Note: This is test shard 1 of 3.
[==========] Running 2 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 2 tests from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/0
2026-09-23T19:49:53Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-09-23T19:49:53Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260923 19:49:53.816550 5695 external_mini_cluster.cc:1372] Running /tmp/dist-test-task5JtCX2/build/asan/bin/kudu
/tmp/dist-test-task5JtCX2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.143.254:37151
--webserver_interface=127.5.143.254
--webserver_port=0
--builtin_ntp_servers=127.5.143.212:38183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.143.254:37151,127.5.143.253:45285,127.5.143.252:45543
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260923 19:49:54.168124 5703 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:49:54.168542 5703 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:49:54.168679 5703 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260923 19:49:54.177186 5703 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:49:54.177337 5703 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:49:54.177443 5703 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:49:54.177534 5703 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:49:54.188894 5703 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.143.212:38183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.5.143.254:37151,127.5.143.253:45285,127.5.143.252:45543
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.143.254:37151
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.143.254
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision faa920b8364ca43fd9d419253dab85c46533dc98
build type FASTDEBUG
built by None at 23 Sep 2026 19:43:25 UTC on bdcb31816ec0
build id 13965
ASAN enabled
I20260923 19:49:54.190733 5703 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:49:54.192739 5703 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260923 19:49:54.201843 5709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:49:54.202309 5708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:49:54.203565 5711 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:49:54.203738 5703 server_base.cc:1061] running on GCE node
I20260923 19:49:54.204558 5703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:49:54.206246 5703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:49:54.207571 5703 hybrid_clock.cc:648] HybridClock initialized: now 1790192994207485 us; error 49 us; skew 500 ppm
I20260923 19:49:54.208176 5703 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:49:54.211081 5703 webserver.cc:533] Webserver started at http://127.5.143.254:39441/ using document root <none> and password file <none>
I20260923 19:49:54.211990 5703 fs_manager.cc:362] Metadata directory not provided
I20260923 19:49:54.212113 5703 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:49:54.212531 5703 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:49:54.215247 5703 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-0/data/instance:
uuid: "6b3d628214a34b4fa3ca0c1abe422bae"
format_stamp: "Formatted at 2026-09-23 19:49:54 on dist-test-slave-th4g"
I20260923 19:49:54.216111 5703 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-0/wal/instance:
uuid: "6b3d628214a34b4fa3ca0c1abe422bae"
format_stamp: "Formatted at 2026-09-23 19:49:54 on dist-test-slave-th4g"
I20260923 19:49:54.222472 5703 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260923 19:49:54.226374 5717 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:49:54.227840 5703 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260923 19:49:54.228029 5703 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-0/data,/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-0/wal
uuid: "6b3d628214a34b4fa3ca0c1abe422bae"
format_stamp: "Formatted at 2026-09-23 19:49:54 on dist-test-slave-th4g"
I20260923 19:49:54.228230 5703 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:49:54.245239 5703 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260923 19:49:54.246752 5703 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:49:54.247324 5703 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:49:54.271517 5703 rpc_server.cc:307] RPC server started. Bound to: 127.5.143.254:37151
I20260923 19:49:54.271539 5768 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.143.254:37151 every 8 connection(s)
I20260923 19:49:54.273559 5703 server_base.cc:1193] Dumped server information to /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-0/data/info.pb
I20260923 19:49:54.274770 5695 external_mini_cluster.cc:1434] Started /tmp/dist-test-task5JtCX2/build/asan/bin/kudu as pid 5703
I20260923 19:49:54.275122 5695 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-0/wal/instance
I20260923 19:49:54.277669 5695 external_mini_cluster.cc:1372] Running /tmp/dist-test-task5JtCX2/build/asan/bin/kudu
/tmp/dist-test-task5JtCX2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.143.253:45285
--webserver_interface=127.5.143.253
--webserver_port=0
--builtin_ntp_servers=127.5.143.212:38183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.143.254:37151,127.5.143.253:45285,127.5.143.252:45543
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260923 19:49:54.278779 5769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:54.286125 5769 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } has no permanent_uuid. Determining permanent_uuid...
I20260923 19:49:54.323148 5769 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } has no permanent_uuid. Determining permanent_uuid...
W20260923 19:49:54.324681 5720 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.143.253:45285: connect: Connection refused (error 111)
W20260923 19:49:54.327144 5769 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.143.253:45285: Network error: Client connection negotiation failed: client connection to 127.5.143.253:45285: connect: Connection refused (error 111)
I20260923 19:49:54.376643 5769 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } attempt: 1
W20260923 19:49:54.379777 5769 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.143.253:45285: Network error: Client connection negotiation failed: client connection to 127.5.143.253:45285: connect: Connection refused (error 111)
I20260923 19:49:54.448292 5769 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } attempt: 2
W20260923 19:49:54.451113 5769 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.143.253:45285: Network error: Client connection negotiation failed: client connection to 127.5.143.253:45285: connect: Connection refused (error 111)
I20260923 19:49:54.542471 5769 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } attempt: 3
W20260923 19:49:54.544834 5769 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.143.253:45285: Network error: Client connection negotiation failed: client connection to 127.5.143.253:45285: connect: Connection refused (error 111)
W20260923 19:49:54.666910 5771 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:49:54.667239 5771 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:49:54.667382 5771 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260923 19:49:54.675902 5771 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:49:54.676002 5771 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:49:54.676055 5771 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:49:54.676173 5771 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:49:54.686825 5771 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.143.212:38183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.5.143.254:37151,127.5.143.253:45285,127.5.143.252:45543
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.143.253:45285
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.5.143.253
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision faa920b8364ca43fd9d419253dab85c46533dc98
build type FASTDEBUG
built by None at 23 Sep 2026 19:43:25 UTC on bdcb31816ec0
build id 13965
ASAN enabled
I20260923 19:49:54.688194 5769 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } attempt: 4
I20260923 19:49:54.688578 5771 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:49:54.690518 5771 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260923 19:49:54.690634 5769 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.143.253:45285: Network error: Client connection negotiation failed: client connection to 127.5.143.253:45285: connect: Connection refused (error 111)
W20260923 19:49:54.699491 5779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:49:54.700457 5780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:49:54.700486 5782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:49:54.700531 5771 server_base.cc:1061] running on GCE node
I20260923 19:49:54.701462 5771 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:49:54.703058 5771 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:49:54.704331 5771 hybrid_clock.cc:648] HybridClock initialized: now 1790192994704278 us; error 48 us; skew 500 ppm
I20260923 19:49:54.704746 5771 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:49:54.707352 5771 webserver.cc:533] Webserver started at http://127.5.143.253:33985/ using document root <none> and password file <none>
I20260923 19:49:54.708133 5771 fs_manager.cc:362] Metadata directory not provided
I20260923 19:49:54.708276 5771 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:49:54.708657 5771 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:49:54.711205 5771 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-1/data/instance:
uuid: "83e97b26500048d0b75350a21a8ff96b"
format_stamp: "Formatted at 2026-09-23 19:49:54 on dist-test-slave-th4g"
I20260923 19:49:54.712004 5771 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-1/wal/instance:
uuid: "83e97b26500048d0b75350a21a8ff96b"
format_stamp: "Formatted at 2026-09-23 19:49:54 on dist-test-slave-th4g"
I20260923 19:49:54.717782 5771 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260923 19:49:54.721469 5788 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:49:54.723183 5771 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260923 19:49:54.723376 5771 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-1/data,/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-1/wal
uuid: "83e97b26500048d0b75350a21a8ff96b"
format_stamp: "Formatted at 2026-09-23 19:49:54 on dist-test-slave-th4g"
I20260923 19:49:54.723609 5771 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:49:54.739133 5771 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260923 19:49:54.740036 5771 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:49:54.740337 5771 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:49:54.765362 5839 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.143.253:45285 every 8 connection(s)
I20260923 19:49:54.765383 5771 rpc_server.cc:307] RPC server started. Bound to: 127.5.143.253:45285
I20260923 19:49:54.767603 5771 server_base.cc:1193] Dumped server information to /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-1/data/info.pb
I20260923 19:49:54.772511 5840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:54.777661 5695 external_mini_cluster.cc:1434] Started /tmp/dist-test-task5JtCX2/build/asan/bin/kudu as pid 5771
I20260923 19:49:54.777957 5695 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-1/wal/instance
I20260923 19:49:54.778684 5840 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } has no permanent_uuid. Determining permanent_uuid...
I20260923 19:49:54.779445 5695 external_mini_cluster.cc:1372] Running /tmp/dist-test-task5JtCX2/build/asan/bin/kudu
/tmp/dist-test-task5JtCX2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.143.252:45543
--webserver_interface=127.5.143.252
--webserver_port=0
--builtin_ntp_servers=127.5.143.212:38183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.143.254:37151,127.5.143.253:45285,127.5.143.252:45543
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260923 19:49:54.795308 5840 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } has no permanent_uuid. Determining permanent_uuid...
I20260923 19:49:54.810493 5840 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } has no permanent_uuid. Determining permanent_uuid...
W20260923 19:49:54.812172 5791 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.143.252:45543: connect: Connection refused (error 111)
W20260923 19:49:54.814684 5840 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.143.252:45543: Network error: Client connection negotiation failed: client connection to 127.5.143.252:45543: connect: Connection refused (error 111)
I20260923 19:49:54.864122 5840 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } attempt: 1
W20260923 19:49:54.866523 5840 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.143.252:45543: Network error: Client connection negotiation failed: client connection to 127.5.143.252:45543: connect: Connection refused (error 111)
I20260923 19:49:54.934917 5840 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } attempt: 2
W20260923 19:49:54.937160 5840 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.143.252:45543: Network error: Client connection negotiation failed: client connection to 127.5.143.252:45543: connect: Connection refused (error 111)
I20260923 19:49:54.990028 5769 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } attempt: 5
I20260923 19:49:54.998808 5769 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } has no permanent_uuid. Determining permanent_uuid...
W20260923 19:49:55.001552 5769 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.143.252:45543: Network error: Client connection negotiation failed: client connection to 127.5.143.252:45543: connect: Connection refused (error 111)
I20260923 19:49:55.028481 5840 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } attempt: 3
W20260923 19:49:55.031527 5840 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.143.252:45543: Network error: Client connection negotiation failed: client connection to 127.5.143.252:45543: connect: Connection refused (error 111)
I20260923 19:49:55.052850 5769 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } attempt: 1
W20260923 19:49:55.055365 5769 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.143.252:45543: Network error: Client connection negotiation failed: client connection to 127.5.143.252:45543: connect: Connection refused (error 111)
I20260923 19:49:55.123610 5769 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } attempt: 2
W20260923 19:49:55.126207 5769 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.143.252:45543: Network error: Client connection negotiation failed: client connection to 127.5.143.252:45543: connect: Connection refused (error 111)
W20260923 19:49:55.161119 5842 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:49:55.161546 5842 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:49:55.161697 5842 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260923 19:49:55.171161 5842 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:49:55.171321 5842 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:49:55.171439 5842 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:49:55.171532 5842 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:49:55.174820 5840 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } attempt: 4
W20260923 19:49:55.177624 5840 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.143.252:45543: Network error: Client connection negotiation failed: client connection to 127.5.143.252:45543: connect: Connection refused (error 111)
I20260923 19:49:55.184410 5842 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.143.212:38183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.5.143.254:37151,127.5.143.253:45285,127.5.143.252:45543
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.143.252:45543
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.5.143.252
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision faa920b8364ca43fd9d419253dab85c46533dc98
build type FASTDEBUG
built by None at 23 Sep 2026 19:43:25 UTC on bdcb31816ec0
build id 13965
ASAN enabled
I20260923 19:49:55.186200 5842 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:49:55.187992 5842 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260923 19:49:55.197240 5850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:49:55.197429 5851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:49:55.197685 5853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:49:55.198728 5842 server_base.cc:1061] running on GCE node
I20260923 19:49:55.200444 5842 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:49:55.202127 5842 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:49:55.203401 5842 hybrid_clock.cc:648] HybridClock initialized: now 1790192995203371 us; error 48 us; skew 500 ppm
I20260923 19:49:55.203926 5842 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:49:55.206614 5842 webserver.cc:533] Webserver started at http://127.5.143.252:46305/ using document root <none> and password file <none>
I20260923 19:49:55.207432 5842 fs_manager.cc:362] Metadata directory not provided
I20260923 19:49:55.207585 5842 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:49:55.207976 5842 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:49:55.210613 5842 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-2/data/instance:
uuid: "009ffee03a4d41db84df9f450aa84562"
format_stamp: "Formatted at 2026-09-23 19:49:55 on dist-test-slave-th4g"
I20260923 19:49:55.211472 5842 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-2/wal/instance:
uuid: "009ffee03a4d41db84df9f450aa84562"
format_stamp: "Formatted at 2026-09-23 19:49:55 on dist-test-slave-th4g"
I20260923 19:49:55.217722 5842 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260923 19:49:55.222292 5859 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:49:55.223781 5842 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260923 19:49:55.223981 5842 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-2/data,/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-2/wal
uuid: "009ffee03a4d41db84df9f450aa84562"
format_stamp: "Formatted at 2026-09-23 19:49:55 on dist-test-slave-th4g"
I20260923 19:49:55.224207 5842 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:49:55.232540 5769 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } attempt: 3
W20260923 19:49:55.234790 5769 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.5.143.252:45543: Network error: Client connection negotiation failed: client connection to 127.5.143.252:45543: connect: Connection refused (error 111)
I20260923 19:49:55.249058 5842 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260923 19:49:55.250012 5842 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:49:55.250273 5842 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:49:55.276638 5842 rpc_server.cc:307] RPC server started. Bound to: 127.5.143.252:45543
I20260923 19:49:55.276614 5910 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.143.252:45543 every 8 connection(s)
I20260923 19:49:55.278357 5842 server_base.cc:1193] Dumped server information to /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-2/data/info.pb
I20260923 19:49:55.282392 5695 external_mini_cluster.cc:1434] Started /tmp/dist-test-task5JtCX2/build/asan/bin/kudu as pid 5842
I20260923 19:49:55.282585 5695 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-2/wal/instance
I20260923 19:49:55.283695 5911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:55.291647 5911 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } has no permanent_uuid. Determining permanent_uuid...
I20260923 19:49:55.309353 5911 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } has no permanent_uuid. Determining permanent_uuid...
I20260923 19:49:55.319047 5911 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } has no permanent_uuid. Determining permanent_uuid...
I20260923 19:49:55.333038 5911 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562: Bootstrap starting.
I20260923 19:49:55.336850 5911 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:55.338009 5911 log.cc:826] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562: Log is configured to *not* fsync() on all Append() calls
I20260923 19:49:55.341198 5911 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562: No bootstrap required, opened a new log
I20260923 19:49:55.346639 5911 raft_consensus.cc:359] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } }
I20260923 19:49:55.346949 5911 raft_consensus.cc:385] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:55.347093 5911 raft_consensus.cc:740] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 009ffee03a4d41db84df9f450aa84562, State: Initialized, Role: FOLLOWER
I20260923 19:49:55.348474 5911 consensus_queue.cc:260] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } }
I20260923 19:49:55.349515 5920 sys_catalog.cc:455] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } } }
I20260923 19:49:55.349848 5920 sys_catalog.cc:458] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:49:55.350610 5911 sys_catalog.cc:565] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [sys.catalog]: configured and running, proceeding with master startup.
W20260923 19:49:55.362044 5931 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 19:49:55.362226 5931 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 19:49:55.359217 5842 master_runner.cc:187] Error getting master registration for 127.5.143.254:37151: OK, instance_id { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" instance_seqno: 1790192994265113 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260923 19:49:55.367799 5842 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260923 19:49:55.412120 5769 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } attempt: 4
I20260923 19:49:55.425208 5769 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae: Bootstrap starting.
I20260923 19:49:55.428656 5769 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:55.430377 5769 log.cc:826] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae: Log is configured to *not* fsync() on all Append() calls
I20260923 19:49:55.434612 5769 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae: No bootstrap required, opened a new log
I20260923 19:49:55.439826 5769 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } }
I20260923 19:49:55.440104 5769 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:55.440269 5769 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3d628214a34b4fa3ca0c1abe422bae, State: Initialized, Role: FOLLOWER
I20260923 19:49:55.440924 5769 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } }
I20260923 19:49:55.441967 5934 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } } }
I20260923 19:49:55.442243 5934 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:49:55.443094 5769 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [sys.catalog]: configured and running, proceeding with master startup.
W20260923 19:49:55.454672 5945 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 19:49:55.454813 5945 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 19:49:55.454447 5703 master_runner.cc:187] Error getting master registration for 127.5.143.253:45285: OK, instance_id { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" instance_seqno: 1790192994757842 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260923 19:49:55.462071 5703 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260923 19:49:55.476903 5840 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } attempt: 5
I20260923 19:49:55.494215 5840 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Bootstrap starting.
I20260923 19:49:55.498656 5840 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:55.500531 5840 log.cc:826] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Log is configured to *not* fsync() on all Append() calls
W20260923 19:49:55.500931 5723 tablet.cc:2433] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 19:49:55.502440 5865 tablet.cc:2433] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:49:55.506096 5840 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: No bootstrap required, opened a new log
I20260923 19:49:55.513137 5934 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:49:55.513418 5934 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } }
I20260923 19:49:55.515264 5934 leader_election.cc:290] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83e97b26500048d0b75350a21a8ff96b (127.5.143.253:45285), 009ffee03a4d41db84df9f450aa84562 (127.5.143.252:45543)
I20260923 19:49:55.515727 5840 raft_consensus.cc:359] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } }
I20260923 19:49:55.516068 5840 raft_consensus.cc:385] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:55.516198 5840 raft_consensus.cc:740] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83e97b26500048d0b75350a21a8ff96b, State: Initialized, Role: FOLLOWER
I20260923 19:49:55.516987 5840 consensus_queue.cc:260] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } }
I20260923 19:49:55.517360 5886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "009ffee03a4d41db84df9f450aa84562" is_pre_election: true
I20260923 19:49:55.517944 5886 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b3d628214a34b4fa3ca0c1abe422bae in term 0.
I20260923 19:49:55.518947 5720 leader_election.cc:304] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 009ffee03a4d41db84df9f450aa84562, 6b3d628214a34b4fa3ca0c1abe422bae; no voters:
I20260923 19:49:55.519552 5934 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:49:55.519691 5934 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:49:55.519785 5934 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:49:55.524319 5948 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } } }
I20260923 19:49:55.524963 5948 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:49:55.525254 5934 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } }
I20260923 19:49:55.527043 5815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83e97b26500048d0b75350a21a8ff96b" is_pre_election: true
I20260923 19:49:55.527138 5814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83e97b26500048d0b75350a21a8ff96b"
I20260923 19:49:55.527534 5814 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:49:55.531819 5814 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3d628214a34b4fa3ca0c1abe422bae in term 1.
I20260923 19:49:55.531858 5886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "009ffee03a4d41db84df9f450aa84562"
I20260923 19:49:55.532102 5886 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:49:55.534993 5840 sys_catalog.cc:565] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:49:55.536825 5886 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b3d628214a34b4fa3ca0c1abe422bae in term 1.
I20260923 19:49:55.537205 5720 leader_election.cc:304] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3d628214a34b4fa3ca0c1abe422bae, 83e97b26500048d0b75350a21a8ff96b; no voters:
I20260923 19:49:55.541793 5934 leader_election.cc:290] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [CANDIDATE]: Term 1 election: Requested vote from peers 83e97b26500048d0b75350a21a8ff96b (127.5.143.253:45285), 009ffee03a4d41db84df9f450aa84562 (127.5.143.252:45543)
I20260923 19:49:55.542384 5934 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:49:55.542868 5934 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 1 LEADER]: Becoming Leader. State: Replica: 6b3d628214a34b4fa3ca0c1abe422bae, State: Running, Role: LEADER
I20260923 19:49:55.543620 5934 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } }
I20260923 19:49:55.556818 5934 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6b3d628214a34b4fa3ca0c1abe422bae. Latest consensus state: current_term: 1 leader_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } } }
I20260923 19:49:55.561820 5934 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [sys.catalog]: This master's current role is: LEADER
I20260923 19:49:55.569988 5955 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260923 19:49:55.572538 5955 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260923 19:49:55.587184 5886 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [term 1 FOLLOWER]: Refusing update from remote peer 6b3d628214a34b4fa3ca0c1abe422bae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:49:55.587671 5814 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [term 1 FOLLOWER]: Refusing update from remote peer 6b3d628214a34b4fa3ca0c1abe422bae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:49:55.588470 5934 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [LEADER]: Connected to new peer: Peer: permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:49:55.589155 5934 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [LEADER]: Connected to new peer: Peer: permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:49:55.623739 5920 sys_catalog.cc:455] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6b3d628214a34b4fa3ca0c1abe422bae. Latest consensus state: current_term: 1 leader_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } } }
I20260923 19:49:55.624019 5920 sys_catalog.cc:458] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:49:55.626461 5948 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6b3d628214a34b4fa3ca0c1abe422bae. Latest consensus state: current_term: 1 leader_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } } }
I20260923 19:49:55.626734 5948 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:49:55.629326 5959 mvcc.cc:204] Tried to move back new op lower bound from 7332630509908578304 to 7332630509759778816. Current Snapshot: MvccSnapshot[applied={T|T < 7332630509908578304}]
I20260923 19:49:55.638536 5920 sys_catalog.cc:455] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } } }
I20260923 19:49:55.638785 5920 sys_catalog.cc:458] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:49:55.651124 5948 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } } }
I20260923 19:49:55.651376 5948 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:49:55.656402 5934 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } } }
I20260923 19:49:55.656895 5934 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [sys.catalog]: This master's current role is: LEADER
I20260923 19:49:55.657377 5934 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } } }
I20260923 19:49:55.657562 5934 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [sys.catalog]: This master's current role is: LEADER
I20260923 19:49:55.660661 5955 catalog_manager.cc:1396] Generated new cluster ID: bb53aae1ed8841f4b400598d36bb10de
I20260923 19:49:55.660784 5955 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260923 19:49:55.661229 5969 catalog_manager.cc:818] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260923 19:49:55.690868 5955 catalog_manager.cc:1419] Generated new certificate authority record
I20260923 19:49:55.692529 5955 catalog_manager.cc:1553] Loading token signing keys...
I20260923 19:49:55.723618 5955 catalog_manager.cc:6219] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae: Generated new TSK 0
I20260923 19:49:55.725286 5955 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260923 19:49:55.742776 5695 external_mini_cluster.cc:1372] Running /tmp/dist-test-task5JtCX2/build/asan/bin/kudu
/tmp/dist-test-task5JtCX2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.143.193:0
--local_ip_for_outbound_sockets=127.5.143.193
--webserver_interface=127.5.143.193
--webserver_port=0
--tserver_master_addrs=127.5.143.254:37151,127.5.143.253:45285,127.5.143.252:45543
--builtin_ntp_servers=127.5.143.212:38183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260923 19:49:56.222679 5975 raft_consensus.cc:493] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3d628214a34b4fa3ca0c1abe422bae)
I20260923 19:49:56.222909 5975 raft_consensus.cc:515] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } }
I20260923 19:49:56.224215 5975 leader_election.cc:290] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b3d628214a34b4fa3ca0c1abe422bae (127.5.143.254:37151), 009ffee03a4d41db84df9f450aa84562 (127.5.143.252:45543)
I20260923 19:49:56.224843 5886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "83e97b26500048d0b75350a21a8ff96b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "009ffee03a4d41db84df9f450aa84562" is_pre_election: true
I20260923 19:49:56.224901 5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "83e97b26500048d0b75350a21a8ff96b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" is_pre_election: true
I20260923 19:49:56.225745 5790 leader_election.cc:304] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83e97b26500048d0b75350a21a8ff96b; no voters: 009ffee03a4d41db84df9f450aa84562, 6b3d628214a34b4fa3ca0c1abe422bae
I20260923 19:49:56.226212 5975 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 19:49:56.230140 5977 raft_consensus.cc:493] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b3d628214a34b4fa3ca0c1abe422bae)
I20260923 19:49:56.230389 5977 raft_consensus.cc:515] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } }
I20260923 19:49:56.231874 5977 leader_election.cc:290] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b3d628214a34b4fa3ca0c1abe422bae (127.5.143.254:37151), 83e97b26500048d0b75350a21a8ff96b (127.5.143.253:45285)
I20260923 19:49:56.232446 5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "009ffee03a4d41db84df9f450aa84562" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" is_pre_election: true
I20260923 19:49:56.232467 5814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "009ffee03a4d41db84df9f450aa84562" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83e97b26500048d0b75350a21a8ff96b" is_pre_election: true
I20260923 19:49:56.232679 5814 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 009ffee03a4d41db84df9f450aa84562 in term 1.
I20260923 19:49:56.233201 5861 leader_election.cc:304] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 009ffee03a4d41db84df9f450aa84562, 83e97b26500048d0b75350a21a8ff96b; no voters: 6b3d628214a34b4fa3ca0c1abe422bae
I20260923 19:49:56.233846 5977 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260923 19:49:56.233985 5977 raft_consensus.cc:493] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b3d628214a34b4fa3ca0c1abe422bae)
I20260923 19:49:56.234097 5977 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [term 1 FOLLOWER]: Advancing to term 2
W20260923 19:49:56.234305 5972 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:49:56.234684 5972 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:49:56.234830 5972 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260923 19:49:56.237114 5977 raft_consensus.cc:515] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } }
I20260923 19:49:56.237895 5977 leader_election.cc:290] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [CANDIDATE]: Term 2 election: Requested vote from peers 6b3d628214a34b4fa3ca0c1abe422bae (127.5.143.254:37151), 83e97b26500048d0b75350a21a8ff96b (127.5.143.253:45285)
I20260923 19:49:56.238466 5814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "009ffee03a4d41db84df9f450aa84562" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "83e97b26500048d0b75350a21a8ff96b"
I20260923 19:49:56.238672 5814 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [term 1 FOLLOWER]: Advancing to term 2
I20260923 19:49:56.241770 5814 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 009ffee03a4d41db84df9f450aa84562 in term 2.
I20260923 19:49:56.242174 5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "009ffee03a4d41db84df9f450aa84562" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6b3d628214a34b4fa3ca0c1abe422bae"
I20260923 19:49:56.242408 5862 leader_election.cc:304] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 009ffee03a4d41db84df9f450aa84562, 83e97b26500048d0b75350a21a8ff96b; no voters:
I20260923 19:49:56.243027 5977 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [term 2 FOLLOWER]: Leader election won for term 2
I20260923 19:49:56.243459 5977 raft_consensus.cc:697] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [term 2 LEADER]: Becoming Leader. State: Replica: 009ffee03a4d41db84df9f450aa84562, State: Running, Role: LEADER
I20260923 19:49:56.243996 5977 consensus_queue.cc:237] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } }
I20260923 19:49:56.246237 5978 sys_catalog.cc:455] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 009ffee03a4d41db84df9f450aa84562. Latest consensus state: current_term: 2 leader_uuid: "009ffee03a4d41db84df9f450aa84562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } } }
I20260923 19:49:56.246498 5978 sys_catalog.cc:458] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [sys.catalog]: This master's current role is: LEADER
I20260923 19:49:56.247200 5979 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
W20260923 19:49:56.247921 5972 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:49:56.248136 5972 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.143.193
I20260923 19:49:56.249754 5979 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260923 19:49:56.250736 5979 catalog_manager.cc:1308] Loaded cluster ID: bb53aae1ed8841f4b400598d36bb10de
I20260923 19:49:56.250813 5979 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260923 19:49:56.253652 5979 catalog_manager.cc:1553] Loading token signing keys...
I20260923 19:49:56.255386 5979 catalog_manager.cc:6230] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562: Loaded TSK: 0
I20260923 19:49:56.256690 5979 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260923 19:49:56.259902 5972 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.143.212:38183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.143.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.143.193
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.5.143.254:37151,127.5.143.253:45285,127.5.143.252:45543
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.143.193
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision faa920b8364ca43fd9d419253dab85c46533dc98
build type FASTDEBUG
built by None at 23 Sep 2026 19:43:25 UTC on bdcb31816ec0
build id 13965
ASAN enabled
I20260923 19:49:56.261507 5972 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:49:56.263350 5972 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260923 19:49:56.267603 5886 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [term 2 LEADER]: Rejecting Update request from peer 6b3d628214a34b4fa3ca0c1abe422bae for earlier term 1. Current term is 2. Ops: []
I20260923 19:49:56.268285 5980 consensus_queue.cc:1059] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260923 19:49:56.268760 5980 consensus_queue.cc:1243] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [LEADER]: Peer 009ffee03a4d41db84df9f450aa84562 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260923 19:49:56.268905 5981 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 1 LEADER]: Stepping down as leader of term 1
I20260923 19:49:56.269014 5981 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b3d628214a34b4fa3ca0c1abe422bae, State: Running, Role: LEADER
I20260923 19:49:56.269397 5981 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } }
I20260923 19:49:56.269938 5981 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 1 FOLLOWER]: Advancing to term 2
W20260923 19:49:56.274317 5983 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:49:56.278779 5984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:49:56.279698 5986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:49:56.280965 5972 server_base.cc:1061] running on GCE node
I20260923 19:49:56.281756 5972 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:49:56.282961 5972 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:49:56.284199 5972 hybrid_clock.cc:648] HybridClock initialized: now 1790192996284125 us; error 65 us; skew 500 ppm
I20260923 19:49:56.284554 5972 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:49:56.287505 5972 webserver.cc:533] Webserver started at http://127.5.143.193:32915/ using document root <none> and password file <none>
I20260923 19:49:56.288326 5972 fs_manager.cc:362] Metadata directory not provided
I20260923 19:49:56.288460 5972 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:49:56.288856 5972 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:49:56.291499 5972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/data/instance:
uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
format_stamp: "Formatted at 2026-09-23 19:49:56 on dist-test-slave-th4g"
I20260923 19:49:56.292317 5972 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/instance:
uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
format_stamp: "Formatted at 2026-09-23 19:49:56 on dist-test-slave-th4g"
I20260923 19:49:56.298056 5972 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260923 19:49:56.301614 5992 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:49:56.303190 5972 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 19:49:56.303344 5972 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/data,/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal
uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
format_stamp: "Formatted at 2026-09-23 19:49:56 on dist-test-slave-th4g"
I20260923 19:49:56.303516 5972 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:49:56.324256 5972 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260923 19:49:56.325119 5972 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:49:56.325378 5972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:49:56.326418 5972 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260923 19:49:56.328248 5972 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:49:56.328337 5972 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:49:56.328897 5972 ts_tablet_manager.cc:616] Registered 0 tablets
I20260923 19:49:56.328981 5972 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260923 19:49:56.370885 5972 rpc_server.cc:307] RPC server started. Bound to: 127.5.143.193:39887
I20260923 19:49:56.371063 6104 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.143.193:39887 every 8 connection(s)
I20260923 19:49:56.372382 5972 server_base.cc:1193] Dumped server information to /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/data/info.pb
I20260923 19:49:56.378698 5695 external_mini_cluster.cc:1434] Started /tmp/dist-test-task5JtCX2/build/asan/bin/kudu as pid 5972
I20260923 19:49:56.379009 5695 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/instance
I20260923 19:49:56.399454 5695 external_mini_cluster.cc:1372] Running /tmp/dist-test-task5JtCX2/build/asan/bin/kudu
/tmp/dist-test-task5JtCX2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.143.194:0
--local_ip_for_outbound_sockets=127.5.143.194
--webserver_interface=127.5.143.194
--webserver_port=0
--tserver_master_addrs=127.5.143.254:37151,127.5.143.253:45285,127.5.143.252:45543
--builtin_ntp_servers=127.5.143.212:38183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260923 19:49:56.409088 6106 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
I20260923 19:49:56.409708 6106 heartbeater.cc:461] Registering TS with master...
I20260923 19:49:56.410791 6105 heartbeater.cc:344] Connected to a master server at 127.5.143.252:45543
I20260923 19:49:56.410915 6105 heartbeater.cc:461] Registering TS with master...
I20260923 19:49:56.410993 6106 heartbeater.cc:507] Master 127.5.143.254:37151 requested a full tablet report, sending...
I20260923 19:49:56.411478 6105 heartbeater.cc:507] Master 127.5.143.252:45543 requested a full tablet report, sending...
I20260923 19:49:56.413538 5876 ts_manager.cc:194] Registered new tserver with Master: e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:49:56.413538 5734 ts_manager.cc:194] Registered new tserver with Master: e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:49:56.415326 5876 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.5.143.193:36433
I20260923 19:49:56.418274 6107 heartbeater.cc:344] Connected to a master server at 127.5.143.253:45285
I20260923 19:49:56.418468 6107 heartbeater.cc:461] Registering TS with master...
I20260923 19:49:56.418911 6107 heartbeater.cc:507] Master 127.5.143.253:45285 requested a full tablet report, sending...
I20260923 19:49:56.421126 5805 ts_manager.cc:194] Registered new tserver with Master: e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:49:56.457805 5945 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260923 19:49:56.645968 5744 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 2 FOLLOWER]: Refusing update from remote peer 009ffee03a4d41db84df9f450aa84562: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260923 19:49:56.646836 5978 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260923 19:49:56.648746 5981 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 009ffee03a4d41db84df9f450aa84562. Latest consensus state: current_term: 2 leader_uuid: "009ffee03a4d41db84df9f450aa84562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } } }
I20260923 19:49:56.649004 5981 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:49:56.650811 5814 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [term 2 FOLLOWER]: Refusing update from remote peer 009ffee03a4d41db84df9f450aa84562: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260923 19:49:56.651706 5977 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260923 19:49:56.662076 5981 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "009ffee03a4d41db84df9f450aa84562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } } }
I20260923 19:49:56.662343 5981 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:49:56.666117 5978 sys_catalog.cc:455] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "009ffee03a4d41db84df9f450aa84562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } } }
I20260923 19:49:56.666463 5978 sys_catalog.cc:458] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [sys.catalog]: This master's current role is: LEADER
I20260923 19:49:56.666509 6120 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "009ffee03a4d41db84df9f450aa84562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } } }
I20260923 19:49:56.666767 6120 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:49:56.668924 5975 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 009ffee03a4d41db84df9f450aa84562. Latest consensus state: current_term: 2 leader_uuid: "009ffee03a4d41db84df9f450aa84562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } } }
I20260923 19:49:56.669150 5975 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:49:56.673020 5969 catalog_manager.cc:1308] Loaded cluster ID: bb53aae1ed8841f4b400598d36bb10de
I20260923 19:49:56.673225 5969 catalog_manager.cc:1601] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: loading cluster ID for follower catalog manager: success
I20260923 19:49:56.677680 5969 catalog_manager.cc:1623] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: acquiring CA information for follower catalog manager: success
I20260923 19:49:56.680619 5969 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260923 19:49:56.783993 6115 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:49:56.784351 6115 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:49:56.784533 6115 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260923 19:49:56.793146 6115 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:49:56.793386 6115 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.143.194
I20260923 19:49:56.805011 6115 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.143.212:38183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.143.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.143.194
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.5.143.254:37151,127.5.143.253:45285,127.5.143.252:45543
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.143.194
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision faa920b8364ca43fd9d419253dab85c46533dc98
build type FASTDEBUG
built by None at 23 Sep 2026 19:43:25 UTC on bdcb31816ec0
build id 13965
ASAN enabled
I20260923 19:49:56.806710 6115 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:49:56.808463 6115 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260923 19:49:56.818265 6126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:49:56.819895 6129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:49:56.819891 6127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:49:56.820752 6115 server_base.cc:1061] running on GCE node
I20260923 19:49:56.821311 6115 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:49:56.822296 6115 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:49:56.823557 6115 hybrid_clock.cc:648] HybridClock initialized: now 1790192996823517 us; error 36 us; skew 500 ppm
I20260923 19:49:56.823863 6115 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:49:56.826664 6115 webserver.cc:533] Webserver started at http://127.5.143.194:46461/ using document root <none> and password file <none>
I20260923 19:49:56.827430 6115 fs_manager.cc:362] Metadata directory not provided
I20260923 19:49:56.827567 6115 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:49:56.827929 6115 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:49:56.830634 6115 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/data/instance:
uuid: "61022dd7f2f14dc19aebe3af5f08f430"
format_stamp: "Formatted at 2026-09-23 19:49:56 on dist-test-slave-th4g"
I20260923 19:49:56.831408 6115 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/instance:
uuid: "61022dd7f2f14dc19aebe3af5f08f430"
format_stamp: "Formatted at 2026-09-23 19:49:56 on dist-test-slave-th4g"
I20260923 19:49:56.837038 6115 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260923 19:49:56.840638 6135 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:49:56.842144 6115 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260923 19:49:56.842327 6115 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/data,/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal
uuid: "61022dd7f2f14dc19aebe3af5f08f430"
format_stamp: "Formatted at 2026-09-23 19:49:56 on dist-test-slave-th4g"
I20260923 19:49:56.842940 6115 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:49:56.861449 6115 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260923 19:49:56.862444 6115 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:49:56.862733 6115 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:49:56.863709 6115 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260923 19:49:56.865545 6115 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:49:56.865669 6115 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:49:56.865809 6115 ts_tablet_manager.cc:616] Registered 0 tablets
I20260923 19:49:56.865914 6115 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:49:56.918404 6115 rpc_server.cc:307] RPC server started. Bound to: 127.5.143.194:35295
I20260923 19:49:56.918423 6247 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.143.194:35295 every 8 connection(s)
I20260923 19:49:56.919018 6105 heartbeater.cc:499] Master 127.5.143.252:45543 was elected leader, sending a full tablet report...
I20260923 19:49:56.920295 6115 server_base.cc:1193] Dumped server information to /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/data/info.pb
I20260923 19:49:56.928563 5695 external_mini_cluster.cc:1434] Started /tmp/dist-test-task5JtCX2/build/asan/bin/kudu as pid 6115
I20260923 19:49:56.928802 5695 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/instance
I20260923 19:49:56.943904 5695 external_mini_cluster.cc:1372] Running /tmp/dist-test-task5JtCX2/build/asan/bin/kudu
/tmp/dist-test-task5JtCX2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.143.195:0
--local_ip_for_outbound_sockets=127.5.143.195
--webserver_interface=127.5.143.195
--webserver_port=0
--tserver_master_addrs=127.5.143.254:37151,127.5.143.253:45285,127.5.143.252:45543
--builtin_ntp_servers=127.5.143.212:38183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260923 19:49:56.966849 6249 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
I20260923 19:49:56.967315 6249 heartbeater.cc:461] Registering TS with master...
I20260923 19:49:56.968588 6249 heartbeater.cc:507] Master 127.5.143.254:37151 requested a full tablet report, sending...
I20260923 19:49:56.970256 6248 heartbeater.cc:344] Connected to a master server at 127.5.143.252:45543
I20260923 19:49:56.970402 6248 heartbeater.cc:461] Registering TS with master...
I20260923 19:49:56.970485 5734 ts_manager.cc:194] Registered new tserver with Master: 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:49:56.970907 6248 heartbeater.cc:507] Master 127.5.143.252:45543 requested a full tablet report, sending...
I20260923 19:49:56.972054 5876 ts_manager.cc:194] Registered new tserver with Master: 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:49:56.973289 5876 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.5.143.194:60131
I20260923 19:49:56.978791 6254 heartbeater.cc:344] Connected to a master server at 127.5.143.253:45285
I20260923 19:49:56.978962 6254 heartbeater.cc:461] Registering TS with master...
I20260923 19:49:56.979389 6254 heartbeater.cc:507] Master 127.5.143.253:45285 requested a full tablet report, sending...
I20260923 19:49:56.980777 5805 ts_manager.cc:194] Registered new tserver with Master: 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:49:57.153443 5981 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 009ffee03a4d41db84df9f450aa84562)
I20260923 19:49:57.153638 5975 raft_consensus.cc:493] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 009ffee03a4d41db84df9f450aa84562)
I20260923 19:49:57.153663 5981 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } }
I20260923 19:49:57.153820 5975 raft_consensus.cc:515] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } }
I20260923 19:49:57.154403 5981 leader_election.cc:290] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 83e97b26500048d0b75350a21a8ff96b (127.5.143.253:45285), 009ffee03a4d41db84df9f450aa84562 (127.5.143.252:45543)
I20260923 19:49:57.154582 5975 leader_election.cc:290] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b3d628214a34b4fa3ca0c1abe422bae (127.5.143.254:37151), 009ffee03a4d41db84df9f450aa84562 (127.5.143.252:45543)
I20260923 19:49:57.155380 5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "83e97b26500048d0b75350a21a8ff96b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" is_pre_election: true
I20260923 19:49:57.155588 5744 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83e97b26500048d0b75350a21a8ff96b in term 2.
I20260923 19:49:57.155561 5886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "83e97b26500048d0b75350a21a8ff96b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "009ffee03a4d41db84df9f450aa84562" is_pre_election: true
I20260923 19:49:57.156222 5790 leader_election.cc:304] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b3d628214a34b4fa3ca0c1abe422bae, 83e97b26500048d0b75350a21a8ff96b; no voters:
I20260923 19:49:57.156260 5886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "009ffee03a4d41db84df9f450aa84562" is_pre_election: true
I20260923 19:49:57.156950 5975 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260923 19:49:57.157073 5975 raft_consensus.cc:493] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 009ffee03a4d41db84df9f450aa84562)
I20260923 19:49:57.157179 5975 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [term 2 FOLLOWER]: Advancing to term 3
I20260923 19:49:57.157145 5814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "83e97b26500048d0b75350a21a8ff96b" is_pre_election: true
I20260923 19:49:57.160305 5975 raft_consensus.cc:515] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } }
I20260923 19:49:57.160770 5814 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b3d628214a34b4fa3ca0c1abe422bae in current term 3: Already voted for candidate 83e97b26500048d0b75350a21a8ff96b in this term.
I20260923 19:49:57.161474 5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "83e97b26500048d0b75350a21a8ff96b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6b3d628214a34b4fa3ca0c1abe422bae"
I20260923 19:49:57.161695 5744 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 2 FOLLOWER]: Advancing to term 3
I20260923 19:49:57.161744 5720 leader_election.cc:304] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3d628214a34b4fa3ca0c1abe422bae; no voters: 009ffee03a4d41db84df9f450aa84562, 83e97b26500048d0b75350a21a8ff96b
I20260923 19:49:57.162129 5975 leader_election.cc:290] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [CANDIDATE]: Term 3 election: Requested vote from peers 6b3d628214a34b4fa3ca0c1abe422bae (127.5.143.254:37151), 009ffee03a4d41db84df9f450aa84562 (127.5.143.252:45543)
I20260923 19:49:57.162284 5886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "83e97b26500048d0b75350a21a8ff96b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "009ffee03a4d41db84df9f450aa84562"
I20260923 19:49:57.164191 5744 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83e97b26500048d0b75350a21a8ff96b in term 3.
I20260923 19:49:57.164367 5981 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260923 19:49:57.164682 5790 leader_election.cc:304] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b3d628214a34b4fa3ca0c1abe422bae, 83e97b26500048d0b75350a21a8ff96b; no voters: 009ffee03a4d41db84df9f450aa84562
I20260923 19:49:57.165020 5975 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [term 3 FOLLOWER]: Leader election won for term 3
I20260923 19:49:57.165167 5975 raft_consensus.cc:697] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [term 3 LEADER]: Becoming Leader. State: Replica: 83e97b26500048d0b75350a21a8ff96b, State: Running, Role: LEADER
I20260923 19:49:57.165551 5975 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } }
I20260923 19:49:57.167291 6120 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83e97b26500048d0b75350a21a8ff96b. Latest consensus state: current_term: 3 leader_uuid: "83e97b26500048d0b75350a21a8ff96b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } } }
I20260923 19:49:57.167474 6120 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [sys.catalog]: This master's current role is: LEADER
I20260923 19:49:57.168028 6259 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260923 19:49:57.170326 6259 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260923 19:49:57.171116 6259 catalog_manager.cc:1308] Loaded cluster ID: bb53aae1ed8841f4b400598d36bb10de
I20260923 19:49:57.171182 6259 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260923 19:49:57.172214 6259 catalog_manager.cc:1553] Loading token signing keys...
I20260923 19:49:57.172984 6259 catalog_manager.cc:6230] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Loaded TSK: 0
I20260923 19:49:57.173766 6259 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260923 19:49:57.178685 6261 sys_catalog.cc:455] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "009ffee03a4d41db84df9f450aa84562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } } }
I20260923 19:49:57.178946 6261 sys_catalog.cc:458] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [sys.catalog]: This master's current role is: LEADER
I20260923 19:49:57.179447 5814 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [term 3 LEADER]: Rejecting Update request from peer 009ffee03a4d41db84df9f450aa84562 for earlier term 2. Current term is 3. Ops: []
I20260923 19:49:57.180186 6261 consensus_queue.cc:1059] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260923 19:49:57.180477 6261 consensus_queue.cc:1243] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [LEADER]: Peer 83e97b26500048d0b75350a21a8ff96b log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260923 19:49:57.180701 6260 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [term 2 LEADER]: Stepping down as leader of term 2
I20260923 19:49:57.180811 6260 raft_consensus.cc:740] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 009ffee03a4d41db84df9f450aa84562, State: Running, Role: LEADER
I20260923 19:49:57.181169 6260 consensus_queue.cc:260] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } }
I20260923 19:49:57.181691 6260 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [term 2 FOLLOWER]: Advancing to term 3
W20260923 19:49:57.336668 6258 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:49:57.336966 6258 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:49:57.337054 6258 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260923 19:49:57.346261 6258 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:49:57.346432 6258 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.143.195
I20260923 19:49:57.357424 6258 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.143.212:38183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.143.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.143.195
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.5.143.254:37151,127.5.143.253:45285,127.5.143.252:45543
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.143.195
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision faa920b8364ca43fd9d419253dab85c46533dc98
build type FASTDEBUG
built by None at 23 Sep 2026 19:43:25 UTC on bdcb31816ec0
build id 13965
ASAN enabled
I20260923 19:49:57.359022 6258 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:49:57.360745 6258 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260923 19:49:57.364323 5931 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260923 19:49:57.371214 6271 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:49:57.371238 6269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:49:57.371157 6268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:49:57.373500 6258 server_base.cc:1061] running on GCE node
I20260923 19:49:57.374184 6258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:49:57.375130 6258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:49:57.376380 6258 hybrid_clock.cc:648] HybridClock initialized: now 1790192997376318 us; error 53 us; skew 500 ppm
I20260923 19:49:57.376720 6258 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:49:57.378930 6258 webserver.cc:533] Webserver started at http://127.5.143.195:43993/ using document root <none> and password file <none>
I20260923 19:49:57.379673 6258 fs_manager.cc:362] Metadata directory not provided
I20260923 19:49:57.379813 6258 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:49:57.380182 6258 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 19:49:57.382668 6258 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/data/instance:
uuid: "2bf41435f70447f19992d368ca6b46bd"
format_stamp: "Formatted at 2026-09-23 19:49:57 on dist-test-slave-th4g"
I20260923 19:49:57.383427 6258 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/instance:
uuid: "2bf41435f70447f19992d368ca6b46bd"
format_stamp: "Formatted at 2026-09-23 19:49:57 on dist-test-slave-th4g"
I20260923 19:49:57.388777 6258 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260923 19:49:57.392205 6277 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:49:57.393584 6258 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260923 19:49:57.393769 6258 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/data,/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal
uuid: "2bf41435f70447f19992d368ca6b46bd"
format_stamp: "Formatted at 2026-09-23 19:49:57 on dist-test-slave-th4g"
I20260923 19:49:57.394449 6258 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:49:57.410630 6258 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260923 19:49:57.411502 6258 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:49:57.411774 6258 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:49:57.412693 6258 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260923 19:49:57.414393 6258 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 19:49:57.414522 6258 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 19:49:57.414644 6258 ts_tablet_manager.cc:616] Registered 0 tablets
I20260923 19:49:57.414729 6258 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 19:49:57.459903 6258 rpc_server.cc:307] RPC server started. Bound to: 127.5.143.195:32855
I20260923 19:49:57.459978 6389 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.143.195:32855 every 8 connection(s)
I20260923 19:49:57.461374 6258 server_base.cc:1193] Dumped server information to /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/data/info.pb
I20260923 19:49:57.468492 5695 external_mini_cluster.cc:1434] Started /tmp/dist-test-task5JtCX2/build/asan/bin/kudu as pid 6258
I20260923 19:49:57.468719 5695 external_mini_cluster.cc:1448] Reading /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/instance
I20260923 19:49:57.476009 6248 heartbeater.cc:499] Master 127.5.143.252:45543 was elected leader, sending a full tablet report...
I20260923 19:49:57.480855 6391 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
I20260923 19:49:57.481261 6391 heartbeater.cc:461] Registering TS with master...
I20260923 19:49:57.482411 6391 heartbeater.cc:507] Master 127.5.143.254:37151 requested a full tablet report, sending...
I20260923 19:49:57.483738 6390 heartbeater.cc:344] Connected to a master server at 127.5.143.252:45543
I20260923 19:49:57.483886 6390 heartbeater.cc:461] Registering TS with master...
I20260923 19:49:57.484006 6392 heartbeater.cc:344] Connected to a master server at 127.5.143.253:45285
I20260923 19:49:57.484144 6392 heartbeater.cc:461] Registering TS with master...
I20260923 19:49:57.484180 5734 ts_manager.cc:194] Registered new tserver with Master: 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:49:57.484439 6390 heartbeater.cc:507] Master 127.5.143.252:45543 requested a full tablet report, sending...
I20260923 19:49:57.484702 6392 heartbeater.cc:507] Master 127.5.143.253:45285 requested a full tablet report, sending...
I20260923 19:49:57.485797 5805 ts_manager.cc:194] Registered new tserver with Master: 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:49:57.485898 5876 ts_manager.cc:194] Registered new tserver with Master: 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:49:57.487206 5805 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.5.143.195:53215
I20260923 19:49:57.495028 5695 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260923 19:49:57.528277 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_a3cd829932624ebc96b13c3981634e7d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:49:57.533316 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_5c386bcb9a714bfba6fc85565bdca7d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:57.533939 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5c386bcb9a714bfba6fc85565bdca7d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:49:57.534329 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3cd829932624ebc96b13c3981634e7d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:57.536625 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_c35eae7f8e354b17b77e6b425ccdc2b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:57.537268 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c35eae7f8e354b17b77e6b425ccdc2b1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:57.539672 5886 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [term 3 FOLLOWER]: Refusing update from remote peer 83e97b26500048d0b75350a21a8ff96b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 7. (index mismatch)
I20260923 19:49:57.539531 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_fafdb197db38467e9f07d53865533562"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:57.540124 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fafdb197db38467e9f07d53865533562 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:57.540403 6120 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [LEADER]: Connected to new peer: Peer: permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260923 19:49:57.541452 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_01da6333cb0047f5bd656bed831a84ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:57.542086 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_01da6333cb0047f5bd656bed831a84ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:57.543730 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_8c25db02363b40649341a7f93b24ffe3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:57.544477 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c25db02363b40649341a7f93b24ffe3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:57.546084 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_ceaeb838eec845e783ed97a309f40e5b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:57.546793 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ceaeb838eec845e783ed97a309f40e5b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:57.550127 5744 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 3 FOLLOWER]: Refusing update from remote peer 83e97b26500048d0b75350a21a8ff96b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 7. (index mismatch)
I20260923 19:49:57.550948 6120 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260923 19:49:57.528209 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_e131f27add304f08a62cfd1a22f1d62d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:57.553484 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e131f27add304f08a62cfd1a22f1d62d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:57.557289 6260 sys_catalog.cc:455] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83e97b26500048d0b75350a21a8ff96b. Latest consensus state: current_term: 3 leader_uuid: "83e97b26500048d0b75350a21a8ff96b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } } }
I20260923 19:49:57.557588 6260 sys_catalog.cc:458] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:49:57.567802 5981 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83e97b26500048d0b75350a21a8ff96b. Latest consensus state: current_term: 3 leader_uuid: "83e97b26500048d0b75350a21a8ff96b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } } }
I20260923 19:49:57.568075 5981 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:49:57.580679 6428 mvcc.cc:204] Tried to move back new op lower bound from 7332630517911953408 to 7332630516394606592. Current Snapshot: MvccSnapshot[applied={T|T < 7332630517911953408 or (T in {7332630517911953408})}]
I20260923 19:49:57.580914 6260 sys_catalog.cc:455] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "83e97b26500048d0b75350a21a8ff96b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } } }
I20260923 19:49:57.581113 6260 sys_catalog.cc:458] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:49:57.583247 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_6c2dcdbec7e14073a25a9c532d94c479"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:57.583997 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c2dcdbec7e14073a25a9c532d94c479 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:57.585394 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_77c8657d1b814c41b318ee97dbbd5b9f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:57.586092 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_77c8657d1b814c41b318ee97dbbd5b9f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:57.588901 6427 mvcc.cc:204] Tried to move back new op lower bound from 7332630517911953408 to 7332630516394606592. Current Snapshot: MvccSnapshot[applied={T|T < 7332630517911953408 or (T in {7332630517911953408})}]
I20260923 19:49:57.589520 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5c386bcb9a714bfba6fc85565bdca7d7" } new_table_name: "default.Table_ec392391116742c48d1625a10b74de68" modify_external_catalogs: true
I20260923 19:49:57.591316 5975 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "83e97b26500048d0b75350a21a8ff96b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } } }
I20260923 19:49:57.591521 5975 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [sys.catalog]: This master's current role is: LEADER
I20260923 19:49:57.598631 5695 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task5JtCX2/build/asan/bin/kudu pid 5842
I20260923 19:49:57.599500 5981 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "83e97b26500048d0b75350a21a8ff96b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } } }
I20260923 19:49:57.599726 5981 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:49:57.600366 5906 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:49:57.606330 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_01da6333cb0047f5bd656bed831a84ed" } new_table_name: "default.Table_a1e21fac044546acb4b417436464d269" modify_external_catalogs: true
I20260923 19:49:57.628288 5805 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a3cd829932624ebc96b13c3981634e7d" } modify_external_catalogs: true
I20260923 19:49:57.628567 5805 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a3cd829932624ebc96b13c3981634e7d" } modify_external_catalogs: true
I20260923 19:49:57.630138 5799 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ceaeb838eec845e783ed97a309f40e5b" } new_table_name: "default.Table_43950dd9881344228e8be0c4c48466b3" modify_external_catalogs: true
I20260923 19:49:57.630201 5804 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_e131f27add304f08a62cfd1a22f1d62d" } modify_external_catalogs: true
I20260923 19:49:57.630414 5804 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_e131f27add304f08a62cfd1a22f1d62d" } modify_external_catalogs: true
I20260923 19:49:57.631467 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_8c25db02363b40649341a7f93b24ffe3" } new_table_name: "default.Table_becda8ed754641458d230754da7bf5a0" modify_external_catalogs: true
I20260923 19:49:57.631752 5975 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "83e97b26500048d0b75350a21a8ff96b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } } }
I20260923 19:49:57.631963 5975 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [sys.catalog]: This master's current role is: LEADER
I20260923 19:49:57.632983 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_fafdb197db38467e9f07d53865533562" } new_table_name: "default.Table_50d29795fad14466bdad023967b789ac" modify_external_catalogs: true
I20260923 19:49:57.638983 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_c35eae7f8e354b17b77e6b425ccdc2b1" } modify_external_catalogs: true
I20260923 19:49:57.639158 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_c35eae7f8e354b17b77e6b425ccdc2b1" } modify_external_catalogs: true
I20260923 19:49:57.644886 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_6c2dcdbec7e14073a25a9c532d94c479" } modify_external_catalogs: true
I20260923 19:49:57.645072 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_6c2dcdbec7e14073a25a9c532d94c479" } modify_external_catalogs: true
I20260923 19:49:57.646087 5797 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_77c8657d1b814c41b318ee97dbbd5b9f" } modify_external_catalogs: true
I20260923 19:49:57.646240 5797 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_77c8657d1b814c41b318ee97dbbd5b9f" } modify_external_catalogs: true
I20260923 19:49:57.646924 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 2876a4a967624fa8aa0657dd5d707748 (DEFAULT_TABLE table=default.Table_5c386bcb9a714bfba6fc85565bdca7d7 [id=47c37093044c462993bba6cb00bd296a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:57.648607 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2876a4a967624fa8aa0657dd5d707748. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:49:57.658458 5803 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2876a4a967624fa8aa0657dd5d707748 consensus state has no leader
W20260923 19:49:57.658958 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 11f9db993b0541668e0babd466059ff6 has no consensus state
I20260923 19:49:57.659325 5805 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 86623a9914ae426e9a4baf0691a88aca
W20260923 19:49:57.659710 5799 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2f78261842744af08d86da64d37d708c has no consensus state
I20260923 19:49:57.670941 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 2876a4a967624fa8aa0657dd5d707748 (DEFAULT_TABLE table=default.Table_5c386bcb9a714bfba6fc85565bdca7d7 [id=47c37093044c462993bba6cb00bd296a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:57.672439 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2876a4a967624fa8aa0657dd5d707748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:57.673420 5804 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 5d5f65c287454d81b50a1bdbc1c8e854
W20260923 19:49:57.673525 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cca0dc9ed824410bbed5a25afebb90e1 has no consensus state
I20260923 19:49:57.672768 6040 tablet_service.cc:1511] Processing CreateTablet for tablet 2876a4a967624fa8aa0657dd5d707748 (DEFAULT_TABLE table=default.Table_5c386bcb9a714bfba6fc85565bdca7d7 [id=47c37093044c462993bba6cb00bd296a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:49:57.674834 5800 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1ca02c3972cb4611a6eed3078056affb has no consensus state
I20260923 19:49:57.675791 6040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2876a4a967624fa8aa0657dd5d707748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:57.676491 5802 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet b8ef95c3755347ada9551725e51f7cb6
I20260923 19:49:57.669286 6454 tablet_bootstrap.cc:492] T 2876a4a967624fa8aa0657dd5d707748 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:49:57.681416 6454 tablet_bootstrap.cc:654] T 2876a4a967624fa8aa0657dd5d707748 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:57.682849 6454 log.cc:826] T 2876a4a967624fa8aa0657dd5d707748 P 61022dd7f2f14dc19aebe3af5f08f430: Log is configured to *not* fsync() on all Append() calls
W20260923 19:49:57.685034 5792 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 2f78261842744af08d86da64d37d708c (table default.Table_43950dd9881344228e8be0c4c48466b3 [id=7e9508e469b14579a0c697ac4ca5cc4a], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2f78261842744af08d86da64d37d708c has no consensus state
I20260923 19:49:57.688182 5802 master_service.cc:960] ReplaceTablet: received request to replace tablet 2876a4a967624fa8aa0657dd5d707748 from {username='slave'} at 127.0.0.1:59912
I20260923 19:49:57.691388 5800 master_service.cc:960] ReplaceTablet: received request to replace tablet 2876a4a967624fa8aa0657dd5d707748 from {username='slave'} at 127.0.0.1:59912
I20260923 19:49:57.691751 5798 master_service.cc:960] ReplaceTablet: received request to replace tablet 2876a4a967624fa8aa0657dd5d707748 from {username='slave'} at 127.0.0.1:59912
I20260923 19:49:57.692028 5804 master_service.cc:960] ReplaceTablet: received request to replace tablet 2876a4a967624fa8aa0657dd5d707748 from {username='slave'} at 127.0.0.1:59912
I20260923 19:49:57.694350 5799 master_service.cc:960] ReplaceTablet: received request to replace tablet 2876a4a967624fa8aa0657dd5d707748 from {username='slave'} at 127.0.0.1:59912
I20260923 19:49:57.696949 6454 tablet_bootstrap.cc:492] T 2876a4a967624fa8aa0657dd5d707748 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:49:57.697317 6454 ts_tablet_manager.cc:1403] T 2876a4a967624fa8aa0657dd5d707748 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.028s user 0.017s sys 0.000s
I20260923 19:49:57.706700 6456 tablet_bootstrap.cc:492] T 2876a4a967624fa8aa0657dd5d707748 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:49:57.711122 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 2876a4a967624fa8aa0657dd5d707748
I20260923 19:49:57.711580 6457 tablet_bootstrap.cc:492] T 2876a4a967624fa8aa0657dd5d707748 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:49:57.711863 5802 catalog_manager.cc:6934] ReplaceTablet: tablet 2876a4a967624fa8aa0657dd5d707748 deleted and replaced by tablet 1e1fef9ad60c4cf08507bb380f58fff3
I20260923 19:49:57.712790 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 2876a4a967624fa8aa0657dd5d707748 with delete_type TABLET_DATA_DELETED (replaced by tablet 1e1fef9ad60c4cf08507bb380f58fff3) from {username='slave'} at 127.0.0.1:60210
I20260923 19:49:57.713133 6456 tablet_bootstrap.cc:654] T 2876a4a967624fa8aa0657dd5d707748 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:57.715147 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet 2876a4a967624fa8aa0657dd5d707748 with delete_type TABLET_DATA_DELETED (replaced by tablet 1e1fef9ad60c4cf08507bb380f58fff3) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:57.715838 6457 tablet_bootstrap.cc:654] T 2876a4a967624fa8aa0657dd5d707748 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:57.718429 6456 log.cc:826] T 2876a4a967624fa8aa0657dd5d707748 P 2bf41435f70447f19992d368ca6b46bd: Log is configured to *not* fsync() on all Append() calls
I20260923 19:49:57.721939 6182 tablet_service.cc:1511] Processing CreateTablet for tablet 4beb8ce27cf84fe9bacae12e8ff496e3 (DEFAULT_TABLE table=default.Table_6c2dcdbec7e14073a25a9c532d94c479 [id=699382b6e1fa451c90111ad6e3972beb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:57.722472 6182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4beb8ce27cf84fe9bacae12e8ff496e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:57.723752 6324 tablet_service.cc:1511] Processing CreateTablet for tablet 4beb8ce27cf84fe9bacae12e8ff496e3 (DEFAULT_TABLE table=default.Table_6c2dcdbec7e14073a25a9c532d94c479 [id=699382b6e1fa451c90111ad6e3972beb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:57.724323 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4beb8ce27cf84fe9bacae12e8ff496e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:57.724313 6039 tablet_service.cc:1511] Processing CreateTablet for tablet 4beb8ce27cf84fe9bacae12e8ff496e3 (DEFAULT_TABLE table=default.Table_6c2dcdbec7e14073a25a9c532d94c479 [id=699382b6e1fa451c90111ad6e3972beb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:57.724815 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4beb8ce27cf84fe9bacae12e8ff496e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:57.725452 6323 tablet_service.cc:1511] Processing CreateTablet for tablet 1ca02c3972cb4611a6eed3078056affb (DEFAULT_TABLE table=default.Table_50d29795fad14466bdad023967b789ac [id=ca73f0867b5d49cfb0bb7cd2315c47f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:57.726540 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ca02c3972cb4611a6eed3078056affb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:57.726799 6322 tablet_service.cc:1511] Processing CreateTablet for tablet 11f9db993b0541668e0babd466059ff6 (DEFAULT_TABLE table=default.Table_a1e21fac044546acb4b417436464d269 [id=c5b2cbbf70c0433986e5c8c9430c9bfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:57.727270 6322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11f9db993b0541668e0babd466059ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:57.727474 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 11f9db993b0541668e0babd466059ff6 (DEFAULT_TABLE table=default.Table_a1e21fac044546acb4b417436464d269 [id=c5b2cbbf70c0433986e5c8c9430c9bfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:57.727929 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11f9db993b0541668e0babd466059ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:57.728837 6321 tablet_service.cc:1511] Processing CreateTablet for tablet 461b1718396e4750ad88394346a87d20 (DEFAULT_TABLE table=default.Table_77c8657d1b814c41b318ee97dbbd5b9f [id=1bbf846e9f4c45d988671ee7ee7f230e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:57.729022 6040 tablet_service.cc:1558] Processing DeleteTablet for tablet 2876a4a967624fa8aa0657dd5d707748 with delete_type TABLET_DATA_DELETED (replaced by tablet 1e1fef9ad60c4cf08507bb380f58fff3) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:57.729352 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 461b1718396e4750ad88394346a87d20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:57.730283 6038 tablet_service.cc:1511] Processing CreateTablet for tablet 1ca02c3972cb4611a6eed3078056affb (DEFAULT_TABLE table=default.Table_50d29795fad14466bdad023967b789ac [id=ca73f0867b5d49cfb0bb7cd2315c47f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:57.730772 6038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ca02c3972cb4611a6eed3078056affb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:57.733001 6035 tablet_service.cc:1511] Processing CreateTablet for tablet cca0dc9ed824410bbed5a25afebb90e1 (DEFAULT_TABLE table=default.Table_becda8ed754641458d230754da7bf5a0 [id=9dec959401b44b6894aff08698088c4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:57.734011 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cca0dc9ed824410bbed5a25afebb90e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:57.734217 6319 tablet_service.cc:1511] Processing CreateTablet for tablet 2f78261842744af08d86da64d37d708c (DEFAULT_TABLE table=default.Table_43950dd9881344228e8be0c4c48466b3 [id=7e9508e469b14579a0c697ac4ca5cc4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:57.734445 6320 tablet_service.cc:1511] Processing CreateTablet for tablet cca0dc9ed824410bbed5a25afebb90e1 (DEFAULT_TABLE table=default.Table_becda8ed754641458d230754da7bf5a0 [id=9dec959401b44b6894aff08698088c4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:57.734746 6319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f78261842744af08d86da64d37d708c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:57.735170 6320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cca0dc9ed824410bbed5a25afebb90e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:57.738380 6036 tablet_service.cc:1511] Processing CreateTablet for tablet 461b1718396e4750ad88394346a87d20 (DEFAULT_TABLE table=default.Table_77c8657d1b814c41b318ee97dbbd5b9f [id=1bbf846e9f4c45d988671ee7ee7f230e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:57.738930 6036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 461b1718396e4750ad88394346a87d20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:57.742296 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 2f78261842744af08d86da64d37d708c (DEFAULT_TABLE table=default.Table_43950dd9881344228e8be0c4c48466b3 [id=7e9508e469b14579a0c697ac4ca5cc4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:57.743311 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f78261842744af08d86da64d37d708c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:57.749040 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 4beb8ce27cf84fe9bacae12e8ff496e3
I20260923 19:49:57.750535 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 461b1718396e4750ad88394346a87d20
I20260923 19:49:57.750488 6318 tablet_service.cc:1558] Processing DeleteTablet for tablet 4beb8ce27cf84fe9bacae12e8ff496e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:49:57.752497 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet 461b1718396e4750ad88394346a87d20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:57.752813 6033 tablet_service.cc:1558] Processing DeleteTablet for tablet 4beb8ce27cf84fe9bacae12e8ff496e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:57.721688 6454 raft_consensus.cc:359] T 2876a4a967624fa8aa0657dd5d707748 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:49:57.754347 6318 tablet_service.cc:1558] Processing DeleteTablet for tablet 461b1718396e4750ad88394346a87d20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:49:57.758456 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 2876a4a967624fa8aa0657dd5d707748 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2876a4a967624fa8aa0657dd5d707748 already in progress: creating tablet
W20260923 19:49:57.762037 5792 catalog_manager.cc:5030] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 4beb8ce27cf84fe9bacae12e8ff496e3 because the tablet was not found. No further retry: Not found: Tablet not found: 4beb8ce27cf84fe9bacae12e8ff496e3
W20260923 19:49:57.762651 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 461b1718396e4750ad88394346a87d20 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 461b1718396e4750ad88394346a87d20 already in progress: creating tablet
W20260923 19:49:57.762725 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 2876a4a967624fa8aa0657dd5d707748 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2876a4a967624fa8aa0657dd5d707748 already in progress: creating tablet
W20260923 19:49:57.762984 5790 catalog_manager.cc:5030] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 461b1718396e4750ad88394346a87d20 because the tablet was not found. No further retry: Not found: Tablet not found: 461b1718396e4750ad88394346a87d20
W20260923 19:49:57.763204 5790 catalog_manager.cc:5030] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 4beb8ce27cf84fe9bacae12e8ff496e3 because the tablet was not found. No further retry: Not found: Tablet not found: 4beb8ce27cf84fe9bacae12e8ff496e3
I20260923 19:49:57.774076 6320 tablet_service.cc:1511] Processing CreateTablet for tablet 1e1fef9ad60c4cf08507bb380f58fff3 (DEFAULT_TABLE table=default.Table_ec392391116742c48d1625a10b74de68 [id=47c37093044c462993bba6cb00bd296a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:57.774504 6320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e1fef9ad60c4cf08507bb380f58fff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:57.774691 6040 tablet_service.cc:1511] Processing CreateTablet for tablet 1e1fef9ad60c4cf08507bb380f58fff3 (DEFAULT_TABLE table=default.Table_ec392391116742c48d1625a10b74de68 [id=47c37093044c462993bba6cb00bd296a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:57.775141 6040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e1fef9ad60c4cf08507bb380f58fff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:57.786263 6457 log.cc:826] T 2876a4a967624fa8aa0657dd5d707748 P e546f660e7e541d1aa9ae38e5ee5b9c0: Log is configured to *not* fsync() on all Append() calls
I20260923 19:49:57.789284 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_d3a08fb31394427c903ae442641fbb14"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:57.790084 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d3a08fb31394427c903ae442641fbb14 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:57.791316 6454 raft_consensus.cc:385] T 2876a4a967624fa8aa0657dd5d707748 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:57.794791 6456 tablet_bootstrap.cc:492] T 2876a4a967624fa8aa0657dd5d707748 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:49:57.795101 6456 ts_tablet_manager.cc:1403] T 2876a4a967624fa8aa0657dd5d707748 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.089s user 0.006s sys 0.018s
I20260923 19:49:57.791469 6454 raft_consensus.cc:740] T 2876a4a967624fa8aa0657dd5d707748 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:49:57.803782 6180 tablet_service.cc:1511] Processing CreateTablet for tablet 461b1718396e4750ad88394346a87d20 (DEFAULT_TABLE table=default.Table_77c8657d1b814c41b318ee97dbbd5b9f [id=1bbf846e9f4c45d988671ee7ee7f230e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:57.804144 6457 tablet_bootstrap.cc:492] T 2876a4a967624fa8aa0657dd5d707748 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:49:57.804324 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 461b1718396e4750ad88394346a87d20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:57.804615 6457 ts_tablet_manager.cc:1403] T 2876a4a967624fa8aa0657dd5d707748 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.093s user 0.002s sys 0.008s
I20260923 19:49:57.802665 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 1ca02c3972cb4611a6eed3078056affb (DEFAULT_TABLE table=default.Table_50d29795fad14466bdad023967b789ac [id=ca73f0867b5d49cfb0bb7cd2315c47f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:57.811935 6179 tablet_service.cc:1511] Processing CreateTablet for tablet cca0dc9ed824410bbed5a25afebb90e1 (DEFAULT_TABLE table=default.Table_becda8ed754641458d230754da7bf5a0 [id=9dec959401b44b6894aff08698088c4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:57.812505 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cca0dc9ed824410bbed5a25afebb90e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:57.814213 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_b3a35efd6cf64d91af4088cda7a3d582"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:57.814845 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b3a35efd6cf64d91af4088cda7a3d582 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:57.817513 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_382e555ccd2a4ebda27bedf8b1cbb159"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:49:57.817615 6457 raft_consensus.cc:359] T 2876a4a967624fa8aa0657dd5d707748 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:49:57.818037 6457 raft_consensus.cc:385] T 2876a4a967624fa8aa0657dd5d707748 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:57.818147 6457 raft_consensus.cc:740] T 2876a4a967624fa8aa0657dd5d707748 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:49:57.818130 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_7b9d98ec508a4b2997cfa2fb1a4b2076"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:49:57.818315 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_2e76a1dfd8c44bacb357b152127dc2f4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:57.818660 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b9d98ec508a4b2997cfa2fb1a4b2076 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:49:57.818826 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e76a1dfd8c44bacb357b152127dc2f4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:57.819837 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_2b81de9814ec4e8fa1420f8de8616fc4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:49:57.819865 6456 raft_consensus.cc:359] T 2876a4a967624fa8aa0657dd5d707748 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:49:57.820114 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_0e33e49bac5e4266bd2b09bb1010fce4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:49:57.820277 6456 raft_consensus.cc:385] T 2876a4a967624fa8aa0657dd5d707748 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:57.820377 6456 raft_consensus.cc:740] T 2876a4a967624fa8aa0657dd5d707748 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
W20260923 19:49:57.820399 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2b81de9814ec4e8fa1420f8de8616fc4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:49:57.820542 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0e33e49bac5e4266bd2b09bb1010fce4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:57.821223 6456 consensus_queue.cc:260] T 2876a4a967624fa8aa0657dd5d707748 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
W20260923 19:49:57.822511 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_382e555ccd2a4ebda27bedf8b1cbb159 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:57.802906 6454 consensus_queue.cc:260] T 2876a4a967624fa8aa0657dd5d707748 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:49:57.825567 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 2f78261842744af08d86da64d37d708c (DEFAULT_TABLE table=default.Table_43950dd9881344228e8be0c4c48466b3 [id=7e9508e469b14579a0c697ac4ca5cc4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:57.826633 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ca02c3972cb4611a6eed3078056affb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:57.828490 6457 consensus_queue.cc:260] T 2876a4a967624fa8aa0657dd5d707748 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:49:57.829265 6181 tablet_service.cc:1511] Processing CreateTablet for tablet 11f9db993b0541668e0babd466059ff6 (DEFAULT_TABLE table=default.Table_a1e21fac044546acb4b417436464d269 [id=c5b2cbbf70c0433986e5c8c9430c9bfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:57.830008 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11f9db993b0541668e0babd466059ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:57.834437 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f78261842744af08d86da64d37d708c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:57.837522 6457 ts_tablet_manager.cc:1434] T 2876a4a967624fa8aa0657dd5d707748 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.033s user 0.007s sys 0.007s
I20260923 19:49:57.837822 6107 heartbeater.cc:499] Master 127.5.143.253:45285 was elected leader, sending a full tablet report...
I20260923 19:49:57.837993 6456 ts_tablet_manager.cc:1434] T 2876a4a967624fa8aa0657dd5d707748 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.043s user 0.019s sys 0.008s
I20260923 19:49:57.838843 6176 tablet_service.cc:1558] Processing DeleteTablet for tablet 461b1718396e4750ad88394346a87d20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:57.839125 6457 tablet_bootstrap.cc:492] T 1ca02c3972cb4611a6eed3078056affb P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:49:57.839442 6175 tablet_service.cc:1511] Processing CreateTablet for tablet 1e1fef9ad60c4cf08507bb380f58fff3 (DEFAULT_TABLE table=default.Table_ec392391116742c48d1625a10b74de68 [id=47c37093044c462993bba6cb00bd296a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:57.839926 6175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e1fef9ad60c4cf08507bb380f58fff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:57.840975 6457 tablet_bootstrap.cc:654] T 1ca02c3972cb4611a6eed3078056affb P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:57.842563 6177 tablet_service.cc:1558] Processing DeleteTablet for tablet 4beb8ce27cf84fe9bacae12e8ff496e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:60148
W20260923 19:49:57.843184 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 2876a4a967624fa8aa0657dd5d707748 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2876a4a967624fa8aa0657dd5d707748 already in progress: creating tablet
I20260923 19:49:57.845615 6392 heartbeater.cc:499] Master 127.5.143.253:45285 was elected leader, sending a full tablet report...
I20260923 19:49:57.845788 6456 tablet_bootstrap.cc:492] T 1ca02c3972cb4611a6eed3078056affb P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:49:57.847515 6456 tablet_bootstrap.cc:654] T 1ca02c3972cb4611a6eed3078056affb P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:57.848876 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_fd622dbf705f46299f505f239bc74789"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:57.849455 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd622dbf705f46299f505f239bc74789 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:57.850703 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_7146a9adbec34a6ab1272e2f632209d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:57.851190 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7146a9adbec34a6ab1272e2f632209d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:49:57.851298 5791 catalog_manager.cc:5030] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 461b1718396e4750ad88394346a87d20 because the tablet was not found. No further retry: Not found: Tablet not found: 461b1718396e4750ad88394346a87d20
W20260923 19:49:57.851548 5791 catalog_manager.cc:5030] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 4beb8ce27cf84fe9bacae12e8ff496e3 because the tablet was not found. No further retry: Not found: Tablet not found: 4beb8ce27cf84fe9bacae12e8ff496e3
I20260923 19:49:57.855710 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_83dc8a536f3944439f90216fd56a49b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:49:57.855952 6456 tablet_bootstrap.cc:492] T 1ca02c3972cb4611a6eed3078056affb P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:49:57.856088 6456 ts_tablet_manager.cc:1403] T 1ca02c3972cb4611a6eed3078056affb P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.001s
W20260923 19:49:57.856227 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_83dc8a536f3944439f90216fd56a49b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:57.857125 6456 raft_consensus.cc:359] T 1ca02c3972cb4611a6eed3078056affb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:57.857329 6456 raft_consensus.cc:385] T 1ca02c3972cb4611a6eed3078056affb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:57.857412 6456 raft_consensus.cc:740] T 1ca02c3972cb4611a6eed3078056affb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:49:57.857661 6456 consensus_queue.cc:260] T 1ca02c3972cb4611a6eed3078056affb P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:57.858163 6456 ts_tablet_manager.cc:1434] T 1ca02c3972cb4611a6eed3078056affb P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260923 19:49:57.858453 6456 tablet_bootstrap.cc:492] T 461b1718396e4750ad88394346a87d20 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:49:57.865752 6320 tablet_service.cc:1511] Processing CreateTablet for tablet 5725a9cb95c448d0a5ea8114e90bc9fe (DEFAULT_TABLE table=default.Table_d3a08fb31394427c903ae442641fbb14 [id=d3b60b7fc1d84a46aa49932d5c3363ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:57.866298 6320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5725a9cb95c448d0a5ea8114e90bc9fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:57.868305 6456 tablet_bootstrap.cc:654] T 461b1718396e4750ad88394346a87d20 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:57.871147 6035 tablet_service.cc:1511] Processing CreateTablet for tablet 5725a9cb95c448d0a5ea8114e90bc9fe (DEFAULT_TABLE table=default.Table_d3a08fb31394427c903ae442641fbb14 [id=d3b60b7fc1d84a46aa49932d5c3363ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:57.871570 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5725a9cb95c448d0a5ea8114e90bc9fe. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:49:57.876359 6108 tablet.cc:2433] T 2876a4a967624fa8aa0657dd5d707748 P e546f660e7e541d1aa9ae38e5ee5b9c0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:49:57.882447 5799 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ec392391116742c48d1625a10b74de68" } new_table_name: "default.Table_02aee02d3b8746ce98cba010a0ac8149" modify_external_catalogs: true
I20260923 19:49:57.884006 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_43950dd9881344228e8be0c4c48466b3" } new_table_name: "default.Table_dd95f6056b9c4769bca675537e329b4e" modify_external_catalogs: true
I20260923 19:49:57.887256 5803 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a1e21fac044546acb4b417436464d269" } modify_external_catalogs: true
I20260923 19:49:57.887418 5803 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a1e21fac044546acb4b417436464d269" } modify_external_catalogs: true
I20260923 19:49:57.888002 5796 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d3a08fb31394427c903ae442641fbb14" } new_table_name: "default.Table_607989c106774f33b04dd16e8c16b890" modify_external_catalogs: true
I20260923 19:49:57.888330 5804 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_becda8ed754641458d230754da7bf5a0" } modify_external_catalogs: true
I20260923 19:49:57.888481 5804 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_becda8ed754641458d230754da7bf5a0" } modify_external_catalogs: true
I20260923 19:49:57.889554 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b3a35efd6cf64d91af4088cda7a3d582" } new_table_name: "default.Table_db8d2bf4a72d4038998c7ac73aef62f1" modify_external_catalogs: true
I20260923 19:49:57.889925 5797 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_50d29795fad14466bdad023967b789ac" } new_table_name: "default.Table_7152653ba30c4b02b3be0f5045300bcc" modify_external_catalogs: true
I20260923 19:49:57.893647 6324 tablet_service.cc:1511] Processing CreateTablet for tablet 29b2b75a12cb4ea3b73afe0ac549386f (DEFAULT_TABLE table=default.Table_b3a35efd6cf64d91af4088cda7a3d582 [id=c28edbfa33d947f1ad22e1f218da9de0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:57.894122 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29b2b75a12cb4ea3b73afe0ac549386f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:57.895519 6039 tablet_service.cc:1511] Processing CreateTablet for tablet 29b2b75a12cb4ea3b73afe0ac549386f (DEFAULT_TABLE table=default.Table_b3a35efd6cf64d91af4088cda7a3d582 [id=c28edbfa33d947f1ad22e1f218da9de0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:57.895901 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29b2b75a12cb4ea3b73afe0ac549386f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:57.901948 6182 tablet_service.cc:1511] Processing CreateTablet for tablet 5725a9cb95c448d0a5ea8114e90bc9fe (DEFAULT_TABLE table=default.Table_d3a08fb31394427c903ae442641fbb14 [id=d3b60b7fc1d84a46aa49932d5c3363ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:57.902413 6182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5725a9cb95c448d0a5ea8114e90bc9fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:57.905936 5801 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_2b81de9814ec4e8fa1420f8de8616fc4" } modify_external_catalogs: true
I20260923 19:49:57.906126 5801 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_2b81de9814ec4e8fa1420f8de8616fc4" } modify_external_catalogs: true
I20260923 19:49:57.908129 5695 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task5JtCX2/build/asan/bin/kudu with pid 5842
I20260923 19:49:57.910061 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 29b2b75a12cb4ea3b73afe0ac549386f (DEFAULT_TABLE table=default.Table_b3a35efd6cf64d91af4088cda7a3d582 [id=c28edbfa33d947f1ad22e1f218da9de0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:57.917163 5805 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 11f9db993b0541668e0babd466059ff6 (table default.Table_a1e21fac044546acb4b417436464d269 [id=c5b2cbbf70c0433986e5c8c9430c9bfd]). Expected version 1 got 0
I20260923 19:49:57.917443 5805 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 1ca02c3972cb4611a6eed3078056affb (table default.Table_50d29795fad14466bdad023967b789ac [id=ca73f0867b5d49cfb0bb7cd2315c47f2]). Expected version 1 got 0
I20260923 19:49:57.917690 5805 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 1e1fef9ad60c4cf08507bb380f58fff3 (table default.Table_ec392391116742c48d1625a10b74de68 [id=47c37093044c462993bba6cb00bd296a]). Expected version 1 got 0
I20260923 19:49:57.917969 5805 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 2f78261842744af08d86da64d37d708c (table default.Table_43950dd9881344228e8be0c4c48466b3 [id=7e9508e469b14579a0c697ac4ca5cc4a]). Expected version 1 got 0
I20260923 19:49:57.919130 5802 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 2f78261842744af08d86da64d37d708c (table default.Table_43950dd9881344228e8be0c4c48466b3 [id=7e9508e469b14579a0c697ac4ca5cc4a]). Expected version 1 got 0
I20260923 19:49:57.919315 5802 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 11f9db993b0541668e0babd466059ff6 (table default.Table_a1e21fac044546acb4b417436464d269 [id=c5b2cbbf70c0433986e5c8c9430c9bfd]). Expected version 1 got 0
I20260923 19:49:57.919480 5802 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 1ca02c3972cb4611a6eed3078056affb (table default.Table_50d29795fad14466bdad023967b789ac [id=ca73f0867b5d49cfb0bb7cd2315c47f2]). Expected version 1 got 0
I20260923 19:49:57.919621 5802 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 1e1fef9ad60c4cf08507bb380f58fff3 (table default.Table_ec392391116742c48d1625a10b74de68 [id=47c37093044c462993bba6cb00bd296a]). Expected version 1 got 0
W20260923 19:49:57.920280 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2f78261842744af08d86da64d37d708c consensus state has no leader
I20260923 19:49:57.920463 6456 tablet_bootstrap.cc:492] T 461b1718396e4750ad88394346a87d20 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:49:57.920652 6456 ts_tablet_manager.cc:1403] T 461b1718396e4750ad88394346a87d20 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.062s user 0.002s sys 0.013s
W20260923 19:49:57.920783 5799 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1e1fef9ad60c4cf08507bb380f58fff3 consensus state has no leader
W20260923 19:49:57.920922 5800 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 29b2b75a12cb4ea3b73afe0ac549386f consensus state has no leader
I20260923 19:49:57.921429 6456 raft_consensus.cc:359] T 461b1718396e4750ad88394346a87d20 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:57.921643 6456 raft_consensus.cc:385] T 461b1718396e4750ad88394346a87d20 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:57.921739 6456 raft_consensus.cc:740] T 461b1718396e4750ad88394346a87d20 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:49:57.922030 6456 consensus_queue.cc:260] T 461b1718396e4750ad88394346a87d20 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:57.923359 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet cca0dc9ed824410bbed5a25afebb90e1
I20260923 19:49:57.924126 6039 tablet_service.cc:1558] Processing DeleteTablet for tablet cca0dc9ed824410bbed5a25afebb90e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:57.925244 6177 tablet_service.cc:1558] Processing DeleteTablet for tablet cca0dc9ed824410bbed5a25afebb90e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:60148
W20260923 19:49:57.925302 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet cca0dc9ed824410bbed5a25afebb90e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cca0dc9ed824410bbed5a25afebb90e1 already in progress: creating tablet
W20260923 19:49:57.925966 5791 catalog_manager.cc:5030] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet cca0dc9ed824410bbed5a25afebb90e1 because the tablet was not found. No further retry: Not found: Tablet not found: cca0dc9ed824410bbed5a25afebb90e1
I20260923 19:49:57.927795 5801 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 9f226d78c56347d3bd0bf711c3963d1f
I20260923 19:49:57.928514 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29b2b75a12cb4ea3b73afe0ac549386f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:57.935379 5804 master_service.cc:960] ReplaceTablet: received request to replace tablet 1ca02c3972cb4611a6eed3078056affb from {username='slave'} at 127.0.0.1:59912
I20260923 19:49:57.935436 5801 master_service.cc:960] ReplaceTablet: received request to replace tablet 4beb8ce27cf84fe9bacae12e8ff496e3 from {username='slave'} at 127.0.0.1:59912
I20260923 19:49:57.936139 5798 master_service.cc:960] ReplaceTablet: received request to replace tablet 1ca02c3972cb4611a6eed3078056affb from {username='slave'} at 127.0.0.1:59912
I20260923 19:49:57.936455 5799 master_service.cc:960] ReplaceTablet: received request to replace tablet 2876a4a967624fa8aa0657dd5d707748 from {username='slave'} at 127.0.0.1:59912
I20260923 19:49:57.936543 6469 raft_consensus.cc:493] T 1ca02c3972cb4611a6eed3078056affb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:49:57.937629 6469 raft_consensus.cc:515] T 1ca02c3972cb4611a6eed3078056affb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:57.939404 6320 tablet_service.cc:1558] Processing DeleteTablet for tablet cca0dc9ed824410bbed5a25afebb90e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:49:57.940407 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet cca0dc9ed824410bbed5a25afebb90e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cca0dc9ed824410bbed5a25afebb90e1 already in progress: creating tablet
W20260923 19:49:57.944501 5796 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5725a9cb95c448d0a5ea8114e90bc9fe consensus state has no leader
I20260923 19:49:57.945168 5800 master_service.cc:960] ReplaceTablet: received request to replace tablet 2876a4a967624fa8aa0657dd5d707748 from {username='slave'} at 127.0.0.1:59912
W20260923 19:49:57.946404 5797 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1ca02c3972cb4611a6eed3078056affb consensus state has no leader
I20260923 19:49:57.950685 6254 heartbeater.cc:499] Master 127.5.143.253:45285 was elected leader, sending a full tablet report...
I20260923 19:49:57.950882 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 11f9db993b0541668e0babd466059ff6
I20260923 19:49:57.952759 6039 tablet_service.cc:1558] Processing DeleteTablet for tablet 11f9db993b0541668e0babd466059ff6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:57.954368 6322 tablet_service.cc:1558] Processing DeleteTablet for tablet 2876a4a967624fa8aa0657dd5d707748 with delete_type TABLET_DATA_DELETED (replaced by tablet 1e1fef9ad60c4cf08507bb380f58fff3) from {username='slave'} at 127.0.0.1:60210
I20260923 19:49:57.954660 6319 tablet_service.cc:1558] Processing DeleteTablet for tablet 461b1718396e4750ad88394346a87d20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:49:57.954859 6321 tablet_service.cc:1558] Processing DeleteTablet for tablet 4beb8ce27cf84fe9bacae12e8ff496e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:49:57.955139 6458 tablet_replica.cc:333] T 2876a4a967624fa8aa0657dd5d707748 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:49:57.955564 6458 raft_consensus.cc:2243] T 2876a4a967624fa8aa0657dd5d707748 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:49:57.955982 6458 raft_consensus.cc:2272] T 2876a4a967624fa8aa0657dd5d707748 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:49:57.959061 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca02c3972cb4611a6eed3078056affb" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:49:57.960218 6458 ts_tablet_manager.cc:1916] T 2876a4a967624fa8aa0657dd5d707748 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:49:57.963346 6279 leader_election.cc:343] T 1ca02c3972cb4611a6eed3078056affb P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:49:57.964741 6393 tablet.cc:2433] T 1ca02c3972cb4611a6eed3078056affb P 2bf41435f70447f19992d368ca6b46bd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:49:57.965210 6039 tablet_service.cc:1558] Processing DeleteTablet for tablet 4beb8ce27cf84fe9bacae12e8ff496e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:57.965440 6036 tablet_service.cc:1558] Processing DeleteTablet for tablet cca0dc9ed824410bbed5a25afebb90e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:57.965715 6040 tablet_service.cc:1558] Processing DeleteTablet for tablet 461b1718396e4750ad88394346a87d20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:57.966010 6035 tablet_service.cc:1558] Processing DeleteTablet for tablet 2876a4a967624fa8aa0657dd5d707748 with delete_type TABLET_DATA_DELETED (replaced by tablet 1e1fef9ad60c4cf08507bb380f58fff3) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:57.966224 6461 tablet_replica.cc:333] T 2876a4a967624fa8aa0657dd5d707748 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:49:57.966245 6456 ts_tablet_manager.cc:1434] T 461b1718396e4750ad88394346a87d20 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.045s user 0.015s sys 0.003s
I20260923 19:49:57.966269 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet cca0dc9ed824410bbed5a25afebb90e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:49:57.966496 6320 tablet_service.cc:1558] Processing DeleteTablet for tablet 11f9db993b0541668e0babd466059ff6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:49:57.966611 6461 raft_consensus.cc:2243] T 2876a4a967624fa8aa0657dd5d707748 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:49:57.966768 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet 11f9db993b0541668e0babd466059ff6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:57.966991 6461 raft_consensus.cc:2272] T 2876a4a967624fa8aa0657dd5d707748 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260923 19:49:57.967387 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 11f9db993b0541668e0babd466059ff6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11f9db993b0541668e0babd466059ff6 already in progress: creating tablet
I20260923 19:49:57.967814 6471 raft_consensus.cc:493] T 2876a4a967624fa8aa0657dd5d707748 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:49:57.968016 6471 raft_consensus.cc:515] T 2876a4a967624fa8aa0657dd5d707748 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:49:57.968650 6456 tablet_bootstrap.cc:492] T 2f78261842744af08d86da64d37d708c P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:49:57.968866 6461 ts_tablet_manager.cc:1916] T 2876a4a967624fa8aa0657dd5d707748 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:49:57.968966 6458 ts_tablet_manager.cc:1929] T 2876a4a967624fa8aa0657dd5d707748 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:49:57.969106 6458 log.cc:1199] T 2876a4a967624fa8aa0657dd5d707748 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/2876a4a967624fa8aa0657dd5d707748
I20260923 19:49:57.969611 6458 ts_tablet_manager.cc:1950] T 2876a4a967624fa8aa0657dd5d707748 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:49:57.970549 6456 tablet_bootstrap.cc:654] T 2f78261842744af08d86da64d37d708c P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:49:57.971527 6280 connection.cc:573] client connection to 127.5.143.252:45543 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260923 19:49:57.971875 6390 heartbeater.cc:646] Failed to heartbeat to 127.5.143.252:45543 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260923 19:49:57.972055 6138 connection.cc:573] client connection to 127.5.143.252:45543 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 19:49:57.972464 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 2876a4a967624fa8aa0657dd5d707748 (table default.Table_02aee02d3b8746ce98cba010a0ac8149 [id=47c37093044c462993bba6cb00bd296a]) successfully deleted
W20260923 19:49:57.972741 6248 heartbeater.cc:646] Failed to heartbeat to 127.5.143.252:45543 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 19:49:57.972908 6458 tablet_replica.cc:333] T 461b1718396e4750ad88394346a87d20 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:49:57.973100 6458 raft_consensus.cc:2243] T 461b1718396e4750ad88394346a87d20 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:49:57.973273 6458 raft_consensus.cc:2272] T 461b1718396e4750ad88394346a87d20 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:49:57.974025 6458 ts_tablet_manager.cc:1916] T 461b1718396e4750ad88394346a87d20 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:49:57.976176 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 11f9db993b0541668e0babd466059ff6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11f9db993b0541668e0babd466059ff6 already in progress: creating tablet
W20260923 19:49:57.976441 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 4beb8ce27cf84fe9bacae12e8ff496e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4beb8ce27cf84fe9bacae12e8ff496e3 already in progress: creating tablet
W20260923 19:49:57.976627 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet cca0dc9ed824410bbed5a25afebb90e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cca0dc9ed824410bbed5a25afebb90e1 already in progress: creating tablet
W20260923 19:49:57.976879 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 461b1718396e4750ad88394346a87d20 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 461b1718396e4750ad88394346a87d20 already in progress: creating tablet
I20260923 19:49:57.977787 5803 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 2f78261842744af08d86da64d37d708c (table default.Table_dd95f6056b9c4769bca675537e329b4e [id=7e9508e469b14579a0c697ac4ca5cc4a]). Expected version 2 got 0
I20260923 19:49:57.978142 5803 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 5725a9cb95c448d0a5ea8114e90bc9fe (table default.Table_607989c106774f33b04dd16e8c16b890 [id=d3b60b7fc1d84a46aa49932d5c3363ea]). Expected version 1 got 0
I20260923 19:49:57.978345 5803 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 1e1fef9ad60c4cf08507bb380f58fff3 (table default.Table_02aee02d3b8746ce98cba010a0ac8149 [id=47c37093044c462993bba6cb00bd296a]). Expected version 2 got 0
I20260923 19:49:57.982086 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_fd622dbf705f46299f505f239bc74789" } modify_external_catalogs: true
I20260923 19:49:57.982308 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_fd622dbf705f46299f505f239bc74789" } modify_external_catalogs: true
I20260923 19:49:57.983575 6461 ts_tablet_manager.cc:1929] T 2876a4a967624fa8aa0657dd5d707748 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:49:57.985611 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 1ca02c3972cb4611a6eed3078056affb
I20260923 19:49:57.986416 6461 log.cc:1199] T 2876a4a967624fa8aa0657dd5d707748 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/2876a4a967624fa8aa0657dd5d707748
I20260923 19:49:57.986688 5804 catalog_manager.cc:6934] ReplaceTablet: tablet 1ca02c3972cb4611a6eed3078056affb deleted and replaced by tablet 13566283020c41c9b97d8c16678450d6
W20260923 19:49:57.986850 6396 negotiation.cc:336] Failed RPC negotiation. Trace:
0923 19:49:57.972382 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.5.143.252:45543 (local address 127.5.143.195:58425)
0923 19:49:57.973663 (+ 1281us) negotiation.cc:107] Waiting for socket to connect
0923 19:49:57.973696 (+ 33us) client_negotiation.cc:175] Beginning negotiation
0923 19:49:57.973805 (+ 109us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0923 19:49:57.985426 (+ 11621us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.143.252:45543: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":1141}
I20260923 19:49:57.987511 6461 ts_tablet_manager.cc:1950] T 2876a4a967624fa8aa0657dd5d707748 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:49:57.989183 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ca02c3972cb4611a6eed3078056affb with delete_type TABLET_DATA_DELETED (replaced by tablet 13566283020c41c9b97d8c16678450d6) from {username='slave'} at 127.0.0.1:60210
I20260923 19:49:57.989487 6035 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ca02c3972cb4611a6eed3078056affb with delete_type TABLET_DATA_DELETED (replaced by tablet 13566283020c41c9b97d8c16678450d6) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:57.991186 6320 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ca02c3972cb4611a6eed3078056affb with delete_type TABLET_DATA_DELETED (replaced by tablet 13566283020c41c9b97d8c16678450d6) from {username='slave'} at 127.0.0.1:60210
I20260923 19:49:57.992054 6471 leader_election.cc:290] T 2876a4a967624fa8aa0657dd5d707748 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:49:57.995812 5803 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_db8d2bf4a72d4038998c7ac73aef62f1" } modify_external_catalogs: true
I20260923 19:49:57.996012 5803 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_db8d2bf4a72d4038998c7ac73aef62f1" } modify_external_catalogs: true
W20260923 19:49:57.996899 6139 leader_election.cc:343] T 2876a4a967624fa8aa0657dd5d707748 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 2876a4a967624fa8aa0657dd5d707748
W20260923 19:49:57.999008 6137 leader_election.cc:343] T 2876a4a967624fa8aa0657dd5d707748 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 2876a4a967624fa8aa0657dd5d707748
I20260923 19:49:57.999176 6137 leader_election.cc:304] T 2876a4a967624fa8aa0657dd5d707748 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:49:57.999934 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet 461b1718396e4750ad88394346a87d20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:58.000229 6182 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ca02c3972cb4611a6eed3078056affb with delete_type TABLET_DATA_DELETED (replaced by tablet 13566283020c41c9b97d8c16678450d6) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:58.000280 6471 raft_consensus.cc:2749] T 2876a4a967624fa8aa0657dd5d707748 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:49:57.999184 6454 ts_tablet_manager.cc:1434] T 2876a4a967624fa8aa0657dd5d707748 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.302s user 0.013s sys 0.013s
I20260923 19:49:58.000495 6320 tablet_service.cc:1511] Processing CreateTablet for tablet 57edfc8db29d498689ab77006d3fddfd (DEFAULT_TABLE table=default.Table_83dc8a536f3944439f90216fd56a49b7 [id=ab7359c3bd74468a8e5eca672ba3fb1f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:49:58.001092 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 461b1718396e4750ad88394346a87d20 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 461b1718396e4750ad88394346a87d20 already in progress: creating tablet
W20260923 19:49:58.001379 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 1ca02c3972cb4611a6eed3078056affb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ca02c3972cb4611a6eed3078056affb already in progress: creating tablet
I20260923 19:49:58.001407 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ca02c3972cb4611a6eed3078056affb with delete_type TABLET_DATA_DELETED (replaced by tablet 13566283020c41c9b97d8c16678450d6) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:58.001856 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 57edfc8db29d498689ab77006d3fddfd (DEFAULT_TABLE table=default.Table_83dc8a536f3944439f90216fd56a49b7 [id=ab7359c3bd74468a8e5eca672ba3fb1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.002107 5802 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet fd2f88d422c940949cf4f44a4012c607
I20260923 19:49:58.002295 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57edfc8db29d498689ab77006d3fddfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.002738 6179 tablet_service.cc:1511] Processing CreateTablet for tablet e67ef0eb259544a4b283cd03721bffe5 (DEFAULT_TABLE table=default.Table_7b9d98ec508a4b2997cfa2fb1a4b2076 [id=3fb7e854da784756b57db432e6c373db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.003095 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e67ef0eb259544a4b283cd03721bffe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.003510 6324 tablet_service.cc:1511] Processing CreateTablet for tablet e67ef0eb259544a4b283cd03721bffe5 (DEFAULT_TABLE table=default.Table_7b9d98ec508a4b2997cfa2fb1a4b2076 [id=3fb7e854da784756b57db432e6c373db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.005510 6454 tablet_bootstrap.cc:492] T 1ca02c3972cb4611a6eed3078056affb P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:49:58.005582 6321 tablet_service.cc:1511] Processing CreateTablet for tablet 16098a9f015040dc93d9cca2fc9ebce2 (DEFAULT_TABLE table=default.Table_7146a9adbec34a6ab1272e2f632209d1 [id=25b5843f90294bc8a77f3a0e00193f0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.005699 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet 4beb8ce27cf84fe9bacae12e8ff496e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:58.007957 6454 tablet_bootstrap.cc:654] T 1ca02c3972cb4611a6eed3078056affb P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:58.008632 6319 tablet_service.cc:1511] Processing CreateTablet for tablet c1b82e4a02794947b77040b6323ad96a (DEFAULT_TABLE table=default.Table_382e555ccd2a4ebda27bedf8b1cbb159 [id=ce8e51ef23914830a2fc7f9bb0d2ac68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.010612 6320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57edfc8db29d498689ab77006d3fddfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.010649 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 2876a4a967624fa8aa0657dd5d707748 (table default.Table_02aee02d3b8746ce98cba010a0ac8149 [id=47c37093044c462993bba6cb00bd296a]) successfully deleted
W20260923 19:49:58.011006 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 1ca02c3972cb4611a6eed3078056affb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ca02c3972cb4611a6eed3078056affb already in progress: creating tablet
I20260923 19:49:58.011174 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16098a9f015040dc93d9cca2fc9ebce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.011605 6319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b82e4a02794947b77040b6323ad96a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.011885 6035 tablet_service.cc:1511] Processing CreateTablet for tablet 57edfc8db29d498689ab77006d3fddfd (DEFAULT_TABLE table=default.Table_83dc8a536f3944439f90216fd56a49b7 [id=ab7359c3bd74468a8e5eca672ba3fb1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.012007 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e67ef0eb259544a4b283cd03721bffe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.012357 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57edfc8db29d498689ab77006d3fddfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.013955 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet 2876a4a967624fa8aa0657dd5d707748 with delete_type TABLET_DATA_DELETED (replaced by tablet 1e1fef9ad60c4cf08507bb380f58fff3) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:58.014302 6459 tablet_replica.cc:333] T 2876a4a967624fa8aa0657dd5d707748 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:49:58.014742 6459 raft_consensus.cc:2243] T 2876a4a967624fa8aa0657dd5d707748 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:49:58.015113 6459 raft_consensus.cc:2272] T 2876a4a967624fa8aa0657dd5d707748 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:49:58.015575 6182 tablet_service.cc:1558] Processing DeleteTablet for tablet cca0dc9ed824410bbed5a25afebb90e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:58.016714 6457 tablet_bootstrap.cc:492] T 1ca02c3972cb4611a6eed3078056affb P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:49:58.016870 6457 ts_tablet_manager.cc:1403] T 1ca02c3972cb4611a6eed3078056affb P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.178s user 0.000s sys 0.015s
I20260923 19:49:58.016861 6459 ts_tablet_manager.cc:1916] T 2876a4a967624fa8aa0657dd5d707748 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:49:58.017774 6457 raft_consensus.cc:359] T 1ca02c3972cb4611a6eed3078056affb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.017990 6457 raft_consensus.cc:385] T 1ca02c3972cb4611a6eed3078056affb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:58.018071 6457 raft_consensus.cc:740] T 1ca02c3972cb4611a6eed3078056affb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:49:58.018350 6457 consensus_queue.cc:260] T 1ca02c3972cb4611a6eed3078056affb P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.018847 6469 leader_election.cc:290] T 1ca02c3972cb4611a6eed3078056affb P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:49:58.021833 6322 tablet_service.cc:1511] Processing CreateTablet for tablet c817af3eb83a43a3b6d4e9c83a9eefbb (DEFAULT_TABLE table=default.Table_2e76a1dfd8c44bacb357b152127dc2f4 [id=b9b7fe147b8645389ebef237fa735b2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.022420 6322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c817af3eb83a43a3b6d4e9c83a9eefbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.030257 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 38993814002d4391a9801c0cf55e5374 (DEFAULT_TABLE table=default.Table_0e33e49bac5e4266bd2b09bb1010fce4 [id=ce4094be808b4dd3997cb576e11e3894]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.030822 6457 ts_tablet_manager.cc:1434] T 1ca02c3972cb4611a6eed3078056affb P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260923 19:49:58.030867 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38993814002d4391a9801c0cf55e5374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.031152 6457 tablet_bootstrap.cc:492] T cca0dc9ed824410bbed5a25afebb90e1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:49:58.032909 6457 tablet_bootstrap.cc:654] T cca0dc9ed824410bbed5a25afebb90e1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:58.042565 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_88b60f3e46a743d3913e7a4c0f353a59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:58.043473 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_88b60f3e46a743d3913e7a4c0f353a59 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:58.048606 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 29b2b75a12cb4ea3b73afe0ac549386f
I20260923 19:49:58.049819 6318 tablet_service.cc:1558] Processing DeleteTablet for tablet 29b2b75a12cb4ea3b73afe0ac549386f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:49:58.050226 6458 ts_tablet_manager.cc:1929] T 461b1718396e4750ad88394346a87d20 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:49:58.050398 6458 log.cc:1199] T 461b1718396e4750ad88394346a87d20 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/461b1718396e4750ad88394346a87d20
I20260923 19:49:58.050854 6458 ts_tablet_manager.cc:1950] T 461b1718396e4750ad88394346a87d20 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:49:58.052080 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 461b1718396e4750ad88394346a87d20 (table default.Table_77c8657d1b814c41b318ee97dbbd5b9f [id=1bbf846e9f4c45d988671ee7ee7f230e]) successfully deleted
W20260923 19:49:58.052856 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 4beb8ce27cf84fe9bacae12e8ff496e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4beb8ce27cf84fe9bacae12e8ff496e3 already in progress: creating tablet
W20260923 19:49:58.053553 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet cca0dc9ed824410bbed5a25afebb90e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cca0dc9ed824410bbed5a25afebb90e1 already in progress: creating tablet
W20260923 19:49:58.054288 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 11f9db993b0541668e0babd466059ff6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11f9db993b0541668e0babd466059ff6 already in progress: creating tablet
I20260923 19:49:58.054651 6458 tablet_replica.cc:333] T 1ca02c3972cb4611a6eed3078056affb P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:49:58.054862 6458 raft_consensus.cc:2243] T 1ca02c3972cb4611a6eed3078056affb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:49:58.055073 6458 raft_consensus.cc:2272] T 1ca02c3972cb4611a6eed3078056affb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:49:58.061703 6458 ts_tablet_manager.cc:1916] T 1ca02c3972cb4611a6eed3078056affb P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:49:58.064172 5791 consensus_peers.cc:597] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b -> Peer 009ffee03a4d41db84df9f450aa84562 (127.5.143.252:45543): Couldn't send request to peer 009ffee03a4d41db84df9f450aa84562. Status: Network error: Client connection negotiation failed: client connection to 127.5.143.252:45543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260923 19:49:58.065193 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 1ca02c3972cb4611a6eed3078056affb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ca02c3972cb4611a6eed3078056affb already in progress: creating tablet
W20260923 19:49:58.065653 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 4beb8ce27cf84fe9bacae12e8ff496e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4beb8ce27cf84fe9bacae12e8ff496e3 already in progress: creating tablet
I20260923 19:49:58.068284 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca02c3972cb4611a6eed3078056affb" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:49:58.070019 6040 tablet_service.cc:1511] Processing CreateTablet for tablet 16098a9f015040dc93d9cca2fc9ebce2 (DEFAULT_TABLE table=default.Table_7146a9adbec34a6ab1272e2f632209d1 [id=25b5843f90294bc8a77f3a0e00193f0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.070232 6036 tablet_service.cc:1511] Processing CreateTablet for tablet c1b82e4a02794947b77040b6323ad96a (DEFAULT_TABLE table=default.Table_382e555ccd2a4ebda27bedf8b1cbb159 [id=ce8e51ef23914830a2fc7f9bb0d2ac68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.070503 6040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16098a9f015040dc93d9cca2fc9ebce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.070734 6039 tablet_service.cc:1511] Processing CreateTablet for tablet c817af3eb83a43a3b6d4e9c83a9eefbb (DEFAULT_TABLE table=default.Table_2e76a1dfd8c44bacb357b152127dc2f4 [id=b9b7fe147b8645389ebef237fa735b2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.071076 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c817af3eb83a43a3b6d4e9c83a9eefbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.072235 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 38993814002d4391a9801c0cf55e5374 (DEFAULT_TABLE table=default.Table_0e33e49bac5e4266bd2b09bb1010fce4 [id=ce4094be808b4dd3997cb576e11e3894]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.072693 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38993814002d4391a9801c0cf55e5374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.074810 6036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b82e4a02794947b77040b6323ad96a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.078063 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet 29b2b75a12cb4ea3b73afe0ac549386f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:58.078339 6038 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ca02c3972cb4611a6eed3078056affb with delete_type TABLET_DATA_DELETED (replaced by tablet 13566283020c41c9b97d8c16678450d6) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:58.078249 6179 tablet_service.cc:1511] Processing CreateTablet for tablet 16098a9f015040dc93d9cca2fc9ebce2 (DEFAULT_TABLE table=default.Table_7146a9adbec34a6ab1272e2f632209d1 [id=25b5843f90294bc8a77f3a0e00193f0f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:49:58.078748 6105 heartbeater.cc:646] Failed to heartbeat to 127.5.143.252:45543 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.5.143.252:45543: connect: Connection refused (error 111)
I20260923 19:49:58.078814 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16098a9f015040dc93d9cca2fc9ebce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.080428 6178 tablet_service.cc:1511] Processing CreateTablet for tablet c1b82e4a02794947b77040b6323ad96a (DEFAULT_TABLE table=default.Table_382e555ccd2a4ebda27bedf8b1cbb159 [id=ce8e51ef23914830a2fc7f9bb0d2ac68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.080866 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b82e4a02794947b77040b6323ad96a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.081761 6182 tablet_service.cc:1511] Processing CreateTablet for tablet c817af3eb83a43a3b6d4e9c83a9eefbb (DEFAULT_TABLE table=default.Table_2e76a1dfd8c44bacb357b152127dc2f4 [id=b9b7fe147b8645389ebef237fa735b2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.082203 6182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c817af3eb83a43a3b6d4e9c83a9eefbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.083037 6181 tablet_service.cc:1511] Processing CreateTablet for tablet 38993814002d4391a9801c0cf55e5374 (DEFAULT_TABLE table=default.Table_0e33e49bac5e4266bd2b09bb1010fce4 [id=ce4094be808b4dd3997cb576e11e3894]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.083411 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38993814002d4391a9801c0cf55e5374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.084132 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet 29b2b75a12cb4ea3b73afe0ac549386f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:58.084702 6461 tablet_replica.cc:333] T 1ca02c3972cb4611a6eed3078056affb P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:49:58.084964 6461 raft_consensus.cc:2243] T 1ca02c3972cb4611a6eed3078056affb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:49:58.085163 6461 raft_consensus.cc:2272] T 1ca02c3972cb4611a6eed3078056affb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:49:58.086499 6461 ts_tablet_manager.cc:1916] T 1ca02c3972cb4611a6eed3078056affb P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:49:58.086652 6280 leader_election.cc:343] T 1ca02c3972cb4611a6eed3078056affb P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:49:58.086944 6280 leader_election.cc:304] T 1ca02c3972cb4611a6eed3078056affb P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:49:58.087380 6280 raft_consensus.cc:2686] T 1ca02c3972cb4611a6eed3078056affb P 2bf41435f70447f19992d368ca6b46bd: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260923 19:49:58.088384 6035 tablet_service.cc:1511] Processing CreateTablet for tablet e67ef0eb259544a4b283cd03721bffe5 (DEFAULT_TABLE table=default.Table_7b9d98ec508a4b2997cfa2fb1a4b2076 [id=3fb7e854da784756b57db432e6c373db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.088929 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e67ef0eb259544a4b283cd03721bffe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.097007 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_faa53cf5cc5541afb7b391368bdc55f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:58.097803 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_faa53cf5cc5541afb7b391368bdc55f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:49:58.100311 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 29b2b75a12cb4ea3b73afe0ac549386f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29b2b75a12cb4ea3b73afe0ac549386f already in progress: creating tablet
I20260923 19:49:58.104672 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_8b11b0f74b55400080d37799143edfac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:49:58.104964 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_655e0d86bc12407f9287ace4b3e76c29"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:58.105290 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8b11b0f74b55400080d37799143edfac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:49:58.105357 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_655e0d86bc12407f9287ace4b3e76c29 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:58.107039 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_c2f12662db1946519dacb058dcfca16b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:49:58.107129 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_1839abf2a7cd49589075d19a0fb9b337"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:58.107583 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1839abf2a7cd49589075d19a0fb9b337 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:49:58.107584 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2f12662db1946519dacb058dcfca16b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:58.110966 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_59963526245d437089bb2a1e5a276493"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:58.111477 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_59963526245d437089bb2a1e5a276493 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:58.113317 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_f1e7b89f9642419a93fed2c6c85f26c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:58.113971 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1e7b89f9642419a93fed2c6c85f26c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:58.115321 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_5bd1226477eb4f5dbd7b9b55afb6abda"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:58.115871 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5bd1226477eb4f5dbd7b9b55afb6abda in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:58.117127 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_8c17fe46fbab4e55ad9e956a1fe0dd6c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:58.117693 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c17fe46fbab4e55ad9e956a1fe0dd6c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:58.122258 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_2e76a1dfd8c44bacb357b152127dc2f4" } new_table_name: "default.Table_8e6e41e025804f89b18881a02817d3f1" modify_external_catalogs: true
I20260923 19:49:58.127784 6454 tablet_bootstrap.cc:492] T 1ca02c3972cb4611a6eed3078056affb P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:49:58.127946 6454 ts_tablet_manager.cc:1403] T 1ca02c3972cb4611a6eed3078056affb P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.123s user 0.039s sys 0.054s
I20260923 19:49:58.128127 6457 tablet_bootstrap.cc:492] T cca0dc9ed824410bbed5a25afebb90e1 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:49:58.128319 6457 ts_tablet_manager.cc:1403] T cca0dc9ed824410bbed5a25afebb90e1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.097s user 0.016s sys 0.022s
I20260923 19:49:58.128962 6454 raft_consensus.cc:359] T 1ca02c3972cb4611a6eed3078056affb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.129155 6454 raft_consensus.cc:385] T 1ca02c3972cb4611a6eed3078056affb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:58.129180 6456 tablet_bootstrap.cc:492] T 2f78261842744af08d86da64d37d708c P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:49:58.129244 6454 raft_consensus.cc:740] T 1ca02c3972cb4611a6eed3078056affb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:49:58.129201 6457 raft_consensus.cc:359] T cca0dc9ed824410bbed5a25afebb90e1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.129325 6456 ts_tablet_manager.cc:1403] T 2f78261842744af08d86da64d37d708c P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.161s user 0.014s sys 0.035s
I20260923 19:49:58.129417 6457 raft_consensus.cc:385] T cca0dc9ed824410bbed5a25afebb90e1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:58.129492 6457 raft_consensus.cc:740] T cca0dc9ed824410bbed5a25afebb90e1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:49:58.129509 6454 consensus_queue.cc:260] T 1ca02c3972cb4611a6eed3078056affb P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.129766 6457 consensus_queue.cc:260] T cca0dc9ed824410bbed5a25afebb90e1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.130182 6456 raft_consensus.cc:359] T 2f78261842744af08d86da64d37d708c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.130369 6456 raft_consensus.cc:385] T 2f78261842744af08d86da64d37d708c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:58.130456 6456 raft_consensus.cc:740] T 2f78261842744af08d86da64d37d708c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:49:58.130667 6456 consensus_queue.cc:260] T 2f78261842744af08d86da64d37d708c P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.131313 6456 ts_tablet_manager.cc:1434] T 2f78261842744af08d86da64d37d708c P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:49:58.131599 6456 tablet_bootstrap.cc:492] T 11f9db993b0541668e0babd466059ff6 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:49:58.133455 6456 tablet_bootstrap.cc:654] T 11f9db993b0541668e0babd466059ff6 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:58.134058 6454 ts_tablet_manager.cc:1434] T 1ca02c3972cb4611a6eed3078056affb P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260923 19:49:58.135304 6454 tablet_bootstrap.cc:492] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:49:58.137171 6454 tablet_bootstrap.cc:654] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:58.139297 6457 ts_tablet_manager.cc:1434] T cca0dc9ed824410bbed5a25afebb90e1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260923 19:49:58.141572 6457 tablet_bootstrap.cc:492] T 11f9db993b0541668e0babd466059ff6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:49:58.143013 6456 tablet_bootstrap.cc:492] T 11f9db993b0541668e0babd466059ff6 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:49:58.143198 6456 ts_tablet_manager.cc:1403] T 11f9db993b0541668e0babd466059ff6 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.004s
I20260923 19:49:58.143535 6457 tablet_bootstrap.cc:654] T 11f9db993b0541668e0babd466059ff6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:58.143957 6456 raft_consensus.cc:359] T 11f9db993b0541668e0babd466059ff6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.144230 6456 raft_consensus.cc:385] T 11f9db993b0541668e0babd466059ff6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:58.144304 6456 raft_consensus.cc:740] T 11f9db993b0541668e0babd466059ff6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:49:58.144615 6456 consensus_queue.cc:260] T 11f9db993b0541668e0babd466059ff6 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.147290 6456 ts_tablet_manager.cc:1434] T 11f9db993b0541668e0babd466059ff6 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260923 19:49:58.149324 6456 tablet_bootstrap.cc:492] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:49:58.151151 6456 tablet_bootstrap.cc:654] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:58.159020 6456 tablet_bootstrap.cc:492] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:49:58.159188 6456 ts_tablet_manager.cc:1403] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.006s
I20260923 19:49:58.159981 6456 raft_consensus.cc:359] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.160180 6456 raft_consensus.cc:385] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:58.160269 6456 raft_consensus.cc:740] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:49:58.160537 6456 consensus_queue.cc:260] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.162717 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 13566283020c41c9b97d8c16678450d6 (DEFAULT_TABLE table=default.Table_7152653ba30c4b02b3be0f5045300bcc [id=ca73f0867b5d49cfb0bb7cd2315c47f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.163132 6456 ts_tablet_manager.cc:1434] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260923 19:49:58.165498 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 13566283020c41c9b97d8c16678450d6 (DEFAULT_TABLE table=default.Table_7152653ba30c4b02b3be0f5045300bcc [id=ca73f0867b5d49cfb0bb7cd2315c47f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.165999 6456 tablet_bootstrap.cc:492] T cca0dc9ed824410bbed5a25afebb90e1 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:49:58.167587 6456 tablet_bootstrap.cc:654] T cca0dc9ed824410bbed5a25afebb90e1 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:58.170130 6036 tablet_service.cc:1511] Processing CreateTablet for tablet 13566283020c41c9b97d8c16678450d6 (DEFAULT_TABLE table=default.Table_7152653ba30c4b02b3be0f5045300bcc [id=ca73f0867b5d49cfb0bb7cd2315c47f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.170511 6456 tablet_bootstrap.cc:492] T cca0dc9ed824410bbed5a25afebb90e1 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:49:58.170675 6456 ts_tablet_manager.cc:1403] T cca0dc9ed824410bbed5a25afebb90e1 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260923 19:49:58.171420 6456 raft_consensus.cc:359] T cca0dc9ed824410bbed5a25afebb90e1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.171612 6456 raft_consensus.cc:385] T cca0dc9ed824410bbed5a25afebb90e1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:58.171681 6456 raft_consensus.cc:740] T cca0dc9ed824410bbed5a25afebb90e1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:49:58.171943 6456 consensus_queue.cc:260] T cca0dc9ed824410bbed5a25afebb90e1 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.174305 6459 ts_tablet_manager.cc:1929] T 2876a4a967624fa8aa0657dd5d707748 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:49:58.174499 6459 log.cc:1199] T 2876a4a967624fa8aa0657dd5d707748 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/2876a4a967624fa8aa0657dd5d707748
I20260923 19:49:58.174675 6456 ts_tablet_manager.cc:1434] T cca0dc9ed824410bbed5a25afebb90e1 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260923 19:49:58.174985 6459 ts_tablet_manager.cc:1950] T 2876a4a967624fa8aa0657dd5d707748 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:49:58.175961 6456 tablet_bootstrap.cc:492] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:49:58.177573 6456 tablet_bootstrap.cc:654] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:58.177850 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13566283020c41c9b97d8c16678450d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.184834 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13566283020c41c9b97d8c16678450d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.193529 6456 tablet_bootstrap.cc:492] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:49:58.193817 6456 ts_tablet_manager.cc:1403] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.009s
I20260923 19:49:58.194657 6456 raft_consensus.cc:359] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.194859 6456 raft_consensus.cc:385] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:58.194959 6456 raft_consensus.cc:740] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:49:58.195351 6456 consensus_queue.cc:260] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.197036 6456 ts_tablet_manager.cc:1434] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:49:58.198184 6456 tablet_bootstrap.cc:492] T 5725a9cb95c448d0a5ea8114e90bc9fe P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:49:58.200083 6456 tablet_bootstrap.cc:654] T 5725a9cb95c448d0a5ea8114e90bc9fe P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:49:58.205345 6255 tablet.cc:2433] T 1ca02c3972cb4611a6eed3078056affb P 61022dd7f2f14dc19aebe3af5f08f430: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:49:58.208606 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_607989c106774f33b04dd16e8c16b890" } new_table_name: "default.Table_1d045e195d50465784c49c6ecdc0e167" modify_external_catalogs: true
I20260923 19:49:58.209040 5804 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7b9d98ec508a4b2997cfa2fb1a4b2076" } new_table_name: "default.Table_c6eae8a1ba8a4263a38f1d0480c5fbd4" modify_external_catalogs: true
I20260923 19:49:58.210374 5805 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_382e555ccd2a4ebda27bedf8b1cbb159" } modify_external_catalogs: true
I20260923 19:49:58.210551 5805 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_382e555ccd2a4ebda27bedf8b1cbb159" } modify_external_catalogs: true
I20260923 19:49:58.211252 5797 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_83dc8a536f3944439f90216fd56a49b7" } modify_external_catalogs: true
I20260923 19:49:58.211418 5797 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_83dc8a536f3944439f90216fd56a49b7" } modify_external_catalogs: true
I20260923 19:49:58.211491 6456 tablet_bootstrap.cc:492] T 5725a9cb95c448d0a5ea8114e90bc9fe P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:49:58.211679 6456 ts_tablet_manager.cc:1403] T 5725a9cb95c448d0a5ea8114e90bc9fe P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.003s
I20260923 19:49:58.212311 5799 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7152653ba30c4b02b3be0f5045300bcc" } new_table_name: "default.Table_dc62d1ed0f594a698f993c61a912cdbc" modify_external_catalogs: true
I20260923 19:49:58.212414 6456 raft_consensus.cc:359] T 5725a9cb95c448d0a5ea8114e90bc9fe P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.212642 6456 raft_consensus.cc:385] T 5725a9cb95c448d0a5ea8114e90bc9fe P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:58.212716 6456 raft_consensus.cc:740] T 5725a9cb95c448d0a5ea8114e90bc9fe P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:49:58.212996 6456 consensus_queue.cc:260] T 5725a9cb95c448d0a5ea8114e90bc9fe P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.213356 5800 master_service.cc:960] ReplaceTablet: received request to replace tablet 1e1fef9ad60c4cf08507bb380f58fff3 from {username='slave'} at 127.0.0.1:59912
W20260923 19:49:58.213518 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c817af3eb83a43a3b6d4e9c83a9eefbb consensus state has no leader
I20260923 19:49:58.213784 5801 master_service.cc:960] ReplaceTablet: received request to replace tablet 57edfc8db29d498689ab77006d3fddfd from {username='slave'} at 127.0.0.1:59912
I20260923 19:49:58.217118 6456 ts_tablet_manager.cc:1434] T 5725a9cb95c448d0a5ea8114e90bc9fe P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260923 19:49:58.218214 5796 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_dd95f6056b9c4769bca675537e329b4e" } new_table_name: "default.Table_088b66f184a84e1dbfac0965c064ee09" modify_external_catalogs: true
I20260923 19:49:58.218951 6179 tablet_service.cc:1511] Processing CreateTablet for tablet c14d36ad1b7241c894dbdff46159000c (DEFAULT_TABLE table=default.Table_88b60f3e46a743d3913e7a4c0f353a59 [id=56cd81aa3d6f47d388803884b9220810]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.219521 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c14d36ad1b7241c894dbdff46159000c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.220009 6466 raft_consensus.cc:493] T cca0dc9ed824410bbed5a25afebb90e1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:49:58.220304 6456 tablet_bootstrap.cc:492] T 29b2b75a12cb4ea3b73afe0ac549386f P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:49:58.220264 6466 raft_consensus.cc:515] T cca0dc9ed824410bbed5a25afebb90e1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.222018 6456 tablet_bootstrap.cc:654] T 29b2b75a12cb4ea3b73afe0ac549386f P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:58.222255 6466 leader_election.cc:290] T cca0dc9ed824410bbed5a25afebb90e1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:49:58.222678 6325 tablet_service.cc:1511] Processing CreateTablet for tablet c14d36ad1b7241c894dbdff46159000c (DEFAULT_TABLE table=default.Table_88b60f3e46a743d3913e7a4c0f353a59 [id=56cd81aa3d6f47d388803884b9220810]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.223201 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 2876a4a967624fa8aa0657dd5d707748 (table default.Table_02aee02d3b8746ce98cba010a0ac8149 [id=47c37093044c462993bba6cb00bd296a]) successfully deleted
W20260923 19:49:58.223491 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet cca0dc9ed824410bbed5a25afebb90e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cca0dc9ed824410bbed5a25afebb90e1 already in progress: creating tablet
W20260923 19:49:58.223701 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 29b2b75a12cb4ea3b73afe0ac549386f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29b2b75a12cb4ea3b73afe0ac549386f already in progress: creating tablet
I20260923 19:49:58.228248 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ca02c3972cb4611a6eed3078056affb with delete_type TABLET_DATA_DELETED (replaced by tablet 13566283020c41c9b97d8c16678450d6) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:58.228577 6459 tablet_replica.cc:333] T 1ca02c3972cb4611a6eed3078056affb P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:49:58.228863 6459 raft_consensus.cc:2243] T 1ca02c3972cb4611a6eed3078056affb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:49:58.229233 6459 raft_consensus.cc:2272] T 1ca02c3972cb4611a6eed3078056affb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:49:58.230151 6459 ts_tablet_manager.cc:1916] T 1ca02c3972cb4611a6eed3078056affb P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:49:58.231400 6345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca0dc9ed824410bbed5a25afebb90e1" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:49:58.231784 6345 raft_consensus.cc:2468] T cca0dc9ed824410bbed5a25afebb90e1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 0.
I20260923 19:49:58.232398 5996 leader_election.cc:304] T cca0dc9ed824410bbed5a25afebb90e1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:49:58.232941 6466 raft_consensus.cc:2804] T cca0dc9ed824410bbed5a25afebb90e1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:49:58.233068 6466 raft_consensus.cc:493] T cca0dc9ed824410bbed5a25afebb90e1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:49:58.233142 6466 raft_consensus.cc:3060] T cca0dc9ed824410bbed5a25afebb90e1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
W20260923 19:49:58.255084 5790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.143.254:37151, user_credentials={real_user=slave}} blocked reactor thread for 52254.9us
I20260923 19:49:58.275625 6466 raft_consensus.cc:515] T cca0dc9ed824410bbed5a25afebb90e1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.276575 6466 leader_election.cc:290] T cca0dc9ed824410bbed5a25afebb90e1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:49:58.277287 6345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca0dc9ed824410bbed5a25afebb90e1" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:49:58.277506 6345 raft_consensus.cc:3060] T cca0dc9ed824410bbed5a25afebb90e1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:49:58.279913 6458 ts_tablet_manager.cc:1929] T 1ca02c3972cb4611a6eed3078056affb P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:49:58.280076 6458 log.cc:1199] T 1ca02c3972cb4611a6eed3078056affb P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/1ca02c3972cb4611a6eed3078056affb
I20260923 19:49:58.280474 6458 ts_tablet_manager.cc:1950] T 1ca02c3972cb4611a6eed3078056affb P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:49:58.282220 6461 ts_tablet_manager.cc:1929] T 1ca02c3972cb4611a6eed3078056affb P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:49:58.282418 6461 log.cc:1199] T 1ca02c3972cb4611a6eed3078056affb P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/1ca02c3972cb4611a6eed3078056affb
I20260923 19:49:58.282917 6461 ts_tablet_manager.cc:1950] T 1ca02c3972cb4611a6eed3078056affb P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:49:58.284974 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c14d36ad1b7241c894dbdff46159000c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.287508 6036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13566283020c41c9b97d8c16678450d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.295181 6469 raft_consensus.cc:493] T 5725a9cb95c448d0a5ea8114e90bc9fe P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:49:58.295373 6469 raft_consensus.cc:515] T 5725a9cb95c448d0a5ea8114e90bc9fe P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.296058 6469 leader_election.cc:290] T 5725a9cb95c448d0a5ea8114e90bc9fe P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:49:58.296931 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5725a9cb95c448d0a5ea8114e90bc9fe" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:49:58.297817 6280 leader_election.cc:343] T 5725a9cb95c448d0a5ea8114e90bc9fe P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:49:58.315438 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5725a9cb95c448d0a5ea8114e90bc9fe" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:49:58.315958 6034 tablet_service.cc:1511] Processing CreateTablet for tablet c14d36ad1b7241c894dbdff46159000c (DEFAULT_TABLE table=default.Table_88b60f3e46a743d3913e7a4c0f353a59 [id=56cd81aa3d6f47d388803884b9220810]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.316130 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca0dc9ed824410bbed5a25afebb90e1" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:49:58.316363 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c14d36ad1b7241c894dbdff46159000c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:49:58.316552 6279 leader_election.cc:343] T 5725a9cb95c448d0a5ea8114e90bc9fe P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:49:58.316797 6279 leader_election.cc:304] T 5725a9cb95c448d0a5ea8114e90bc9fe P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:49:58.317377 6469 raft_consensus.cc:2749] T 5725a9cb95c448d0a5ea8114e90bc9fe P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:49:58.318048 5995 leader_election.cc:343] T cca0dc9ed824410bbed5a25afebb90e1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:49:58.319877 6036 tablet_service.cc:1558] Processing DeleteTablet for tablet cca0dc9ed824410bbed5a25afebb90e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:58.321771 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca0dc9ed824410bbed5a25afebb90e1" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
W20260923 19:49:58.325943 5995 leader_election.cc:343] T cca0dc9ed824410bbed5a25afebb90e1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:49:58.327615 5804 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e67ef0eb259544a4b283cd03721bffe5 consensus state has no leader
W20260923 19:49:58.327950 5799 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 13566283020c41c9b97d8c16678450d6 consensus state has no leader
I20260923 19:49:58.328033 5804 master_service.cc:960] ReplaceTablet: received request to replace tablet e67ef0eb259544a4b283cd03721bffe5 from {username='slave'} at 127.0.0.1:59912
I20260923 19:49:58.330225 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7146a9adbec34a6ab1272e2f632209d1" } modify_external_catalogs: true
I20260923 19:49:58.330473 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7146a9adbec34a6ab1272e2f632209d1" } modify_external_catalogs: true
I20260923 19:49:58.331236 5799 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_0e33e49bac5e4266bd2b09bb1010fce4" } modify_external_catalogs: true
I20260923 19:49:58.331409 5799 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_0e33e49bac5e4266bd2b09bb1010fce4" } modify_external_catalogs: true
I20260923 19:49:58.334836 6454 tablet_bootstrap.cc:492] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:49:58.335126 6454 ts_tablet_manager.cc:1403] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.200s user 0.044s sys 0.118s
I20260923 19:49:58.336217 6454 raft_consensus.cc:359] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.337255 6454 raft_consensus.cc:385] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:58.337435 6454 raft_consensus.cc:740] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:49:58.338018 6456 tablet_bootstrap.cc:492] T 29b2b75a12cb4ea3b73afe0ac549386f P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:49:58.338193 6456 ts_tablet_manager.cc:1403] T 29b2b75a12cb4ea3b73afe0ac549386f P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.118s user 0.060s sys 0.055s
I20260923 19:49:58.337918 6454 consensus_queue.cc:260] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.339121 6454 ts_tablet_manager.cc:1434] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260923 19:49:58.339466 6454 tablet_bootstrap.cc:492] T 1e1fef9ad60c4cf08507bb380f58fff3 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:49:58.339618 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet c1b82e4a02794947b77040b6323ad96a
I20260923 19:49:58.340291 5805 master_service.cc:960] ReplaceTablet: received request to replace tablet 13566283020c41c9b97d8c16678450d6 from {username='slave'} at 127.0.0.1:59912
I20260923 19:49:58.341236 6454 tablet_bootstrap.cc:654] T 1e1fef9ad60c4cf08507bb380f58fff3 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:58.341564 6320 tablet_service.cc:1558] Processing DeleteTablet for tablet c1b82e4a02794947b77040b6323ad96a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:58 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:49:58.341609 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet c1b82e4a02794947b77040b6323ad96a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:58 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:58.341899 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 57edfc8db29d498689ab77006d3fddfd
I20260923 19:49:58.342409 6457 tablet_bootstrap.cc:492] T 11f9db993b0541668e0babd466059ff6 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:49:58.342604 6457 ts_tablet_manager.cc:1403] T 11f9db993b0541668e0babd466059ff6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.201s user 0.040s sys 0.070s
I20260923 19:49:58.343618 5797 master_service.cc:960] ReplaceTablet: received request to replace tablet 4beb8ce27cf84fe9bacae12e8ff496e3 from {username='slave'} at 127.0.0.1:59912
I20260923 19:49:58.343670 6457 raft_consensus.cc:359] T 11f9db993b0541668e0babd466059ff6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.343926 6457 raft_consensus.cc:385] T 11f9db993b0541668e0babd466059ff6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:58.344035 6457 raft_consensus.cc:740] T 11f9db993b0541668e0babd466059ff6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:49:58.344110 5797 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_8b11b0f74b55400080d37799143edfac" } modify_external_catalogs: true
I20260923 19:49:58.344290 5797 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_8b11b0f74b55400080d37799143edfac" } modify_external_catalogs: true
I20260923 19:49:58.344370 6457 consensus_queue.cc:260] T 11f9db993b0541668e0babd466059ff6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.345041 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_73b9e29628e7432a929c5e9c193d22fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:49:58.345067 6456 raft_consensus.cc:359] T 29b2b75a12cb4ea3b73afe0ac549386f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.345242 6456 raft_consensus.cc:385] T 29b2b75a12cb4ea3b73afe0ac549386f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:58.345321 6456 raft_consensus.cc:740] T 29b2b75a12cb4ea3b73afe0ac549386f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
W20260923 19:49:58.345625 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_73b9e29628e7432a929c5e9c193d22fa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:58.345575 6456 consensus_queue.cc:260] T 29b2b75a12cb4ea3b73afe0ac549386f P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.346117 6456 ts_tablet_manager.cc:1434] T 29b2b75a12cb4ea3b73afe0ac549386f P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260923 19:49:58.347870 6457 ts_tablet_manager.cc:1434] T 11f9db993b0541668e0babd466059ff6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260923 19:49:58.348312 6456 tablet_bootstrap.cc:492] T 16098a9f015040dc93d9cca2fc9ebce2 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:49:58.349010 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet 4beb8ce27cf84fe9bacae12e8ff496e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:58.350158 6456 tablet_bootstrap.cc:654] T 16098a9f015040dc93d9cca2fc9ebce2 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:58.350200 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet 57edfc8db29d498689ab77006d3fddfd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:58 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:58.350238 6320 tablet_service.cc:1558] Processing DeleteTablet for tablet 57edfc8db29d498689ab77006d3fddfd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:58 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:49:58.354067 6457 tablet_bootstrap.cc:492] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:49:58.356884 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet c1b82e4a02794947b77040b6323ad96a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:58 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:58.357511 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet 57edfc8db29d498689ab77006d3fddfd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:58 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:58.358317 6456 tablet_bootstrap.cc:492] T 16098a9f015040dc93d9cca2fc9ebce2 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:49:58.358501 6456 ts_tablet_manager.cc:1403] T 16098a9f015040dc93d9cca2fc9ebce2 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.002s
I20260923 19:49:58.359233 6456 raft_consensus.cc:359] T 16098a9f015040dc93d9cca2fc9ebce2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.359426 6456 raft_consensus.cc:385] T 16098a9f015040dc93d9cca2fc9ebce2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:58.359512 6456 raft_consensus.cc:740] T 16098a9f015040dc93d9cca2fc9ebce2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:49:58.359793 6456 consensus_queue.cc:260] T 16098a9f015040dc93d9cca2fc9ebce2 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.362318 6456 ts_tablet_manager.cc:1434] T 16098a9f015040dc93d9cca2fc9ebce2 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260923 19:49:58.364142 6456 tablet_bootstrap.cc:492] T 38993814002d4391a9801c0cf55e5374 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:49:58.365799 6456 tablet_bootstrap.cc:654] T 38993814002d4391a9801c0cf55e5374 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:58.373957 6456 tablet_bootstrap.cc:492] T 38993814002d4391a9801c0cf55e5374 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:49:58.374120 6456 ts_tablet_manager.cc:1403] T 38993814002d4391a9801c0cf55e5374 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260923 19:49:58.374861 6456 raft_consensus.cc:359] T 38993814002d4391a9801c0cf55e5374 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.375054 6456 raft_consensus.cc:385] T 38993814002d4391a9801c0cf55e5374 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:58.375167 6456 raft_consensus.cc:740] T 38993814002d4391a9801c0cf55e5374 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:49:58.375473 6456 consensus_queue.cc:260] T 38993814002d4391a9801c0cf55e5374 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.377192 6345 raft_consensus.cc:2468] T cca0dc9ed824410bbed5a25afebb90e1 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 1.
I20260923 19:49:58.379601 6456 ts_tablet_manager.cc:1434] T 38993814002d4391a9801c0cf55e5374 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260923 19:49:58.381770 6458 tablet_replica.cc:333] T 29b2b75a12cb4ea3b73afe0ac549386f P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:49:58.382037 6456 tablet_bootstrap.cc:492] T c1b82e4a02794947b77040b6323ad96a P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:49:58.382344 6459 ts_tablet_manager.cc:1929] T 1ca02c3972cb4611a6eed3078056affb P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:49:58.382511 6459 log.cc:1199] T 1ca02c3972cb4611a6eed3078056affb P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/1ca02c3972cb4611a6eed3078056affb
I20260923 19:49:58.382578 5996 leader_election.cc:304] T cca0dc9ed824410bbed5a25afebb90e1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:49:58.382942 6459 ts_tablet_manager.cc:1950] T 1ca02c3972cb4611a6eed3078056affb P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:49:58.383219 6466 raft_consensus.cc:2804] T cca0dc9ed824410bbed5a25afebb90e1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:49:58.383816 6456 tablet_bootstrap.cc:654] T c1b82e4a02794947b77040b6323ad96a P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:58.384192 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 1ca02c3972cb4611a6eed3078056affb (table default.Table_dc62d1ed0f594a698f993c61a912cdbc [id=ca73f0867b5d49cfb0bb7cd2315c47f2]) successfully deleted
W20260923 19:49:58.384534 5792 catalog_manager.cc:5030] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 1ca02c3972cb4611a6eed3078056affb because the tablet was not found. No further retry: Not found: Tablet not found: 1ca02c3972cb4611a6eed3078056affb
I20260923 19:49:58.384986 6469 raft_consensus.cc:493] T 16098a9f015040dc93d9cca2fc9ebce2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:49:58.382050 6458 raft_consensus.cc:2243] T 29b2b75a12cb4ea3b73afe0ac549386f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:49:58.385308 6458 raft_consensus.cc:2272] T 29b2b75a12cb4ea3b73afe0ac549386f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:49:58.385207 6469 raft_consensus.cc:515] T 16098a9f015040dc93d9cca2fc9ebce2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.386217 6469 leader_election.cc:290] T 16098a9f015040dc93d9cca2fc9ebce2 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:49:58.386494 6461 tablet_replica.cc:333] T cca0dc9ed824410bbed5a25afebb90e1 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:49:58.386798 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16098a9f015040dc93d9cca2fc9ebce2" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:49:58.387181 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16098a9f015040dc93d9cca2fc9ebce2" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:49:58.387396 6279 leader_election.cc:343] T 16098a9f015040dc93d9cca2fc9ebce2 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:49:58.387503 6458 ts_tablet_manager.cc:1916] T 29b2b75a12cb4ea3b73afe0ac549386f P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:49:58.387881 6280 leader_election.cc:343] T 16098a9f015040dc93d9cca2fc9ebce2 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:49:58.388082 6280 leader_election.cc:304] T 16098a9f015040dc93d9cca2fc9ebce2 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:49:58.388612 6469 raft_consensus.cc:2749] T 16098a9f015040dc93d9cca2fc9ebce2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:49:58.393347 6456 tablet_bootstrap.cc:492] T c1b82e4a02794947b77040b6323ad96a P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:49:58.393508 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 1ca02c3972cb4611a6eed3078056affb (table default.Table_dc62d1ed0f594a698f993c61a912cdbc [id=ca73f0867b5d49cfb0bb7cd2315c47f2]) successfully deleted
I20260923 19:49:58.393563 6456 ts_tablet_manager.cc:1403] T c1b82e4a02794947b77040b6323ad96a P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.002s
I20260923 19:49:58.394421 6456 raft_consensus.cc:359] T c1b82e4a02794947b77040b6323ad96a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.394675 6456 raft_consensus.cc:385] T c1b82e4a02794947b77040b6323ad96a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:58.394814 6456 raft_consensus.cc:740] T c1b82e4a02794947b77040b6323ad96a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:49:58.395128 6456 consensus_queue.cc:260] T c1b82e4a02794947b77040b6323ad96a P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.396459 6456 ts_tablet_manager.cc:1434] T c1b82e4a02794947b77040b6323ad96a P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
W20260923 19:49:58.398077 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5725a9cb95c448d0a5ea8114e90bc9fe consensus state has no leader
I20260923 19:49:58.398140 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet e67ef0eb259544a4b283cd03721bffe5
I20260923 19:49:58.398662 5804 catalog_manager.cc:6934] ReplaceTablet: tablet e67ef0eb259544a4b283cd03721bffe5 deleted and replaced by tablet 32c8333073574fe79bfc3e33f3249256
I20260923 19:49:58.399127 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet e67ef0eb259544a4b283cd03721bffe5 with delete_type TABLET_DATA_DELETED (replaced by tablet 32c8333073574fe79bfc3e33f3249256) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:58.400063 6456 tablet_bootstrap.cc:492] T e67ef0eb259544a4b283cd03721bffe5 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:49:58.401829 6456 tablet_bootstrap.cc:654] T e67ef0eb259544a4b283cd03721bffe5 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:58.370226 6457 tablet_bootstrap.cc:654] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:58.404243 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet e67ef0eb259544a4b283cd03721bffe5 with delete_type TABLET_DATA_DELETED (replaced by tablet 32c8333073574fe79bfc3e33f3249256) from {username='slave'} at 127.0.0.1:60210
I20260923 19:49:58.404570 6466 raft_consensus.cc:697] T cca0dc9ed824410bbed5a25afebb90e1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Becoming Leader. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Running, Role: LEADER
I20260923 19:49:58.405210 6466 consensus_queue.cc:237] T cca0dc9ed824410bbed5a25afebb90e1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.406728 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet e67ef0eb259544a4b283cd03721bffe5 with delete_type TABLET_DATA_DELETED (replaced by tablet 32c8333073574fe79bfc3e33f3249256) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:58.407541 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet 11f9db993b0541668e0babd466059ff6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:58.408315 6469 raft_consensus.cc:493] T 38993814002d4391a9801c0cf55e5374 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:49:58.408483 6469 raft_consensus.cc:515] T 38993814002d4391a9801c0cf55e5374 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.409204 6469 leader_election.cc:290] T 38993814002d4391a9801c0cf55e5374 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:49:58.410094 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38993814002d4391a9801c0cf55e5374" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:49:58.410302 6454 tablet_bootstrap.cc:492] T 1e1fef9ad60c4cf08507bb380f58fff3 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:49:58.410494 6454 ts_tablet_manager.cc:1403] T 1e1fef9ad60c4cf08507bb380f58fff3 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.071s user 0.035s sys 0.022s
I20260923 19:49:58.410681 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38993814002d4391a9801c0cf55e5374" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
W20260923 19:49:58.410836 6280 leader_election.cc:343] T 38993814002d4391a9801c0cf55e5374 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:49:58.411216 6279 leader_election.cc:343] T 38993814002d4391a9801c0cf55e5374 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:49:58.411320 6279 leader_election.cc:304] T 38993814002d4391a9801c0cf55e5374 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:49:58.411702 6469 raft_consensus.cc:2749] T 38993814002d4391a9801c0cf55e5374 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:49:58.412397 6457 tablet_bootstrap.cc:492] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:49:58.412310 6454 raft_consensus.cc:359] T 1e1fef9ad60c4cf08507bb380f58fff3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.412590 6457 ts_tablet_manager.cc:1403] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.059s user 0.004s sys 0.000s
I20260923 19:49:58.412629 6454 raft_consensus.cc:385] T 1e1fef9ad60c4cf08507bb380f58fff3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:58.412827 6454 raft_consensus.cc:740] T 1e1fef9ad60c4cf08507bb380f58fff3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:49:58.413231 6457 raft_consensus.cc:359] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.413411 6457 raft_consensus.cc:385] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:58.413266 6454 consensus_queue.cc:260] T 1e1fef9ad60c4cf08507bb380f58fff3 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.413484 6457 raft_consensus.cc:740] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:49:58.414041 6471 raft_consensus.cc:493] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:49:58.414196 6471 raft_consensus.cc:515] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.414836 6471 leader_election.cc:290] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:49:58.415062 6454 ts_tablet_manager.cc:1434] T 1e1fef9ad60c4cf08507bb380f58fff3 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260923 19:49:58.415390 6454 tablet_bootstrap.cc:492] T 461b1718396e4750ad88394346a87d20 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:49:58.415529 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4beb8ce27cf84fe9bacae12e8ff496e3" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:49:58.415840 6345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4beb8ce27cf84fe9bacae12e8ff496e3" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:49:58.416043 6345 raft_consensus.cc:2468] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
W20260923 19:49:58.416091 6137 leader_election.cc:343] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:49:58.416581 6139 leader_election.cc:304] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:49:58.417057 6471 raft_consensus.cc:2804] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:49:58.417191 6471 raft_consensus.cc:493] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:49:58.417312 6471 raft_consensus.cc:3060] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:49:58.417353 6454 tablet_bootstrap.cc:654] T 461b1718396e4750ad88394346a87d20 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:58.419046 6461 raft_consensus.cc:2243] T cca0dc9ed824410bbed5a25afebb90e1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:49:58.419870 6461 pending_rounds.cc:70] T cca0dc9ed824410bbed5a25afebb90e1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Trying to abort 1 pending ops.
I20260923 19:49:58.420018 6461 pending_rounds.cc:77] T cca0dc9ed824410bbed5a25afebb90e1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630521473445888 op_type: NO_OP noop_request { }
I20260923 19:49:58.420198 6461 raft_consensus.cc:2889] T cca0dc9ed824410bbed5a25afebb90e1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:49:58.420332 6461 raft_consensus.cc:2272] T cca0dc9ed824410bbed5a25afebb90e1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:49:58.421649 6457 consensus_queue.cc:260] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.423281 6461 ts_tablet_manager.cc:1916] T cca0dc9ed824410bbed5a25afebb90e1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:49:58.426893 6457 ts_tablet_manager.cc:1434] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260923 19:49:58.427424 6457 tablet_bootstrap.cc:492] T 461b1718396e4750ad88394346a87d20 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:49:58.429255 6457 tablet_bootstrap.cc:654] T 461b1718396e4750ad88394346a87d20 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:58.430226 6179 tablet_service.cc:1511] Processing CreateTablet for tablet 259e4faa58f549699538317019be5daf (DEFAULT_TABLE table=default.Table_59963526245d437089bb2a1e5a276493 [id=15b32ad6fb42473abddb1188aa861441]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.430645 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 259e4faa58f549699538317019be5daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.431245 6454 tablet_bootstrap.cc:492] T 461b1718396e4750ad88394346a87d20 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:49:58.431416 6454 ts_tablet_manager.cc:1403] T 461b1718396e4750ad88394346a87d20 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.006s
I20260923 19:49:58.432222 6454 raft_consensus.cc:359] T 461b1718396e4750ad88394346a87d20 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.432411 6454 raft_consensus.cc:385] T 461b1718396e4750ad88394346a87d20 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:58.432487 6454 raft_consensus.cc:740] T 461b1718396e4750ad88394346a87d20 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:49:58.432786 6454 consensus_queue.cc:260] T 461b1718396e4750ad88394346a87d20 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.433291 6454 ts_tablet_manager.cc:1434] T 461b1718396e4750ad88394346a87d20 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:49:58.433629 6454 tablet_bootstrap.cc:492] T 2f78261842744af08d86da64d37d708c P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:49:58.434242 5803 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 2f78261842744af08d86da64d37d708c (table default.Table_dd95f6056b9c4769bca675537e329b4e [id=7e9508e469b14579a0c697ac4ca5cc4a]). Expected version 2 got 0
I20260923 19:49:58.435420 6454 tablet_bootstrap.cc:654] T 2f78261842744af08d86da64d37d708c P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:58.435770 6320 tablet_service.cc:1511] Processing CreateTablet for tablet e655ab5873294e75a242709f069aabf2 (DEFAULT_TABLE table=default.Table_f1e7b89f9642419a93fed2c6c85f26c8 [id=c048860d19b54812a5898d84095d2353]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.436688 6183 tablet_service.cc:1511] Processing CreateTablet for tablet e655ab5873294e75a242709f069aabf2 (DEFAULT_TABLE table=default.Table_f1e7b89f9642419a93fed2c6c85f26c8 [id=c048860d19b54812a5898d84095d2353]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.437155 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e655ab5873294e75a242709f069aabf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.437120 5798 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 2f78261842744af08d86da64d37d708c (table default.Table_dd95f6056b9c4769bca675537e329b4e [id=7e9508e469b14579a0c697ac4ca5cc4a]). Expected version 2 got 0
W20260923 19:49:58.437716 5796 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2f78261842744af08d86da64d37d708c consensus state has no leader
I20260923 19:49:58.443073 6182 tablet_service.cc:1511] Processing CreateTablet for tablet 199843bdd7184df58be9a4a06a5ffb8b (DEFAULT_TABLE table=default.Table_c2f12662db1946519dacb058dcfca16b [id=a09c0c82fcc747babbd555f9aeae4ed9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.443550 6182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 199843bdd7184df58be9a4a06a5ffb8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.446270 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 223edddace234a16b2d360504a99c28b (DEFAULT_TABLE table=default.Table_1839abf2a7cd49589075d19a0fb9b337 [id=ed438085f7054d9993a39852df4cc790]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.446741 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 223edddace234a16b2d360504a99c28b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.455018 6039 tablet_service.cc:1511] Processing CreateTablet for tablet 223edddace234a16b2d360504a99c28b (DEFAULT_TABLE table=default.Table_1839abf2a7cd49589075d19a0fb9b337 [id=ed438085f7054d9993a39852df4cc790]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.455499 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 259e4faa58f549699538317019be5daf (DEFAULT_TABLE table=default.Table_59963526245d437089bb2a1e5a276493 [id=15b32ad6fb42473abddb1188aa861441]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.455682 6035 tablet_service.cc:1511] Processing CreateTablet for tablet e655ab5873294e75a242709f069aabf2 (DEFAULT_TABLE table=default.Table_f1e7b89f9642419a93fed2c6c85f26c8 [id=c048860d19b54812a5898d84095d2353]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.456157 6038 tablet_service.cc:1511] Processing CreateTablet for tablet 3158b344d1c748aab5004543e4448adb (DEFAULT_TABLE table=default.Table_655e0d86bc12407f9287ace4b3e76c29 [id=5bc43061f37b4defac5a530a1f174684]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.456704 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 0cdb778f87fa40b89dad97d166192a1e (DEFAULT_TABLE table=default.Table_8b11b0f74b55400080d37799143edfac [id=e16f8e50cfeb444eae29278b7a4b65df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.457542 6036 tablet_service.cc:1511] Processing CreateTablet for tablet 199843bdd7184df58be9a4a06a5ffb8b (DEFAULT_TABLE table=default.Table_c2f12662db1946519dacb058dcfca16b [id=a09c0c82fcc747babbd555f9aeae4ed9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.459585 6322 tablet_service.cc:1511] Processing CreateTablet for tablet 199843bdd7184df58be9a4a06a5ffb8b (DEFAULT_TABLE table=default.Table_c2f12662db1946519dacb058dcfca16b [id=a09c0c82fcc747babbd555f9aeae4ed9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.460223 6321 tablet_service.cc:1511] Processing CreateTablet for tablet 223edddace234a16b2d360504a99c28b (DEFAULT_TABLE table=default.Table_1839abf2a7cd49589075d19a0fb9b337 [id=ed438085f7054d9993a39852df4cc790]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.460788 6324 tablet_service.cc:1511] Processing CreateTablet for tablet 3158b344d1c748aab5004543e4448adb (DEFAULT_TABLE table=default.Table_655e0d86bc12407f9287ace4b3e76c29 [id=5bc43061f37b4defac5a530a1f174684]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.465523 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_552860e790be402a91af4ff2e2185d10"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:58.466284 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_552860e790be402a91af4ff2e2185d10 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:58.468322 6181 tablet_service.cc:1511] Processing CreateTablet for tablet 3158b344d1c748aab5004543e4448adb (DEFAULT_TABLE table=default.Table_655e0d86bc12407f9287ace4b3e76c29 [id=5bc43061f37b4defac5a530a1f174684]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.468398 6180 tablet_service.cc:1511] Processing CreateTablet for tablet 0cdb778f87fa40b89dad97d166192a1e (DEFAULT_TABLE table=default.Table_8b11b0f74b55400080d37799143edfac [id=e16f8e50cfeb444eae29278b7a4b65df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.468881 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3158b344d1c748aab5004543e4448adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.468956 6175 tablet_service.cc:1511] Processing CreateTablet for tablet 09bb2ab5617a49d99e75191b3b48b85f (DEFAULT_TABLE table=default.Table_faa53cf5cc5541afb7b391368bdc55f7 [id=4a8f28e842e94d628326ca83935f23c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.473281 6319 tablet_service.cc:1511] Processing CreateTablet for tablet 0cdb778f87fa40b89dad97d166192a1e (DEFAULT_TABLE table=default.Table_8b11b0f74b55400080d37799143edfac [id=e16f8e50cfeb444eae29278b7a4b65df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.474458 6175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09bb2ab5617a49d99e75191b3b48b85f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.481709 5796 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 2f78261842744af08d86da64d37d708c (table default.Table_088b66f184a84e1dbfac0965c064ee09 [id=7e9508e469b14579a0c697ac4ca5cc4a]). Expected version 3 got 0
I20260923 19:49:58.483423 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 259e4faa58f549699538317019be5daf (DEFAULT_TABLE table=default.Table_59963526245d437089bb2a1e5a276493 [id=15b32ad6fb42473abddb1188aa861441]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.485800 6459 tablet_replica.cc:333] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:49:58.486774 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 223edddace234a16b2d360504a99c28b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.490126 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cdb778f87fa40b89dad97d166192a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.490787 6038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3158b344d1c748aab5004543e4448adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.491487 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cdb778f87fa40b89dad97d166192a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.494334 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 259e4faa58f549699538317019be5daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.495358 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 1ca02c3972cb4611a6eed3078056affb (table default.Table_dc62d1ed0f594a698f993c61a912cdbc [id=ca73f0867b5d49cfb0bb7cd2315c47f2]) successfully deleted
W20260923 19:49:58.495719 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet c1b82e4a02794947b77040b6323ad96a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c1b82e4a02794947b77040b6323ad96a already in progress: creating tablet
I20260923 19:49:58.496176 6036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 199843bdd7184df58be9a4a06a5ffb8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.497247 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e655ab5873294e75a242709f069aabf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.513540 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 223edddace234a16b2d360504a99c28b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.514374 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3158b344d1c748aab5004543e4448adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.514937 6319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cdb778f87fa40b89dad97d166192a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.515477 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 259e4faa58f549699538317019be5daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.519001 6457 tablet_bootstrap.cc:492] T 461b1718396e4750ad88394346a87d20 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:49:58.519063 6320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e655ab5873294e75a242709f069aabf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.519215 6457 ts_tablet_manager.cc:1403] T 461b1718396e4750ad88394346a87d20 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.092s user 0.004s sys 0.008s
I20260923 19:49:58.520269 6457 raft_consensus.cc:359] T 461b1718396e4750ad88394346a87d20 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.520524 6457 raft_consensus.cc:385] T 461b1718396e4750ad88394346a87d20 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:58.520627 6457 raft_consensus.cc:740] T 461b1718396e4750ad88394346a87d20 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:49:58.521028 6457 consensus_queue.cc:260] T 461b1718396e4750ad88394346a87d20 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.522069 6322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 199843bdd7184df58be9a4a06a5ffb8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.521613 6457 ts_tablet_manager.cc:1434] T 461b1718396e4750ad88394346a87d20 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260923 19:49:58.530052 6457 tablet_bootstrap.cc:492] T 4beb8ce27cf84fe9bacae12e8ff496e3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:49:58.536036 6457 tablet_bootstrap.cc:654] T 4beb8ce27cf84fe9bacae12e8ff496e3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:58.550323 6457 tablet_bootstrap.cc:492] T 4beb8ce27cf84fe9bacae12e8ff496e3 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:49:58.550588 6457 ts_tablet_manager.cc:1403] T 4beb8ce27cf84fe9bacae12e8ff496e3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.002s
I20260923 19:49:58.574432 6471 raft_consensus.cc:515] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.588212 6471 leader_election.cc:290] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:49:58.588598 6459 raft_consensus.cc:2243] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:49:58.588719 6345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4beb8ce27cf84fe9bacae12e8ff496e3" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:49:58.589018 6345 raft_consensus.cc:3060] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:49:58.589389 6459 raft_consensus.cc:2272] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:49:58.590329 6459 ts_tablet_manager.cc:1916] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:49:58.622129 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4beb8ce27cf84fe9bacae12e8ff496e3" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:49:58.622673 6466 raft_consensus.cc:493] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:49:58.622848 6457 raft_consensus.cc:359] T 4beb8ce27cf84fe9bacae12e8ff496e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:49:58.623202 6137 leader_election.cc:343] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:49:58.625978 6466 raft_consensus.cc:515] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.626909 6466 leader_election.cc:290] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:49:58.627974 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f78261842744af08d86da64d37d708c" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:49:58.628320 6344 raft_consensus.cc:2468] T 2f78261842744af08d86da64d37d708c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 0.
I20260923 19:49:58.628285 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f78261842744af08d86da64d37d708c" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:49:58.630918 5996 leader_election.cc:304] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
W20260923 19:49:58.632069 5995 leader_election.cc:343] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:49:58.633168 6466 raft_consensus.cc:2804] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:49:58.633332 6466 raft_consensus.cc:493] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:49:58.633708 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_75d1617a325e4c6591795f8378cfa93d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:58.634514 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_75d1617a325e4c6591795f8378cfa93d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:58.635097 6466 raft_consensus.cc:3060] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:49:58.636426 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_24cb0f5e10b74268b41c6fde2d1a9409"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:58.636996 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_24cb0f5e10b74268b41c6fde2d1a9409 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:58.643178 6318 tablet_service.cc:1511] Processing CreateTablet for tablet 8a2fbac8080441d4a9e03ff1d580bc8e (DEFAULT_TABLE table=default.Table_5bd1226477eb4f5dbd7b9b55afb6abda [id=738ed1d070ef485e9299c1f3b1db008a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.643455 6457 raft_consensus.cc:385] T 4beb8ce27cf84fe9bacae12e8ff496e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:58.643584 6457 raft_consensus.cc:740] T 4beb8ce27cf84fe9bacae12e8ff496e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:49:58.644271 6322 tablet_service.cc:1511] Processing CreateTablet for tablet 09bb2ab5617a49d99e75191b3b48b85f (DEFAULT_TABLE table=default.Table_faa53cf5cc5541afb7b391368bdc55f7 [id=4a8f28e842e94d628326ca83935f23c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.644757 6181 tablet_service.cc:1511] Processing CreateTablet for tablet 8a2fbac8080441d4a9e03ff1d580bc8e (DEFAULT_TABLE table=default.Table_5bd1226477eb4f5dbd7b9b55afb6abda [id=738ed1d070ef485e9299c1f3b1db008a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.645848 6461 ts_tablet_manager.cc:1929] T cca0dc9ed824410bbed5a25afebb90e1 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:49:58.646291 6456 tablet_bootstrap.cc:492] T e67ef0eb259544a4b283cd03721bffe5 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:49:58.646452 6456 ts_tablet_manager.cc:1403] T e67ef0eb259544a4b283cd03721bffe5 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.250s user 0.072s sys 0.142s
I20260923 19:49:58.647521 6456 raft_consensus.cc:359] T e67ef0eb259544a4b283cd03721bffe5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.647776 6456 raft_consensus.cc:385] T e67ef0eb259544a4b283cd03721bffe5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:58.647891 6456 raft_consensus.cc:740] T e67ef0eb259544a4b283cd03721bffe5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:49:58.648247 6456 consensus_queue.cc:260] T e67ef0eb259544a4b283cd03721bffe5 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.652442 6457 consensus_queue.cc:260] T 4beb8ce27cf84fe9bacae12e8ff496e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.652663 6456 ts_tablet_manager.cc:1434] T e67ef0eb259544a4b283cd03721bffe5 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260923 19:49:58.652792 6040 tablet_service.cc:1511] Processing CreateTablet for tablet 09bb2ab5617a49d99e75191b3b48b85f (DEFAULT_TABLE table=default.Table_faa53cf5cc5541afb7b391368bdc55f7 [id=4a8f28e842e94d628326ca83935f23c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.652997 6457 ts_tablet_manager.cc:1434] T 4beb8ce27cf84fe9bacae12e8ff496e3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.102s user 0.002s sys 0.001s
I20260923 19:49:58.653203 6040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09bb2ab5617a49d99e75191b3b48b85f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.653313 6457 tablet_bootstrap.cc:492] T 1e1fef9ad60c4cf08507bb380f58fff3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:49:58.655189 6457 tablet_bootstrap.cc:654] T 1e1fef9ad60c4cf08507bb380f58fff3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:58.655431 6456 tablet_bootstrap.cc:492] T c817af3eb83a43a3b6d4e9c83a9eefbb P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:49:58.656169 6461 log.cc:1199] T cca0dc9ed824410bbed5a25afebb90e1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/cca0dc9ed824410bbed5a25afebb90e1
I20260923 19:49:58.656605 6461 ts_tablet_manager.cc:1950] T cca0dc9ed824410bbed5a25afebb90e1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:49:58.658094 6456 tablet_bootstrap.cc:654] T c817af3eb83a43a3b6d4e9c83a9eefbb P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:58.658663 6457 tablet_bootstrap.cc:492] T 1e1fef9ad60c4cf08507bb380f58fff3 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:49:58.658816 6457 ts_tablet_manager.cc:1403] T 1e1fef9ad60c4cf08507bb380f58fff3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260923 19:49:58.659610 6457 raft_consensus.cc:359] T 1e1fef9ad60c4cf08507bb380f58fff3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.659811 6457 raft_consensus.cc:385] T 1e1fef9ad60c4cf08507bb380f58fff3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:58.659916 6457 raft_consensus.cc:740] T 1e1fef9ad60c4cf08507bb380f58fff3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:49:58.660181 6457 consensus_queue.cc:260] T 1e1fef9ad60c4cf08507bb380f58fff3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.661718 6457 ts_tablet_manager.cc:1434] T 1e1fef9ad60c4cf08507bb380f58fff3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:49:58.661783 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 0cdb778f87fa40b89dad97d166192a1e
I20260923 19:49:58.662032 6457 tablet_bootstrap.cc:492] T 5725a9cb95c448d0a5ea8114e90bc9fe P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:49:58.663872 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_30a13147f51347808f58bfef0919dd77"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:58.664486 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_30a13147f51347808f58bfef0919dd77 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:58.665365 6457 tablet_bootstrap.cc:654] T 5725a9cb95c448d0a5ea8114e90bc9fe P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:58.666198 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet 0cdb778f87fa40b89dad97d166192a1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:58 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:49:58.669519 6175 tablet_service.cc:1558] Processing DeleteTablet for tablet 0cdb778f87fa40b89dad97d166192a1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:58 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:58.670403 6033 tablet_service.cc:1558] Processing DeleteTablet for tablet 461b1718396e4750ad88394346a87d20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:58.670596 6457 tablet_bootstrap.cc:492] T 5725a9cb95c448d0a5ea8114e90bc9fe P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:49:58.670773 6457 ts_tablet_manager.cc:1403] T 5725a9cb95c448d0a5ea8114e90bc9fe P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.002s
I20260923 19:49:58.671490 6457 raft_consensus.cc:359] T 5725a9cb95c448d0a5ea8114e90bc9fe P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.671721 6457 raft_consensus.cc:385] T 5725a9cb95c448d0a5ea8114e90bc9fe P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:58.671846 6457 raft_consensus.cc:740] T 5725a9cb95c448d0a5ea8114e90bc9fe P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:49:58.672116 6457 consensus_queue.cc:260] T 5725a9cb95c448d0a5ea8114e90bc9fe P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.672389 6033 tablet_service.cc:1511] Processing CreateTablet for tablet 8a2fbac8080441d4a9e03ff1d580bc8e (DEFAULT_TABLE table=default.Table_5bd1226477eb4f5dbd7b9b55afb6abda [id=738ed1d070ef485e9299c1f3b1db008a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:58.673067 6033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a2fbac8080441d4a9e03ff1d580bc8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.677984 6457 ts_tablet_manager.cc:1434] T 5725a9cb95c448d0a5ea8114e90bc9fe P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260923 19:49:58.679726 6457 tablet_bootstrap.cc:492] T 29b2b75a12cb4ea3b73afe0ac549386f P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:49:58.681836 6457 tablet_bootstrap.cc:654] T 29b2b75a12cb4ea3b73afe0ac549386f P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:58.681928 6345 raft_consensus.cc:2468] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:49:58.682331 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a2fbac8080441d4a9e03ff1d580bc8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.682472 6458 ts_tablet_manager.cc:1929] T 29b2b75a12cb4ea3b73afe0ac549386f P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:49:58.682616 6458 log.cc:1199] T 29b2b75a12cb4ea3b73afe0ac549386f P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/29b2b75a12cb4ea3b73afe0ac549386f
I20260923 19:49:58.682943 6458 ts_tablet_manager.cc:1950] T 29b2b75a12cb4ea3b73afe0ac549386f P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:49:58.682993 6456 tablet_bootstrap.cc:492] T c817af3eb83a43a3b6d4e9c83a9eefbb P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:49:58.683141 6456 ts_tablet_manager.cc:1403] T c817af3eb83a43a3b6d4e9c83a9eefbb P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.022s
I20260923 19:49:58.683481 6318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a2fbac8080441d4a9e03ff1d580bc8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.683941 6456 raft_consensus.cc:359] T c817af3eb83a43a3b6d4e9c83a9eefbb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.684129 6456 raft_consensus.cc:385] T c817af3eb83a43a3b6d4e9c83a9eefbb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:58.684103 6139 leader_election.cc:304] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:49:58.684206 6456 raft_consensus.cc:740] T c817af3eb83a43a3b6d4e9c83a9eefbb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
W20260923 19:49:58.684378 6139 raft_consensus.cc:2686] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 61022dd7f2f14dc19aebe3af5f08f430: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260923 19:49:58.684440 6456 consensus_queue.cc:260] T c817af3eb83a43a3b6d4e9c83a9eefbb P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.686241 6456 ts_tablet_manager.cc:1434] T c817af3eb83a43a3b6d4e9c83a9eefbb P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260923 19:49:58.686559 6456 tablet_bootstrap.cc:492] T 57edfc8db29d498689ab77006d3fddfd P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:49:58.688336 6456 tablet_bootstrap.cc:654] T 57edfc8db29d498689ab77006d3fddfd P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:58.688416 6466 raft_consensus.cc:515] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.689816 6345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f78261842744af08d86da64d37d708c" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:49:58.690054 6345 raft_consensus.cc:3060] T 2f78261842744af08d86da64d37d708c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:49:58.693836 6466 leader_election.cc:290] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:49:58.694263 6469 raft_consensus.cc:493] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:49:58.694427 6469 raft_consensus.cc:515] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.695088 6469 leader_election.cc:290] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:49:58.695297 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f78261842744af08d86da64d37d708c" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:49:58.697185 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1fef9ad60c4cf08507bb380f58fff3" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:49:58.697479 6060 raft_consensus.cc:2468] T 1e1fef9ad60c4cf08507bb380f58fff3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:49:58.698320 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1fef9ad60c4cf08507bb380f58fff3" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:49:58.698611 6202 raft_consensus.cc:2468] T 1e1fef9ad60c4cf08507bb380f58fff3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:49:58.699246 6280 leader_election.cc:304] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:49:58.699605 6469 raft_consensus.cc:2804] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:49:58.699724 6469 raft_consensus.cc:493] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:49:58.699847 6469 raft_consensus.cc:3060] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:49:58.702153 6461 tablet_replica.cc:333] T 11f9db993b0541668e0babd466059ff6 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:49:58.702436 6461 raft_consensus.cc:2243] T 11f9db993b0541668e0babd466059ff6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:49:58.702700 6461 raft_consensus.cc:2272] T 11f9db993b0541668e0babd466059ff6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:49:58.703768 6461 ts_tablet_manager.cc:1916] T 11f9db993b0541668e0babd466059ff6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:49:58.714212 6456 tablet_bootstrap.cc:492] T 57edfc8db29d498689ab77006d3fddfd P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:49:58.715626 6456 ts_tablet_manager.cc:1403] T 57edfc8db29d498689ab77006d3fddfd P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.011s
I20260923 19:49:58.717028 6456 raft_consensus.cc:359] T 57edfc8db29d498689ab77006d3fddfd P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.718644 6456 raft_consensus.cc:385] T 57edfc8db29d498689ab77006d3fddfd P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:58.718935 6456 raft_consensus.cc:740] T 57edfc8db29d498689ab77006d3fddfd P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:49:58.719453 6456 consensus_queue.cc:260] T 57edfc8db29d498689ab77006d3fddfd P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:49:58.736764 5995 leader_election.cc:343] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:49:58.744084 5789 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 5725a9cb95c448d0a5ea8114e90bc9fe (table default.Table_1d045e195d50465784c49c6ecdc0e167 [id=d3b60b7fc1d84a46aa49932d5c3363ea], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 5725a9cb95c448d0a5ea8114e90bc9fe consensus state has no leader
I20260923 19:49:58.746340 6322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09bb2ab5617a49d99e75191b3b48b85f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:58.754036 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet cca0dc9ed824410bbed5a25afebb90e1 (table default.Table_becda8ed754641458d230754da7bf5a0 [id=9dec959401b44b6894aff08698088c4e]) successfully deleted
W20260923 19:49:58.754536 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet c1b82e4a02794947b77040b6323ad96a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c1b82e4a02794947b77040b6323ad96a already in progress: creating tablet
I20260923 19:49:58.755306 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet 0cdb778f87fa40b89dad97d166192a1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:58 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:58.755755 6040 tablet_service.cc:1558] Processing DeleteTablet for tablet 4beb8ce27cf84fe9bacae12e8ff496e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:58.756307 6463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "83e97b26500048d0b75350a21a8ff96b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } } }
I20260923 19:49:58.761497 6463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [sys.catalog]: This master's current role is: LEADER
W20260923 19:49:58.766796 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 57edfc8db29d498689ab77006d3fddfd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 57edfc8db29d498689ab77006d3fddfd already in progress: creating tablet
W20260923 19:49:58.767515 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet e67ef0eb259544a4b283cd03721bffe5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e67ef0eb259544a4b283cd03721bffe5 already in progress: creating tablet
I20260923 19:49:58.774298 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 13566283020c41c9b97d8c16678450d6
I20260923 19:49:58.774801 5805 catalog_manager.cc:6934] ReplaceTablet: tablet 13566283020c41c9b97d8c16678450d6 deleted and replaced by tablet c52da04e5fe0454ea76bf4d99a930fd7
I20260923 19:49:58.776135 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet 13566283020c41c9b97d8c16678450d6 with delete_type TABLET_DATA_DELETED (replaced by tablet c52da04e5fe0454ea76bf4d99a930fd7) from {username='slave'} at 127.0.0.1:60210
I20260923 19:49:58.785737 6458 tablet_replica.cc:333] T c1b82e4a02794947b77040b6323ad96a P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:49:58.786350 6459 ts_tablet_manager.cc:1929] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:49:58.786521 6459 log.cc:1199] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/4beb8ce27cf84fe9bacae12e8ff496e3
I20260923 19:49:58.787011 6459 ts_tablet_manager.cc:1950] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:49:58.790362 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 29b2b75a12cb4ea3b73afe0ac549386f (table default.Table_db8d2bf4a72d4038998c7ac73aef62f1 [id=c28edbfa33d947f1ad22e1f218da9de0]) successfully deleted
I20260923 19:49:58.790969 6458 raft_consensus.cc:2243] T c1b82e4a02794947b77040b6323ad96a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:49:58.791177 6458 raft_consensus.cc:2272] T c1b82e4a02794947b77040b6323ad96a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:49:58.791690 6345 raft_consensus.cc:2468] T 2f78261842744af08d86da64d37d708c P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 1.
I20260923 19:49:58.792060 6458 ts_tablet_manager.cc:1916] T c1b82e4a02794947b77040b6323ad96a P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:49:58.792273 5996 leader_election.cc:304] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:49:58.792912 6466 raft_consensus.cc:2804] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:49:58.793076 6466 raft_consensus.cc:697] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Becoming Leader. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Running, Role: LEADER
I20260923 19:49:58.793356 6466 consensus_queue.cc:237] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.812978 6040 tablet_service.cc:1558] Processing DeleteTablet for tablet 13566283020c41c9b97d8c16678450d6 with delete_type TABLET_DATA_DELETED (replaced by tablet c52da04e5fe0454ea76bf4d99a930fd7) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:58.815680 6454 tablet_bootstrap.cc:492] T 2f78261842744af08d86da64d37d708c P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:49:58.815989 6454 ts_tablet_manager.cc:1403] T 2f78261842744af08d86da64d37d708c P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.382s user 0.119s sys 0.218s
W20260923 19:49:58.837782 5791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.143.252:45543, user_credentials={real_user=slave}} blocked reactor thread for 127379us
I20260923 19:49:58.837643 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_c0be6341515349798508cd7887abaa7e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:49:58.838605 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet 13566283020c41c9b97d8c16678450d6 with delete_type TABLET_DATA_DELETED (replaced by tablet c52da04e5fe0454ea76bf4d99a930fd7) from {username='slave'} at 127.0.0.1:60148
W20260923 19:49:58.838678 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c0be6341515349798508cd7887abaa7e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:58.839995 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_3a938c91580b4d23a2a0fad133090624"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:58.840673 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a938c91580b4d23a2a0fad133090624 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:58.842216 5800 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 1e1fef9ad60c4cf08507bb380f58fff3
I20260923 19:49:58.817781 6454 raft_consensus.cc:359] T 2f78261842744af08d86da64d37d708c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.842372 6454 raft_consensus.cc:385] T 2f78261842744af08d86da64d37d708c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:58.842521 6454 raft_consensus.cc:740] T 2f78261842744af08d86da64d37d708c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:49:58.842818 6454 consensus_queue.cc:260] T 2f78261842744af08d86da64d37d708c P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.842939 5800 catalog_manager.cc:6934] ReplaceTablet: tablet 1e1fef9ad60c4cf08507bb380f58fff3 deleted and replaced by tablet 8db0358af7634911820f99fe16605ca7
I20260923 19:49:58.843197 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e1fef9ad60c4cf08507bb380f58fff3 with delete_type TABLET_DATA_DELETED (replaced by tablet 8db0358af7634911820f99fe16605ca7) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:58.843360 6454 ts_tablet_manager.cc:1434] T 2f78261842744af08d86da64d37d708c P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.027s user 0.002s sys 0.001s
I20260923 19:49:58.843362 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_f8e149be0f0d456894956d425be24693"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:58.844040 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f8e149be0f0d456894956d425be24693 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:58.844313 6508 raft_consensus.cc:493] T 57edfc8db29d498689ab77006d3fddfd P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:49:58.844816 6456 ts_tablet_manager.cc:1434] T 57edfc8db29d498689ab77006d3fddfd P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.129s user 0.021s sys 0.043s
I20260923 19:49:58.844460 6508 raft_consensus.cc:515] T 57edfc8db29d498689ab77006d3fddfd P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.845698 6508 leader_election.cc:290] T 57edfc8db29d498689ab77006d3fddfd P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:49:58.845752 6456 tablet_bootstrap.cc:492] T 13566283020c41c9b97d8c16678450d6 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:49:58.846191 5804 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_c2f12662db1946519dacb058dcfca16b" } new_table_name: "default.Table_19746277e0c142bd8bfa415a7effbbe0" modify_external_catalogs: true
I20260923 19:49:58.846733 6457 tablet_bootstrap.cc:492] T 29b2b75a12cb4ea3b73afe0ac549386f P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:49:58.846964 6454 tablet_bootstrap.cc:492] T cca0dc9ed824410bbed5a25afebb90e1 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:49:58.847711 6457 ts_tablet_manager.cc:1403] T 29b2b75a12cb4ea3b73afe0ac549386f P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.169s user 0.022s sys 0.085s
I20260923 19:49:58.847939 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_f57f5ddf52f541ab91b4a9638fcf81a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:58.848418 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f57f5ddf52f541ab91b4a9638fcf81a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:58.848661 6454 tablet_bootstrap.cc:654] T cca0dc9ed824410bbed5a25afebb90e1 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:58.848563 6457 raft_consensus.cc:359] T 29b2b75a12cb4ea3b73afe0ac549386f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.848742 6457 raft_consensus.cc:385] T 29b2b75a12cb4ea3b73afe0ac549386f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:58.848829 6457 raft_consensus.cc:740] T 29b2b75a12cb4ea3b73afe0ac549386f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:49:58.849346 6456 tablet_bootstrap.cc:654] T 13566283020c41c9b97d8c16678450d6 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:58.850484 6457 consensus_queue.cc:260] T 29b2b75a12cb4ea3b73afe0ac549386f P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.850927 5803 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 5725a9cb95c448d0a5ea8114e90bc9fe (table default.Table_1d045e195d50465784c49c6ecdc0e167 [id=d3b60b7fc1d84a46aa49932d5c3363ea]). Expected version 2 got 0
I20260923 19:49:58.851322 6492 raft_consensus.cc:493] T 4beb8ce27cf84fe9bacae12e8ff496e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:49:58.851440 6492 raft_consensus.cc:515] T 4beb8ce27cf84fe9bacae12e8ff496e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.852391 6492 leader_election.cc:290] T 4beb8ce27cf84fe9bacae12e8ff496e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:49:58.854140 6457 ts_tablet_manager.cc:1434] T 29b2b75a12cb4ea3b73afe0ac549386f P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260923 19:49:58.854311 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 16098a9f015040dc93d9cca2fc9ebce2
I20260923 19:49:58.854449 6457 tablet_bootstrap.cc:492] T 57edfc8db29d498689ab77006d3fddfd P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:49:58.855237 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet 16098a9f015040dc93d9cca2fc9ebce2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:58 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:58.855214 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_a04bbcc870f94f609935f519709a7d95"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:58.855782 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a04bbcc870f94f609935f519709a7d95 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:58.856105 6457 tablet_bootstrap.cc:654] T 57edfc8db29d498689ab77006d3fddfd P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:58.856947 5799 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 38993814002d4391a9801c0cf55e5374
I20260923 19:49:58.857973 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet 38993814002d4391a9801c0cf55e5374 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:58 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:58.857945 5799 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_088b66f184a84e1dbfac0965c064ee09" } new_table_name: "default.Table_a5d9d7b0e0b449ae8791e459b7d88f18" modify_external_catalogs: true
I20260923 19:49:58.861553 6457 tablet_bootstrap.cc:492] T 57edfc8db29d498689ab77006d3fddfd P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:49:58.861560 6319 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e1fef9ad60c4cf08507bb380f58fff3 with delete_type TABLET_DATA_DELETED (replaced by tablet 8db0358af7634911820f99fe16605ca7) from {username='slave'} at 127.0.0.1:60210
I20260923 19:49:58.861717 6457 ts_tablet_manager.cc:1403] T 57edfc8db29d498689ab77006d3fddfd P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260923 19:49:58.862514 6457 raft_consensus.cc:359] T 57edfc8db29d498689ab77006d3fddfd P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.862692 6457 raft_consensus.cc:385] T 57edfc8db29d498689ab77006d3fddfd P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:58.862761 6457 raft_consensus.cc:740] T 57edfc8db29d498689ab77006d3fddfd P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:49:58.864797 6457 consensus_queue.cc:260] T 57edfc8db29d498689ab77006d3fddfd P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.865015 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5bd1226477eb4f5dbd7b9b55afb6abda" } new_table_name: "default.Table_d94eaba070fd454bb85f8ef139ba0a28" modify_external_catalogs: true
I20260923 19:49:58.865854 6457 ts_tablet_manager.cc:1434] T 57edfc8db29d498689ab77006d3fddfd P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260923 19:49:58.866776 6457 tablet_bootstrap.cc:492] T 16098a9f015040dc93d9cca2fc9ebce2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:49:58.866853 5805 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_8c17fe46fbab4e55ad9e956a1fe0dd6c" } modify_external_catalogs: true
I20260923 19:49:58.867024 5805 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_8c17fe46fbab4e55ad9e956a1fe0dd6c" } modify_external_catalogs: true
I20260923 19:49:58.868625 6457 tablet_bootstrap.cc:654] T 16098a9f015040dc93d9cca2fc9ebce2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:58.871272 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 38993814002d4391a9801c0cf55e5374 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:58 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:49:58.871515 6456 tablet_bootstrap.cc:492] T 13566283020c41c9b97d8c16678450d6 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:49:58.871634 6319 tablet_service.cc:1558] Processing DeleteTablet for tablet 16098a9f015040dc93d9cca2fc9ebce2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:58 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:49:58.871706 6456 ts_tablet_manager.cc:1403] T 13566283020c41c9b97d8c16678450d6 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.027s user 0.008s sys 0.012s
I20260923 19:49:58.872526 6456 raft_consensus.cc:359] T 13566283020c41c9b97d8c16678450d6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.872745 6456 raft_consensus.cc:385] T 13566283020c41c9b97d8c16678450d6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:58.872816 6456 raft_consensus.cc:740] T 13566283020c41c9b97d8c16678450d6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:49:58.873044 6456 consensus_queue.cc:260] T 13566283020c41c9b97d8c16678450d6 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.873330 6345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4beb8ce27cf84fe9bacae12e8ff496e3" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:49:58.873564 6456 ts_tablet_manager.cc:1434] T 13566283020c41c9b97d8c16678450d6 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:49:58.873776 6345 raft_consensus.cc:2393] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in current term 1: Already voted for candidate 61022dd7f2f14dc19aebe3af5f08f430 in this term.
I20260923 19:49:58.873960 6456 tablet_bootstrap.cc:492] T c14d36ad1b7241c894dbdff46159000c P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:49:58.873958 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57edfc8db29d498689ab77006d3fddfd" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:49:58.875720 6456 tablet_bootstrap.cc:654] T c14d36ad1b7241c894dbdff46159000c P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:49:58.876982 6280 leader_election.cc:343] T 57edfc8db29d498689ab77006d3fddfd P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:49:58.880481 6320 tablet_service.cc:1558] Processing DeleteTablet for tablet cca0dc9ed824410bbed5a25afebb90e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:49:58.880611 5803 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 2f78261842744af08d86da64d37d708c (table default.Table_088b66f184a84e1dbfac0965c064ee09 [id=7e9508e469b14579a0c697ac4ca5cc4a]). Expected version 3 got 0
I20260923 19:49:58.880702 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 29b2b75a12cb4ea3b73afe0ac549386f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:49:58.880906 6319 tablet_service.cc:1558] Processing DeleteTablet for tablet 4beb8ce27cf84fe9bacae12e8ff496e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:49:58.881027 6457 tablet_bootstrap.cc:492] T 16098a9f015040dc93d9cca2fc9ebce2 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:49:58.881177 6457 ts_tablet_manager.cc:1403] T 16098a9f015040dc93d9cca2fc9ebce2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.003s
I20260923 19:49:58.884766 6457 raft_consensus.cc:359] T 16098a9f015040dc93d9cca2fc9ebce2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.885308 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57edfc8db29d498689ab77006d3fddfd" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:49:58.885448 6457 raft_consensus.cc:385] T 16098a9f015040dc93d9cca2fc9ebce2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:58.885558 6457 raft_consensus.cc:740] T 16098a9f015040dc93d9cca2fc9ebce2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:49:58.885599 6060 raft_consensus.cc:2468] T 57edfc8db29d498689ab77006d3fddfd P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:49:58.885818 6457 consensus_queue.cc:260] T 16098a9f015040dc93d9cca2fc9ebce2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.886410 6457 ts_tablet_manager.cc:1434] T 16098a9f015040dc93d9cca2fc9ebce2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260923 19:49:58.886723 6457 tablet_bootstrap.cc:492] T c817af3eb83a43a3b6d4e9c83a9eefbb P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
W20260923 19:49:58.887454 5995 leader_election.cc:343] T 4beb8ce27cf84fe9bacae12e8ff496e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Not found: Tablet not found: 4beb8ce27cf84fe9bacae12e8ff496e3
I20260923 19:49:58.887648 5995 leader_election.cc:304] T 4beb8ce27cf84fe9bacae12e8ff496e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:49:58.887748 6459 tablet_replica.cc:333] T 1e1fef9ad60c4cf08507bb380f58fff3 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:49:58.887979 6459 raft_consensus.cc:2243] T 1e1fef9ad60c4cf08507bb380f58fff3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:49:58.887987 6466 raft_consensus.cc:3060] T 4beb8ce27cf84fe9bacae12e8ff496e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:49:58.888150 6459 raft_consensus.cc:2272] T 1e1fef9ad60c4cf08507bb380f58fff3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:49:58.888598 6457 tablet_bootstrap.cc:654] T c817af3eb83a43a3b6d4e9c83a9eefbb P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:58.889038 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 4beb8ce27cf84fe9bacae12e8ff496e3 (table default.Table_6c2dcdbec7e14073a25a9c532d94c479 [id=699382b6e1fa451c90111ad6e3972beb]) successfully deleted
W20260923 19:49:58.889348 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 57edfc8db29d498689ab77006d3fddfd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 57edfc8db29d498689ab77006d3fddfd already in progress: creating tablet
W20260923 19:49:58.889556 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet e67ef0eb259544a4b283cd03721bffe5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e67ef0eb259544a4b283cd03721bffe5 already in progress: creating tablet
W20260923 19:49:58.889837 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 0cdb778f87fa40b89dad97d166192a1e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0cdb778f87fa40b89dad97d166192a1e already in progress: creating tablet
W20260923 19:49:58.890071 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 13566283020c41c9b97d8c16678450d6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 13566283020c41c9b97d8c16678450d6 already in progress: creating tablet
I20260923 19:49:58.890424 6279 leader_election.cc:304] T 57edfc8db29d498689ab77006d3fddfd P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:49:58.891811 6508 raft_consensus.cc:2804] T 57edfc8db29d498689ab77006d3fddfd P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:49:58.891968 6508 raft_consensus.cc:493] T 57edfc8db29d498689ab77006d3fddfd P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:49:58.892071 6508 raft_consensus.cc:3060] T 57edfc8db29d498689ab77006d3fddfd P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:49:58.895231 6469 raft_consensus.cc:515] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.896220 6469 leader_election.cc:290] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:49:58.903601 6461 ts_tablet_manager.cc:1929] T 11f9db993b0541668e0babd466059ff6 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:49:58.903779 6461 log.cc:1199] T 11f9db993b0541668e0babd466059ff6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/11f9db993b0541668e0babd466059ff6
I20260923 19:49:58.904204 6461 ts_tablet_manager.cc:1950] T 11f9db993b0541668e0babd466059ff6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:49:58.905187 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1fef9ad60c4cf08507bb380f58fff3" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:49:58.905822 6459 ts_tablet_manager.cc:1916] T 1e1fef9ad60c4cf08507bb380f58fff3 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:49:58.905856 6280 leader_election.cc:343] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:49:58.906792 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1fef9ad60c4cf08507bb380f58fff3" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:49:58.907020 6060 raft_consensus.cc:3060] T 1e1fef9ad60c4cf08507bb380f58fff3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:49:58.915949 6321 tablet_service.cc:1558] Processing DeleteTablet for tablet 11f9db993b0541668e0babd466059ff6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:49:58.916534 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet 16098a9f015040dc93d9cca2fc9ebce2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:58 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:58.917577 6040 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e1fef9ad60c4cf08507bb380f58fff3 with delete_type TABLET_DATA_DELETED (replaced by tablet 8db0358af7634911820f99fe16605ca7) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:58.917724 6039 tablet_service.cc:1558] Processing DeleteTablet for tablet 38993814002d4391a9801c0cf55e5374 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:58 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:58.925349 5695 external_mini_cluster.cc:1372] Running /tmp/dist-test-task5JtCX2/build/asan/bin/kudu
/tmp/dist-test-task5JtCX2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.143.252:45543
--webserver_interface=127.5.143.252
--webserver_port=46305
--builtin_ntp_servers=127.5.143.212:38183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.143.254:37151,127.5.143.253:45285,127.5.143.252:45543
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260923 19:49:58.927174 6461 tablet_replica.cc:333] T 461b1718396e4750ad88394346a87d20 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:49:58.927490 6461 raft_consensus.cc:2243] T 461b1718396e4750ad88394346a87d20 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:49:58.927691 6461 raft_consensus.cc:2272] T 461b1718396e4750ad88394346a87d20 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:49:58.928542 6461 ts_tablet_manager.cc:1916] T 461b1718396e4750ad88394346a87d20 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:49:58.930856 6060 raft_consensus.cc:2468] T 1e1fef9ad60c4cf08507bb380f58fff3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:49:58.931419 6466 raft_consensus.cc:2749] T 4beb8ce27cf84fe9bacae12e8ff496e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:49:58.931896 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 11f9db993b0541668e0babd466059ff6 (table default.Table_a1e21fac044546acb4b417436464d269 [id=c5b2cbbf70c0433986e5c8c9430c9bfd]) successfully deleted
I20260923 19:49:58.932427 6279 leader_election.cc:304] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:49:58.933065 6469 raft_consensus.cc:2804] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:49:58.933264 6469 raft_consensus.cc:697] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:49:58.933698 6469 consensus_queue.cc:237] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.938690 6508 raft_consensus.cc:515] T 57edfc8db29d498689ab77006d3fddfd P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:58.939642 6508 leader_election.cc:290] T 57edfc8db29d498689ab77006d3fddfd P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:49:58.941128 6458 ts_tablet_manager.cc:1929] T c1b82e4a02794947b77040b6323ad96a P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:49:58.941303 6458 log.cc:1199] T c1b82e4a02794947b77040b6323ad96a P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/c1b82e4a02794947b77040b6323ad96a
I20260923 19:49:58.941779 6458 ts_tablet_manager.cc:1950] T c1b82e4a02794947b77040b6323ad96a P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:49:58.942890 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57edfc8db29d498689ab77006d3fddfd" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
W20260923 19:49:58.943730 6280 leader_election.cc:343] T 57edfc8db29d498689ab77006d3fddfd P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:49:58.950870 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57edfc8db29d498689ab77006d3fddfd" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:49:58.951329 6060 raft_consensus.cc:3060] T 57edfc8db29d498689ab77006d3fddfd P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:49:58.969901 5800 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_88b60f3e46a743d3913e7a4c0f353a59" } modify_external_catalogs: true
I20260923 19:49:58.970227 5800 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_88b60f3e46a743d3913e7a4c0f353a59" } modify_external_catalogs: true
W20260923 19:49:59.009348 5804 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 199843bdd7184df58be9a4a06a5ffb8b consensus state has no leader
I20260923 19:49:59.009814 5804 master_service.cc:960] ReplaceTablet: received request to replace tablet 13566283020c41c9b97d8c16678450d6 from {username='slave'} at 127.0.0.1:59912
I20260923 19:49:59.022409 6461 ts_tablet_manager.cc:1929] T 461b1718396e4750ad88394346a87d20 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:49:59.022595 6461 log.cc:1199] T 461b1718396e4750ad88394346a87d20 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/461b1718396e4750ad88394346a87d20
I20260923 19:49:59.022982 6461 ts_tablet_manager.cc:1950] T 461b1718396e4750ad88394346a87d20 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:49:59.026973 6459 ts_tablet_manager.cc:1929] T 1e1fef9ad60c4cf08507bb380f58fff3 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:49:59.027153 6459 log.cc:1199] T 1e1fef9ad60c4cf08507bb380f58fff3 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/1e1fef9ad60c4cf08507bb380f58fff3
I20260923 19:49:59.027525 6459 ts_tablet_manager.cc:1950] T 1e1fef9ad60c4cf08507bb380f58fff3 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:49:59.027844 5797 master_service.cc:960] ReplaceTablet: received request to replace tablet e67ef0eb259544a4b283cd03721bffe5 from {username='slave'} at 127.0.0.1:59912
I20260923 19:49:59.027844 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet c1b82e4a02794947b77040b6323ad96a (table default.Table_382e555ccd2a4ebda27bedf8b1cbb159 [id=ce8e51ef23914830a2fc7f9bb0d2ac68]) successfully deleted
I20260923 19:49:59.029420 6461 tablet_replica.cc:333] T 4beb8ce27cf84fe9bacae12e8ff496e3 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:49:59.029631 6461 raft_consensus.cc:2243] T 4beb8ce27cf84fe9bacae12e8ff496e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:49:59.029829 6461 raft_consensus.cc:2272] T 4beb8ce27cf84fe9bacae12e8ff496e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:49:59.030368 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 461b1718396e4750ad88394346a87d20 (table default.Table_77c8657d1b814c41b318ee97dbbd5b9f [id=1bbf846e9f4c45d988671ee7ee7f230e]) successfully deleted
W20260923 19:49:59.030673 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 0cdb778f87fa40b89dad97d166192a1e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0cdb778f87fa40b89dad97d166192a1e already in progress: creating tablet
I20260923 19:49:59.031021 6060 raft_consensus.cc:2468] T 57edfc8db29d498689ab77006d3fddfd P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:49:59.031199 6458 tablet_replica.cc:333] T 57edfc8db29d498689ab77006d3fddfd P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:49:59.031236 5797 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_c6eae8a1ba8a4263a38f1d0480c5fbd4" } new_table_name: "default.Table_61c4c80bb6264458b904d9b0322596c0" modify_external_catalogs: true
I20260923 19:49:59.031021 6461 ts_tablet_manager.cc:1916] T 4beb8ce27cf84fe9bacae12e8ff496e3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:49:59.033224 6454 tablet_bootstrap.cc:492] T cca0dc9ed824410bbed5a25afebb90e1 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:49:59.033465 6454 ts_tablet_manager.cc:1403] T cca0dc9ed824410bbed5a25afebb90e1 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.187s user 0.066s sys 0.099s
I20260923 19:49:59.034413 6454 raft_consensus.cc:359] T cca0dc9ed824410bbed5a25afebb90e1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.034577 6458 raft_consensus.cc:2243] T 57edfc8db29d498689ab77006d3fddfd P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:49:59.034793 6458 raft_consensus.cc:2272] T 57edfc8db29d498689ab77006d3fddfd P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:49:59.035000 6456 tablet_bootstrap.cc:492] T c14d36ad1b7241c894dbdff46159000c P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:49:59.035207 6456 ts_tablet_manager.cc:1403] T c14d36ad1b7241c894dbdff46159000c P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.161s user 0.018s sys 0.051s
I20260923 19:49:59.035378 6279 leader_election.cc:304] T 57edfc8db29d498689ab77006d3fddfd P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
W20260923 19:49:59.035655 6279 raft_consensus.cc:2686] T 57edfc8db29d498689ab77006d3fddfd P 2bf41435f70447f19992d368ca6b46bd: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260923 19:49:59.035651 6458 ts_tablet_manager.cc:1916] T 57edfc8db29d498689ab77006d3fddfd P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:49:59.036044 6456 raft_consensus.cc:359] T c14d36ad1b7241c894dbdff46159000c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.036280 6456 raft_consensus.cc:385] T c14d36ad1b7241c894dbdff46159000c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:59.036381 6456 raft_consensus.cc:740] T c14d36ad1b7241c894dbdff46159000c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:49:59.036708 6457 tablet_bootstrap.cc:492] T c817af3eb83a43a3b6d4e9c83a9eefbb P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:49:59.036682 5802 master_service.cc:960] ReplaceTablet: received request to replace tablet 16098a9f015040dc93d9cca2fc9ebce2 from {username='slave'} at 127.0.0.1:59912
I20260923 19:49:59.036672 6456 consensus_queue.cc:260] T c14d36ad1b7241c894dbdff46159000c P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.036921 6454 raft_consensus.cc:385] T cca0dc9ed824410bbed5a25afebb90e1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:59.037194 6456 ts_tablet_manager.cc:1434] T c14d36ad1b7241c894dbdff46159000c P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:49:59.037374 6454 raft_consensus.cc:740] T cca0dc9ed824410bbed5a25afebb90e1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:49:59.037609 6456 tablet_bootstrap.cc:492] T 199843bdd7184df58be9a4a06a5ffb8b P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:49:59.037981 6454 consensus_queue.cc:260] T cca0dc9ed824410bbed5a25afebb90e1 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.039669 6457 ts_tablet_manager.cc:1403] T c817af3eb83a43a3b6d4e9c83a9eefbb P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.151s user 0.030s sys 0.034s
I20260923 19:49:59.039700 6456 tablet_bootstrap.cc:654] T 199843bdd7184df58be9a4a06a5ffb8b P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:59.040601 6457 raft_consensus.cc:359] T c817af3eb83a43a3b6d4e9c83a9eefbb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.041610 6454 ts_tablet_manager.cc:1434] T cca0dc9ed824410bbed5a25afebb90e1 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260923 19:49:59.042171 6457 raft_consensus.cc:385] T c817af3eb83a43a3b6d4e9c83a9eefbb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:59.042382 6457 raft_consensus.cc:740] T c817af3eb83a43a3b6d4e9c83a9eefbb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:49:59.042955 6454 tablet_bootstrap.cc:492] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:49:59.043413 6456 tablet_bootstrap.cc:492] T 199843bdd7184df58be9a4a06a5ffb8b P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:49:59.043643 6456 ts_tablet_manager.cc:1403] T 199843bdd7184df58be9a4a06a5ffb8b P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.002s
I20260923 19:49:59.044027 6457 consensus_queue.cc:260] T c817af3eb83a43a3b6d4e9c83a9eefbb P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.044456 6456 raft_consensus.cc:359] T 199843bdd7184df58be9a4a06a5ffb8b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.044674 6456 raft_consensus.cc:385] T 199843bdd7184df58be9a4a06a5ffb8b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:59.044775 6456 raft_consensus.cc:740] T 199843bdd7184df58be9a4a06a5ffb8b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:49:59.044992 6456 consensus_queue.cc:260] T 199843bdd7184df58be9a4a06a5ffb8b P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.045258 6508 raft_consensus.cc:493] T 11f9db993b0541668e0babd466059ff6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:49:59.045394 6508 raft_consensus.cc:515] T 11f9db993b0541668e0babd466059ff6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.045512 6456 ts_tablet_manager.cc:1434] T 199843bdd7184df58be9a4a06a5ffb8b P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260923 19:49:59.045848 6456 tablet_bootstrap.cc:492] T 223edddace234a16b2d360504a99c28b P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:49:59.046111 6508 leader_election.cc:290] T 11f9db993b0541668e0babd466059ff6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:49:59.047911 6456 tablet_bootstrap.cc:654] T 223edddace234a16b2d360504a99c28b P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:59.049423 6454 tablet_bootstrap.cc:654] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:59.049718 6457 ts_tablet_manager.cc:1434] T c817af3eb83a43a3b6d4e9c83a9eefbb P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260923 19:49:59.050163 6457 tablet_bootstrap.cc:492] T 38993814002d4391a9801c0cf55e5374 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:49:59.052049 6457 tablet_bootstrap.cc:654] T 38993814002d4391a9801c0cf55e5374 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:59.055210 6456 tablet_bootstrap.cc:492] T 223edddace234a16b2d360504a99c28b P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:49:59.055392 6456 ts_tablet_manager.cc:1403] T 223edddace234a16b2d360504a99c28b P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s
I20260923 19:49:59.056315 6456 raft_consensus.cc:359] T 223edddace234a16b2d360504a99c28b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.056559 6456 raft_consensus.cc:385] T 223edddace234a16b2d360504a99c28b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:59.056668 6456 raft_consensus.cc:740] T 223edddace234a16b2d360504a99c28b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:49:59.057058 5805 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet d3009193f7e44af2b29e41407d46f52a
I20260923 19:49:59.057533 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_725d284e03844342909746398cb12562"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:59.057765 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8a2fbac8080441d4a9e03ff1d580bc8e consensus state has no leader
I20260923 19:49:59.058288 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_1839abf2a7cd49589075d19a0fb9b337" } new_table_name: "default.Table_d9565c591cc1467e9b8284d62c696644" modify_external_catalogs: true
W20260923 19:49:59.061198 6279 leader_election.cc:343] T 11f9db993b0541668e0babd466059ff6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 11f9db993b0541668e0babd466059ff6
I20260923 19:49:59.065476 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f9db993b0541668e0babd466059ff6" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:49:59.058300 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_725d284e03844342909746398cb12562 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:59.068989 6456 consensus_queue.cc:260] T 223edddace234a16b2d360504a99c28b P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.071177 6456 ts_tablet_manager.cc:1434] T 223edddace234a16b2d360504a99c28b P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
W20260923 19:49:59.071964 6280 leader_election.cc:343] T 11f9db993b0541668e0babd466059ff6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:49:59.072113 6280 leader_election.cc:304] T 11f9db993b0541668e0babd466059ff6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:49:59.072579 6508 raft_consensus.cc:2749] T 11f9db993b0541668e0babd466059ff6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:49:59.074450 6454 tablet_bootstrap.cc:492] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:49:59.074615 6454 ts_tablet_manager.cc:1403] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.032s user 0.007s sys 0.005s
I20260923 19:49:59.075429 6454 raft_consensus.cc:359] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.075639 6454 raft_consensus.cc:385] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:59.075757 6454 raft_consensus.cc:740] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:49:59.076022 6454 consensus_queue.cc:260] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.076637 6454 ts_tablet_manager.cc:1434] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:49:59.077006 6454 tablet_bootstrap.cc:492] T 11f9db993b0541668e0babd466059ff6 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:49:59.072573 6456 tablet_bootstrap.cc:492] T 3158b344d1c748aab5004543e4448adb P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:49:59.078907 6454 tablet_bootstrap.cc:654] T 11f9db993b0541668e0babd466059ff6 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:59.081202 6456 tablet_bootstrap.cc:654] T 3158b344d1c748aab5004543e4448adb P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:59.081915 6457 tablet_bootstrap.cc:492] T 38993814002d4391a9801c0cf55e5374 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:49:59.082086 6457 ts_tablet_manager.cc:1403] T 38993814002d4391a9801c0cf55e5374 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.032s user 0.008s sys 0.011s
I20260923 19:49:59.083082 6457 raft_consensus.cc:359] T 38993814002d4391a9801c0cf55e5374 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.083354 6457 raft_consensus.cc:385] T 38993814002d4391a9801c0cf55e5374 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:59.083451 6457 raft_consensus.cc:740] T 38993814002d4391a9801c0cf55e5374 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:49:59.083887 6457 consensus_queue.cc:260] T 38993814002d4391a9801c0cf55e5374 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.088454 6457 ts_tablet_manager.cc:1434] T 38993814002d4391a9801c0cf55e5374 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260923 19:49:59.089248 6457 tablet_bootstrap.cc:492] T c1b82e4a02794947b77040b6323ad96a P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:49:59.092662 6457 tablet_bootstrap.cc:654] T c1b82e4a02794947b77040b6323ad96a P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:59.095083 6456 tablet_bootstrap.cc:492] T 3158b344d1c748aab5004543e4448adb P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:49:59.095366 6456 ts_tablet_manager.cc:1403] T 3158b344d1c748aab5004543e4448adb P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.015s
I20260923 19:49:59.097419 6456 raft_consensus.cc:359] T 3158b344d1c748aab5004543e4448adb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.097625 6456 raft_consensus.cc:385] T 3158b344d1c748aab5004543e4448adb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:59.097699 6456 raft_consensus.cc:740] T 3158b344d1c748aab5004543e4448adb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:49:59.098033 6456 consensus_queue.cc:260] T 3158b344d1c748aab5004543e4448adb P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.098595 6456 ts_tablet_manager.cc:1434] T 3158b344d1c748aab5004543e4448adb P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260923 19:49:59.099833 6457 tablet_bootstrap.cc:492] T c1b82e4a02794947b77040b6323ad96a P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:49:59.100008 6457 ts_tablet_manager.cc:1403] T c1b82e4a02794947b77040b6323ad96a P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.001s
I20260923 19:49:59.100889 6457 raft_consensus.cc:359] T c1b82e4a02794947b77040b6323ad96a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.101115 6457 raft_consensus.cc:385] T c1b82e4a02794947b77040b6323ad96a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:59.101200 6457 raft_consensus.cc:740] T c1b82e4a02794947b77040b6323ad96a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:49:59.101523 6457 consensus_queue.cc:260] T c1b82e4a02794947b77040b6323ad96a P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.102702 6457 ts_tablet_manager.cc:1434] T c1b82e4a02794947b77040b6323ad96a P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
W20260923 19:49:59.102871 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 223edddace234a16b2d360504a99c28b consensus state has no leader
I20260923 19:49:59.103246 6457 tablet_bootstrap.cc:492] T e67ef0eb259544a4b283cd03721bffe5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:49:59.103421 5801 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_24cb0f5e10b74268b41c6fde2d1a9409" } modify_external_catalogs: true
I20260923 19:49:59.103659 5801 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_24cb0f5e10b74268b41c6fde2d1a9409" } modify_external_catalogs: true
I20260923 19:49:59.105962 6457 tablet_bootstrap.cc:654] T e67ef0eb259544a4b283cd03721bffe5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:59.110616 6454 tablet_bootstrap.cc:492] T 11f9db993b0541668e0babd466059ff6 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:49:59.110607 6322 tablet_service.cc:1511] Processing CreateTablet for tablet 4dbc0e17d77140f6abe9ee26c8ec13ee (DEFAULT_TABLE table=default.Table_73b9e29628e7432a929c5e9c193d22fa [id=67292e21e6b546298c5d629c6ebcb718]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.110854 6454 ts_tablet_manager.cc:1403] T 11f9db993b0541668e0babd466059ff6 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.034s user 0.016s sys 0.015s
I20260923 19:49:59.111145 5802 master_service.cc:960] ReplaceTablet: received request to replace tablet 3158b344d1c748aab5004543e4448adb from {username='slave'} at 127.0.0.1:59912
I20260923 19:49:59.111220 6321 tablet_service.cc:1511] Processing CreateTablet for tablet 32c8333073574fe79bfc3e33f3249256 (DEFAULT_TABLE table=default.Table_c6eae8a1ba8a4263a38f1d0480c5fbd4 [id=3fb7e854da784756b57db432e6c373db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.111935 5796 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet c817af3eb83a43a3b6d4e9c83a9eefbb (table default.Table_8e6e41e025804f89b18881a02817d3f1 [id=b9b7fe147b8645389ebef237fa735b2b]). Expected version 1 got 0
I20260923 19:49:59.111881 6454 raft_consensus.cc:359] T 11f9db993b0541668e0babd466059ff6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.112161 6454 raft_consensus.cc:385] T 11f9db993b0541668e0babd466059ff6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:59.112243 6454 raft_consensus.cc:740] T 11f9db993b0541668e0babd466059ff6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:49:59.112607 6454 consensus_queue.cc:260] T 11f9db993b0541668e0babd466059ff6 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.112697 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_e98e3cad705343819726665a1b6732d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:49:59.113155 6454 ts_tablet_manager.cc:1434] T 11f9db993b0541668e0babd466059ff6 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260923 19:49:59.113225 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e98e3cad705343819726665a1b6732d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:49:59.113437 5797 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 32c8333073574fe79bfc3e33f3249256 consensus state has no leader
I20260923 19:49:59.115008 6181 tablet_service.cc:1511] Processing CreateTablet for tablet 4dbc0e17d77140f6abe9ee26c8ec13ee (DEFAULT_TABLE table=default.Table_73b9e29628e7432a929c5e9c193d22fa [id=67292e21e6b546298c5d629c6ebcb718]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.115440 6180 tablet_service.cc:1511] Processing CreateTablet for tablet 32c8333073574fe79bfc3e33f3249256 (DEFAULT_TABLE table=default.Table_c6eae8a1ba8a4263a38f1d0480c5fbd4 [id=3fb7e854da784756b57db432e6c373db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.113819 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_a5f8ff7925264093b2de9ce72248f714"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:59.117347 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a5f8ff7925264093b2de9ce72248f714 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:59.118626 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32c8333073574fe79bfc3e33f3249256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.119230 6454 tablet_bootstrap.cc:492] T 29b2b75a12cb4ea3b73afe0ac549386f P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:49:59.121097 6454 tablet_bootstrap.cc:654] T 29b2b75a12cb4ea3b73afe0ac549386f P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:59.122351 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dbc0e17d77140f6abe9ee26c8ec13ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.126480 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 1e1fef9ad60c4cf08507bb380f58fff3 (table default.Table_02aee02d3b8746ce98cba010a0ac8149 [id=47c37093044c462993bba6cb00bd296a]) successfully deleted
I20260923 19:49:59.127547 6466 raft_consensus.cc:493] T 29b2b75a12cb4ea3b73afe0ac549386f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:49:59.127734 6466 raft_consensus.cc:515] T 29b2b75a12cb4ea3b73afe0ac549386f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.128705 6466 leader_election.cc:290] T 29b2b75a12cb4ea3b73afe0ac549386f P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:49:59.133433 6322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dbc0e17d77140f6abe9ee26c8ec13ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.134018 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32c8333073574fe79bfc3e33f3249256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.139317 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_5a37113811124370ba5d20a7ed3a5771"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:59.140142 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5a37113811124370ba5d20a7ed3a5771 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:59.142897 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_ef15680a91354f2696ca46dc6f2562e5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:59.143636 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ef15680a91354f2696ca46dc6f2562e5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:59.147605 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29b2b75a12cb4ea3b73afe0ac549386f" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:49:59.148327 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 4dbc0e17d77140f6abe9ee26c8ec13ee (DEFAULT_TABLE table=default.Table_73b9e29628e7432a929c5e9c193d22fa [id=67292e21e6b546298c5d629c6ebcb718]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.148902 6039 tablet_service.cc:1511] Processing CreateTablet for tablet 32c8333073574fe79bfc3e33f3249256 (DEFAULT_TABLE table=default.Table_c6eae8a1ba8a4263a38f1d0480c5fbd4 [id=3fb7e854da784756b57db432e6c373db]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:49:59.150949 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 16098a9f015040dc93d9cca2fc9ebce2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16098a9f015040dc93d9cca2fc9ebce2 already in progress: creating tablet
W20260923 19:49:59.151337 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 38993814002d4391a9801c0cf55e5374 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 38993814002d4391a9801c0cf55e5374 already in progress: creating tablet
W20260923 19:49:59.163389 5995 leader_election.cc:343] T 29b2b75a12cb4ea3b73afe0ac549386f P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:49:59.170010 5801 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet bde3d7a63d134944918da28b1f6e368a
I20260923 19:49:59.170431 5800 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet c14d36ad1b7241c894dbdff46159000c
I20260923 19:49:59.172062 6321 tablet_service.cc:1558] Processing DeleteTablet for tablet c14d36ad1b7241c894dbdff46159000c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:58 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:49:59.172773 5797 master_service.cc:960] ReplaceTablet: received request to replace tablet 0cdb778f87fa40b89dad97d166192a1e from {username='slave'} at 127.0.0.1:59912
I20260923 19:49:59.174981 6175 tablet_service.cc:1558] Processing DeleteTablet for tablet c14d36ad1b7241c894dbdff46159000c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:58 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:59.175966 6456 tablet_bootstrap.cc:492] T e655ab5873294e75a242709f069aabf2 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:49:59.177769 6456 tablet_bootstrap.cc:654] T e655ab5873294e75a242709f069aabf2 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:49:59.179538 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet c14d36ad1b7241c894dbdff46159000c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c14d36ad1b7241c894dbdff46159000c already in progress: creating tablet
I20260923 19:49:59.192263 6456 tablet_bootstrap.cc:492] T e655ab5873294e75a242709f069aabf2 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:49:59.192569 6456 ts_tablet_manager.cc:1403] T e655ab5873294e75a242709f069aabf2 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.017s user 0.010s sys 0.001s
I20260923 19:49:59.193449 6456 raft_consensus.cc:359] T e655ab5873294e75a242709f069aabf2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.193850 6456 raft_consensus.cc:385] T e655ab5873294e75a242709f069aabf2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:59.194121 6456 raft_consensus.cc:740] T e655ab5873294e75a242709f069aabf2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:49:59.194449 6456 consensus_queue.cc:260] T e655ab5873294e75a242709f069aabf2 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.194947 6040 tablet_service.cc:1558] Processing DeleteTablet for tablet c14d36ad1b7241c894dbdff46159000c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:58 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:59.195446 6456 ts_tablet_manager.cc:1434] T e655ab5873294e75a242709f069aabf2 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260923 19:49:59.195808 6456 tablet_bootstrap.cc:492] T 259e4faa58f549699538317019be5daf P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:49:59.197640 6456 tablet_bootstrap.cc:654] T 259e4faa58f549699538317019be5daf P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:49:59.199980 5996 leader_election.cc:343] T 29b2b75a12cb4ea3b73afe0ac549386f P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 29b2b75a12cb4ea3b73afe0ac549386f
I20260923 19:49:59.200147 5996 leader_election.cc:304] T 29b2b75a12cb4ea3b73afe0ac549386f P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:49:59.200644 6466 raft_consensus.cc:2749] T 29b2b75a12cb4ea3b73afe0ac549386f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:49:59.211678 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_ac282a79af174a87b864e9156993fd25"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:49:59.211998 6456 tablet_bootstrap.cc:492] T 259e4faa58f549699538317019be5daf P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:49:59.212239 6456 ts_tablet_manager.cc:1403] T 259e4faa58f549699538317019be5daf P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.008s
I20260923 19:49:59.213056 6456 raft_consensus.cc:359] T 259e4faa58f549699538317019be5daf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.213264 6456 raft_consensus.cc:385] T 259e4faa58f549699538317019be5daf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:59.213335 6456 raft_consensus.cc:740] T 259e4faa58f549699538317019be5daf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:49:59.215844 6456 consensus_queue.cc:260] T 259e4faa58f549699538317019be5daf P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.216463 6456 ts_tablet_manager.cc:1434] T 259e4faa58f549699538317019be5daf P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260923 19:49:59.217667 6456 tablet_bootstrap.cc:492] T 0cdb778f87fa40b89dad97d166192a1e P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:49:59.219564 6456 tablet_bootstrap.cc:654] T 0cdb778f87fa40b89dad97d166192a1e P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:49:59.212534 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac282a79af174a87b864e9156993fd25 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:59.214422 5804 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a04bbcc870f94f609935f519709a7d95" } modify_external_catalogs: true
I20260923 19:49:59.224030 5804 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a04bbcc870f94f609935f519709a7d95" } modify_external_catalogs: true
I20260923 19:49:59.224097 6457 tablet_bootstrap.cc:492] T e67ef0eb259544a4b283cd03721bffe5 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:49:59.224256 6457 ts_tablet_manager.cc:1403] T e67ef0eb259544a4b283cd03721bffe5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.121s user 0.020s sys 0.033s
I20260923 19:49:59.224486 6454 tablet_bootstrap.cc:492] T 29b2b75a12cb4ea3b73afe0ac549386f P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:49:59.214679 5801 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f1e7b89f9642419a93fed2c6c85f26c8" } modify_external_catalogs: true
I20260923 19:49:59.224628 6454 ts_tablet_manager.cc:1403] T 29b2b75a12cb4ea3b73afe0ac549386f P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.106s user 0.027s sys 0.042s
I20260923 19:49:59.224609 5801 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f1e7b89f9642419a93fed2c6c85f26c8" } modify_external_catalogs: true
I20260923 19:49:59.225446 6454 raft_consensus.cc:359] T 29b2b75a12cb4ea3b73afe0ac549386f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.225627 6454 raft_consensus.cc:385] T 29b2b75a12cb4ea3b73afe0ac549386f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:59.225711 6454 raft_consensus.cc:740] T 29b2b75a12cb4ea3b73afe0ac549386f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:49:59.225966 6454 consensus_queue.cc:260] T 29b2b75a12cb4ea3b73afe0ac549386f P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.226486 6454 ts_tablet_manager.cc:1434] T 29b2b75a12cb4ea3b73afe0ac549386f P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:49:59.226833 6454 tablet_bootstrap.cc:492] T e67ef0eb259544a4b283cd03721bffe5 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:49:59.228689 6454 tablet_bootstrap.cc:654] T e67ef0eb259544a4b283cd03721bffe5 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:59.228801 6461 ts_tablet_manager.cc:1929] T 4beb8ce27cf84fe9bacae12e8ff496e3 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:49:59.228928 6461 log.cc:1199] T 4beb8ce27cf84fe9bacae12e8ff496e3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/4beb8ce27cf84fe9bacae12e8ff496e3
I20260923 19:49:59.229318 6461 ts_tablet_manager.cc:1950] T 4beb8ce27cf84fe9bacae12e8ff496e3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:49:59.229755 6458 ts_tablet_manager.cc:1929] T 57edfc8db29d498689ab77006d3fddfd P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:49:59.230876 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dbc0e17d77140f6abe9ee26c8ec13ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.231432 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32c8333073574fe79bfc3e33f3249256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.235131 6512 raft_consensus.cc:493] T 223edddace234a16b2d360504a99c28b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:49:59.235325 6512 raft_consensus.cc:515] T 223edddace234a16b2d360504a99c28b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.236225 6512 leader_election.cc:290] T 223edddace234a16b2d360504a99c28b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:49:59.237003 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "223edddace234a16b2d360504a99c28b" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:49:59.237515 6458 log.cc:1199] T 57edfc8db29d498689ab77006d3fddfd P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/57edfc8db29d498689ab77006d3fddfd
W20260923 19:49:59.237562 6279 leader_election.cc:343] T 223edddace234a16b2d360504a99c28b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:49:59.238644 6458 ts_tablet_manager.cc:1950] T 57edfc8db29d498689ab77006d3fddfd P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:49:59.243453 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_d92791d5f2ea45269d76ff9c82be1880"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:59.244256 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d92791d5f2ea45269d76ff9c82be1880 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:59.244339 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "223edddace234a16b2d360504a99c28b" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:49:59.246378 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_a34330ce2a604efca09f754e4d3e2127"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:59.247130 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a34330ce2a604efca09f754e4d3e2127 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:59.255560 6466 raft_consensus.cc:493] T 16098a9f015040dc93d9cca2fc9ebce2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:49:59.255796 6466 raft_consensus.cc:515] T 16098a9f015040dc93d9cca2fc9ebce2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.256148 6457 raft_consensus.cc:359] T e67ef0eb259544a4b283cd03721bffe5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.256343 6457 raft_consensus.cc:385] T e67ef0eb259544a4b283cd03721bffe5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:59.256438 6457 raft_consensus.cc:740] T e67ef0eb259544a4b283cd03721bffe5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:49:59.256765 6466 leader_election.cc:290] T 16098a9f015040dc93d9cca2fc9ebce2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:49:59.257521 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16098a9f015040dc93d9cca2fc9ebce2" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:49:59.258157 5995 leader_election.cc:343] T 16098a9f015040dc93d9cca2fc9ebce2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:49:59.256769 6457 consensus_queue.cc:260] T e67ef0eb259544a4b283cd03721bffe5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.262491 6457 ts_tablet_manager.cc:1434] T e67ef0eb259544a4b283cd03721bffe5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.038s user 0.003s sys 0.000s
I20260923 19:49:59.263062 6457 tablet_bootstrap.cc:492] T 13566283020c41c9b97d8c16678450d6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:49:59.265071 6457 tablet_bootstrap.cc:654] T 13566283020c41c9b97d8c16678450d6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:59.267342 6456 tablet_bootstrap.cc:492] T 0cdb778f87fa40b89dad97d166192a1e P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:49:59.267623 6456 ts_tablet_manager.cc:1403] T 0cdb778f87fa40b89dad97d166192a1e P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.050s user 0.004s sys 0.001s
I20260923 19:49:59.268620 6456 raft_consensus.cc:359] T 0cdb778f87fa40b89dad97d166192a1e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.268834 6456 raft_consensus.cc:385] T 0cdb778f87fa40b89dad97d166192a1e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:59.268910 6456 raft_consensus.cc:740] T 0cdb778f87fa40b89dad97d166192a1e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:49:59.269172 6456 consensus_queue.cc:260] T 0cdb778f87fa40b89dad97d166192a1e P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.269788 6456 ts_tablet_manager.cc:1434] T 0cdb778f87fa40b89dad97d166192a1e P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:49:59.270139 6456 tablet_bootstrap.cc:492] T 8a2fbac8080441d4a9e03ff1d580bc8e P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:49:59.271884 6456 tablet_bootstrap.cc:654] T 8a2fbac8080441d4a9e03ff1d580bc8e P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:59.285738 6456 tablet_bootstrap.cc:492] T 8a2fbac8080441d4a9e03ff1d580bc8e P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:49:59.285993 6456 ts_tablet_manager.cc:1403] T 8a2fbac8080441d4a9e03ff1d580bc8e P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.006s
I20260923 19:49:59.286459 5798 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 5725a9cb95c448d0a5ea8114e90bc9fe (table default.Table_1d045e195d50465784c49c6ecdc0e167 [id=d3b60b7fc1d84a46aa49932d5c3363ea]). Expected version 2 got 0
I20260923 19:49:59.286825 6456 raft_consensus.cc:359] T 8a2fbac8080441d4a9e03ff1d580bc8e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.287060 6456 raft_consensus.cc:385] T 8a2fbac8080441d4a9e03ff1d580bc8e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:59.287129 6456 raft_consensus.cc:740] T 8a2fbac8080441d4a9e03ff1d580bc8e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:49:59.286928 5798 catalog_manager.cc:5838] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193). New cstate: current_term: 1 leader_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: UNKNOWN } } }
I20260923 19:49:59.288069 5798 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 2f78261842744af08d86da64d37d708c (table default.Table_088b66f184a84e1dbfac0965c064ee09 [id=7e9508e469b14579a0c697ac4ca5cc4a]). Expected version 3 got 0
I20260923 19:49:59.289486 6456 consensus_queue.cc:260] T 8a2fbac8080441d4a9e03ff1d580bc8e P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.290084 6456 ts_tablet_manager.cc:1434] T 8a2fbac8080441d4a9e03ff1d580bc8e P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260923 19:49:59.290437 6456 tablet_bootstrap.cc:492] T 09bb2ab5617a49d99e75191b3b48b85f P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
W20260923 19:49:59.290772 5799 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2f78261842744af08d86da64d37d708c consensus state has no leader
I20260923 19:49:59.292215 6456 tablet_bootstrap.cc:654] T 09bb2ab5617a49d99e75191b3b48b85f P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:59.292968 6180 tablet_service.cc:1511] Processing CreateTablet for tablet e52d78a941a341d186dc00bbe7df96bf (DEFAULT_TABLE table=default.Table_a04bbcc870f94f609935f519709a7d95 [id=ff751c756a0240a18ca02cbb9d44e73d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.293304 6322 tablet_service.cc:1511] Processing CreateTablet for tablet e52d78a941a341d186dc00bbe7df96bf (DEFAULT_TABLE table=default.Table_a04bbcc870f94f609935f519709a7d95 [id=ff751c756a0240a18ca02cbb9d44e73d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.293422 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e52d78a941a341d186dc00bbe7df96bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.293774 6322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e52d78a941a341d186dc00bbe7df96bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.294178 6181 tablet_service.cc:1511] Processing CreateTablet for tablet 9ed630e738c54ed38b9933f95fb552c5 (DEFAULT_TABLE table=default.Table_f8e149be0f0d456894956d425be24693 [id=c97fdc3b0e4447c284ad90fab54a1fa5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.294508 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ed630e738c54ed38b9933f95fb552c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.298334 6175 tablet_service.cc:1558] Processing DeleteTablet for tablet 461b1718396e4750ad88394346a87d20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:59.298390 6321 tablet_service.cc:1511] Processing CreateTablet for tablet 9ed630e738c54ed38b9933f95fb552c5 (DEFAULT_TABLE table=default.Table_f8e149be0f0d456894956d425be24693 [id=c97fdc3b0e4447c284ad90fab54a1fa5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.298676 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e1fef9ad60c4cf08507bb380f58fff3 with delete_type TABLET_DATA_DELETED (replaced by tablet 8db0358af7634911820f99fe16605ca7) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:59.298806 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ed630e738c54ed38b9933f95fb552c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.299909 6459 tablet_replica.cc:333] T 461b1718396e4750ad88394346a87d20 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:49:59.300083 6459 raft_consensus.cc:2243] T 461b1718396e4750ad88394346a87d20 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:49:59.300267 6459 raft_consensus.cc:2272] T 461b1718396e4750ad88394346a87d20 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:49:59.300874 6459 ts_tablet_manager.cc:1916] T 461b1718396e4750ad88394346a87d20 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:49:59.302889 6318 tablet_service.cc:1511] Processing CreateTablet for tablet c52da04e5fe0454ea76bf4d99a930fd7 (DEFAULT_TABLE table=default.Table_dc62d1ed0f594a698f993c61a912cdbc [id=ca73f0867b5d49cfb0bb7cd2315c47f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.303269 6318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c52da04e5fe0454ea76bf4d99a930fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.306529 6183 tablet_service.cc:1511] Processing CreateTablet for tablet c52da04e5fe0454ea76bf4d99a930fd7 (DEFAULT_TABLE table=default.Table_dc62d1ed0f594a698f993c61a912cdbc [id=ca73f0867b5d49cfb0bb7cd2315c47f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.308696 6181 tablet_service.cc:1511] Processing CreateTablet for tablet 87afbdb11c6e4e58affd2f2d7995e1f8 (DEFAULT_TABLE table=default.Table_f57f5ddf52f541ab91b4a9638fcf81a0 [id=e0da333ed7f44d6aa283da81b1cfbf17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.311326 6175 tablet_service.cc:1511] Processing CreateTablet for tablet 8db0358af7634911820f99fe16605ca7 (DEFAULT_TABLE table=default.Table_02aee02d3b8746ce98cba010a0ac8149 [id=47c37093044c462993bba6cb00bd296a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.312371 6319 tablet_service.cc:1511] Processing CreateTablet for tablet 8db0358af7634911820f99fe16605ca7 (DEFAULT_TABLE table=default.Table_02aee02d3b8746ce98cba010a0ac8149 [id=47c37093044c462993bba6cb00bd296a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.312819 6319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8db0358af7634911820f99fe16605ca7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.315445 6179 tablet_service.cc:1511] Processing CreateTablet for tablet 77f111a495f3429cb243417824095d02 (DEFAULT_TABLE table=default.Table_552860e790be402a91af4ff2e2185d10 [id=e98e62b25556431abdccca23fa9d81e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.321044 6461 tablet_replica.cc:333] T 16098a9f015040dc93d9cca2fc9ebce2 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:49:59.321352 6461 raft_consensus.cc:2243] T 16098a9f015040dc93d9cca2fc9ebce2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:49:59.321571 6461 raft_consensus.cc:2272] T 16098a9f015040dc93d9cca2fc9ebce2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:49:59.322667 6458 tablet_replica.cc:333] T e67ef0eb259544a4b283cd03721bffe5 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:49:59.322918 6458 raft_consensus.cc:2243] T e67ef0eb259544a4b283cd03721bffe5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:49:59.323119 6458 raft_consensus.cc:2272] T e67ef0eb259544a4b283cd03721bffe5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:49:59.323720 6458 ts_tablet_manager.cc:1916] T e67ef0eb259544a4b283cd03721bffe5 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:49:59.325942 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 77f111a495f3429cb243417824095d02 (DEFAULT_TABLE table=default.Table_552860e790be402a91af4ff2e2185d10 [id=e98e62b25556431abdccca23fa9d81e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.326445 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77f111a495f3429cb243417824095d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.330442 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 57edfc8db29d498689ab77006d3fddfd (table default.Table_83dc8a536f3944439f90216fd56a49b7 [id=ab7359c3bd74468a8e5eca672ba3fb1f]) successfully deleted
I20260923 19:49:59.334062 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c52da04e5fe0454ea76bf4d99a930fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.334347 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87afbdb11c6e4e58affd2f2d7995e1f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.334766 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77f111a495f3429cb243417824095d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.338276 6175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8db0358af7634911820f99fe16605ca7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.346567 6461 ts_tablet_manager.cc:1916] T 16098a9f015040dc93d9cca2fc9ebce2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:49:59.350293 6322 tablet_service.cc:1511] Processing CreateTablet for tablet 87afbdb11c6e4e58affd2f2d7995e1f8 (DEFAULT_TABLE table=default.Table_f57f5ddf52f541ab91b4a9638fcf81a0 [id=e0da333ed7f44d6aa283da81b1cfbf17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.350970 6322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87afbdb11c6e4e58affd2f2d7995e1f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.351537 6039 tablet_service.cc:1511] Processing CreateTablet for tablet e52d78a941a341d186dc00bbe7df96bf (DEFAULT_TABLE table=default.Table_a04bbcc870f94f609935f519709a7d95 [id=ff751c756a0240a18ca02cbb9d44e73d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.351938 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e52d78a941a341d186dc00bbe7df96bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.354179 6345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16098a9f015040dc93d9cca2fc9ebce2" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:49:59.354239 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 9ed630e738c54ed38b9933f95fb552c5 (DEFAULT_TABLE table=default.Table_f8e149be0f0d456894956d425be24693 [id=c97fdc3b0e4447c284ad90fab54a1fa5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.354496 6345 raft_consensus.cc:2468] T 16098a9f015040dc93d9cca2fc9ebce2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 0.
I20260923 19:49:59.354621 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ed630e738c54ed38b9933f95fb552c5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:49:59.355002 6280 leader_election.cc:343] T 223edddace234a16b2d360504a99c28b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:49:59.355170 6280 leader_election.cc:304] T 223edddace234a16b2d360504a99c28b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:49:59.355490 6512 raft_consensus.cc:2749] T 223edddace234a16b2d360504a99c28b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:49:59.356367 5996 leader_election.cc:304] T 16098a9f015040dc93d9cca2fc9ebce2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
W20260923 19:49:59.356670 5996 raft_consensus.cc:2686] T 16098a9f015040dc93d9cca2fc9ebce2 P e546f660e7e541d1aa9ae38e5ee5b9c0: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260923 19:49:59.357517 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 4beb8ce27cf84fe9bacae12e8ff496e3 (table default.Table_6c2dcdbec7e14073a25a9c532d94c479 [id=699382b6e1fa451c90111ad6e3972beb]) successfully deleted
I20260923 19:49:59.358289 6040 tablet_service.cc:1511] Processing CreateTablet for tablet c52da04e5fe0454ea76bf4d99a930fd7 (DEFAULT_TABLE table=default.Table_dc62d1ed0f594a698f993c61a912cdbc [id=ca73f0867b5d49cfb0bb7cd2315c47f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.358697 6040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c52da04e5fe0454ea76bf4d99a930fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.359117 6180 tablet_service.cc:1511] Processing CreateTablet for tablet 1a5f682ef2794a1fb9f5c4c2c1ee52e7 (DEFAULT_TABLE table=default.Table_3a938c91580b4d23a2a0fad133090624 [id=767c530f4e214408a45adcb31c9d0f28]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:49:59.361090 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 13566283020c41c9b97d8c16678450d6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 13566283020c41c9b97d8c16678450d6 already in progress: creating tablet
I20260923 19:49:59.362252 6036 tablet_service.cc:1511] Processing CreateTablet for tablet 87afbdb11c6e4e58affd2f2d7995e1f8 (DEFAULT_TABLE table=default.Table_f57f5ddf52f541ab91b4a9638fcf81a0 [id=e0da333ed7f44d6aa283da81b1cfbf17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.362665 6036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87afbdb11c6e4e58affd2f2d7995e1f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.363854 6182 tablet_service.cc:1511] Processing CreateTablet for tablet 4bf129dd52b84a4ea461ec454bc34fe8 (DEFAULT_TABLE table=default.Table_75d1617a325e4c6591795f8378cfa93d [id=5e08f31834ac4ba188ce1b23889287a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.367053 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 8db0358af7634911820f99fe16605ca7 (DEFAULT_TABLE table=default.Table_02aee02d3b8746ce98cba010a0ac8149 [id=47c37093044c462993bba6cb00bd296a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.367221 6178 tablet_service.cc:1511] Processing CreateTablet for tablet cc3b6d245c3e40cdabb20d7dcf07ec0e (DEFAULT_TABLE table=default.Table_30a13147f51347808f58bfef0919dd77 [id=da91b06e11c64bb0aaec37a0188b5586]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.367594 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8db0358af7634911820f99fe16605ca7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.370206 6471 raft_consensus.cc:493] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:49:59.370422 6471 raft_consensus.cc:515] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.371402 6471 leader_election.cc:290] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:49:59.376264 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5725a9cb95c448d0a5ea8114e90bc9fe" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:49:59.376521 6060 raft_consensus.cc:2468] T 5725a9cb95c448d0a5ea8114e90bc9fe P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:49:59.377281 6033 tablet_service.cc:1511] Processing CreateTablet for tablet 77f111a495f3429cb243417824095d02 (DEFAULT_TABLE table=default.Table_552860e790be402a91af4ff2e2185d10 [id=e98e62b25556431abdccca23fa9d81e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.377669 6033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77f111a495f3429cb243417824095d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.379873 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_11716058362a4681b084cb08a17de6f1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:59.380656 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11716058362a4681b084cb08a17de6f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:59.382196 5799 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d9565c591cc1467e9b8284d62c696644" } new_table_name: "default.Table_d4c5e4b161f843ce9dc495bc75e81488" modify_external_catalogs: true
I20260923 19:49:59.382320 6137 leader_election.cc:304] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:49:59.382880 6038 tablet_service.cc:1511] Processing CreateTablet for tablet 1a5f682ef2794a1fb9f5c4c2c1ee52e7 (DEFAULT_TABLE table=default.Table_3a938c91580b4d23a2a0fad133090624 [id=767c530f4e214408a45adcb31c9d0f28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.383301 6038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a5f682ef2794a1fb9f5c4c2c1ee52e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.386590 6035 tablet_service.cc:1511] Processing CreateTablet for tablet 4bf129dd52b84a4ea461ec454bc34fe8 (DEFAULT_TABLE table=default.Table_75d1617a325e4c6591795f8378cfa93d [id=5e08f31834ac4ba188ce1b23889287a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.387075 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bf129dd52b84a4ea461ec454bc34fe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.388983 5805 master_service.cc:960] ReplaceTablet: received request to replace tablet 3158b344d1c748aab5004543e4448adb from {username='slave'} at 127.0.0.1:59912
I20260923 19:49:59.390702 6032 tablet_service.cc:1511] Processing CreateTablet for tablet cc3b6d245c3e40cdabb20d7dcf07ec0e (DEFAULT_TABLE table=default.Table_30a13147f51347808f58bfef0919dd77 [id=da91b06e11c64bb0aaec37a0188b5586]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.390928 6345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5725a9cb95c448d0a5ea8114e90bc9fe" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:49:59.391235 6345 raft_consensus.cc:2468] T 5725a9cb95c448d0a5ea8114e90bc9fe P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:49:59.391330 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc3b6d245c3e40cdabb20d7dcf07ec0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.391647 6471 raft_consensus.cc:2804] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:49:59.391817 6471 raft_consensus.cc:493] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:49:59.391948 6471 raft_consensus.cc:3060] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:49:59.396008 6320 tablet_service.cc:1511] Processing CreateTablet for tablet 4bf129dd52b84a4ea461ec454bc34fe8 (DEFAULT_TABLE table=default.Table_75d1617a325e4c6591795f8378cfa93d [id=5e08f31834ac4ba188ce1b23889287a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.396442 6320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bf129dd52b84a4ea461ec454bc34fe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.402925 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_a949ff6346b345ffa7ce8d5d9a390997"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:59.403860 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a949ff6346b345ffa7ce8d5d9a390997 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:59.413954 6512 raft_consensus.cc:493] T c14d36ad1b7241c894dbdff46159000c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:49:59.414372 6512 raft_consensus.cc:515] T c14d36ad1b7241c894dbdff46159000c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.415303 6512 leader_election.cc:290] T c14d36ad1b7241c894dbdff46159000c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:49:59.422384 6324 tablet_service.cc:1511] Processing CreateTablet for tablet f7e282b6699a4ce9837d221132a1f54e (DEFAULT_TABLE table=default.Table_c0be6341515349798508cd7887abaa7e [id=b5b882261126409ea6b837b2c010dd9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.422493 6320 tablet_service.cc:1511] Processing CreateTablet for tablet cc3b6d245c3e40cdabb20d7dcf07ec0e (DEFAULT_TABLE table=default.Table_30a13147f51347808f58bfef0919dd77 [id=da91b06e11c64bb0aaec37a0188b5586]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.422865 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7e282b6699a4ce9837d221132a1f54e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.429780 6320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc3b6d245c3e40cdabb20d7dcf07ec0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.429994 6512 raft_consensus.cc:493] T 259e4faa58f549699538317019be5daf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:49:59.430174 6512 raft_consensus.cc:515] T 259e4faa58f549699538317019be5daf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.430895 6512 leader_election.cc:290] T 259e4faa58f549699538317019be5daf P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:49:59.431380 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14d36ad1b7241c894dbdff46159000c" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:49:59.433753 6177 tablet_service.cc:1511] Processing CreateTablet for tablet f7e282b6699a4ce9837d221132a1f54e (DEFAULT_TABLE table=default.Table_c0be6341515349798508cd7887abaa7e [id=b5b882261126409ea6b837b2c010dd9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.446651 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5a37113811124370ba5d20a7ed3a5771" } new_table_name: "default.Table_cb2f56ff38ac4d1992cfa9c08d3a0cf0" modify_external_catalogs: true
I20260923 19:49:59.448513 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 3158b344d1c748aab5004543e4448adb
I20260923 19:49:59.449142 5802 catalog_manager.cc:6934] ReplaceTablet: tablet 3158b344d1c748aab5004543e4448adb deleted and replaced by tablet 640a98d3a845461e8d4f07041ab515c7
I20260923 19:49:59.449234 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14d36ad1b7241c894dbdff46159000c" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:49:59.449587 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_61c4c80bb6264458b904d9b0322596c0" } modify_external_catalogs: true
I20260923 19:49:59.449944 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259e4faa58f549699538317019be5daf" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:49:59.450181 5801 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet e655ab5873294e75a242709f069aabf2
W20260923 19:49:59.450500 6279 leader_election.cc:343] T c14d36ad1b7241c894dbdff46159000c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:49:59.450896 6279 leader_election.cc:343] T 259e4faa58f549699538317019be5daf P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:49:59.451040 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_8e6e41e025804f89b18881a02817d3f1" } new_table_name: "default.Table_30f4ccabe7fa4c8ba92e008f3d9b2d80" modify_external_catalogs: true
I20260923 19:49:59.452790 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet e52d78a941a341d186dc00bbe7df96bf
I20260923 19:49:59.453625 5804 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ef15680a91354f2696ca46dc6f2562e5" } new_table_name: "default.Table_f3f7926d9a214e1bb8b8b42655baef50" modify_external_catalogs: true
I20260923 19:49:59.456060 5803 master_service.cc:960] ReplaceTablet: received request to replace tablet 199843bdd7184df58be9a4a06a5ffb8b from {username='slave'} at 127.0.0.1:59912
I20260923 19:49:59.457487 5797 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 199843bdd7184df58be9a4a06a5ffb8b (table default.Table_19746277e0c142bd8bfa415a7effbbe0 [id=a09c0c82fcc747babbd555f9aeae4ed9]). Expected version 1 got 0
I20260923 19:49:59.457759 5797 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 223edddace234a16b2d360504a99c28b (table default.Table_d9565c591cc1467e9b8284d62c696644 [id=ed438085f7054d9993a39852df4cc790]). Expected version 1 got 0
I20260923 19:49:59.458498 6320 tablet_service.cc:1558] Processing DeleteTablet for tablet 3158b344d1c748aab5004543e4448adb with delete_type TABLET_DATA_DELETED (replaced by tablet 640a98d3a845461e8d4f07041ab515c7) from {username='slave'} at 127.0.0.1:60210
I20260923 19:49:59.458738 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet e655ab5873294e75a242709f069aabf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:49:59.458947 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet e52d78a941a341d186dc00bbe7df96bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:49:59.459077 5799 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 223edddace234a16b2d360504a99c28b consensus state has no leader
I20260923 19:49:59.459374 5799 master_service.cc:960] ReplaceTablet: received request to replace tablet 13566283020c41c9b97d8c16678450d6 from {username='slave'} at 127.0.0.1:59912
I20260923 19:49:59.459941 6512 raft_consensus.cc:493] T e655ab5873294e75a242709f069aabf2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:49:59.460100 6512 raft_consensus.cc:515] T e655ab5873294e75a242709f069aabf2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.460053 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_607e77dd178f4b828d2b91cccdf593a8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:59.460776 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_607e77dd178f4b828d2b91cccdf593a8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:59.461005 6512 leader_election.cc:290] T e655ab5873294e75a242709f069aabf2 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:49:59.463322 5797 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_3a938c91580b4d23a2a0fad133090624" } modify_external_catalogs: true
I20260923 19:49:59.463474 5797 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_3a938c91580b4d23a2a0fad133090624" } modify_external_catalogs: true
I20260923 19:49:59.464860 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_adfa6338ea024e4a87e614cbc086cbc3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:59.465395 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_adfa6338ea024e4a87e614cbc086cbc3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:59.467561 5800 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 5725a9cb95c448d0a5ea8114e90bc9fe (table default.Table_1d045e195d50465784c49c6ecdc0e167 [id=d3b60b7fc1d84a46aa49932d5c3363ea]). Expected version 2 got 0
I20260923 19:49:59.468990 5800 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_19746277e0c142bd8bfa415a7effbbe0" } modify_external_catalogs: true
I20260923 19:49:59.469159 5800 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_19746277e0c142bd8bfa415a7effbbe0" } modify_external_catalogs: true
I20260923 19:49:59.471586 6176 tablet_service.cc:1558] Processing DeleteTablet for tablet 3158b344d1c748aab5004543e4448adb with delete_type TABLET_DATA_DELETED (replaced by tablet 640a98d3a845461e8d4f07041ab515c7) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:59.472000 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet e655ab5873294e75a242709f069aabf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:59.472738 6173 tablet_service.cc:1558] Processing DeleteTablet for tablet e52d78a941a341d186dc00bbe7df96bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:59.473012 6172 tablet_service.cc:1558] Processing DeleteTablet for tablet 11f9db993b0541668e0babd466059ff6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:59.473238 6171 tablet_service.cc:1558] Processing DeleteTablet for tablet cca0dc9ed824410bbed5a25afebb90e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:59.473536 6170 tablet_service.cc:1558] Processing DeleteTablet for tablet 29b2b75a12cb4ea3b73afe0ac549386f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:59.473994 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a5f682ef2794a1fb9f5c4c2c1ee52e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.474164 6459 ts_tablet_manager.cc:1929] T 461b1718396e4750ad88394346a87d20 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:49:59.474311 6459 log.cc:1199] T 461b1718396e4750ad88394346a87d20 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/461b1718396e4750ad88394346a87d20
I20260923 19:49:59.449803 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_61c4c80bb6264458b904d9b0322596c0" } modify_external_catalogs: true
I20260923 19:49:59.474586 6182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bf129dd52b84a4ea461ec454bc34fe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.474735 6459 ts_tablet_manager.cc:1950] T 461b1718396e4750ad88394346a87d20 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:49:59.475102 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc3b6d245c3e40cdabb20d7dcf07ec0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.475570 6177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7e282b6699a4ce9837d221132a1f54e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.478669 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e655ab5873294e75a242709f069aabf2" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
W20260923 19:49:59.480719 6279 leader_election.cc:343] T e655ab5873294e75a242709f069aabf2 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:49:59.485177 6039 tablet_service.cc:1558] Processing DeleteTablet for tablet e655ab5873294e75a242709f069aabf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:59.486209 6039 tablet_service.cc:1558] Processing DeleteTablet for tablet e52d78a941a341d186dc00bbe7df96bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:49:59.491902 6280 leader_election.cc:343] T c14d36ad1b7241c894dbdff46159000c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:49:59.492198 6280 leader_election.cc:304] T c14d36ad1b7241c894dbdff46159000c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:49:59.492570 6512 raft_consensus.cc:2749] T c14d36ad1b7241c894dbdff46159000c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:49:59.494284 6040 tablet_service.cc:1511] Processing CreateTablet for tablet f7e282b6699a4ce9837d221132a1f54e (DEFAULT_TABLE table=default.Table_c0be6341515349798508cd7887abaa7e [id=b5b882261126409ea6b837b2c010dd9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.497704 6038 tablet_service.cc:1558] Processing DeleteTablet for tablet 3158b344d1c748aab5004543e4448adb with delete_type TABLET_DATA_DELETED (replaced by tablet 640a98d3a845461e8d4f07041ab515c7) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:59.498271 6540 raft_consensus.cc:493] T 2f78261842744af08d86da64d37d708c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:49:59.498466 6540 raft_consensus.cc:515] T 2f78261842744af08d86da64d37d708c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.499745 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f78261842744af08d86da64d37d708c" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:49:59.499953 6033 tablet_service.cc:1558] Processing DeleteTablet for tablet 57edfc8db29d498689ab77006d3fddfd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:58 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:59.500393 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259e4faa58f549699538317019be5daf" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:49:59.500504 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e655ab5873294e75a242709f069aabf2" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:49:59.499764 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet 29b2b75a12cb4ea3b73afe0ac549386f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:57 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:49:59.501076 6280 leader_election.cc:343] T e655ab5873294e75a242709f069aabf2 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:49:59.501181 6540 leader_election.cc:290] T 2f78261842744af08d86da64d37d708c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:49:59.501235 6280 leader_election.cc:304] T e655ab5873294e75a242709f069aabf2 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:49:59.501245 6345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f78261842744af08d86da64d37d708c" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:49:59.501543 6345 raft_consensus.cc:2393] T 2f78261842744af08d86da64d37d708c P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61022dd7f2f14dc19aebe3af5f08f430 in current term 1: Already voted for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in this term.
W20260923 19:49:59.501693 6280 leader_election.cc:343] T 259e4faa58f549699538317019be5daf P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:49:59.501824 6280 leader_election.cc:304] T 259e4faa58f549699538317019be5daf P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:49:59.502076 6469 raft_consensus.cc:2749] T e655ab5873294e75a242709f069aabf2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:49:59.502121 6139 leader_election.cc:304] T 2f78261842744af08d86da64d37d708c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:49:59.502238 6469 raft_consensus.cc:2749] T 259e4faa58f549699538317019be5daf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:49:59.502415 6540 raft_consensus.cc:3060] T 2f78261842744af08d86da64d37d708c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:49:59.503055 6318 tablet_service.cc:1511] Processing CreateTablet for tablet 1a5f682ef2794a1fb9f5c4c2c1ee52e7 (DEFAULT_TABLE table=default.Table_3a938c91580b4d23a2a0fad133090624 [id=767c530f4e214408a45adcb31c9d0f28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.503698 6454 tablet_bootstrap.cc:492] T e67ef0eb259544a4b283cd03721bffe5 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:49:59.503870 6454 ts_tablet_manager.cc:1403] T e67ef0eb259544a4b283cd03721bffe5 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.277s user 0.063s sys 0.124s
I20260923 19:49:59.504560 6454 raft_consensus.cc:359] T e67ef0eb259544a4b283cd03721bffe5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.504748 6454 raft_consensus.cc:385] T e67ef0eb259544a4b283cd03721bffe5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:59.504814 6454 raft_consensus.cc:740] T e67ef0eb259544a4b283cd03721bffe5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:49:59.505030 6454 consensus_queue.cc:260] T e67ef0eb259544a4b283cd03721bffe5 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.507551 6457 tablet_bootstrap.cc:492] T 13566283020c41c9b97d8c16678450d6 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:49:59.507808 6457 ts_tablet_manager.cc:1403] T 13566283020c41c9b97d8c16678450d6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.245s user 0.007s sys 0.009s
I20260923 19:49:59.510761 5796 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet c817af3eb83a43a3b6d4e9c83a9eefbb (table default.Table_8e6e41e025804f89b18881a02817d3f1 [id=b9b7fe147b8645389ebef237fa735b2b]). Expected version 1 got 0
I20260923 19:49:59.513017 6457 raft_consensus.cc:359] T 13566283020c41c9b97d8c16678450d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.513513 6457 raft_consensus.cc:385] T 13566283020c41c9b97d8c16678450d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:59.513685 6457 raft_consensus.cc:740] T 13566283020c41c9b97d8c16678450d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:49:59.514063 6457 consensus_queue.cc:260] T 13566283020c41c9b97d8c16678450d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.517167 6457 ts_tablet_manager.cc:1434] T 13566283020c41c9b97d8c16678450d6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.009s user 0.000s sys 0.002s
I20260923 19:49:59.518035 6457 tablet_bootstrap.cc:492] T c14d36ad1b7241c894dbdff46159000c P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:49:59.521302 6345 raft_consensus.cc:1275] T 2f78261842744af08d86da64d37d708c P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Refusing update from remote peer e546f660e7e541d1aa9ae38e5ee5b9c0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:49:59.522097 6466 consensus_queue.cc:1048] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:49:59.524449 6454 ts_tablet_manager.cc:1434] T e67ef0eb259544a4b283cd03721bffe5 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.020s user 0.006s sys 0.006s
I20260923 19:49:59.524773 6454 tablet_bootstrap.cc:492] T 57edfc8db29d498689ab77006d3fddfd P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:49:59.526562 6454 tablet_bootstrap.cc:654] T 57edfc8db29d498689ab77006d3fddfd P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:59.530676 6471 raft_consensus.cc:515] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.531599 6471 leader_election.cc:290] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:49:59.534740 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5725a9cb95c448d0a5ea8114e90bc9fe" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:49:59.534996 6344 raft_consensus.cc:3060] T 5725a9cb95c448d0a5ea8114e90bc9fe P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:49:59.539680 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5725a9cb95c448d0a5ea8114e90bc9fe" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:49:59.539937 6060 raft_consensus.cc:3060] T 5725a9cb95c448d0a5ea8114e90bc9fe P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:49:59.543044 6454 tablet_bootstrap.cc:492] T 57edfc8db29d498689ab77006d3fddfd P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:49:59.543210 6454 ts_tablet_manager.cc:1403] T 57edfc8db29d498689ab77006d3fddfd P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.019s user 0.006s sys 0.000s
W20260923 19:49:59.543646 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7504a2be25b54ed4bc539eb10199fe15 has no consensus state
I20260923 19:49:59.544015 6454 raft_consensus.cc:359] T 57edfc8db29d498689ab77006d3fddfd P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.544202 6454 raft_consensus.cc:385] T 57edfc8db29d498689ab77006d3fddfd P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:59.544296 6454 raft_consensus.cc:740] T 57edfc8db29d498689ab77006d3fddfd P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:49:59.544531 6454 consensus_queue.cc:260] T 57edfc8db29d498689ab77006d3fddfd P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.544934 6542 raft_consensus.cc:493] T 11f9db993b0541668e0babd466059ff6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:49:59.545089 6542 raft_consensus.cc:515] T 11f9db993b0541668e0babd466059ff6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.545944 6542 leader_election.cc:290] T 11f9db993b0541668e0babd466059ff6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:49:59.546569 6454 ts_tablet_manager.cc:1434] T 57edfc8db29d498689ab77006d3fddfd P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:49:59.546893 6454 tablet_bootstrap.cc:492] T c817af3eb83a43a3b6d4e9c83a9eefbb P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:49:59.548481 5798 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 8a2fbac8080441d4a9e03ff1d580bc8e (table default.Table_d94eaba070fd454bb85f8ef139ba0a28 [id=738ed1d070ef485e9299c1f3b1db008a]). Expected version 1 got 0
I20260923 19:49:59.548820 6454 tablet_bootstrap.cc:654] T c817af3eb83a43a3b6d4e9c83a9eefbb P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
W20260923 19:49:59.552716 6137 leader_election.cc:343] T 11f9db993b0541668e0babd466059ff6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 11f9db993b0541668e0babd466059ff6
I20260923 19:49:59.553591 6454 tablet_bootstrap.cc:492] T c817af3eb83a43a3b6d4e9c83a9eefbb P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:49:59.553789 6454 ts_tablet_manager.cc:1403] T c817af3eb83a43a3b6d4e9c83a9eefbb P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.002s
W20260923 19:49:59.553853 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c817af3eb83a43a3b6d4e9c83a9eefbb consensus state has no leader
I20260923 19:49:59.554317 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_ba9e77809f194febb243d6dc37df3ee0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:49:59.554647 6454 raft_consensus.cc:359] T c817af3eb83a43a3b6d4e9c83a9eefbb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.554843 6454 raft_consensus.cc:385] T c817af3eb83a43a3b6d4e9c83a9eefbb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:59.554927 6454 raft_consensus.cc:740] T c817af3eb83a43a3b6d4e9c83a9eefbb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
W20260923 19:49:59.554943 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba9e77809f194febb243d6dc37df3ee0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:59.555002 6459 tablet_replica.cc:333] T 11f9db993b0541668e0babd466059ff6 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:49:59.555241 6459 raft_consensus.cc:2243] T 11f9db993b0541668e0babd466059ff6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:49:59.555202 6454 consensus_queue.cc:260] T c817af3eb83a43a3b6d4e9c83a9eefbb P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.555855 6459 raft_consensus.cc:2272] T 11f9db993b0541668e0babd466059ff6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:49:59.556275 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 461b1718396e4750ad88394346a87d20 (table default.Table_77c8657d1b814c41b318ee97dbbd5b9f [id=1bbf846e9f4c45d988671ee7ee7f230e]) successfully deleted
W20260923 19:49:59.556523 5791 catalog_manager.cc:5030] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 1e1fef9ad60c4cf08507bb380f58fff3 because the tablet was not found. No further retry: Not found: Tablet not found: 1e1fef9ad60c4cf08507bb380f58fff3
I20260923 19:49:59.556650 6459 ts_tablet_manager.cc:1916] T 11f9db993b0541668e0babd466059ff6 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:49:59.556764 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 3158b344d1c748aab5004543e4448adb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3158b344d1c748aab5004543e4448adb already in progress: creating tablet
W20260923 19:49:59.556960 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet e655ab5873294e75a242709f069aabf2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e655ab5873294e75a242709f069aabf2 already in progress: creating tablet
W20260923 19:49:59.557173 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet e52d78a941a341d186dc00bbe7df96bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e52d78a941a341d186dc00bbe7df96bf already in progress: creating tablet
I20260923 19:49:59.557480 6544 raft_consensus.cc:493] T c817af3eb83a43a3b6d4e9c83a9eefbb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:49:59.557662 6544 raft_consensus.cc:515] T c817af3eb83a43a3b6d4e9c83a9eefbb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.558565 6544 leader_election.cc:290] T c817af3eb83a43a3b6d4e9c83a9eefbb P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:49:59.559966 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c817af3eb83a43a3b6d4e9c83a9eefbb" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:49:59.560176 6203 raft_consensus.cc:2468] T c817af3eb83a43a3b6d4e9c83a9eefbb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 0.
I20260923 19:49:59.560669 5995 leader_election.cc:304] T c817af3eb83a43a3b6d4e9c83a9eefbb P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:49:59.560990 6544 raft_consensus.cc:2804] T c817af3eb83a43a3b6d4e9c83a9eefbb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:49:59.561110 6544 raft_consensus.cc:493] T c817af3eb83a43a3b6d4e9c83a9eefbb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:49:59.561215 6544 raft_consensus.cc:3060] T c817af3eb83a43a3b6d4e9c83a9eefbb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:49:59.566097 6040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7e282b6699a4ce9837d221132a1f54e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.579308 6454 ts_tablet_manager.cc:1434] T c817af3eb83a43a3b6d4e9c83a9eefbb P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.025s user 0.003s sys 0.000s
W20260923 19:49:59.584556 5804 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f302f91c8ef44237b1c9909d88dacbff has no consensus state
I20260923 19:49:59.584995 6318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a5f682ef2794a1fb9f5c4c2c1ee52e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.585013 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_2dccfebfe81e430892751230061f6fa2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:59.585614 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2dccfebfe81e430892751230061f6fa2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:59.586282 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c817af3eb83a43a3b6d4e9c83a9eefbb" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:49:59.586398 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_d22fe13ff3c946e8acdb140f7d73f71e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:49:59.586511 6342 raft_consensus.cc:2468] T c817af3eb83a43a3b6d4e9c83a9eefbb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 0.
W20260923 19:49:59.586908 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d22fe13ff3c946e8acdb140f7d73f71e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:59.587925 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f9db993b0541668e0babd466059ff6" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:49:59.588232 6343 raft_consensus.cc:2468] T 11f9db993b0541668e0babd466059ff6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:49:59.588718 6139 leader_election.cc:304] T 11f9db993b0541668e0babd466059ff6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:49:59.588961 6139 raft_consensus.cc:2686] T 11f9db993b0541668e0babd466059ff6 P 61022dd7f2f14dc19aebe3af5f08f430: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260923 19:49:59.589201 6454 tablet_bootstrap.cc:492] T 38993814002d4391a9801c0cf55e5374 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:49:59.591233 6457 tablet_bootstrap.cc:654] T c14d36ad1b7241c894dbdff46159000c P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:59.592813 6454 tablet_bootstrap.cc:654] T 38993814002d4391a9801c0cf55e5374 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:59.594738 6456 tablet_bootstrap.cc:492] T 09bb2ab5617a49d99e75191b3b48b85f P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:49:59.594919 6456 ts_tablet_manager.cc:1403] T 09bb2ab5617a49d99e75191b3b48b85f P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.305s user 0.003s sys 0.000s
I20260923 19:49:59.595793 6456 raft_consensus.cc:359] T 09bb2ab5617a49d99e75191b3b48b85f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.596477 6456 raft_consensus.cc:385] T 09bb2ab5617a49d99e75191b3b48b85f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:59.596596 6456 raft_consensus.cc:740] T 09bb2ab5617a49d99e75191b3b48b85f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:49:59.596916 6456 consensus_queue.cc:260] T 09bb2ab5617a49d99e75191b3b48b85f P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.597765 6471 raft_consensus.cc:493] T 57edfc8db29d498689ab77006d3fddfd P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:49:59.597949 6471 raft_consensus.cc:515] T 57edfc8db29d498689ab77006d3fddfd P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.598673 6471 leader_election.cc:290] T 57edfc8db29d498689ab77006d3fddfd P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:49:59.599190 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57edfc8db29d498689ab77006d3fddfd" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:49:59.599591 6059 raft_consensus.cc:2393] T 57edfc8db29d498689ab77006d3fddfd P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61022dd7f2f14dc19aebe3af5f08f430 in current term 1: Already voted for candidate 2bf41435f70447f19992d368ca6b46bd in this term.
W20260923 19:49:59.600205 6139 leader_election.cc:343] T 57edfc8db29d498689ab77006d3fddfd P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 57edfc8db29d498689ab77006d3fddfd
I20260923 19:49:59.600723 6137 leader_election.cc:304] T 57edfc8db29d498689ab77006d3fddfd P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:49:59.601308 6471 raft_consensus.cc:3060] T 57edfc8db29d498689ab77006d3fddfd P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:49:59.604225 6456 ts_tablet_manager.cc:1434] T 09bb2ab5617a49d99e75191b3b48b85f P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.009s user 0.001s sys 0.002s
I20260923 19:49:59.610024 6456 tablet_bootstrap.cc:492] T 32c8333073574fe79bfc3e33f3249256 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:49:59.613703 6456 tablet_bootstrap.cc:654] T 32c8333073574fe79bfc3e33f3249256 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:59.615803 6454 tablet_bootstrap.cc:492] T 38993814002d4391a9801c0cf55e5374 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:49:59.616362 6457 tablet_bootstrap.cc:492] T c14d36ad1b7241c894dbdff46159000c P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:49:59.616525 6457 ts_tablet_manager.cc:1403] T c14d36ad1b7241c894dbdff46159000c P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.099s user 0.000s sys 0.008s
I20260923 19:49:59.617054 6454 ts_tablet_manager.cc:1403] T 38993814002d4391a9801c0cf55e5374 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.003s
I20260923 19:49:59.617612 6457 raft_consensus.cc:359] T c14d36ad1b7241c894dbdff46159000c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.617862 6457 raft_consensus.cc:385] T c14d36ad1b7241c894dbdff46159000c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:59.618185 6540 raft_consensus.cc:2749] T 2f78261842744af08d86da64d37d708c P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:49:59.619228 6202 raft_consensus.cc:1275] T 2f78261842744af08d86da64d37d708c P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Refusing update from remote peer e546f660e7e541d1aa9ae38e5ee5b9c0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:49:59.619792 6344 raft_consensus.cc:2468] T 5725a9cb95c448d0a5ea8114e90bc9fe P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:49:59.620304 6458 ts_tablet_manager.cc:1929] T e67ef0eb259544a4b283cd03721bffe5 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:49:59.620424 6458 log.cc:1199] T e67ef0eb259544a4b283cd03721bffe5 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/e67ef0eb259544a4b283cd03721bffe5
I20260923 19:49:59.620823 6458 ts_tablet_manager.cc:1950] T e67ef0eb259544a4b283cd03721bffe5 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:49:59.621541 6459 ts_tablet_manager.cc:1929] T 11f9db993b0541668e0babd466059ff6 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:49:59.621688 6459 log.cc:1199] T 11f9db993b0541668e0babd466059ff6 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/11f9db993b0541668e0babd466059ff6
I20260923 19:49:59.622102 6459 ts_tablet_manager.cc:1950] T 11f9db993b0541668e0babd466059ff6 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:49:59.622239 6457 raft_consensus.cc:740] T c14d36ad1b7241c894dbdff46159000c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:49:59.622529 6457 consensus_queue.cc:260] T c14d36ad1b7241c894dbdff46159000c P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.623039 6454 raft_consensus.cc:359] T 38993814002d4391a9801c0cf55e5374 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.624676 6466 consensus_queue.cc:1048] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:49:59.625638 6454 raft_consensus.cc:385] T 38993814002d4391a9801c0cf55e5374 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:59.626250 6454 raft_consensus.cc:740] T 38993814002d4391a9801c0cf55e5374 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:49:59.627981 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 1a5f682ef2794a1fb9f5c4c2c1ee52e7
I20260923 19:49:59.627779 6454 consensus_queue.cc:260] T 38993814002d4391a9801c0cf55e5374 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.629448 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a5f682ef2794a1fb9f5c4c2c1ee52e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:49:59.630685 6457 ts_tablet_manager.cc:1434] T c14d36ad1b7241c894dbdff46159000c P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.010s user 0.000s sys 0.003s
I20260923 19:49:59.631301 5797 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_11716058362a4681b084cb08a17de6f1" } new_table_name: "default.Table_aab032fe31ab45fab7fa71a5b191c898" modify_external_catalogs: true
I20260923 19:49:59.631541 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a5f682ef2794a1fb9f5c4c2c1ee52e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:59.631771 6454 ts_tablet_manager.cc:1434] T 38993814002d4391a9801c0cf55e5374 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.014s user 0.002s sys 0.001s
I20260923 19:49:59.633985 6457 tablet_bootstrap.cc:492] T e655ab5873294e75a242709f069aabf2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:49:59.634320 6454 tablet_bootstrap.cc:492] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:49:59.637163 6471 raft_consensus.cc:2749] T 57edfc8db29d498689ab77006d3fddfd P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:49:59.639444 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 199843bdd7184df58be9a4a06a5ffb8b
I20260923 19:49:59.639998 5803 catalog_manager.cc:6934] ReplaceTablet: tablet 199843bdd7184df58be9a4a06a5ffb8b deleted and replaced by tablet 41c33dee851f49a0b935cf65dbc75e90
I20260923 19:49:59.640056 6139 leader_election.cc:304] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:49:59.640257 5803 master_service.cc:960] ReplaceTablet: received request to replace tablet 8a2fbac8080441d4a9e03ff1d580bc8e from {username='slave'} at 127.0.0.1:59912
I20260923 19:49:59.640810 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 32c8333073574fe79bfc3e33f3249256
I20260923 19:49:59.619172 6060 raft_consensus.cc:2468] T 5725a9cb95c448d0a5ea8114e90bc9fe P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:49:59.619524 6461 ts_tablet_manager.cc:1929] T 16098a9f015040dc93d9cca2fc9ebce2 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:49:59.641413 6461 log.cc:1199] T 16098a9f015040dc93d9cca2fc9ebce2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/16098a9f015040dc93d9cca2fc9ebce2
I20260923 19:49:59.641825 6461 ts_tablet_manager.cc:1950] T 16098a9f015040dc93d9cca2fc9ebce2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:49:59.642897 6461 tablet_replica.cc:333] T 1e1fef9ad60c4cf08507bb380f58fff3 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:49:59.643108 6461 raft_consensus.cc:2243] T 1e1fef9ad60c4cf08507bb380f58fff3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:49:59.643313 6461 raft_consensus.cc:2272] T 1e1fef9ad60c4cf08507bb380f58fff3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:49:59.643606 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 199843bdd7184df58be9a4a06a5ffb8b with delete_type TABLET_DATA_DELETED (replaced by tablet 41c33dee851f49a0b935cf65dbc75e90) from {username='slave'} at 127.0.0.1:60210
I20260923 19:49:59.643868 6461 ts_tablet_manager.cc:1916] T 1e1fef9ad60c4cf08507bb380f58fff3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:49:59.643606 6322 tablet_service.cc:1558] Processing DeleteTablet for tablet 32c8333073574fe79bfc3e33f3249256 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:49:59.645915 6454 tablet_bootstrap.cc:654] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:59.647079 6457 tablet_bootstrap.cc:654] T e655ab5873294e75a242709f069aabf2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:59.647100 6180 tablet_service.cc:1558] Processing DeleteTablet for tablet 32c8333073574fe79bfc3e33f3249256 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:59.648296 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_23399a041c37452a8cebbc2f411fdb3f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:49:59.648419 6177 tablet_service.cc:1558] Processing DeleteTablet for tablet e67ef0eb259544a4b283cd03721bffe5 with delete_type TABLET_DATA_DELETED (replaced by tablet 32c8333073574fe79bfc3e33f3249256) from {username='slave'} at 127.0.0.1:60148
W20260923 19:49:59.648896 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_23399a041c37452a8cebbc2f411fdb3f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:59.649350 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet 199843bdd7184df58be9a4a06a5ffb8b with delete_type TABLET_DATA_DELETED (replaced by tablet 41c33dee851f49a0b935cf65dbc75e90) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:59.650134 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_7fca491d466748de94242c08e20984b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:59.650674 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7fca491d466748de94242c08e20984b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:59.652501 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 32) took 1250 ms. Trace:
I20260923 19:49:59.652685 6458 rpcz_store.cc:276] 0923 19:49:58.401677 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:49:58.404144 (+ 2467us) service_pool.cc:224] Handling call
0923 19:49:59.315090 (+910946us) ts_tablet_manager.cc:1151] Deleting tablet e67ef0eb259544a4b283cd03721bffe5
0923 19:49:59.321816 (+ 6726us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:49:59.542645 (+220829us) tablet_metadata.cc:665] Metadata flushed
0923 19:49:59.620199 (+ 77554us) tablet_metadata.cc:665] Metadata flushed
0923 19:49:59.652457 (+ 32258us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":910712}
I20260923 19:49:59.653177 6458 tablet_replica.cc:333] T 0cdb778f87fa40b89dad97d166192a1e P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:49:59.653400 6458 raft_consensus.cc:2243] T 0cdb778f87fa40b89dad97d166192a1e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:49:59.653465 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_3e0aab2edce945689943d3e65c1c01de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:49:59.653573 6458 raft_consensus.cc:2272] T 0cdb778f87fa40b89dad97d166192a1e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
W20260923 19:49:59.654019 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e0aab2edce945689943d3e65c1c01de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:59.654085 6512 raft_consensus.cc:493] T 13566283020c41c9b97d8c16678450d6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:49:59.654227 6512 raft_consensus.cc:515] T 13566283020c41c9b97d8c16678450d6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.654932 6512 leader_election.cc:290] T 13566283020c41c9b97d8c16678450d6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:49:59.656917 6459 tablet_replica.cc:333] T cca0dc9ed824410bbed5a25afebb90e1 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:49:59.656967 5796 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet c817af3eb83a43a3b6d4e9c83a9eefbb (table default.Table_30f4ccabe7fa4c8ba92e008f3d9b2d80 [id=b9b7fe147b8645389ebef237fa735b2b]). Expected version 2 got 0
I20260923 19:49:59.657049 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 11f9db993b0541668e0babd466059ff6 (table default.Table_a1e21fac044546acb4b417436464d269 [id=c5b2cbbf70c0433986e5c8c9430c9bfd]) successfully deleted
I20260923 19:49:59.657110 6459 raft_consensus.cc:2243] T cca0dc9ed824410bbed5a25afebb90e1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:49:59.657305 6459 raft_consensus.cc:2272] T cca0dc9ed824410bbed5a25afebb90e1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:49:59.657905 6459 ts_tablet_manager.cc:1916] T cca0dc9ed824410bbed5a25afebb90e1 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:49:59.658571 6458 ts_tablet_manager.cc:1916] T 0cdb778f87fa40b89dad97d166192a1e P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:49:59.659096 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13566283020c41c9b97d8c16678450d6" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:49:59.659722 6280 leader_election.cc:343] T 13566283020c41c9b97d8c16678450d6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:49:59.660332 6177 tablet_service.cc:1558] Processing DeleteTablet for tablet 38993814002d4391a9801c0cf55e5374 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:58 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:59.660593 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet 57edfc8db29d498689ab77006d3fddfd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:58 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:59.665268 6471 raft_consensus.cc:2804] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:49:59.665426 6544 raft_consensus.cc:515] T c817af3eb83a43a3b6d4e9c83a9eefbb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.668085 5796 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 2f78261842744af08d86da64d37d708c (table default.Table_a5d9d7b0e0b449ae8791e459b7d88f18 [id=7e9508e469b14579a0c697ac4ca5cc4a]). Expected version 4 got 0
I20260923 19:49:59.668679 6454 tablet_bootstrap.cc:492] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:49:59.668964 6454 ts_tablet_manager.cc:1403] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.035s user 0.004s sys 0.003s
W20260923 19:49:59.669111 5797 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e1752d6b46894796bdc94e6230e3327d has no consensus state
I20260923 19:49:59.670251 6454 raft_consensus.cc:359] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.670408 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c817af3eb83a43a3b6d4e9c83a9eefbb" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:49:59.670614 6344 raft_consensus.cc:3060] T c817af3eb83a43a3b6d4e9c83a9eefbb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:49:59.670586 6454 raft_consensus.cc:385] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:59.670727 6454 raft_consensus.cc:740] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:49:59.671116 6454 consensus_queue.cc:260] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.673064 6454 ts_tablet_manager.cc:1434] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260923 19:49:59.673674 6344 raft_consensus.cc:2468] T c817af3eb83a43a3b6d4e9c83a9eefbb P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 1.
I20260923 19:49:59.674417 5996 leader_election.cc:304] T c817af3eb83a43a3b6d4e9c83a9eefbb P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:49:59.675571 6454 tablet_bootstrap.cc:492] T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:49:59.678040 5800 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 41c33dee851f49a0b935cf65dbc75e90
I20260923 19:49:59.678843 6471 raft_consensus.cc:697] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:49:59.679311 6471 consensus_queue.cc:237] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.679877 6512 raft_consensus.cc:493] T 199843bdd7184df58be9a4a06a5ffb8b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:49:59.680135 6512 raft_consensus.cc:515] T 199843bdd7184df58be9a4a06a5ffb8b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.680665 6544 leader_election.cc:290] T c817af3eb83a43a3b6d4e9c83a9eefbb P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:49:59.680886 6544 raft_consensus.cc:493] T 13566283020c41c9b97d8c16678450d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:49:59.681005 6512 leader_election.cc:290] T 199843bdd7184df58be9a4a06a5ffb8b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:49:59.681025 6544 raft_consensus.cc:515] T 13566283020c41c9b97d8c16678450d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.687294 6544 leader_election.cc:290] T 13566283020c41c9b97d8c16678450d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:49:59.688454 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199843bdd7184df58be9a4a06a5ffb8b" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:49:59.690092 5800 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_655e0d86bc12407f9287ace4b3e76c29" } modify_external_catalogs: true
I20260923 19:49:59.690385 5800 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_655e0d86bc12407f9287ace4b3e76c29" } modify_external_catalogs: true
I20260923 19:49:59.691180 6512 raft_consensus.cc:493] T 8a2fbac8080441d4a9e03ff1d580bc8e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:49:59.691475 6512 raft_consensus.cc:515] T 8a2fbac8080441d4a9e03ff1d580bc8e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.692442 6512 leader_election.cc:290] T 8a2fbac8080441d4a9e03ff1d580bc8e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:49:59.692813 6544 raft_consensus.cc:2804] T c817af3eb83a43a3b6d4e9c83a9eefbb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:49:59.693171 6544 raft_consensus.cc:697] T c817af3eb83a43a3b6d4e9c83a9eefbb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Becoming Leader. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Running, Role: LEADER
I20260923 19:49:59.693558 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_75d1617a325e4c6591795f8378cfa93d" } modify_external_catalogs: true
I20260923 19:49:59.693773 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_75d1617a325e4c6591795f8378cfa93d" } modify_external_catalogs: true
I20260923 19:49:59.694877 6544 consensus_queue.cc:237] T c817af3eb83a43a3b6d4e9c83a9eefbb P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.695319 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2fbac8080441d4a9e03ff1d580bc8e" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:49:59.695413 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_423256ac67c24899a4b67915596ef545"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:59.695863 6280 leader_election.cc:343] T 199843bdd7184df58be9a4a06a5ffb8b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:49:59.696157 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_423256ac67c24899a4b67915596ef545 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:49:59.696348 6280 leader_election.cc:343] T 8a2fbac8080441d4a9e03ff1d580bc8e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:49:59.698117 5799 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a5f8ff7925264093b2de9ce72248f714" } new_table_name: "default.Table_607b21eb9423483daac43c4cb1507962" modify_external_catalogs: true
I20260923 19:49:59.698369 6454 tablet_bootstrap.cc:654] T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:59.705816 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 8a2fbac8080441d4a9e03ff1d580bc8e
I20260923 19:49:59.706828 5803 catalog_manager.cc:6934] ReplaceTablet: tablet 8a2fbac8080441d4a9e03ff1d580bc8e deleted and replaced by tablet 5adadf8caf5e4a9ab1107d0fb6a91735
I20260923 19:49:59.707268 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a2fbac8080441d4a9e03ff1d580bc8e with delete_type TABLET_DATA_DELETED (replaced by tablet 5adadf8caf5e4a9ab1107d0fb6a91735) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:59.710654 6322 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a2fbac8080441d4a9e03ff1d580bc8e with delete_type TABLET_DATA_DELETED (replaced by tablet 5adadf8caf5e4a9ab1107d0fb6a91735) from {username='slave'} at 127.0.0.1:60210
I20260923 19:49:59.711958 6454 tablet_bootstrap.cc:492] T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:49:59.712229 6454 ts_tablet_manager.cc:1403] T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.037s user 0.002s sys 0.004s
I20260923 19:49:59.713755 6454 raft_consensus.cc:359] T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.714145 6454 raft_consensus.cc:385] T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:59.714326 6454 raft_consensus.cc:740] T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:49:59.715164 6454 consensus_queue.cc:260] T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.716887 6454 ts_tablet_manager.cc:1434] T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260923 19:49:59.718101 6454 tablet_bootstrap.cc:492] T 13566283020c41c9b97d8c16678450d6 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:49:59.730257 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_31c14a76edf9403d83cdaedde790fb14"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:59.731127 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_31c14a76edf9403d83cdaedde790fb14 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:59.731889 6454 tablet_bootstrap.cc:654] T 13566283020c41c9b97d8c16678450d6 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:49:59.736073 5805 master_service.cc:960] ReplaceTablet: received request to replace tablet 09bb2ab5617a49d99e75191b3b48b85f from {username='slave'} at 127.0.0.1:59912
I20260923 19:49:59.736963 5798 master_service.cc:960] ReplaceTablet: received request to replace tablet 13566283020c41c9b97d8c16678450d6 from {username='slave'} at 127.0.0.1:59912
I20260923 19:49:59.738385 5798 master_service.cc:960] ReplaceTablet: received request to replace tablet 87afbdb11c6e4e58affd2f2d7995e1f8 from {username='slave'} at 127.0.0.1:59912
W20260923 19:49:59.742280 5799 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f2d9f1a0fae849ae8083eba082055fe9 has no consensus state
I20260923 19:49:59.746775 6461 ts_tablet_manager.cc:1929] T 1e1fef9ad60c4cf08507bb380f58fff3 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:49:59.741839 6458 ts_tablet_manager.cc:1929] T 0cdb778f87fa40b89dad97d166192a1e P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:49:59.747685 6461 log.cc:1199] T 1e1fef9ad60c4cf08507bb380f58fff3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/1e1fef9ad60c4cf08507bb380f58fff3
I20260923 19:49:59.748783 6458 log.cc:1199] T 0cdb778f87fa40b89dad97d166192a1e P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/0cdb778f87fa40b89dad97d166192a1e
I20260923 19:49:59.749378 6461 ts_tablet_manager.cc:1950] T 1e1fef9ad60c4cf08507bb380f58fff3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:49:59.749818 6458 ts_tablet_manager.cc:1950] T 0cdb778f87fa40b89dad97d166192a1e P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:49:59.750784 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 41) took 1084 ms. Trace:
W20260923 19:49:59.748438 5996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.195:32855, user_credentials={real_user=slave}} blocked reactor thread for 74064.7us
W20260923 19:49:59.751816 5790 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet e67ef0eb259544a4b283cd03721bffe5 (table default.Table_61c4c80bb6264458b904d9b0322596c0 [id=3fb7e854da784756b57db432e6c373db], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet e67ef0eb259544a4b283cd03721bffe5 consensus state has no leader
I20260923 19:49:59.753588 6454 tablet_bootstrap.cc:492] T 13566283020c41c9b97d8c16678450d6 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:49:59.753935 6454 ts_tablet_manager.cc:1403] T 13566283020c41c9b97d8c16678450d6 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.036s user 0.004s sys 0.006s
I20260923 19:49:59.755802 6454 raft_consensus.cc:359] T 13566283020c41c9b97d8c16678450d6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.756338 6454 raft_consensus.cc:385] T 13566283020c41c9b97d8c16678450d6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:49:59.756629 6454 raft_consensus.cc:740] T 13566283020c41c9b97d8c16678450d6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:49:59.758051 6454 consensus_queue.cc:260] T 13566283020c41c9b97d8c16678450d6 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.762807 5803 catalog_manager.cc:5838] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194). New cstate: current_term: 1 leader_uuid: "61022dd7f2f14dc19aebe3af5f08f430" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: UNKNOWN } } }
I20260923 19:49:59.763475 5803 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 5725a9cb95c448d0a5ea8114e90bc9fe (table default.Table_1d045e195d50465784c49c6ecdc0e167 [id=d3b60b7fc1d84a46aa49932d5c3363ea]). Expected version 2 got 0
I20260923 19:49:59.768134 6560 tablet.cc:1751] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260923 19:49:59.780062 6461 tablet_replica.cc:333] T 38993814002d4391a9801c0cf55e5374 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:49:59.782928 5797 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_3e0aab2edce945689943d3e65c1c01de" } new_table_name: "default.Table_7fd9c4118903480880d758509d249fd6" modify_external_catalogs: true
I20260923 19:49:59.783962 5802 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_aab032fe31ab45fab7fa71a5b191c898" } new_table_name: "default.Table_7c9010170aac47fdbbc0aa6b197ecac3" modify_external_catalogs: true
I20260923 19:49:59.773186 6318 tablet_service.cc:1511] Processing CreateTablet for tablet b2762648045b4378bcc2c1234460c352 (DEFAULT_TABLE table=default.Table_d92791d5f2ea45269d76ff9c82be1880 [id=ada5cc6ef65b4859bf027fd3af9ad0f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.773967 6322 tablet_service.cc:1511] Processing CreateTablet for tablet 115048f771764e41a3816e17a6c6cf94 (DEFAULT_TABLE table=default.Table_ac282a79af174a87b864e9156993fd25 [id=498c667413e24c7c800fe5eae263cf22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.792156 5804 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 2f78261842744af08d86da64d37d708c (table default.Table_a5d9d7b0e0b449ae8791e459b7d88f18 [id=7e9508e469b14579a0c697ac4ca5cc4a]). Expected version 4 got 0
I20260923 19:49:59.792362 6322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 115048f771764e41a3816e17a6c6cf94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.793041 5800 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 640a98d3a845461e8d4f07041ab515c7
I20260923 19:49:59.793761 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 87afbdb11c6e4e58affd2f2d7995e1f8
I20260923 19:49:59.794220 5798 catalog_manager.cc:6934] ReplaceTablet: tablet 87afbdb11c6e4e58affd2f2d7995e1f8 deleted and replaced by tablet 5c0142f4e3ad42048803481d68f0ee5d
I20260923 19:49:59.795271 6321 tablet_service.cc:1558] Processing DeleteTablet for tablet 640a98d3a845461e8d4f07041ab515c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:49:59.796137 6319 tablet_service.cc:1558] Processing DeleteTablet for tablet 87afbdb11c6e4e58affd2f2d7995e1f8 with delete_type TABLET_DATA_DELETED (replaced by tablet 5c0142f4e3ad42048803481d68f0ee5d) from {username='slave'} at 127.0.0.1:60210
I20260923 19:49:59.796164 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 09bb2ab5617a49d99e75191b3b48b85f
I20260923 19:49:59.796571 5805 catalog_manager.cc:6934] ReplaceTablet: tablet 09bb2ab5617a49d99e75191b3b48b85f deleted and replaced by tablet d70b7662d85a4f64a11420448c4d140d
I20260923 19:49:59.798107 6319 tablet_service.cc:1558] Processing DeleteTablet for tablet 09bb2ab5617a49d99e75191b3b48b85f with delete_type TABLET_DATA_DELETED (replaced by tablet d70b7662d85a4f64a11420448c4d140d) from {username='slave'} at 127.0.0.1:60210
I20260923 19:49:59.798815 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 4bf129dd52b84a4ea461ec454bc34fe8
I20260923 19:49:59.800380 6319 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bf129dd52b84a4ea461ec454bc34fe8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:49:59.802960 6319 tablet_service.cc:1511] Processing CreateTablet for tablet 7504a2be25b54ed4bc539eb10199fe15 (DEFAULT_TABLE table=default.Table_cb2f56ff38ac4d1992cfa9c08d3a0cf0 [id=9e398f48d86e4c5898cac7336d3c24bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.802335 6318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2762648045b4378bcc2c1234460c352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.804153 6319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7504a2be25b54ed4bc539eb10199fe15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.806512 5796 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_31c14a76edf9403d83cdaedde790fb14" } new_table_name: "default.Table_286d831d3cff4c89b493d45f28acbca2" modify_external_catalogs: true
I20260923 19:49:59.808061 6321 tablet_service.cc:1511] Processing CreateTablet for tablet e1752d6b46894796bdc94e6230e3327d (DEFAULT_TABLE table=default.Table_aab032fe31ab45fab7fa71a5b191c898 [id=387269136a564b4f9bc782c785066dd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.808519 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1752d6b46894796bdc94e6230e3327d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.810302 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_5d58068c086e43069a48f9544c8c8757"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:59.810933 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d58068c086e43069a48f9544c8c8757 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:59.812397 6323 tablet_service.cc:1511] Processing CreateTablet for tablet a10110f4a2b34b61a4cc586d65981606 (DEFAULT_TABLE table=default.Table_e98e3cad705343819726665a1b6732d7 [id=019ceccbcb1041cc9e5625274c45a0f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.812863 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a10110f4a2b34b61a4cc586d65981606. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.813302 6454 ts_tablet_manager.cc:1434] T 13566283020c41c9b97d8c16678450d6 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.059s user 0.000s sys 0.003s
I20260923 19:49:59.817296 6324 tablet_service.cc:1511] Processing CreateTablet for tablet a1e8b8e638ec438a86f05fa147cdb27c (DEFAULT_TABLE table=default.Table_725d284e03844342909746398cb12562 [id=cc4f14506e3d44649b2795f866ab8618]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.817734 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1e8b8e638ec438a86f05fa147cdb27c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.820686 6320 tablet_service.cc:1511] Processing CreateTablet for tablet 640a98d3a845461e8d4f07041ab515c7 (DEFAULT_TABLE table=default.Table_655e0d86bc12407f9287ace4b3e76c29 [id=5bc43061f37b4defac5a530a1f174684]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.821090 6320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 640a98d3a845461e8d4f07041ab515c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.833818 6454 tablet_bootstrap.cc:492] T c14d36ad1b7241c894dbdff46159000c P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:49:59.833974 5805 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a949ff6346b345ffa7ce8d5d9a390997" } modify_external_catalogs: true
I20260923 19:49:59.834195 5805 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a949ff6346b345ffa7ce8d5d9a390997" } modify_external_catalogs: true
I20260923 19:49:59.834470 6316 tablet_service.cc:1511] Processing CreateTablet for tablet f2d9f1a0fae849ae8083eba082055fe9 (DEFAULT_TABLE table=default.Table_607b21eb9423483daac43c4cb1507962 [id=7252ede56f734ff5b3d3dc7576201183]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.835749 6175 tablet_service.cc:1558] Processing DeleteTablet for tablet 640a98d3a845461e8d4f07041ab515c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60148
W20260923 19:49:59.837769 5802 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e1752d6b46894796bdc94e6230e3327d consensus state has no leader
I20260923 19:49:59.838074 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet 87afbdb11c6e4e58affd2f2d7995e1f8 with delete_type TABLET_DATA_DELETED (replaced by tablet 5c0142f4e3ad42048803481d68f0ee5d) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:59.839016 6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2d9f1a0fae849ae8083eba082055fe9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:49:59.839905 5797 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 063fc0e77d294ddf8a02e9ab5968a5e3 has no consensus state
I20260923 19:49:59.842161 6317 tablet_service.cc:1511] Processing CreateTablet for tablet b302820d329a41f0a9a54501c079fcd7 (DEFAULT_TABLE table=default.Table_a34330ce2a604efca09f754e4d3e2127 [id=18f1a98d21a2426faed4f4dbf4fc57d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.844566 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b302820d329a41f0a9a54501c079fcd7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:49:59.849067 5796 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 64a38bbd3fbd4738a73e78e3f6436fe5 has no consensus state
I20260923 19:49:59.850688 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_9429c0a32a944532a7c0e98762ee3ebe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:59.852133 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9429c0a32a944532a7c0e98762ee3ebe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:59.855202 5803 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7c9010170aac47fdbbc0aa6b197ecac3" } modify_external_catalogs: true
I20260923 19:49:59.855414 5803 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7c9010170aac47fdbbc0aa6b197ecac3" } modify_external_catalogs: true
I20260923 19:49:59.856395 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_5840c3d0f0f540f4aa28042cd39593cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:59.856948 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5840c3d0f0f540f4aa28042cd39593cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:59.858037 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_103c4095b9c641d7aed905489796806e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:59.858500 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_103c4095b9c641d7aed905489796806e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:59.858824 6170 tablet_service.cc:1511] Processing CreateTablet for tablet e1752d6b46894796bdc94e6230e3327d (DEFAULT_TABLE table=default.Table_aab032fe31ab45fab7fa71a5b191c898 [id=387269136a564b4f9bc782c785066dd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.861985 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bf129dd52b84a4ea461ec454bc34fe8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:59.863327 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 7504a2be25b54ed4bc539eb10199fe15 (DEFAULT_TABLE table=default.Table_cb2f56ff38ac4d1992cfa9c08d3a0cf0 [id=9e398f48d86e4c5898cac7336d3c24bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.864163 6180 tablet_service.cc:1511] Processing CreateTablet for tablet f302f91c8ef44237b1c9909d88dacbff (DEFAULT_TABLE table=default.Table_f3f7926d9a214e1bb8b8b42655baef50 [id=4300ad9818924415b6414ea9f89445ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.864660 6177 tablet_service.cc:1511] Processing CreateTablet for tablet 115048f771764e41a3816e17a6c6cf94 (DEFAULT_TABLE table=default.Table_ac282a79af174a87b864e9156993fd25 [id=498c667413e24c7c800fe5eae263cf22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.864938 6182 tablet_service.cc:1558] Processing DeleteTablet for tablet 09bb2ab5617a49d99e75191b3b48b85f with delete_type TABLET_DATA_DELETED (replaced by tablet d70b7662d85a4f64a11420448c4d140d) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:59.865365 6179 tablet_service.cc:1511] Processing CreateTablet for tablet a1e8b8e638ec438a86f05fa147cdb27c (DEFAULT_TABLE table=default.Table_725d284e03844342909746398cb12562 [id=cc4f14506e3d44649b2795f866ab8618]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.865259 6173 tablet_service.cc:1511] Processing CreateTablet for tablet f2d9f1a0fae849ae8083eba082055fe9 (DEFAULT_TABLE table=default.Table_607b21eb9423483daac43c4cb1507962 [id=7252ede56f734ff5b3d3dc7576201183]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.869831 6181 tablet_service.cc:1511] Processing CreateTablet for tablet b2762648045b4378bcc2c1234460c352 (DEFAULT_TABLE table=default.Table_d92791d5f2ea45269d76ff9c82be1880 [id=ada5cc6ef65b4859bf027fd3af9ad0f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.870477 6175 tablet_service.cc:1511] Processing CreateTablet for tablet a10110f4a2b34b61a4cc586d65981606 (DEFAULT_TABLE table=default.Table_e98e3cad705343819726665a1b6732d7 [id=019ceccbcb1041cc9e5625274c45a0f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.870949 6182 tablet_service.cc:1558] Processing DeleteTablet for tablet 13566283020c41c9b97d8c16678450d6 with delete_type TABLET_DATA_DELETED (replaced by tablet c52da04e5fe0454ea76bf4d99a930fd7) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:59.871045 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet c1b82e4a02794947b77040b6323ad96a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:58 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:59.778913 6345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13566283020c41c9b97d8c16678450d6" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:49:59.781849 6325 tablet_service.cc:1511] Processing CreateTablet for tablet f302f91c8ef44237b1c9909d88dacbff (DEFAULT_TABLE table=default.Table_f3f7926d9a214e1bb8b8b42655baef50 [id=4300ad9818924415b6414ea9f89445ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.782375 6561 tablet.cc:1751] T 2f78261842744af08d86da64d37d708c P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260923 19:49:59.870187 6171 tablet_service.cc:1511] Processing CreateTablet for tablet 640a98d3a845461e8d4f07041ab515c7 (DEFAULT_TABLE table=default.Table_655e0d86bc12407f9287ace4b3e76c29 [id=5bc43061f37b4defac5a530a1f174684]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.872041 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet 16098a9f015040dc93d9cca2fc9ebce2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:58 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:49:59.870956 6172 tablet_service.cc:1511] Processing CreateTablet for tablet b302820d329a41f0a9a54501c079fcd7 (DEFAULT_TABLE table=default.Table_a34330ce2a604efca09f754e4d3e2127 [id=18f1a98d21a2426faed4f4dbf4fc57d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.872730 6170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1752d6b46894796bdc94e6230e3327d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.873076 6454 tablet_bootstrap.cc:654] T c14d36ad1b7241c894dbdff46159000c P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
W20260923 19:49:59.783555 5995 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 160473us
I20260923 19:49:59.875974 6461 raft_consensus.cc:2243] T 38993814002d4391a9801c0cf55e5374 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:49:59.876180 6461 raft_consensus.cc:2272] T 38993814002d4391a9801c0cf55e5374 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:49:59.877379 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13566283020c41c9b97d8c16678450d6" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:49:59.877640 6060 raft_consensus.cc:2468] T 13566283020c41c9b97d8c16678450d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:49:59.877710 6058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2fbac8080441d4a9e03ff1d580bc8e" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:49:59.878028 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199843bdd7184df58be9a4a06a5ffb8b" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:49:59.878463 6040 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a5f682ef2794a1fb9f5c4c2c1ee52e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:59.878755 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet 199843bdd7184df58be9a4a06a5ffb8b with delete_type TABLET_DATA_DELETED (replaced by tablet 41c33dee851f49a0b935cf65dbc75e90) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:59.785923 6457 tablet_bootstrap.cc:492] T e655ab5873294e75a242709f069aabf2 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:49:59.789705 6541 mvcc.cc:204] Tried to move back new op lower bound from 7332630526004994048 to 7332630523069882368. Current Snapshot: MvccSnapshot[applied={T|T < 7332630526004994048}]
I20260923 19:49:59.878973 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet 32c8333073574fe79bfc3e33f3249256 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:59.879032 6457 ts_tablet_manager.cc:1403] T e655ab5873294e75a242709f069aabf2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.245s user 0.038s sys 0.050s
I20260923 19:49:59.802513 6552 raft_consensus.cc:493] T c1b82e4a02794947b77040b6323ad96a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:49:59.879714 6033 tablet_service.cc:1558] Processing DeleteTablet for tablet e67ef0eb259544a4b283cd03721bffe5 with delete_type TABLET_DATA_DELETED (replaced by tablet 32c8333073574fe79bfc3e33f3249256) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:59.880239 6038 tablet_service.cc:1558] Processing DeleteTablet for tablet c1b82e4a02794947b77040b6323ad96a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:58 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:59.830008 6544 raft_consensus.cc:493] T e67ef0eb259544a4b283cd03721bffe5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:49:59.880369 6039 tablet_service.cc:1511] Processing CreateTablet for tablet f302f91c8ef44237b1c9909d88dacbff (DEFAULT_TABLE table=default.Table_f3f7926d9a214e1bb8b8b42655baef50 [id=4300ad9818924415b6414ea9f89445ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.881973 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f302f91c8ef44237b1c9909d88dacbff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.882242 6177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 115048f771764e41a3816e17a6c6cf94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.882220 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 16098a9f015040dc93d9cca2fc9ebce2 (table default.Table_7146a9adbec34a6ab1272e2f632209d1 [id=25b5843f90294bc8a77f3a0e00193f0f]) successfully deleted
I20260923 19:49:59.882478 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 1e1fef9ad60c4cf08507bb380f58fff3 (table default.Table_02aee02d3b8746ce98cba010a0ac8149 [id=47c37093044c462993bba6cb00bd296a]) successfully deleted
I20260923 19:49:59.882925 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1e8b8e638ec438a86f05fa147cdb27c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.883172 6172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b302820d329a41f0a9a54501c079fcd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.883296 6544 raft_consensus.cc:515] T e67ef0eb259544a4b283cd03721bffe5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.884521 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_cb2f56ff38ac4d1992cfa9c08d3a0cf0" } new_table_name: "default.Table_21a1fa60dde7481e8ad7a7fe355a1e94" modify_external_catalogs: true
I20260923 19:49:59.886044 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2d9f1a0fae849ae8083eba082055fe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.886446 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f302f91c8ef44237b1c9909d88dacbff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.887380 6175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a10110f4a2b34b61a4cc586d65981606. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.888265 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7504a2be25b54ed4bc539eb10199fe15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.889043 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2762648045b4378bcc2c1234460c352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.895876 6345 raft_consensus.cc:2468] T 13566283020c41c9b97d8c16678450d6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 0.
I20260923 19:49:59.896749 6458 rpcz_store.cc:276] 0923 19:49:58.665951 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:49:58.666031 (+ 80us) service_pool.cc:224] Handling call
0923 19:49:59.653113 (+987082us) ts_tablet_manager.cc:1151] Deleting tablet 0cdb778f87fa40b89dad97d166192a1e
0923 19:49:59.653124 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:49:59.699833 (+ 46709us) tablet_metadata.cc:665] Metadata flushed
0923 19:49:59.741684 (+ 41851us) tablet_metadata.cc:665] Metadata flushed
0923 19:49:59.750725 (+ 9041us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":986747}
I20260923 19:49:59.897799 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 0cdb778f87fa40b89dad97d166192a1e (table default.Table_8b11b0f74b55400080d37799143edfac [id=e16f8e50cfeb444eae29278b7a4b65df]) successfully deleted
I20260923 19:49:59.898442 6458 tablet_replica.cc:333] T 13566283020c41c9b97d8c16678450d6 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:49:59.898783 6458 raft_consensus.cc:2243] T 13566283020c41c9b97d8c16678450d6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:49:59.899106 6458 raft_consensus.cc:2272] T 13566283020c41c9b97d8c16678450d6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:49:59.900113 6458 ts_tablet_manager.cc:1916] T 13566283020c41c9b97d8c16678450d6 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:49:59.902022 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13566283020c41c9b97d8c16678450d6" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:49:59.902269 6203 raft_consensus.cc:2468] T 13566283020c41c9b97d8c16678450d6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 0.
I20260923 19:49:59.902685 6319 tablet_service.cc:1511] Processing CreateTablet for tablet 033c2d772c8a44d2a0e671664bb9085d (DEFAULT_TABLE table=default.Table_423256ac67c24899a4b67915596ef545 [id=c4756b4d81ce4fc2acf001ae879a5c3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.903017 6171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 640a98d3a845461e8d4f07041ab515c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.903587 6319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 033c2d772c8a44d2a0e671664bb9085d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.904246 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c817af3eb83a43a3b6d4e9c83a9eefbb" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:49:59.904431 6202 raft_consensus.cc:3060] T c817af3eb83a43a3b6d4e9c83a9eefbb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:49:59.921559 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_f5a4e1719fbf4219b34b7c0f65ee80ca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:59.923102 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f5a4e1719fbf4219b34b7c0f65ee80ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:59.926334 6321 tablet_service.cc:1511] Processing CreateTablet for tablet 063fc0e77d294ddf8a02e9ab5968a5e3 (DEFAULT_TABLE table=default.Table_7fd9c4118903480880d758509d249fd6 [id=83a8f991844b4cb0a9008f5bc3dea17b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.927083 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 063fc0e77d294ddf8a02e9ab5968a5e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.928712 6040 tablet_service.cc:1511] Processing CreateTablet for tablet 115048f771764e41a3816e17a6c6cf94 (DEFAULT_TABLE table=default.Table_ac282a79af174a87b864e9156993fd25 [id=498c667413e24c7c800fe5eae263cf22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.879601 6552 raft_consensus.cc:515] T c1b82e4a02794947b77040b6323ad96a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.930335 6561 tablet.cc:1746] T 2f78261842744af08d86da64d37d708c P 2bf41435f70447f19992d368ca6b46bd: Skipping requested alter to schema version 4, tablet already version 4
I20260923 19:49:59.930311 6038 tablet_service.cc:1511] Processing CreateTablet for tablet 7504a2be25b54ed4bc539eb10199fe15 (DEFAULT_TABLE table=default.Table_cb2f56ff38ac4d1992cfa9c08d3a0cf0 [id=9e398f48d86e4c5898cac7336d3c24bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.930387 6560 tablet.cc:1746] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0: Skipping requested alter to schema version 4, tablet already version 4
I20260923 19:49:59.931046 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f302f91c8ef44237b1c9909d88dacbff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.932035 6457 raft_consensus.cc:359] T e655ab5873294e75a242709f069aabf2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:49:59.932588 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_80d9cfc4fde44357a239cb5aa1f38bb4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:59.933184 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80d9cfc4fde44357a239cb5aa1f38bb4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:59.934495 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_9ef6e2f26ba14f5095a1d65288df3089"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:59.934993 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ef6e2f26ba14f5095a1d65288df3089 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:59.935223 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet 87afbdb11c6e4e58affd2f2d7995e1f8 with delete_type TABLET_DATA_DELETED (replaced by tablet 5c0142f4e3ad42048803481d68f0ee5d) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:59.936146 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_f1de0114e81245fdb95e257431f5a975"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:59.936656 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1de0114e81245fdb95e257431f5a975 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:59.938377 5797 master_service.cc:960] ReplaceTablet: received request to replace tablet e67ef0eb259544a4b283cd03721bffe5 from {username='slave'} at 127.0.0.1:59912
I20260923 19:49:59.938982 6512 raft_consensus.cc:493] T 3158b344d1c748aab5004543e4448adb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:49:59.940470 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_faa53cf5cc5541afb7b391368bdc55f7" } modify_external_catalogs: true
I20260923 19:49:59.940676 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_faa53cf5cc5541afb7b391368bdc55f7" } modify_external_catalogs: true
I20260923 19:49:59.942823 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bf129dd52b84a4ea461ec454bc34fe8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:59.948261 6032 tablet_service.cc:1511] Processing CreateTablet for tablet a10110f4a2b34b61a4cc586d65981606 (DEFAULT_TABLE table=default.Table_e98e3cad705343819726665a1b6732d7 [id=019ceccbcb1041cc9e5625274c45a0f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.953946 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_99945eeb183b4b18be67e5b484ad3454"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:59.954558 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99945eeb183b4b18be67e5b484ad3454 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:59.957006 6036 tablet_service.cc:1511] Processing CreateTablet for tablet b2762648045b4378bcc2c1234460c352 (DEFAULT_TABLE table=default.Table_d92791d5f2ea45269d76ff9c82be1880 [id=ada5cc6ef65b4859bf027fd3af9ad0f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.957520 6035 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a2fbac8080441d4a9e03ff1d580bc8e with delete_type TABLET_DATA_DELETED (replaced by tablet 5adadf8caf5e4a9ab1107d0fb6a91735) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:59.958218 6035 tablet_service.cc:1511] Processing CreateTablet for tablet 64a38bbd3fbd4738a73e78e3f6436fe5 (DEFAULT_TABLE table=default.Table_286d831d3cff4c89b493d45f28acbca2 [id=f02b0dcd479d46fea2683769212f2f40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.959071 6033 tablet_service.cc:1558] Processing DeleteTablet for tablet 640a98d3a845461e8d4f07041ab515c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:49:59.959520 6033 tablet_service.cc:1511] Processing CreateTablet for tablet 5adadf8caf5e4a9ab1107d0fb6a91735 (DEFAULT_TABLE table=default.Table_d94eaba070fd454bb85f8ef139ba0a28 [id=738ed1d070ef485e9299c1f3b1db008a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.959973 6040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 115048f771764e41a3816e17a6c6cf94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.960285 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a10110f4a2b34b61a4cc586d65981606. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.960511 6036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2762648045b4378bcc2c1234460c352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.962059 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64a38bbd3fbd4738a73e78e3f6436fe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.966091 6033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5adadf8caf5e4a9ab1107d0fb6a91735. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.973757 6324 tablet_service.cc:1511] Processing CreateTablet for tablet 5455beff354a4616a68d8746e3e4f9a8 (DEFAULT_TABLE table=default.Table_a949ff6346b345ffa7ce8d5d9a390997 [id=b1c31f5e95b54ad6860aaeb11048d36b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.974047 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 033c2d772c8a44d2a0e671664bb9085d (DEFAULT_TABLE table=default.Table_423256ac67c24899a4b67915596ef545 [id=c4756b4d81ce4fc2acf001ae879a5c3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.974800 6322 tablet_service.cc:1511] Processing CreateTablet for tablet b7f372b952804ac58e602998d9b77d72 (DEFAULT_TABLE table=default.Table_7fca491d466748de94242c08e20984b6 [id=5e155553f7ae43eca827dbbafdd2bbe6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.975919 6202 raft_consensus.cc:2468] T c817af3eb83a43a3b6d4e9c83a9eefbb P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 1.
I20260923 19:49:59.976006 6279 leader_election.cc:304] T 13566283020c41c9b97d8c16678450d6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:49:59.976928 6317 tablet_service.cc:1511] Processing CreateTablet for tablet 6e726ee6a5494fd4b72c1ebef7d66b42 (DEFAULT_TABLE table=default.Table_ba9e77809f194febb243d6dc37df3ee0 [id=6cacf523bb724ea58690207d93819846]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.977654 6512 raft_consensus.cc:515] T 3158b344d1c748aab5004543e4448adb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:49:59.977949 6279 raft_consensus.cc:2686] T 13566283020c41c9b97d8c16678450d6 P 2bf41435f70447f19992d368ca6b46bd: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260923 19:49:59.978894 6038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7504a2be25b54ed4bc539eb10199fe15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.978717 6320 tablet_service.cc:1511] Processing CreateTablet for tablet 5adadf8caf5e4a9ab1107d0fb6a91735 (DEFAULT_TABLE table=default.Table_d94eaba070fd454bb85f8ef139ba0a28 [id=738ed1d070ef485e9299c1f3b1db008a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.980655 6322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f372b952804ac58e602998d9b77d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.980734 6182 tablet_service.cc:1511] Processing CreateTablet for tablet 0a5ce253bcce410b9517449f133d39e8 (DEFAULT_TABLE table=default.Table_2dccfebfe81e430892751230061f6fa2 [id=0d4f6a5bb30c4d2a937424cf0e651afd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.981487 6552 leader_election.cc:290] T c1b82e4a02794947b77040b6323ad96a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:49:59.981717 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet 09bb2ab5617a49d99e75191b3b48b85f with delete_type TABLET_DATA_DELETED (replaced by tablet d70b7662d85a4f64a11420448c4d140d) from {username='slave'} at 127.0.0.1:56924
W20260923 19:49:59.982959 5800 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7504a2be25b54ed4bc539eb10199fe15 consensus state has no leader
I20260923 19:49:59.983050 5996 leader_election.cc:304] T 13566283020c41c9b97d8c16678450d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:49:59.983374 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_23399a041c37452a8cebbc2f411fdb3f" } new_table_name: "default.Table_a079a188cf0c46a884c2de951b9f6bb5" modify_external_catalogs: true
I20260923 19:49:59.984076 5802 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_a5d9d7b0e0b449ae8791e459b7d88f18 [id=7e9508e469b14579a0c697ac4ca5cc4a] alter complete (version 4)
I20260923 19:49:59.984977 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 5455beff354a4616a68d8746e3e4f9a8
I20260923 19:49:59.984764 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_0f7d73099ac1462b962be0316b72a59a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:49:59.985620 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f7d73099ac1462b962be0316b72a59a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:49:59.986440 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet e1752d6b46894796bdc94e6230e3327d
I20260923 19:49:59.987229 6034 tablet_service.cc:1511] Processing CreateTablet for tablet e1752d6b46894796bdc94e6230e3327d (DEFAULT_TABLE table=default.Table_aab032fe31ab45fab7fa71a5b191c898 [id=387269136a564b4f9bc782c785066dd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.988148 6031 tablet_service.cc:1511] Processing CreateTablet for tablet a1e8b8e638ec438a86f05fa147cdb27c (DEFAULT_TABLE table=default.Table_725d284e03844342909746398cb12562 [id=cc4f14506e3d44649b2795f866ab8618]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.988894 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 5c0142f4e3ad42048803481d68f0ee5d (DEFAULT_TABLE table=default.Table_f57f5ddf52f541ab91b4a9638fcf81a0 [id=e0da333ed7f44d6aa283da81b1cfbf17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.988775 6029 tablet_service.cc:1511] Processing CreateTablet for tablet b302820d329a41f0a9a54501c079fcd7 (DEFAULT_TABLE table=default.Table_a34330ce2a604efca09f754e4d3e2127 [id=18f1a98d21a2426faed4f4dbf4fc57d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.990200 6027 tablet_service.cc:1511] Processing CreateTablet for tablet 063fc0e77d294ddf8a02e9ab5968a5e3 (DEFAULT_TABLE table=default.Table_7fd9c4118903480880d758509d249fd6 [id=83a8f991844b4cb0a9008f5bc3dea17b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.991767 6025 tablet_service.cc:1511] Processing CreateTablet for tablet 0a5ce253bcce410b9517449f133d39e8 (DEFAULT_TABLE table=default.Table_2dccfebfe81e430892751230061f6fa2 [id=0d4f6a5bb30c4d2a937424cf0e651afd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.992699 6030 tablet_service.cc:1511] Processing CreateTablet for tablet 640a98d3a845461e8d4f07041ab515c7 (DEFAULT_TABLE table=default.Table_655e0d86bc12407f9287ace4b3e76c29 [id=5bc43061f37b4defac5a530a1f174684]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.993849 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet d70b7662d85a4f64a11420448c4d140d
I20260923 19:49:59.995069 6552 raft_consensus.cc:2804] T 13566283020c41c9b97d8c16678450d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260923 19:49:59.996204 5996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.195:32855, user_credentials={real_user=slave}} blocked reactor thread for 95040.2us
I20260923 19:49:59.997458 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1752d6b46894796bdc94e6230e3327d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:49:59.999460 6026 tablet_service.cc:1511] Processing CreateTablet for tablet 033c2d772c8a44d2a0e671664bb9085d (DEFAULT_TABLE table=default.Table_423256ac67c24899a4b67915596ef545 [id=c4756b4d81ce4fc2acf001ae879a5c3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.999506 6024 tablet_service.cc:1511] Processing CreateTablet for tablet 6a34e178007b4e8ebed429cedf44e82a (DEFAULT_TABLE table=default.Table_d22fe13ff3c946e8acdb140f7d73f71e [id=0bc5dceb2ad84601aa35e4d2714f0b41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.994333 6028 tablet_service.cc:1511] Processing CreateTablet for tablet f2d9f1a0fae849ae8083eba082055fe9 (DEFAULT_TABLE table=default.Table_607b21eb9423483daac43c4cb1507962 [id=7252ede56f734ff5b3d3dc7576201183]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.000471 6032 tablet_service.cc:1511] Processing CreateTablet for tablet d91a56bace854494b7affd6c766b2847 (DEFAULT_TABLE table=default.Table_607e77dd178f4b828d2b91cccdf593a8 [id=a6dbcc9c44fb400b926e21aa6d683186]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:49:59.999749 6022 tablet_service.cc:1511] Processing CreateTablet for tablet b7f372b952804ac58e602998d9b77d72 (DEFAULT_TABLE table=default.Table_7fca491d466748de94242c08e20984b6 [id=5e155553f7ae43eca827dbbafdd2bbe6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.003638 5797 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_c0be6341515349798508cd7887abaa7e" } modify_external_catalogs: true
I20260923 19:50:00.003865 5797 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_c0be6341515349798508cd7887abaa7e" } modify_external_catalogs: true
I20260923 19:50:00.003314 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7fca491d466748de94242c08e20984b6" } modify_external_catalogs: true
I20260923 19:50:00.004536 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7fca491d466748de94242c08e20984b6" } modify_external_catalogs: true
I20260923 19:50:00.004715 6459 ts_tablet_manager.cc:1929] T cca0dc9ed824410bbed5a25afebb90e1 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:00.008800 6169 tablet_service.cc:1511] Processing CreateTablet for tablet 6e726ee6a5494fd4b72c1ebef7d66b42 (DEFAULT_TABLE table=default.Table_ba9e77809f194febb243d6dc37df3ee0 [id=6cacf523bb724ea58690207d93819846]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.010057 6459 log.cc:1199] T cca0dc9ed824410bbed5a25afebb90e1 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/cca0dc9ed824410bbed5a25afebb90e1
I20260923 19:50:00.002094 6023 tablet_service.cc:1511] Processing CreateTablet for tablet 6e726ee6a5494fd4b72c1ebef7d66b42 (DEFAULT_TABLE table=default.Table_ba9e77809f194febb243d6dc37df3ee0 [id=6cacf523bb724ea58690207d93819846]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.001680 6021 tablet_service.cc:1511] Processing CreateTablet for tablet 5455beff354a4616a68d8746e3e4f9a8 (DEFAULT_TABLE table=default.Table_a949ff6346b345ffa7ce8d5d9a390997 [id=b1c31f5e95b54ad6860aaeb11048d36b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.011853 6173 tablet_service.cc:1511] Processing CreateTablet for tablet d70b7662d85a4f64a11420448c4d140d (DEFAULT_TABLE table=default.Table_faa53cf5cc5541afb7b391368bdc55f7 [id=4a8f28e842e94d628326ca83935f23c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.011019 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 5455beff354a4616a68d8746e3e4f9a8 (DEFAULT_TABLE table=default.Table_a949ff6346b345ffa7ce8d5d9a390997 [id=b1c31f5e95b54ad6860aaeb11048d36b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.013381 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 063fc0e77d294ddf8a02e9ab5968a5e3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:00.014094 5800 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a224ae69503e4ab588d6269086317f09 consensus state has no leader
I20260923 19:50:00.014557 6172 tablet_service.cc:1511] Processing CreateTablet for tablet a224ae69503e4ab588d6269086317f09 (DEFAULT_TABLE table=default.Table_23399a041c37452a8cebbc2f411fdb3f [id=6c09f84a1d19402b8b59bbc60ae92bcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.015064 6024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a34e178007b4e8ebed429cedf44e82a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.011134 6166 tablet_service.cc:1511] Processing CreateTablet for tablet 64a38bbd3fbd4738a73e78e3f6436fe5 (DEFAULT_TABLE table=default.Table_286d831d3cff4c89b493d45f28acbca2 [id=f02b0dcd479d46fea2683769212f2f40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.015772 6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5455beff354a4616a68d8746e3e4f9a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.016064 6023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e726ee6a5494fd4b72c1ebef7d66b42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.009964 6168 tablet_service.cc:1511] Processing CreateTablet for tablet b7f372b952804ac58e602998d9b77d72 (DEFAULT_TABLE table=default.Table_7fca491d466748de94242c08e20984b6 [id=5e155553f7ae43eca827dbbafdd2bbe6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.017513 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 033c2d772c8a44d2a0e671664bb9085d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.017477 6471 raft_consensus.cc:493] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:00.017807 6182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a5ce253bcce410b9517449f133d39e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.017709 6471 raft_consensus.cc:515] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.017938 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e67ef0eb259544a4b283cd03721bffe5" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:00.018133 6203 raft_consensus.cc:2468] T e67ef0eb259544a4b283cd03721bffe5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 0.
I20260923 19:50:00.018788 6471 leader_election.cc:290] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:00.011315 6165 tablet_service.cc:1511] Processing CreateTablet for tablet 5adadf8caf5e4a9ab1107d0fb6a91735 (DEFAULT_TABLE table=default.Table_d94eaba070fd454bb85f8ef139ba0a28 [id=738ed1d070ef485e9299c1f3b1db008a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.011677 6176 tablet_service.cc:1511] Processing CreateTablet for tablet 6a34e178007b4e8ebed429cedf44e82a (DEFAULT_TABLE table=default.Table_d22fe13ff3c946e8acdb140f7d73f71e [id=0bc5dceb2ad84601aa35e4d2714f0b41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.011228 6174 tablet_service.cc:1511] Processing CreateTablet for tablet 063fc0e77d294ddf8a02e9ab5968a5e3 (DEFAULT_TABLE table=default.Table_7fd9c4118903480880d758509d249fd6 [id=83a8f991844b4cb0a9008f5bc3dea17b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.022485 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 640a98d3a845461e8d4f07041ab515c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.023900 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b302820d329a41f0a9a54501c079fcd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.027092 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1e8b8e638ec438a86f05fa147cdb27c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.027570 6175 tablet_service.cc:1511] Processing CreateTablet for tablet d91a56bace854494b7affd6c766b2847 (DEFAULT_TABLE table=default.Table_607e77dd178f4b828d2b91cccdf593a8 [id=a6dbcc9c44fb400b926e21aa6d683186]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.027762 6544 leader_election.cc:290] T e67ef0eb259544a4b283cd03721bffe5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:00.028098 6457 raft_consensus.cc:385] T e655ab5873294e75a242709f069aabf2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:00.028121 6459 ts_tablet_manager.cc:1950] T cca0dc9ed824410bbed5a25afebb90e1 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:00.028203 6457 raft_consensus.cc:740] T e655ab5873294e75a242709f069aabf2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:00.028403 6454 tablet_bootstrap.cc:492] T c14d36ad1b7241c894dbdff46159000c P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:00.022027 6164 tablet_service.cc:1511] Processing CreateTablet for tablet 5c0142f4e3ad42048803481d68f0ee5d (DEFAULT_TABLE table=default.Table_f57f5ddf52f541ab91b4a9638fcf81a0 [id=e0da333ed7f44d6aa283da81b1cfbf17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.029223 6457 consensus_queue.cc:260] T e655ab5873294e75a242709f069aabf2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.030421 6457 ts_tablet_manager.cc:1434] T e655ab5873294e75a242709f069aabf2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.151s user 0.003s sys 0.000s
I20260923 19:50:00.030809 6454 ts_tablet_manager.cc:1403] T c14d36ad1b7241c894dbdff46159000c P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.215s user 0.001s sys 0.006s
I20260923 19:50:00.033138 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d70b7662d85a4f64a11420448c4d140d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.038059 6457 tablet_bootstrap.cc:492] T 3158b344d1c748aab5004543e4448adb P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:00.039863 6552 raft_consensus.cc:493] T 13566283020c41c9b97d8c16678450d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:00.040027 6552 raft_consensus.cc:3060] T 13566283020c41c9b97d8c16678450d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:00.042810 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d4c5e4b161f843ce9dc495bc75e81488" } new_table_name: "default.Table_118cf2f6e9e24518800d3f0b52552cee" modify_external_catalogs: true
I20260923 19:50:00.042781 6057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b82e4a02794947b77040b6323ad96a" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:00.043109 6057 raft_consensus.cc:2468] T c1b82e4a02794947b77040b6323ad96a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:00.044364 6137 leader_election.cc:304] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:00.044806 6471 raft_consensus.cc:2804] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:00.045413 6471 raft_consensus.cc:493] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:00.045534 6471 raft_consensus.cc:3060] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:00.047003 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e726ee6a5494fd4b72c1ebef7d66b42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.047978 5802 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_2dccfebfe81e430892751230061f6fa2" } new_table_name: "default.Table_84d13e1ea6234e5ca45738376e83f537" modify_external_catalogs: true
I20260923 19:50:00.049968 6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 033c2d772c8a44d2a0e671664bb9085d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:00.052315 5791 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.143.252:45543: connect: Connection refused (error 111) [suppressed 8 similar messages]
I20260923 19:50:00.055825 6454 raft_consensus.cc:359] T c14d36ad1b7241c894dbdff46159000c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.056239 6454 raft_consensus.cc:385] T c14d36ad1b7241c894dbdff46159000c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:00.056417 6454 raft_consensus.cc:740] T c14d36ad1b7241c894dbdff46159000c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:00.056746 6454 consensus_queue.cc:260] T c14d36ad1b7241c894dbdff46159000c P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.058475 6454 ts_tablet_manager.cc:1434] T c14d36ad1b7241c894dbdff46159000c P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.026s user 0.000s sys 0.002s
I20260923 19:50:00.058832 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a5ce253bcce410b9517449f133d39e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.059468 5995 leader_election.cc:304] T e67ef0eb259544a4b283cd03721bffe5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:00.059788 6471 raft_consensus.cc:515] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.060497 6471 leader_election.cc:290] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:00.061488 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_51c3e54ed92742fe9c3cb2e940037343"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:00.062109 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51c3e54ed92742fe9c3cb2e940037343 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:00.063381 5799 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_e98e3cad705343819726665a1b6732d7" } new_table_name: "default.Table_b455e09005774effa019e6ddc31cd521" modify_external_catalogs: true
I20260923 19:50:00.064064 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f372b952804ac58e602998d9b77d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.065011 6544 raft_consensus.cc:2804] T e67ef0eb259544a4b283cd03721bffe5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:00.069397 6057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b82e4a02794947b77040b6323ad96a" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:00.069623 6057 raft_consensus.cc:3060] T c1b82e4a02794947b77040b6323ad96a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:00.070664 6461 ts_tablet_manager.cc:1916] T 38993814002d4391a9801c0cf55e5374 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:00.077162 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d91a56bace854494b7affd6c766b2847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.078059 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2d9f1a0fae849ae8083eba082055fe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.081765 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c0142f4e3ad42048803481d68f0ee5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.082582 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5455beff354a4616a68d8746e3e4f9a8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:00.082675 5800 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 223edddace234a16b2d360504a99c28b consensus state has no leader
I20260923 19:50:00.083511 6544 raft_consensus.cc:493] T e67ef0eb259544a4b283cd03721bffe5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:00.087536 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b82e4a02794947b77040b6323ad96a" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:00.087880 6203 raft_consensus.cc:2393] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in current term 1: Already voted for candidate 61022dd7f2f14dc19aebe3af5f08f430 in this term.
W20260923 19:50:00.090950 5799 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a10110f4a2b34b61a4cc586d65981606 consensus state has no leader
I20260923 19:50:00.090193 6544 raft_consensus.cc:3060] T e67ef0eb259544a4b283cd03721bffe5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:00.094717 6165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5adadf8caf5e4a9ab1107d0fb6a91735. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.095045 6180 tablet_service.cc:1558] Processing DeleteTablet for tablet 5455beff354a4616a68d8746e3e4f9a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:00.095218 6181 tablet_service.cc:1511] Processing CreateTablet for tablet 3190d18f00234d71b0a58c2c334ef45f (DEFAULT_TABLE table=default.Table_adfa6338ea024e4a87e614cbc086cbc3 [id=eedb3f35db9640d992be8887c071962f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.095322 6180 tablet_service.cc:1558] Processing DeleteTablet for tablet e1752d6b46894796bdc94e6230e3327d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:00.095492 6180 tablet_service.cc:1558] Processing DeleteTablet for tablet d70b7662d85a4f64a11420448c4d140d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:00.095623 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3190d18f00234d71b0a58c2c334ef45f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.096253 6039 tablet_service.cc:1511] Processing CreateTablet for tablet d70b7662d85a4f64a11420448c4d140d (DEFAULT_TABLE table=default.Table_faa53cf5cc5541afb7b391368bdc55f7 [id=4a8f28e842e94d628326ca83935f23c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.097167 6552 raft_consensus.cc:515] T 13566283020c41c9b97d8c16678450d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.094709 6459 tablet_replica.cc:333] T 29b2b75a12cb4ea3b73afe0ac549386f P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:00.097620 6459 raft_consensus.cc:2243] T 29b2b75a12cb4ea3b73afe0ac549386f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:00.097807 6459 raft_consensus.cc:2272] T 29b2b75a12cb4ea3b73afe0ac549386f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:00.098201 6552 leader_election.cc:290] T 13566283020c41c9b97d8c16678450d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:00.098378 6454 tablet_bootstrap.cc:492] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:00.098407 6459 ts_tablet_manager.cc:1916] T 29b2b75a12cb4ea3b73afe0ac549386f P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:00.098765 6172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a224ae69503e4ab588d6269086317f09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.099969 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet cca0dc9ed824410bbed5a25afebb90e1 (table default.Table_becda8ed754641458d230754da7bf5a0 [id=9dec959401b44b6894aff08698088c4e]) successfully deleted
I20260923 19:50:00.102890 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13566283020c41c9b97d8c16678450d6" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:00.103099 6203 raft_consensus.cc:3060] T 13566283020c41c9b97d8c16678450d6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:00.105917 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d70b7662d85a4f64a11420448c4d140d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.108275 6459 ts_tablet_manager.cc:1929] T 29b2b75a12cb4ea3b73afe0ac549386f P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:00.108630 6459 log.cc:1199] T 29b2b75a12cb4ea3b73afe0ac549386f P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/29b2b75a12cb4ea3b73afe0ac549386f
I20260923 19:50:00.109216 6459 ts_tablet_manager.cc:1950] T 29b2b75a12cb4ea3b73afe0ac549386f P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:00.109855 6027 tablet_service.cc:1511] Processing CreateTablet for tablet 3190d18f00234d71b0a58c2c334ef45f (DEFAULT_TABLE table=default.Table_adfa6338ea024e4a87e614cbc086cbc3 [id=eedb3f35db9640d992be8887c071962f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.110201 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 29b2b75a12cb4ea3b73afe0ac549386f (table default.Table_db8d2bf4a72d4038998c7ac73aef62f1 [id=c28edbfa33d947f1ad22e1f218da9de0]) successfully deleted
I20260923 19:50:00.110286 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3190d18f00234d71b0a58c2c334ef45f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:00.111128 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 1a5f682ef2794a1fb9f5c4c2c1ee52e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a5f682ef2794a1fb9f5c4c2c1ee52e7 already in progress: creating tablet
I20260923 19:50:00.111552 6203 raft_consensus.cc:2468] T 13566283020c41c9b97d8c16678450d6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 1.
W20260923 19:50:00.112354 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 32c8333073574fe79bfc3e33f3249256 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32c8333073574fe79bfc3e33f3249256 already in progress: creating tablet
I20260923 19:50:00.113320 6459 tablet_replica.cc:333] T e67ef0eb259544a4b283cd03721bffe5 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:00.113617 6459 raft_consensus.cc:2243] T e67ef0eb259544a4b283cd03721bffe5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:00.113850 6459 raft_consensus.cc:2272] T e67ef0eb259544a4b283cd03721bffe5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:00.113801 6323 tablet_service.cc:1511] Processing CreateTablet for tablet 64a38bbd3fbd4738a73e78e3f6436fe5 (DEFAULT_TABLE table=default.Table_286d831d3cff4c89b493d45f28acbca2 [id=f02b0dcd479d46fea2683769212f2f40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.114495 6459 ts_tablet_manager.cc:1916] T e67ef0eb259544a4b283cd03721bffe5 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:00.116653 6026 tablet_service.cc:1558] Processing DeleteTablet for tablet 5455beff354a4616a68d8746e3e4f9a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:00.116884 6026 tablet_service.cc:1558] Processing DeleteTablet for tablet e1752d6b46894796bdc94e6230e3327d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:00.117084 6026 tablet_service.cc:1558] Processing DeleteTablet for tablet d70b7662d85a4f64a11420448c4d140d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:00.122100 6459 ts_tablet_manager.cc:1929] T e67ef0eb259544a4b283cd03721bffe5 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:00.122236 6459 log.cc:1199] T e67ef0eb259544a4b283cd03721bffe5 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/e67ef0eb259544a4b283cd03721bffe5
I20260923 19:50:00.122613 6459 ts_tablet_manager.cc:1950] T e67ef0eb259544a4b283cd03721bffe5 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:00.123180 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet e67ef0eb259544a4b283cd03721bffe5 (table default.Table_61c4c80bb6264458b904d9b0322596c0 [id=3fb7e854da784756b57db432e6c373db]) successfully deleted
I20260923 19:50:00.124027 6459 tablet_replica.cc:333] T 38993814002d4391a9801c0cf55e5374 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:00.124289 6459 raft_consensus.cc:2243] T 38993814002d4391a9801c0cf55e5374 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:00.124656 6459 raft_consensus.cc:2272] T 38993814002d4391a9801c0cf55e5374 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:00.124975 6520 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
I20260923 19:50:00.125391 6459 ts_tablet_manager.cc:1916] T 38993814002d4391a9801c0cf55e5374 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:00.125437 6520 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 19:50:00.125557 6520 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260923 19:50:00.131839 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_4e613a89795a4121ab7fa2a338f3cc0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:00.132469 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4e613a89795a4121ab7fa2a338f3cc0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:00.130332 6035 tablet_service.cc:1511] Processing CreateTablet for tablet a224ae69503e4ab588d6269086317f09 (DEFAULT_TABLE table=default.Table_23399a041c37452a8cebbc2f411fdb3f [id=6c09f84a1d19402b8b59bbc60ae92bcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.135519 6459 ts_tablet_manager.cc:1929] T 38993814002d4391a9801c0cf55e5374 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:00.136130 6459 log.cc:1199] T 38993814002d4391a9801c0cf55e5374 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/38993814002d4391a9801c0cf55e5374
I20260923 19:50:00.137038 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a224ae69503e4ab588d6269086317f09. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:00.137202 6279 leader_election.cc:343] T 8a2fbac8080441d4a9e03ff1d580bc8e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:00.137267 6459 ts_tablet_manager.cc:1950] T 38993814002d4391a9801c0cf55e5374 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:00.138093 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e726ee6a5494fd4b72c1ebef7d66b42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.138175 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 38993814002d4391a9801c0cf55e5374 (table default.Table_0e33e49bac5e4266bd2b09bb1010fce4 [id=ce4094be808b4dd3997cb576e11e3894]) successfully deleted
I20260923 19:50:00.135514 6565 mvcc.cc:204] Tried to move back new op lower bound from 7332630526004994048 to 7332630523069882368. Current Snapshot: MvccSnapshot[applied={T|T < 7332630526004994048}]
I20260923 19:50:00.143496 6459 tablet_replica.cc:333] T 57edfc8db29d498689ab77006d3fddfd P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:00.145195 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_28e177d48f7949c4914feb2cf5143aeb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:00.145998 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28e177d48f7949c4914feb2cf5143aeb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:00.147814 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_7342c845a15749d5b6bd089d55287f3a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:00.148339 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7342c845a15749d5b6bd089d55287f3a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:00.150190 6459 raft_consensus.cc:2243] T 57edfc8db29d498689ab77006d3fddfd P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:00.150830 6316 tablet_service.cc:1511] Processing CreateTablet for tablet 6a34e178007b4e8ebed429cedf44e82a (DEFAULT_TABLE table=default.Table_d22fe13ff3c946e8acdb140f7d73f71e [id=0bc5dceb2ad84601aa35e4d2714f0b41]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:00.151547 6520 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:50:00.151695 6520 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:50:00.151861 6520 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:50:00.151959 6520 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
W20260923 19:50:00.152479 5996 leader_election.cc:343] T e67ef0eb259544a4b283cd03721bffe5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: e67ef0eb259544a4b283cd03721bffe5
W20260923 19:50:00.152901 5996 leader_election.cc:343] T c1b82e4a02794947b77040b6323ad96a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: c1b82e4a02794947b77040b6323ad96a
I20260923 19:50:00.153033 5996 leader_election.cc:304] T c1b82e4a02794947b77040b6323ad96a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:00.153676 6512 leader_election.cc:290] T 3158b344d1c748aab5004543e4448adb P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:00.154502 6315 tablet_service.cc:1511] Processing CreateTablet for tablet 5c0142f4e3ad42048803481d68f0ee5d (DEFAULT_TABLE table=default.Table_f57f5ddf52f541ab91b4a9638fcf81a0 [id=e0da333ed7f44d6aa283da81b1cfbf17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.155047 6457 tablet_bootstrap.cc:654] T 3158b344d1c748aab5004543e4448adb P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:00.156068 6456 tablet_bootstrap.cc:492] T 32c8333073574fe79bfc3e33f3249256 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:00.156945 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 0a5ce253bcce410b9517449f133d39e8 (DEFAULT_TABLE table=default.Table_2dccfebfe81e430892751230061f6fa2 [id=0d4f6a5bb30c4d2a937424cf0e651afd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.157330 6314 tablet_service.cc:1511] Processing CreateTablet for tablet d91a56bace854494b7affd6c766b2847 (DEFAULT_TABLE table=default.Table_607e77dd178f4b828d2b91cccdf593a8 [id=a6dbcc9c44fb400b926e21aa6d683186]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.157691 6279 leader_election.cc:304] T 8a2fbac8080441d4a9e03ff1d580bc8e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:00.158089 6279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.193:39887, user_credentials={real_user=slave}} blocked reactor thread for 179543us
W20260923 19:50:00.158450 6279 leader_election.cc:343] T 199843bdd7184df58be9a4a06a5ffb8b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:00.158571 6279 leader_election.cc:304] T 199843bdd7184df58be9a4a06a5ffb8b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:00.159103 6279 consensus_peers.cc:597] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1e1fef9ad60c4cf08507bb380f58fff3. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:00.159550 6320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5adadf8caf5e4a9ab1107d0fb6a91735. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.159498 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 3190d18f00234d71b0a58c2c334ef45f (DEFAULT_TABLE table=default.Table_adfa6338ea024e4a87e614cbc086cbc3 [id=eedb3f35db9640d992be8887c071962f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.160377 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a5ce253bcce410b9517449f133d39e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.161382 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64a38bbd3fbd4738a73e78e3f6436fe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.162422 6345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13566283020c41c9b97d8c16678450d6" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:00.162541 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5455beff354a4616a68d8746e3e4f9a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.164148 5995 leader_election.cc:304] T 13566283020c41c9b97d8c16678450d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:00.169103 6555 raft_consensus.cc:2804] T 13566283020c41c9b97d8c16678450d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election won for term 1
W20260923 19:50:00.170490 5802 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0a5ce253bcce410b9517449f133d39e8 consensus state has no leader
W20260923 19:50:00.172807 5996 leader_election.cc:343] T 13566283020c41c9b97d8c16678450d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: Tablet not RUNNING: STOPPED
I20260923 19:50:00.173113 6466 raft_consensus.cc:493] T e655ab5873294e75a242709f069aabf2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:00.173543 6456 ts_tablet_manager.cc:1403] T 32c8333073574fe79bfc3e33f3249256 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.551s user 0.006s sys 0.006s
I20260923 19:50:00.174172 6310 tablet_service.cc:1558] Processing DeleteTablet for tablet 5455beff354a4616a68d8746e3e4f9a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:00.174703 6313 tablet_service.cc:1511] Processing CreateTablet for tablet d70b7662d85a4f64a11420448c4d140d (DEFAULT_TABLE table=default.Table_faa53cf5cc5541afb7b391368bdc55f7 [id=4a8f28e842e94d628326ca83935f23c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.176396 6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a34e178007b4e8ebed429cedf44e82a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.176047 6312 tablet_service.cc:1511] Processing CreateTablet for tablet a224ae69503e4ab588d6269086317f09 (DEFAULT_TABLE table=default.Table_23399a041c37452a8cebbc2f411fdb3f [id=6c09f84a1d19402b8b59bbc60ae92bcb]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:00.178494 6280 consensus_peers.cc:597] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1e1fef9ad60c4cf08507bb380f58fff3. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:00.179581 6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c0142f4e3ad42048803481d68f0ee5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.179454 6466 raft_consensus.cc:515] T e655ab5873294e75a242709f069aabf2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.180433 6466 leader_election.cc:290] T e655ab5873294e75a242709f069aabf2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:00.180488 6310 tablet_service.cc:1558] Processing DeleteTablet for tablet d70b7662d85a4f64a11420448c4d140d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:00.182926 6512 raft_consensus.cc:2749] T 8a2fbac8080441d4a9e03ff1d580bc8e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:00.183166 6512 raft_consensus.cc:2749] T 199843bdd7184df58be9a4a06a5ffb8b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:00.183318 6309 tablet_service.cc:1558] Processing DeleteTablet for tablet e1752d6b46894796bdc94e6230e3327d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:00.185590 6345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e655ab5873294e75a242709f069aabf2" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:00.186558 6345 raft_consensus.cc:2468] T e655ab5873294e75a242709f069aabf2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 0.
I20260923 19:50:00.186626 6456 raft_consensus.cc:359] T 32c8333073574fe79bfc3e33f3249256 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.187765 6456 raft_consensus.cc:385] T 32c8333073574fe79bfc3e33f3249256 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:00.187862 6456 raft_consensus.cc:740] T 32c8333073574fe79bfc3e33f3249256 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:00.187815 5996 leader_election.cc:304] T e655ab5873294e75a242709f069aabf2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:00.191792 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3190d18f00234d71b0a58c2c334ef45f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.193547 6520 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.143.212:38183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.5.143.254:37151,127.5.143.253:45285,127.5.143.252:45543
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.143.252:45543
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.5.143.252
--webserver_port=46305
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision faa920b8364ca43fd9d419253dab85c46533dc98
build type FASTDEBUG
built by None at 23 Sep 2026 19:43:25 UTC on bdcb31816ec0
build id 13965
ASAN enabled
I20260923 19:50:00.193665 6466 raft_consensus.cc:2804] T e655ab5873294e75a242709f069aabf2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:00.193825 6466 raft_consensus.cc:493] T e655ab5873294e75a242709f069aabf2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:00.194007 6466 raft_consensus.cc:3060] T e655ab5873294e75a242709f069aabf2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:00.197422 6456 consensus_queue.cc:260] T 32c8333073574fe79bfc3e33f3249256 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.203677 6520 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:50:00.207070 6456 ts_tablet_manager.cc:1434] T 32c8333073574fe79bfc3e33f3249256 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.024s user 0.002s sys 0.000s
I20260923 19:50:00.208455 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a224ae69503e4ab588d6269086317f09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.211867 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3158b344d1c748aab5004543e4448adb" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:00.212908 6139 leader_election.cc:343] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: c1b82e4a02794947b77040b6323ad96a
I20260923 19:50:00.213814 6471 raft_consensus.cc:493] T c14d36ad1b7241c894dbdff46159000c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:00.214053 6471 raft_consensus.cc:515] T c14d36ad1b7241c894dbdff46159000c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.214820 6520 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260923 19:50:00.215869 6471 leader_election.cc:290] T c14d36ad1b7241c894dbdff46159000c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:00.216075 6459 raft_consensus.cc:2272] T 57edfc8db29d498689ab77006d3fddfd P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:00.216993 6139 leader_election.cc:343] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: c1b82e4a02794947b77040b6323ad96a
I20260923 19:50:00.217761 6459 ts_tablet_manager.cc:1916] T 57edfc8db29d498689ab77006d3fddfd P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:00.218443 6280 leader_election.cc:343] T 3158b344d1c748aab5004543e4448adb P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:00.219292 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d91a56bace854494b7affd6c766b2847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.225611 6459 ts_tablet_manager.cc:1929] T 57edfc8db29d498689ab77006d3fddfd P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:00.225863 6459 log.cc:1199] T 57edfc8db29d498689ab77006d3fddfd P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/57edfc8db29d498689ab77006d3fddfd
I20260923 19:50:00.229400 6570 tablet.cc:1751] T 2f78261842744af08d86da64d37d708c P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260923 19:50:00.234381 6456 tablet_bootstrap.cc:492] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:00.235790 6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d70b7662d85a4f64a11420448c4d140d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.240760 6454 tablet_bootstrap.cc:654] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:00.245932 6345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14d36ad1b7241c894dbdff46159000c" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:00.246095 6459 ts_tablet_manager.cc:1950] T 57edfc8db29d498689ab77006d3fddfd P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:00.247145 6058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3158b344d1c748aab5004543e4448adb" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:00.248277 6345 raft_consensus.cc:2468] T c14d36ad1b7241c894dbdff46159000c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
W20260923 19:50:00.249121 6279 leader_election.cc:343] T 3158b344d1c748aab5004543e4448adb P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:00.206154 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_607e77dd178f4b828d2b91cccdf593a8" } new_table_name: "default.Table_299a64a07c544bb28305e07bd411f045" modify_external_catalogs: true
I20260923 19:50:00.250517 6279 leader_election.cc:304] T 3158b344d1c748aab5004543e4448adb P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:00.250919 6139 leader_election.cc:304] T c14d36ad1b7241c894dbdff46159000c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:00.206704 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_526fa05830fd4679bd95ea4b8e9af682"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:00.251901 6512 raft_consensus.cc:2749] T 3158b344d1c748aab5004543e4448adb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:00.252265 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_526fa05830fd4679bd95ea4b8e9af682 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:00.252894 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14d36ad1b7241c894dbdff46159000c" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:00.253579 6471 raft_consensus.cc:2804] T c14d36ad1b7241c894dbdff46159000c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:00.253695 6471 raft_consensus.cc:493] T c14d36ad1b7241c894dbdff46159000c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:00.253839 6471 raft_consensus.cc:3060] T c14d36ad1b7241c894dbdff46159000c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:00.206934 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_18b2b0faf7ec48c7b8e02c1459247503"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:00.255277 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_18b2b0faf7ec48c7b8e02c1459247503 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:00.256726 6471 raft_consensus.cc:515] T c14d36ad1b7241c894dbdff46159000c P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.207775 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_c716115e5d0045b691616d451daec14d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:00.257480 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c716115e5d0045b691616d451daec14d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:00.208645 5799 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_02aee02d3b8746ce98cba010a0ac8149" } modify_external_catalogs: true
I20260923 19:50:00.257980 5799 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_02aee02d3b8746ce98cba010a0ac8149" } modify_external_catalogs: true
I20260923 19:50:00.210306 5804 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_51c3e54ed92742fe9c3cb2e940037343" } modify_external_catalogs: true
I20260923 19:50:00.258396 5804 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_51c3e54ed92742fe9c3cb2e940037343" } modify_external_catalogs: true
I20260923 19:50:00.259786 6059 raft_consensus.cc:2468] T c14d36ad1b7241c894dbdff46159000c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:00.246474 6555 raft_consensus.cc:697] T 13566283020c41c9b97d8c16678450d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Becoming Leader. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Running, Role: LEADER
I20260923 19:50:00.271929 6471 leader_election.cc:290] T c14d36ad1b7241c894dbdff46159000c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:00.272845 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e655ab5873294e75a242709f069aabf2" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:00.273058 6057 raft_consensus.cc:2468] T c1b82e4a02794947b77040b6323ad96a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
W20260923 19:50:00.273425 5995 leader_election.cc:343] T e655ab5873294e75a242709f069aabf2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:00.273427 6552 raft_consensus.cc:2749] T c1b82e4a02794947b77040b6323ad96a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:00.274624 6459 tablet_replica.cc:333] T 13566283020c41c9b97d8c16678450d6 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:00.274847 6459 raft_consensus.cc:2243] T 13566283020c41c9b97d8c16678450d6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:00.275009 6459 raft_consensus.cc:2272] T 13566283020c41c9b97d8c16678450d6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:00.275713 6137 leader_election.cc:304] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd
I20260923 19:50:00.276048 6471 raft_consensus.cc:2804] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:00.276206 6471 raft_consensus.cc:697] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:00.276491 6471 consensus_queue.cc:237] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.276865 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 57edfc8db29d498689ab77006d3fddfd (table default.Table_83dc8a536f3944439f90216fd56a49b7 [id=ab7359c3bd74468a8e5eca672ba3fb1f]) successfully deleted
W20260923 19:50:00.277252 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 8a2fbac8080441d4a9e03ff1d580bc8e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a2fbac8080441d4a9e03ff1d580bc8e already in progress: creating tablet
W20260923 19:50:00.277477 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 640a98d3a845461e8d4f07041ab515c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 640a98d3a845461e8d4f07041ab515c7 already in progress: creating tablet
W20260923 19:50:00.277717 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 87afbdb11c6e4e58affd2f2d7995e1f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 87afbdb11c6e4e58affd2f2d7995e1f8 already in progress: creating tablet
W20260923 19:50:00.277935 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 4bf129dd52b84a4ea461ec454bc34fe8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4bf129dd52b84a4ea461ec454bc34fe8 already in progress: creating tablet
I20260923 19:50:00.275931 6459 ts_tablet_manager.cc:1916] T 13566283020c41c9b97d8c16678450d6 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:00.287029 6454 tablet_bootstrap.cc:492] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:00.289358 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14d36ad1b7241c894dbdff46159000c" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:00.297271 6544 raft_consensus.cc:515] T e67ef0eb259544a4b283cd03721bffe5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:00.297668 5800 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d91a56bace854494b7affd6c766b2847 consensus state has no leader
I20260923 19:50:00.293654 6555 consensus_queue.cc:237] T 13566283020c41c9b97d8c16678450d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.301143 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_aa2654e8c2db467ab317ae37cf1985aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:00.302119 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa2654e8c2db467ab317ae37cf1985aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:00.309564 5804 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 711bf0886c5540bdb2056c06197a62c8
I20260923 19:50:00.310145 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_a1fd9ea56c3849d19928269a6e9de801"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:00.310963 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1fd9ea56c3849d19928269a6e9de801 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:00.311610 6345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c14d36ad1b7241c894dbdff46159000c" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:00.312088 6345 raft_consensus.cc:3060] T c14d36ad1b7241c894dbdff46159000c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:00.313344 5801 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f5a4e1719fbf4219b34b7c0f65ee80ca" } modify_external_catalogs: true
I20260923 19:50:00.313578 5801 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f5a4e1719fbf4219b34b7c0f65ee80ca" } modify_external_catalogs: true
I20260923 19:50:00.315266 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_725d284e03844342909746398cb12562" } new_table_name: "default.Table_abe1e48d70954781b8e1ca09411789d4" modify_external_catalogs: true
I20260923 19:50:00.319419 6059 raft_consensus.cc:3060] T c14d36ad1b7241c894dbdff46159000c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:00.321034 6544 leader_election.cc:290] T e67ef0eb259544a4b283cd03721bffe5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:00.327719 5996 leader_election.cc:343] T e67ef0eb259544a4b283cd03721bffe5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: e67ef0eb259544a4b283cd03721bffe5
W20260923 19:50:00.330288 5995 leader_election.cc:343] T e67ef0eb259544a4b283cd03721bffe5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Not found: Tablet not found: e67ef0eb259544a4b283cd03721bffe5
I20260923 19:50:00.330566 5995 leader_election.cc:304] T e67ef0eb259544a4b283cd03721bffe5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:00.331976 6544 raft_consensus.cc:2749] T e67ef0eb259544a4b283cd03721bffe5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260923 19:50:00.336781 6456 tablet_bootstrap.cc:654] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:00.338289 6461 ts_tablet_manager.cc:1929] T 38993814002d4391a9801c0cf55e5374 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:00.342443 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_7ab0f3b15ee44f47b99ae44d22ec533f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:00.343883 6458 ts_tablet_manager.cc:1929] T 13566283020c41c9b97d8c16678450d6 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260923 19:50:00.343920 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7ab0f3b15ee44f47b99ae44d22ec533f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:00.344012 6458 log.cc:1199] T 13566283020c41c9b97d8c16678450d6 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/13566283020c41c9b97d8c16678450d6
I20260923 19:50:00.344476 6458 ts_tablet_manager.cc:1950] T 13566283020c41c9b97d8c16678450d6 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:00.345274 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 42) took 1569 ms. Trace:
I20260923 19:50:00.345391 6458 rpcz_store.cc:276] 0923 19:49:58.775995 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:49:58.776053 (+ 58us) service_pool.cc:224] Handling call
0923 19:49:59.898310 (+1122257us) ts_tablet_manager.cc:1151] Deleting tablet 13566283020c41c9b97d8c16678450d6
0923 19:49:59.898325 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:00.242603 (+344278us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:00.343782 (+101179us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:00.345238 (+ 1456us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1122024}
I20260923 19:50:00.349048 5802 master_service.cc:960] ReplaceTablet: received request to replace tablet cc3b6d245c3e40cdabb20d7dcf07ec0e from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:00.349351 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 13566283020c41c9b97d8c16678450d6 (table default.Table_dc62d1ed0f594a698f993c61a912cdbc [id=ca73f0867b5d49cfb0bb7cd2315c47f2]) successfully deleted
I20260923 19:50:00.352419 6461 log.cc:1199] T 38993814002d4391a9801c0cf55e5374 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/38993814002d4391a9801c0cf55e5374
I20260923 19:50:00.352854 6461 ts_tablet_manager.cc:1950] T 38993814002d4391a9801c0cf55e5374 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:00.353870 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 49) took 1467 ms. Trace:
I20260923 19:50:00.354455 6461 rpcz_store.cc:276] 0923 19:49:58.886333 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:49:58.917672 (+ 31339us) service_pool.cc:224] Handling call
0923 19:49:59.779996 (+862324us) ts_tablet_manager.cc:1151] Deleting tablet 38993814002d4391a9801c0cf55e5374
0923 19:49:59.780006 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:00.320231 (+540225us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:00.338202 (+ 17971us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:00.353812 (+ 15610us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":861853}
I20260923 19:50:00.343786 6059 raft_consensus.cc:2468] T c14d36ad1b7241c894dbdff46159000c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:00.347519 6466 raft_consensus.cc:515] T e655ab5873294e75a242709f069aabf2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.356741 6466 leader_election.cc:290] T e655ab5873294e75a242709f069aabf2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:00.358078 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 38993814002d4391a9801c0cf55e5374 (table default.Table_0e33e49bac5e4266bd2b09bb1010fce4 [id=ce4094be808b4dd3997cb576e11e3894]) successfully deleted
I20260923 19:50:00.360538 6461 tablet_replica.cc:333] T c14d36ad1b7241c894dbdff46159000c P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:00.361137 6461 raft_consensus.cc:2243] T c14d36ad1b7241c894dbdff46159000c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:00.361454 6461 raft_consensus.cc:2272] T c14d36ad1b7241c894dbdff46159000c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:00.362143 6461 ts_tablet_manager.cc:1916] T c14d36ad1b7241c894dbdff46159000c P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:00.364724 5801 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 00b6998f54ea46ff88c30481da296e0d
I20260923 19:50:00.364952 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e655ab5873294e75a242709f069aabf2" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:00.365135 6343 raft_consensus.cc:3060] T e655ab5873294e75a242709f069aabf2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:00.368338 6344 raft_consensus.cc:1275] T 5725a9cb95c448d0a5ea8114e90bc9fe P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Refusing update from remote peer 61022dd7f2f14dc19aebe3af5f08f430: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:50:00.364780 6345 raft_consensus.cc:2468] T c14d36ad1b7241c894dbdff46159000c P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:00.369359 6458 tablet_replica.cc:333] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:00.370889 6343 raft_consensus.cc:2468] T e655ab5873294e75a242709f069aabf2 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 1.
I20260923 19:50:00.371287 6461 ts_tablet_manager.cc:1929] T c14d36ad1b7241c894dbdff46159000c P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:00.371425 6461 log.cc:1199] T c14d36ad1b7241c894dbdff46159000c P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/c14d36ad1b7241c894dbdff46159000c
I20260923 19:50:00.371449 5996 leader_election.cc:304] T e655ab5873294e75a242709f069aabf2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:00.371850 6555 raft_consensus.cc:2804] T e655ab5873294e75a242709f069aabf2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:00.371992 6555 raft_consensus.cc:697] T e655ab5873294e75a242709f069aabf2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Becoming Leader. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Running, Role: LEADER
I20260923 19:50:00.372249 6555 consensus_queue.cc:237] T e655ab5873294e75a242709f069aabf2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.372505 5804 master_service.cc:960] ReplaceTablet: received request to replace tablet 3158b344d1c748aab5004543e4448adb from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:00.374650 5804 master_service.cc:960] ReplaceTablet: received request to replace tablet 32c8333073574fe79bfc3e33f3249256 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:00.377475 6458 raft_consensus.cc:2243] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:00.382472 6461 ts_tablet_manager.cc:1950] T c14d36ad1b7241c894dbdff46159000c P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:00.386113 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 52) took 1191 ms. Trace:
I20260923 19:50:00.386355 6461 rpcz_store.cc:276] 0923 19:49:59.194774 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:49:59.194849 (+ 75us) service_pool.cc:224] Handling call
0923 19:50:00.360440 (+1165591us) ts_tablet_manager.cc:1151] Deleting tablet c14d36ad1b7241c894dbdff46159000c
0923 19:50:00.360451 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:00.367191 (+ 6740us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:00.371180 (+ 3989us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:00.386043 (+ 14863us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1165347}
I20260923 19:50:00.386871 6461 tablet_replica.cc:333] T e655ab5873294e75a242709f069aabf2 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:00.386893 6458 pending_rounds.cc:70] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd: Trying to abort 1 pending ops.
I20260923 19:50:00.387132 6458 pending_rounds.cc:77] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630523637407744 op_type: NO_OP noop_request { }
I20260923 19:50:00.387288 6458 raft_consensus.cc:2889] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:00.388388 6461 raft_consensus.cc:2243] T e655ab5873294e75a242709f069aabf2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:00.388842 6461 pending_rounds.cc:70] T e655ab5873294e75a242709f069aabf2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Trying to abort 1 pending ops.
I20260923 19:50:00.389765 6458 raft_consensus.cc:2272] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:00.389968 6461 pending_rounds.cc:77] T e655ab5873294e75a242709f069aabf2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630529527029760 op_type: NO_OP noop_request { }
I20260923 19:50:00.390139 6461 raft_consensus.cc:2889] T e655ab5873294e75a242709f069aabf2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:00.390311 6461 raft_consensus.cc:2272] T e655ab5873294e75a242709f069aabf2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:00.390749 6458 ts_tablet_manager.cc:1916] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:00.391191 6461 ts_tablet_manager.cc:1916] T e655ab5873294e75a242709f069aabf2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:00.377394 5804 master_service.cc:960] ReplaceTablet: received request to replace tablet c52da04e5fe0454ea76bf4d99a930fd7 from {username='slave'} at 127.0.0.1:59912
W20260923 19:50:00.378602 5805 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a1e8b8e638ec438a86f05fa147cdb27c consensus state has no leader
I20260923 19:50:00.402057 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_118cf2f6e9e24518800d3f0b52552cee" } new_table_name: "default.Table_4b2190aa0f324c3987e02081e95555e4" modify_external_catalogs: true
I20260923 19:50:00.407163 6461 ts_tablet_manager.cc:1929] T e655ab5873294e75a242709f069aabf2 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:00.406919 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet c14d36ad1b7241c894dbdff46159000c (table default.Table_88b60f3e46a743d3913e7a4c0f353a59 [id=56cd81aa3d6f47d388803884b9220810]) successfully deleted
I20260923 19:50:00.412094 6456 tablet_bootstrap.cc:492] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:00.412271 6456 ts_tablet_manager.cc:1403] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.205s user 0.003s sys 0.005s
I20260923 19:50:00.412388 6461 log.cc:1199] T e655ab5873294e75a242709f069aabf2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/e655ab5873294e75a242709f069aabf2
I20260923 19:50:00.413337 6456 raft_consensus.cc:359] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.413473 6461 ts_tablet_manager.cc:1950] T e655ab5873294e75a242709f069aabf2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:00.413563 6456 raft_consensus.cc:385] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:00.413648 6456 raft_consensus.cc:740] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:00.413937 6456 consensus_queue.cc:260] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.389997 5801 master_service.cc:960] ReplaceTablet: received request to replace tablet e655ab5873294e75a242709f069aabf2 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:00.415136 6461 tablet_replica.cc:333] T 57edfc8db29d498689ab77006d3fddfd P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:00.416679 6461 raft_consensus.cc:2243] T 57edfc8db29d498689ab77006d3fddfd P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:00.416934 6461 raft_consensus.cc:2272] T 57edfc8db29d498689ab77006d3fddfd P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:00.417194 6456 ts_tablet_manager.cc:1434] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260923 19:50:00.417043 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet e655ab5873294e75a242709f069aabf2 (table default.Table_f1e7b89f9642419a93fed2c6c85f26c8 [id=c048860d19b54812a5898d84095d2353]) successfully deleted
I20260923 19:50:00.417541 6456 tablet_bootstrap.cc:492] T e52d78a941a341d186dc00bbe7df96bf P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:00.419396 6456 tablet_bootstrap.cc:654] T e52d78a941a341d186dc00bbe7df96bf P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:00.419909 6461 ts_tablet_manager.cc:1916] T 57edfc8db29d498689ab77006d3fddfd P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:00.424145 5798 catalog_manager.cc:5838] T c817af3eb83a43a3b6d4e9c83a9eefbb P e546f660e7e541d1aa9ae38e5ee5b9c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193). New cstate: current_term: 1 leader_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: UNKNOWN } } }
I20260923 19:50:00.424638 5798 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet c817af3eb83a43a3b6d4e9c83a9eefbb (table default.Table_30f4ccabe7fa4c8ba92e008f3d9b2d80 [id=b9b7fe147b8645389ebef237fa735b2b]). Expected version 2 got 0
I20260923 19:50:00.424993 6458 ts_tablet_manager.cc:1929] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:00.425112 6458 log.cc:1199] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/1e1fef9ad60c4cf08507bb380f58fff3
I20260923 19:50:00.425527 6458 ts_tablet_manager.cc:1950] T 1e1fef9ad60c4cf08507bb380f58fff3 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:00.427294 6461 ts_tablet_manager.cc:1929] T 57edfc8db29d498689ab77006d3fddfd P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:00.350668 6176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a34e178007b4e8ebed429cedf44e82a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.428680 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 4b15b250f594459eb959b4871f7ae398 (DEFAULT_TABLE table=default.Table_5840c3d0f0f540f4aa28042cd39593cc [id=4bf839f09513412ea20c5e0afece9c37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.433437 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b15b250f594459eb959b4871f7ae398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.356006 6137 leader_election.cc:304] T c14d36ad1b7241c894dbdff46159000c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:00.434389 6471 raft_consensus.cc:2804] T c14d36ad1b7241c894dbdff46159000c P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:00.357558 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e655ab5873294e75a242709f069aabf2" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:00.434532 6471 raft_consensus.cc:697] T c14d36ad1b7241c894dbdff46159000c P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:00.372977 6540 consensus_queue.cc:1048] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:00.434784 6471 consensus_queue.cc:237] T c14d36ad1b7241c894dbdff46159000c P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.394820 6570 tablet.cc:1746] T 2f78261842744af08d86da64d37d708c P 61022dd7f2f14dc19aebe3af5f08f430: Skipping requested alter to schema version 4, tablet already version 4
W20260923 19:50:00.436698 6139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.195:32855, user_credentials={real_user=slave}} blocked reactor thread for 63864us
W20260923 19:50:00.437268 5995 leader_election.cc:343] T e655ab5873294e75a242709f069aabf2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:00.437443 6461 log.cc:1199] T 57edfc8db29d498689ab77006d3fddfd P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/57edfc8db29d498689ab77006d3fddfd
I20260923 19:50:00.437834 6461 ts_tablet_manager.cc:1950] T 57edfc8db29d498689ab77006d3fddfd P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:00.438127 6173 tablet_service.cc:1511] Processing CreateTablet for tablet 789c54477bec4636bb3669e1f62730e2 (DEFAULT_TABLE table=default.Table_5d58068c086e43069a48f9544c8c8757 [id=a29ffe556086466eb3f8602902a72517]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.438526 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 789c54477bec4636bb3669e1f62730e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.428452 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 4b15b250f594459eb959b4871f7ae398 (DEFAULT_TABLE table=default.Table_5840c3d0f0f540f4aa28042cd39593cc [id=4bf839f09513412ea20c5e0afece9c37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.439731 6461 tablet_replica.cc:333] T 29b2b75a12cb4ea3b73afe0ac549386f P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:00.439862 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b15b250f594459eb959b4871f7ae398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.439997 6461 raft_consensus.cc:2243] T 29b2b75a12cb4ea3b73afe0ac549386f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:00.440214 6461 raft_consensus.cc:2272] T 29b2b75a12cb4ea3b73afe0ac549386f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:00.440486 6315 tablet_service.cc:1511] Processing CreateTablet for tablet 789c54477bec4636bb3669e1f62730e2 (DEFAULT_TABLE table=default.Table_5d58068c086e43069a48f9544c8c8757 [id=a29ffe556086466eb3f8602902a72517]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.440896 6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 789c54477bec4636bb3669e1f62730e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.440920 6461 ts_tablet_manager.cc:1916] T 29b2b75a12cb4ea3b73afe0ac549386f P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:00.445778 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 9101e82501fd461f8a4b2dcd9dffbd74 (DEFAULT_TABLE table=default.Table_9429c0a32a944532a7c0e98762ee3ebe [id=3ab47a5709f64cdf87575911498c5760]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.446244 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9101e82501fd461f8a4b2dcd9dffbd74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.451180 6540 raft_consensus.cc:493] T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:00.451347 6540 raft_consensus.cc:515] T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.431164 6456 tablet_bootstrap.cc:492] T e52d78a941a341d186dc00bbe7df96bf P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:00.452102 6540 leader_election.cc:290] T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:00.452210 6456 ts_tablet_manager.cc:1403] T e52d78a941a341d186dc00bbe7df96bf P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.035s user 0.004s sys 0.000s
I20260923 19:50:00.452996 6456 raft_consensus.cc:359] T e52d78a941a341d186dc00bbe7df96bf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.453177 6456 raft_consensus.cc:385] T e52d78a941a341d186dc00bbe7df96bf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:00.453245 6456 raft_consensus.cc:740] T e52d78a941a341d186dc00bbe7df96bf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:00.453740 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64a38bbd3fbd4738a73e78e3f6436fe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.454674 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 43) took 1594 ms. Trace:
I20260923 19:50:00.454792 6458 rpcz_store.cc:276] 0923 19:49:58.860226 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:49:58.861454 (+ 1228us) service_pool.cc:224] Handling call
0923 19:50:00.354974 (+1493520us) ts_tablet_manager.cc:1151] Deleting tablet 1e1fef9ad60c4cf08507bb380f58fff3
0923 19:50:00.354986 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:00.411281 (+ 56295us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:00.424910 (+ 13629us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:00.454642 (+ 29732us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1493255}
I20260923 19:50:00.455451 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c0142f4e3ad42048803481d68f0ee5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.455369 6456 consensus_queue.cc:260] T e52d78a941a341d186dc00bbe7df96bf P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.455782 6570 tablet.cc:1751] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:00.455937 6456 ts_tablet_manager.cc:1434] T e52d78a941a341d186dc00bbe7df96bf P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260923 19:50:00.456262 6456 tablet_bootstrap.cc:492] T c52da04e5fe0454ea76bf4d99a930fd7 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:00.458853 6586 tablet.cc:1751] T 5725a9cb95c448d0a5ea8114e90bc9fe P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:00.459818 6458 tablet_replica.cc:333] T 38993814002d4391a9801c0cf55e5374 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:00.460448 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f372b952804ac58e602998d9b77d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.460785 6458 raft_consensus.cc:2243] T 38993814002d4391a9801c0cf55e5374 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:00.461241 6458 raft_consensus.cc:2272] T 38993814002d4391a9801c0cf55e5374 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:00.462368 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 063fc0e77d294ddf8a02e9ab5968a5e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.462812 6458 ts_tablet_manager.cc:1916] T 38993814002d4391a9801c0cf55e5374 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:00.463733 6461 ts_tablet_manager.cc:1929] T 29b2b75a12cb4ea3b73afe0ac549386f P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:00.463979 6461 log.cc:1199] T 29b2b75a12cb4ea3b73afe0ac549386f P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/29b2b75a12cb4ea3b73afe0ac549386f
I20260923 19:50:00.464442 6461 ts_tablet_manager.cc:1950] T 29b2b75a12cb4ea3b73afe0ac549386f P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:00.464179 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16098a9f015040dc93d9cca2fc9ebce2" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:00.466234 6343 raft_consensus.cc:2468] T 16098a9f015040dc93d9cca2fc9ebce2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:00.466658 6175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d91a56bace854494b7affd6c766b2847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.468710 6139 leader_election.cc:304] T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:00.471361 6456 tablet_bootstrap.cc:654] T c52da04e5fe0454ea76bf4d99a930fd7 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:00.474040 6471 raft_consensus.cc:2804] T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:00.474102 6461 tablet_replica.cc:333] T e67ef0eb259544a4b283cd03721bffe5 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:00.474256 6471 raft_consensus.cc:493] T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:00.474381 6461 raft_consensus.cc:2243] T e67ef0eb259544a4b283cd03721bffe5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:00.474500 6471 raft_consensus.cc:3060] T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:00.474745 6461 raft_consensus.cc:2272] T e67ef0eb259544a4b283cd03721bffe5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:00.475524 6461 ts_tablet_manager.cc:1916] T e67ef0eb259544a4b283cd03721bffe5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:00.481308 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 4750e2a1b24e4bc7aafa4cd36afebbbd (DEFAULT_TABLE table=default.Table_103c4095b9c641d7aed905489796806e [id=0747811756dc43fdb5cba790c9a319df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.481906 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4750e2a1b24e4bc7aafa4cd36afebbbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.484673 6471 raft_consensus.cc:515] T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.486501 6461 ts_tablet_manager.cc:1929] T e67ef0eb259544a4b283cd03721bffe5 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:00.488873 6471 leader_election.cc:290] T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:00.495803 6461 log.cc:1199] T e67ef0eb259544a4b283cd03721bffe5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/e67ef0eb259544a4b283cd03721bffe5
I20260923 19:50:00.496450 6461 ts_tablet_manager.cc:1950] T e67ef0eb259544a4b283cd03721bffe5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:00.493772 6457 tablet_bootstrap.cc:492] T 3158b344d1c748aab5004543e4448adb P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:00.455406 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 1e1fef9ad60c4cf08507bb380f58fff3 (table default.Table_02aee02d3b8746ce98cba010a0ac8149 [id=47c37093044c462993bba6cb00bd296a]) successfully deleted
W20260923 19:50:00.502249 5792 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.5.143.195:32855, user_credentials={real_user=slave}} blocked reactor thread for 46836.5us
W20260923 19:50:00.429940 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet e52d78a941a341d186dc00bbe7df96bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e52d78a941a341d186dc00bbe7df96bf already in progress: creating tablet
W20260923 19:50:00.504045 5790 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.5.143.193:39887, user_credentials={real_user=slave}} blocked reactor thread for 74751.3us
I20260923 19:50:00.504532 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 57edfc8db29d498689ab77006d3fddfd (table default.Table_83dc8a536f3944439f90216fd56a49b7 [id=ab7359c3bd74468a8e5eca672ba3fb1f]) successfully deleted
I20260923 19:50:00.504993 6457 ts_tablet_manager.cc:1403] T 3158b344d1c748aab5004543e4448adb P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.467s user 0.008s sys 0.007s
I20260923 19:50:00.506016 6461 tablet_replica.cc:333] T c1b82e4a02794947b77040b6323ad96a P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:00.506081 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 29b2b75a12cb4ea3b73afe0ac549386f (table default.Table_db8d2bf4a72d4038998c7ac73aef62f1 [id=c28edbfa33d947f1ad22e1f218da9de0]) successfully deleted
W20260923 19:50:00.506323 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 1a5f682ef2794a1fb9f5c4c2c1ee52e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a5f682ef2794a1fb9f5c4c2c1ee52e7 already in progress: creating tablet
I20260923 19:50:00.506736 6461 raft_consensus.cc:2243] T c1b82e4a02794947b77040b6323ad96a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:00.507011 6461 raft_consensus.cc:2272] T c1b82e4a02794947b77040b6323ad96a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:00.507464 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 32c8333073574fe79bfc3e33f3249256 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32c8333073574fe79bfc3e33f3249256 already in progress: creating tablet
I20260923 19:50:00.506256 6457 raft_consensus.cc:359] T 3158b344d1c748aab5004543e4448adb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.507699 6457 raft_consensus.cc:385] T 3158b344d1c748aab5004543e4448adb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:00.507791 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet e67ef0eb259544a4b283cd03721bffe5 (table default.Table_61c4c80bb6264458b904d9b0322596c0 [id=3fb7e854da784756b57db432e6c373db]) successfully deleted
I20260923 19:50:00.507855 6457 raft_consensus.cc:740] T 3158b344d1c748aab5004543e4448adb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:00.508272 6457 consensus_queue.cc:260] T 3158b344d1c748aab5004543e4448adb P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.508850 6022 tablet_service.cc:1511] Processing CreateTablet for tablet 4b15b250f594459eb959b4871f7ae398 (DEFAULT_TABLE table=default.Table_5840c3d0f0f540f4aa28042cd39593cc [id=4bf839f09513412ea20c5e0afece9c37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.509099 6457 ts_tablet_manager.cc:1434] T 3158b344d1c748aab5004543e4448adb P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260923 19:50:00.509339 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b15b250f594459eb959b4871f7ae398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.509526 6457 tablet_bootstrap.cc:492] T 8a2fbac8080441d4a9e03ff1d580bc8e P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:00.512516 6457 tablet_bootstrap.cc:654] T 8a2fbac8080441d4a9e03ff1d580bc8e P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:00.513736 6461 ts_tablet_manager.cc:1916] T c1b82e4a02794947b77040b6323ad96a P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:00.522205 6022 tablet_service.cc:1511] Processing CreateTablet for tablet 789c54477bec4636bb3669e1f62730e2 (DEFAULT_TABLE table=default.Table_5d58068c086e43069a48f9544c8c8757 [id=a29ffe556086466eb3f8602902a72517]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.522756 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 789c54477bec4636bb3669e1f62730e2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:00.526250 6588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 19:50:00.527318 6590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:50:00.528466 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 9101e82501fd461f8a4b2dcd9dffbd74 (DEFAULT_TABLE table=default.Table_9429c0a32a944532a7c0e98762ee3ebe [id=3ab47a5709f64cdf87575911498c5760]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.528762 6032 tablet_service.cc:1511] Processing CreateTablet for tablet 4750e2a1b24e4bc7aafa4cd36afebbbd (DEFAULT_TABLE table=default.Table_103c4095b9c641d7aed905489796806e [id=0747811756dc43fdb5cba790c9a319df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.528941 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9101e82501fd461f8a4b2dcd9dffbd74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.529160 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4750e2a1b24e4bc7aafa4cd36afebbbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.534209 6454 ts_tablet_manager.cc:1403] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.437s user 0.002s sys 0.003s
I20260923 19:50:00.535158 6454 raft_consensus.cc:359] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.535369 6454 raft_consensus.cc:385] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:00.535445 6454 raft_consensus.cc:740] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
W20260923 19:50:00.536376 6137 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.193:39887, user_credentials={real_user=slave}} blocked reactor thread for 180393us
I20260923 19:50:00.537442 6059 raft_consensus.cc:1275] T 5725a9cb95c448d0a5ea8114e90bc9fe P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Refusing update from remote peer 61022dd7f2f14dc19aebe3af5f08f430: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260923 19:50:00.541406 6137 leader_election.cc:343] T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 16098a9f015040dc93d9cca2fc9ebce2
W20260923 19:50:00.541916 6137 leader_election.cc:343] T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 16098a9f015040dc93d9cca2fc9ebce2
I20260923 19:50:00.542892 6459 ts_tablet_manager.cc:1929] T 13566283020c41c9b97d8c16678450d6 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:00.543092 6459 log.cc:1199] T 13566283020c41c9b97d8c16678450d6 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/13566283020c41c9b97d8c16678450d6
W20260923 19:50:00.543059 6593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:50:00.543597 6459 ts_tablet_manager.cc:1950] T 13566283020c41c9b97d8c16678450d6 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:00.544847 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 13566283020c41c9b97d8c16678450d6 (table default.Table_dc62d1ed0f594a698f993c61a912cdbc [id=ca73f0867b5d49cfb0bb7cd2315c47f2]) successfully deleted
I20260923 19:50:00.545173 6457 tablet_bootstrap.cc:492] T 8a2fbac8080441d4a9e03ff1d580bc8e P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:00.545432 6457 ts_tablet_manager.cc:1403] T 8a2fbac8080441d4a9e03ff1d580bc8e P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.036s user 0.004s sys 0.000s
I20260923 19:50:00.546319 6520 server_base.cc:1061] running on GCE node
I20260923 19:50:00.546480 6457 raft_consensus.cc:359] T 8a2fbac8080441d4a9e03ff1d580bc8e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.546684 6457 raft_consensus.cc:385] T 8a2fbac8080441d4a9e03ff1d580bc8e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:00.546765 6457 raft_consensus.cc:740] T 8a2fbac8080441d4a9e03ff1d580bc8e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:00.547060 6457 consensus_queue.cc:260] T 8a2fbac8080441d4a9e03ff1d580bc8e P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.547583 6457 ts_tablet_manager.cc:1434] T 8a2fbac8080441d4a9e03ff1d580bc8e P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:50:00.547887 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5d58068c086e43069a48f9544c8c8757" } new_table_name: "default.Table_655007916e0446c2bd045bee42d2592f" modify_external_catalogs: true
I20260923 19:50:00.548561 6457 tablet_bootstrap.cc:492] T 0cdb778f87fa40b89dad97d166192a1e P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:00.548326 6520 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:50:00.549458 6582 consensus_queue.cc:1048] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:00.550287 6457 tablet_bootstrap.cc:654] T 0cdb778f87fa40b89dad97d166192a1e P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:00.554014 6584 mvcc.cc:204] Tried to move back new op lower bound from 7332630529478656000 to 7332630526751449088. Current Snapshot: MvccSnapshot[applied={T|T < 7332630529478656000}]
I20260923 19:50:00.558286 6512 raft_consensus.cc:493] T 09bb2ab5617a49d99e75191b3b48b85f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:00.558729 6512 raft_consensus.cc:515] T 09bb2ab5617a49d99e75191b3b48b85f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.559379 6512 leader_election.cc:290] T 09bb2ab5617a49d99e75191b3b48b85f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:00.559552 6512 raft_consensus.cc:493] T 32c8333073574fe79bfc3e33f3249256 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:00.559681 6512 raft_consensus.cc:515] T 32c8333073574fe79bfc3e33f3249256 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.560300 6512 leader_election.cc:290] T 32c8333073574fe79bfc3e33f3249256 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:00.560846 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16098a9f015040dc93d9cca2fc9ebce2" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:00.561036 6569 raft_consensus.cc:493] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:00.561031 6057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bb2ab5617a49d99e75191b3b48b85f" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:00.561637 6343 raft_consensus.cc:3060] T 16098a9f015040dc93d9cca2fc9ebce2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:00.562073 6058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8333073574fe79bfc3e33f3249256" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:00.563071 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bb2ab5617a49d99e75191b3b48b85f" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:00.563540 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8333073574fe79bfc3e33f3249256" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:00.564738 6279 leader_election.cc:343] T 09bb2ab5617a49d99e75191b3b48b85f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:00.564495 6569 raft_consensus.cc:515] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:00.567957 6280 leader_election.cc:343] T 09bb2ab5617a49d99e75191b3b48b85f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:00.570091 6461 ts_tablet_manager.cc:1929] T c1b82e4a02794947b77040b6323ad96a P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:00.570547 6461 log.cc:1199] T c1b82e4a02794947b77040b6323ad96a P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/c1b82e4a02794947b77040b6323ad96a
I20260923 19:50:00.571224 6461 ts_tablet_manager.cc:1950] T c1b82e4a02794947b77040b6323ad96a P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:00.573133 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet c1b82e4a02794947b77040b6323ad96a (table default.Table_382e555ccd2a4ebda27bedf8b1cbb159 [id=ce8e51ef23914830a2fc7f9bb0d2ac68]) successfully deleted
W20260923 19:50:00.575459 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 87afbdb11c6e4e58affd2f2d7995e1f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 87afbdb11c6e4e58affd2f2d7995e1f8 already in progress: creating tablet
W20260923 19:50:00.577255 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 4bf129dd52b84a4ea461ec454bc34fe8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4bf129dd52b84a4ea461ec454bc34fe8 already in progress: creating tablet
I20260923 19:50:00.578508 6461 tablet_replica.cc:333] T 8a2fbac8080441d4a9e03ff1d580bc8e P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:00.579385 6461 raft_consensus.cc:2243] T 8a2fbac8080441d4a9e03ff1d580bc8e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:00.582958 6461 raft_consensus.cc:2272] T 8a2fbac8080441d4a9e03ff1d580bc8e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:00.591212 6461 ts_tablet_manager.cc:1916] T 8a2fbac8080441d4a9e03ff1d580bc8e P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:00.535722 6454 consensus_queue.cc:260] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.593217 6454 ts_tablet_manager.cc:1434] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.059s user 0.001s sys 0.001s
I20260923 19:50:00.594158 6459 tablet_replica.cc:333] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:00.594323 6459 raft_consensus.cc:2243] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:00.594734 6459 pending_rounds.cc:70] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:00.594918 6459 pending_rounds.cc:77] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630529134755840 op_type: NO_OP noop_request { }
I20260923 19:50:00.595082 6459 raft_consensus.cc:2889] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:00.595191 6459 raft_consensus.cc:2272] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:00.600977 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet b7f372b952804ac58e602998d9b77d72
I20260923 19:50:00.602182 6022 tablet_service.cc:1558] Processing DeleteTablet for tablet b7f372b952804ac58e602998d9b77d72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:00.603960 6022 tablet_service.cc:1558] Processing DeleteTablet for tablet c14d36ad1b7241c894dbdff46159000c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:58 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:00.603929 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet 13566283020c41c9b97d8c16678450d6 with delete_type TABLET_DATA_DELETED (replaced by tablet c52da04e5fe0454ea76bf4d99a930fd7) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:00.604271 5800 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 2f78261842744af08d86da64d37d708c (table default.Table_a5d9d7b0e0b449ae8791e459b7d88f18 [id=7e9508e469b14579a0c697ac4ca5cc4a]). Expected version 4 got 0
I20260923 19:50:00.608904 5799 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 8db0358af7634911820f99fe16605ca7
I20260923 19:50:00.610148 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet 8db0358af7634911820f99fe16605ca7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:00 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:00.611845 5805 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 223edddace234a16b2d360504a99c28b consensus state has no leader
I20260923 19:50:00.613300 6461 ts_tablet_manager.cc:1929] T 8a2fbac8080441d4a9e03ff1d580bc8e P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:00.617493 6461 log.cc:1199] T 8a2fbac8080441d4a9e03ff1d580bc8e P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/8a2fbac8080441d4a9e03ff1d580bc8e
I20260923 19:50:00.618968 6461 ts_tablet_manager.cc:1950] T 8a2fbac8080441d4a9e03ff1d580bc8e P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:00.619845 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 8a2fbac8080441d4a9e03ff1d580bc8e (table default.Table_d94eaba070fd454bb85f8ef139ba0a28 [id=738ed1d070ef485e9299c1f3b1db008a]) successfully deleted
W20260923 19:50:00.621246 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 640a98d3a845461e8d4f07041ab515c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 640a98d3a845461e8d4f07041ab515c7 already in progress: creating tablet
W20260923 19:50:00.622152 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 5455beff354a4616a68d8746e3e4f9a8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5455beff354a4616a68d8746e3e4f9a8 already in progress: creating tablet
W20260923 19:50:00.622823 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet e1752d6b46894796bdc94e6230e3327d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e1752d6b46894796bdc94e6230e3327d already in progress: creating tablet
W20260923 19:50:00.623462 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet d70b7662d85a4f64a11420448c4d140d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d70b7662d85a4f64a11420448c4d140d already in progress: creating tablet
W20260923 19:50:00.624310 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet b7f372b952804ac58e602998d9b77d72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b7f372b952804ac58e602998d9b77d72 already in progress: creating tablet
W20260923 19:50:00.624949 5790 catalog_manager.cc:5030] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet c14d36ad1b7241c894dbdff46159000c because the tablet was not found. No further retry: Not found: Tablet not found: c14d36ad1b7241c894dbdff46159000c
I20260923 19:50:00.625320 6461 tablet_replica.cc:333] T 13566283020c41c9b97d8c16678450d6 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:00.626112 6461 raft_consensus.cc:2243] T 13566283020c41c9b97d8c16678450d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:00.626652 6461 pending_rounds.cc:70] T 13566283020c41c9b97d8c16678450d6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Trying to abort 1 pending ops.
I20260923 19:50:00.627249 6461 pending_rounds.cc:77] T 13566283020c41c9b97d8c16678450d6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630529226006528 op_type: NO_OP noop_request { }
I20260923 19:50:00.627668 6461 raft_consensus.cc:2889] T 13566283020c41c9b97d8c16678450d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:00.628014 6461 raft_consensus.cc:2272] T 13566283020c41c9b97d8c16678450d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:00.630128 6461 ts_tablet_manager.cc:1916] T 13566283020c41c9b97d8c16678450d6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:00.633364 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet b7f372b952804ac58e602998d9b77d72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:00.636349 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet 8db0358af7634911820f99fe16605ca7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:00 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:00.646721 6458 ts_tablet_manager.cc:1929] T 38993814002d4391a9801c0cf55e5374 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:00.647323 6280 leader_election.cc:304] T 09bb2ab5617a49d99e75191b3b48b85f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:00.647430 6458 log.cc:1199] T 38993814002d4391a9801c0cf55e5374 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/38993814002d4391a9801c0cf55e5374
W20260923 19:50:00.647785 6280 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 83619us
I20260923 19:50:00.648056 6458 ts_tablet_manager.cc:1950] T 38993814002d4391a9801c0cf55e5374 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:00.648212 6569 leader_election.cc:290] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:00.648437 6569 raft_consensus.cc:2749] T 09bb2ab5617a49d99e75191b3b48b85f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:00.649372 6456 tablet_bootstrap.cc:492] T c52da04e5fe0454ea76bf4d99a930fd7 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
W20260923 19:50:00.647094 6279 leader_election.cc:343] T 32c8333073574fe79bfc3e33f3249256 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:00.649549 6454 tablet_bootstrap.cc:492] T 199843bdd7184df58be9a4a06a5ffb8b P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
W20260923 19:50:00.654078 6280 leader_election.cc:343] T 32c8333073574fe79bfc3e33f3249256 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:00.654366 6280 leader_election.cc:304] T 32c8333073574fe79bfc3e33f3249256 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:00.655946 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dbc0e17d77140f6abe9ee26c8ec13ee" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:00.656436 6512 raft_consensus.cc:2749] T 32c8333073574fe79bfc3e33f3249256 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:00.657112 6454 tablet_bootstrap.cc:654] T 199843bdd7184df58be9a4a06a5ffb8b P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:00.657275 6280 leader_election.cc:343] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:00.660487 6459 ts_tablet_manager.cc:1916] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:00.665959 6456 ts_tablet_manager.cc:1403] T c52da04e5fe0454ea76bf4d99a930fd7 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.193s user 0.011s sys 0.019s
I20260923 19:50:00.666409 6461 ts_tablet_manager.cc:1929] T 13566283020c41c9b97d8c16678450d6 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:00.666558 6461 log.cc:1199] T 13566283020c41c9b97d8c16678450d6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/13566283020c41c9b97d8c16678450d6
I20260923 19:50:00.666987 6461 ts_tablet_manager.cc:1950] T 13566283020c41c9b97d8c16678450d6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:00.667409 6456 raft_consensus.cc:359] T c52da04e5fe0454ea76bf4d99a930fd7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.667639 6456 raft_consensus.cc:385] T c52da04e5fe0454ea76bf4d99a930fd7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260923 19:50:00.667721 6279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.193:39887, user_credentials={real_user=slave}} blocked reactor thread for 84634.4us
I20260923 19:50:00.668905 6456 raft_consensus.cc:740] T c52da04e5fe0454ea76bf4d99a930fd7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:00.669008 6058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dbc0e17d77140f6abe9ee26c8ec13ee" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:00.669176 6456 consensus_queue.cc:260] T c52da04e5fe0454ea76bf4d99a930fd7 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.670691 6456 ts_tablet_manager.cc:1434] T c52da04e5fe0454ea76bf4d99a930fd7 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
W20260923 19:50:00.671025 6279 leader_election.cc:343] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:00.671207 6279 leader_election.cc:304] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:00.671742 6456 tablet_bootstrap.cc:492] T 4bf129dd52b84a4ea461ec454bc34fe8 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:00.672791 6512 raft_consensus.cc:2749] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:00.674763 6343 raft_consensus.cc:2468] T 16098a9f015040dc93d9cca2fc9ebce2 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:00.674846 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet f7e282b6699a4ce9837d221132a1f54e
I20260923 19:50:00.675905 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet f7e282b6699a4ce9837d221132a1f54e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:00.676662 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet c52da04e5fe0454ea76bf4d99a930fd7
I20260923 19:50:00.677277 6457 tablet_bootstrap.cc:492] T 0cdb778f87fa40b89dad97d166192a1e P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:00.677450 5804 catalog_manager.cc:6934] ReplaceTablet: tablet c52da04e5fe0454ea76bf4d99a930fd7 deleted and replaced by tablet b529b0e82c5b48edac54cc281ac4b4a6
I20260923 19:50:00.677778 6457 ts_tablet_manager.cc:1403] T 0cdb778f87fa40b89dad97d166192a1e P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.129s user 0.012s sys 0.015s
I20260923 19:50:00.678053 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet c52da04e5fe0454ea76bf4d99a930fd7 with delete_type TABLET_DATA_DELETED (replaced by tablet b529b0e82c5b48edac54cc281ac4b4a6) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:00.679404 6457 raft_consensus.cc:359] T 0cdb778f87fa40b89dad97d166192a1e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.681015 6457 raft_consensus.cc:385] T 0cdb778f87fa40b89dad97d166192a1e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:00.681190 6457 raft_consensus.cc:740] T 0cdb778f87fa40b89dad97d166192a1e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:00.681577 6456 tablet_bootstrap.cc:654] T 4bf129dd52b84a4ea461ec454bc34fe8 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:00.682458 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 9101e82501fd461f8a4b2dcd9dffbd74 (DEFAULT_TABLE table=default.Table_9429c0a32a944532a7c0e98762ee3ebe [id=3ab47a5709f64cdf87575911498c5760]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.683313 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9101e82501fd461f8a4b2dcd9dffbd74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.686043 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_b28fac33a5bd4feea5ac2c04b2bcecc4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:00.686794 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b28fac33a5bd4feea5ac2c04b2bcecc4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:00.688287 5797 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_4e613a89795a4121ab7fa2a338f3cc0a" } new_table_name: "default.Table_822c35f920714c3d8d79f91566bd5da9" modify_external_catalogs: true
I20260923 19:50:00.689491 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_42fbb36fdc75430881f49e0b2bb82fc3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:00.690024 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_42fbb36fdc75430881f49e0b2bb82fc3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:00.691381 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_8f05b370f3d340329b68573e263210cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:00.681586 6457 consensus_queue.cc:260] T 0cdb778f87fa40b89dad97d166192a1e P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:00.691989 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f05b370f3d340329b68573e263210cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:00.692584 6457 ts_tablet_manager.cc:1434] T 0cdb778f87fa40b89dad97d166192a1e P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260923 19:50:00.692992 6457 tablet_bootstrap.cc:492] T 199843bdd7184df58be9a4a06a5ffb8b P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:00.693281 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_f6c15bbc16984baa89deab54175d787a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:00.693864 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f6c15bbc16984baa89deab54175d787a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:00.695919 6457 tablet_bootstrap.cc:654] T 199843bdd7184df58be9a4a06a5ffb8b P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:00.697360 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 13566283020c41c9b97d8c16678450d6 (table default.Table_dc62d1ed0f594a698f993c61a912cdbc [id=ca73f0867b5d49cfb0bb7cd2315c47f2]) successfully deleted
W20260923 19:50:00.697670 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 8db0358af7634911820f99fe16605ca7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8db0358af7634911820f99fe16605ca7 already in progress: creating tablet
W20260923 19:50:00.697937 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet f7e282b6699a4ce9837d221132a1f54e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7e282b6699a4ce9837d221132a1f54e already in progress: creating tablet
W20260923 19:50:00.698173 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet c52da04e5fe0454ea76bf4d99a930fd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c52da04e5fe0454ea76bf4d99a930fd7 already in progress: creating tablet
I20260923 19:50:00.698613 6601 tablet.cc:1751] T 5725a9cb95c448d0a5ea8114e90bc9fe P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:00.702064 5804 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7fd9c4118903480880d758509d249fd6" } new_table_name: "default.Table_c7b73cad6d7c4835b049256948ad530c" modify_external_catalogs: true
I20260923 19:50:00.704214 6555 consensus_queue.cc:1048] T c817af3eb83a43a3b6d4e9c83a9eefbb P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:00.705984 6315 tablet_service.cc:1558] Processing DeleteTablet for tablet b7f372b952804ac58e602998d9b77d72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:00.706241 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet cc3b6d245c3e40cdabb20d7dcf07ec0e
I20260923 19:50:00.706728 5802 catalog_manager.cc:6934] ReplaceTablet: tablet cc3b6d245c3e40cdabb20d7dcf07ec0e deleted and replaced by tablet 85d35ebef3c24a2e89233dd900b63513
I20260923 19:50:00.707124 6313 tablet_service.cc:1558] Processing DeleteTablet for tablet 8db0358af7634911820f99fe16605ca7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:00 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:00.708110 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 4750e2a1b24e4bc7aafa4cd36afebbbd (DEFAULT_TABLE table=default.Table_103c4095b9c641d7aed905489796806e [id=0747811756dc43fdb5cba790c9a319df]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:00.708510 5803 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 789c54477bec4636bb3669e1f62730e2 consensus state has no leader
I20260923 19:50:00.708621 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4750e2a1b24e4bc7aafa4cd36afebbbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.709482 6520 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:50:00.709693 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet cc3b6d245c3e40cdabb20d7dcf07ec0e with delete_type TABLET_DATA_DELETED (replaced by tablet 85d35ebef3c24a2e89233dd900b63513) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:00.710439 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet cc3b6d245c3e40cdabb20d7dcf07ec0e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc3b6d245c3e40cdabb20d7dcf07ec0e already in progress: creating tablet
I20260923 19:50:00.711544 6315 tablet_service.cc:1558] Processing DeleteTablet for tablet f7e282b6699a4ce9837d221132a1f54e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:00.711474 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_e6225c62c99144cdb7c222d165e1d7b5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:00.711706 6313 tablet_service.cc:1558] Processing DeleteTablet for tablet c52da04e5fe0454ea76bf4d99a930fd7 with delete_type TABLET_DATA_DELETED (replaced by tablet b529b0e82c5b48edac54cc281ac4b4a6) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:00.712199 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e6225c62c99144cdb7c222d165e1d7b5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:00.715261 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 45) took 1844 ms. Trace:
I20260923 19:50:00.715360 6458 rpcz_store.cc:276] 0923 19:49:58.871049 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:49:58.871125 (+ 76us) service_pool.cc:224] Handling call
0923 19:50:00.459755 (+1588630us) ts_tablet_manager.cc:1151] Deleting tablet 38993814002d4391a9801c0cf55e5374
0923 19:50:00.459765 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:00.570893 (+111128us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:00.646401 (+ 75508us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:00.715188 (+ 68787us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1588290}
I20260923 19:50:00.715811 6458 tablet_replica.cc:333] T 16098a9f015040dc93d9cca2fc9ebce2 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:00.716010 6458 raft_consensus.cc:2243] T 16098a9f015040dc93d9cca2fc9ebce2 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:00.716064 6313 tablet_service.cc:1558] Processing DeleteTablet for tablet cc3b6d245c3e40cdabb20d7dcf07ec0e with delete_type TABLET_DATA_DELETED (replaced by tablet 85d35ebef3c24a2e89233dd900b63513) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:00.716650 6458 raft_consensus.cc:2272] T 16098a9f015040dc93d9cca2fc9ebce2 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:00.716696 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 38993814002d4391a9801c0cf55e5374 (table default.Table_0e33e49bac5e4266bd2b09bb1010fce4 [id=ce4094be808b4dd3997cb576e11e3894]) successfully deleted
I20260923 19:50:00.717185 6458 ts_tablet_manager.cc:1916] T 16098a9f015040dc93d9cca2fc9ebce2 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:00.717710 6596 raft_consensus.cc:493] T e52d78a941a341d186dc00bbe7df96bf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:00.717931 6596 raft_consensus.cc:515] T e52d78a941a341d186dc00bbe7df96bf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.718369 6520 hybrid_clock.cc:648] HybridClock initialized: now 1790193000716715 us; error 1639 us; skew 500 ppm
I20260923 19:50:00.718866 6520 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:50:00.718865 6596 leader_election.cc:290] T e52d78a941a341d186dc00bbe7df96bf P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:00.719271 6139 leader_election.cc:304] T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:00.720506 6058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52d78a941a341d186dc00bbe7df96bf" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
W20260923 19:50:00.721319 6279 leader_election.cc:343] T e52d78a941a341d186dc00bbe7df96bf P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:00.724762 6582 raft_consensus.cc:2804] T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:00.726716 5803 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_286d831d3cff4c89b493d45f28acbca2" } modify_external_catalogs: true
I20260923 19:50:00.727005 5803 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_286d831d3cff4c89b493d45f28acbca2" } modify_external_catalogs: true
I20260923 19:50:00.727128 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e52d78a941a341d186dc00bbe7df96bf" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:00.727795 6280 leader_election.cc:343] T e52d78a941a341d186dc00bbe7df96bf P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:00.727964 6280 leader_election.cc:304] T e52d78a941a341d186dc00bbe7df96bf P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:00.728497 6596 raft_consensus.cc:2749] T e52d78a941a341d186dc00bbe7df96bf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:00.728861 6168 tablet_service.cc:1558] Processing DeleteTablet for tablet f7e282b6699a4ce9837d221132a1f54e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:00.729075 6582 raft_consensus.cc:697] T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:00.729434 6582 consensus_queue.cc:237] T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.730753 6175 tablet_service.cc:1558] Processing DeleteTablet for tablet c52da04e5fe0454ea76bf4d99a930fd7 with delete_type TABLET_DATA_DELETED (replaced by tablet b529b0e82c5b48edac54cc281ac4b4a6) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:00.730870 6456 tablet_bootstrap.cc:492] T 4bf129dd52b84a4ea461ec454bc34fe8 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:00.731036 6456 ts_tablet_manager.cc:1403] T 4bf129dd52b84a4ea461ec454bc34fe8 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.059s user 0.001s sys 0.009s
I20260923 19:50:00.731524 6175 tablet_service.cc:1558] Processing DeleteTablet for tablet cc3b6d245c3e40cdabb20d7dcf07ec0e with delete_type TABLET_DATA_DELETED (replaced by tablet 85d35ebef3c24a2e89233dd900b63513) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:00.731958 6456 raft_consensus.cc:359] T 4bf129dd52b84a4ea461ec454bc34fe8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.732167 6456 raft_consensus.cc:385] T 4bf129dd52b84a4ea461ec454bc34fe8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:00.732254 6456 raft_consensus.cc:740] T 4bf129dd52b84a4ea461ec454bc34fe8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:00.732569 6457 tablet_bootstrap.cc:492] T 199843bdd7184df58be9a4a06a5ffb8b P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:00.732523 6456 consensus_queue.cc:260] T 4bf129dd52b84a4ea461ec454bc34fe8 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.732983 6457 ts_tablet_manager.cc:1403] T 199843bdd7184df58be9a4a06a5ffb8b P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.003s
I20260923 19:50:00.733691 6456 ts_tablet_manager.cc:1434] T 4bf129dd52b84a4ea461ec454bc34fe8 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:50:00.734745 6457 raft_consensus.cc:359] T 199843bdd7184df58be9a4a06a5ffb8b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.735001 6457 raft_consensus.cc:385] T 199843bdd7184df58be9a4a06a5ffb8b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:00.735085 6457 raft_consensus.cc:740] T 199843bdd7184df58be9a4a06a5ffb8b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:00.735391 6457 consensus_queue.cc:260] T 199843bdd7184df58be9a4a06a5ffb8b P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.736007 6457 ts_tablet_manager.cc:1434] T 199843bdd7184df58be9a4a06a5ffb8b P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260923 19:50:00.737165 6456 tablet_bootstrap.cc:492] T f7e282b6699a4ce9837d221132a1f54e P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:00.739604 6456 tablet_bootstrap.cc:654] T f7e282b6699a4ce9837d221132a1f54e P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:00.742291 6457 tablet_bootstrap.cc:492] T 223edddace234a16b2d360504a99c28b P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:00.749440 6456 tablet_bootstrap.cc:492] T f7e282b6699a4ce9837d221132a1f54e P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:00.749717 6456 ts_tablet_manager.cc:1403] T f7e282b6699a4ce9837d221132a1f54e P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.013s user 0.010s sys 0.000s
I20260923 19:50:00.750782 6456 raft_consensus.cc:359] T f7e282b6699a4ce9837d221132a1f54e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.751104 6456 raft_consensus.cc:385] T f7e282b6699a4ce9837d221132a1f54e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:00.751273 6456 raft_consensus.cc:740] T f7e282b6699a4ce9837d221132a1f54e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:00.751628 6456 consensus_queue.cc:260] T f7e282b6699a4ce9837d221132a1f54e P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.752177 6457 tablet_bootstrap.cc:654] T 223edddace234a16b2d360504a99c28b P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:00.752946 6456 ts_tablet_manager.cc:1434] T f7e282b6699a4ce9837d221132a1f54e P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:50:00.753258 6456 tablet_bootstrap.cc:492] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:00.755079 6456 tablet_bootstrap.cc:654] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:00.757140 5791 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 223edddace234a16b2d360504a99c28b (table default.Table_4b2190aa0f324c3987e02081e95555e4 [id=ed438085f7054d9993a39852df4cc790], current schema version=4) failed: Not found: failed to reset TS proxy: No leader found: Tablet 223edddace234a16b2d360504a99c28b consensus state has no leader
I20260923 19:50:00.758164 6456 tablet_bootstrap.cc:492] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:00.758419 6456 ts_tablet_manager.cc:1403] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260923 19:50:00.759328 6456 raft_consensus.cc:359] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.759598 6456 raft_consensus.cc:385] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:00.759727 6456 raft_consensus.cc:740] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
W20260923 19:50:00.760066 5791 consensus_peers.cc:597] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b -> Peer 009ffee03a4d41db84df9f450aa84562 (127.5.143.252:45543): Couldn't send request to peer 009ffee03a4d41db84df9f450aa84562. Status: Network error: Client connection negotiation failed: client connection to 127.5.143.252:45543: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260923 19:50:00.760134 6456 consensus_queue.cc:260] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.761307 6456 ts_tablet_manager.cc:1434] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260923 19:50:00.761591 6457 tablet_bootstrap.cc:492] T 223edddace234a16b2d360504a99c28b P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:00.762279 6457 ts_tablet_manager.cc:1403] T 223edddace234a16b2d360504a99c28b P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.003s
I20260923 19:50:00.762290 6456 tablet_bootstrap.cc:492] T 8db0358af7634911820f99fe16605ca7 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:00.762447 6454 tablet_bootstrap.cc:492] T 199843bdd7184df58be9a4a06a5ffb8b P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:00.763319 6457 raft_consensus.cc:359] T 223edddace234a16b2d360504a99c28b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.764659 6457 raft_consensus.cc:385] T 223edddace234a16b2d360504a99c28b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:00.764726 6456 tablet_bootstrap.cc:654] T 8db0358af7634911820f99fe16605ca7 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:00.764909 6457 raft_consensus.cc:740] T 223edddace234a16b2d360504a99c28b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:00.765303 6457 consensus_queue.cc:260] T 223edddace234a16b2d360504a99c28b P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.766744 6457 ts_tablet_manager.cc:1434] T 223edddace234a16b2d360504a99c28b P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260923 19:50:00.767814 6457 tablet_bootstrap.cc:492] T 09bb2ab5617a49d99e75191b3b48b85f P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:00.771416 6457 tablet_bootstrap.cc:654] T 09bb2ab5617a49d99e75191b3b48b85f P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:00.780414 6576 consensus_queue.cc:1048] T c817af3eb83a43a3b6d4e9c83a9eefbb P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:00.787246 6596 raft_consensus.cc:493] T f7e282b6699a4ce9837d221132a1f54e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:00.787431 6596 raft_consensus.cc:515] T f7e282b6699a4ce9837d221132a1f54e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.788092 6596 leader_election.cc:290] T f7e282b6699a4ce9837d221132a1f54e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:00.789283 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e282b6699a4ce9837d221132a1f54e" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
W20260923 19:50:00.790325 6279 leader_election.cc:343] T f7e282b6699a4ce9837d221132a1f54e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:00.789244 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e282b6699a4ce9837d221132a1f54e" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:00.793668 6280 leader_election.cc:343] T f7e282b6699a4ce9837d221132a1f54e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:00.794167 6280 leader_election.cc:304] T f7e282b6699a4ce9837d221132a1f54e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:00.794519 6596 raft_consensus.cc:2749] T f7e282b6699a4ce9837d221132a1f54e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:00.794870 6454 ts_tablet_manager.cc:1403] T 199843bdd7184df58be9a4a06a5ffb8b P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.201s user 0.001s sys 0.004s
I20260923 19:50:00.811018 6601 tablet.cc:1751] T c817af3eb83a43a3b6d4e9c83a9eefbb P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:00.812328 6520 webserver.cc:533] Webserver started at http://127.5.143.252:46305/ using document root <none> and password file <none>
I20260923 19:50:00.812448 6586 tablet.cc:1751] T c817af3eb83a43a3b6d4e9c83a9eefbb P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:00.815402 6520 fs_manager.cc:362] Metadata directory not provided
I20260923 19:50:00.815773 6520 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:50:00.820779 6601 tablet.cc:1746] T c817af3eb83a43a3b6d4e9c83a9eefbb P e546f660e7e541d1aa9ae38e5ee5b9c0: Skipping requested alter to schema version 2, tablet already version 2
I20260923 19:50:00.821381 6586 tablet.cc:1746] T c817af3eb83a43a3b6d4e9c83a9eefbb P 2bf41435f70447f19992d368ca6b46bd: Skipping requested alter to schema version 2, tablet already version 2
I20260923 19:50:00.829283 6520 fs_manager.cc:714] Time spent opening directory manager: real 0.009s user 0.000s sys 0.006s
W20260923 19:50:00.837796 6608 log.cc:927] Time spent T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430: Append to log took a long time: real 0.074s user 0.001s sys 0.000s
I20260923 19:50:00.839749 6618 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:50:00.841361 6454 raft_consensus.cc:359] T 199843bdd7184df58be9a4a06a5ffb8b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.841805 6454 raft_consensus.cc:385] T 199843bdd7184df58be9a4a06a5ffb8b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:00.841970 6520 fs_manager.cc:730] Time spent opening block manager: real 0.008s user 0.002s sys 0.001s
I20260923 19:50:00.841998 6454 raft_consensus.cc:740] T 199843bdd7184df58be9a4a06a5ffb8b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:00.842356 6454 consensus_queue.cc:260] T 199843bdd7184df58be9a4a06a5ffb8b P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.842342 6520 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-2/data,/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-2/wal
uuid: "009ffee03a4d41db84df9f450aa84562"
format_stamp: "Formatted at 2026-09-23 19:49:55 on dist-test-slave-th4g"
I20260923 19:50:00.844127 6576 raft_consensus.cc:493] T 199843bdd7184df58be9a4a06a5ffb8b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:00.844368 6576 raft_consensus.cc:515] T 199843bdd7184df58be9a4a06a5ffb8b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.844419 6520 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:50:00.845201 6576 leader_election.cc:290] T 199843bdd7184df58be9a4a06a5ffb8b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:00.846276 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199843bdd7184df58be9a4a06a5ffb8b" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:00.846505 6343 raft_consensus.cc:2468] T 199843bdd7184df58be9a4a06a5ffb8b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 0.
I20260923 19:50:00.847061 5996 leader_election.cc:304] T 199843bdd7184df58be9a4a06a5ffb8b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:00.847434 6576 raft_consensus.cc:2804] T 199843bdd7184df58be9a4a06a5ffb8b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:00.847527 6576 raft_consensus.cc:493] T 199843bdd7184df58be9a4a06a5ffb8b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:00.847627 6576 raft_consensus.cc:3060] T 199843bdd7184df58be9a4a06a5ffb8b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:00.855796 6576 raft_consensus.cc:515] T 199843bdd7184df58be9a4a06a5ffb8b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.856195 6458 ts_tablet_manager.cc:1929] T 16098a9f015040dc93d9cca2fc9ebce2 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:00.856719 6454 ts_tablet_manager.cc:1434] T 199843bdd7184df58be9a4a06a5ffb8b P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.062s user 0.000s sys 0.002s
I20260923 19:50:00.858906 6576 leader_election.cc:290] T 199843bdd7184df58be9a4a06a5ffb8b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:00.859690 6570 tablet.cc:1751] T c817af3eb83a43a3b6d4e9c83a9eefbb P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:00.860519 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199843bdd7184df58be9a4a06a5ffb8b" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:00.860783 6202 raft_consensus.cc:3060] T 199843bdd7184df58be9a4a06a5ffb8b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:00.864771 6202 raft_consensus.cc:2468] T 199843bdd7184df58be9a4a06a5ffb8b P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 1.
I20260923 19:50:00.865501 5995 leader_election.cc:304] T 199843bdd7184df58be9a4a06a5ffb8b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:00.865866 6576 raft_consensus.cc:2804] T 199843bdd7184df58be9a4a06a5ffb8b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:00.866044 6576 raft_consensus.cc:697] T 199843bdd7184df58be9a4a06a5ffb8b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Becoming Leader. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Running, Role: LEADER
I20260923 19:50:00.866309 6576 consensus_queue.cc:237] T 199843bdd7184df58be9a4a06a5ffb8b P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.874271 5800 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 5725a9cb95c448d0a5ea8114e90bc9fe (table default.Table_1d045e195d50465784c49c6ecdc0e167 [id=d3b60b7fc1d84a46aa49932d5c3363ea]). Expected version 2 got 0
W20260923 19:50:00.876509 5797 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ec4cc8a742114e5fb07c5c9157ce09e8 has no consensus state
I20260923 19:50:00.876951 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_53a39bb32157475a99f1d1822cf2e6d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:00.877637 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_53a39bb32157475a99f1d1822cf2e6d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:00.879240 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_a11420ea5a314c55aed7538c702811ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:00.879827 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a11420ea5a314c55aed7538c702811ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:00.881434 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_973ceea94f2e4c6da7b1c722b99ac413"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:00.882398 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_abe1e48d70954781b8e1ca09411789d4" } modify_external_catalogs: true
I20260923 19:50:00.882607 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_abe1e48d70954781b8e1ca09411789d4" } modify_external_catalogs: true
I20260923 19:50:00.885959 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet 13566283020c41c9b97d8c16678450d6 with delete_type TABLET_DATA_DELETED (replaced by tablet c52da04e5fe0454ea76bf4d99a930fd7) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:00.887081 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_973ceea94f2e4c6da7b1c722b99ac413 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:00.888537 5790 catalog_manager.cc:5030] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 13566283020c41c9b97d8c16678450d6 because the tablet was not found. No further retry: Not found: Tablet not found: 13566283020c41c9b97d8c16678450d6
I20260923 19:50:00.890100 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a2fbac8080441d4a9e03ff1d580bc8e with delete_type TABLET_DATA_DELETED (replaced by tablet 5adadf8caf5e4a9ab1107d0fb6a91735) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:00.890848 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet 3158b344d1c748aab5004543e4448adb with delete_type TABLET_DATA_DELETED (replaced by tablet 640a98d3a845461e8d4f07041ab515c7) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:00.890954 5790 catalog_manager.cc:5030] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 8a2fbac8080441d4a9e03ff1d580bc8e because the tablet was not found. No further retry: Not found: Tablet not found: 8a2fbac8080441d4a9e03ff1d580bc8e
I20260923 19:50:00.891458 6461 tablet_replica.cc:333] T 3158b344d1c748aab5004543e4448adb P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:00.891729 6461 raft_consensus.cc:2243] T 3158b344d1c748aab5004543e4448adb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:00.891969 6461 raft_consensus.cc:2272] T 3158b344d1c748aab5004543e4448adb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:00.892606 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_1812c0af6506416eb91a37c34e916119"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:00.893214 6461 ts_tablet_manager.cc:1916] T 3158b344d1c748aab5004543e4448adb P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:00.893712 5804 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 063fc0e77d294ddf8a02e9ab5968a5e3 consensus state has no leader
I20260923 19:50:00.894042 5804 master_service.cc:960] ReplaceTablet: received request to replace tablet 8a2fbac8080441d4a9e03ff1d580bc8e from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:00.894532 5804 master_service.cc:960] ReplaceTablet: received request to replace tablet 09bb2ab5617a49d99e75191b3b48b85f from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:00.895071 5804 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_80d9cfc4fde44357a239cb5aa1f38bb4" } new_table_name: "default.Table_504b18d33ff6487da9b8f40467850853" modify_external_catalogs: true
I20260923 19:50:00.903131 6461 ts_tablet_manager.cc:1929] T 3158b344d1c748aab5004543e4448adb P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:00.903420 6461 log.cc:1199] T 3158b344d1c748aab5004543e4448adb P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/3158b344d1c748aab5004543e4448adb
I20260923 19:50:00.903558 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199843bdd7184df58be9a4a06a5ffb8b" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:00.904009 6461 ts_tablet_manager.cc:1950] T 3158b344d1c748aab5004543e4448adb P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:00.904021 6203 raft_consensus.cc:2376] T 199843bdd7184df58be9a4a06a5ffb8b P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 1. Re-sending same reply.
W20260923 19:50:00.905354 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1812c0af6506416eb91a37c34e916119 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:00.905510 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 3158b344d1c748aab5004543e4448adb (table default.Table_655e0d86bc12407f9287ace4b3e76c29 [id=5bc43061f37b4defac5a530a1f174684]) successfully deleted
I20260923 19:50:00.929343 6454 tablet_bootstrap.cc:492] T 259e4faa58f549699538317019be5daf P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:00.933272 6454 tablet_bootstrap.cc:654] T 259e4faa58f549699538317019be5daf P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:00.933833 6571 raft_consensus.cc:493] T 0cdb778f87fa40b89dad97d166192a1e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:00.934087 6571 raft_consensus.cc:515] T 0cdb778f87fa40b89dad97d166192a1e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.934954 6571 leader_election.cc:290] T 0cdb778f87fa40b89dad97d166192a1e P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:00.935443 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdb778f87fa40b89dad97d166192a1e" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:00.935976 5995 leader_election.cc:343] T 0cdb778f87fa40b89dad97d166192a1e P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:00.936167 5996 leader_election.cc:343] T 0cdb778f87fa40b89dad97d166192a1e P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 0cdb778f87fa40b89dad97d166192a1e
I20260923 19:50:00.936291 5996 leader_election.cc:304] T 0cdb778f87fa40b89dad97d166192a1e P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:00.936820 6571 raft_consensus.cc:2749] T 0cdb778f87fa40b89dad97d166192a1e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:00.937016 6457 tablet_bootstrap.cc:492] T 09bb2ab5617a49d99e75191b3b48b85f P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:00.937242 6457 ts_tablet_manager.cc:1403] T 09bb2ab5617a49d99e75191b3b48b85f P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.169s user 0.059s sys 0.053s
I20260923 19:50:00.938056 6457 raft_consensus.cc:359] T 09bb2ab5617a49d99e75191b3b48b85f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.938252 6457 raft_consensus.cc:385] T 09bb2ab5617a49d99e75191b3b48b85f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:00.938336 6457 raft_consensus.cc:740] T 09bb2ab5617a49d99e75191b3b48b85f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:00.938597 6457 consensus_queue.cc:260] T 09bb2ab5617a49d99e75191b3b48b85f P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.939134 6457 ts_tablet_manager.cc:1434] T 09bb2ab5617a49d99e75191b3b48b85f P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:00.939468 6457 tablet_bootstrap.cc:492] T 259e4faa58f549699538317019be5daf P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:00.941249 6457 tablet_bootstrap.cc:654] T 259e4faa58f549699538317019be5daf P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:00.947710 6570 tablet.cc:1746] T c817af3eb83a43a3b6d4e9c83a9eefbb P 61022dd7f2f14dc19aebe3af5f08f430: Skipping requested alter to schema version 2, tablet already version 2
I20260923 19:50:00.948521 6459 ts_tablet_manager.cc:1929] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:00.948760 6459 log.cc:1199] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/c1b82e4a02794947b77040b6323ad96a
I20260923 19:50:00.949401 6459 ts_tablet_manager.cc:1950] T c1b82e4a02794947b77040b6323ad96a P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:00.951196 6582 raft_consensus.cc:493] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:00.951342 6582 raft_consensus.cc:515] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.951951 6582 leader_election.cc:290] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:00.952709 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "223edddace234a16b2d360504a99c28b" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:00.952927 6059 raft_consensus.cc:2468] T 223edddace234a16b2d360504a99c28b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:00.953764 6137 leader_election.cc:304] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:00.954332 6582 raft_consensus.cc:2804] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:00.954927 6582 raft_consensus.cc:493] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:00.955049 6582 raft_consensus.cc:3060] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:00.959326 6582 raft_consensus.cc:515] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.960675 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "223edddace234a16b2d360504a99c28b" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:00.960894 6059 raft_consensus.cc:3060] T 223edddace234a16b2d360504a99c28b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:00.965973 6059 raft_consensus.cc:2468] T 223edddace234a16b2d360504a99c28b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:00.858750 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "199843bdd7184df58be9a4a06a5ffb8b" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:00.980417 6343 raft_consensus.cc:3060] T 199843bdd7184df58be9a4a06a5ffb8b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:00.982429 6456 tablet_bootstrap.cc:492] T 8db0358af7634911820f99fe16605ca7 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:00.983044 6456 ts_tablet_manager.cc:1403] T 8db0358af7634911820f99fe16605ca7 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.221s user 0.033s sys 0.089s
I20260923 19:50:00.983354 6343 raft_consensus.cc:2468] T 199843bdd7184df58be9a4a06a5ffb8b P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 1.
I20260923 19:50:00.953102 6345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "223edddace234a16b2d360504a99c28b" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:00.983866 6345 raft_consensus.cc:2468] T 223edddace234a16b2d360504a99c28b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:00.984086 6456 raft_consensus.cc:359] T 8db0358af7634911820f99fe16605ca7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.958110 6596 raft_consensus.cc:493] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:00.984536 6456 raft_consensus.cc:385] T 8db0358af7634911820f99fe16605ca7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:00.984480 6596 raft_consensus.cc:515] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.984629 6456 raft_consensus.cc:740] T 8db0358af7634911820f99fe16605ca7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:00.984843 6456 consensus_queue.cc:260] T 8db0358af7634911820f99fe16605ca7 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:00.985201 6596 leader_election.cc:290] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:00.985554 6456 ts_tablet_manager.cc:1434] T 8db0358af7634911820f99fe16605ca7 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:50:00.986176 6456 tablet_bootstrap.cc:492] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:00.987656 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc3b6d245c3e40cdabb20d7dcf07ec0e" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
W20260923 19:50:00.988742 6279 leader_election.cc:343] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:00.992148 5802 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 223edddace234a16b2d360504a99c28b (table default.Table_4b2190aa0f324c3987e02081e95555e4 [id=ed438085f7054d9993a39852df4cc790]). Expected version 4 got 0
I20260923 19:50:00.992323 6032 tablet_service.cc:1511] Processing CreateTablet for tablet 42e9cbcf77324d91abd029c12eaf950d (DEFAULT_TABLE table=default.Table_a1fd9ea56c3849d19928269a6e9de801 [id=a2b5a27b4b93406b9bd6fd2248562a78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.992699 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 42e9cbcf77324d91abd029c12eaf950d (DEFAULT_TABLE table=default.Table_a1fd9ea56c3849d19928269a6e9de801 [id=a2b5a27b4b93406b9bd6fd2248562a78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.992951 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42e9cbcf77324d91abd029c12eaf950d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.993142 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42e9cbcf77324d91abd029c12eaf950d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.994180 5799 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 223edddace234a16b2d360504a99c28b (table default.Table_4b2190aa0f324c3987e02081e95555e4 [id=ed438085f7054d9993a39852df4cc790]). Expected version 4 got 0
I20260923 19:50:00.994264 6022 tablet_service.cc:1511] Processing CreateTablet for tablet b4fc995819cc40bf9956d85966bcd330 (DEFAULT_TABLE table=default.Table_0f7d73099ac1462b962be0316b72a59a [id=20b663f1b2504d4199c2a9a2e9667d5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.994716 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4fc995819cc40bf9956d85966bcd330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.996817 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_e06d0ff4af234fa090feddba5bef4853"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:00.997357 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e06d0ff4af234fa090feddba5bef4853 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:00.997988 6313 tablet_service.cc:1511] Processing CreateTablet for tablet b4fc995819cc40bf9956d85966bcd330 (DEFAULT_TABLE table=default.Table_0f7d73099ac1462b962be0316b72a59a [id=20b663f1b2504d4199c2a9a2e9667d5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:00.998382 6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4fc995819cc40bf9956d85966bcd330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:00.998714 5805 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_103c4095b9c641d7aed905489796806e" } modify_external_catalogs: true
I20260923 19:50:00.998908 5805 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_103c4095b9c641d7aed905489796806e" } modify_external_catalogs: true
I20260923 19:50:01.000250 5798 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_607b21eb9423483daac43c4cb1507962" } modify_external_catalogs: true
I20260923 19:50:01.000406 5798 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_607b21eb9423483daac43c4cb1507962" } modify_external_catalogs: true
I20260923 19:50:01.003283 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_9429c0a32a944532a7c0e98762ee3ebe" } new_table_name: "default.Table_b5e4b2595161409da2fb9a56664da184" modify_external_catalogs: true
I20260923 19:50:01.003983 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 623fb5b761134951a4b742ab2ba480a4 (DEFAULT_TABLE table=default.Table_526fa05830fd4679bd95ea4b8e9af682 [id=6cd1efd05c5d40d695658ba3aa1ddadc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.004086 6315 tablet_service.cc:1511] Processing CreateTablet for tablet 623fb5b761134951a4b742ab2ba480a4 (DEFAULT_TABLE table=default.Table_526fa05830fd4679bd95ea4b8e9af682 [id=6cd1efd05c5d40d695658ba3aa1ddadc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.004423 6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 623fb5b761134951a4b742ab2ba480a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.005275 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 623fb5b761134951a4b742ab2ba480a4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:01.013609 5804 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 495292cacf3b42a5b633ad40e5e01972 consensus state has no leader
I20260923 19:50:01.018959 6035 tablet_service.cc:1511] Processing CreateTablet for tablet ec4cc8a742114e5fb07c5c9157ce09e8 (DEFAULT_TABLE table=default.Table_822c35f920714c3d8d79f91566bd5da9 [id=89181985e6154c7fa946148e48bef2eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.019536 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec4cc8a742114e5fb07c5c9157ce09e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.022732 5800 master_service.cc:960] ReplaceTablet: received request to replace tablet f2d9f1a0fae849ae8083eba082055fe9 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:01.025143 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 26031fe469d046518cdd0f1e955e19d1 (DEFAULT_TABLE table=default.Table_99945eeb183b4b18be67e5b484ad3454 [id=82cba3f0e2f64118a0747fe6ff9bc796]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.025594 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26031fe469d046518cdd0f1e955e19d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.025669 6458 log.cc:1199] T 16098a9f015040dc93d9cca2fc9ebce2 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/16098a9f015040dc93d9cca2fc9ebce2
I20260923 19:50:01.026081 6458 ts_tablet_manager.cc:1950] T 16098a9f015040dc93d9cca2fc9ebce2 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:01.026899 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 44) took 2156 ms. Trace:
I20260923 19:50:01.027006 6458 rpcz_store.cc:276] 0923 19:49:58.870769 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:49:58.871523 (+ 754us) service_pool.cc:224] Handling call
0923 19:50:00.715712 (+1844189us) ts_tablet_manager.cc:1151] Deleting tablet 16098a9f015040dc93d9cca2fc9ebce2
0923 19:50:00.715725 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:00.853006 (+137281us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:00.856105 (+ 3099us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:01.026861 (+170756us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1843971}
I20260923 19:50:01.027542 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 16098a9f015040dc93d9cca2fc9ebce2 (table default.Table_7146a9adbec34a6ab1272e2f632209d1 [id=25b5843f90294bc8a77f3a0e00193f0f]) successfully deleted
I20260923 19:50:01.031630 6456 tablet_bootstrap.cc:654] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:01.037122 6458 tablet_replica.cc:333] T cca0dc9ed824410bbed5a25afebb90e1 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:01.038264 6458 raft_consensus.cc:2243] T cca0dc9ed824410bbed5a25afebb90e1 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:01.039003 6458 raft_consensus.cc:2272] T cca0dc9ed824410bbed5a25afebb90e1 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:01.041651 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet a1e8b8e638ec438a86f05fa147cdb27c
I20260923 19:50:01.042469 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_552860e790be402a91af4ff2e2185d10" } modify_external_catalogs: true
I20260923 19:50:01.042670 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_552860e790be402a91af4ff2e2185d10" } modify_external_catalogs: true
I20260923 19:50:01.042824 6037 tablet_service.cc:1511] Processing CreateTablet for tablet ab73e8a1b6774ca0b43e5be67da68fab (DEFAULT_TABLE table=default.Table_c716115e5d0045b691616d451daec14d [id=bb00103e5a52400b9e7fb4db39f27bd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.043397 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab73e8a1b6774ca0b43e5be67da68fab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.044121 6022 tablet_service.cc:1558] Processing DeleteTablet for tablet a1e8b8e638ec438a86f05fa147cdb27c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:00 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:01.044241 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 4750e2a1b24e4bc7aafa4cd36afebbbd
I20260923 19:50:01.044942 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_73b9e29628e7432a929c5e9c193d22fa" } new_table_name: "default.Table_732b2167539b49abaf9a0a019c6c70da" modify_external_catalogs: true
I20260923 19:50:01.045011 6032 tablet_service.cc:1511] Processing CreateTablet for tablet 5427b0f0218d4131b68a39e8e3bf02e7 (DEFAULT_TABLE table=default.Table_aa2654e8c2db467ab317ae37cf1985aa [id=325a9dcdfe3c44fca0e5b9d0bc0cd1f0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:01.045475 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet a1e8b8e638ec438a86f05fa147cdb27c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a1e8b8e638ec438a86f05fa147cdb27c already in progress: creating tablet
I20260923 19:50:01.045527 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5427b0f0218d4131b68a39e8e3bf02e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.046761 6035 tablet_service.cc:1511] Processing CreateTablet for tablet 86473c5cbca54b5792b038aef445998c (DEFAULT_TABLE table=default.Table_f1de0114e81245fdb95e257431f5a975 [id=7f0d9665430447528c3829934eb4b634]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.047179 5797 master_service.cc:960] ReplaceTablet: received request to replace tablet f7e282b6699a4ce9837d221132a1f54e from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:01.047497 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86473c5cbca54b5792b038aef445998c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.047667 5797 master_service.cc:960] ReplaceTablet: received request to replace tablet b7f372b952804ac58e602998d9b77d72 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:01.049206 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 4750e2a1b24e4bc7aafa4cd36afebbbd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:00 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:01.050442 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 4750e2a1b24e4bc7aafa4cd36afebbbd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4750e2a1b24e4bc7aafa4cd36afebbbd already in progress: creating tablet
I20260923 19:50:01.050771 5799 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_1d045e195d50465784c49c6ecdc0e167 [id=d3b60b7fc1d84a46aa49932d5c3363ea] alter complete (version 2)
I20260923 19:50:01.051895 6028 tablet_service.cc:1511] Processing CreateTablet for tablet ec4284d6a0fa416ca95b4d675c8e3912 (DEFAULT_TABLE table=default.Table_9ef6e2f26ba14f5095a1d65288df3089 [id=29a38060f3bf43f3900ad0ee42fbde9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.052387 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec4284d6a0fa416ca95b4d675c8e3912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.054152 5802 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_30f4ccabe7fa4c8ba92e008f3d9b2d80 [id=b9b7fe147b8645389ebef237fa735b2b] alter complete (version 2)
I20260923 19:50:01.055639 6027 tablet_service.cc:1558] Processing DeleteTablet for tablet 199843bdd7184df58be9a4a06a5ffb8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:01.055996 6461 tablet_replica.cc:333] T 199843bdd7184df58be9a4a06a5ffb8b P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:01.056255 6461 raft_consensus.cc:2243] T 199843bdd7184df58be9a4a06a5ffb8b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:01.056596 6461 pending_rounds.cc:70] T 199843bdd7184df58be9a4a06a5ffb8b P e546f660e7e541d1aa9ae38e5ee5b9c0: Trying to abort 1 pending ops.
I20260923 19:50:01.056715 6461 pending_rounds.cc:77] T 199843bdd7184df58be9a4a06a5ffb8b P e546f660e7e541d1aa9ae38e5ee5b9c0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630531550965760 op_type: NO_OP noop_request { }
I20260923 19:50:01.056869 6461 raft_consensus.cc:2889] T 199843bdd7184df58be9a4a06a5ffb8b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:01.057008 6461 raft_consensus.cc:2272] T 199843bdd7184df58be9a4a06a5ffb8b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:01.057499 6022 tablet_service.cc:1558] Processing DeleteTablet for tablet 0cdb778f87fa40b89dad97d166192a1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:58 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:01.058122 6461 ts_tablet_manager.cc:1916] T 199843bdd7184df58be9a4a06a5ffb8b P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:01.062160 5703 master_runner.cc:187] Error getting master registration for 127.5.143.252:45543: Network error: Client connection negotiation failed: client connection to 127.5.143.252:45543: connect: Connection refused (error 111),
I20260923 19:50:01.062378 5703 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260923 19:50:01.063459 6027 tablet_service.cc:1511] Processing CreateTablet for tablet 495292cacf3b42a5b633ad40e5e01972 (DEFAULT_TABLE table=default.Table_504b18d33ff6487da9b8f40467850853 [id=97f3cda15d6f4e258eece32745c45b50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.064411 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 495292cacf3b42a5b633ad40e5e01972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.068884 6137 leader_election.cc:304] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
W20260923 19:50:01.071548 6137 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.193:39887, user_credentials={real_user=slave}} blocked reactor thread for 104853us
I20260923 19:50:01.072605 6582 leader_election.cc:290] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:01.077826 6582 raft_consensus.cc:2804] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:01.078014 6582 raft_consensus.cc:697] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:01.079600 6582 consensus_queue.cc:237] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:01.081429 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc3b6d245c3e40cdabb20d7dcf07ec0e" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:01.082858 6175 tablet_service.cc:1511] Processing CreateTablet for tablet b4fc995819cc40bf9956d85966bcd330 (DEFAULT_TABLE table=default.Table_0f7d73099ac1462b962be0316b72a59a [id=20b663f1b2504d4199c2a9a2e9667d5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.083273 6175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4fc995819cc40bf9956d85966bcd330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.085554 6022 tablet_service.cc:1558] Processing DeleteTablet for tablet 09bb2ab5617a49d99e75191b3b48b85f with delete_type TABLET_DATA_DELETED (replaced by tablet d70b7662d85a4f64a11420448c4d140d) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:01.087641 5802 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_1d045e195d50465784c49c6ecdc0e167" } new_table_name: "default.Table_2f03e909da3b4f3d9736f0ca37d25a92" modify_external_catalogs: true
I20260923 19:50:01.087944 6025 tablet_service.cc:1511] Processing CreateTablet for tablet e9cbfaa34c924a678f23cbcbf1a6fb0a (DEFAULT_TABLE table=default.Table_18b2b0faf7ec48c7b8e02c1459247503 [id=94ef9897f5c44524ae14f2b721a586e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.088374 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9cbfaa34c924a678f23cbcbf1a6fb0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.089048 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_ad0a2201b53b433ba6f5ff6dd74cf9b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:01.089581 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad0a2201b53b433ba6f5ff6dd74cf9b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:01.091073 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_53ff161409a94c28a2d7f0a67a6eb839"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:01.091620 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_53ff161409a94c28a2d7f0a67a6eb839 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:01.093008 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_5365e890b976423aa339a9b5e8c8db7e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:01.093911 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5365e890b976423aa339a9b5e8c8db7e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:01.094772 6039 tablet_service.cc:1511] Processing CreateTablet for tablet 556b32b8ccd54c439f86b0069e2a5ce0 (DEFAULT_TABLE table=default.Table_28e177d48f7949c4914feb2cf5143aeb [id=f329852cd968475584a70fbb8b1b1c3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.095314 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 556b32b8ccd54c439f86b0069e2a5ce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.096074 6173 tablet_service.cc:1511] Processing CreateTablet for tablet 42e9cbcf77324d91abd029c12eaf950d (DEFAULT_TABLE table=default.Table_a1fd9ea56c3849d19928269a6e9de801 [id=a2b5a27b4b93406b9bd6fd2248562a78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.082696 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 92) took 1197 ms. Trace:
I20260923 19:50:01.098232 6031 tablet_service.cc:1511] Processing CreateTablet for tablet f4e3e64fdf584743a3a88df5d6600b22 (DEFAULT_TABLE table=default.Table_7342c845a15749d5b6bd089d55287f3a [id=d9b49a00239d40f3982556322a0143e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.098644 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4e3e64fdf584743a3a88df5d6600b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.099211 6168 tablet_service.cc:1511] Processing CreateTablet for tablet 623fb5b761134951a4b742ab2ba480a4 (DEFAULT_TABLE table=default.Table_526fa05830fd4679bd95ea4b8e9af682 [id=6cd1efd05c5d40d695658ba3aa1ddadc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.099910 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 623fb5b761134951a4b742ab2ba480a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.102278 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42e9cbcf77324d91abd029c12eaf950d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.103955 6174 tablet_service.cc:1511] Processing CreateTablet for tablet ec4cc8a742114e5fb07c5c9157ce09e8 (DEFAULT_TABLE table=default.Table_822c35f920714c3d8d79f91566bd5da9 [id=89181985e6154c7fa946148e48bef2eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.104310 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec4cc8a742114e5fb07c5c9157ce09e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.104585 6166 tablet_service.cc:1511] Processing CreateTablet for tablet 26031fe469d046518cdd0f1e955e19d1 (DEFAULT_TABLE table=default.Table_99945eeb183b4b18be67e5b484ad3454 [id=82cba3f0e2f64118a0747fe6ff9bc796]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.105844 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26031fe469d046518cdd0f1e955e19d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.103330 6459 rpcz_store.cc:276] 0923 19:49:59.870813 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:49:59.870989 (+ 176us) service_pool.cc:224] Handling call
0923 19:50:00.594055 (+723066us) ts_tablet_manager.cc:1151] Deleting tablet c1b82e4a02794947b77040b6323ad96a
0923 19:50:00.594076 (+ 21us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:00.719781 (+125705us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:00.948426 (+228645us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:01.068716 (+120290us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":722933}
I20260923 19:50:01.109155 6164 tablet_service.cc:1511] Processing CreateTablet for tablet ab73e8a1b6774ca0b43e5be67da68fab (DEFAULT_TABLE table=default.Table_c716115e5d0045b691616d451daec14d [id=bb00103e5a52400b9e7fb4db39f27bd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.110435 6176 tablet_service.cc:1558] Processing DeleteTablet for tablet 4750e2a1b24e4bc7aafa4cd36afebbbd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:00 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:01.111153 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 5427b0f0218d4131b68a39e8e3bf02e7 (DEFAULT_TABLE table=default.Table_aa2654e8c2db467ab317ae37cf1985aa [id=325a9dcdfe3c44fca0e5b9d0bc0cd1f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.111877 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet c14d36ad1b7241c894dbdff46159000c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:58 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:01.112073 6459 tablet_replica.cc:333] T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:01.112128 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet a1e8b8e638ec438a86f05fa147cdb27c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:00 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:01.112695 6459 raft_consensus.cc:2243] T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:01.112720 6182 tablet_service.cc:1511] Processing CreateTablet for tablet 86473c5cbca54b5792b038aef445998c (DEFAULT_TABLE table=default.Table_f1de0114e81245fdb95e257431f5a975 [id=7f0d9665430447528c3829934eb4b634]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.113722 6459 pending_rounds.cc:70] T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:01.113797 6459 pending_rounds.cc:77] T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630530991595520 op_type: NO_OP noop_request { }
I20260923 19:50:01.113837 6176 tablet_service.cc:1511] Processing CreateTablet for tablet ec4284d6a0fa416ca95b4d675c8e3912 (DEFAULT_TABLE table=default.Table_9ef6e2f26ba14f5095a1d65288df3089 [id=29a38060f3bf43f3900ad0ee42fbde9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.114732 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 495292cacf3b42a5b633ad40e5e01972 (DEFAULT_TABLE table=default.Table_504b18d33ff6487da9b8f40467850853 [id=97f3cda15d6f4e258eece32745c45b50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.115653 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab73e8a1b6774ca0b43e5be67da68fab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.118024 6182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86473c5cbca54b5792b038aef445998c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.119699 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5427b0f0218d4131b68a39e8e3bf02e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.123855 6179 tablet_service.cc:1511] Processing CreateTablet for tablet f4e3e64fdf584743a3a88df5d6600b22 (DEFAULT_TABLE table=default.Table_7342c845a15749d5b6bd089d55287f3a [id=d9b49a00239d40f3982556322a0143e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.125506 6459 raft_consensus.cc:2889] T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:01.047871 6315 tablet_service.cc:1511] Processing CreateTablet for tablet ec4cc8a742114e5fb07c5c9157ce09e8 (DEFAULT_TABLE table=default.Table_822c35f920714c3d8d79f91566bd5da9 [id=89181985e6154c7fa946148e48bef2eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.126962 6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec4cc8a742114e5fb07c5c9157ce09e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.127185 6458 ts_tablet_manager.cc:1916] T cca0dc9ed824410bbed5a25afebb90e1 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:01.048919 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 26031fe469d046518cdd0f1e955e19d1 (DEFAULT_TABLE table=default.Table_99945eeb183b4b18be67e5b484ad3454 [id=82cba3f0e2f64118a0747fe6ff9bc796]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.050606 6312 tablet_service.cc:1511] Processing CreateTablet for tablet ab73e8a1b6774ca0b43e5be67da68fab (DEFAULT_TABLE table=default.Table_c716115e5d0045b691616d451daec14d [id=bb00103e5a52400b9e7fb4db39f27bd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.050952 6316 tablet_service.cc:1511] Processing CreateTablet for tablet 5427b0f0218d4131b68a39e8e3bf02e7 (DEFAULT_TABLE table=default.Table_aa2654e8c2db467ab317ae37cf1985aa [id=325a9dcdfe3c44fca0e5b9d0bc0cd1f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.051142 6320 tablet_service.cc:1558] Processing DeleteTablet for tablet 4750e2a1b24e4bc7aafa4cd36afebbbd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:00 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:01.051403 6319 tablet_service.cc:1511] Processing CreateTablet for tablet 86473c5cbca54b5792b038aef445998c (DEFAULT_TABLE table=default.Table_f1de0114e81245fdb95e257431f5a975 [id=7f0d9665430447528c3829934eb4b634]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.061414 6313 tablet_service.cc:1558] Processing DeleteTablet for tablet a1e8b8e638ec438a86f05fa147cdb27c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:00 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:01.062729 6325 tablet_service.cc:1511] Processing CreateTablet for tablet ec4284d6a0fa416ca95b4d675c8e3912 (DEFAULT_TABLE table=default.Table_9ef6e2f26ba14f5095a1d65288df3089 [id=29a38060f3bf43f3900ad0ee42fbde9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.063716 6314 tablet_service.cc:1511] Processing CreateTablet for tablet 495292cacf3b42a5b633ad40e5e01972 (DEFAULT_TABLE table=default.Table_504b18d33ff6487da9b8f40467850853 [id=97f3cda15d6f4e258eece32745c45b50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.065016 6321 tablet_service.cc:1511] Processing CreateTablet for tablet f4e3e64fdf584743a3a88df5d6600b22 (DEFAULT_TABLE table=default.Table_7342c845a15749d5b6bd089d55287f3a [id=d9b49a00239d40f3982556322a0143e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.068071 6324 tablet_service.cc:1511] Processing CreateTablet for tablet 556b32b8ccd54c439f86b0069e2a5ce0 (DEFAULT_TABLE table=default.Table_28e177d48f7949c4914feb2cf5143aeb [id=f329852cd968475584a70fbb8b1b1c3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.070860 6323 tablet_service.cc:1511] Processing CreateTablet for tablet e9cbfaa34c924a678f23cbcbf1a6fb0a (DEFAULT_TABLE table=default.Table_18b2b0faf7ec48c7b8e02c1459247503 [id=94ef9897f5c44524ae14f2b721a586e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.074926 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "223edddace234a16b2d360504a99c28b" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:01.131572 6343 raft_consensus.cc:3060] T 223edddace234a16b2d360504a99c28b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:01.133235 6461 ts_tablet_manager.cc:1929] T 199843bdd7184df58be9a4a06a5ffb8b P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260923 19:50:01.082517 6280 leader_election.cc:343] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:01.133432 6461 log.cc:1199] T 199843bdd7184df58be9a4a06a5ffb8b P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/199843bdd7184df58be9a4a06a5ffb8b
I20260923 19:50:01.133509 6280 leader_election.cc:304] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:01.133867 6280 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 51360.9us
I20260923 19:50:01.134140 6596 raft_consensus.cc:2749] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:01.137851 6461 ts_tablet_manager.cc:1950] T 199843bdd7184df58be9a4a06a5ffb8b P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:01.139602 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 199843bdd7184df58be9a4a06a5ffb8b (table default.Table_19746277e0c142bd8bfa415a7effbbe0 [id=a09c0c82fcc747babbd555f9aeae4ed9]) successfully deleted
I20260923 19:50:01.140018 6461 tablet_replica.cc:333] T 0cdb778f87fa40b89dad97d166192a1e P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:01.140270 6461 raft_consensus.cc:2243] T 0cdb778f87fa40b89dad97d166192a1e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:01.140473 6461 raft_consensus.cc:2272] T 0cdb778f87fa40b89dad97d166192a1e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:01.140686 6343 raft_consensus.cc:2468] T 223edddace234a16b2d360504a99c28b P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:01.142318 6457 tablet_bootstrap.cc:492] T 259e4faa58f549699538317019be5daf P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:01.142542 6457 ts_tablet_manager.cc:1403] T 259e4faa58f549699538317019be5daf P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.203s user 0.058s sys 0.099s
I20260923 19:50:01.143574 6457 raft_consensus.cc:359] T 259e4faa58f549699538317019be5daf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:01.143862 6457 raft_consensus.cc:385] T 259e4faa58f549699538317019be5daf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:01.143996 6457 raft_consensus.cc:740] T 259e4faa58f549699538317019be5daf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:01.144374 6457 consensus_queue.cc:260] T 259e4faa58f549699538317019be5daf P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:01.146191 6461 ts_tablet_manager.cc:1916] T 0cdb778f87fa40b89dad97d166192a1e P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:01.147218 6457 ts_tablet_manager.cc:1434] T 259e4faa58f549699538317019be5daf P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260923 19:50:01.148355 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 495292cacf3b42a5b633ad40e5e01972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.148481 6457 tablet_bootstrap.cc:492] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:01.152844 6459 raft_consensus.cc:2272] T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:01.153510 6172 tablet_service.cc:1511] Processing CreateTablet for tablet e9cbfaa34c924a678f23cbcbf1a6fb0a (DEFAULT_TABLE table=default.Table_18b2b0faf7ec48c7b8e02c1459247503 [id=94ef9897f5c44524ae14f2b721a586e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.153841 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 556b32b8ccd54c439f86b0069e2a5ce0 (DEFAULT_TABLE table=default.Table_28e177d48f7949c4914feb2cf5143aeb [id=f329852cd968475584a70fbb8b1b1c3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.154963 6457 tablet_bootstrap.cc:654] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:01.126554 6456 tablet_bootstrap.cc:492] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:01.157225 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab73e8a1b6774ca0b43e5be67da68fab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.157296 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4e3e64fdf584743a3a88df5d6600b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.157393 6456 ts_tablet_manager.cc:1403] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.171s user 0.004s sys 0.000s
I20260923 19:50:01.158320 6456 raft_consensus.cc:359] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:01.158538 6456 raft_consensus.cc:385] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:01.158622 6456 raft_consensus.cc:740] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:01.158880 6456 consensus_queue.cc:260] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:01.159690 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26031fe469d046518cdd0f1e955e19d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.159907 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet c1b82e4a02794947b77040b6323ad96a (table default.Table_382e555ccd2a4ebda27bedf8b1cbb159 [id=ce8e51ef23914830a2fc7f9bb0d2ac68]) successfully deleted
I20260923 19:50:01.160905 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 495292cacf3b42a5b633ad40e5e01972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.166237 6459 ts_tablet_manager.cc:1916] T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:01.166303 6319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86473c5cbca54b5792b038aef445998c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.166563 6169 tablet_service.cc:1558] Processing DeleteTablet for tablet 199843bdd7184df58be9a4a06a5ffb8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:01.166780 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 556b32b8ccd54c439f86b0069e2a5ce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.168263 6172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9cbfaa34c924a678f23cbcbf1a6fb0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.170199 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec4284d6a0fa416ca95b4d675c8e3912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.177385 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9cbfaa34c924a678f23cbcbf1a6fb0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.181319 6456 ts_tablet_manager.cc:1434] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.024s user 0.002s sys 0.000s
I20260923 19:50:01.186692 6456 tablet_bootstrap.cc:492] T 9ed630e738c54ed38b9933f95fb552c5 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:01.187012 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4e3e64fdf584743a3a88df5d6600b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.188982 6456 tablet_bootstrap.cc:654] T 9ed630e738c54ed38b9933f95fb552c5 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:01.189285 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 556b32b8ccd54c439f86b0069e2a5ce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.190165 6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5427b0f0218d4131b68a39e8e3bf02e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.200639 6461 ts_tablet_manager.cc:1929] T 0cdb778f87fa40b89dad97d166192a1e P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:01.203094 6458 ts_tablet_manager.cc:1929] T cca0dc9ed824410bbed5a25afebb90e1 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:01.204617 6461 log.cc:1199] T 0cdb778f87fa40b89dad97d166192a1e P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/0cdb778f87fa40b89dad97d166192a1e
I20260923 19:50:01.205415 6461 ts_tablet_manager.cc:1950] T 0cdb778f87fa40b89dad97d166192a1e P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:01.206017 6458 log.cc:1199] T cca0dc9ed824410bbed5a25afebb90e1 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/cca0dc9ed824410bbed5a25afebb90e1
I20260923 19:50:01.207844 6458 ts_tablet_manager.cc:1950] T cca0dc9ed824410bbed5a25afebb90e1 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
W20260923 19:50:01.208246 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9101e82501fd461f8a4b2dcd9dffbd74 consensus state has no leader
I20260923 19:50:01.209851 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 0cdb778f87fa40b89dad97d166192a1e (table default.Table_8b11b0f74b55400080d37799143edfac [id=e16f8e50cfeb444eae29278b7a4b65df]) successfully deleted
I20260923 19:50:01.210119 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 64a38bbd3fbd4738a73e78e3f6436fe5
I20260923 19:50:01.210940 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 49) took 2330 ms. Trace:
I20260923 19:50:01.211267 6025 tablet_service.cc:1558] Processing DeleteTablet for tablet 64a38bbd3fbd4738a73e78e3f6436fe5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:00 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:01.212474 6461 tablet_replica.cc:333] T 09bb2ab5617a49d99e75191b3b48b85f P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:01.212621 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_65616076f4a1461e9b5798cd7d8a089e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:01.213301 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_65616076f4a1461e9b5798cd7d8a089e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:01.213898 6461 raft_consensus.cc:2243] T 09bb2ab5617a49d99e75191b3b48b85f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:01.214116 6461 raft_consensus.cc:2272] T 09bb2ab5617a49d99e75191b3b48b85f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:01.214116 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 77f111a495f3429cb243417824095d02
I20260923 19:50:01.214493 6458 rpcz_store.cc:276] 0923 19:49:58.880350 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:49:58.880402 (+ 52us) service_pool.cc:224] Handling call
0923 19:50:01.037049 (+2156647us) ts_tablet_manager.cc:1151] Deleting tablet cca0dc9ed824410bbed5a25afebb90e1
0923 19:50:01.037056 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:01.163635 (+126579us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:01.203009 (+ 39374us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:01.210885 (+ 7876us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2156439}
I20260923 19:50:01.214926 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 47) took 2334 ms. Trace:
I20260923 19:50:01.214944 5796 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_dc62d1ed0f594a698f993c61a912cdbc" } new_table_name: "default.Table_d001b1ae71164031b36e4bb63cf308bc" modify_external_catalogs: true
I20260923 19:50:01.215018 6458 rpcz_store.cc:276] 0923 19:49:58.880114 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:49:58.880647 (+ 533us) service_pool.cc:224] Handling call
0923 19:50:01.214784 (+2334137us) ts_tablet_manager.cc:1151] Deleting tablet 29b2b75a12cb4ea3b73afe0ac549386f
0923 19:50:01.214794 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:01.214877 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2333961}
I20260923 19:50:01.215356 6025 tablet_service.cc:1558] Processing DeleteTablet for tablet 77f111a495f3429cb243417824095d02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:01.215400 6458 tablet_replica.cc:333] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:01.215610 6458 raft_consensus.cc:2243] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:01.215806 6458 raft_consensus.cc:2272] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:01.216322 5805 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4dbc0e17d77140f6abe9ee26c8ec13ee consensus state has no leader
I20260923 19:50:01.217464 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_3b67057fc3ff492b9de9e41944c4bb1c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:01.218047 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b67057fc3ff492b9de9e41944c4bb1c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:01.218442 6596 raft_consensus.cc:493] T 8db0358af7634911820f99fe16605ca7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:01.218585 6596 raft_consensus.cc:515] T 8db0358af7634911820f99fe16605ca7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:01.219324 6596 leader_election.cc:290] T 8db0358af7634911820f99fe16605ca7 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:01.220654 6461 ts_tablet_manager.cc:1916] T 09bb2ab5617a49d99e75191b3b48b85f P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:01.221657 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db0358af7634911820f99fe16605ca7" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:01.222856 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet cca0dc9ed824410bbed5a25afebb90e1 (table default.Table_becda8ed754641458d230754da7bf5a0 [id=9dec959401b44b6894aff08698088c4e]) successfully deleted
W20260923 19:50:01.223114 5792 catalog_manager.cc:5030] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 29b2b75a12cb4ea3b73afe0ac549386f because the tablet was not found. No further retry: Not found: Tablet not found: 29b2b75a12cb4ea3b73afe0ac549386f
I20260923 19:50:01.225795 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_f24ccf7245f94d7eb868cc4fb3cd2759"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:01.225967 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_4e7f76686b274699817f861e70ce98aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:01.226415 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4e7f76686b274699817f861e70ce98aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:01.227535 6279 leader_election.cc:343] T 8db0358af7634911820f99fe16605ca7 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:01.228250 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet f2d9f1a0fae849ae8083eba082055fe9
I20260923 19:50:01.229063 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_87a4a0bf78434d8b84d7d1f0f1795fa4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:01.229156 6025 tablet_service.cc:1558] Processing DeleteTablet for tablet f2d9f1a0fae849ae8083eba082055fe9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:00 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:01.226416 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f24ccf7245f94d7eb868cc4fb3cd2759 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:01.230051 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet f2d9f1a0fae849ae8083eba082055fe9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:00 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:01.230895 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_87a4a0bf78434d8b84d7d1f0f1795fa4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:01.236608 6520 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260923 19:50:01.238106 6520 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:50:01.238523 6520 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:50:01.246762 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db0358af7634911820f99fe16605ca7" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:01.247277 6176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec4284d6a0fa416ca95b4d675c8e3912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.248452 6457 tablet_bootstrap.cc:492] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:01.253471 6175 tablet_service.cc:1558] Processing DeleteTablet for tablet 64a38bbd3fbd4738a73e78e3f6436fe5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:00 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:01.253702 6169 tablet_service.cc:1558] Processing DeleteTablet for tablet 77f111a495f3429cb243417824095d02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:01.254377 5797 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7ab0f3b15ee44f47b99ae44d22ec533f" } new_table_name: "default.Table_654e78935bde491c95268be69d832a46" modify_external_catalogs: true
W20260923 19:50:01.255566 5796 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b529b0e82c5b48edac54cc281ac4b4a6 has no consensus state
I20260923 19:50:01.255816 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_255bdbade70b4630938642879f85d901"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:01.255905 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_adfa6338ea024e4a87e614cbc086cbc3" } modify_external_catalogs: true
I20260923 19:50:01.256052 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_adfa6338ea024e4a87e614cbc086cbc3" } modify_external_catalogs: true
W20260923 19:50:01.257395 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_255bdbade70b4630938642879f85d901 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:01.258983 5805 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_30f4ccabe7fa4c8ba92e008f3d9b2d80" } modify_external_catalogs: true
I20260923 19:50:01.259135 5805 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_30f4ccabe7fa4c8ba92e008f3d9b2d80" } modify_external_catalogs: true
I20260923 19:50:01.260907 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_5a6fa8ae653f425cab3881df9d38f909"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:01.261534 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5a6fa8ae653f425cab3881df9d38f909 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:01.248870 6457 ts_tablet_manager.cc:1403] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.101s user 0.004s sys 0.005s
I20260923 19:50:01.269649 6457 raft_consensus.cc:359] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:01.270151 5800 master_service.cc:960] ReplaceTablet: received request to replace tablet 3158b344d1c748aab5004543e4448adb from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:01.279254 6457 raft_consensus.cc:385] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:01.279521 6457 raft_consensus.cc:740] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:01.280138 6457 consensus_queue.cc:260] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:01.280897 6457 ts_tablet_manager.cc:1434] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260923 19:50:01.281019 6175 tablet_service.cc:1558] Processing DeleteTablet for tablet f2d9f1a0fae849ae8083eba082055fe9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:00 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:01.281812 6457 tablet_bootstrap.cc:492] T 32c8333073574fe79bfc3e33f3249256 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
W20260923 19:50:01.286979 6137 consensus_peers.cc:597] T c14d36ad1b7241c894dbdff46159000c P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c14d36ad1b7241c894dbdff46159000c. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:01.288409 6457 tablet_bootstrap.cc:654] T 32c8333073574fe79bfc3e33f3249256 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:01.291833 6280 leader_election.cc:343] T 8db0358af7634911820f99fe16605ca7 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:01.292004 6280 leader_election.cc:304] T 8db0358af7634911820f99fe16605ca7 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:01.296273 6461 ts_tablet_manager.cc:1929] T 09bb2ab5617a49d99e75191b3b48b85f P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:01.297211 6570 tablet.cc:1751] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260923 19:50:01.297750 6601 tablet.cc:1751] T 5725a9cb95c448d0a5ea8114e90bc9fe P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260923 19:50:01.298974 6457 tablet_bootstrap.cc:492] T 32c8333073574fe79bfc3e33f3249256 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:01.299786 6457 ts_tablet_manager.cc:1403] T 32c8333073574fe79bfc3e33f3249256 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.000s
I20260923 19:50:01.300691 6457 raft_consensus.cc:359] T 32c8333073574fe79bfc3e33f3249256 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:01.301304 6457 raft_consensus.cc:385] T 32c8333073574fe79bfc3e33f3249256 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:01.301563 6457 raft_consensus.cc:740] T 32c8333073574fe79bfc3e33f3249256 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:01.302271 6457 consensus_queue.cc:260] T 32c8333073574fe79bfc3e33f3249256 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:01.300966 6461 log.cc:1199] T 09bb2ab5617a49d99e75191b3b48b85f P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/09bb2ab5617a49d99e75191b3b48b85f
I20260923 19:50:01.303259 6461 ts_tablet_manager.cc:1950] T 09bb2ab5617a49d99e75191b3b48b85f P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:01.304530 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 09bb2ab5617a49d99e75191b3b48b85f (table default.Table_faa53cf5cc5541afb7b391368bdc55f7 [id=4a8f28e842e94d628326ca83935f23c6]) successfully deleted
I20260923 19:50:01.307168 6457 ts_tablet_manager.cc:1434] T 32c8333073574fe79bfc3e33f3249256 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
W20260923 19:50:01.309685 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 64a38bbd3fbd4738a73e78e3f6436fe5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64a38bbd3fbd4738a73e78e3f6436fe5 already in progress: creating tablet
I20260923 19:50:01.310276 6457 tablet_bootstrap.cc:492] T cc3b6d245c3e40cdabb20d7dcf07ec0e P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
W20260923 19:50:01.311712 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 77f111a495f3429cb243417824095d02 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 77f111a495f3429cb243417824095d02 already in progress: creating tablet
W20260923 19:50:01.312959 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet f2d9f1a0fae849ae8083eba082055fe9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2d9f1a0fae849ae8083eba082055fe9 already in progress: creating tablet
I20260923 19:50:01.315830 6457 tablet_bootstrap.cc:654] T cc3b6d245c3e40cdabb20d7dcf07ec0e P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:01.326462 5803 master_service.cc:960] ReplaceTablet: received request to replace tablet 1a5f682ef2794a1fb9f5c4c2c1ee52e7 from {username='slave'} at 127.0.0.1:59912
W20260923 19:50:01.335773 5797 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6fe14389e2a3487587dfcf7a8b4b242d has no consensus state
I20260923 19:50:01.337515 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet c817af3eb83a43a3b6d4e9c83a9eefbb
I20260923 19:50:01.339537 6025 tablet_service.cc:1558] Processing DeleteTablet for tablet c817af3eb83a43a3b6d4e9c83a9eefbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:01.340003 6461 tablet_replica.cc:333] T c817af3eb83a43a3b6d4e9c83a9eefbb P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:01.340215 6461 raft_consensus.cc:2243] T c817af3eb83a43a3b6d4e9c83a9eefbb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:01.340654 6461 raft_consensus.cc:2272] T c817af3eb83a43a3b6d4e9c83a9eefbb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:01.341198 5805 master_service.cc:960] ReplaceTablet: received request to replace tablet 32c8333073574fe79bfc3e33f3249256 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:01.342150 6168 tablet_service.cc:1558] Processing DeleteTablet for tablet c817af3eb83a43a3b6d4e9c83a9eefbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:01.342788 6461 ts_tablet_manager.cc:1916] T c817af3eb83a43a3b6d4e9c83a9eefbb P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:01.348483 5799 catalog_manager.cc:5838] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194). New cstate: current_term: 1 leader_uuid: "61022dd7f2f14dc19aebe3af5f08f430" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: UNKNOWN } } }
I20260923 19:50:01.349109 5799 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 223edddace234a16b2d360504a99c28b (table default.Table_4b2190aa0f324c3987e02081e95555e4 [id=ed438085f7054d9993a39852df4cc790]). Expected version 4 got 0
I20260923 19:50:01.355731 5801 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 4dbc0e17d77140f6abe9ee26c8ec13ee (table default.Table_732b2167539b49abaf9a0a019c6c70da [id=67292e21e6b546298c5d629c6ebcb718]). Expected version 1 got 0
I20260923 19:50:01.361773 5799 master_service.cc:960] ReplaceTablet: received request to replace tablet a1e8b8e638ec438a86f05fa147cdb27c from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:01.363443 6025 tablet_service.cc:1511] Processing CreateTablet for tablet 359b08ef348d4be68b14f9e871a5e519 (DEFAULT_TABLE table=default.Table_1812c0af6506416eb91a37c34e916119 [id=bf85ae2ea4884de58391fc9e7b140b7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.363686 6168 tablet_service.cc:1511] Processing CreateTablet for tablet 359b08ef348d4be68b14f9e871a5e519 (DEFAULT_TABLE table=default.Table_1812c0af6506416eb91a37c34e916119 [id=bf85ae2ea4884de58391fc9e7b140b7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.364110 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 359b08ef348d4be68b14f9e871a5e519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.364176 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 359b08ef348d4be68b14f9e871a5e519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.368880 6315 tablet_service.cc:1558] Processing DeleteTablet for tablet 77f111a495f3429cb243417824095d02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:01.371106 6031 tablet_service.cc:1511] Processing CreateTablet for tablet 337f32eb47954689a6eb8f74408e01d9 (DEFAULT_TABLE table=default.Table_a11420ea5a314c55aed7538c702811ee [id=f509f74bbf6b4b6381509c265432cbd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.371558 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 337f32eb47954689a6eb8f74408e01d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.373983 6039 tablet_service.cc:1511] Processing CreateTablet for tablet 2f627b7b9ff74750bd8dd59840bf77db (DEFAULT_TABLE table=default.Table_e6225c62c99144cdb7c222d165e1d7b5 [id=e54ebfe94bd640f59f7006d4d146a9da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.374372 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f627b7b9ff74750bd8dd59840bf77db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.391636 6182 tablet_service.cc:1511] Processing CreateTablet for tablet 337f32eb47954689a6eb8f74408e01d9 (DEFAULT_TABLE table=default.Table_a11420ea5a314c55aed7538c702811ee [id=f509f74bbf6b4b6381509c265432cbd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.392459 6182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 337f32eb47954689a6eb8f74408e01d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.392676 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 3190d18f00234d71b0a58c2c334ef45f
I20260923 19:50:01.393656 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet 3190d18f00234d71b0a58c2c334ef45f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:01.394801 6039 tablet_service.cc:1558] Processing DeleteTablet for tablet 3190d18f00234d71b0a58c2c334ef45f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:01.395067 5801 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_2f03e909da3b4f3d9736f0ca37d25a92 [id=d3b60b7fc1d84a46aa49932d5c3363ea] alter complete (version 3)
I20260923 19:50:01.397751 6025 tablet_service.cc:1558] Processing DeleteTablet for tablet 32c8333073574fe79bfc3e33f3249256 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:01.397967 6458 ts_tablet_manager.cc:1916] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:01.402616 6461 ts_tablet_manager.cc:1929] T c817af3eb83a43a3b6d4e9c83a9eefbb P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260923 19:50:01.402789 6461 log.cc:1199] T c817af3eb83a43a3b6d4e9c83a9eefbb P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/c817af3eb83a43a3b6d4e9c83a9eefbb
I20260923 19:50:01.403283 6461 ts_tablet_manager.cc:1950] T c817af3eb83a43a3b6d4e9c83a9eefbb P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:01.404660 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet c817af3eb83a43a3b6d4e9c83a9eefbb (table default.Table_30f4ccabe7fa4c8ba92e008f3d9b2d80 [id=b9b7fe147b8645389ebef237fa735b2b]) successfully deleted
W20260923 19:50:01.410760 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 3190d18f00234d71b0a58c2c334ef45f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3190d18f00234d71b0a58c2c334ef45f already in progress: creating tablet
I20260923 19:50:01.411202 6461 tablet_replica.cc:333] T 32c8333073574fe79bfc3e33f3249256 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:01.411468 6461 raft_consensus.cc:2243] T 32c8333073574fe79bfc3e33f3249256 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:01.411687 6461 raft_consensus.cc:2272] T 32c8333073574fe79bfc3e33f3249256 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:01.412976 6461 ts_tablet_manager.cc:1916] T 32c8333073574fe79bfc3e33f3249256 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:01.426327 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ad0a2201b53b433ba6f5ff6dd74cf9b3" } modify_external_catalogs: true
I20260923 19:50:01.426579 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ad0a2201b53b433ba6f5ff6dd74cf9b3" } modify_external_catalogs: true
I20260923 19:50:01.427773 6459 ts_tablet_manager.cc:1929] T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:01.427917 6459 log.cc:1199] T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/16098a9f015040dc93d9cca2fc9ebce2
I20260923 19:50:01.427925 5799 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_2f03e909da3b4f3d9736f0ca37d25a92" } new_table_name: "default.Table_b07b177ae0cb435598465ff79d506a10" modify_external_catalogs: true
I20260923 19:50:01.428313 5801 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_655007916e0446c2bd045bee42d2592f" } modify_external_catalogs: true
I20260923 19:50:01.428515 5801 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_655007916e0446c2bd045bee42d2592f" } modify_external_catalogs: true
I20260923 19:50:01.431519 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_0f7d73099ac1462b962be0316b72a59a" } new_table_name: "default.Table_ee5fbb39c54a49c89eaaff48f72a9c3c" modify_external_catalogs: true
I20260923 19:50:01.431699 6459 ts_tablet_manager.cc:1950] T 16098a9f015040dc93d9cca2fc9ebce2 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:01.432729 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f24ccf7245f94d7eb868cc4fb3cd2759" } new_table_name: "default.Table_bc20a658edaf42818fb401723f10f95f" modify_external_catalogs: true
I20260923 19:50:01.434819 5803 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f6c15bbc16984baa89deab54175d787a" } modify_external_catalogs: true
I20260923 19:50:01.435108 5803 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f6c15bbc16984baa89deab54175d787a" } modify_external_catalogs: true
I20260923 19:50:01.440809 6596 raft_consensus.cc:2749] T 8db0358af7634911820f99fe16605ca7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:01.441218 6512 raft_consensus.cc:493] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:01.444077 5796 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 621de7e5ea4f4f2789bd75b042e5e11b
W20260923 19:50:01.447326 5805 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b4fc995819cc40bf9956d85966bcd330 consensus state has no leader
W20260923 19:50:01.447700 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cd02244c52ad4d2ab3915108a92a6f97 has no consensus state
W20260923 19:50:01.448377 6280 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 44673.1us
I20260923 19:50:01.448585 5801 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 789c54477bec4636bb3669e1f62730e2
I20260923 19:50:01.449386 6315 tablet_service.cc:1558] Processing DeleteTablet for tablet c817af3eb83a43a3b6d4e9c83a9eefbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:01.449637 6596 raft_consensus.cc:493] T c52da04e5fe0454ea76bf4d99a930fd7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:01.449584 6025 tablet_service.cc:1558] Processing DeleteTablet for tablet 789c54477bec4636bb3669e1f62730e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:01.441849 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 91) took 1563 ms. Trace:
I20260923 19:50:01.451421 6459 rpcz_store.cc:276] 0923 19:49:59.870655 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:49:59.871922 (+ 1267us) service_pool.cc:224] Handling call
0923 19:50:01.108051 (+1236129us) ts_tablet_manager.cc:1151] Deleting tablet 16098a9f015040dc93d9cca2fc9ebce2
0923 19:50:01.108061 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:01.184717 (+ 76656us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:01.427698 (+242981us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:01.434556 (+ 6858us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1235897}
I20260923 19:50:01.452113 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 16098a9f015040dc93d9cca2fc9ebce2 (table default.Table_7146a9adbec34a6ab1272e2f632209d1 [id=25b5843f90294bc8a77f3a0e00193f0f]) successfully deleted
I20260923 19:50:01.442863 6454 tablet_bootstrap.cc:492] T 259e4faa58f549699538317019be5daf P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:01.452855 6454 ts_tablet_manager.cc:1403] T 259e4faa58f549699538317019be5daf P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.524s user 0.001s sys 0.011s
I20260923 19:50:01.453863 6454 raft_consensus.cc:359] T 259e4faa58f549699538317019be5daf P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:01.454159 6454 raft_consensus.cc:385] T 259e4faa58f549699538317019be5daf P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:01.454283 6454 raft_consensus.cc:740] T 259e4faa58f549699538317019be5daf P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:01.457049 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_c49fa1ccdba34f098164e9732f9a750a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:01.457713 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c49fa1ccdba34f098164e9732f9a750a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:01.462725 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_18b2b0faf7ec48c7b8e02c1459247503" } new_table_name: "default.Table_5fe1e9c68ca74f1cacee9b8f129ad7f8" modify_external_catalogs: true
I20260923 19:50:01.463838 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_7920d992d8e64e6386e9d47abb996a6b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:01.464349 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7920d992d8e64e6386e9d47abb996a6b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:01.464967 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_41c2e67e9c7e4fa192fc124e05c2d34f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:01.465682 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41c2e67e9c7e4fa192fc124e05c2d34f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:01.466619 6596 raft_consensus.cc:515] T c52da04e5fe0454ea76bf4d99a930fd7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:01.467355 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_7685437ec90948a480a544421ad56cc4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:01.468019 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7685437ec90948a480a544421ad56cc4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:01.450816 6176 tablet_service.cc:1558] Processing DeleteTablet for tablet 789c54477bec4636bb3669e1f62730e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:01.471463 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_0291d1f518d445cda50f5b95a4aee646"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:01.472940 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0291d1f518d445cda50f5b95a4aee646 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:01.475037 6461 ts_tablet_manager.cc:1929] T 32c8333073574fe79bfc3e33f3249256 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:01.475281 6461 log.cc:1199] T 32c8333073574fe79bfc3e33f3249256 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/32c8333073574fe79bfc3e33f3249256
I20260923 19:50:01.476944 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_809bfd3727c8499980a5a1fa9b42b948"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:01.477495 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_809bfd3727c8499980a5a1fa9b42b948 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:01.477552 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet f108ebdaecab42e7b57057c7ecfbe690
I20260923 19:50:01.479135 6176 tablet_service.cc:1558] Processing DeleteTablet for tablet f108ebdaecab42e7b57057c7ecfbe690 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:01.479506 6025 tablet_service.cc:1558] Processing DeleteTablet for tablet f108ebdaecab42e7b57057c7ecfbe690 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:01.476346 6461 ts_tablet_manager.cc:1950] T 32c8333073574fe79bfc3e33f3249256 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
W20260923 19:50:01.485139 5805 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e9cbfaa34c924a678f23cbcbf1a6fb0a consensus state has no leader
I20260923 19:50:01.454653 6454 consensus_queue.cc:260] T 259e4faa58f549699538317019be5daf P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:01.487677 6512 raft_consensus.cc:515] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:01.489604 6323 tablet_service.cc:1511] Processing CreateTablet for tablet 337f32eb47954689a6eb8f74408e01d9 (DEFAULT_TABLE table=default.Table_a11420ea5a314c55aed7538c702811ee [id=f509f74bbf6b4b6381509c265432cbd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.489971 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52da04e5fe0454ea76bf4d99a930fd7" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:01.490711 6471 raft_consensus.cc:493] T 259e4faa58f549699538317019be5daf P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:01.491231 6471 raft_consensus.cc:515] T 259e4faa58f549699538317019be5daf P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:01.492189 6471 leader_election.cc:290] T 259e4faa58f549699538317019be5daf P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:01.493752 6058 raft_consensus.cc:1275] T 223edddace234a16b2d360504a99c28b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Refusing update from remote peer 61022dd7f2f14dc19aebe3af5f08f430: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:50:01.493980 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52da04e5fe0454ea76bf4d99a930fd7" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:01.494143 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87afbdb11c6e4e58affd2f2d7995e1f8" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:01.494311 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 32c8333073574fe79bfc3e33f3249256 (table default.Table_61c4c80bb6264458b904d9b0322596c0 [id=3fb7e854da784756b57db432e6c373db]) successfully deleted
I20260923 19:50:01.494915 6315 tablet_service.cc:1511] Processing CreateTablet for tablet 359b08ef348d4be68b14f9e871a5e519 (DEFAULT_TABLE table=default.Table_1812c0af6506416eb91a37c34e916119 [id=bf85ae2ea4884de58391fc9e7b140b7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.495601 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259e4faa58f549699538317019be5daf" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:01.495795 6454 ts_tablet_manager.cc:1434] T 259e4faa58f549699538317019be5daf P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.043s user 0.002s sys 0.000s
I20260923 19:50:01.495795 6059 raft_consensus.cc:2468] T 259e4faa58f549699538317019be5daf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:01.496471 6137 leader_election.cc:304] T 259e4faa58f549699538317019be5daf P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
W20260923 19:50:01.497148 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 789c54477bec4636bb3669e1f62730e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 789c54477bec4636bb3669e1f62730e2 already in progress: creating tablet
W20260923 19:50:01.500270 5790 catalog_manager.cc:5030] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet f108ebdaecab42e7b57057c7ecfbe690 because the tablet was not found. No further retry: Not found: Tablet not found: f108ebdaecab42e7b57057c7ecfbe690
I20260923 19:50:01.502619 6025 tablet_service.cc:1511] Processing CreateTablet for tablet daafbafae5004b8499e7ea93342c0517 (DEFAULT_TABLE table=default.Table_8f05b370f3d340329b68573e263210cd [id=08d65b643de645c7b760d27d28eccafe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.503136 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daafbafae5004b8499e7ea93342c0517. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.507108 6512 leader_election.cc:290] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:01.508846 6316 tablet_service.cc:1558] Processing DeleteTablet for tablet 64a38bbd3fbd4738a73e78e3f6436fe5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:00 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:01.509230 6279 leader_election.cc:343] T c52da04e5fe0454ea76bf4d99a930fd7 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:01.510195 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87afbdb11c6e4e58affd2f2d7995e1f8" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:01.511241 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 337f32eb47954689a6eb8f74408e01d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.511461 6596 leader_election.cc:290] T c52da04e5fe0454ea76bf4d99a930fd7 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:01.511656 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet 789c54477bec4636bb3669e1f62730e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:01.512495 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet 3190d18f00234d71b0a58c2c334ef45f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:01.512497 6039 tablet_service.cc:1511] Processing CreateTablet for tablet c48d4a8371fa4454b7c67291db3ab796 (DEFAULT_TABLE table=default.Table_42fbb36fdc75430881f49e0b2bb82fc3 [id=8a2bd1f24f824735a82439a9b4ce1f0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.512905 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c48d4a8371fa4454b7c67291db3ab796. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:01.513625 6280 leader_election.cc:343] T c52da04e5fe0454ea76bf4d99a930fd7 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:01.513702 6279 leader_election.cc:343] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:01.515264 6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 359b08ef348d4be68b14f9e871a5e519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.515568 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet f108ebdaecab42e7b57057c7ecfbe690 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:01.518496 6176 tablet_service.cc:1511] Processing CreateTablet for tablet daafbafae5004b8499e7ea93342c0517 (DEFAULT_TABLE table=default.Table_8f05b370f3d340329b68573e263210cd [id=08d65b643de645c7b760d27d28eccafe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.520272 6344 raft_consensus.cc:1275] T 223edddace234a16b2d360504a99c28b P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Refusing update from remote peer 61022dd7f2f14dc19aebe3af5f08f430: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:50:01.520516 6471 consensus_queue.cc:1048] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260923 19:50:01.521998 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_f7169811b947488a8dabd2f5d912b2d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:01.522020 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_69bbed3a902143c0a4fc91ee4cf3fec4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:01.522584 6471 consensus_queue.cc:1048] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260923 19:50:01.522732 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f7169811b947488a8dabd2f5d912b2d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:01.522755 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_69bbed3a902143c0a4fc91ee4cf3fec4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:01.524158 6280 leader_election.cc:304] T c52da04e5fe0454ea76bf4d99a930fd7 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:01.524610 6280 leader_election.cc:343] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:01.524744 6280 leader_election.cc:304] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:01.525586 6596 raft_consensus.cc:2749] T c52da04e5fe0454ea76bf4d99a930fd7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:01.525619 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 85d35ebef3c24a2e89233dd900b63513 (DEFAULT_TABLE table=default.Table_30a13147f51347808f58bfef0919dd77 [id=da91b06e11c64bb0aaec37a0188b5586]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.525815 6596 raft_consensus.cc:2749] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:01.526961 6324 tablet_service.cc:1511] Processing CreateTablet for tablet 2f627b7b9ff74750bd8dd59840bf77db (DEFAULT_TABLE table=default.Table_e6225c62c99144cdb7c222d165e1d7b5 [id=e54ebfe94bd640f59f7006d4d146a9da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.527350 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f627b7b9ff74750bd8dd59840bf77db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.528012 6345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259e4faa58f549699538317019be5daf" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:01.528204 6345 raft_consensus.cc:2468] T 259e4faa58f549699538317019be5daf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:01.528170 6312 tablet_service.cc:1511] Processing CreateTablet for tablet 015c14b447fe4cd18d197b2d1ed5884e (DEFAULT_TABLE table=default.Table_e06d0ff4af234fa090feddba5bef4853 [id=5f2c892d7f794a6dbc1499fada9faf02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.528471 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 6fe14389e2a3487587dfcf7a8b4b242d (DEFAULT_TABLE table=default.Table_654e78935bde491c95268be69d832a46 [id=db37d58a601f44c4a08efd4fcc3f115b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.528600 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 015c14b447fe4cd18d197b2d1ed5884e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.529363 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 6fe14389e2a3487587dfcf7a8b4b242d (DEFAULT_TABLE table=default.Table_654e78935bde491c95268be69d832a46 [id=db37d58a601f44c4a08efd4fcc3f115b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.530123 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85d35ebef3c24a2e89233dd900b63513. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.533800 6319 tablet_service.cc:1511] Processing CreateTablet for tablet c48d4a8371fa4454b7c67291db3ab796 (DEFAULT_TABLE table=default.Table_42fbb36fdc75430881f49e0b2bb82fc3 [id=8a2bd1f24f824735a82439a9b4ce1f0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.536639 6319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c48d4a8371fa4454b7c67291db3ab796. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.538391 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fe14389e2a3487587dfcf7a8b4b242d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.539330 5799 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_822c35f920714c3d8d79f91566bd5da9" } new_table_name: "default.Table_2adc87e06d81491498aa018f49fdc08d" modify_external_catalogs: true
I20260923 19:50:01.540823 6456 tablet_bootstrap.cc:492] T 9ed630e738c54ed38b9933f95fb552c5 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:01.540975 6456 ts_tablet_manager.cc:1403] T 9ed630e738c54ed38b9933f95fb552c5 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.354s user 0.020s sys 0.034s
I20260923 19:50:01.541280 6031 tablet_service.cc:1511] Processing CreateTablet for tablet 6fe14389e2a3487587dfcf7a8b4b242d (DEFAULT_TABLE table=default.Table_654e78935bde491c95268be69d832a46 [id=db37d58a601f44c4a08efd4fcc3f115b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.541838 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fe14389e2a3487587dfcf7a8b4b242d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.541729 6456 raft_consensus.cc:359] T 9ed630e738c54ed38b9933f95fb552c5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:01.541937 6456 raft_consensus.cc:385] T 9ed630e738c54ed38b9933f95fb552c5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:01.542040 6456 raft_consensus.cc:740] T 9ed630e738c54ed38b9933f95fb552c5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:01.542289 6456 consensus_queue.cc:260] T 9ed630e738c54ed38b9933f95fb552c5 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:01.542840 6456 ts_tablet_manager.cc:1434] T 9ed630e738c54ed38b9933f95fb552c5 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:01.542984 6454 tablet_bootstrap.cc:492] T e655ab5873294e75a242709f069aabf2 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:01.543572 6456 tablet_bootstrap.cc:492] T 77f111a495f3429cb243417824095d02 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:01.545426 6456 tablet_bootstrap.cc:654] T 77f111a495f3429cb243417824095d02 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:01.547748 6173 tablet_service.cc:1511] Processing CreateTablet for tablet 6e781ccf4aa343fc924138c3cc2b04e6 (DEFAULT_TABLE table=default.Table_973ceea94f2e4c6da7b1c722b99ac413 [id=c9f541017259420e858a2982f3e32141]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.548380 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 107) took 1501 ms. Trace:
I20260923 19:50:01.548525 6459 rpcz_store.cc:276] 0923 19:50:00.004378 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:00.094959 (+ 90581us) service_pool.cc:224] Handling call
0923 19:50:01.497719 (+1402760us) ts_tablet_manager.cc:1151] Deleting tablet 5455beff354a4616a68d8746e3e4f9a8
0923 19:50:01.497730 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:01.505712 (+ 7982us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1392322}
W20260923 19:50:01.549203 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 5455beff354a4616a68d8746e3e4f9a8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5455beff354a4616a68d8746e3e4f9a8 already in progress: creating tablet
I20260923 19:50:01.549454 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 85d35ebef3c24a2e89233dd900b63513 (DEFAULT_TABLE table=default.Table_30a13147f51347808f58bfef0919dd77 [id=da91b06e11c64bb0aaec37a0188b5586]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.550819 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85d35ebef3c24a2e89233dd900b63513. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.555583 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5a6fa8ae653f425cab3881df9d38f909" } modify_external_catalogs: true
I20260923 19:50:01.555855 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5a6fa8ae653f425cab3881df9d38f909" } modify_external_catalogs: true
I20260923 19:50:01.557319 6314 tablet_service.cc:1511] Processing CreateTablet for tablet 6e781ccf4aa343fc924138c3cc2b04e6 (DEFAULT_TABLE table=default.Table_973ceea94f2e4c6da7b1c722b99ac413 [id=c9f541017259420e858a2982f3e32141]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.558275 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_5febe26a78884634a01aa0ec62f36604"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:01.558487 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_82887fe31841462bafc075decf6acdbd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:01.558961 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5febe26a78884634a01aa0ec62f36604 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:01.558970 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_82887fe31841462bafc075decf6acdbd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:01.561182 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e781ccf4aa343fc924138c3cc2b04e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.570330 6032 tablet_service.cc:1511] Processing CreateTablet for tablet 6e781ccf4aa343fc924138c3cc2b04e6 (DEFAULT_TABLE table=default.Table_973ceea94f2e4c6da7b1c722b99ac413 [id=c9f541017259420e858a2982f3e32141]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.570770 6172 tablet_service.cc:1511] Processing CreateTablet for tablet 2f627b7b9ff74750bd8dd59840bf77db (DEFAULT_TABLE table=default.Table_e6225c62c99144cdb7c222d165e1d7b5 [id=e54ebfe94bd640f59f7006d4d146a9da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.569918 6035 tablet_service.cc:1511] Processing CreateTablet for tablet 015c14b447fe4cd18d197b2d1ed5884e (DEFAULT_TABLE table=default.Table_e06d0ff4af234fa090feddba5bef4853 [id=5f2c892d7f794a6dbc1499fada9faf02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.537513 6316 tablet_service.cc:1511] Processing CreateTablet for tablet daafbafae5004b8499e7ea93342c0517 (DEFAULT_TABLE table=default.Table_8f05b370f3d340329b68573e263210cd [id=08d65b643de645c7b760d27d28eccafe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.574895 6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daafbafae5004b8499e7ea93342c0517. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.577064 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e781ccf4aa343fc924138c3cc2b04e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.580020 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 015c14b447fe4cd18d197b2d1ed5884e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.580140 6458 ts_tablet_manager.cc:1929] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:01.580271 6458 log.cc:1199] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/4beb8ce27cf84fe9bacae12e8ff496e3
I20260923 19:50:01.582970 6458 ts_tablet_manager.cc:1950] T 4beb8ce27cf84fe9bacae12e8ff496e3 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:01.585248 5797 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 223edddace234a16b2d360504a99c28b (table default.Table_4b2190aa0f324c3987e02081e95555e4 [id=ed438085f7054d9993a39852df4cc790]). Expected version 4 got 0
I20260923 19:50:01.591754 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 46) took 2704 ms. Trace:
I20260923 19:50:01.591902 6458 rpcz_store.cc:276] 0923 19:49:58.879980 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:49:58.880854 (+ 874us) service_pool.cc:224] Handling call
0923 19:50:01.215322 (+2334468us) ts_tablet_manager.cc:1151] Deleting tablet 4beb8ce27cf84fe9bacae12e8ff496e3
0923 19:50:01.215330 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:01.532524 (+317194us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:01.580038 (+ 47514us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:01.584588 (+ 4550us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2334327}
I20260923 19:50:01.592358 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 4beb8ce27cf84fe9bacae12e8ff496e3 (table default.Table_6c2dcdbec7e14073a25a9c532d94c479 [id=699382b6e1fa451c90111ad6e3972beb]) successfully deleted
I20260923 19:50:01.592433 6458 tablet_replica.cc:333] T 11f9db993b0541668e0babd466059ff6 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:01.592660 6458 raft_consensus.cc:2243] T 11f9db993b0541668e0babd466059ff6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:01.592828 6458 raft_consensus.cc:2272] T 11f9db993b0541668e0babd466059ff6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:01.593410 6458 ts_tablet_manager.cc:1916] T 11f9db993b0541668e0babd466059ff6 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:01.619438 5803 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_e06d0ff4af234fa090feddba5bef4853" } modify_external_catalogs: true
I20260923 19:50:01.619693 5803 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_e06d0ff4af234fa090feddba5bef4853" } modify_external_catalogs: true
I20260923 19:50:01.625202 6652 tablet.cc:1751] T 5725a9cb95c448d0a5ea8114e90bc9fe P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260923 19:50:01.628418 6638 raft_consensus.cc:2804] T 259e4faa58f549699538317019be5daf P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:01.628592 5797 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 223edddace234a16b2d360504a99c28b (table default.Table_4b2190aa0f324c3987e02081e95555e4 [id=ed438085f7054d9993a39852df4cc790]). Expected version 4 got 0
I20260923 19:50:01.628569 6638 raft_consensus.cc:493] T 259e4faa58f549699538317019be5daf P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:01.629297 6176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daafbafae5004b8499e7ea93342c0517. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.630326 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 108) took 1541 ms. Trace:
I20260923 19:50:01.630589 6638 raft_consensus.cc:3060] T 259e4faa58f549699538317019be5daf P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:01.631171 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 85d35ebef3c24a2e89233dd900b63513 (DEFAULT_TABLE table=default.Table_30a13147f51347808f58bfef0919dd77 [id=da91b06e11c64bb0aaec37a0188b5586]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.631450 6164 tablet_service.cc:1511] Processing CreateTablet for tablet f108ebdaecab42e7b57057c7ecfbe690 (DEFAULT_TABLE table=default.Table_f6c15bbc16984baa89deab54175d787a [id=ec60adadc27d45b19a9eec1b8709eecb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.632313 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 015c14b447fe4cd18d197b2d1ed5884e (DEFAULT_TABLE table=default.Table_e06d0ff4af234fa090feddba5bef4853 [id=5f2c892d7f794a6dbc1499fada9faf02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.632373 6037 tablet_service.cc:1511] Processing CreateTablet for tablet f108ebdaecab42e7b57057c7ecfbe690 (DEFAULT_TABLE table=default.Table_f6c15bbc16984baa89deab54175d787a [id=ec60adadc27d45b19a9eec1b8709eecb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.632901 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f108ebdaecab42e7b57057c7ecfbe690. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:01.633184 6626 log.cc:927] Time spent T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430: Append to log took a long time: real 0.308s user 0.000s sys 0.001s
I20260923 19:50:01.633936 6459 rpcz_store.cc:276] 0923 19:50:00.008308 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:00.095193 (+ 86885us) service_pool.cc:224] Handling call
0923 19:50:01.549522 (+1454329us) ts_tablet_manager.cc:1151] Deleting tablet e1752d6b46894796bdc94e6230e3327d
0923 19:50:01.549532 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:01.549672 (+ 140us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1454078}
I20260923 19:50:01.635380 6471 consensus_queue.cc:1048] T c14d36ad1b7241c894dbdff46159000c P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.070s
W20260923 19:50:01.636759 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet e1752d6b46894796bdc94e6230e3327d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e1752d6b46894796bdc94e6230e3327d already in progress: creating tablet
I20260923 19:50:01.637342 6168 tablet_service.cc:1511] Processing CreateTablet for tablet c48d4a8371fa4454b7c67291db3ab796 (DEFAULT_TABLE table=default.Table_42fbb36fdc75430881f49e0b2bb82fc3 [id=8a2bd1f24f824735a82439a9b4ce1f0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.640341 6457 tablet_bootstrap.cc:492] T cc3b6d245c3e40cdabb20d7dcf07ec0e P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:01.640532 6457 ts_tablet_manager.cc:1403] T cc3b6d245c3e40cdabb20d7dcf07ec0e P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.330s user 0.012s sys 0.033s
I20260923 19:50:01.641392 6457 raft_consensus.cc:359] T cc3b6d245c3e40cdabb20d7dcf07ec0e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:01.641649 6457 raft_consensus.cc:385] T cc3b6d245c3e40cdabb20d7dcf07ec0e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:01.641793 6457 raft_consensus.cc:740] T cc3b6d245c3e40cdabb20d7dcf07ec0e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:01.644532 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 109) took 1628 ms. Trace:
I20260923 19:50:01.644709 6459 rpcz_store.cc:276] 0923 19:50:00.009138 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:00.095433 (+ 86295us) service_pool.cc:224] Handling call
0923 19:50:01.636288 (+1540855us) ts_tablet_manager.cc:1151] Deleting tablet d70b7662d85a4f64a11420448c4d140d
0923 19:50:01.636297 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:01.637793 (+ 1496us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1540682}
W20260923 19:50:01.645565 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet d70b7662d85a4f64a11420448c4d140d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d70b7662d85a4f64a11420448c4d140d already in progress: creating tablet
I20260923 19:50:01.647735 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_255bdbade70b4630938642879f85d901" } new_table_name: "default.Table_b729507fea034866a46da1d40fde099c" modify_external_catalogs: true
I20260923 19:50:01.649645 6172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f627b7b9ff74750bd8dd59840bf77db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.650202 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f108ebdaecab42e7b57057c7ecfbe690. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.650164 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d001b1ae71164031b36e4bb63cf308bc" } new_table_name: "default.Table_504bdbe9702948d58b4f958360a2040b" modify_external_catalogs: true
I20260923 19:50:01.651443 5802 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5fe1e9c68ca74f1cacee9b8f129ad7f8" } new_table_name: "default.Table_7e1ef96ed9694a29966dfbace1a5f555" modify_external_catalogs: true
I20260923 19:50:01.653648 5800 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 5725a9cb95c448d0a5ea8114e90bc9fe (table default.Table_b07b177ae0cb435598465ff79d506a10 [id=d3b60b7fc1d84a46aa49932d5c3363ea]). Expected version 4 got 3
I20260923 19:50:01.654421 5797 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f7169811b947488a8dabd2f5d912b2d4" } modify_external_catalogs: true
I20260923 19:50:01.654639 5797 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f7169811b947488a8dabd2f5d912b2d4" } modify_external_catalogs: true
I20260923 19:50:01.654660 5800 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b5e4b2595161409da2fb9a56664da184" } modify_external_catalogs: true
I20260923 19:50:01.654822 5800 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b5e4b2595161409da2fb9a56664da184" } modify_external_catalogs: true
I20260923 19:50:01.656973 6601 tablet.cc:1751] T 223edddace234a16b2d360504a99c28b P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260923 19:50:01.657409 6570 tablet.cc:1751] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260923 19:50:01.657855 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c48d4a8371fa4454b7c67291db3ab796. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.660549 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 115) took 1050 ms. Trace:
I20260923 19:50:01.660676 6459 rpcz_store.cc:276] 0923 19:50:00.606033 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:00.633198 (+ 27165us) service_pool.cc:224] Handling call
0923 19:50:01.645024 (+1011826us) ts_tablet_manager.cc:1151] Deleting tablet b7f372b952804ac58e602998d9b77d72
0923 19:50:01.645038 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:01.656487 (+ 11449us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1011198}
W20260923 19:50:01.662674 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet b7f372b952804ac58e602998d9b77d72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b7f372b952804ac58e602998d9b77d72 already in progress: creating tablet
I20260923 19:50:01.663836 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 116) took 1050 ms. Trace:
I20260923 19:50:01.663946 6459 rpcz_store.cc:276] 0923 19:50:00.610545 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:00.636224 (+ 25679us) service_pool.cc:224] Handling call
0923 19:50:01.660976 (+1024752us) ts_tablet_manager.cc:1151] Deleting tablet 8db0358af7634911820f99fe16605ca7
0923 19:50:01.660987 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:01.661101 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1024407}
W20260923 19:50:01.665654 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 8db0358af7634911820f99fe16605ca7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8db0358af7634911820f99fe16605ca7 already in progress: creating tablet
W20260923 19:50:01.666039 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet f7e282b6699a4ce9837d221132a1f54e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7e282b6699a4ce9837d221132a1f54e already in progress: creating tablet
I20260923 19:50:01.668116 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85d35ebef3c24a2e89233dd900b63513. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:01.668987 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet c52da04e5fe0454ea76bf4d99a930fd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c52da04e5fe0454ea76bf4d99a930fd7 already in progress: creating tablet
W20260923 19:50:01.669245 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet cc3b6d245c3e40cdabb20d7dcf07ec0e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc3b6d245c3e40cdabb20d7dcf07ec0e already in progress: creating tablet
W20260923 19:50:01.669466 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 4750e2a1b24e4bc7aafa4cd36afebbbd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4750e2a1b24e4bc7aafa4cd36afebbbd already in progress: creating tablet
W20260923 19:50:01.671360 5799 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ec4cc8a742114e5fb07c5c9157ce09e8 consensus state has no leader
I20260923 19:50:01.671801 5796 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet a9f808b3edd04d8ab3e32abb5b0203b9
I20260923 19:50:01.673897 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 015c14b447fe4cd18d197b2d1ed5884e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.675824 6459 tablet_replica.cc:333] T c14d36ad1b7241c894dbdff46159000c P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:01.676887 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 015c14b447fe4cd18d197b2d1ed5884e
I20260923 19:50:01.673745 6638 raft_consensus.cc:515] T 259e4faa58f549699538317019be5daf P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:01.679948 6459 raft_consensus.cc:2243] T c14d36ad1b7241c894dbdff46159000c P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:01.680970 5805 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f57f5ddf52f541ab91b4a9638fcf81a0" } modify_external_catalogs: true
I20260923 19:50:01.681092 6035 tablet_service.cc:1558] Processing DeleteTablet for tablet 015c14b447fe4cd18d197b2d1ed5884e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:01.681159 5805 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f57f5ddf52f541ab91b4a9638fcf81a0" } modify_external_catalogs: true
W20260923 19:50:01.682042 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 015c14b447fe4cd18d197b2d1ed5884e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 015c14b447fe4cd18d197b2d1ed5884e already in progress: creating tablet
I20260923 19:50:01.682288 6457 consensus_queue.cc:260] T cc3b6d245c3e40cdabb20d7dcf07ec0e P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:01.682514 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_df1bcb6c01a64dcebb3ce9b719acd5db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:01.683111 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_df1bcb6c01a64dcebb3ce9b719acd5db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:01.685328 6638 leader_election.cc:290] T 259e4faa58f549699538317019be5daf P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:01.685586 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259e4faa58f549699538317019be5daf" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:01.685803 6059 raft_consensus.cc:3060] T 259e4faa58f549699538317019be5daf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:01.686043 6457 ts_tablet_manager.cc:1434] T cc3b6d245c3e40cdabb20d7dcf07ec0e P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.045s user 0.003s sys 0.000s
I20260923 19:50:01.687855 5796 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 223edddace234a16b2d360504a99c28b (table default.Table_4b2190aa0f324c3987e02081e95555e4 [id=ed438085f7054d9993a39852df4cc790]). Expected version 4 got 0
I20260923 19:50:01.688937 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_1a5602208673400faf5f272297ff82b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:01.689551 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a5602208673400faf5f272297ff82b9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:01.691921 6457 tablet_bootstrap.cc:492] T e52d78a941a341d186dc00bbe7df96bf P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:01.694108 6457 tablet_bootstrap.cc:654] T e52d78a941a341d186dc00bbe7df96bf P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:01.699324 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ba4e9fee05994c0d8e7d1f21788280d3 has no consensus state
W20260923 19:50:01.700519 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b529b0e82c5b48edac54cc281ac4b4a6 consensus state has no leader
W20260923 19:50:01.703389 5802 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e9cbfaa34c924a678f23cbcbf1a6fb0a consensus state has no leader
W20260923 19:50:01.710659 6651 log.cc:927] Time spent T 223edddace234a16b2d360504a99c28b P 2bf41435f70447f19992d368ca6b46bd: Append to log took a long time: real 0.079s user 0.000s sys 0.000s
I20260923 19:50:01.711951 6324 tablet_service.cc:1511] Processing CreateTablet for tablet f108ebdaecab42e7b57057c7ecfbe690 (DEFAULT_TABLE table=default.Table_f6c15bbc16984baa89deab54175d787a [id=ec60adadc27d45b19a9eec1b8709eecb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.712397 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f108ebdaecab42e7b57057c7ecfbe690. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.713615 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_bbfd70af85d34f29bc8bbd6dbf85023d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:01.713972 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_8f05b370f3d340329b68573e263210cd" } new_table_name: "default.Table_4611fd8972c94dfdbbaf669673dbd540" modify_external_catalogs: true
W20260923 19:50:01.714236 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bbfd70af85d34f29bc8bbd6dbf85023d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:01.715574 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_9a02c99394944c41a1e4da7ce679e401"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:01.716048 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a02c99394944c41a1e4da7ce679e401 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:01.696826 6059 raft_consensus.cc:2468] T 259e4faa58f549699538317019be5daf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:01.706601 6035 tablet_service.cc:1511] Processing CreateTablet for tablet ffcf1a144f3c42719a5aa5deed537975 (DEFAULT_TABLE table=default.Table_53a39bb32157475a99f1d1822cf2e6d1 [id=85128802d87b452aa7d172c790ead994]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.717933 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffcf1a144f3c42719a5aa5deed537975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.719640 6315 tablet_service.cc:1558] Processing DeleteTablet for tablet 015c14b447fe4cd18d197b2d1ed5884e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:01.720507 6458 ts_tablet_manager.cc:1929] T 11f9db993b0541668e0babd466059ff6 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:01.721082 6458 log.cc:1199] T 11f9db993b0541668e0babd466059ff6 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/11f9db993b0541668e0babd466059ff6
I20260923 19:50:01.722487 6458 ts_tablet_manager.cc:1950] T 11f9db993b0541668e0babd466059ff6 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:01.722805 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e781ccf4aa343fc924138c3cc2b04e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.728193 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 48) took 2847 ms. Trace:
I20260923 19:50:01.728912 6458 rpcz_store.cc:276] 0923 19:49:58.880203 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:49:58.915798 (+ 35595us) service_pool.cc:224] Handling call
0923 19:50:01.592363 (+2676565us) ts_tablet_manager.cc:1151] Deleting tablet 11f9db993b0541668e0babd466059ff6
0923 19:50:01.592375 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:01.629407 (+ 37032us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:01.720342 (+ 90935us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:01.728071 (+ 7729us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2676186}
I20260923 19:50:01.730307 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 11f9db993b0541668e0babd466059ff6 (table default.Table_a1e21fac044546acb4b417436464d269 [id=c5b2cbbf70c0433986e5c8c9430c9bfd]) successfully deleted
I20260923 19:50:01.731006 6458 tablet_replica.cc:333] T c14d36ad1b7241c894dbdff46159000c P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:01.733990 5800 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 9101e82501fd461f8a4b2dcd9dffbd74
I20260923 19:50:01.735016 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_95db9487259c45f5bbfdede6ebd6d1da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:01.735369 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet 9101e82501fd461f8a4b2dcd9dffbd74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:01.735582 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_95db9487259c45f5bbfdede6ebd6d1da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:01.736241 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 9101e82501fd461f8a4b2dcd9dffbd74 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9101e82501fd461f8a4b2dcd9dffbd74 already in progress: creating tablet
I20260923 19:50:01.737921 5797 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet b5d8df45de46431da93af3db4e1113bc
I20260923 19:50:01.738286 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_973f7a2560ab48ad8d84aeb2f4fc235b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:01.739315 5804 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_4b2190aa0f324c3987e02081e95555e4 [id=ed438085f7054d9993a39852df4cc790] alter complete (version 4)
W20260923 19:50:01.739404 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_973f7a2560ab48ad8d84aeb2f4fc235b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:01.739817 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 5c0142f4e3ad42048803481d68f0ee5d
I20260923 19:50:01.744303 6315 tablet_service.cc:1558] Processing DeleteTablet for tablet 9101e82501fd461f8a4b2dcd9dffbd74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:01.744537 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c0142f4e3ad42048803481d68f0ee5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:01.744588 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet daafbafae5004b8499e7ea93342c0517 consensus state has no leader
I20260923 19:50:01.747429 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c0142f4e3ad42048803481d68f0ee5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:01.748533 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet cc3b6d245c3e40cdabb20d7dcf07ec0e with delete_type TABLET_DATA_DELETED (replaced by tablet 85d35ebef3c24a2e89233dd900b63513) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:01.748880 6461 tablet_replica.cc:333] T cc3b6d245c3e40cdabb20d7dcf07ec0e P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:01.748962 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c0142f4e3ad42048803481d68f0ee5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:01.749150 6461 raft_consensus.cc:2243] T cc3b6d245c3e40cdabb20d7dcf07ec0e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:01.749349 6461 raft_consensus.cc:2272] T cc3b6d245c3e40cdabb20d7dcf07ec0e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:01.750371 6461 ts_tablet_manager.cc:1916] T cc3b6d245c3e40cdabb20d7dcf07ec0e P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:01.754133 6459 pending_rounds.cc:70] T c14d36ad1b7241c894dbdff46159000c P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:01.754359 6137 leader_election.cc:304] T 259e4faa58f549699538317019be5daf P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:01.754920 6638 raft_consensus.cc:2804] T 259e4faa58f549699538317019be5daf P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:01.755848 6638 raft_consensus.cc:697] T 259e4faa58f549699538317019be5daf P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:01.756472 6638 consensus_queue.cc:237] T 259e4faa58f549699538317019be5daf P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:01.757679 6179 tablet_service.cc:1511] Processing CreateTablet for tablet ffcf1a144f3c42719a5aa5deed537975 (DEFAULT_TABLE table=default.Table_53a39bb32157475a99f1d1822cf2e6d1 [id=85128802d87b452aa7d172c790ead994]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:01.758603 5789 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet ba4e9fee05994c0d8e7d1f21788280d3 (table default.Table_b729507fea034866a46da1d40fde099c [id=49bb9f954b544f41b75f6035b1ea68b1], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet ba4e9fee05994c0d8e7d1f21788280d3 has no consensus state
I20260923 19:50:01.759684 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fe14389e2a3487587dfcf7a8b4b242d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.759660 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet 9101e82501fd461f8a4b2dcd9dffbd74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:01.759913 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffcf1a144f3c42719a5aa5deed537975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.769318 6461 ts_tablet_manager.cc:1929] T cc3b6d245c3e40cdabb20d7dcf07ec0e P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:01.769553 6461 log.cc:1199] T cc3b6d245c3e40cdabb20d7dcf07ec0e P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/cc3b6d245c3e40cdabb20d7dcf07ec0e
I20260923 19:50:01.778290 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_4803d401dac84700919d6879b552cd8d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:01.779142 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4803d401dac84700919d6879b552cd8d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:01.759462 6459 pending_rounds.cc:77] T c14d36ad1b7241c894dbdff46159000c P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630529783627776 op_type: NO_OP noop_request { }
I20260923 19:50:01.786120 6461 ts_tablet_manager.cc:1950] T cc3b6d245c3e40cdabb20d7dcf07ec0e P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:01.789402 6601 tablet.cc:1751] T 5725a9cb95c448d0a5ea8114e90bc9fe P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260923 19:50:01.709986 6643 raft_consensus.cc:493] T 4bf129dd52b84a4ea461ec454bc34fe8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:01.792896 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259e4faa58f549699538317019be5daf" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:01.793087 6342 raft_consensus.cc:3060] T 259e4faa58f549699538317019be5daf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:01.796900 6457 tablet_bootstrap.cc:492] T e52d78a941a341d186dc00bbe7df96bf P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:01.797209 6457 ts_tablet_manager.cc:1403] T e52d78a941a341d186dc00bbe7df96bf P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.105s user 0.003s sys 0.002s
I20260923 19:50:01.798483 6457 raft_consensus.cc:359] T e52d78a941a341d186dc00bbe7df96bf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:01.799659 6457 raft_consensus.cc:385] T e52d78a941a341d186dc00bbe7df96bf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:01.799666 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 31b0bdf719554d37993a802831e324ee (DEFAULT_TABLE table=default.Table_b28fac33a5bd4feea5ac2c04b2bcecc4 [id=bf8666274f50416b80fcd282e4d1e2a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.799990 6457 raft_consensus.cc:740] T e52d78a941a341d186dc00bbe7df96bf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:01.800146 6454 tablet_bootstrap.cc:654] T e655ab5873294e75a242709f069aabf2 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:01.800550 6457 consensus_queue.cc:260] T e52d78a941a341d186dc00bbe7df96bf P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:01.800094 6643 raft_consensus.cc:515] T 4bf129dd52b84a4ea461ec454bc34fe8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:01.802158 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 31b0bdf719554d37993a802831e324ee (DEFAULT_TABLE table=default.Table_b28fac33a5bd4feea5ac2c04b2bcecc4 [id=bf8666274f50416b80fcd282e4d1e2a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.802673 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31b0bdf719554d37993a802831e324ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.803848 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf129dd52b84a4ea461ec454bc34fe8" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:01.807894 6459 raft_consensus.cc:2889] T c14d36ad1b7241c894dbdff46159000c P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:01.808065 6459 raft_consensus.cc:2272] T c14d36ad1b7241c894dbdff46159000c P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:01.809513 6457 ts_tablet_manager.cc:1434] T e52d78a941a341d186dc00bbe7df96bf P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260923 19:50:01.813592 6459 ts_tablet_manager.cc:1916] T c14d36ad1b7241c894dbdff46159000c P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:01.818343 6182 tablet_service.cc:1558] Processing DeleteTablet for tablet 015c14b447fe4cd18d197b2d1ed5884e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:01.822109 5802 master_service.cc:960] ReplaceTablet: received request to replace tablet 623fb5b761134951a4b742ab2ba480a4 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:01.825182 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf129dd52b84a4ea461ec454bc34fe8" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:01.826463 6174 tablet_service.cc:1511] Processing CreateTablet for tablet 31b0bdf719554d37993a802831e324ee (DEFAULT_TABLE table=default.Table_b28fac33a5bd4feea5ac2c04b2bcecc4 [id=bf8666274f50416b80fcd282e4d1e2a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.828037 6457 tablet_bootstrap.cc:492] T 4bf129dd52b84a4ea461ec454bc34fe8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:01.830624 6182 tablet_service.cc:1511] Processing CreateTablet for tablet b529b0e82c5b48edac54cc281ac4b4a6 (DEFAULT_TABLE table=default.Table_504bdbe9702948d58b4f958360a2040b [id=ca73f0867b5d49cfb0bb7cd2315c47f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.830760 6457 tablet_bootstrap.cc:654] T 4bf129dd52b84a4ea461ec454bc34fe8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:01.831804 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31b0bdf719554d37993a802831e324ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.833135 6315 tablet_service.cc:1511] Processing CreateTablet for tablet b529b0e82c5b48edac54cc281ac4b4a6 (DEFAULT_TABLE table=default.Table_504bdbe9702948d58b4f958360a2040b [id=ca73f0867b5d49cfb0bb7cd2315c47f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.835318 6182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b529b0e82c5b48edac54cc281ac4b4a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.835876 6652 tablet.cc:1751] T 223edddace234a16b2d360504a99c28b P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260923 19:50:01.820050 6035 tablet_service.cc:1511] Processing CreateTablet for tablet b529b0e82c5b48edac54cc281ac4b4a6 (DEFAULT_TABLE table=default.Table_504bdbe9702948d58b4f958360a2040b [id=ca73f0867b5d49cfb0bb7cd2315c47f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.836975 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b529b0e82c5b48edac54cc281ac4b4a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.837419 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31b0bdf719554d37993a802831e324ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.838047 6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b529b0e82c5b48edac54cc281ac4b4a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.837956 6314 tablet_service.cc:1511] Processing CreateTablet for tablet ffcf1a144f3c42719a5aa5deed537975 (DEFAULT_TABLE table=default.Table_53a39bb32157475a99f1d1822cf2e6d1 [id=85128802d87b452aa7d172c790ead994]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:01.838367 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffcf1a144f3c42719a5aa5deed537975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:01.839036 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet cc3b6d245c3e40cdabb20d7dcf07ec0e (table default.Table_30a13147f51347808f58bfef0919dd77 [id=da91b06e11c64bb0aaec37a0188b5586]) successfully deleted
W20260923 19:50:01.839406 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 5c0142f4e3ad42048803481d68f0ee5d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c0142f4e3ad42048803481d68f0ee5d already in progress: creating tablet
I20260923 19:50:01.841218 6570 tablet.cc:1751] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260923 19:50:01.841311 6342 raft_consensus.cc:2468] T 259e4faa58f549699538317019be5daf P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:01.845150 6643 leader_election.cc:290] T 4bf129dd52b84a4ea461ec454bc34fe8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:01.845489 6279 leader_election.cc:343] T 4bf129dd52b84a4ea461ec454bc34fe8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:01.846088 6280 leader_election.cc:343] T 4bf129dd52b84a4ea461ec454bc34fe8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:01.846665 6280 leader_election.cc:304] T 4bf129dd52b84a4ea461ec454bc34fe8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:01.847865 6643 raft_consensus.cc:2749] T 4bf129dd52b84a4ea461ec454bc34fe8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:01.864271 6457 tablet_bootstrap.cc:492] T 4bf129dd52b84a4ea461ec454bc34fe8 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:01.865269 6457 ts_tablet_manager.cc:1403] T 4bf129dd52b84a4ea461ec454bc34fe8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.037s user 0.001s sys 0.004s
I20260923 19:50:01.866482 6457 raft_consensus.cc:359] T 4bf129dd52b84a4ea461ec454bc34fe8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:01.866818 6457 raft_consensus.cc:385] T 4bf129dd52b84a4ea461ec454bc34fe8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:01.866952 6457 raft_consensus.cc:740] T 4bf129dd52b84a4ea461ec454bc34fe8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:01.867347 6457 consensus_queue.cc:260] T 4bf129dd52b84a4ea461ec454bc34fe8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:01.873149 6457 ts_tablet_manager.cc:1434] T 4bf129dd52b84a4ea461ec454bc34fe8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260923 19:50:01.886801 6601 tablet.cc:1746] T 223edddace234a16b2d360504a99c28b P e546f660e7e541d1aa9ae38e5ee5b9c0: Skipping requested alter to schema version 4, tablet already version 4
I20260923 19:50:01.888857 6652 tablet.cc:1751] T 5725a9cb95c448d0a5ea8114e90bc9fe P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260923 19:50:01.879654 6457 tablet_bootstrap.cc:492] T c52da04e5fe0454ea76bf4d99a930fd7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:01.892899 6457 tablet_bootstrap.cc:654] T c52da04e5fe0454ea76bf4d99a930fd7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:01.902284 6457 tablet_bootstrap.cc:492] T c52da04e5fe0454ea76bf4d99a930fd7 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:01.902612 6457 ts_tablet_manager.cc:1403] T c52da04e5fe0454ea76bf4d99a930fd7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.000s
I20260923 19:50:01.903929 6457 raft_consensus.cc:359] T c52da04e5fe0454ea76bf4d99a930fd7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:01.904455 6457 raft_consensus.cc:385] T c52da04e5fe0454ea76bf4d99a930fd7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:01.904619 6457 raft_consensus.cc:740] T c52da04e5fe0454ea76bf4d99a930fd7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:01.905023 6457 consensus_queue.cc:260] T c52da04e5fe0454ea76bf4d99a930fd7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:01.910553 6459 ts_tablet_manager.cc:1929] T c14d36ad1b7241c894dbdff46159000c P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:01.911180 6457 ts_tablet_manager.cc:1434] T c52da04e5fe0454ea76bf4d99a930fd7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260923 19:50:01.912313 6458 raft_consensus.cc:2243] T c14d36ad1b7241c894dbdff46159000c P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:01.917272 6458 pending_rounds.cc:70] T c14d36ad1b7241c894dbdff46159000c P 2bf41435f70447f19992d368ca6b46bd: Trying to abort 1 pending ops.
I20260923 19:50:01.917462 6458 pending_rounds.cc:77] T c14d36ad1b7241c894dbdff46159000c P 2bf41435f70447f19992d368ca6b46bd: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630529783627776 op_type: NO_OP noop_request { }
I20260923 19:50:01.917752 6458 raft_consensus.cc:2889] T c14d36ad1b7241c894dbdff46159000c P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:01.917948 6458 raft_consensus.cc:2272] T c14d36ad1b7241c894dbdff46159000c P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:01.918848 6458 ts_tablet_manager.cc:1916] T c14d36ad1b7241c894dbdff46159000c P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:01.924723 6457 tablet_bootstrap.cc:492] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:01.926048 6456 tablet_bootstrap.cc:492] T 77f111a495f3429cb243417824095d02 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:01.926620 6456 ts_tablet_manager.cc:1403] T 77f111a495f3429cb243417824095d02 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.383s user 0.006s sys 0.001s
I20260923 19:50:01.927251 6457 tablet_bootstrap.cc:654] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:01.935163 6457 tablet_bootstrap.cc:492] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:01.935436 6457 ts_tablet_manager.cc:1403] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.003s
I20260923 19:50:01.936530 6457 raft_consensus.cc:359] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:01.936909 6457 raft_consensus.cc:385] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:01.937052 6457 raft_consensus.cc:740] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:01.937490 6457 consensus_queue.cc:260] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:01.930634 6456 raft_consensus.cc:359] T 77f111a495f3429cb243417824095d02 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:01.942116 6456 raft_consensus.cc:385] T 77f111a495f3429cb243417824095d02 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:01.943328 6456 raft_consensus.cc:740] T 77f111a495f3429cb243417824095d02 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:01.944455 6457 ts_tablet_manager.cc:1434] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260923 19:50:01.944873 6456 consensus_queue.cc:260] T 77f111a495f3429cb243417824095d02 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:01.950012 6457 tablet_bootstrap.cc:492] T 77f111a495f3429cb243417824095d02 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:01.950646 6459 log.cc:1199] T c14d36ad1b7241c894dbdff46159000c P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/c14d36ad1b7241c894dbdff46159000c
I20260923 19:50:01.926113 6655 tablet.cc:1746] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430: Skipping requested alter to schema version 4, tablet already version 4
I20260923 19:50:01.952823 6457 tablet_bootstrap.cc:654] T 77f111a495f3429cb243417824095d02 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:01.952940 6454 tablet_bootstrap.cc:492] T e655ab5873294e75a242709f069aabf2 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:01.953176 6454 ts_tablet_manager.cc:1403] T e655ab5873294e75a242709f069aabf2 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.457s user 0.007s sys 0.008s
I20260923 19:50:01.959483 5799 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_b07b177ae0cb435598465ff79d506a10 [id=d3b60b7fc1d84a46aa49932d5c3363ea] alter complete (version 4)
I20260923 19:50:01.959887 5799 master_service.cc:960] ReplaceTablet: received request to replace tablet b4fc995819cc40bf9956d85966bcd330 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:01.960846 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_9ef6e2f26ba14f5095a1d65288df3089" } new_table_name: "default.Table_00f5789c01e94f8e8c65077f98b164c2" modify_external_catalogs: true
I20260923 19:50:01.961619 5804 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_423256ac67c24899a4b67915596ef545" } modify_external_catalogs: true
I20260923 19:50:01.961896 5804 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_423256ac67c24899a4b67915596ef545" } modify_external_catalogs: true
I20260923 19:50:01.962597 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_24178fa82e3c4d878ed35fe32867eb98"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:01.963809 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_24178fa82e3c4d878ed35fe32867eb98 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:01.965749 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_7d32a5cfd4df4d989e7a55f600da00fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:01.966529 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7d32a5cfd4df4d989e7a55f600da00fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:01.966869 6456 ts_tablet_manager.cc:1434] T 77f111a495f3429cb243417824095d02 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.038s user 0.001s sys 0.001s
I20260923 19:50:01.968254 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_a5e5938cb98d49b2828f047807b2b784"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:01.968910 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a5e5938cb98d49b2828f047807b2b784 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:01.970063 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 623fb5b761134951a4b742ab2ba480a4
I20260923 19:50:01.970566 5802 catalog_manager.cc:6934] ReplaceTablet: tablet 623fb5b761134951a4b742ab2ba480a4 deleted and replaced by tablet 05a2d1b0979c4788bccc3a71e1cd098e
I20260923 19:50:01.972926 6315 tablet_service.cc:1558] Processing DeleteTablet for tablet 623fb5b761134951a4b742ab2ba480a4 with delete_type TABLET_DATA_DELETED (replaced by tablet 05a2d1b0979c4788bccc3a71e1cd098e) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:01.972939 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_654e78935bde491c95268be69d832a46" } modify_external_catalogs: true
I20260923 19:50:01.973114 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_654e78935bde491c95268be69d832a46" } modify_external_catalogs: true
I20260923 19:50:01.973325 6456 tablet_bootstrap.cc:492] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:01.974061 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_1812c0af6506416eb91a37c34e916119" } new_table_name: "default.Table_91a9675177604eb39c32e86718c59d31" modify_external_catalogs: true
I20260923 19:50:01.975252 6035 tablet_service.cc:1558] Processing DeleteTablet for tablet 623fb5b761134951a4b742ab2ba480a4 with delete_type TABLET_DATA_DELETED (replaced by tablet 05a2d1b0979c4788bccc3a71e1cd098e) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:01.976485 5802 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_732b2167539b49abaf9a0a019c6c70da" } new_table_name: "default.Table_701c81d7fd4844f09fc1ccc28f0eda9c" modify_external_catalogs: true
I20260923 19:50:01.979005 6456 tablet_bootstrap.cc:654] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:01.982299 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 623fb5b761134951a4b742ab2ba480a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 623fb5b761134951a4b742ab2ba480a4 already in progress: creating tablet
I20260923 19:50:01.985636 6459 ts_tablet_manager.cc:1950] T c14d36ad1b7241c894dbdff46159000c P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
W20260923 19:50:01.987003 5803 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ec4284d6a0fa416ca95b4d675c8e3912 consensus state has no leader
I20260923 19:50:01.988332 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet 623fb5b761134951a4b742ab2ba480a4 with delete_type TABLET_DATA_DELETED (replaced by tablet 05a2d1b0979c4788bccc3a71e1cd098e) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:01.990347 6454 raft_consensus.cc:359] T e655ab5873294e75a242709f069aabf2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:01.994069 6454 raft_consensus.cc:385] T e655ab5873294e75a242709f069aabf2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:01.994220 6454 raft_consensus.cc:740] T e655ab5873294e75a242709f069aabf2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:01.994495 6454 consensus_queue.cc:260] T e655ab5873294e75a242709f069aabf2 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:01.995095 6454 ts_tablet_manager.cc:1434] T e655ab5873294e75a242709f069aabf2 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.042s user 0.001s sys 0.001s
I20260923 19:50:01.997447 6035 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bf129dd52b84a4ea461ec454bc34fe8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:01.997815 6461 tablet_replica.cc:333] T 4bf129dd52b84a4ea461ec454bc34fe8 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:01.998095 6461 raft_consensus.cc:2243] T 4bf129dd52b84a4ea461ec454bc34fe8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:01.998333 6461 raft_consensus.cc:2272] T 4bf129dd52b84a4ea461ec454bc34fe8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:01.998750 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_3b67057fc3ff492b9de9e41944c4bb1c" } new_table_name: "default.Table_e1b933d20310499aab93b720704ea8d0" modify_external_catalogs: true
I20260923 19:50:01.999179 6461 ts_tablet_manager.cc:1916] T 4bf129dd52b84a4ea461ec454bc34fe8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:01.999778 5803 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7e1ef96ed9694a29966dfbace1a5f555" } modify_external_catalogs: true
I20260923 19:50:01.999960 5803 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7e1ef96ed9694a29966dfbace1a5f555" } modify_external_catalogs: true
I20260923 19:50:02.001675 6035 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a5f682ef2794a1fb9f5c4c2c1ee52e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:02.001909 6459 tablet_replica.cc:333] T 199843bdd7184df58be9a4a06a5ffb8b P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:02.002096 6459 raft_consensus.cc:2243] T 199843bdd7184df58be9a4a06a5ffb8b P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:02.002223 6035 tablet_service.cc:1558] Processing DeleteTablet for tablet e52d78a941a341d186dc00bbe7df96bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:02.002281 6459 raft_consensus.cc:2272] T 199843bdd7184df58be9a4a06a5ffb8b P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:02.002746 6035 tablet_service.cc:1558] Processing DeleteTablet for tablet c52da04e5fe0454ea76bf4d99a930fd7 with delete_type TABLET_DATA_DELETED (replaced by tablet b529b0e82c5b48edac54cc281ac4b4a6) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:02.002800 6459 ts_tablet_manager.cc:1916] T 199843bdd7184df58be9a4a06a5ffb8b P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:02.006175 6461 ts_tablet_manager.cc:1929] T 4bf129dd52b84a4ea461ec454bc34fe8 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:02.006289 6461 log.cc:1199] T 4bf129dd52b84a4ea461ec454bc34fe8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/4bf129dd52b84a4ea461ec454bc34fe8
I20260923 19:50:02.006652 6461 ts_tablet_manager.cc:1950] T 4bf129dd52b84a4ea461ec454bc34fe8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:02.007690 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 4bf129dd52b84a4ea461ec454bc34fe8 (table default.Table_75d1617a325e4c6591795f8378cfa93d [id=5e08f31834ac4ba188ce1b23889287a4]) successfully deleted
I20260923 19:50:02.008014 6461 tablet_replica.cc:333] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:02.008204 6461 raft_consensus.cc:2243] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:02.008350 6461 raft_consensus.cc:2272] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:02.009064 6461 ts_tablet_manager.cc:1916] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:02.013407 6457 tablet_bootstrap.cc:492] T 77f111a495f3429cb243417824095d02 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:02.013449 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet c14d36ad1b7241c894dbdff46159000c (table default.Table_88b60f3e46a743d3913e7a4c0f353a59 [id=56cd81aa3d6f47d388803884b9220810]) successfully deleted
W20260923 19:50:02.013785 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet a1e8b8e638ec438a86f05fa147cdb27c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a1e8b8e638ec438a86f05fa147cdb27c already in progress: creating tablet
I20260923 19:50:02.013631 6457 ts_tablet_manager.cc:1403] T 77f111a495f3429cb243417824095d02 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.064s user 0.004s sys 0.004s
I20260923 19:50:02.009466 6652 tablet.cc:1746] T 223edddace234a16b2d360504a99c28b P 2bf41435f70447f19992d368ca6b46bd: Skipping requested alter to schema version 4, tablet already version 4
I20260923 19:50:02.014784 6457 raft_consensus.cc:359] T 77f111a495f3429cb243417824095d02 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.015045 6457 raft_consensus.cc:385] T 77f111a495f3429cb243417824095d02 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:02.015196 6457 raft_consensus.cc:740] T 77f111a495f3429cb243417824095d02 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:02.015533 6457 consensus_queue.cc:260] T 77f111a495f3429cb243417824095d02 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.011247 6458 ts_tablet_manager.cc:1929] T c14d36ad1b7241c894dbdff46159000c P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:02.019562 6458 log.cc:1199] T c14d36ad1b7241c894dbdff46159000c P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/c14d36ad1b7241c894dbdff46159000c
I20260923 19:50:02.021956 5799 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet b4fc995819cc40bf9956d85966bcd330
I20260923 19:50:02.022600 5799 catalog_manager.cc:6934] ReplaceTablet: tablet b4fc995819cc40bf9956d85966bcd330 deleted and replaced by tablet efc63a151f6444dfb03c3f15f6f54473
I20260923 19:50:02.023658 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 6fe14389e2a3487587dfcf7a8b4b242d
I20260923 19:50:02.023815 6035 tablet_service.cc:1558] Processing DeleteTablet for tablet b4fc995819cc40bf9956d85966bcd330 with delete_type TABLET_DATA_DELETED (replaced by tablet efc63a151f6444dfb03c3f15f6f54473) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:02.024816 5802 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4dbc0e17d77140f6abe9ee26c8ec13ee consensus state has no leader
I20260923 19:50:02.025034 6314 tablet_service.cc:1558] Processing DeleteTablet for tablet 6fe14389e2a3487587dfcf7a8b4b242d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:02.025511 6035 tablet_service.cc:1558] Processing DeleteTablet for tablet 6fe14389e2a3487587dfcf7a8b4b242d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:02.025748 6315 tablet_service.cc:1558] Processing DeleteTablet for tablet b4fc995819cc40bf9956d85966bcd330 with delete_type TABLET_DATA_DELETED (replaced by tablet efc63a151f6444dfb03c3f15f6f54473) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:02.026340 6461 ts_tablet_manager.cc:1929] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260923 19:50:02.026986 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 359b08ef348d4be68b14f9e871a5e519 consensus state has no leader
I20260923 19:50:02.026986 6461 log.cc:1199] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/1a5f682ef2794a1fb9f5c4c2c1ee52e7
I20260923 19:50:02.027261 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet b4fc995819cc40bf9956d85966bcd330 with delete_type TABLET_DATA_DELETED (replaced by tablet efc63a151f6444dfb03c3f15f6f54473) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:02.027473 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_7b49fa59d61b48669d03e8b1c874baf5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:02.027585 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet 6fe14389e2a3487587dfcf7a8b4b242d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:02.027616 6461 ts_tablet_manager.cc:1950] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
W20260923 19:50:02.028083 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b49fa59d61b48669d03e8b1c874baf5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:02.028393 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_f3099aec2da54c33b79ac8261f13f6a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:02.029212 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f3099aec2da54c33b79ac8261f13f6a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:02.029582 5798 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_59963526245d437089bb2a1e5a276493" } modify_external_catalogs: true
I20260923 19:50:02.030121 6461 tablet_replica.cc:333] T e52d78a941a341d186dc00bbe7df96bf P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:02.030103 5798 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_59963526245d437089bb2a1e5a276493" } modify_external_catalogs: true
I20260923 19:50:02.030149 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_a0bee41bcb2d439fb8619a6c19152813"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:02.030318 6461 raft_consensus.cc:2243] T e52d78a941a341d186dc00bbe7df96bf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:02.030494 6461 raft_consensus.cc:2272] T e52d78a941a341d186dc00bbe7df96bf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:02.030632 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a0bee41bcb2d439fb8619a6c19152813 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:02.032021 6461 ts_tablet_manager.cc:1916] T e52d78a941a341d186dc00bbe7df96bf P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:02.029925 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_bbfd70af85d34f29bc8bbd6dbf85023d" } modify_external_catalogs: true
I20260923 19:50:02.032104 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_59faad35003f4e6f95781fbb1895f6aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:02.032308 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_bbfd70af85d34f29bc8bbd6dbf85023d" } modify_external_catalogs: true
W20260923 19:50:02.032723 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_59faad35003f4e6f95781fbb1895f6aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:02.034579 6458 ts_tablet_manager.cc:1950] T c14d36ad1b7241c894dbdff46159000c P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:02.037040 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 52) took 2865 ms. Trace:
I20260923 19:50:02.037810 6454 tablet_bootstrap.cc:492] T 3158b344d1c748aab5004543e4448adb P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:02.038978 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 1a5f682ef2794a1fb9f5c4c2c1ee52e7 (table default.Table_3a938c91580b4d23a2a0fad133090624 [id=767c530f4e214408a45adcb31c9d0f28]) successfully deleted
I20260923 19:50:02.041993 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet e9cbfaa34c924a678f23cbcbf1a6fb0a
I20260923 19:50:02.043021 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet e9cbfaa34c924a678f23cbcbf1a6fb0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:02.043182 6035 tablet_service.cc:1558] Processing DeleteTablet for tablet 77f111a495f3429cb243417824095d02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:02.044185 5800 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a08446fcf1794dab9d3181904507456f has no consensus state
I20260923 19:50:02.044454 6454 tablet_bootstrap.cc:654] T 3158b344d1c748aab5004543e4448adb P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:02.044536 5800 master_service.cc:960] ReplaceTablet: received request to replace tablet 4b15b250f594459eb959b4871f7ae398 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:02.045747 6459 ts_tablet_manager.cc:1929] T 199843bdd7184df58be9a4a06a5ffb8b P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:02.045969 6459 log.cc:1199] T 199843bdd7184df58be9a4a06a5ffb8b P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/199843bdd7184df58be9a4a06a5ffb8b
I20260923 19:50:02.046046 6035 tablet_service.cc:1558] Processing DeleteTablet for tablet e9cbfaa34c924a678f23cbcbf1a6fb0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:02.047147 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_c7b73cad6d7c4835b049256948ad530c" } new_table_name: "default.Table_3034bb02271e459ebedf3424b5f8f908" modify_external_catalogs: true
I20260923 19:50:02.048002 6461 ts_tablet_manager.cc:1929] T e52d78a941a341d186dc00bbe7df96bf P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:02.048990 6461 log.cc:1199] T e52d78a941a341d186dc00bbe7df96bf P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/e52d78a941a341d186dc00bbe7df96bf
I20260923 19:50:02.049544 6461 ts_tablet_manager.cc:1950] T e52d78a941a341d186dc00bbe7df96bf P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:02.050971 6457 ts_tablet_manager.cc:1434] T 77f111a495f3429cb243417824095d02 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.037s user 0.000s sys 0.002s
I20260923 19:50:02.051097 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet e52d78a941a341d186dc00bbe7df96bf (table default.Table_a04bbcc870f94f609935f519709a7d95 [id=ff751c756a0240a18ca02cbb9d44e73d]) successfully deleted
I20260923 19:50:02.051704 6457 tablet_bootstrap.cc:492] T 8db0358af7634911820f99fe16605ca7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:02.052932 6461 tablet_replica.cc:333] T c52da04e5fe0454ea76bf4d99a930fd7 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:02.053160 6461 raft_consensus.cc:2243] T c52da04e5fe0454ea76bf4d99a930fd7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:02.053380 6461 raft_consensus.cc:2272] T c52da04e5fe0454ea76bf4d99a930fd7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:02.054641 6459 ts_tablet_manager.cc:1950] T 199843bdd7184df58be9a4a06a5ffb8b P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:02.055451 6461 ts_tablet_manager.cc:1916] T c52da04e5fe0454ea76bf4d99a930fd7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:02.043946 6315 tablet_service.cc:1558] Processing DeleteTablet for tablet e9cbfaa34c924a678f23cbcbf1a6fb0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:02.056310 6458 rpcz_store.cc:276] 0923 19:49:59.171892 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:49:59.171959 (+ 67us) service_pool.cc:224] Handling call
0923 19:50:01.730784 (+2558825us) ts_tablet_manager.cc:1151] Deleting tablet c14d36ad1b7241c894dbdff46159000c
0923 19:50:01.730800 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:01.917128 (+186328us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x6160000c1f54. stack: 00007fcce587b366 00007fcce587b120 00007fcce488534d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007fccf196fa70 00007fccf2cf8583 00007fccf58c58b7 00007fccf58f8a64 00007fccf58d93a0 00007fccf58d912d 0000000000aaef9c 00007fcce58c188f 00007fcce58c4b8b 00007fcce58c4a08
0923 19:50:01.974986 (+ 57858us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:02.011171 (+ 36185us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:02.036976 (+ 25805us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":415564672,"tablet-delete.queue_time_us":2558521}
I20260923 19:50:02.058907 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet c14d36ad1b7241c894dbdff46159000c (table default.Table_88b60f3e46a743d3913e7a4c0f353a59 [id=56cd81aa3d6f47d388803884b9220810]) successfully deleted
I20260923 19:50:02.059376 6458 tablet_replica.cc:333] T 3158b344d1c748aab5004543e4448adb P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:02.059733 5802 master_service.cc:960] ReplaceTablet: received request to replace tablet 4b15b250f594459eb959b4871f7ae398 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:02.060123 6576 raft_consensus.cc:493] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:02.060313 6576 raft_consensus.cc:515] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.060824 6459 tablet_replica.cc:333] T c817af3eb83a43a3b6d4e9c83a9eefbb P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:02.060993 6576 leader_election.cc:290] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:02.061025 6459 raft_consensus.cc:2243] T c817af3eb83a43a3b6d4e9c83a9eefbb P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:02.061221 6459 raft_consensus.cc:2272] T c817af3eb83a43a3b6d4e9c83a9eefbb P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:02.061739 6459 ts_tablet_manager.cc:1916] T c817af3eb83a43a3b6d4e9c83a9eefbb P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:02.063239 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dbc0e17d77140f6abe9ee26c8ec13ee" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:02.063897 5995 leader_election.cc:343] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:02.064098 6458 raft_consensus.cc:2243] T 3158b344d1c748aab5004543e4448adb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:02.064357 6458 raft_consensus.cc:2272] T 3158b344d1c748aab5004543e4448adb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:02.064558 5801 master_service.cc:960] ReplaceTablet: received request to replace tablet 495292cacf3b42a5b633ad40e5e01972 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:02.064978 6458 ts_tablet_manager.cc:1916] T 3158b344d1c748aab5004543e4448adb P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:02.065128 5803 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 063fc0e77d294ddf8a02e9ab5968a5e3 consensus state has no leader
I20260923 19:50:02.065593 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_3eb6c5fd5fa541a0b2d8215098fbf2f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:02.066299 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3eb6c5fd5fa541a0b2d8215098fbf2f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:02.066380 6454 tablet_bootstrap.cc:492] T 3158b344d1c748aab5004543e4448adb P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:02.066531 6454 ts_tablet_manager.cc:1403] T 3158b344d1c748aab5004543e4448adb P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.004s
I20260923 19:50:02.067238 6454 raft_consensus.cc:359] T 3158b344d1c748aab5004543e4448adb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.067461 6454 raft_consensus.cc:385] T 3158b344d1c748aab5004543e4448adb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:02.067526 6454 raft_consensus.cc:740] T 3158b344d1c748aab5004543e4448adb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:02.067791 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 199843bdd7184df58be9a4a06a5ffb8b (table default.Table_19746277e0c142bd8bfa415a7effbbe0 [id=a09c0c82fcc747babbd555f9aeae4ed9]) successfully deleted
I20260923 19:50:02.067839 6454 consensus_queue.cc:260] T 3158b344d1c748aab5004543e4448adb P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:02.068089 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 64a38bbd3fbd4738a73e78e3f6436fe5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64a38bbd3fbd4738a73e78e3f6436fe5 already in progress: creating tablet
W20260923 19:50:02.068320 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 77f111a495f3429cb243417824095d02 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 77f111a495f3429cb243417824095d02 already in progress: creating tablet
W20260923 19:50:02.068542 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet f2d9f1a0fae849ae8083eba082055fe9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2d9f1a0fae849ae8083eba082055fe9 already in progress: creating tablet
I20260923 19:50:02.063460 6345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dbc0e17d77140f6abe9ee26c8ec13ee" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:02.070956 6461 ts_tablet_manager.cc:1929] T c52da04e5fe0454ea76bf4d99a930fd7 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:02.071061 6456 tablet_bootstrap.cc:492] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:02.071259 6456 ts_tablet_manager.cc:1403] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.098s user 0.000s sys 0.004s
I20260923 19:50:02.071317 6454 ts_tablet_manager.cc:1434] T 3158b344d1c748aab5004543e4448adb P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260923 19:50:02.071686 6461 log.cc:1199] T c52da04e5fe0454ea76bf4d99a930fd7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/c52da04e5fe0454ea76bf4d99a930fd7
I20260923 19:50:02.072682 6456 raft_consensus.cc:359] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.072880 6456 raft_consensus.cc:385] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:02.073196 6456 raft_consensus.cc:740] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:02.073253 6461 ts_tablet_manager.cc:1950] T c52da04e5fe0454ea76bf4d99a930fd7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:02.073539 6456 consensus_queue.cc:260] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.074636 6457 tablet_bootstrap.cc:654] T 8db0358af7634911820f99fe16605ca7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:02.075086 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet c52da04e5fe0454ea76bf4d99a930fd7 (table default.Table_504bdbe9702948d58b4f958360a2040b [id=ca73f0867b5d49cfb0bb7cd2315c47f2]) successfully deleted
I20260923 19:50:02.075356 6456 ts_tablet_manager.cc:1434] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260923 19:50:02.075498 6345 raft_consensus.cc:2468] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 0.
I20260923 19:50:02.075958 5996 leader_election.cc:304] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
W20260923 19:50:02.076021 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet b4fc995819cc40bf9956d85966bcd330 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4fc995819cc40bf9956d85966bcd330 already in progress: creating tablet
I20260923 19:50:02.076464 6576 raft_consensus.cc:2804] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260923 19:50:02.077061 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 6fe14389e2a3487587dfcf7a8b4b242d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6fe14389e2a3487587dfcf7a8b4b242d already in progress: creating tablet
I20260923 19:50:02.077077 6576 raft_consensus.cc:493] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:02.077188 6576 raft_consensus.cc:3060] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:02.077623 6461 tablet_replica.cc:333] T 77f111a495f3429cb243417824095d02 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:02.077807 6461 raft_consensus.cc:2243] T 77f111a495f3429cb243417824095d02 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:02.078009 6461 raft_consensus.cc:2272] T 77f111a495f3429cb243417824095d02 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:02.080268 6454 tablet_bootstrap.cc:492] T 09bb2ab5617a49d99e75191b3b48b85f P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:02.081190 6456 tablet_bootstrap.cc:492] T e1752d6b46894796bdc94e6230e3327d P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:02.081043 6576 raft_consensus.cc:515] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.082397 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dbc0e17d77140f6abe9ee26c8ec13ee" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
W20260923 19:50:02.082912 5995 leader_election.cc:343] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:02.082723 6576 leader_election.cc:290] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:02.083204 6345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dbc0e17d77140f6abe9ee26c8ec13ee" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:02.083460 6345 raft_consensus.cc:3060] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:02.083877 6461 ts_tablet_manager.cc:1916] T 77f111a495f3429cb243417824095d02 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:02.086934 6345 raft_consensus.cc:2468] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 1.
I20260923 19:50:02.089309 6454 tablet_bootstrap.cc:654] T 09bb2ab5617a49d99e75191b3b48b85f P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:02.094715 6461 ts_tablet_manager.cc:1929] T 77f111a495f3429cb243417824095d02 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:02.097345 6461 log.cc:1199] T 77f111a495f3429cb243417824095d02 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/77f111a495f3429cb243417824095d02
I20260923 19:50:02.097994 6461 ts_tablet_manager.cc:1950] T 77f111a495f3429cb243417824095d02 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:02.098935 6459 ts_tablet_manager.cc:1929] T c817af3eb83a43a3b6d4e9c83a9eefbb P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260923 19:50:02.099998 6459 log.cc:1199] T c817af3eb83a43a3b6d4e9c83a9eefbb P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/c817af3eb83a43a3b6d4e9c83a9eefbb
I20260923 19:50:02.099920 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 77f111a495f3429cb243417824095d02 (table default.Table_552860e790be402a91af4ff2e2185d10 [id=e98e62b25556431abdccca23fa9d81e2]) successfully deleted
W20260923 19:50:02.100356 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet e9cbfaa34c924a678f23cbcbf1a6fb0a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9cbfaa34c924a678f23cbcbf1a6fb0a already in progress: creating tablet
I20260923 19:50:02.100605 6459 ts_tablet_manager.cc:1950] T c817af3eb83a43a3b6d4e9c83a9eefbb P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:02.101339 6457 tablet_bootstrap.cc:492] T 8db0358af7634911820f99fe16605ca7 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:02.102141 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet c817af3eb83a43a3b6d4e9c83a9eefbb (table default.Table_30f4ccabe7fa4c8ba92e008f3d9b2d80 [id=b9b7fe147b8645389ebef237fa735b2b]) successfully deleted
I20260923 19:50:02.102283 5996 leader_election.cc:304] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:02.102692 6576 raft_consensus.cc:2804] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election won for term 1
W20260923 19:50:02.103662 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 3190d18f00234d71b0a58c2c334ef45f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3190d18f00234d71b0a58c2c334ef45f already in progress: creating tablet
I20260923 19:50:02.104472 6454 tablet_bootstrap.cc:492] T 09bb2ab5617a49d99e75191b3b48b85f P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:02.104663 6454 ts_tablet_manager.cc:1403] T 09bb2ab5617a49d99e75191b3b48b85f P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.001s
I20260923 19:50:02.091970 6456 tablet_bootstrap.cc:654] T e1752d6b46894796bdc94e6230e3327d P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:02.105754 6454 raft_consensus.cc:359] T 09bb2ab5617a49d99e75191b3b48b85f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.105991 6454 raft_consensus.cc:385] T 09bb2ab5617a49d99e75191b3b48b85f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:02.106120 6454 raft_consensus.cc:740] T 09bb2ab5617a49d99e75191b3b48b85f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:02.106413 6454 consensus_queue.cc:260] T 09bb2ab5617a49d99e75191b3b48b85f P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.102104 6457 ts_tablet_manager.cc:1403] T 8db0358af7634911820f99fe16605ca7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.050s user 0.003s sys 0.004s
I20260923 19:50:02.107652 6457 raft_consensus.cc:359] T 8db0358af7634911820f99fe16605ca7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.108830 6457 raft_consensus.cc:385] T 8db0358af7634911820f99fe16605ca7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:02.109066 6457 raft_consensus.cc:740] T 8db0358af7634911820f99fe16605ca7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:02.110045 6454 ts_tablet_manager.cc:1434] T 09bb2ab5617a49d99e75191b3b48b85f P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260923 19:50:02.109540 6457 consensus_queue.cc:260] T 8db0358af7634911820f99fe16605ca7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.113317 6454 tablet_bootstrap.cc:492] T 0cdb778f87fa40b89dad97d166192a1e P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
W20260923 19:50:02.114472 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 789c54477bec4636bb3669e1f62730e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 789c54477bec4636bb3669e1f62730e2 already in progress: creating tablet
I20260923 19:50:02.114755 5797 catalog_manager.cc:5838] T 259e4faa58f549699538317019be5daf P 61022dd7f2f14dc19aebe3af5f08f430 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194). New cstate: current_term: 1 leader_uuid: "61022dd7f2f14dc19aebe3af5f08f430" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: UNKNOWN } } }
I20260923 19:50:02.116000 6454 tablet_bootstrap.cc:654] T 0cdb778f87fa40b89dad97d166192a1e P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:02.117717 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet f108ebdaecab42e7b57057c7ecfbe690 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f108ebdaecab42e7b57057c7ecfbe690 already in progress: creating tablet
W20260923 19:50:02.118937 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 5c0142f4e3ad42048803481d68f0ee5d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c0142f4e3ad42048803481d68f0ee5d already in progress: creating tablet
W20260923 19:50:02.119658 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 9101e82501fd461f8a4b2dcd9dffbd74 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9101e82501fd461f8a4b2dcd9dffbd74 already in progress: creating tablet
I20260923 19:50:02.121168 6315 tablet_service.cc:1511] Processing CreateTablet for tablet 3919b15a00eb4fb08008f065f556c760 (DEFAULT_TABLE table=default.Table_9a02c99394944c41a1e4da7ce679e401 [id=8325a8f159124a2da260e2be3ce69500]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.121624 6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3919b15a00eb4fb08008f065f556c760. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:02.121778 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 015c14b447fe4cd18d197b2d1ed5884e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 015c14b447fe4cd18d197b2d1ed5884e already in progress: creating tablet
W20260923 19:50:02.122385 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 623fb5b761134951a4b742ab2ba480a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 623fb5b761134951a4b742ab2ba480a4 already in progress: creating tablet
W20260923 19:50:02.122987 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet b4fc995819cc40bf9956d85966bcd330 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4fc995819cc40bf9956d85966bcd330 already in progress: creating tablet
I20260923 19:50:02.120415 6182 tablet_service.cc:1511] Processing CreateTablet for tablet 3919b15a00eb4fb08008f065f556c760 (DEFAULT_TABLE table=default.Table_9a02c99394944c41a1e4da7ce679e401 [id=8325a8f159124a2da260e2be3ce69500]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.123423 6182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3919b15a00eb4fb08008f065f556c760. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.124231 6035 tablet_service.cc:1511] Processing CreateTablet for tablet 3919b15a00eb4fb08008f065f556c760 (DEFAULT_TABLE table=default.Table_9a02c99394944c41a1e4da7ce679e401 [id=8325a8f159124a2da260e2be3ce69500]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.124629 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3919b15a00eb4fb08008f065f556c760. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.124683 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 033c2d772c8a44d2a0e671664bb9085d
I20260923 19:50:02.125735 6314 tablet_service.cc:1558] Processing DeleteTablet for tablet 033c2d772c8a44d2a0e671664bb9085d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:02.126351 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet 033c2d772c8a44d2a0e671664bb9085d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:02.127699 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet 033c2d772c8a44d2a0e671664bb9085d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:02.129108 6576 raft_consensus.cc:697] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Becoming Leader. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Running, Role: LEADER
I20260923 19:50:02.129513 6576 consensus_queue.cc:237] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:02.130390 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 033c2d772c8a44d2a0e671664bb9085d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 033c2d772c8a44d2a0e671664bb9085d already in progress: creating tablet
I20260923 19:50:02.132949 6174 tablet_service.cc:1511] Processing CreateTablet for tablet fe5d081a41a3417b855656ca6e24f235 (DEFAULT_TABLE table=default.Table_df1bcb6c01a64dcebb3ce9b719acd5db [id=b4a404dd8b1b4bd1971ec4ae180bff02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.133365 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe5d081a41a3417b855656ca6e24f235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.134636 5801 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 495292cacf3b42a5b633ad40e5e01972
I20260923 19:50:02.135375 5801 catalog_manager.cc:6934] ReplaceTablet: tablet 495292cacf3b42a5b633ad40e5e01972 deleted and replaced by tablet 6a2564a99c274e07a7e43da739a2458b
I20260923 19:50:02.136094 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 2ccfe6531fc44f86a0edc8bda1547442
I20260923 19:50:02.136505 6314 tablet_service.cc:1511] Processing CreateTablet for tablet fe5d081a41a3417b855656ca6e24f235 (DEFAULT_TABLE table=default.Table_df1bcb6c01a64dcebb3ce9b719acd5db [id=b4a404dd8b1b4bd1971ec4ae180bff02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.136878 6456 tablet_bootstrap.cc:492] T e1752d6b46894796bdc94e6230e3327d P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:02.136920 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe5d081a41a3417b855656ca6e24f235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.137039 6456 ts_tablet_manager.cc:1403] T e1752d6b46894796bdc94e6230e3327d P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.056s user 0.000s sys 0.003s
I20260923 19:50:02.137785 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ccfe6531fc44f86a0edc8bda1547442 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:02.138026 6456 raft_consensus.cc:359] T e1752d6b46894796bdc94e6230e3327d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.138307 6456 raft_consensus.cc:385] T e1752d6b46894796bdc94e6230e3327d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:02.138423 6456 raft_consensus.cc:740] T e1752d6b46894796bdc94e6230e3327d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:02.139745 6456 consensus_queue.cc:260] T e1752d6b46894796bdc94e6230e3327d P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.140084 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ccfe6531fc44f86a0edc8bda1547442 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:02.140080 6035 tablet_service.cc:1558] Processing DeleteTablet for tablet 495292cacf3b42a5b633ad40e5e01972 with delete_type TABLET_DATA_DELETED (replaced by tablet 6a2564a99c274e07a7e43da739a2458b) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:02.140962 5790 catalog_manager.cc:5030] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 2ccfe6531fc44f86a0edc8bda1547442 because the tablet was not found. No further retry: Not found: Tablet not found: 2ccfe6531fc44f86a0edc8bda1547442
W20260923 19:50:02.141302 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 495292cacf3b42a5b633ad40e5e01972 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 495292cacf3b42a5b633ad40e5e01972 already in progress: creating tablet
I20260923 19:50:02.141894 6037 tablet_service.cc:1511] Processing CreateTablet for tablet fe5d081a41a3417b855656ca6e24f235 (DEFAULT_TABLE table=default.Table_df1bcb6c01a64dcebb3ce9b719acd5db [id=b4a404dd8b1b4bd1971ec4ae180bff02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.142380 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe5d081a41a3417b855656ca6e24f235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.147727 5800 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 4b15b250f594459eb959b4871f7ae398
I20260923 19:50:02.148217 5800 catalog_manager.cc:6934] ReplaceTablet: tablet 4b15b250f594459eb959b4871f7ae398 deleted and replaced by tablet c19298691d5d4209b2d1147a1aad2f6f
I20260923 19:50:02.148196 6456 ts_tablet_manager.cc:1434] T e1752d6b46894796bdc94e6230e3327d P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.011s user 0.000s sys 0.002s
I20260923 19:50:02.149063 6035 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b15b250f594459eb959b4871f7ae398 with delete_type TABLET_DATA_DELETED (replaced by tablet c19298691d5d4209b2d1147a1aad2f6f) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:02.135830 6315 tablet_service.cc:1558] Processing DeleteTablet for tablet 495292cacf3b42a5b633ad40e5e01972 with delete_type TABLET_DATA_DELETED (replaced by tablet 6a2564a99c274e07a7e43da739a2458b) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:02.150708 6315 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b15b250f594459eb959b4871f7ae398 with delete_type TABLET_DATA_DELETED (replaced by tablet c19298691d5d4209b2d1147a1aad2f6f) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:02.151383 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 4b15b250f594459eb959b4871f7ae398 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b15b250f594459eb959b4871f7ae398 already in progress: creating tablet
W20260923 19:50:02.154162 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 6fe14389e2a3487587dfcf7a8b4b242d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6fe14389e2a3487587dfcf7a8b4b242d already in progress: creating tablet
I20260923 19:50:02.156231 6456 tablet_bootstrap.cc:492] T 640a98d3a845461e8d4f07041ab515c7 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:02.159317 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b15b250f594459eb959b4871f7ae398 with delete_type TABLET_DATA_DELETED (replaced by tablet c19298691d5d4209b2d1147a1aad2f6f) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:02.159343 6035 tablet_service.cc:1511] Processing CreateTablet for tablet b985acc650334497832cf4505e1b0043 (DEFAULT_TABLE table=default.Table_0291d1f518d445cda50f5b95a4aee646 [id=4dd6a10e3a9f465f816cc39c3a122468]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.159802 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b985acc650334497832cf4505e1b0043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.160090 6173 tablet_service.cc:1511] Processing CreateTablet for tablet 0d70deeda179486291195476e47a9ae6 (DEFAULT_TABLE table=default.Table_809bfd3727c8499980a5a1fa9b42b948 [id=d1e262e6e34742538b2b26c5fae80a99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.159317 6182 tablet_service.cc:1558] Processing DeleteTablet for tablet 495292cacf3b42a5b633ad40e5e01972 with delete_type TABLET_DATA_DELETED (replaced by tablet 6a2564a99c274e07a7e43da739a2458b) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:02.161628 6315 tablet_service.cc:1511] Processing CreateTablet for tablet b985acc650334497832cf4505e1b0043 (DEFAULT_TABLE table=default.Table_0291d1f518d445cda50f5b95a4aee646 [id=4dd6a10e3a9f465f816cc39c3a122468]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.162038 6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b985acc650334497832cf4505e1b0043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.162305 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 259e4faa58f549699538317019be5daf
I20260923 19:50:02.162470 6458 ts_tablet_manager.cc:1929] T 3158b344d1c748aab5004543e4448adb P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:02.162600 6458 log.cc:1199] T 3158b344d1c748aab5004543e4448adb P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/3158b344d1c748aab5004543e4448adb
I20260923 19:50:02.162962 6458 ts_tablet_manager.cc:1950] T 3158b344d1c748aab5004543e4448adb P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:02.166028 6314 tablet_service.cc:1558] Processing DeleteTablet for tablet 259e4faa58f549699538317019be5daf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:02.166844 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_ab743ed22da14340a2986998869db477"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:02.166951 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ccfe6531fc44f86a0edc8bda1547442 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:02.167444 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab743ed22da14340a2986998869db477 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:02.168817 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet e9cbfaa34c924a678f23cbcbf1a6fb0a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9cbfaa34c924a678f23cbcbf1a6fb0a already in progress: creating tablet
I20260923 19:50:02.169236 6179 tablet_service.cc:1511] Processing CreateTablet for tablet b985acc650334497832cf4505e1b0043 (DEFAULT_TABLE table=default.Table_0291d1f518d445cda50f5b95a4aee646 [id=4dd6a10e3a9f465f816cc39c3a122468]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.170799 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d70deeda179486291195476e47a9ae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.172819 6456 tablet_bootstrap.cc:654] T 640a98d3a845461e8d4f07041ab515c7 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:02.172878 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b985acc650334497832cf4505e1b0043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.173429 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 63) took 2715 ms. Trace:
I20260923 19:50:02.174531 6458 rpcz_store.cc:276] 0923 19:49:59.458296 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:49:59.458372 (+ 76us) service_pool.cc:224] Handling call
0923 19:50:02.059284 (+2600912us) ts_tablet_manager.cc:1151] Deleting tablet 3158b344d1c748aab5004543e4448adb
0923 19:50:02.059294 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:02.094736 (+ 35442us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:02.162386 (+ 67650us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:02.173391 (+ 11005us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2600640}
I20260923 19:50:02.175770 6458 tablet_replica.cc:333] T e655ab5873294e75a242709f069aabf2 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:02.176205 6316 tablet_service.cc:1511] Processing CreateTablet for tablet 15c0dc02ba964af38ca9f76161722588 (DEFAULT_TABLE table=default.Table_7920d992d8e64e6386e9d47abb996a6b [id=647997210f5349a68aa98d24e12a33cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.176260 6324 tablet_service.cc:1511] Processing CreateTablet for tablet e071b9dd1db44af0a9d1b9e904f875a5 (DEFAULT_TABLE table=default.Table_65616076f4a1461e9b5798cd7d8a089e [id=8b14917d9dc6415dbb75917bccf09502]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.176590 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 194494af2c424a55a772f3858af63c2c (DEFAULT_TABLE table=default.Table_41c2e67e9c7e4fa192fc124e05c2d34f [id=b5209bbe29cb42e6b2473caddc119f44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.176615 6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15c0dc02ba964af38ca9f76161722588. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.177419 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 194494af2c424a55a772f3858af63c2c (DEFAULT_TABLE table=default.Table_41c2e67e9c7e4fa192fc124e05c2d34f [id=b5209bbe29cb42e6b2473caddc119f44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.177785 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 194494af2c424a55a772f3858af63c2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.178758 6035 tablet_service.cc:1511] Processing CreateTablet for tablet 0d70deeda179486291195476e47a9ae6 (DEFAULT_TABLE table=default.Table_809bfd3727c8499980a5a1fa9b42b948 [id=d1e262e6e34742538b2b26c5fae80a99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.179591 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d70deeda179486291195476e47a9ae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.179730 6039 tablet_service.cc:1511] Processing CreateTablet for tablet 15c0dc02ba964af38ca9f76161722588 (DEFAULT_TABLE table=default.Table_7920d992d8e64e6386e9d47abb996a6b [id=647997210f5349a68aa98d24e12a33cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.180063 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15c0dc02ba964af38ca9f76161722588. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.181532 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e071b9dd1db44af0a9d1b9e904f875a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.183744 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 15c0dc02ba964af38ca9f76161722588 (DEFAULT_TABLE table=default.Table_7920d992d8e64e6386e9d47abb996a6b [id=647997210f5349a68aa98d24e12a33cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.184123 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15c0dc02ba964af38ca9f76161722588. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.185143 6032 tablet_service.cc:1511] Processing CreateTablet for tablet 194494af2c424a55a772f3858af63c2c (DEFAULT_TABLE table=default.Table_41c2e67e9c7e4fa192fc124e05c2d34f [id=b5209bbe29cb42e6b2473caddc119f44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.185384 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 194494af2c424a55a772f3858af63c2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.185541 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 194494af2c424a55a772f3858af63c2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.186614 6031 tablet_service.cc:1511] Processing CreateTablet for tablet e071b9dd1db44af0a9d1b9e904f875a5 (DEFAULT_TABLE table=default.Table_65616076f4a1461e9b5798cd7d8a089e [id=8b14917d9dc6415dbb75917bccf09502]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.186971 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e071b9dd1db44af0a9d1b9e904f875a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.189716 6176 tablet_service.cc:1511] Processing CreateTablet for tablet a08446fcf1794dab9d3181904507456f (DEFAULT_TABLE table=default.Table_e1b933d20310499aab93b720704ea8d0 [id=c348e030b47641e7a407e9c2903215d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.190887 6168 tablet_service.cc:1558] Processing DeleteTablet for tablet e655ab5873294e75a242709f069aabf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:02.192250 6167 tablet_service.cc:1511] Processing CreateTablet for tablet e071b9dd1db44af0a9d1b9e904f875a5 (DEFAULT_TABLE table=default.Table_65616076f4a1461e9b5798cd7d8a089e [id=8b14917d9dc6415dbb75917bccf09502]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.192579 6172 tablet_service.cc:1558] Processing DeleteTablet for tablet 09bb2ab5617a49d99e75191b3b48b85f with delete_type TABLET_DATA_DELETED (replaced by tablet d70b7662d85a4f64a11420448c4d140d) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:02.191118 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet 3158b344d1c748aab5004543e4448adb with delete_type TABLET_DATA_DELETED (replaced by tablet 640a98d3a845461e8d4f07041ab515c7) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:02.194638 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_d824a438d0804f58b8b89f6f0f0f964e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:02.195449 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d824a438d0804f58b8b89f6f0f0f964e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:02.197350 6176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a08446fcf1794dab9d3181904507456f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.198287 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e071b9dd1db44af0a9d1b9e904f875a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.200383 6458 raft_consensus.cc:2243] T e655ab5873294e75a242709f069aabf2 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:02.200644 6458 raft_consensus.cc:2272] T e655ab5873294e75a242709f069aabf2 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:02.204399 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_0b41cc085cff4695b3729e5b2ec8bbbb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:02.204592 5802 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d94eaba070fd454bb85f8ef139ba0a28" } new_table_name: "default.Table_bd91264aa4a0430eb1a8f69129fb0f3f" modify_external_catalogs: true
W20260923 19:50:02.205163 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0b41cc085cff4695b3729e5b2ec8bbbb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:02.205938 6458 ts_tablet_manager.cc:1916] T e655ab5873294e75a242709f069aabf2 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:02.209977 6316 tablet_service.cc:1511] Processing CreateTablet for tablet a08446fcf1794dab9d3181904507456f (DEFAULT_TABLE table=default.Table_e1b933d20310499aab93b720704ea8d0 [id=c348e030b47641e7a407e9c2903215d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.210475 6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a08446fcf1794dab9d3181904507456f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.201006 6314 tablet_service.cc:1511] Processing CreateTablet for tablet 0d70deeda179486291195476e47a9ae6 (DEFAULT_TABLE table=default.Table_809bfd3727c8499980a5a1fa9b42b948 [id=d1e262e6e34742538b2b26c5fae80a99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.213533 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d70deeda179486291195476e47a9ae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.215378 6039 tablet_service.cc:1511] Processing CreateTablet for tablet a08446fcf1794dab9d3181904507456f (DEFAULT_TABLE table=default.Table_e1b933d20310499aab93b720704ea8d0 [id=c348e030b47641e7a407e9c2903215d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.215997 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a08446fcf1794dab9d3181904507456f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.219952 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet 259e4faa58f549699538317019be5daf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:02.219851 6324 tablet_service.cc:1511] Processing CreateTablet for tablet 2db82e6f314f412385b41720c7efdef5 (DEFAULT_TABLE table=default.Table_4e7f76686b274699817f861e70ce98aa [id=6d79e588fb9e4936aedf8cd500f68d60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.220350 6461 tablet_replica.cc:333] T 259e4faa58f549699538317019be5daf P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:02.220460 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2db82e6f314f412385b41720c7efdef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.220582 6461 raft_consensus.cc:2243] T 259e4faa58f549699538317019be5daf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:02.220757 6461 raft_consensus.cc:2272] T 259e4faa58f549699538317019be5daf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:02.221345 6461 ts_tablet_manager.cc:1916] T 259e4faa58f549699538317019be5daf P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:02.222131 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 2db82e6f314f412385b41720c7efdef5 (DEFAULT_TABLE table=default.Table_4e7f76686b274699817f861e70ce98aa [id=6d79e588fb9e4936aedf8cd500f68d60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.223639 6164 tablet_service.cc:1511] Processing CreateTablet for tablet 2db82e6f314f412385b41720c7efdef5 (DEFAULT_TABLE table=default.Table_4e7f76686b274699817f861e70ce98aa [id=6d79e588fb9e4936aedf8cd500f68d60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.224037 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2db82e6f314f412385b41720c7efdef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.229117 5797 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b28fac33a5bd4feea5ac2c04b2bcecc4" } modify_external_catalogs: true
I20260923 19:50:02.229475 5797 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b28fac33a5bd4feea5ac2c04b2bcecc4" } modify_external_catalogs: true
I20260923 19:50:02.231709 5798 master_service.cc:960] ReplaceTablet: received request to replace tablet 3158b344d1c748aab5004543e4448adb from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:02.232195 6646 raft_consensus.cc:493] T 3158b344d1c748aab5004543e4448adb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:02.232360 6646 raft_consensus.cc:515] T 3158b344d1c748aab5004543e4448adb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.234745 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2db82e6f314f412385b41720c7efdef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.235023 6182 tablet_service.cc:1558] Processing DeleteTablet for tablet 259e4faa58f549699538317019be5daf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:02.235203 6646 leader_election.cc:290] T 3158b344d1c748aab5004543e4448adb P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:02.236024 6139 leader_election.cc:343] T 3158b344d1c748aab5004543e4448adb P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 3158b344d1c748aab5004543e4448adb
W20260923 19:50:02.236263 6137 leader_election.cc:343] T 3158b344d1c748aab5004543e4448adb P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 3158b344d1c748aab5004543e4448adb
I20260923 19:50:02.236861 6456 tablet_bootstrap.cc:492] T 640a98d3a845461e8d4f07041ab515c7 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:02.237056 6456 ts_tablet_manager.cc:1403] T 640a98d3a845461e8d4f07041ab515c7 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.081s user 0.002s sys 0.002s
I20260923 19:50:02.237368 6137 leader_election.cc:304] T 3158b344d1c748aab5004543e4448adb P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:02.237803 6646 raft_consensus.cc:2749] T 3158b344d1c748aab5004543e4448adb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:02.237931 6456 raft_consensus.cc:359] T 640a98d3a845461e8d4f07041ab515c7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.238166 6456 raft_consensus.cc:385] T 640a98d3a845461e8d4f07041ab515c7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:02.238297 6456 raft_consensus.cc:740] T 640a98d3a845461e8d4f07041ab515c7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:02.238608 6456 consensus_queue.cc:260] T 640a98d3a845461e8d4f07041ab515c7 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.242542 6643 raft_consensus.cc:493] T e1752d6b46894796bdc94e6230e3327d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:02.242679 6643 raft_consensus.cc:515] T e1752d6b46894796bdc94e6230e3327d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.243306 6643 leader_election.cc:290] T e1752d6b46894796bdc94e6230e3327d P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:02.243999 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1752d6b46894796bdc94e6230e3327d" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:02.244290 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1752d6b46894796bdc94e6230e3327d" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:02.244613 6279 leader_election.cc:343] T e1752d6b46894796bdc94e6230e3327d P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:02.245362 6456 ts_tablet_manager.cc:1434] T 640a98d3a845461e8d4f07041ab515c7 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260923 19:50:02.245606 6461 ts_tablet_manager.cc:1929] T 259e4faa58f549699538317019be5daf P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:02.245869 6461 log.cc:1199] T 259e4faa58f549699538317019be5daf P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/259e4faa58f549699538317019be5daf
W20260923 19:50:02.246166 6280 leader_election.cc:343] T e1752d6b46894796bdc94e6230e3327d P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:02.246315 6280 leader_election.cc:304] T e1752d6b46894796bdc94e6230e3327d P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:02.246529 6461 ts_tablet_manager.cc:1950] T 259e4faa58f549699538317019be5daf P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:02.247071 6643 raft_consensus.cc:2749] T e1752d6b46894796bdc94e6230e3327d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:02.249133 6456 tablet_bootstrap.cc:492] T a10110f4a2b34b61a4cc586d65981606 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:02.249164 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_2d93c35dfe11401d8c780bda7643cb4f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:02.249295 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_4de2183ac1874f7eaf33c6ad5093c02d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:02.249779 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d93c35dfe11401d8c780bda7643cb4f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:02.250326 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4de2183ac1874f7eaf33c6ad5093c02d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:02.251505 6456 tablet_bootstrap.cc:654] T a10110f4a2b34b61a4cc586d65981606 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:02.252425 5804 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_87a4a0bf78434d8b84d7d1f0f1795fa4" } new_table_name: "default.Table_fcbdddfc239041ae96611a78df2b3303" modify_external_catalogs: true
I20260923 19:50:02.254587 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_4e7f76686b274699817f861e70ce98aa" } new_table_name: "default.Table_cabcb31bab8e4f7fa1442bf693674afa" modify_external_catalogs: true
I20260923 19:50:02.255960 6178 tablet_service.cc:1511] Processing CreateTablet for tablet f1a4bccf6dd2411f83b86d782ecf5f40 (DEFAULT_TABLE table=default.Table_87a4a0bf78434d8b84d7d1f0f1795fa4 [id=24fd12b0465443c58bca97fcfea1f1d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.256359 5799 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_4611fd8972c94dfdbbaf669673dbd540" } modify_external_catalogs: true
I20260923 19:50:02.256542 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7d32a5cfd4df4d989e7a55f600da00fd" } new_table_name: "default.Table_c67ffb2902d446cba5c75e4a3d46d559" modify_external_catalogs: true
I20260923 19:50:02.256924 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a4bccf6dd2411f83b86d782ecf5f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.256565 5799 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_4611fd8972c94dfdbbaf669673dbd540" } modify_external_catalogs: true
I20260923 19:50:02.260973 6031 tablet_service.cc:1511] Processing CreateTablet for tablet f1a4bccf6dd2411f83b86d782ecf5f40 (DEFAULT_TABLE table=default.Table_87a4a0bf78434d8b84d7d1f0f1795fa4 [id=24fd12b0465443c58bca97fcfea1f1d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.261337 6182 tablet_service.cc:1511] Processing CreateTablet for tablet 623052a8c9c2436a828655da6cf6d379 (DEFAULT_TABLE table=default.Table_5365e890b976423aa339a9b5e8c8db7e [id=c815692bfbde445ea9c331e95615a751]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.261619 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a4bccf6dd2411f83b86d782ecf5f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.266193 6324 tablet_service.cc:1511] Processing CreateTablet for tablet f1a4bccf6dd2411f83b86d782ecf5f40 (DEFAULT_TABLE table=default.Table_87a4a0bf78434d8b84d7d1f0f1795fa4 [id=24fd12b0465443c58bca97fcfea1f1d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.266764 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a4bccf6dd2411f83b86d782ecf5f40. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:02.267844 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 033c2d772c8a44d2a0e671664bb9085d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 033c2d772c8a44d2a0e671664bb9085d already in progress: creating tablet
I20260923 19:50:02.271576 6457 ts_tablet_manager.cc:1434] T 8db0358af7634911820f99fe16605ca7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.165s user 0.000s sys 0.003s
I20260923 19:50:02.273404 6457 tablet_bootstrap.cc:492] T 87afbdb11c6e4e58affd2f2d7995e1f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:02.273595 6316 tablet_service.cc:1511] Processing CreateTablet for tablet 623052a8c9c2436a828655da6cf6d379 (DEFAULT_TABLE table=default.Table_5365e890b976423aa339a9b5e8c8db7e [id=c815692bfbde445ea9c331e95615a751]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:02.275542 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 4b15b250f594459eb959b4871f7ae398 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b15b250f594459eb959b4871f7ae398 already in progress: creating tablet
I20260923 19:50:02.279438 6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 623052a8c9c2436a828655da6cf6d379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.279435 6182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 623052a8c9c2436a828655da6cf6d379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.278988 6314 tablet_service.cc:1511] Processing CreateTablet for tablet 1c26a2863fdd4912b6d357877af1eb42 (DEFAULT_TABLE table=default.Table_53ff161409a94c28a2d7f0a67a6eb839 [id=b3a6838530c74581b0b5afbca24f80ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.282253 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c26a2863fdd4912b6d357877af1eb42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.282958 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 259e4faa58f549699538317019be5daf (table default.Table_59963526245d437089bb2a1e5a276493 [id=15b32ad6fb42473abddb1188aa861441]) successfully deleted
I20260923 19:50:02.284390 6035 tablet_service.cc:1511] Processing CreateTablet for tablet 623052a8c9c2436a828655da6cf6d379 (DEFAULT_TABLE table=default.Table_5365e890b976423aa339a9b5e8c8db7e [id=c815692bfbde445ea9c331e95615a751]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.284866 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 623052a8c9c2436a828655da6cf6d379. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:02.285903 5802 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5adadf8caf5e4a9ab1107d0fb6a91735 consensus state has no leader
I20260923 19:50:02.285951 6164 tablet_service.cc:1511] Processing CreateTablet for tablet 1c26a2863fdd4912b6d357877af1eb42 (DEFAULT_TABLE table=default.Table_53ff161409a94c28a2d7f0a67a6eb839 [id=b3a6838530c74581b0b5afbca24f80ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.286316 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c26a2863fdd4912b6d357877af1eb42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.286329 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_0fd85280951f4a8586bf9aae46daa067"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:02.286836 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0fd85280951f4a8586bf9aae46daa067 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:02.287828 6311 tablet_service.cc:1511] Processing CreateTablet for tablet cd02244c52ad4d2ab3915108a92a6f97 (DEFAULT_TABLE table=default.Table_bc20a658edaf42818fb401723f10f95f [id=a36a23e5497a47e19f09ec8627152b1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.288164 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd02244c52ad4d2ab3915108a92a6f97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.288344 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_0562db93b14243108d8731231ae538c1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:02.288815 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0562db93b14243108d8731231ae538c1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:02.290112 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 495292cacf3b42a5b633ad40e5e01972 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 495292cacf3b42a5b633ad40e5e01972 already in progress: creating tablet
I20260923 19:50:02.300747 6035 tablet_service.cc:1511] Processing CreateTablet for tablet 1c26a2863fdd4912b6d357877af1eb42 (DEFAULT_TABLE table=default.Table_53ff161409a94c28a2d7f0a67a6eb839 [id=b3a6838530c74581b0b5afbca24f80ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.301220 6176 tablet_service.cc:1511] Processing CreateTablet for tablet cd02244c52ad4d2ab3915108a92a6f97 (DEFAULT_TABLE table=default.Table_bc20a658edaf42818fb401723f10f95f [id=a36a23e5497a47e19f09ec8627152b1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.301491 6032 tablet_service.cc:1511] Processing CreateTablet for tablet cd02244c52ad4d2ab3915108a92a6f97 (DEFAULT_TABLE table=default.Table_bc20a658edaf42818fb401723f10f95f [id=a36a23e5497a47e19f09ec8627152b1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.301970 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c26a2863fdd4912b6d357877af1eb42. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:02.302186 5791 catalog_manager.cc:5030] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 2ccfe6531fc44f86a0edc8bda1547442 because the tablet was not found. No further retry: Not found: Tablet not found: 2ccfe6531fc44f86a0edc8bda1547442
I20260923 19:50:02.302341 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd02244c52ad4d2ab3915108a92a6f97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.302796 6457 tablet_bootstrap.cc:654] T 87afbdb11c6e4e58affd2f2d7995e1f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:02.306339 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 235b4b8081ad4a13937a7941344dbc33 (DEFAULT_TABLE table=default.Table_1a5602208673400faf5f272297ff82b9 [id=a7241c5e33894e8c97e723b3b90b8cc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.306725 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 235b4b8081ad4a13937a7941344dbc33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.308805 6643 raft_consensus.cc:493] T 9ed630e738c54ed38b9933f95fb552c5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:02.308959 6643 raft_consensus.cc:515] T 9ed630e738c54ed38b9933f95fb552c5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.309618 6643 leader_election.cc:290] T 9ed630e738c54ed38b9933f95fb552c5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:02.309998 6458 ts_tablet_manager.cc:1929] T e655ab5873294e75a242709f069aabf2 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:02.310177 6458 log.cc:1199] T e655ab5873294e75a242709f069aabf2 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/e655ab5873294e75a242709f069aabf2
I20260923 19:50:02.310611 6458 ts_tablet_manager.cc:1950] T e655ab5873294e75a242709f069aabf2 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:02.310774 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ed630e738c54ed38b9933f95fb552c5" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
W20260923 19:50:02.311324 6279 leader_election.cc:343] T 9ed630e738c54ed38b9933f95fb552c5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:02.314774 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7920d992d8e64e6386e9d47abb996a6b" } new_table_name: "default.Table_ab0854f0eab74c5da576ed87dc003ad8" modify_external_catalogs: true
I20260923 19:50:02.315455 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 2ccfe6531fc44f86a0edc8bda1547442 (DEFAULT_TABLE table=default.Table_bbfd70af85d34f29bc8bbd6dbf85023d [id=d21707fbdafa4fb4a14990578cc7ab56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.315836 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ccfe6531fc44f86a0edc8bda1547442. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.316480 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 31b0bdf719554d37993a802831e324ee
I20260923 19:50:02.317400 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_a1e299fcb1ab48a58822c77a8a198c90"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:02.318128 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1e299fcb1ab48a58822c77a8a198c90 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:02.319878 6319 tablet_service.cc:1558] Processing DeleteTablet for tablet 31b0bdf719554d37993a802831e324ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:02.320883 6456 tablet_bootstrap.cc:492] T a10110f4a2b34b61a4cc586d65981606 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:02.320896 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_1587e5e79036480bbea0019663e71ef4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:02.321110 6456 ts_tablet_manager.cc:1403] T a10110f4a2b34b61a4cc586d65981606 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.072s user 0.001s sys 0.003s
W20260923 19:50:02.321622 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1587e5e79036480bbea0019663e71ef4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:02.322129 6456 raft_consensus.cc:359] T a10110f4a2b34b61a4cc586d65981606 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.322402 6456 raft_consensus.cc:385] T a10110f4a2b34b61a4cc586d65981606 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:02.322520 6456 raft_consensus.cc:740] T a10110f4a2b34b61a4cc586d65981606 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:02.322834 6456 consensus_queue.cc:260] T a10110f4a2b34b61a4cc586d65981606 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.326733 6456 ts_tablet_manager.cc:1434] T a10110f4a2b34b61a4cc586d65981606 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260923 19:50:02.326773 6179 tablet_service.cc:1511] Processing CreateTablet for tablet 2ccfe6531fc44f86a0edc8bda1547442 (DEFAULT_TABLE table=default.Table_bbfd70af85d34f29bc8bbd6dbf85023d [id=d21707fbdafa4fb4a14990578cc7ab56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.329187 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet 31b0bdf719554d37993a802831e324ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:02.329329 6176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd02244c52ad4d2ab3915108a92a6f97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.329087 6035 tablet_service.cc:1511] Processing CreateTablet for tablet 2ccfe6531fc44f86a0edc8bda1547442 (DEFAULT_TABLE table=default.Table_bbfd70af85d34f29bc8bbd6dbf85023d [id=d21707fbdafa4fb4a14990578cc7ab56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.330111 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ccfe6531fc44f86a0edc8bda1547442. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.332077 6039 tablet_service.cc:1511] Processing CreateTablet for tablet 235b4b8081ad4a13937a7941344dbc33 (DEFAULT_TABLE table=default.Table_1a5602208673400faf5f272297ff82b9 [id=a7241c5e33894e8c97e723b3b90b8cc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.332459 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 235b4b8081ad4a13937a7941344dbc33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.335047 6456 tablet_bootstrap.cc:492] T a1e8b8e638ec438a86f05fa147cdb27c P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:02.335932 6457 tablet_bootstrap.cc:492] T 87afbdb11c6e4e58affd2f2d7995e1f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:02.336129 6457 ts_tablet_manager.cc:1403] T 87afbdb11c6e4e58affd2f2d7995e1f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.063s user 0.004s sys 0.000s
I20260923 19:50:02.336619 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ed630e738c54ed38b9933f95fb552c5" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:02.337182 6456 tablet_bootstrap.cc:654] T a1e8b8e638ec438a86f05fa147cdb27c P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:02.337275 6457 raft_consensus.cc:359] T 87afbdb11c6e4e58affd2f2d7995e1f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:02.337539 6280 leader_election.cc:343] T 9ed630e738c54ed38b9933f95fb552c5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:02.337571 6457 raft_consensus.cc:385] T 87afbdb11c6e4e58affd2f2d7995e1f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:02.337756 6457 raft_consensus.cc:740] T 87afbdb11c6e4e58affd2f2d7995e1f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:02.337711 6280 leader_election.cc:304] T 9ed630e738c54ed38b9933f95fb552c5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:02.338037 6643 raft_consensus.cc:2749] T 9ed630e738c54ed38b9933f95fb552c5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:02.338097 6457 consensus_queue.cc:260] T 87afbdb11c6e4e58affd2f2d7995e1f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.338339 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 64) took 2879 ms. Trace:
I20260923 19:50:02.338451 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ccfe6531fc44f86a0edc8bda1547442. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.338480 6458 rpcz_store.cc:276] 0923 19:49:59.458464 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:49:59.458648 (+ 184us) service_pool.cc:224] Handling call
0923 19:50:02.175688 (+2717040us) ts_tablet_manager.cc:1151] Deleting tablet e655ab5873294e75a242709f069aabf2
0923 19:50:02.175698 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:02.257733 (+ 82035us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:02.309923 (+ 52190us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:02.338281 (+ 28358us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2716835}
I20260923 19:50:02.339097 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet e655ab5873294e75a242709f069aabf2 (table default.Table_f1e7b89f9642419a93fed2c6c85f26c8 [id=c048860d19b54812a5898d84095d2353]) successfully deleted
I20260923 19:50:02.340004 6458 tablet_replica.cc:333] T e52d78a941a341d186dc00bbe7df96bf P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:02.340270 6458 raft_consensus.cc:2243] T e52d78a941a341d186dc00bbe7df96bf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:02.340521 6458 raft_consensus.cc:2272] T e52d78a941a341d186dc00bbe7df96bf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:02.341100 6458 ts_tablet_manager.cc:1916] T e52d78a941a341d186dc00bbe7df96bf P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:02.341862 6457 ts_tablet_manager.cc:1434] T 87afbdb11c6e4e58affd2f2d7995e1f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260923 19:50:02.344847 6325 tablet_service.cc:1511] Processing CreateTablet for tablet d2298d814a104f5cb62196be3bf0dae6 (DEFAULT_TABLE table=default.Table_69bbed3a902143c0a4fc91ee4cf3fec4 [id=ba1f8e14938e4925b3fc8a8b72002231]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.345355 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2298d814a104f5cb62196be3bf0dae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.345420 6457 tablet_bootstrap.cc:492] T 9ed630e738c54ed38b9933f95fb552c5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:02.350814 6457 tablet_bootstrap.cc:654] T 9ed630e738c54ed38b9933f95fb552c5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:02.351662 6174 tablet_service.cc:1511] Processing CreateTablet for tablet 235b4b8081ad4a13937a7941344dbc33 (DEFAULT_TABLE table=default.Table_1a5602208673400faf5f272297ff82b9 [id=a7241c5e33894e8c97e723b3b90b8cc7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:02.354560 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 31b0bdf719554d37993a802831e324ee because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31b0bdf719554d37993a802831e324ee already in progress: creating tablet
I20260923 19:50:02.354552 6037 tablet_service.cc:1511] Processing CreateTablet for tablet d2298d814a104f5cb62196be3bf0dae6 (DEFAULT_TABLE table=default.Table_69bbed3a902143c0a4fc91ee4cf3fec4 [id=ba1f8e14938e4925b3fc8a8b72002231]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.356035 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet 31b0bdf719554d37993a802831e324ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:02.356449 6173 tablet_service.cc:1511] Processing CreateTablet for tablet d2298d814a104f5cb62196be3bf0dae6 (DEFAULT_TABLE table=default.Table_69bbed3a902143c0a4fc91ee4cf3fec4 [id=ba1f8e14938e4925b3fc8a8b72002231]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.357079 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 235b4b8081ad4a13937a7941344dbc33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.358237 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2298d814a104f5cb62196be3bf0dae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.364627 6459 tablet_replica.cc:333] T e655ab5873294e75a242709f069aabf2 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:02.364943 6459 raft_consensus.cc:2243] T e655ab5873294e75a242709f069aabf2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:02.365170 6459 raft_consensus.cc:2272] T e655ab5873294e75a242709f069aabf2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:02.365584 6183 tablet_service.cc:1511] Processing CreateTablet for tablet ba4e9fee05994c0d8e7d1f21788280d3 (DEFAULT_TABLE table=default.Table_b729507fea034866a46da1d40fde099c [id=49bb9f954b544f41b75f6035b1ea68b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.366119 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2298d814a104f5cb62196be3bf0dae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.370013 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba4e9fee05994c0d8e7d1f21788280d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.372208 6457 tablet_bootstrap.cc:492] T 9ed630e738c54ed38b9933f95fb552c5 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:02.372460 6457 ts_tablet_manager.cc:1403] T 9ed630e738c54ed38b9933f95fb552c5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.027s user 0.005s sys 0.000s
I20260923 19:50:02.373304 6457 raft_consensus.cc:359] T 9ed630e738c54ed38b9933f95fb552c5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.373623 6457 raft_consensus.cc:385] T 9ed630e738c54ed38b9933f95fb552c5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:02.373746 6457 raft_consensus.cc:740] T 9ed630e738c54ed38b9933f95fb552c5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:02.374137 6457 consensus_queue.cc:260] T 9ed630e738c54ed38b9933f95fb552c5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.374933 6457 ts_tablet_manager.cc:1434] T 9ed630e738c54ed38b9933f95fb552c5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:50:02.375296 6457 tablet_bootstrap.cc:492] T f7e282b6699a4ce9837d221132a1f54e P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:02.382011 6457 tablet_bootstrap.cc:654] T f7e282b6699a4ce9837d221132a1f54e P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:02.396301 6459 ts_tablet_manager.cc:1916] T e655ab5873294e75a242709f069aabf2 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:02.403352 6457 tablet_bootstrap.cc:492] T f7e282b6699a4ce9837d221132a1f54e P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:02.403576 6457 ts_tablet_manager.cc:1403] T f7e282b6699a4ce9837d221132a1f54e P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.028s user 0.006s sys 0.014s
I20260923 19:50:02.404887 6457 raft_consensus.cc:359] T f7e282b6699a4ce9837d221132a1f54e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.405155 6457 raft_consensus.cc:385] T f7e282b6699a4ce9837d221132a1f54e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:02.405272 6457 raft_consensus.cc:740] T f7e282b6699a4ce9837d221132a1f54e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:02.405627 6457 consensus_queue.cc:260] T f7e282b6699a4ce9837d221132a1f54e P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.411479 6457 ts_tablet_manager.cc:1434] T f7e282b6699a4ce9837d221132a1f54e P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260923 19:50:02.414532 6454 tablet_bootstrap.cc:492] T 0cdb778f87fa40b89dad97d166192a1e P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:02.414733 6454 ts_tablet_manager.cc:1403] T 0cdb778f87fa40b89dad97d166192a1e P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.301s user 0.005s sys 0.000s
I20260923 19:50:02.415525 6454 raft_consensus.cc:359] T 0cdb778f87fa40b89dad97d166192a1e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.415951 6454 raft_consensus.cc:385] T 0cdb778f87fa40b89dad97d166192a1e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:02.416059 6454 raft_consensus.cc:740] T 0cdb778f87fa40b89dad97d166192a1e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:02.416282 6457 tablet_bootstrap.cc:492] T a10110f4a2b34b61a4cc586d65981606 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:02.416394 6454 consensus_queue.cc:260] T 0cdb778f87fa40b89dad97d166192a1e P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.419255 6454 ts_tablet_manager.cc:1434] T 0cdb778f87fa40b89dad97d166192a1e P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260923 19:50:02.420636 6457 tablet_bootstrap.cc:654] T a10110f4a2b34b61a4cc586d65981606 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:02.421315 6454 tablet_bootstrap.cc:492] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:02.430780 6457 tablet_bootstrap.cc:492] T a10110f4a2b34b61a4cc586d65981606 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:02.430860 6456 tablet_bootstrap.cc:492] T a1e8b8e638ec438a86f05fa147cdb27c P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:02.431020 6456 ts_tablet_manager.cc:1403] T a1e8b8e638ec438a86f05fa147cdb27c P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.096s user 0.001s sys 0.002s
I20260923 19:50:02.431023 6457 ts_tablet_manager.cc:1403] T a10110f4a2b34b61a4cc586d65981606 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.005s
I20260923 19:50:02.431808 6456 raft_consensus.cc:359] T a1e8b8e638ec438a86f05fa147cdb27c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.432001 6456 raft_consensus.cc:385] T a1e8b8e638ec438a86f05fa147cdb27c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:02.432101 6456 raft_consensus.cc:740] T a1e8b8e638ec438a86f05fa147cdb27c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:02.432009 6457 raft_consensus.cc:359] T a10110f4a2b34b61a4cc586d65981606 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.432282 6457 raft_consensus.cc:385] T a10110f4a2b34b61a4cc586d65981606 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:02.432379 6457 raft_consensus.cc:740] T a10110f4a2b34b61a4cc586d65981606 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:02.432349 6456 consensus_queue.cc:260] T a1e8b8e638ec438a86f05fa147cdb27c P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.432781 6457 consensus_queue.cc:260] T a10110f4a2b34b61a4cc586d65981606 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.432928 6456 ts_tablet_manager.cc:1434] T a1e8b8e638ec438a86f05fa147cdb27c P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:50:02.433182 6456 tablet_bootstrap.cc:492] T 115048f771764e41a3816e17a6c6cf94 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:02.438771 6456 tablet_bootstrap.cc:654] T 115048f771764e41a3816e17a6c6cf94 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:02.443440 6454 tablet_bootstrap.cc:654] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:02.445448 6457 ts_tablet_manager.cc:1434] T a10110f4a2b34b61a4cc586d65981606 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
W20260923 19:50:02.446794 5803 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2db82e6f314f412385b41720c7efdef5 consensus state has no leader
I20260923 19:50:02.449585 6457 tablet_bootstrap.cc:492] T f302f91c8ef44237b1c9909d88dacbff P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:02.451545 6037 tablet_service.cc:1511] Processing CreateTablet for tablet ba4e9fee05994c0d8e7d1f21788280d3 (DEFAULT_TABLE table=default.Table_b729507fea034866a46da1d40fde099c [id=49bb9f954b544f41b75f6035b1ea68b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.452078 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba4e9fee05994c0d8e7d1f21788280d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.459040 6164 tablet_service.cc:1511] Processing CreateTablet for tablet 58c24aa494bc4da28536dfa1df6123b7 (DEFAULT_TABLE table=default.Table_82887fe31841462bafc075decf6acdbd [id=8bf9f0ca8abf4fa1a05458b12288cd12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.459448 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c24aa494bc4da28536dfa1df6123b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.462688 6039 tablet_service.cc:1511] Processing CreateTablet for tablet 908596339b2e4f7f8ddb7f9cd5bdcc3e (DEFAULT_TABLE table=default.Table_7685437ec90948a480a544421ad56cc4 [id=1e323f5b380a4af4acc3865649648e12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.463238 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 908596339b2e4f7f8ddb7f9cd5bdcc3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.491149 6457 tablet_bootstrap.cc:654] T f302f91c8ef44237b1c9909d88dacbff P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:02.492024 6325 tablet_service.cc:1511] Processing CreateTablet for tablet ba4e9fee05994c0d8e7d1f21788280d3 (DEFAULT_TABLE table=default.Table_b729507fea034866a46da1d40fde099c [id=49bb9f954b544f41b75f6035b1ea68b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.492465 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba4e9fee05994c0d8e7d1f21788280d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.494175 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 908596339b2e4f7f8ddb7f9cd5bdcc3e (DEFAULT_TABLE table=default.Table_7685437ec90948a480a544421ad56cc4 [id=1e323f5b380a4af4acc3865649648e12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.494367 6576 raft_consensus.cc:493] T 87afbdb11c6e4e58affd2f2d7995e1f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:02.494520 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 908596339b2e4f7f8ddb7f9cd5bdcc3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.494611 6576 raft_consensus.cc:515] T 87afbdb11c6e4e58affd2f2d7995e1f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.495498 6576 leader_election.cc:290] T 87afbdb11c6e4e58affd2f2d7995e1f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:02.498399 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87afbdb11c6e4e58affd2f2d7995e1f8" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:02.499352 5995 leader_election.cc:343] T 87afbdb11c6e4e58affd2f2d7995e1f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:02.500263 6345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87afbdb11c6e4e58affd2f2d7995e1f8" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:02.500854 6345 raft_consensus.cc:2468] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 0.
I20260923 19:50:02.501971 5996 leader_election.cc:304] T 87afbdb11c6e4e58affd2f2d7995e1f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:02.502316 6576 raft_consensus.cc:2804] T 87afbdb11c6e4e58affd2f2d7995e1f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:02.502453 6576 raft_consensus.cc:493] T 87afbdb11c6e4e58affd2f2d7995e1f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:02.502573 6576 raft_consensus.cc:3060] T 87afbdb11c6e4e58affd2f2d7995e1f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:02.506711 6576 raft_consensus.cc:515] T 87afbdb11c6e4e58affd2f2d7995e1f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.508141 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87afbdb11c6e4e58affd2f2d7995e1f8" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:02.508513 6345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87afbdb11c6e4e58affd2f2d7995e1f8" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:02.508790 6345 raft_consensus.cc:3060] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:02.513068 6345 raft_consensus.cc:2468] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 1.
W20260923 19:50:02.513864 5995 leader_election.cc:343] T 87afbdb11c6e4e58affd2f2d7995e1f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:02.514410 5996 leader_election.cc:304] T 87afbdb11c6e4e58affd2f2d7995e1f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:02.514772 6689 raft_consensus.cc:2804] T 87afbdb11c6e4e58affd2f2d7995e1f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:02.515018 6689 raft_consensus.cc:697] T 87afbdb11c6e4e58affd2f2d7995e1f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Becoming Leader. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Running, Role: LEADER
I20260923 19:50:02.515062 5799 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet daafbafae5004b8499e7ea93342c0517
W20260923 19:50:02.515529 5804 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f1a4bccf6dd2411f83b86d782ecf5f40 consensus state has no leader
I20260923 19:50:02.519649 6689 consensus_queue.cc:237] T 87afbdb11c6e4e58affd2f2d7995e1f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:02.520372 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 15c0dc02ba964af38ca9f76161722588 consensus state has no leader
I20260923 19:50:02.520695 5801 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_526fa05830fd4679bd95ea4b8e9af682" } modify_external_catalogs: true
W20260923 19:50:02.522208 5805 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c0ff8838ab17433ab733d3b293d4964f has no consensus state
I20260923 19:50:02.522488 5805 master_service.cc:960] ReplaceTablet: received request to replace tablet 2f627b7b9ff74750bd8dd59840bf77db from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:02.521386 5801 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_526fa05830fd4679bd95ea4b8e9af682" } modify_external_catalogs: true
I20260923 19:50:02.520134 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_4cb745719e44465b8bdd1ed8a1e04b8e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:02.526008 5799 master_service.cc:960] ReplaceTablet: received request to replace tablet 4dbc0e17d77140f6abe9ee26c8ec13ee from {username='slave'} at 127.0.0.1:59912
W20260923 19:50:02.527886 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4cb745719e44465b8bdd1ed8a1e04b8e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:02.528769 6035 tablet_service.cc:1511] Processing CreateTablet for tablet f5cb8dd5dcf54df9989dd808fe148ce6 (DEFAULT_TABLE table=default.Table_c49fa1ccdba34f098164e9732f9a750a [id=1b9a067155ad446db4ead7a1ece15427]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.529346 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5cb8dd5dcf54df9989dd808fe148ce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.531196 6314 tablet_service.cc:1511] Processing CreateTablet for tablet f5cb8dd5dcf54df9989dd808fe148ce6 (DEFAULT_TABLE table=default.Table_c49fa1ccdba34f098164e9732f9a750a [id=1b9a067155ad446db4ead7a1ece15427]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.531651 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5cb8dd5dcf54df9989dd808fe148ce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.533972 6687 raft_consensus.cc:493] T a10110f4a2b34b61a4cc586d65981606 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:02.534626 6687 raft_consensus.cc:515] T a10110f4a2b34b61a4cc586d65981606 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.535557 6687 leader_election.cc:290] T a10110f4a2b34b61a4cc586d65981606 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:02.539803 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10110f4a2b34b61a4cc586d65981606" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:02.542419 6172 tablet_service.cc:1558] Processing DeleteTablet for tablet 0cdb778f87fa40b89dad97d166192a1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:58 UTC) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:02.542758 5995 leader_election.cc:343] T a10110f4a2b34b61a4cc586d65981606 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:02.543030 6172 tablet_service.cc:1511] Processing CreateTablet for tablet 896bd068e6b343e48eb2a01679b49326 (DEFAULT_TABLE table=default.Table_5febe26a78884634a01aa0ec62f36604 [id=e2a29fc060074c45918b97001dd03207]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.543195 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet daafbafae5004b8499e7ea93342c0517 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:02.543396 6576 leader_election.cc:290] T 87afbdb11c6e4e58affd2f2d7995e1f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:02.543431 6172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 896bd068e6b343e48eb2a01679b49326. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.547732 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_aa989ce1be2c4480b91e1102cef5a585"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:02.547809 6316 tablet_service.cc:1511] Processing CreateTablet for tablet 896bd068e6b343e48eb2a01679b49326 (DEFAULT_TABLE table=default.Table_5febe26a78884634a01aa0ec62f36604 [id=e2a29fc060074c45918b97001dd03207]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.548228 6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 896bd068e6b343e48eb2a01679b49326. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:02.548630 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet daafbafae5004b8499e7ea93342c0517 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet daafbafae5004b8499e7ea93342c0517 already in progress: creating tablet
I20260923 19:50:02.552341 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 896bd068e6b343e48eb2a01679b49326 (DEFAULT_TABLE table=default.Table_5febe26a78884634a01aa0ec62f36604 [id=e2a29fc060074c45918b97001dd03207]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.552888 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 896bd068e6b343e48eb2a01679b49326. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:02.552986 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa989ce1be2c4480b91e1102cef5a585 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:02.553294 6345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10110f4a2b34b61a4cc586d65981606" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:02.553548 6345 raft_consensus.cc:2468] T a10110f4a2b34b61a4cc586d65981606 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 0.
I20260923 19:50:02.554162 5996 leader_election.cc:304] T a10110f4a2b34b61a4cc586d65981606 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:02.554345 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet daafbafae5004b8499e7ea93342c0517 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:02.554728 6689 raft_consensus.cc:2804] T a10110f4a2b34b61a4cc586d65981606 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:02.554883 6689 raft_consensus.cc:493] T a10110f4a2b34b61a4cc586d65981606 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:02.554996 6689 raft_consensus.cc:3060] T a10110f4a2b34b61a4cc586d65981606 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:02.558388 6164 tablet_service.cc:1511] Processing CreateTablet for tablet f5cb8dd5dcf54df9989dd808fe148ce6 (DEFAULT_TABLE table=default.Table_c49fa1ccdba34f098164e9732f9a750a [id=1b9a067155ad446db4ead7a1ece15427]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.559749 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5cb8dd5dcf54df9989dd808fe148ce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.561946 6039 tablet_service.cc:1511] Processing CreateTablet for tablet 58c24aa494bc4da28536dfa1df6123b7 (DEFAULT_TABLE table=default.Table_82887fe31841462bafc075decf6acdbd [id=8bf9f0ca8abf4fa1a05458b12288cd12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.562784 6457 tablet_bootstrap.cc:492] T f302f91c8ef44237b1c9909d88dacbff P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:02.562959 6457 ts_tablet_manager.cc:1403] T f302f91c8ef44237b1c9909d88dacbff P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.114s user 0.003s sys 0.003s
I20260923 19:50:02.564536 6457 raft_consensus.cc:359] T f302f91c8ef44237b1c9909d88dacbff P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.564826 6457 raft_consensus.cc:385] T f302f91c8ef44237b1c9909d88dacbff P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:02.564952 6457 raft_consensus.cc:740] T f302f91c8ef44237b1c9909d88dacbff P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:02.565251 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 58c24aa494bc4da28536dfa1df6123b7 (DEFAULT_TABLE table=default.Table_82887fe31841462bafc075decf6acdbd [id=8bf9f0ca8abf4fa1a05458b12288cd12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.565318 6457 consensus_queue.cc:260] T f302f91c8ef44237b1c9909d88dacbff P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.565753 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c24aa494bc4da28536dfa1df6123b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.568190 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet daafbafae5004b8499e7ea93342c0517 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:02.571780 6689 raft_consensus.cc:515] T a10110f4a2b34b61a4cc586d65981606 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.573246 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10110f4a2b34b61a4cc586d65981606" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
W20260923 19:50:02.574000 5995 leader_election.cc:343] T a10110f4a2b34b61a4cc586d65981606 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:02.576484 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c24aa494bc4da28536dfa1df6123b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.580890 5797 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_3eb6c5fd5fa541a0b2d8215098fbf2f3" } modify_external_catalogs: true
I20260923 19:50:02.581103 5797 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_3eb6c5fd5fa541a0b2d8215098fbf2f3" } modify_external_catalogs: true
W20260923 19:50:02.582336 5965 log.cc:927] Time spent T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Append to log took a long time: real 0.069s user 0.000s sys 0.000s
I20260923 19:50:02.584486 5802 master_service.cc:960] ReplaceTablet: received request to replace tablet b4fc995819cc40bf9956d85966bcd330 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:02.586131 6345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10110f4a2b34b61a4cc586d65981606" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:02.586380 6345 raft_consensus.cc:3060] T a10110f4a2b34b61a4cc586d65981606 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:02.586356 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_ee62a8be7c124011a02b14ab41953bab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:02.587005 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee62a8be7c124011a02b14ab41953bab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:02.588099 5804 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_bc20a658edaf42818fb401723f10f95f" } modify_external_catalogs: true
I20260923 19:50:02.588250 5804 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_bc20a658edaf42818fb401723f10f95f" } modify_external_catalogs: true
I20260923 19:50:02.591060 5803 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet a10110f4a2b34b61a4cc586d65981606 (table default.Table_b455e09005774effa019e6ddc31cd521 [id=019ceccbcb1041cc9e5625274c45a0f3]). Expected version 1 got 0
I20260923 19:50:02.591737 5803 master_service.cc:960] ReplaceTablet: received request to replace tablet 495292cacf3b42a5b633ad40e5e01972 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:02.592304 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_30a13147f51347808f58bfef0919dd77" } new_table_name: "default.Table_41c4d80198a246a78955ae6ab79f3532" modify_external_catalogs: true
I20260923 19:50:02.594141 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 2f627b7b9ff74750bd8dd59840bf77db
I20260923 19:50:02.594754 5805 catalog_manager.cc:6934] ReplaceTablet: tablet 2f627b7b9ff74750bd8dd59840bf77db deleted and replaced by tablet d40327145d4d44009f12358eacacf0dd
I20260923 19:50:02.595103 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_d2b5d3afdd76475bbd2a6a78f0522c6b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:02.595167 6031 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f627b7b9ff74750bd8dd59840bf77db with delete_type TABLET_DATA_DELETED (replaced by tablet d40327145d4d44009f12358eacacf0dd) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:02.595585 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d2b5d3afdd76475bbd2a6a78f0522c6b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:02.596263 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 2f627b7b9ff74750bd8dd59840bf77db because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f627b7b9ff74750bd8dd59840bf77db already in progress: creating tablet
I20260923 19:50:02.597566 5801 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 05a2d1b0979c4788bccc3a71e1cd098e
I20260923 19:50:02.597961 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_cabd4e85a8824c7699003c51f4f0ead6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:02.598044 6689 leader_election.cc:290] T a10110f4a2b34b61a4cc586d65981606 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:02.598438 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cabd4e85a8824c7699003c51f4f0ead6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:02.599292 6457 ts_tablet_manager.cc:1434] T f302f91c8ef44237b1c9909d88dacbff P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.036s user 0.003s sys 0.000s
W20260923 19:50:02.602133 6137 consensus_peers.cc:597] T 259e4faa58f549699538317019be5daf P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 259e4faa58f549699538317019be5daf. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:02.603907 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_42fbb36fdc75430881f49e0b2bb82fc3" } modify_external_catalogs: true
I20260923 19:50:02.604090 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_42fbb36fdc75430881f49e0b2bb82fc3" } modify_external_catalogs: true
I20260923 19:50:02.608264 5797 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 80fc733f0068445b9abfa8deaee8293e
I20260923 19:50:02.610040 6457 tablet_bootstrap.cc:492] T 64a38bbd3fbd4738a73e78e3f6436fe5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:02.612433 6457 tablet_bootstrap.cc:654] T 64a38bbd3fbd4738a73e78e3f6436fe5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:02.615197 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet cd02244c52ad4d2ab3915108a92a6f97
W20260923 19:50:02.616914 5803 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 85d35ebef3c24a2e89233dd900b63513 consensus state has no leader
I20260923 19:50:02.617357 6031 tablet_service.cc:1558] Processing DeleteTablet for tablet cd02244c52ad4d2ab3915108a92a6f97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:02.618516 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet cd02244c52ad4d2ab3915108a92a6f97 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd02244c52ad4d2ab3915108a92a6f97 already in progress: creating tablet
I20260923 19:50:02.617575 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_4eba9023b25a445bb87c0b95ee9badaf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:02.620610 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4eba9023b25a445bb87c0b95ee9badaf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:02.628690 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f627b7b9ff74750bd8dd59840bf77db with delete_type TABLET_DATA_DELETED (replaced by tablet d40327145d4d44009f12358eacacf0dd) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:02.629524 6345 raft_consensus.cc:2468] T a10110f4a2b34b61a4cc586d65981606 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 1.
I20260923 19:50:02.630254 5996 leader_election.cc:304] T a10110f4a2b34b61a4cc586d65981606 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:02.630950 6689 raft_consensus.cc:2804] T a10110f4a2b34b61a4cc586d65981606 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:02.632944 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet c48d4a8371fa4454b7c67291db3ab796
I20260923 19:50:02.634256 6316 tablet_service.cc:1558] Processing DeleteTablet for tablet c48d4a8371fa4454b7c67291db3ab796 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:02.634768 6689 raft_consensus.cc:697] T a10110f4a2b34b61a4cc586d65981606 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Becoming Leader. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Running, Role: LEADER
I20260923 19:50:02.635036 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet c48d4a8371fa4454b7c67291db3ab796 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:02.635206 6689 consensus_queue.cc:237] T a10110f4a2b34b61a4cc586d65981606 P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.636691 6035 tablet_service.cc:1558] Processing DeleteTablet for tablet c48d4a8371fa4454b7c67291db3ab796 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:02.637672 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet c48d4a8371fa4454b7c67291db3ab796 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c48d4a8371fa4454b7c67291db3ab796 already in progress: creating tablet
I20260923 19:50:02.638208 6314 tablet_service.cc:1558] Processing DeleteTablet for tablet cd02244c52ad4d2ab3915108a92a6f97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:02.638646 6172 tablet_service.cc:1558] Processing DeleteTablet for tablet cd02244c52ad4d2ab3915108a92a6f97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:02.639036 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f627b7b9ff74750bd8dd59840bf77db with delete_type TABLET_DATA_DELETED (replaced by tablet d40327145d4d44009f12358eacacf0dd) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:02.640239 5801 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet a10110f4a2b34b61a4cc586d65981606 (table default.Table_b455e09005774effa019e6ddc31cd521 [id=019ceccbcb1041cc9e5625274c45a0f3]). Expected version 1 got 0
I20260923 19:50:02.639482 5798 catalog_manager.cc:5838] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193). New cstate: current_term: 1 leader_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: UNKNOWN } } }
I20260923 19:50:02.641021 5798 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 4dbc0e17d77140f6abe9ee26c8ec13ee (table default.Table_701c81d7fd4844f09fc1ccc28f0eda9c [id=67292e21e6b546298c5d629c6ebcb718]). Expected version 2 got 0
I20260923 19:50:02.642091 6182 tablet_service.cc:1511] Processing CreateTablet for tablet 908596339b2e4f7f8ddb7f9cd5bdcc3e (DEFAULT_TABLE table=default.Table_7685437ec90948a480a544421ad56cc4 [id=1e323f5b380a4af4acc3865649648e12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:02.642588 6182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 908596339b2e4f7f8ddb7f9cd5bdcc3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:02.653455 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b07b177ae0cb435598465ff79d506a10" } new_table_name: "default.Table_c7fd5d8532d64b0490ae3f6df528e049" modify_external_catalogs: true
I20260923 19:50:02.664261 5799 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 4dbc0e17d77140f6abe9ee26c8ec13ee
I20260923 19:50:02.664971 5799 catalog_manager.cc:6934] ReplaceTablet: tablet 4dbc0e17d77140f6abe9ee26c8ec13ee deleted and replaced by tablet e4f00490b0364f0e9f1b9569b870808e
I20260923 19:50:02.666632 6035 tablet_service.cc:1558] Processing DeleteTablet for tablet 4dbc0e17d77140f6abe9ee26c8ec13ee with delete_type TABLET_DATA_DELETED (replaced by tablet e4f00490b0364f0e9f1b9569b870808e) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:02.666749 6172 tablet_service.cc:1558] Processing DeleteTablet for tablet 4dbc0e17d77140f6abe9ee26c8ec13ee with delete_type TABLET_DATA_DELETED (replaced by tablet e4f00490b0364f0e9f1b9569b870808e) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:02.667083 6461 tablet_replica.cc:333] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:02.667337 6461 raft_consensus.cc:2243] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:02.667675 6461 pending_rounds.cc:70] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0: Trying to abort 1 pending ops.
I20260923 19:50:02.667766 6461 pending_rounds.cc:77] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630536848101376 op_type: NO_OP noop_request { }
I20260923 19:50:02.667927 6461 raft_consensus.cc:2889] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:02.668053 6461 raft_consensus.cc:2272] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:02.669157 6461 ts_tablet_manager.cc:1916] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:02.673080 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 4dbc0e17d77140f6abe9ee26c8ec13ee with delete_type TABLET_DATA_DELETED (replaced by tablet e4f00490b0364f0e9f1b9569b870808e) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:02.678987 6461 ts_tablet_manager.cc:1929] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:02.679808 6461 log.cc:1199] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/4dbc0e17d77140f6abe9ee26c8ec13ee
I20260923 19:50:02.680471 6461 ts_tablet_manager.cc:1950] T 4dbc0e17d77140f6abe9ee26c8ec13ee P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:02.681437 6457 tablet_bootstrap.cc:492] T 64a38bbd3fbd4738a73e78e3f6436fe5 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:02.681653 6457 ts_tablet_manager.cc:1403] T 64a38bbd3fbd4738a73e78e3f6436fe5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.072s user 0.002s sys 0.002s
I20260923 19:50:02.682487 6457 raft_consensus.cc:359] T 64a38bbd3fbd4738a73e78e3f6436fe5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.682706 6457 raft_consensus.cc:385] T 64a38bbd3fbd4738a73e78e3f6436fe5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:02.682796 6457 raft_consensus.cc:740] T 64a38bbd3fbd4738a73e78e3f6436fe5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:02.683058 6457 consensus_queue.cc:260] T 64a38bbd3fbd4738a73e78e3f6436fe5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.683202 6454 tablet_bootstrap.cc:492] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:02.683565 6457 ts_tablet_manager.cc:1434] T 64a38bbd3fbd4738a73e78e3f6436fe5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260923 19:50:02.683878 6457 tablet_bootstrap.cc:492] T 063fc0e77d294ddf8a02e9ab5968a5e3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:02.685707 6457 tablet_bootstrap.cc:654] T 063fc0e77d294ddf8a02e9ab5968a5e3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:02.687937 6457 tablet_bootstrap.cc:492] T 063fc0e77d294ddf8a02e9ab5968a5e3 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:02.688073 6457 ts_tablet_manager.cc:1403] T 063fc0e77d294ddf8a02e9ab5968a5e3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20260923 19:50:02.688756 6457 raft_consensus.cc:359] T 063fc0e77d294ddf8a02e9ab5968a5e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.688928 6457 raft_consensus.cc:385] T 063fc0e77d294ddf8a02e9ab5968a5e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:02.689023 6457 raft_consensus.cc:740] T 063fc0e77d294ddf8a02e9ab5968a5e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:02.689263 6457 consensus_queue.cc:260] T 063fc0e77d294ddf8a02e9ab5968a5e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.689793 6457 ts_tablet_manager.cc:1434] T 063fc0e77d294ddf8a02e9ab5968a5e3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:50:02.691413 6457 tablet_bootstrap.cc:492] T 033c2d772c8a44d2a0e671664bb9085d P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:02.693161 6457 tablet_bootstrap.cc:654] T 033c2d772c8a44d2a0e671664bb9085d P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:02.695127 6454 ts_tablet_manager.cc:1403] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.276s user 0.004s sys 0.000s
I20260923 19:50:02.698370 6457 tablet_bootstrap.cc:492] T 033c2d772c8a44d2a0e671664bb9085d P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:02.698534 6457 ts_tablet_manager.cc:1403] T 033c2d772c8a44d2a0e671664bb9085d P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260923 19:50:02.699234 6457 raft_consensus.cc:359] T 033c2d772c8a44d2a0e671664bb9085d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.699419 6457 raft_consensus.cc:385] T 033c2d772c8a44d2a0e671664bb9085d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:02.699493 6457 raft_consensus.cc:740] T 033c2d772c8a44d2a0e671664bb9085d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:02.699751 6457 consensus_queue.cc:260] T 033c2d772c8a44d2a0e671664bb9085d P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.700312 6457 ts_tablet_manager.cc:1434] T 033c2d772c8a44d2a0e671664bb9085d P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:50:02.701066 6457 tablet_bootstrap.cc:492] T 5adadf8caf5e4a9ab1107d0fb6a91735 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:02.702644 6458 ts_tablet_manager.cc:1929] T e52d78a941a341d186dc00bbe7df96bf P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:02.702761 6457 tablet_bootstrap.cc:654] T 5adadf8caf5e4a9ab1107d0fb6a91735 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:02.712447 6457 tablet_bootstrap.cc:492] T 5adadf8caf5e4a9ab1107d0fb6a91735 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:02.713006 6457 ts_tablet_manager.cc:1403] T 5adadf8caf5e4a9ab1107d0fb6a91735 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.003s
I20260923 19:50:02.715602 6457 raft_consensus.cc:359] T 5adadf8caf5e4a9ab1107d0fb6a91735 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.716266 6457 raft_consensus.cc:385] T 5adadf8caf5e4a9ab1107d0fb6a91735 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:02.716573 6457 raft_consensus.cc:740] T 5adadf8caf5e4a9ab1107d0fb6a91735 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:02.717329 6457 consensus_queue.cc:260] T 5adadf8caf5e4a9ab1107d0fb6a91735 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.722955 6457 ts_tablet_manager.cc:1434] T 5adadf8caf5e4a9ab1107d0fb6a91735 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.010s user 0.004s sys 0.000s
I20260923 19:50:02.725353 6457 tablet_bootstrap.cc:492] T e1752d6b46894796bdc94e6230e3327d P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:02.696266 6454 raft_consensus.cc:359] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.730993 6457 tablet_bootstrap.cc:654] T e1752d6b46894796bdc94e6230e3327d P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:02.681913 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 4dbc0e17d77140f6abe9ee26c8ec13ee (table default.Table_701c81d7fd4844f09fc1ccc28f0eda9c [id=67292e21e6b546298c5d629c6ebcb718]) successfully deleted
W20260923 19:50:02.732251 5790 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.5.143.193:39887, user_credentials={real_user=slave}} blocked reactor thread for 50380.6us
I20260923 19:50:02.733780 5796 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f3f7926d9a214e1bb8b8b42655baef50" } new_table_name: "default.Table_b623e36133d64d72a070bb99a0b974ee" modify_external_catalogs: true
I20260923 19:50:02.734601 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_413519bded0c44f3b92a3710f13f69bb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:02.735262 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_413519bded0c44f3b92a3710f13f69bb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:02.735579 5802 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_cabcb31bab8e4f7fa1442bf693674afa" } new_table_name: "default.Table_dda4a443221b4621965cbc1f5e631859" modify_external_catalogs: true
I20260923 19:50:02.736850 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_b57993507bc4490baef162d2a394137e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:02.737329 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_a5a21cb4e5bc4aa8be7ed7ac43e94638"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:02.737517 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b57993507bc4490baef162d2a394137e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:02.737953 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a5a21cb4e5bc4aa8be7ed7ac43e94638 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:02.739063 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ac282a79af174a87b864e9156993fd25" } new_table_name: "default.Table_62802f9e844c4c16bf9cb0d04a630fa9" modify_external_catalogs: true
I20260923 19:50:02.740509 5804 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_69bbed3a902143c0a4fc91ee4cf3fec4" } modify_external_catalogs: true
I20260923 19:50:02.740731 5804 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_69bbed3a902143c0a4fc91ee4cf3fec4" } modify_external_catalogs: true
W20260923 19:50:02.748767 5790 catalog_manager.cc:5136] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): alter failed for tablet 4dbc0e17d77140f6abe9ee26c8ec13ee (table default.Table_701c81d7fd4844f09fc1ccc28f0eda9c [id=67292e21e6b546298c5d629c6ebcb718]),no further retry: Not found: Tablet not found: 4dbc0e17d77140f6abe9ee26c8ec13ee
I20260923 19:50:02.750978 6454 raft_consensus.cc:385] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:02.751129 6454 raft_consensus.cc:740] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:02.751487 6454 consensus_queue.cc:260] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:02.754467 5802 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2db82e6f314f412385b41720c7efdef5 consensus state has no leader
W20260923 19:50:02.755231 5805 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 115048f771764e41a3816e17a6c6cf94 consensus state has no leader
I20260923 19:50:02.756978 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_b8c60b9b057e474f83935688ca30222f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:02.758433 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b8c60b9b057e474f83935688ca30222f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:02.765978 5790 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 2db82e6f314f412385b41720c7efdef5 (table default.Table_dda4a443221b4621965cbc1f5e631859 [id=6d79e588fb9e4936aedf8cd500f68d60], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2db82e6f314f412385b41720c7efdef5 consensus state has no leader
I20260923 19:50:02.771829 6457 tablet_bootstrap.cc:492] T e1752d6b46894796bdc94e6230e3327d P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:02.772037 6457 ts_tablet_manager.cc:1403] T e1752d6b46894796bdc94e6230e3327d P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.047s user 0.010s sys 0.002s
I20260923 19:50:02.773049 6457 raft_consensus.cc:359] T e1752d6b46894796bdc94e6230e3327d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.773298 6457 raft_consensus.cc:385] T e1752d6b46894796bdc94e6230e3327d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:02.773384 6457 raft_consensus.cc:740] T e1752d6b46894796bdc94e6230e3327d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:02.773716 6457 consensus_queue.cc:260] T e1752d6b46894796bdc94e6230e3327d P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.777761 6457 ts_tablet_manager.cc:1434] T e1752d6b46894796bdc94e6230e3327d P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260923 19:50:02.779335 6457 tablet_bootstrap.cc:492] T 5455beff354a4616a68d8746e3e4f9a8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:02.781726 6457 tablet_bootstrap.cc:654] T 5455beff354a4616a68d8746e3e4f9a8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:02.792972 5800 master_service.cc:960] ReplaceTablet: received request to replace tablet 3919b15a00eb4fb08008f065f556c760 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:02.793606 6457 tablet_bootstrap.cc:492] T 5455beff354a4616a68d8746e3e4f9a8 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:02.793911 6457 ts_tablet_manager.cc:1403] T 5455beff354a4616a68d8746e3e4f9a8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.007s
I20260923 19:50:02.795298 6457 raft_consensus.cc:359] T 5455beff354a4616a68d8746e3e4f9a8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.795635 6457 raft_consensus.cc:385] T 5455beff354a4616a68d8746e3e4f9a8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:02.795814 6457 raft_consensus.cc:740] T 5455beff354a4616a68d8746e3e4f9a8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:02.796296 6457 consensus_queue.cc:260] T 5455beff354a4616a68d8746e3e4f9a8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.798518 6457 ts_tablet_manager.cc:1434] T 5455beff354a4616a68d8746e3e4f9a8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260923 19:50:02.798877 5801 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f8e149be0f0d456894956d425be24693" } modify_external_catalogs: true
I20260923 19:50:02.799091 5801 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f8e149be0f0d456894956d425be24693" } modify_external_catalogs: true
I20260923 19:50:02.800034 6457 tablet_bootstrap.cc:492] T b2762648045b4378bcc2c1234460c352 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:02.802471 6457 tablet_bootstrap.cc:654] T b2762648045b4378bcc2c1234460c352 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:02.807039 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_5fa9317aca724db689786f2e1c867c53"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:02.807847 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5fa9317aca724db689786f2e1c867c53 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:02.812903 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a34330ce2a604efca09f754e4d3e2127" } modify_external_catalogs: true
I20260923 19:50:02.812953 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_1a1905b61f0a4ba2bec7b293119af35c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:02.813110 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a34330ce2a604efca09f754e4d3e2127" } modify_external_catalogs: true
W20260923 19:50:02.813464 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a1905b61f0a4ba2bec7b293119af35c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:02.818096 5803 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_e6225c62c99144cdb7c222d165e1d7b5" } modify_external_catalogs: true
I20260923 19:50:02.818387 5803 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_e6225c62c99144cdb7c222d165e1d7b5" } modify_external_catalogs: true
I20260923 19:50:02.818960 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_d2249132d73a45758b64da97b668320e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:02.819602 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d2249132d73a45758b64da97b668320e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:02.819888 5797 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_c7fd5d8532d64b0490ae3f6df528e049" } new_table_name: "default.Table_da05e9879e314fd78f1b40a857a393fb" modify_external_catalogs: true
I20260923 19:50:02.825608 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_f68f50c8c0a74d59826e623c007a41a8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:02.826190 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f68f50c8c0a74d59826e623c007a41a8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:02.828594 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_85f67787052f46c2b29555acf4abc05c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:02.829305 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_85f67787052f46c2b29555acf4abc05c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:02.832651 5803 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet d40327145d4d44009f12358eacacf0dd
I20260923 19:50:02.836632 5805 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b8c60b9b057e474f83935688ca30222f" } modify_external_catalogs: true
I20260923 19:50:02.836880 5805 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b8c60b9b057e474f83935688ca30222f" } modify_external_catalogs: true
I20260923 19:50:02.842083 5805 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 034ce8f8f0b843fc9d10848350902800
I20260923 19:50:02.846268 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_76a4d42c4ee8417fa82124f036ec71de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:02.847317 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_76a4d42c4ee8417fa82124f036ec71de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:02.849009 5797 master_service.cc:960] ReplaceTablet: received request to replace tablet e071b9dd1db44af0a9d1b9e904f875a5 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:02.806806 6643 raft_consensus.cc:493] T a1e8b8e638ec438a86f05fa147cdb27c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:02.851383 6643 raft_consensus.cc:515] T a1e8b8e638ec438a86f05fa147cdb27c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.852137 6643 leader_election.cc:290] T a1e8b8e638ec438a86f05fa147cdb27c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:02.852329 6643 raft_consensus.cc:493] T 77f111a495f3429cb243417824095d02 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:02.852502 6643 raft_consensus.cc:515] T 77f111a495f3429cb243417824095d02 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.854204 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e8b8e638ec438a86f05fa147cdb27c" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:02.854236 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77f111a495f3429cb243417824095d02" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:02.862268 6457 tablet_bootstrap.cc:492] T b2762648045b4378bcc2c1234460c352 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:02.862509 6457 ts_tablet_manager.cc:1403] T b2762648045b4378bcc2c1234460c352 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.063s user 0.008s sys 0.005s
I20260923 19:50:02.863543 6457 raft_consensus.cc:359] T b2762648045b4378bcc2c1234460c352 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.863878 6457 raft_consensus.cc:385] T b2762648045b4378bcc2c1234460c352 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:02.863988 6457 raft_consensus.cc:740] T b2762648045b4378bcc2c1234460c352 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:02.864332 6457 consensus_queue.cc:260] T b2762648045b4378bcc2c1234460c352 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.867571 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d92791d5f2ea45269d76ff9c82be1880" } new_table_name: "default.Table_a32dfccff8cd4459919a575fd2a136ad" modify_external_catalogs: true
I20260923 19:50:02.871186 6178 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a2fbac8080441d4a9e03ff1d580bc8e with delete_type TABLET_DATA_DELETED (replaced by tablet 5adadf8caf5e4a9ab1107d0fb6a91735) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:02.872864 6454 ts_tablet_manager.cc:1434] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.178s user 0.002s sys 0.000s
W20260923 19:50:02.877159 5805 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b2762648045b4378bcc2c1234460c352 consensus state has no leader
I20260923 19:50:02.878288 6457 ts_tablet_manager.cc:1434] T b2762648045b4378bcc2c1234460c352 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.016s user 0.003s sys 0.000s
I20260923 19:50:02.879966 6457 tablet_bootstrap.cc:492] T 7504a2be25b54ed4bc539eb10199fe15 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:02.882297 6457 tablet_bootstrap.cc:654] T 7504a2be25b54ed4bc539eb10199fe15 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:02.700865 6459 ts_tablet_manager.cc:1929] T e655ab5873294e75a242709f069aabf2 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:02.885834 6459 log.cc:1199] T e655ab5873294e75a242709f069aabf2 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/e655ab5873294e75a242709f069aabf2
I20260923 19:50:02.887082 6459 ts_tablet_manager.cc:1950] T e655ab5873294e75a242709f069aabf2 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:02.891215 6457 tablet_bootstrap.cc:492] T 7504a2be25b54ed4bc539eb10199fe15 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:02.891400 6457 ts_tablet_manager.cc:1403] T 7504a2be25b54ed4bc539eb10199fe15 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.005s
I20260923 19:50:02.894085 6457 raft_consensus.cc:359] T 7504a2be25b54ed4bc539eb10199fe15 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.894330 6457 raft_consensus.cc:385] T 7504a2be25b54ed4bc539eb10199fe15 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:02.894438 6457 raft_consensus.cc:740] T 7504a2be25b54ed4bc539eb10199fe15 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:02.898113 6689 raft_consensus.cc:493] T 5adadf8caf5e4a9ab1107d0fb6a91735 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:02.898314 6689 raft_consensus.cc:515] T 5adadf8caf5e4a9ab1107d0fb6a91735 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.899104 6689 leader_election.cc:290] T 5adadf8caf5e4a9ab1107d0fb6a91735 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:02.899276 6689 raft_consensus.cc:493] T 8db0358af7634911820f99fe16605ca7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:02.899435 6689 raft_consensus.cc:515] T 8db0358af7634911820f99fe16605ca7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.900089 6689 leader_election.cc:290] T 8db0358af7634911820f99fe16605ca7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:02.901341 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adadf8caf5e4a9ab1107d0fb6a91735" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:02.901888 5995 leader_election.cc:343] T 5adadf8caf5e4a9ab1107d0fb6a91735 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:02.901933 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db0358af7634911820f99fe16605ca7" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:02.901985 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet e655ab5873294e75a242709f069aabf2 (table default.Table_f1e7b89f9642419a93fed2c6c85f26c8 [id=c048860d19b54812a5898d84095d2353]) successfully deleted
I20260923 19:50:02.893543 6454 tablet_bootstrap.cc:492] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:02.904426 6454 tablet_bootstrap.cc:654] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:02.906090 5995 leader_election.cc:343] T 8db0358af7634911820f99fe16605ca7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:02.906755 6459 tablet_replica.cc:333] T 09bb2ab5617a49d99e75191b3b48b85f P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:02.907058 6459 raft_consensus.cc:2243] T 09bb2ab5617a49d99e75191b3b48b85f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:02.907270 6459 raft_consensus.cc:2272] T 09bb2ab5617a49d99e75191b3b48b85f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:02.908000 6459 ts_tablet_manager.cc:1916] T 09bb2ab5617a49d99e75191b3b48b85f P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:02.908841 5700 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 65469.4us
I20260923 19:50:02.912284 6457 consensus_queue.cc:260] T 7504a2be25b54ed4bc539eb10199fe15 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.916706 6457 ts_tablet_manager.cc:1434] T 7504a2be25b54ed4bc539eb10199fe15 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.025s user 0.003s sys 0.000s
I20260923 19:50:02.917309 6735 tablet.cc:1751] T 5725a9cb95c448d0a5ea8114e90bc9fe P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260923 19:50:02.919090 6457 tablet_bootstrap.cc:492] T 115048f771764e41a3816e17a6c6cf94 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:02.924829 6457 tablet_bootstrap.cc:654] T 115048f771764e41a3816e17a6c6cf94 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:02.932689 6457 tablet_bootstrap.cc:492] T 115048f771764e41a3816e17a6c6cf94 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:02.932916 6457 ts_tablet_manager.cc:1403] T 115048f771764e41a3816e17a6c6cf94 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.004s
I20260923 19:50:02.937054 6457 raft_consensus.cc:359] T 115048f771764e41a3816e17a6c6cf94 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.937345 6457 raft_consensus.cc:385] T 115048f771764e41a3816e17a6c6cf94 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:02.937425 6457 raft_consensus.cc:740] T 115048f771764e41a3816e17a6c6cf94 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:02.937793 6457 consensus_queue.cc:260] T 115048f771764e41a3816e17a6c6cf94 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.940025 6457 ts_tablet_manager.cc:1434] T 115048f771764e41a3816e17a6c6cf94 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.007s user 0.001s sys 0.002s
I20260923 19:50:02.940321 6643 leader_election.cc:290] T 77f111a495f3429cb243417824095d02 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:02.940644 6280 leader_election.cc:343] T a1e8b8e638ec438a86f05fa147cdb27c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:02.940950 6280 leader_election.cc:343] T 77f111a495f3429cb243417824095d02 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:02.941677 6457 tablet_bootstrap.cc:492] T 6e726ee6a5494fd4b72c1ebef7d66b42 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:02.942268 6643 raft_consensus.cc:493] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:02.942436 6643 raft_consensus.cc:515] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.943100 6643 leader_election.cc:290] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:02.943707 6279 leader_election.cc:343] T 77f111a495f3429cb243417824095d02 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 77f111a495f3429cb243417824095d02
I20260923 19:50:02.943907 6279 leader_election.cc:304] T 77f111a495f3429cb243417824095d02 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:02.944247 6643 raft_consensus.cc:2749] T 77f111a495f3429cb243417824095d02 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:02.944741 6457 tablet_bootstrap.cc:654] T 6e726ee6a5494fd4b72c1ebef7d66b42 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:02.945506 6279 leader_election.cc:343] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 1a5f682ef2794a1fb9f5c4c2c1ee52e7
I20260923 19:50:02.946521 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e8b8e638ec438a86f05fa147cdb27c" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
W20260923 19:50:02.950193 6279 leader_election.cc:343] T a1e8b8e638ec438a86f05fa147cdb27c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:02.950493 6279 leader_election.cc:304] T a1e8b8e638ec438a86f05fa147cdb27c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:02.950933 6643 raft_consensus.cc:2749] T a1e8b8e638ec438a86f05fa147cdb27c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:02.954293 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_0fabac277720489788ff4ee29635ba66"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:02.955152 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0fabac277720489788ff4ee29635ba66 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:02.955432 6458 log.cc:1199] T e52d78a941a341d186dc00bbe7df96bf P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/e52d78a941a341d186dc00bbe7df96bf
I20260923 19:50:02.956314 6458 ts_tablet_manager.cc:1950] T e52d78a941a341d186dc00bbe7df96bf P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:02.960201 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5840c3d0f0f540f4aa28042cd39593cc" } new_table_name: "default.Table_22f84157ac664f81ae5266143e743737" modify_external_catalogs: true
I20260923 19:50:02.960798 5799 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ee62a8be7c124011a02b14ab41953bab" } new_table_name: "default.Table_c9b2a9eb014e4f61b869daae0ff44c60" modify_external_catalogs: true
I20260923 19:50:02.963877 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 65) took 3504 ms. Trace:
I20260923 19:50:02.964269 6458 rpcz_store.cc:276] 0923 19:49:59.458584 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:49:59.458883 (+ 299us) service_pool.cc:224] Handling call
0923 19:50:02.339460 (+2880577us) ts_tablet_manager.cc:1151] Deleting tablet e52d78a941a341d186dc00bbe7df96bf
0923 19:50:02.339469 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:02.427726 (+ 88257us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:02.702525 (+274799us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:02.962748 (+260223us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2880429}
W20260923 19:50:02.965036 6456 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.525s user 0.113s sys 0.165s
I20260923 19:50:02.965032 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet e52d78a941a341d186dc00bbe7df96bf (table default.Table_a04bbcc870f94f609935f519709a7d95 [id=ff751c756a0240a18ca02cbb9d44e73d]) successfully deleted
W20260923 19:50:02.965615 6456 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.526s user 0.113s sys 0.165s
I20260923 19:50:02.965432 6458 tablet_replica.cc:333] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:02.966815 6456 tablet_bootstrap.cc:492] T 115048f771764e41a3816e17a6c6cf94 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:02.968086 6456 ts_tablet_manager.cc:1403] T 115048f771764e41a3816e17a6c6cf94 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.535s user 0.115s sys 0.166s
I20260923 19:50:02.967162 6458 raft_consensus.cc:2243] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:02.969403 6458 raft_consensus.cc:2272] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:02.927125 6734 tablet.cc:1751] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260923 19:50:02.970165 6458 ts_tablet_manager.cc:1916] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:02.971575 6456 raft_consensus.cc:359] T 115048f771764e41a3816e17a6c6cf94 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.971581 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_a4bed55e26e74a499d9971feb59ba8bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:02.972968 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4bed55e26e74a499d9971feb59ba8bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:02.979498 5799 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d8c8bfa9b7424b9f80f76e0bb05cbc0c has no consensus state
W20260923 19:50:02.981918 5803 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c19298691d5d4209b2d1147a1aad2f6f has no consensus state
I20260923 19:50:02.986737 5799 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 5725a9cb95c448d0a5ea8114e90bc9fe (table default.Table_da05e9879e314fd78f1b40a857a393fb [id=d3b60b7fc1d84a46aa49932d5c3363ea]). Expected version 6 got 5
I20260923 19:50:02.987703 6734 tablet.cc:1751] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260923 19:50:02.988150 6735 tablet.cc:1751] T 5725a9cb95c448d0a5ea8114e90bc9fe P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260923 19:50:02.987282 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_6fc559685e30469ea0537af2f4cf6e1c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:02.994493 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6fc559685e30469ea0537af2f4cf6e1c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:02.995325 6456 raft_consensus.cc:385] T 115048f771764e41a3816e17a6c6cf94 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:02.995457 6456 raft_consensus.cc:740] T 115048f771764e41a3816e17a6c6cf94 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:02.995814 6456 consensus_queue.cc:260] T 115048f771764e41a3816e17a6c6cf94 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:02.996420 6456 ts_tablet_manager.cc:1434] T 115048f771764e41a3816e17a6c6cf94 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.028s user 0.000s sys 0.001s
I20260923 19:50:02.996833 6456 tablet_bootstrap.cc:492] T b302820d329a41f0a9a54501c079fcd7 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:02.999631 6456 tablet_bootstrap.cc:654] T b302820d329a41f0a9a54501c079fcd7 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:02.997238 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_42531a3057904620ad5e116c11f2d03b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:03.005154 6576 raft_consensus.cc:493] T e1752d6b46894796bdc94e6230e3327d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:03.005435 6576 raft_consensus.cc:515] T e1752d6b46894796bdc94e6230e3327d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.006345 6576 leader_election.cc:290] T e1752d6b46894796bdc94e6230e3327d P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:03.008051 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1752d6b46894796bdc94e6230e3327d" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:03.009929 5995 leader_election.cc:343] T e1752d6b46894796bdc94e6230e3327d P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:03.011065 6646 consensus_queue.cc:1048] T 259e4faa58f549699538317019be5daf P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260923 19:50:03.011507 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_42531a3057904620ad5e116c11f2d03b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:03.015894 6454 tablet_bootstrap.cc:492] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:03.016086 6454 ts_tablet_manager.cc:1403] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.123s user 0.001s sys 0.002s
I20260923 19:50:03.016893 6454 raft_consensus.cc:359] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.017125 6454 raft_consensus.cc:385] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:03.017241 6454 raft_consensus.cc:740] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:03.017552 6454 consensus_queue.cc:260] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.020103 5803 master_service.cc:960] ReplaceTablet: received request to replace tablet 15c0dc02ba964af38ca9f76161722588 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:03.026052 5805 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_da05e9879e314fd78f1b40a857a393fb [id=d3b60b7fc1d84a46aa49932d5c3363ea] alter complete (version 6)
I20260923 19:50:03.032955 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a5f682ef2794a1fb9f5c4c2c1ee52e7" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:03.038111 6576 raft_consensus.cc:493] T b2762648045b4378bcc2c1234460c352 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:03.038303 6576 raft_consensus.cc:515] T b2762648045b4378bcc2c1234460c352 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.039139 6576 leader_election.cc:290] T b2762648045b4378bcc2c1234460c352 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:03.039948 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2762648045b4378bcc2c1234460c352" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:03.040699 5995 leader_election.cc:343] T b2762648045b4378bcc2c1234460c352 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:02.979125 6458 ts_tablet_manager.cc:1929] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:03.046347 6458 log.cc:1199] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/1a5f682ef2794a1fb9f5c4c2c1ee52e7
I20260923 19:50:03.046908 6458 ts_tablet_manager.cc:1950] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:03.047468 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 66) took 3418 ms. Trace:
I20260923 19:50:03.047717 6458 rpcz_store.cc:276] 0923 19:49:59.629255 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:49:59.629313 (+ 58us) service_pool.cc:224] Handling call
0923 19:50:02.965332 (+3336019us) ts_tablet_manager.cc:1151] Deleting tablet 1a5f682ef2794a1fb9f5c4c2c1ee52e7
0923 19:50:02.965349 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:02.975065 (+ 9716us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:02.979051 (+ 3986us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:03.047408 (+ 68357us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3335728}
I20260923 19:50:03.048357 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 1a5f682ef2794a1fb9f5c4c2c1ee52e7 (table default.Table_3a938c91580b4d23a2a0fad133090624 [id=767c530f4e214408a45adcb31c9d0f28]) successfully deleted
I20260923 19:50:03.048827 6458 tablet_replica.cc:333] T 199843bdd7184df58be9a4a06a5ffb8b P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:03.031386 6345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adadf8caf5e4a9ab1107d0fb6a91735" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:03.032024 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db0358af7634911820f99fe16605ca7" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:03.032624 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1752d6b46894796bdc94e6230e3327d" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:03.049582 6344 raft_consensus.cc:2468] T 8db0358af7634911820f99fe16605ca7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 0.
I20260923 19:50:03.049639 6341 raft_consensus.cc:2468] T e1752d6b46894796bdc94e6230e3327d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 0.
I20260923 19:50:03.049728 6458 raft_consensus.cc:2243] T 199843bdd7184df58be9a4a06a5ffb8b P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:03.049958 6457 tablet_bootstrap.cc:492] T 6e726ee6a5494fd4b72c1ebef7d66b42 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:03.050124 6457 ts_tablet_manager.cc:1403] T 6e726ee6a5494fd4b72c1ebef7d66b42 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.109s user 0.009s sys 0.001s
I20260923 19:50:03.050122 6458 raft_consensus.cc:2272] T 199843bdd7184df58be9a4a06a5ffb8b P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:03.050972 6458 ts_tablet_manager.cc:1916] T 199843bdd7184df58be9a4a06a5ffb8b P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:03.050981 6457 raft_consensus.cc:359] T 6e726ee6a5494fd4b72c1ebef7d66b42 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.051177 6457 raft_consensus.cc:385] T 6e726ee6a5494fd4b72c1ebef7d66b42 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:03.051285 6457 raft_consensus.cc:740] T 6e726ee6a5494fd4b72c1ebef7d66b42 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
W20260923 19:50:03.037362 6280 leader_election.cc:343] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:03.051606 6457 consensus_queue.cc:260] T 6e726ee6a5494fd4b72c1ebef7d66b42 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.053251 6457 ts_tablet_manager.cc:1434] T 6e726ee6a5494fd4b72c1ebef7d66b42 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:50:03.054711 6457 tablet_bootstrap.cc:492] T 640a98d3a845461e8d4f07041ab515c7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:03.058354 6457 tablet_bootstrap.cc:654] T 640a98d3a845461e8d4f07041ab515c7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:03.058740 6280 leader_election.cc:304] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:03.059166 6728 raft_consensus.cc:493] T 115048f771764e41a3816e17a6c6cf94 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:03.059300 6740 tablet.cc:1751] T 5725a9cb95c448d0a5ea8114e90bc9fe P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260923 19:50:03.059363 6728 raft_consensus.cc:515] T 115048f771764e41a3816e17a6c6cf94 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.060609 6728 leader_election.cc:290] T 115048f771764e41a3816e17a6c6cf94 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:03.060877 6280 raft_consensus.cc:2686] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 2bf41435f70447f19992d368ca6b46bd: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260923 19:50:03.060957 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115048f771764e41a3816e17a6c6cf94" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:03.061156 6059 raft_consensus.cc:2468] T 115048f771764e41a3816e17a6c6cf94 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:03.061906 6279 leader_election.cc:304] T 115048f771764e41a3816e17a6c6cf94 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:03.062201 6454 ts_tablet_manager.cc:1434] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.046s user 0.003s sys 0.000s
I20260923 19:50:03.062274 6728 raft_consensus.cc:2804] T 115048f771764e41a3816e17a6c6cf94 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:03.062390 6728 raft_consensus.cc:493] T 115048f771764e41a3816e17a6c6cf94 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:03.062480 6728 raft_consensus.cc:3060] T 115048f771764e41a3816e17a6c6cf94 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:03.062897 6454 tablet_bootstrap.cc:492] T 32c8333073574fe79bfc3e33f3249256 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:03.065629 6454 tablet_bootstrap.cc:654] T 32c8333073574fe79bfc3e33f3249256 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:03.065959 6576 raft_consensus.cc:493] T 063fc0e77d294ddf8a02e9ab5968a5e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:03.066176 6576 raft_consensus.cc:515] T 063fc0e77d294ddf8a02e9ab5968a5e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.066918 6576 leader_election.cc:290] T 063fc0e77d294ddf8a02e9ab5968a5e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:03.067354 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063fc0e77d294ddf8a02e9ab5968a5e3" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:03.067396 6728 raft_consensus.cc:515] T 115048f771764e41a3816e17a6c6cf94 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.067632 5996 leader_election.cc:304] T 8db0358af7634911820f99fe16605ca7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
W20260923 19:50:03.067924 5995 leader_election.cc:343] T 063fc0e77d294ddf8a02e9ab5968a5e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:03.068113 6576 raft_consensus.cc:2804] T 8db0358af7634911820f99fe16605ca7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:03.068212 6576 raft_consensus.cc:493] T 8db0358af7634911820f99fe16605ca7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:03.068313 6576 raft_consensus.cc:3060] T 8db0358af7634911820f99fe16605ca7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:03.069015 6728 leader_election.cc:290] T 115048f771764e41a3816e17a6c6cf94 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:03.069301 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115048f771764e41a3816e17a6c6cf94" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:03.069500 6059 raft_consensus.cc:3060] T 115048f771764e41a3816e17a6c6cf94 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:03.072790 6576 raft_consensus.cc:515] T 8db0358af7634911820f99fe16605ca7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.073450 6457 tablet_bootstrap.cc:492] T 640a98d3a845461e8d4f07041ab515c7 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:03.073662 6457 ts_tablet_manager.cc:1403] T 640a98d3a845461e8d4f07041ab515c7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.019s user 0.007s sys 0.000s
I20260923 19:50:03.073966 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db0358af7634911820f99fe16605ca7" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
W20260923 19:50:03.074504 5995 leader_election.cc:343] T 8db0358af7634911820f99fe16605ca7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:03.074679 6457 raft_consensus.cc:359] T 640a98d3a845461e8d4f07041ab515c7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.076465 6457 raft_consensus.cc:385] T 640a98d3a845461e8d4f07041ab515c7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:03.076689 6457 raft_consensus.cc:740] T 640a98d3a845461e8d4f07041ab515c7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:03.076889 6576 leader_election.cc:290] T 8db0358af7634911820f99fe16605ca7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:03.077297 6457 consensus_queue.cc:260] T 640a98d3a845461e8d4f07041ab515c7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.079839 6457 ts_tablet_manager.cc:1434] T 640a98d3a845461e8d4f07041ab515c7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260923 19:50:03.081029 6457 tablet_bootstrap.cc:492] T b302820d329a41f0a9a54501c079fcd7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:03.084504 6059 raft_consensus.cc:2468] T 115048f771764e41a3816e17a6c6cf94 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:03.085140 6279 leader_election.cc:304] T 115048f771764e41a3816e17a6c6cf94 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:03.085521 6728 raft_consensus.cc:2804] T 115048f771764e41a3816e17a6c6cf94 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:03.085678 6728 raft_consensus.cc:697] T 115048f771764e41a3816e17a6c6cf94 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:03.086014 6728 consensus_queue.cc:237] T 115048f771764e41a3816e17a6c6cf94 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:03.087210 5700 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 51796.7us
I20260923 19:50:03.090482 5799 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 115048f771764e41a3816e17a6c6cf94 (table default.Table_62802f9e844c4c16bf9cb0d04a630fa9 [id=498c667413e24c7c800fe5eae263cf22]). Expected version 1 got 0
I20260923 19:50:03.091686 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_036d9052e0264e978bf3e3698ca8c08b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:03.092494 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_036d9052e0264e978bf3e3698ca8c08b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:03.093243 6459 ts_tablet_manager.cc:1929] T 09bb2ab5617a49d99e75191b3b48b85f P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:03.094450 5996 leader_election.cc:304] T e1752d6b46894796bdc94e6230e3327d P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:03.095108 6576 raft_consensus.cc:2804] T e1752d6b46894796bdc94e6230e3327d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:03.095290 6576 raft_consensus.cc:493] T e1752d6b46894796bdc94e6230e3327d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:03.095448 6576 raft_consensus.cc:3060] T e1752d6b46894796bdc94e6230e3327d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:03.097165 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_b980dd990237405ea45e67525bb34249"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:03.097934 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b980dd990237405ea45e67525bb34249 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:03.099818 6576 raft_consensus.cc:515] T e1752d6b46894796bdc94e6230e3327d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:03.101191 5996 leader_election.cc:343] T 5adadf8caf5e4a9ab1107d0fb6a91735 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:03.101344 5996 leader_election.cc:304] T 5adadf8caf5e4a9ab1107d0fb6a91735 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:03.101581 6689 raft_consensus.cc:493] T 64a38bbd3fbd4738a73e78e3f6436fe5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:03.101774 6689 raft_consensus.cc:515] T 64a38bbd3fbd4738a73e78e3f6436fe5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.102519 6689 leader_election.cc:290] T 64a38bbd3fbd4738a73e78e3f6436fe5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:03.102756 6689 raft_consensus.cc:2749] T 5adadf8caf5e4a9ab1107d0fb6a91735 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:03.103219 6456 tablet_bootstrap.cc:492] T b302820d329a41f0a9a54501c079fcd7 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:03.103416 6456 ts_tablet_manager.cc:1403] T b302820d329a41f0a9a54501c079fcd7 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.107s user 0.000s sys 0.004s
I20260923 19:50:03.104405 6456 raft_consensus.cc:359] T b302820d329a41f0a9a54501c079fcd7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.104601 6456 raft_consensus.cc:385] T b302820d329a41f0a9a54501c079fcd7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:03.104696 6456 raft_consensus.cc:740] T b302820d329a41f0a9a54501c079fcd7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:03.104947 6456 consensus_queue.cc:260] T b302820d329a41f0a9a54501c079fcd7 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.105508 6456 ts_tablet_manager.cc:1434] T b302820d329a41f0a9a54501c079fcd7 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:50:03.106638 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 15c0dc02ba964af38ca9f76161722588
I20260923 19:50:03.107307 5803 catalog_manager.cc:6934] ReplaceTablet: tablet 15c0dc02ba964af38ca9f76161722588 deleted and replaced by tablet 85b7dcf131c54187a6e61f8503c797f8
I20260923 19:50:03.109290 5798 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet f302f91c8ef44237b1c9909d88dacbff (table default.Table_f3f7926d9a214e1bb8b8b42655baef50 [id=4300ad9818924415b6414ea9f89445ce]). Expected version 1 got 0
I20260923 19:50:03.109647 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet 15c0dc02ba964af38ca9f76161722588 with delete_type TABLET_DATA_DELETED (replaced by tablet 85b7dcf131c54187a6e61f8503c797f8) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:03.109769 5798 catalog_manager.cc:5838] T a10110f4a2b34b61a4cc586d65981606 P e546f660e7e541d1aa9ae38e5ee5b9c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193). New cstate: current_term: 1 leader_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: UNKNOWN } } }
I20260923 19:50:03.110431 5798 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet a10110f4a2b34b61a4cc586d65981606 (table default.Table_b455e09005774effa019e6ddc31cd521 [id=019ceccbcb1041cc9e5625274c45a0f3]). Expected version 1 got 0
W20260923 19:50:03.110630 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 15c0dc02ba964af38ca9f76161722588 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15c0dc02ba964af38ca9f76161722588 already in progress: creating tablet
W20260923 19:50:03.111828 5796 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f302f91c8ef44237b1c9909d88dacbff consensus state has no leader
I20260923 19:50:03.113837 6457 tablet_bootstrap.cc:654] T b302820d329a41f0a9a54501c079fcd7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:03.114660 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 1fcd1c1bfd2c437a955c34569605a6d4 (DEFAULT_TABLE table=default.Table_a1e299fcb1ab48a58822c77a8a198c90 [id=05124f851929441c950eb291a1d269a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.115119 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fcd1c1bfd2c437a955c34569605a6d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.116966 6039 tablet_service.cc:1511] Processing CreateTablet for tablet 7b455812687f42848df5290d0cdbc312 (DEFAULT_TABLE table=default.Table_0fd85280951f4a8586bf9aae46daa067 [id=e263e510102443df8fd2b5886fa01053]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.117555 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b455812687f42848df5290d0cdbc312. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.105861 6456 tablet_bootstrap.cc:492] T f2d9f1a0fae849ae8083eba082055fe9 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:03.108510 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet 15c0dc02ba964af38ca9f76161722588 with delete_type TABLET_DATA_DELETED (replaced by tablet 85b7dcf131c54187a6e61f8503c797f8) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:03.118235 6315 tablet_service.cc:1511] Processing CreateTablet for tablet 1fcd1c1bfd2c437a955c34569605a6d4 (DEFAULT_TABLE table=default.Table_a1e299fcb1ab48a58822c77a8a198c90 [id=05124f851929441c950eb291a1d269a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.120573 6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fcd1c1bfd2c437a955c34569605a6d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.120471 6035 tablet_service.cc:1511] Processing CreateTablet for tablet 601a0ff319cc4c9a898d52bbcb19184b (DEFAULT_TABLE table=default.Table_0b41cc085cff4695b3729e5b2ec8bbbb [id=df481a17409f4078a57a0aef11bef720]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.120954 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 601a0ff319cc4c9a898d52bbcb19184b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.121439 6456 tablet_bootstrap.cc:654] T f2d9f1a0fae849ae8083eba082055fe9 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:03.122154 6031 tablet_service.cc:1511] Processing CreateTablet for tablet 7b1601590508479c8f401cd09d9f4c3b (DEFAULT_TABLE table=default.Table_d824a438d0804f58b8b89f6f0f0f964e [id=83a0bf386540479b9e915b9c66a31376]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.122951 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b1601590508479c8f401cd09d9f4c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.129618 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 601a0ff319cc4c9a898d52bbcb19184b (DEFAULT_TABLE table=default.Table_0b41cc085cff4695b3729e5b2ec8bbbb [id=df481a17409f4078a57a0aef11bef720]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.130295 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 601a0ff319cc4c9a898d52bbcb19184b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.135685 5796 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_299a64a07c544bb28305e07bd411f045" } new_table_name: "default.Table_b3579cbf488c4d1eb5f605ab4e11c340" modify_external_catalogs: true
I20260923 19:50:03.139575 5800 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 3919b15a00eb4fb08008f065f556c760
I20260923 19:50:03.140208 5800 catalog_manager.cc:6934] ReplaceTablet: tablet 3919b15a00eb4fb08008f065f556c760 deleted and replaced by tablet f74e7cb3e5f54dfdb2280c795ce2ce53
I20260923 19:50:03.140705 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_295f07d1ca7345d5a18a80da04089ca2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:03.140798 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet 3919b15a00eb4fb08008f065f556c760 with delete_type TABLET_DATA_DELETED (replaced by tablet f74e7cb3e5f54dfdb2280c795ce2ce53) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:03.141396 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_295f07d1ca7345d5a18a80da04089ca2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:03.142531 6458 ts_tablet_manager.cc:1929] T 199843bdd7184df58be9a4a06a5ffb8b P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:03.142658 6458 log.cc:1199] T 199843bdd7184df58be9a4a06a5ffb8b P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/199843bdd7184df58be9a4a06a5ffb8b
I20260923 19:50:03.143554 6458 ts_tablet_manager.cc:1950] T 199843bdd7184df58be9a4a06a5ffb8b P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:03.144421 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 67) took 3501 ms. Trace:
I20260923 19:50:03.144482 6643 raft_consensus.cc:493] T 640a98d3a845461e8d4f07041ab515c7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:03.144481 5803 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_41c2e67e9c7e4fa192fc124e05c2d34f" } modify_external_catalogs: true
I20260923 19:50:03.144649 5803 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_41c2e67e9c7e4fa192fc124e05c2d34f" } modify_external_catalogs: true
I20260923 19:50:03.144649 6643 raft_consensus.cc:515] T 640a98d3a845461e8d4f07041ab515c7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.145287 6643 leader_election.cc:290] T 640a98d3a845461e8d4f07041ab515c7 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:03.101279 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1752d6b46894796bdc94e6230e3327d" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:03.146755 6459 log.cc:1199] T 09bb2ab5617a49d99e75191b3b48b85f P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/09bb2ab5617a49d99e75191b3b48b85f
I20260923 19:50:03.147594 6459 ts_tablet_manager.cc:1950] T 09bb2ab5617a49d99e75191b3b48b85f P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:03.148506 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet b302820d329a41f0a9a54501c079fcd7
I20260923 19:50:03.107563 6182 tablet_service.cc:1558] Processing DeleteTablet for tablet 15c0dc02ba964af38ca9f76161722588 with delete_type TABLET_DATA_DELETED (replaced by tablet 85b7dcf131c54187a6e61f8503c797f8) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:03.112674 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64a38bbd3fbd4738a73e78e3f6436fe5" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:03.150452 6454 tablet_bootstrap.cc:492] T 32c8333073574fe79bfc3e33f3249256 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:03.112994 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115048f771764e41a3816e17a6c6cf94" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:03.150638 6454 ts_tablet_manager.cc:1403] T 32c8333073574fe79bfc3e33f3249256 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.088s user 0.003s sys 0.000s
I20260923 19:50:03.118995 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 7b455812687f42848df5290d0cdbc312 (DEFAULT_TABLE table=default.Table_0fd85280951f4a8586bf9aae46daa067 [id=e263e510102443df8fd2b5886fa01053]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.119349 6176 tablet_service.cc:1511] Processing CreateTablet for tablet 601a0ff319cc4c9a898d52bbcb19184b (DEFAULT_TABLE table=default.Table_0b41cc085cff4695b3729e5b2ec8bbbb [id=df481a17409f4078a57a0aef11bef720]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.119699 6164 tablet_service.cc:1511] Processing CreateTablet for tablet 1fcd1c1bfd2c437a955c34569605a6d4 (DEFAULT_TABLE table=default.Table_a1e299fcb1ab48a58822c77a8a198c90 [id=05124f851929441c950eb291a1d269a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.145573 6744 raft_consensus.cc:493] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:03.151141 6744 raft_consensus.cc:515] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.151621 6454 raft_consensus.cc:359] T 32c8333073574fe79bfc3e33f3249256 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.151903 6744 leader_election.cc:290] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:03.152323 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet d2298d814a104f5cb62196be3bf0dae6
I20260923 19:50:03.153074 5804 master_service.cc:960] ReplaceTablet: received request to replace tablet 7504a2be25b54ed4bc539eb10199fe15 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:03.153051 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dbc0e17d77140f6abe9ee26c8ec13ee" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:03.151786 6454 raft_consensus.cc:385] T 32c8333073574fe79bfc3e33f3249256 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:03.153215 6454 raft_consensus.cc:740] T 32c8333073574fe79bfc3e33f3249256 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:03.153295 6343 raft_consensus.cc:2393] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61022dd7f2f14dc19aebe3af5f08f430 in current term 1: Already voted for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in this term.
I20260923 19:50:03.153450 6454 consensus_queue.cc:260] T 32c8333073574fe79bfc3e33f3249256 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.154220 6454 ts_tablet_manager.cc:1434] T 32c8333073574fe79bfc3e33f3249256 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
W20260923 19:50:03.155328 6137 leader_election.cc:343] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 4dbc0e17d77140f6abe9ee26c8ec13ee
I20260923 19:50:03.155454 6137 leader_election.cc:304] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:03.155854 6744 raft_consensus.cc:3060] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:03.156785 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_30ce30e86cff4c8f9995423040b349c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:03.157511 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_30ce30e86cff4c8f9995423040b349c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:03.157636 6172 tablet_service.cc:1511] Processing CreateTablet for tablet 7e41501bf01e4765853c27e4cac21e2b (DEFAULT_TABLE table=default.Table_7b49fa59d61b48669d03e8b1c874baf5 [id=9b387d21c8824514b7f3fae8c26b489d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.158774 6744 raft_consensus.cc:2749] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:03.159050 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet d2298d814a104f5cb62196be3bf0dae6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:03.159391 6173 tablet_service.cc:1511] Processing CreateTablet for tablet 7b1601590508479c8f401cd09d9f4c3b (DEFAULT_TABLE table=default.Table_d824a438d0804f58b8b89f6f0f0f964e [id=83a0bf386540479b9e915b9c66a31376]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.159518 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet b302820d329a41f0a9a54501c079fcd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:03.159811 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 465371cfbe544ba98e6eea05033ecf05 (DEFAULT_TABLE table=default.Table_59faad35003f4e6f95781fbb1895f6aa [id=b28193cd587649a4b2c450473da92564]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.159408 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 18bab39d85f94f4283f0b18c1c9b48a2 (DEFAULT_TABLE table=default.Table_a0bee41bcb2d439fb8619a6c19152813 [id=8a710c10b5ca42548116d743cb0812c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.160573 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 09bb2ab5617a49d99e75191b3b48b85f (table default.Table_faa53cf5cc5541afb7b391368bdc55f7 [id=4a8f28e842e94d628326ca83935f23c6]) successfully deleted
I20260923 19:50:03.160575 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 7b455812687f42848df5290d0cdbc312 (DEFAULT_TABLE table=default.Table_0fd85280951f4a8586bf9aae46daa067 [id=e263e510102443df8fd2b5886fa01053]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.144563 6458 rpcz_store.cc:276] 0923 19:49:59.643310 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:49:59.643525 (+ 215us) service_pool.cc:224] Handling call
0923 19:50:03.048739 (+3405214us) ts_tablet_manager.cc:1151] Deleting tablet 199843bdd7184df58be9a4a06a5ffb8b
0923 19:50:03.048751 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:03.055671 (+ 6920us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:03.142434 (+ 86763us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:03.144378 (+ 1944us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3404945}
I20260923 19:50:03.161165 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b455812687f42848df5290d0cdbc312. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.161518 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_d937cfba979e408ebde3725792f5e4e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:03.162086 6314 tablet_service.cc:1558] Processing DeleteTablet for tablet b302820d329a41f0a9a54501c079fcd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:03.162215 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d937cfba979e408ebde3725792f5e4e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:03.162320 6316 tablet_service.cc:1558] Processing DeleteTablet for tablet d2298d814a104f5cb62196be3bf0dae6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:03.163111 6324 tablet_service.cc:1511] Processing CreateTablet for tablet 7b1601590508479c8f401cd09d9f4c3b (DEFAULT_TABLE table=default.Table_d824a438d0804f58b8b89f6f0f0f964e [id=83a0bf386540479b9e915b9c66a31376]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.163513 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b1601590508479c8f401cd09d9f4c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.161152 6458 tablet_replica.cc:333] T 32c8333073574fe79bfc3e33f3249256 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:03.166579 6172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e41501bf01e4765853c27e4cac21e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.167606 6176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 601a0ff319cc4c9a898d52bbcb19184b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.168215 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet d2298d814a104f5cb62196be3bf0dae6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:03.168478 6025 tablet_service.cc:1511] Processing CreateTablet for tablet 465371cfbe544ba98e6eea05033ecf05 (DEFAULT_TABLE table=default.Table_59faad35003f4e6f95781fbb1895f6aa [id=b28193cd587649a4b2c450473da92564]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.168883 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 465371cfbe544ba98e6eea05033ecf05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.170681 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b455812687f42848df5290d0cdbc312. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.174108 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fcd1c1bfd2c437a955c34569605a6d4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:03.174515 5995 leader_election.cc:343] T e1752d6b46894796bdc94e6230e3327d P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:03.174583 6032 tablet_service.cc:1511] Processing CreateTablet for tablet 7e41501bf01e4765853c27e4cac21e2b (DEFAULT_TABLE table=default.Table_7b49fa59d61b48669d03e8b1c874baf5 [id=9b387d21c8824514b7f3fae8c26b489d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:03.174767 5995 leader_election.cc:343] T 64a38bbd3fbd4738a73e78e3f6436fe5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:03.175020 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e41501bf01e4765853c27e4cac21e2b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:03.176070 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 3919b15a00eb4fb08008f065f556c760 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3919b15a00eb4fb08008f065f556c760 already in progress: creating tablet
W20260923 19:50:03.176366 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet d2298d814a104f5cb62196be3bf0dae6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2298d814a104f5cb62196be3bf0dae6 already in progress: creating tablet
I20260923 19:50:03.176692 6182 tablet_service.cc:1558] Processing DeleteTablet for tablet 3919b15a00eb4fb08008f065f556c760 with delete_type TABLET_DATA_DELETED (replaced by tablet f74e7cb3e5f54dfdb2280c795ce2ce53) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:03.178882 6058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "640a98d3a845461e8d4f07041ab515c7" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:03.179139 6058 raft_consensus.cc:2468] T 640a98d3a845461e8d4f07041ab515c7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:03.179580 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b1601590508479c8f401cd09d9f4c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.181455 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 18bab39d85f94f4283f0b18c1c9b48a2 (DEFAULT_TABLE table=default.Table_a0bee41bcb2d439fb8619a6c19152813 [id=8a710c10b5ca42548116d743cb0812c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.181903 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18bab39d85f94f4283f0b18c1c9b48a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.182178 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 465371cfbe544ba98e6eea05033ecf05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.184998 6458 raft_consensus.cc:2243] T 32c8333073574fe79bfc3e33f3249256 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:03.185220 6458 raft_consensus.cc:2272] T 32c8333073574fe79bfc3e33f3249256 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:03.186038 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet e071b9dd1db44af0a9d1b9e904f875a5
I20260923 19:50:03.186607 5797 catalog_manager.cc:6934] ReplaceTablet: tablet e071b9dd1db44af0a9d1b9e904f875a5 deleted and replaced by tablet b18548ba557f448880c5e617fc03cbe0
I20260923 19:50:03.186685 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18bab39d85f94f4283f0b18c1c9b48a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.187330 6172 tablet_service.cc:1558] Processing DeleteTablet for tablet e071b9dd1db44af0a9d1b9e904f875a5 with delete_type TABLET_DATA_DELETED (replaced by tablet b18548ba557f448880c5e617fc03cbe0) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:03.188342 5797 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a5d9d7b0e0b449ae8791e459b7d88f18" } modify_external_catalogs: true
I20260923 19:50:03.188544 5797 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a5d9d7b0e0b449ae8791e459b7d88f18" } modify_external_catalogs: true
W20260923 19:50:03.189090 6280 leader_election.cc:343] T 115048f771764e41a3816e17a6c6cf94 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:03.190354 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "640a98d3a845461e8d4f07041ab515c7" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:03.190790 6576 leader_election.cc:290] T e1752d6b46894796bdc94e6230e3327d P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:03.190977 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115048f771764e41a3816e17a6c6cf94" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:03.191270 6172 tablet_service.cc:1558] Processing DeleteTablet for tablet 32c8333073574fe79bfc3e33f3249256 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:03.166805 6316 tablet_service.cc:1511] Processing CreateTablet for tablet 465371cfbe544ba98e6eea05033ecf05 (DEFAULT_TABLE table=default.Table_59faad35003f4e6f95781fbb1895f6aa [id=b28193cd587649a4b2c450473da92564]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.195672 6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 465371cfbe544ba98e6eea05033ecf05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.185837 6458 ts_tablet_manager.cc:1916] T 32c8333073574fe79bfc3e33f3249256 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:03.167138 6314 tablet_service.cc:1511] Processing CreateTablet for tablet 7e41501bf01e4765853c27e4cac21e2b (DEFAULT_TABLE table=default.Table_7b49fa59d61b48669d03e8b1c874baf5 [id=9b387d21c8824514b7f3fae8c26b489d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.198804 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet e071b9dd1db44af0a9d1b9e904f875a5 with delete_type TABLET_DATA_DELETED (replaced by tablet b18548ba557f448880c5e617fc03cbe0) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:03.182180 6279 leader_election.cc:304] T 640a98d3a845461e8d4f07041ab515c7 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:03.206082 6576 raft_consensus.cc:493] T 9ed630e738c54ed38b9933f95fb552c5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:03.206327 6576 raft_consensus.cc:515] T 9ed630e738c54ed38b9933f95fb552c5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:03.207278 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet e071b9dd1db44af0a9d1b9e904f875a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e071b9dd1db44af0a9d1b9e904f875a5 already in progress: creating tablet
I20260923 19:50:03.207726 6576 leader_election.cc:290] T 9ed630e738c54ed38b9933f95fb552c5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:03.207871 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ed630e738c54ed38b9933f95fb552c5" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:03.212750 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e41501bf01e4765853c27e4cac21e2b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:03.214989 5796 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d91a56bace854494b7affd6c766b2847 consensus state has no leader
W20260923 19:50:03.208469 5995 leader_election.cc:343] T 9ed630e738c54ed38b9933f95fb552c5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:03.218232 6576 raft_consensus.cc:493] T f7e282b6699a4ce9837d221132a1f54e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:03.218423 6576 raft_consensus.cc:515] T f7e282b6699a4ce9837d221132a1f54e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.218762 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_fc95f21fffc649e3953772b8c4ddbdfb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:03.217535 5996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.195:32855, user_credentials={real_user=slave}} blocked reactor thread for 116349us
W20260923 19:50:03.219558 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fc95f21fffc649e3953772b8c4ddbdfb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:03.221531 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 7504a2be25b54ed4bc539eb10199fe15
I20260923 19:50:03.221837 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e282b6699a4ce9837d221132a1f54e" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:03.221838 6312 tablet_service.cc:1511] Processing CreateTablet for tablet c0ff8838ab17433ab733d3b293d4964f (DEFAULT_TABLE table=default.Table_c67ffb2902d446cba5c75e4a3d46d559 [id=b703874c0f19412b96d6776a2cda5caa]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:03.222406 5995 leader_election.cc:343] T f7e282b6699a4ce9837d221132a1f54e P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:03.222543 5804 catalog_manager.cc:6934] ReplaceTablet: tablet 7504a2be25b54ed4bc539eb10199fe15 deleted and replaced by tablet 15a9d1d4adaa402f90d774e77010c928
W20260923 19:50:03.222807 6280 leader_election.cc:343] T 640a98d3a845461e8d4f07041ab515c7 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:03.222949 5804 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_9a02c99394944c41a1e4da7ce679e401" } new_table_name: "default.Table_20badc86d4ef4e2fb377e8e109782afd" modify_external_catalogs: true
I20260923 19:50:03.217676 5796 catalog_manager.cc:5838] T 115048f771764e41a3816e17a6c6cf94 P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:03.225549 6643 raft_consensus.cc:2804] T 640a98d3a845461e8d4f07041ab515c7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:03.225660 6643 raft_consensus.cc:493] T 640a98d3a845461e8d4f07041ab515c7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:03.225643 5796 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 115048f771764e41a3816e17a6c6cf94 (table default.Table_62802f9e844c4c16bf9cb0d04a630fa9 [id=498c667413e24c7c800fe5eae263cf22]). Expected version 1 got 0
I20260923 19:50:03.226032 5796 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 5725a9cb95c448d0a5ea8114e90bc9fe (table default.Table_da05e9879e314fd78f1b40a857a393fb [id=d3b60b7fc1d84a46aa49932d5c3363ea]). Expected version 6 got 5
I20260923 19:50:03.226331 6643 raft_consensus.cc:3060] T 640a98d3a845461e8d4f07041ab515c7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:03.226348 6689 raft_consensus.cc:493] T f302f91c8ef44237b1c9909d88dacbff P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:03.226507 6689 raft_consensus.cc:515] T f302f91c8ef44237b1c9909d88dacbff P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.226778 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet e071b9dd1db44af0a9d1b9e904f875a5 with delete_type TABLET_DATA_DELETED (replaced by tablet b18548ba557f448880c5e617fc03cbe0) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:03.227022 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2762648045b4378bcc2c1234460c352" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:03.227221 6689 leader_election.cc:290] T f302f91c8ef44237b1c9909d88dacbff P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:03.227289 5800 master_service.cc:960] ReplaceTablet: received request to replace tablet 6e726ee6a5494fd4b72c1ebef7d66b42 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:03.227605 6319 tablet_service.cc:1511] Processing CreateTablet for tablet 18bab39d85f94f4283f0b18c1c9b48a2 (DEFAULT_TABLE table=default.Table_a0bee41bcb2d439fb8619a6c19152813 [id=8a710c10b5ca42548116d743cb0812c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.227849 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f302f91c8ef44237b1c9909d88dacbff" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:03.227941 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet 7504a2be25b54ed4bc539eb10199fe15 with delete_type TABLET_DATA_DELETED (replaced by tablet 15a9d1d4adaa402f90d774e77010c928) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:03.228828 5995 leader_election.cc:343] T f302f91c8ef44237b1c9909d88dacbff P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:03.228899 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0ff8838ab17433ab733d3b293d4964f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.229103 6172 tablet_service.cc:1511] Processing CreateTablet for tablet c0ff8838ab17433ab733d3b293d4964f (DEFAULT_TABLE table=default.Table_c67ffb2902d446cba5c75e4a3d46d559 [id=b703874c0f19412b96d6776a2cda5caa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.229501 6172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0ff8838ab17433ab733d3b293d4964f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.229980 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_496c5379825d4fe8bb113e6a77b05390"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:03.230580 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_496c5379825d4fe8bb113e6a77b05390 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:03.232108 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 194494af2c424a55a772f3858af63c2c
I20260923 19:50:03.232613 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063fc0e77d294ddf8a02e9ab5968a5e3" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:03.233467 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a5a21cb4e5bc4aa8be7ed7ac43e94638" } new_table_name: "default.Table_493eae9e089b423ca42a863b541f4ec4" modify_external_catalogs: true
I20260923 19:50:03.233721 6319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18bab39d85f94f4283f0b18c1c9b48a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.234675 6345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8db0358af7634911820f99fe16605ca7" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:03.234865 6345 raft_consensus.cc:3060] T 8db0358af7634911820f99fe16605ca7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:03.236878 6178 tablet_service.cc:1558] Processing DeleteTablet for tablet 7504a2be25b54ed4bc539eb10199fe15 with delete_type TABLET_DATA_DELETED (replaced by tablet 15a9d1d4adaa402f90d774e77010c928) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:03.237217 6315 tablet_service.cc:1558] Processing DeleteTablet for tablet 3919b15a00eb4fb08008f065f556c760 with delete_type TABLET_DATA_DELETED (replaced by tablet f74e7cb3e5f54dfdb2280c795ce2ce53) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:03.238087 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_c9b2a9eb014e4f61b869daae0ff44c60" } new_table_name: "default.Table_f9942fca28234830913277dada229375" modify_external_catalogs: true
I20260923 19:50:03.240571 6173 tablet_service.cc:1558] Processing DeleteTablet for tablet 194494af2c424a55a772f3858af63c2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:03.242261 6459 tablet_replica.cc:333] T 3158b344d1c748aab5004543e4448adb P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:03.242946 6459 raft_consensus.cc:2243] T 3158b344d1c748aab5004543e4448adb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:03.243340 6459 raft_consensus.cc:2272] T 3158b344d1c748aab5004543e4448adb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:03.243916 6454 tablet_bootstrap.cc:492] T 9ed630e738c54ed38b9933f95fb552c5 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:03.246276 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet b302820d329a41f0a9a54501c079fcd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:03.246769 6459 ts_tablet_manager.cc:1916] T 3158b344d1c748aab5004543e4448adb P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:03.247025 6454 tablet_bootstrap.cc:654] T 9ed630e738c54ed38b9933f95fb552c5 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:03.251083 6576 leader_election.cc:290] T f7e282b6699a4ce9837d221132a1f54e P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:03.252230 6172 tablet_service.cc:1511] Processing CreateTablet for tablet 870db252d8414be7bbe613ea467b5f3a (DEFAULT_TABLE table=default.Table_24178fa82e3c4d878ed35fe32867eb98 [id=450e80ee217e4c6f91172b176cdda58c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:03.252404 5790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.143.254:37151, user_credentials={real_user=slave}} blocked reactor thread for 44440.2us
I20260923 19:50:03.252688 6172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 870db252d8414be7bbe613ea467b5f3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.254433 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet 194494af2c424a55a772f3858af63c2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:03.255421 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet 7504a2be25b54ed4bc539eb10199fe15 with delete_type TABLET_DATA_DELETED (replaced by tablet 15a9d1d4adaa402f90d774e77010c928) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:03.255824 6461 tablet_replica.cc:333] T 7504a2be25b54ed4bc539eb10199fe15 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:03.256099 6461 raft_consensus.cc:2243] T 7504a2be25b54ed4bc539eb10199fe15 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:03.256330 6461 raft_consensus.cc:2272] T 7504a2be25b54ed4bc539eb10199fe15 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:03.257575 6461 ts_tablet_manager.cc:1916] T 7504a2be25b54ed4bc539eb10199fe15 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:03.259684 6173 tablet_service.cc:1511] Processing CreateTablet for tablet b92aaac328934d95a89e0fc08a80b0b1 (DEFAULT_TABLE table=default.Table_4de2183ac1874f7eaf33c6ad5093c02d [id=93b330743f8d47f2b3e06f43ec3658b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.260085 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b92aaac328934d95a89e0fc08a80b0b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.256908 6740 tablet.cc:1751] T 5725a9cb95c448d0a5ea8114e90bc9fe P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260923 19:50:03.259864 6323 tablet_service.cc:1511] Processing CreateTablet for tablet 870db252d8414be7bbe613ea467b5f3a (DEFAULT_TABLE table=default.Table_24178fa82e3c4d878ed35fe32867eb98 [id=450e80ee217e4c6f91172b176cdda58c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.262899 6643 raft_consensus.cc:515] T 640a98d3a845461e8d4f07041ab515c7 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.266698 6345 raft_consensus.cc:2468] T 8db0358af7634911820f99fe16605ca7 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 1.
I20260923 19:50:03.266789 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 870db252d8414be7bbe613ea467b5f3a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:03.267134 6280 leader_election.cc:343] T 115048f771764e41a3816e17a6c6cf94 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:03.268021 5996 leader_election.cc:343] T b2762648045b4378bcc2c1234460c352 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:03.269680 5996 leader_election.cc:304] T b2762648045b4378bcc2c1234460c352 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:03.269896 6176 tablet_service.cc:1511] Processing CreateTablet for tablet 86388fa08c454da9ad2ca0124dcba10b (DEFAULT_TABLE table=default.Table_4803d401dac84700919d6879b552cd8d [id=2973ea17373f4ec181b54ab66028a774]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.270298 6763 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.143.252:45543 every 8 connection(s)
I20260923 19:50:03.270424 6176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86388fa08c454da9ad2ca0124dcba10b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:03.270509 5996 leader_election.cc:343] T 063fc0e77d294ddf8a02e9ab5968a5e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:03.270835 5996 leader_election.cc:304] T 063fc0e77d294ddf8a02e9ab5968a5e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:03.271273 5996 leader_election.cc:304] T 8db0358af7634911820f99fe16605ca7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:03.271183 6520 rpc_server.cc:307] RPC server started. Bound to: 127.5.143.252:45543
I20260923 19:50:03.271569 6689 raft_consensus.cc:2749] T b2762648045b4378bcc2c1234460c352 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:03.271752 6689 raft_consensus.cc:2749] T 063fc0e77d294ddf8a02e9ab5968a5e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:03.269264 6035 tablet_service.cc:1511] Processing CreateTablet for tablet c0ff8838ab17433ab733d3b293d4964f (DEFAULT_TABLE table=default.Table_c67ffb2902d446cba5c75e4a3d46d559 [id=b703874c0f19412b96d6776a2cda5caa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.271926 6689 raft_consensus.cc:2804] T 8db0358af7634911820f99fe16605ca7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:03.272042 6689 raft_consensus.cc:697] T 8db0358af7634911820f99fe16605ca7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Becoming Leader. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Running, Role: LEADER
I20260923 19:50:03.272225 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0ff8838ab17433ab733d3b293d4964f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.272356 6689 consensus_queue.cc:237] T 8db0358af7634911820f99fe16605ca7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.277719 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet 194494af2c424a55a772f3858af63c2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:03.281333 6454 tablet_bootstrap.cc:492] T 9ed630e738c54ed38b9933f95fb552c5 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:03.281574 6454 ts_tablet_manager.cc:1403] T 9ed630e738c54ed38b9933f95fb552c5 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.038s user 0.004s sys 0.000s
I20260923 19:50:03.281834 6461 ts_tablet_manager.cc:1929] T 7504a2be25b54ed4bc539eb10199fe15 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:03.282881 6454 raft_consensus.cc:359] T 9ed630e738c54ed38b9933f95fb552c5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.283188 6454 raft_consensus.cc:385] T 9ed630e738c54ed38b9933f95fb552c5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:03.283301 6454 raft_consensus.cc:740] T 9ed630e738c54ed38b9933f95fb552c5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:03.283754 6454 consensus_queue.cc:260] T 9ed630e738c54ed38b9933f95fb552c5 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:03.285606 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet b302820d329a41f0a9a54501c079fcd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b302820d329a41f0a9a54501c079fcd7 already in progress: creating tablet
I20260923 19:50:03.286494 6461 log.cc:1199] T 7504a2be25b54ed4bc539eb10199fe15 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/7504a2be25b54ed4bc539eb10199fe15
I20260923 19:50:03.286856 6520 server_base.cc:1193] Dumped server information to /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-2/data/info.pb
I20260923 19:50:03.287303 6454 ts_tablet_manager.cc:1434] T 9ed630e738c54ed38b9933f95fb552c5 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260923 19:50:03.287384 5695 external_mini_cluster.cc:1434] Started /tmp/dist-test-task5JtCX2/build/asan/bin/kudu as pid 6520
I20260923 19:50:03.287645 6744 raft_consensus.cc:493] T 0cdb778f87fa40b89dad97d166192a1e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:03.287828 6744 raft_consensus.cc:515] T 0cdb778f87fa40b89dad97d166192a1e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.288987 6744 leader_election.cc:290] T 0cdb778f87fa40b89dad97d166192a1e P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:03.290661 6137 leader_election.cc:343] T 0cdb778f87fa40b89dad97d166192a1e P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 0cdb778f87fa40b89dad97d166192a1e
I20260923 19:50:03.290808 6454 tablet_bootstrap.cc:492] T e52d78a941a341d186dc00bbe7df96bf P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
W20260923 19:50:03.292675 6139 leader_election.cc:343] T 0cdb778f87fa40b89dad97d166192a1e P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 0cdb778f87fa40b89dad97d166192a1e
I20260923 19:50:03.292799 6139 leader_election.cc:304] T 0cdb778f87fa40b89dad97d166192a1e P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:03.293195 6744 raft_consensus.cc:2749] T 0cdb778f87fa40b89dad97d166192a1e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:03.294554 6454 tablet_bootstrap.cc:654] T e52d78a941a341d186dc00bbe7df96bf P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:03.293035 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "640a98d3a845461e8d4f07041ab515c7" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:03.300957 6059 raft_consensus.cc:3060] T 640a98d3a845461e8d4f07041ab515c7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:03.301306 6461 ts_tablet_manager.cc:1950] T 7504a2be25b54ed4bc539eb10199fe15 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:03.304699 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 7504a2be25b54ed4bc539eb10199fe15 (table default.Table_21a1fa60dde7481e8ad7a7fe355a1e94 [id=9e398f48d86e4c5898cac7336d3c24bf]) successfully deleted
I20260923 19:50:03.305292 6059 raft_consensus.cc:2468] T 640a98d3a845461e8d4f07041ab515c7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:03.306511 6025 tablet_service.cc:1511] Processing CreateTablet for tablet 870db252d8414be7bbe613ea467b5f3a (DEFAULT_TABLE table=default.Table_24178fa82e3c4d878ed35fe32867eb98 [id=450e80ee217e4c6f91172b176cdda58c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.307070 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 870db252d8414be7bbe613ea467b5f3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.315611 6173 tablet_service.cc:1511] Processing CreateTablet for tablet 8d87f05f29bd476386ff6516676ce31a (DEFAULT_TABLE table=default.Table_95db9487259c45f5bbfdede6ebd6d1da [id=02d2ab56def342c482c86ce96110342f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.315992 6744 raft_consensus.cc:493] T 32c8333073574fe79bfc3e33f3249256 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:03.316064 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d87f05f29bd476386ff6516676ce31a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.316157 6744 raft_consensus.cc:515] T 32c8333073574fe79bfc3e33f3249256 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.316838 6744 leader_election.cc:290] T 32c8333073574fe79bfc3e33f3249256 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:03.319453 6039 tablet_service.cc:1511] Processing CreateTablet for tablet b92aaac328934d95a89e0fc08a80b0b1 (DEFAULT_TABLE table=default.Table_4de2183ac1874f7eaf33c6ad5093c02d [id=93b330743f8d47f2b3e06f43ec3658b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.319531 6316 tablet_service.cc:1511] Processing CreateTablet for tablet b92aaac328934d95a89e0fc08a80b0b1 (DEFAULT_TABLE table=default.Table_4de2183ac1874f7eaf33c6ad5093c02d [id=93b330743f8d47f2b3e06f43ec3658b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.319895 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b92aaac328934d95a89e0fc08a80b0b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.320009 6643 leader_election.cc:290] T 640a98d3a845461e8d4f07041ab515c7 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
W20260923 19:50:03.323448 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 194494af2c424a55a772f3858af63c2c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 194494af2c424a55a772f3858af63c2c already in progress: creating tablet
I20260923 19:50:03.323978 6035 tablet_service.cc:1511] Processing CreateTablet for tablet 86388fa08c454da9ad2ca0124dcba10b (DEFAULT_TABLE table=default.Table_4803d401dac84700919d6879b552cd8d [id=2973ea17373f4ec181b54ab66028a774]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.324427 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86388fa08c454da9ad2ca0124dcba10b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.328004 6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b92aaac328934d95a89e0fc08a80b0b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.328202 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ed630e738c54ed38b9933f95fb552c5" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:03.329036 6343 raft_consensus.cc:2468] T 9ed630e738c54ed38b9933f95fb552c5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 0.
I20260923 19:50:03.329289 6345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64a38bbd3fbd4738a73e78e3f6436fe5" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:03.329563 6279 leader_election.cc:304] T 640a98d3a845461e8d4f07041ab515c7 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:03.332708 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 2f78261842744af08d86da64d37d708c
I20260923 19:50:03.333787 6643 raft_consensus.cc:2804] T 640a98d3a845461e8d4f07041ab515c7 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:03.335129 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_59a69335b281437498cea78a9cb3fadb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:03.335764 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_59a69335b281437498cea78a9cb3fadb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:03.337265 5801 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 9ed630e738c54ed38b9933f95fb552c5
I20260923 19:50:03.338013 6324 tablet_service.cc:1511] Processing CreateTablet for tablet 86388fa08c454da9ad2ca0124dcba10b (DEFAULT_TABLE table=default.Table_4803d401dac84700919d6879b552cd8d [id=2973ea17373f4ec181b54ab66028a774]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.338464 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86388fa08c454da9ad2ca0124dcba10b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.338456 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_2c882fb60c3a4a5685508054fe5fa20d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:03.338984 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c882fb60c3a4a5685508054fe5fa20d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:03.340407 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_eab0a85599f44d58b84847483e41ba6f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:03.340911 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eab0a85599f44d58b84847483e41ba6f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:03.342113 5804 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f74e7cb3e5f54dfdb2280c795ce2ce53 has no consensus state
I20260923 19:50:03.342491 5804 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a1fd9ea56c3849d19928269a6e9de801" } new_table_name: "default.Table_c49ba0c0c07142b6aefaab8632719193" modify_external_catalogs: true
W20260923 19:50:03.344630 6137 leader_election.cc:343] T 32c8333073574fe79bfc3e33f3249256 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 32c8333073574fe79bfc3e33f3249256
I20260923 19:50:03.345598 5800 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 6e726ee6a5494fd4b72c1ebef7d66b42
I20260923 19:50:03.346078 5800 catalog_manager.cc:6934] ReplaceTablet: tablet 6e726ee6a5494fd4b72c1ebef7d66b42 deleted and replaced by tablet 6238d16b1be74dd88fd2e089fbd85d33
I20260923 19:50:03.347019 6744 raft_consensus.cc:493] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260923 19:50:03.347162 5805 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d8c8bfa9b7424b9f80f76e0bb05cbc0c has no consensus state
I20260923 19:50:03.347173 6744 raft_consensus.cc:515] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.347844 6744 leader_election.cc:290] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:03.348865 5996 leader_election.cc:304] T 9ed630e738c54ed38b9933f95fb552c5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:03.349327 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "640a98d3a845461e8d4f07041ab515c7" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
W20260923 19:50:03.349435 5996 leader_election.cc:343] T 64a38bbd3fbd4738a73e78e3f6436fe5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:03.349555 5996 leader_election.cc:304] T 64a38bbd3fbd4738a73e78e3f6436fe5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
W20260923 19:50:03.349790 5803 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 658253ff3d014361803e1aeda978e59a has no consensus state
I20260923 19:50:03.350003 6755 raft_consensus.cc:2804] T 9ed630e738c54ed38b9933f95fb552c5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:03.350106 6755 raft_consensus.cc:493] T 9ed630e738c54ed38b9933f95fb552c5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:03.350215 6755 raft_consensus.cc:3060] T 9ed630e738c54ed38b9933f95fb552c5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:03.353252 6755 raft_consensus.cc:515] T 9ed630e738c54ed38b9933f95fb552c5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.356138 6176 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f78261842744af08d86da64d37d708c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:03.356426 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e726ee6a5494fd4b72c1ebef7d66b42 with delete_type TABLET_DATA_DELETED (replaced by tablet 6238d16b1be74dd88fd2e089fbd85d33) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:03.356637 6178 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ed630e738c54ed38b9933f95fb552c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:03.356993 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ed630e738c54ed38b9933f95fb552c5" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:03.357190 6202 raft_consensus.cc:3060] T 9ed630e738c54ed38b9933f95fb552c5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:03.357718 6345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f302f91c8ef44237b1c9909d88dacbff" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:03.358068 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1752d6b46894796bdc94e6230e3327d" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:03.358996 5803 master_service.cc:960] ReplaceTablet: received request to replace tablet e52d78a941a341d186dc00bbe7df96bf from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:03.359244 5798 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_504b18d33ff6487da9b8f40467850853" } modify_external_catalogs: true
I20260923 19:50:03.359447 5798 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_504b18d33ff6487da9b8f40467850853" } modify_external_catalogs: true
I20260923 19:50:03.363373 6755 leader_election.cc:290] T 9ed630e738c54ed38b9933f95fb552c5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:03.363955 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_ca447ba1a2d04e7ab8954432c4a42c97"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:03.364111 6202 raft_consensus.cc:2468] T 9ed630e738c54ed38b9933f95fb552c5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 1.
W20260923 19:50:03.364543 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca447ba1a2d04e7ab8954432c4a42c97 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:03.364681 6689 raft_consensus.cc:2749] T 64a38bbd3fbd4738a73e78e3f6436fe5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:03.365573 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ed630e738c54ed38b9933f95fb552c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:03.365998 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ed630e738c54ed38b9933f95fb552c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:03.368614 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet f7e282b6699a4ce9837d221132a1f54e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:03.368780 5995 leader_election.cc:304] T 9ed630e738c54ed38b9933f95fb552c5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:03.371521 6755 raft_consensus.cc:2804] T 9ed630e738c54ed38b9933f95fb552c5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:03.371883 5805 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet b2762648045b4378bcc2c1234460c352 (table default.Table_a32dfccff8cd4459919a575fd2a136ad [id=ada5cc6ef65b4859bf027fd3af9ad0f2]). Expected version 1 got 0
I20260923 19:50:03.372186 5805 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 5adadf8caf5e4a9ab1107d0fb6a91735 (table default.Table_bd91264aa4a0430eb1a8f69129fb0f3f [id=738ed1d070ef485e9299c1f3b1db008a]). Expected version 2 got 0
I20260923 19:50:03.372362 5805 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 063fc0e77d294ddf8a02e9ab5968a5e3 (table default.Table_3034bb02271e459ebedf3424b5f8f908 [id=83a8f991844b4cb0a9008f5bc3dea17b]). Expected version 3 got 0
I20260923 19:50:03.372623 5805 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 115048f771764e41a3816e17a6c6cf94 (table default.Table_62802f9e844c4c16bf9cb0d04a630fa9 [id=498c667413e24c7c800fe5eae263cf22]). Expected version 1 got 0
I20260923 19:50:03.374184 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d2b5d3afdd76475bbd2a6a78f0522c6b" } modify_external_catalogs: true
I20260923 19:50:03.374360 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d2b5d3afdd76475bbd2a6a78f0522c6b" } modify_external_catalogs: true
W20260923 19:50:03.377532 5804 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 42e9cbcf77324d91abd029c12eaf950d consensus state has no leader
I20260923 19:50:03.378463 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 6a2564a99c274e07a7e43da739a2458b
I20260923 19:50:03.379590 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a2564a99c274e07a7e43da739a2458b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:03.380587 6035 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f78261842744af08d86da64d37d708c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:03.384269 6461 tablet_replica.cc:333] T 9ed630e738c54ed38b9933f95fb552c5 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:03.385722 6342 raft_consensus.cc:3060] T e1752d6b46894796bdc94e6230e3327d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:03.386042 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c8333073574fe79bfc3e33f3249256" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:03.387506 6027 tablet_service.cc:1558] Processing DeleteTablet for tablet 033c2d772c8a44d2a0e671664bb9085d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:03.387665 6139 leader_election.cc:343] T 32c8333073574fe79bfc3e33f3249256 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: Tablet not RUNNING: STOPPED
I20260923 19:50:03.387822 6139 leader_election.cc:304] T 32c8333073574fe79bfc3e33f3249256 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:03.388296 6744 raft_consensus.cc:2749] T 32c8333073574fe79bfc3e33f3249256 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:03.388456 6457 tablet_bootstrap.cc:492] T b302820d329a41f0a9a54501c079fcd7 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:03.388496 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e726ee6a5494fd4b72c1ebef7d66b42 with delete_type TABLET_DATA_DELETED (replaced by tablet 6238d16b1be74dd88fd2e089fbd85d33) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:03.388824 6031 tablet_service.cc:1558] Processing DeleteTablet for tablet 87afbdb11c6e4e58affd2f2d7995e1f8 with delete_type TABLET_DATA_DELETED (replaced by tablet 5c0142f4e3ad42048803481d68f0ee5d) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:03.389061 6035 tablet_service.cc:1558] Processing DeleteTablet for tablet 5455beff354a4616a68d8746e3e4f9a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:03.389714 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet 8db0358af7634911820f99fe16605ca7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:00 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:03.390080 6022 tablet_service.cc:1558] Processing DeleteTablet for tablet 64a38bbd3fbd4738a73e78e3f6436fe5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:00 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:03.390374 6576 raft_consensus.cc:493] T 6e726ee6a5494fd4b72c1ebef7d66b42 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:03.390635 6576 raft_consensus.cc:515] T 6e726ee6a5494fd4b72c1ebef7d66b42 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.390798 6022 tablet_service.cc:1511] Processing CreateTablet for tablet 8d87f05f29bd476386ff6516676ce31a (DEFAULT_TABLE table=default.Table_95db9487259c45f5bbfdede6ebd6d1da [id=02d2ab56def342c482c86ce96110342f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.391023 6643 raft_consensus.cc:697] T 640a98d3a845461e8d4f07041ab515c7 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:03.391214 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d87f05f29bd476386ff6516676ce31a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.391765 6576 leader_election.cc:290] T 6e726ee6a5494fd4b72c1ebef7d66b42 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:03.388648 6457 ts_tablet_manager.cc:1403] T b302820d329a41f0a9a54501c079fcd7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.308s user 0.006s sys 0.002s
I20260923 19:50:03.391956 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a2564a99c274e07a7e43da739a2458b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:03.392822 6457 raft_consensus.cc:359] T b302820d329a41f0a9a54501c079fcd7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.393008 6457 raft_consensus.cc:385] T b302820d329a41f0a9a54501c079fcd7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:03.393097 6457 raft_consensus.cc:740] T b302820d329a41f0a9a54501c079fcd7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:03.393311 6457 consensus_queue.cc:260] T b302820d329a41f0a9a54501c079fcd7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.393574 6315 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e726ee6a5494fd4b72c1ebef7d66b42 with delete_type TABLET_DATA_DELETED (replaced by tablet 6238d16b1be74dd88fd2e089fbd85d33) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:03.393767 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e282b6699a4ce9837d221132a1f54e" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:03.393919 6457 ts_tablet_manager.cc:1434] T b302820d329a41f0a9a54501c079fcd7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:03.394078 6027 tablet_service.cc:1558] Processing DeleteTablet for tablet 640a98d3a845461e8d4f07041ab515c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:03.394234 6457 tablet_bootstrap.cc:492] T 6a34e178007b4e8ebed429cedf44e82a P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:03.394235 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f78261842744af08d86da64d37d708c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:03.394556 6755 raft_consensus.cc:697] T 9ed630e738c54ed38b9933f95fb552c5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Becoming Leader. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Running, Role: LEADER
I20260923 19:50:03.394961 6755 consensus_queue.cc:237] T 9ed630e738c54ed38b9933f95fb552c5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.396492 6457 tablet_bootstrap.cc:654] T 6a34e178007b4e8ebed429cedf44e82a P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:03.398586 6341 raft_consensus.cc:2468] T f7e282b6699a4ce9837d221132a1f54e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 0.
I20260923 19:50:03.391566 6643 consensus_queue.cc:237] T 640a98d3a845461e8d4f07041ab515c7 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.400933 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a2564a99c274e07a7e43da739a2458b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:03.401154 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2fbac8080441d4a9e03ff1d580bc8e" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:03.401379 6344 raft_consensus.cc:2468] T 8a2fbac8080441d4a9e03ff1d580bc8e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:03.401539 6105 heartbeater.cc:344] Connected to a master server at 127.5.143.252:45543
W20260923 19:50:03.402158 5790 catalog_manager.cc:5136] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): alter failed for tablet 4dbc0e17d77140f6abe9ee26c8ec13ee (table default.Table_701c81d7fd4844f09fc1ccc28f0eda9c [id=67292e21e6b546298c5d629c6ebcb718]),no further retry: Not found: Tablet not found: 4dbc0e17d77140f6abe9ee26c8ec13ee
I20260923 19:50:03.402592 6139 leader_election.cc:304] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:03.403366 6744 raft_consensus.cc:2804] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:03.403474 6744 raft_consensus.cc:493] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:03.403589 6744 raft_consensus.cc:3060] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:03.403765 5802 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 8424bd3035484c2fbe21a37069357d65
I20260923 19:50:03.405793 6766 sys_catalog.cc:263] Verifying existing consensus state
I20260923 19:50:03.407995 6039 tablet_service.cc:1558] Processing DeleteTablet for tablet e1752d6b46894796bdc94e6230e3327d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:03.397330 6280 leader_election.cc:343] T 640a98d3a845461e8d4f07041ab515c7 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:03.409644 6312 tablet_service.cc:1511] Processing CreateTablet for tablet 8d87f05f29bd476386ff6516676ce31a (DEFAULT_TABLE table=default.Table_95db9487259c45f5bbfdede6ebd6d1da [id=02d2ab56def342c482c86ce96110342f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.414323 6766 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562: Bootstrap starting.
I20260923 19:50:03.415807 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d87f05f29bd476386ff6516676ce31a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:03.417088 6137 leader_election.cc:343] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 8a2fbac8080441d4a9e03ff1d580bc8e
I20260923 19:50:03.419276 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e726ee6a5494fd4b72c1ebef7d66b42" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:03.420264 5995 leader_election.cc:343] T 6e726ee6a5494fd4b72c1ebef7d66b42 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:03.423715 6461 raft_consensus.cc:2243] T 9ed630e738c54ed38b9933f95fb552c5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:03.430274 6461 pending_rounds.cc:70] T 9ed630e738c54ed38b9933f95fb552c5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Trying to abort 1 pending ops.
I20260923 19:50:03.434940 6461 pending_rounds.cc:77] T 9ed630e738c54ed38b9933f95fb552c5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630541912166400 op_type: NO_OP noop_request { }
I20260923 19:50:03.435236 6461 raft_consensus.cc:2889] T 9ed630e738c54ed38b9933f95fb552c5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:03.435462 6461 raft_consensus.cc:2272] T 9ed630e738c54ed38b9933f95fb552c5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:03.437801 6766 log.cc:826] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562: Log is configured to *not* fsync() on all Append() calls
I20260923 19:50:03.443193 6039 tablet_service.cc:1558] Processing DeleteTablet for tablet b302820d329a41f0a9a54501c079fcd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:03.444691 6342 raft_consensus.cc:2468] T e1752d6b46894796bdc94e6230e3327d P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 1.
I20260923 19:50:03.451385 6461 ts_tablet_manager.cc:1916] T 9ed630e738c54ed38b9933f95fb552c5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:03.454452 5802 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7685437ec90948a480a544421ad56cc4" } new_table_name: "default.Table_702e4b2ed8dd4400b9e61073b984b3c4" modify_external_catalogs: true
W20260923 19:50:03.455741 6280 consensus_peers.cc:597] T 115048f771764e41a3816e17a6c6cf94 P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:03.459926 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_4e6fe5709a6947bb856cc36444f9fbe6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:03.460254 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_870cfa1b62c4442d866d3b9b1aec4bc7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:03.460548 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4e6fe5709a6947bb856cc36444f9fbe6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:03.460656 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_870cfa1b62c4442d866d3b9b1aec4bc7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:03.461136 6461 ts_tablet_manager.cc:1929] T 9ed630e738c54ed38b9933f95fb552c5 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:03.461277 6461 log.cc:1199] T 9ed630e738c54ed38b9933f95fb552c5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/9ed630e738c54ed38b9933f95fb552c5
I20260923 19:50:03.462057 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_5a1ffa59de984ef3adb370cdf1142f24"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:03.462688 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5a1ffa59de984ef3adb370cdf1142f24 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:03.470324 6059 raft_consensus.cc:1275] T 115048f771764e41a3816e17a6c6cf94 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Refusing update from remote peer 2bf41435f70447f19992d368ca6b46bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:50:03.472482 6728 consensus_queue.cc:1048] T 115048f771764e41a3816e17a6c6cf94 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:03.475719 6744 raft_consensus.cc:515] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:03.476837 5802 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 908596339b2e4f7f8ddb7f9cd5bdcc3e consensus state has no leader
I20260923 19:50:03.477494 6248 heartbeater.cc:344] Connected to a master server at 127.5.143.252:45543
I20260923 19:50:03.478504 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_bbd58de358814dbb827a145793718a7d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:03.478958 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2fbac8080441d4a9e03ff1d580bc8e" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:03.479183 6342 raft_consensus.cc:3060] T 8a2fbac8080441d4a9e03ff1d580bc8e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
W20260923 19:50:03.479331 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bbd58de358814dbb827a145793718a7d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:03.481227 5801 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_c49ba0c0c07142b6aefaab8632719193" } modify_external_catalogs: true
I20260923 19:50:03.481443 5801 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_c49ba0c0c07142b6aefaab8632719193" } modify_external_catalogs: true
W20260923 19:50:03.481973 6137 leader_election.cc:343] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 8a2fbac8080441d4a9e03ff1d580bc8e
I20260923 19:50:03.489625 6755 raft_consensus.cc:493] T 5455beff354a4616a68d8746e3e4f9a8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:03.493039 6755 raft_consensus.cc:515] T 5455beff354a4616a68d8746e3e4f9a8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.493908 6755 leader_election.cc:290] T 5455beff354a4616a68d8746e3e4f9a8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:03.495406 6105 heartbeater.cc:344] Connected to a master server at 127.5.143.252:45543
I20260923 19:50:03.497189 5797 master_service.cc:960] ReplaceTablet: received request to replace tablet 359b08ef348d4be68b14f9e871a5e519 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:03.505635 6744 leader_election.cc:290] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:03.506330 6454 tablet_bootstrap.cc:492] T e52d78a941a341d186dc00bbe7df96bf P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:03.506353 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5455beff354a4616a68d8746e3e4f9a8" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:03.506739 5805 master_service.cc:960] ReplaceTablet: received request to replace tablet a224ae69503e4ab588d6269086317f09 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:03.506781 6454 ts_tablet_manager.cc:1403] T e52d78a941a341d186dc00bbe7df96bf P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.216s user 0.012s sys 0.009s
I20260923 19:50:03.507890 6454 raft_consensus.cc:359] T e52d78a941a341d186dc00bbe7df96bf P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:03.508392 5995 leader_election.cc:343] T 5455beff354a4616a68d8746e3e4f9a8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:03.508934 6454 raft_consensus.cc:385] T e52d78a941a341d186dc00bbe7df96bf P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:03.508893 6342 raft_consensus.cc:2468] T 8a2fbac8080441d4a9e03ff1d580bc8e P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:03.509145 6454 raft_consensus.cc:740] T e52d78a941a341d186dc00bbe7df96bf P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:03.509711 6139 leader_election.cc:304] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:03.509574 6454 consensus_queue.cc:260] T e52d78a941a341d186dc00bbe7df96bf P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.510185 6646 raft_consensus.cc:2804] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:03.510361 6646 raft_consensus.cc:697] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:03.510617 6646 consensus_queue.cc:237] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.511899 5801 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 42e9cbcf77324d91abd029c12eaf950d
I20260923 19:50:03.514055 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 359b08ef348d4be68b14f9e871a5e519
I20260923 19:50:03.514959 6178 tablet_service.cc:1558] Processing DeleteTablet for tablet e52d78a941a341d186dc00bbe7df96bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:03.515239 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet 42e9cbcf77324d91abd029c12eaf950d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:03.519095 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet 359b08ef348d4be68b14f9e871a5e519 with delete_type TABLET_DATA_DELETED (replaced by tablet b7ba284e81bc4388bbd6456a41d1f9f4) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:03.519490 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet 42e9cbcf77324d91abd029c12eaf950d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:03.519594 6025 tablet_service.cc:1558] Processing DeleteTablet for tablet 42e9cbcf77324d91abd029c12eaf950d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:03.519743 5797 catalog_manager.cc:6934] ReplaceTablet: tablet 359b08ef348d4be68b14f9e871a5e519 deleted and replaced by tablet b7ba284e81bc4388bbd6456a41d1f9f4
I20260923 19:50:03.520435 6458 ts_tablet_manager.cc:1929] T 32c8333073574fe79bfc3e33f3249256 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:03.520607 6458 log.cc:1199] T 32c8333073574fe79bfc3e33f3249256 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/32c8333073574fe79bfc3e33f3249256
I20260923 19:50:03.520592 6025 tablet_service.cc:1558] Processing DeleteTablet for tablet 359b08ef348d4be68b14f9e871a5e519 with delete_type TABLET_DATA_DELETED (replaced by tablet b7ba284e81bc4388bbd6456a41d1f9f4) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:03.521000 6458 ts_tablet_manager.cc:1950] T 32c8333073574fe79bfc3e33f3249256 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:03.522590 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet 359b08ef348d4be68b14f9e871a5e519 with delete_type TABLET_DATA_DELETED (replaced by tablet b7ba284e81bc4388bbd6456a41d1f9f4) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:03.531836 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet a224ae69503e4ab588d6269086317f09
I20260923 19:50:03.532462 5805 catalog_manager.cc:6934] ReplaceTablet: tablet a224ae69503e4ab588d6269086317f09 deleted and replaced by tablet d6d3601a392f4723b4ca00f6e12b950c
I20260923 19:50:03.534255 6314 tablet_service.cc:1558] Processing DeleteTablet for tablet a224ae69503e4ab588d6269086317f09 with delete_type TABLET_DATA_DELETED (replaced by tablet d6d3601a392f4723b4ca00f6e12b950c) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:03.536686 6025 tablet_service.cc:1558] Processing DeleteTablet for tablet a224ae69503e4ab588d6269086317f09 with delete_type TABLET_DATA_DELETED (replaced by tablet d6d3601a392f4723b4ca00f6e12b950c) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:03.550752 6454 ts_tablet_manager.cc:1434] T e52d78a941a341d186dc00bbe7df96bf P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.044s user 0.001s sys 0.001s
I20260923 19:50:03.551328 6454 tablet_bootstrap.cc:492] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:03.522683 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 68) took 3879 ms. Trace:
I20260923 19:50:03.551901 6458 rpcz_store.cc:276] 0923 19:49:59.643467 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:49:59.643518 (+ 51us) service_pool.cc:224] Handling call
0923 19:50:03.161058 (+3517540us) ts_tablet_manager.cc:1151] Deleting tablet 32c8333073574fe79bfc3e33f3249256
0923 19:50:03.161068 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:03.430242 (+269174us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:03.465027 (+ 34785us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:03.522631 (+ 57604us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3516885}
I20260923 19:50:03.552803 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 32c8333073574fe79bfc3e33f3249256 (table default.Table_61c4c80bb6264458b904d9b0322596c0 [id=3fb7e854da784756b57db432e6c373db]) successfully deleted
I20260923 19:50:03.561538 5803 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_973ceea94f2e4c6da7b1c722b99ac413" } modify_external_catalogs: true
I20260923 19:50:03.561755 5803 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_973ceea94f2e4c6da7b1c722b99ac413" } modify_external_catalogs: true
I20260923 19:50:03.561808 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_ba859ce2dc954a94ac103be8f6037961"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:03.562621 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba859ce2dc954a94ac103be8f6037961 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:03.564005 5797 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b57993507bc4490baef162d2a394137e" } modify_external_catalogs: true
I20260923 19:50:03.564249 5797 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b57993507bc4490baef162d2a394137e" } modify_external_catalogs: true
W20260923 19:50:03.565347 5996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.195:32855, user_credentials={real_user=slave}} blocked reactor thread for 215890us
I20260923 19:50:03.565603 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5fa9317aca724db689786f2e1c867c53" } new_table_name: "default.Table_0bf993fb53a243408934c3ce7812f300" modify_external_catalogs: true
W20260923 19:50:03.566146 5996 leader_election.cc:343] T f302f91c8ef44237b1c9909d88dacbff P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:03.566280 5996 leader_election.cc:304] T f302f91c8ef44237b1c9909d88dacbff P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:03.566721 6773 raft_consensus.cc:2749] T f302f91c8ef44237b1c9909d88dacbff P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:03.567399 6461 ts_tablet_manager.cc:1950] T 9ed630e738c54ed38b9933f95fb552c5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:03.567489 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_dda4a443221b4621965cbc1f5e631859" } new_table_name: "default.Table_fa1d82a491c04ba89f5cf3162578d550" modify_external_catalogs: true
I20260923 19:50:03.568174 6461 tablet_replica.cc:333] T f7e282b6699a4ce9837d221132a1f54e P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:03.568375 6461 raft_consensus.cc:2243] T f7e282b6699a4ce9837d221132a1f54e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:03.568526 6461 raft_consensus.cc:2272] T f7e282b6699a4ce9837d221132a1f54e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:03.568905 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_bb91666519bc41aaaf1fc7f8e8b26691"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:03.569564 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb91666519bc41aaaf1fc7f8e8b26691 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:03.571049 5804 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b455e09005774effa019e6ddc31cd521" } new_table_name: "default.Table_ccd00f21243a43deb385f4673958f88c" modify_external_catalogs: true
I20260923 19:50:03.572680 6459 ts_tablet_manager.cc:1929] T 3158b344d1c748aab5004543e4448adb P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:03.572805 6459 log.cc:1199] T 3158b344d1c748aab5004543e4448adb P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/3158b344d1c748aab5004543e4448adb
I20260923 19:50:03.573153 6459 ts_tablet_manager.cc:1950] T 3158b344d1c748aab5004543e4448adb P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:03.573728 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 186) took 1384 ms. Trace:
I20260923 19:50:03.582475 6773 raft_consensus.cc:493] T 033c2d772c8a44d2a0e671664bb9085d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:03.582787 6773 raft_consensus.cc:515] T 033c2d772c8a44d2a0e671664bb9085d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.584227 6773 leader_election.cc:290] T 033c2d772c8a44d2a0e671664bb9085d P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:03.586479 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 9ed630e738c54ed38b9933f95fb552c5 (table default.Table_f8e149be0f0d456894956d425be24693 [id=c97fdc3b0e4447c284ad90fab54a1fa5]) successfully deleted
I20260923 19:50:03.586807 6457 tablet_bootstrap.cc:492] T 6a34e178007b4e8ebed429cedf44e82a P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:03.586990 6457 ts_tablet_manager.cc:1403] T 6a34e178007b4e8ebed429cedf44e82a P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.193s user 0.025s sys 0.042s
I20260923 19:50:03.587491 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_2b35ad69600645618a826140c33c4da8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:03.587795 6457 raft_consensus.cc:359] T 6a34e178007b4e8ebed429cedf44e82a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.587970 6457 raft_consensus.cc:385] T 6a34e178007b4e8ebed429cedf44e82a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:03.588037 6457 raft_consensus.cc:740] T 6a34e178007b4e8ebed429cedf44e82a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
W20260923 19:50:03.588114 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2b35ad69600645618a826140c33c4da8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:03.588294 6457 consensus_queue.cc:260] T 6a34e178007b4e8ebed429cedf44e82a P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.588864 6457 ts_tablet_manager.cc:1434] T 6a34e178007b4e8ebed429cedf44e82a P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:50:03.589169 6457 tablet_bootstrap.cc:492] T 0a5ce253bcce410b9517449f133d39e8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:03.589398 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_809bfd3727c8499980a5a1fa9b42b948" } new_table_name: "default.Table_d130b4b675a14c5a86ff587918d83d7c" modify_external_catalogs: true
I20260923 19:50:03.589388 6316 tablet_service.cc:1511] Processing CreateTablet for tablet 0e123b69877e4b1fbcdb2b27960864e9 (DEFAULT_TABLE table=default.Table_0562db93b14243108d8731231ae538c1 [id=74e85060f50e45069c378e7fd4cc7dba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.591451 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_c67ffb2902d446cba5c75e4a3d46d559" } modify_external_catalogs: true
I20260923 19:50:03.591605 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_c67ffb2902d446cba5c75e4a3d46d559" } modify_external_catalogs: true
I20260923 19:50:03.591974 6390 heartbeater.cc:344] Connected to a master server at 127.5.143.252:45543
I20260923 19:50:03.593053 6457 tablet_bootstrap.cc:654] T 0a5ce253bcce410b9517449f133d39e8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:03.593214 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e726ee6a5494fd4b72c1ebef7d66b42" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:03.594064 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5455beff354a4616a68d8746e3e4f9a8" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:03.594722 6314 tablet_service.cc:1511] Processing CreateTablet for tablet 12f4abb573bd4be6961b55c27c684d06 (DEFAULT_TABLE table=default.Table_f3099aec2da54c33b79ac8261f13f6a2 [id=e15861b2c6c2424a862634f2dc347039]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.596413 6456 tablet_bootstrap.cc:492] T f2d9f1a0fae849ae8083eba082055fe9 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:03.596753 6458 tablet_replica.cc:333] T 8a2fbac8080441d4a9e03ff1d580bc8e P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:03.597268 6025 tablet_service.cc:1511] Processing CreateTablet for tablet efc63a151f6444dfb03c3f15f6f54473 (DEFAULT_TABLE table=default.Table_ee5fbb39c54a49c89eaaff48f72a9c3c [id=20b663f1b2504d4199c2a9a2e9667d5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.597811 6039 tablet_service.cc:1511] Processing CreateTablet for tablet 0e123b69877e4b1fbcdb2b27960864e9 (DEFAULT_TABLE table=default.Table_0562db93b14243108d8731231ae538c1 [id=74e85060f50e45069c378e7fd4cc7dba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.598309 6022 tablet_service.cc:1511] Processing CreateTablet for tablet 12f4abb573bd4be6961b55c27c684d06 (DEFAULT_TABLE table=default.Table_f3099aec2da54c33b79ac8261f13f6a2 [id=e15861b2c6c2424a862634f2dc347039]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.598537 6456 ts_tablet_manager.cc:1403] T f2d9f1a0fae849ae8083eba082055fe9 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.491s user 0.011s sys 0.002s
I20260923 19:50:03.598711 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efc63a151f6444dfb03c3f15f6f54473. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.598903 6457 tablet_bootstrap.cc:492] T 0a5ce253bcce410b9517449f133d39e8 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:03.599044 6457 ts_tablet_manager.cc:1403] T 0a5ce253bcce410b9517449f133d39e8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s
I20260923 19:50:03.599921 6457 raft_consensus.cc:359] T 0a5ce253bcce410b9517449f133d39e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.600121 6457 raft_consensus.cc:385] T 0a5ce253bcce410b9517449f133d39e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:03.600211 6457 raft_consensus.cc:740] T 0a5ce253bcce410b9517449f133d39e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:03.600430 6458 raft_consensus.cc:2243] T 8a2fbac8080441d4a9e03ff1d580bc8e P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:03.600458 6457 consensus_queue.cc:260] T 0a5ce253bcce410b9517449f133d39e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.601006 6457 ts_tablet_manager.cc:1434] T 0a5ce253bcce410b9517449f133d39e8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:50:03.600953 6458 raft_consensus.cc:2272] T 8a2fbac8080441d4a9e03ff1d580bc8e P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:03.603188 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ed630e738c54ed38b9933f95fb552c5" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:03.603579 6342 raft_consensus.cc:3060] T 9ed630e738c54ed38b9933f95fb552c5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:03.604043 6457 tablet_bootstrap.cc:492] T d70b7662d85a4f64a11420448c4d140d P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:03.604127 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12f4abb573bd4be6961b55c27c684d06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.608923 6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e123b69877e4b1fbcdb2b27960864e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.609279 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12f4abb573bd4be6961b55c27c684d06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.614557 6458 ts_tablet_manager.cc:1916] T 8a2fbac8080441d4a9e03ff1d580bc8e P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:03.616487 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 6e781ccf4aa343fc924138c3cc2b04e6
I20260923 19:50:03.617856 5797 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 668fa1edd98e4f5495e0acd26745db8a
I20260923 19:50:03.618278 5797 master_service.cc:960] ReplaceTablet: received request to replace tablet 4bf129dd52b84a4ea461ec454bc34fe8 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:03.618142 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_af4eb1297d19460fade71cf33df073a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:03.618489 6456 raft_consensus.cc:359] T f2d9f1a0fae849ae8083eba082055fe9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.618973 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_141fc144025e434aa7d7a6e0ecb9c98d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:03.619794 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_141fc144025e434aa7d7a6e0ecb9c98d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:03.620343 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_a0d1427301b14afd906023f389ea8b81"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:03.620654 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6d29923f139445cc86379c80ac15df5d has no consensus state
I20260923 19:50:03.621166 5798 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_42531a3057904620ad5e116c11f2d03b" } modify_external_catalogs: true
I20260923 19:50:03.621256 6312 tablet_service.cc:1511] Processing CreateTablet for tablet efc63a151f6444dfb03c3f15f6f54473 (DEFAULT_TABLE table=default.Table_ee5fbb39c54a49c89eaaff48f72a9c3c [id=20b663f1b2504d4199c2a9a2e9667d5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.621366 5798 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_42531a3057904620ad5e116c11f2d03b" } modify_external_catalogs: true
W20260923 19:50:03.619266 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af4eb1297d19460fade71cf33df073a4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:03.622582 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a0d1427301b14afd906023f389ea8b81 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:03.637290 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efc63a151f6444dfb03c3f15f6f54473. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.637656 6319 tablet_service.cc:1511] Processing CreateTablet for tablet 66739afdf147413787acb0363aa37df6 (DEFAULT_TABLE table=default.Table_973f7a2560ab48ad8d84aeb2f4fc235b [id=72c42d0bf8264d809c5ec888d05db821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.640609 6457 tablet_bootstrap.cc:654] T d70b7662d85a4f64a11420448c4d140d P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:03.643210 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2db82e6f314f412385b41720c7efdef5 consensus state has no leader
I20260923 19:50:03.643491 6319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66739afdf147413787acb0363aa37df6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.649494 6740 tablet.cc:1751] T 115048f771764e41a3816e17a6c6cf94 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:03.651853 6027 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e781ccf4aa343fc924138c3cc2b04e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:03.652871 6456 raft_consensus.cc:385] T f2d9f1a0fae849ae8083eba082055fe9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:03.653453 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e123b69877e4b1fbcdb2b27960864e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.653574 6314 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e781ccf4aa343fc924138c3cc2b04e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:03.654311 6461 ts_tablet_manager.cc:1916] T f7e282b6699a4ce9837d221132a1f54e P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:03.655260 5996 leader_election.cc:304] T f7e282b6699a4ce9837d221132a1f54e P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:03.656157 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 66739afdf147413787acb0363aa37df6 (DEFAULT_TABLE table=default.Table_973f7a2560ab48ad8d84aeb2f4fc235b [id=72c42d0bf8264d809c5ec888d05db821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.657286 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66739afdf147413787acb0363aa37df6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:03.660820 5800 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0d70deeda179486291195476e47a9ae6 consensus state has no leader
I20260923 19:50:03.661011 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet c0ff8838ab17433ab733d3b293d4964f
I20260923 19:50:03.663462 6314 tablet_service.cc:1558] Processing DeleteTablet for tablet c0ff8838ab17433ab733d3b293d4964f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:03.663751 5996 raft_consensus.cc:2686] T f7e282b6699a4ce9837d221132a1f54e P e546f660e7e541d1aa9ae38e5ee5b9c0: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260923 19:50:03.665632 5996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.195:32855, user_credentials={real_user=slave}} blocked reactor thread for 61596.5us
I20260923 19:50:03.665967 5996 leader_election.cc:304] T e1752d6b46894796bdc94e6230e3327d P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:03.666291 5799 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 115048f771764e41a3816e17a6c6cf94 (table default.Table_62802f9e844c4c16bf9cb0d04a630fa9 [id=498c667413e24c7c800fe5eae263cf22]). Expected version 1 got 0
I20260923 19:50:03.667691 6755 raft_consensus.cc:2804] T e1752d6b46894796bdc94e6230e3327d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:03.667884 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet c0ff8838ab17433ab733d3b293d4964f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:03.661770 6456 raft_consensus.cc:740] T f2d9f1a0fae849ae8083eba082055fe9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:03.674315 6755 raft_consensus.cc:697] T e1752d6b46894796bdc94e6230e3327d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Becoming Leader. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Running, Role: LEADER
I20260923 19:50:03.674666 6755 consensus_queue.cc:237] T e1752d6b46894796bdc94e6230e3327d P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:03.676674 5996 leader_election.cc:343] T 6e726ee6a5494fd4b72c1ebef7d66b42 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:03.678479 5996 leader_election.cc:304] T 6e726ee6a5494fd4b72c1ebef7d66b42 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:03.678892 6773 raft_consensus.cc:2749] T 6e726ee6a5494fd4b72c1ebef7d66b42 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:03.679018 5996 leader_election.cc:343] T 5455beff354a4616a68d8746e3e4f9a8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:03.679141 5996 leader_election.cc:304] T 5455beff354a4616a68d8746e3e4f9a8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:03.679382 6773 raft_consensus.cc:2749] T 5455beff354a4616a68d8746e3e4f9a8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:03.679910 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033c2d772c8a44d2a0e671664bb9085d" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:03.680027 6314 tablet_service.cc:1511] Processing CreateTablet for tablet 474e34e902064764864ba06ef41b1d94 (DEFAULT_TABLE table=default.Table_1587e5e79036480bbea0019663e71ef4 [id=2d69a962a7234afeb8366c66555b91e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.680426 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 474e34e902064764864ba06ef41b1d94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.687156 6323 tablet_service.cc:1511] Processing CreateTablet for tablet 35f46a1be80c4194b592c5d00fe1f342 (DEFAULT_TABLE table=default.Table_a5e5938cb98d49b2828f047807b2b784 [id=d6a2d0fc236a4056b224d01249f045b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.687805 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 6a2564a99c274e07a7e43da739a2458b (DEFAULT_TABLE table=default.Table_504b18d33ff6487da9b8f40467850853 [id=97f3cda15d6f4e258eece32745c45b50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.688124 6459 rpcz_store.cc:276] 0923 19:50:02.188904 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:02.190167 (+ 1263us) service_pool.cc:224] Handling call
0923 19:50:03.160806 (+970639us) ts_tablet_manager.cc:1151] Deleting tablet 3158b344d1c748aab5004543e4448adb
0923 19:50:03.242170 (+ 81364us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:03.296149 (+ 53979us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:03.572581 (+276432us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:03.573654 (+ 1073us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":968013}
I20260923 19:50:03.689939 6342 raft_consensus.cc:2468] T 9ed630e738c54ed38b9933f95fb552c5 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 1.
I20260923 19:50:03.691129 5796 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7b49fa59d61b48669d03e8b1c874baf5" } new_table_name: "default.Table_cbf3c92cd0434d1d9d664d8af53e425e" modify_external_catalogs: true
I20260923 19:50:03.690843 6456 consensus_queue.cc:260] T f2d9f1a0fae849ae8083eba082055fe9 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.692581 6324 tablet_service.cc:1511] Processing CreateTablet for tablet d09faa67bdc54d31a7f7a1b012de9ba1 (DEFAULT_TABLE table=default.Table_ab743ed22da14340a2986998869db477 [id=834c18797d8e48a79c45628c5180b80b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.693094 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35f46a1be80c4194b592c5d00fe1f342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.694065 6027 tablet_service.cc:1511] Processing CreateTablet for tablet edb52bd88b424129bbdc45de89b56efb (DEFAULT_TABLE table=default.Table_2d93c35dfe11401d8c780bda7643cb4f [id=918936f42dad4927bd643541a36f9e5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.694628 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033c2d772c8a44d2a0e671664bb9085d" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:03.695693 6325 tablet_service.cc:1511] Processing CreateTablet for tablet c19298691d5d4209b2d1147a1aad2f6f (DEFAULT_TABLE table=default.Table_22f84157ac664f81ae5266143e743737 [id=4bf839f09513412ea20c5e0afece9c37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.697366 6319 tablet_service.cc:1511] Processing CreateTablet for tablet edb52bd88b424129bbdc45de89b56efb (DEFAULT_TABLE table=default.Table_2d93c35dfe11401d8c780bda7643cb4f [id=918936f42dad4927bd643541a36f9e5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.698087 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a2564a99c274e07a7e43da739a2458b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.701695 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c19298691d5d4209b2d1147a1aad2f6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.702612 6454 tablet_bootstrap.cc:654] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:03.702839 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d09faa67bdc54d31a7f7a1b012de9ba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.712013 6319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edb52bd88b424129bbdc45de89b56efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.722834 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_c670311ee64c4e728677dc29691ea3f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:03.723431 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c670311ee64c4e728677dc29691ea3f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:03.722834 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_307ba44a8b0641cdaaa0ef43e10172e1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:03.724910 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_307ba44a8b0641cdaaa0ef43e10172e1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:03.725472 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 3158b344d1c748aab5004543e4448adb (table default.Table_655e0d86bc12407f9287ace4b3e76c29 [id=5bc43061f37b4defac5a530a1f174684]) successfully deleted
I20260923 19:50:03.729215 5801 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7342c845a15749d5b6bd089d55287f3a" } modify_external_catalogs: true
I20260923 19:50:03.729418 5801 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7342c845a15749d5b6bd089d55287f3a" } modify_external_catalogs: true
I20260923 19:50:03.730217 6174 tablet_service.cc:1511] Processing CreateTablet for tablet edb52bd88b424129bbdc45de89b56efb (DEFAULT_TABLE table=default.Table_2d93c35dfe11401d8c780bda7643cb4f [id=918936f42dad4927bd643541a36f9e5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.730635 6182 tablet_service.cc:1558] Processing DeleteTablet for tablet c0ff8838ab17433ab733d3b293d4964f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:03.730976 6167 tablet_service.cc:1511] Processing CreateTablet for tablet efc63a151f6444dfb03c3f15f6f54473 (DEFAULT_TABLE table=default.Table_ee5fbb39c54a49c89eaaff48f72a9c3c [id=20b663f1b2504d4199c2a9a2e9667d5c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:03.736534 5996 leader_election.cc:343] T 033c2d772c8a44d2a0e671664bb9085d P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:03.741559 5798 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 5fff4c717b324336be8adba67c26df20
I20260923 19:50:03.742890 6766 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=0 applied=17 ignored=0} inserts{seen=23 ignored=0} mutations{seen=1 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 19:50:03.742893 5798 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 115048f771764e41a3816e17a6c6cf94 (table default.Table_62802f9e844c4c16bf9cb0d04a630fa9 [id=498c667413e24c7c800fe5eae263cf22]). Expected version 1 got 0
I20260923 19:50:03.743189 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_036527853b5f467ab42e956cc35b2081"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:03.743533 6766 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562: Bootstrap complete.
W20260923 19:50:03.743881 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_036527853b5f467ab42e956cc35b2081 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:03.746784 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_ceca0c9fd74649909ccd0fd70d2ccca0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:03.747401 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ceca0c9fd74649909ccd0fd70d2ccca0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:03.748174 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edb52bd88b424129bbdc45de89b56efb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:03.751183 5995 leader_election.cc:343] T 033c2d772c8a44d2a0e671664bb9085d P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:03.751829 6773 consensus_queue.cc:1048] T a10110f4a2b34b61a4cc586d65981606 P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260923 19:50:03.752337 6576 consensus_queue.cc:1048] T 87afbdb11c6e4e58affd2f2d7995e1f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260923 19:50:03.752719 6459 tablet_replica.cc:333] T 259e4faa58f549699538317019be5daf P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:03.753585 6766 raft_consensus.cc:359] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } }
I20260923 19:50:03.754707 6766 raft_consensus.cc:740] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 009ffee03a4d41db84df9f450aa84562, State: Initialized, Role: FOLLOWER
I20260923 19:50:03.755607 6766 consensus_queue.cc:260] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 17, Last appended: 3.17, Last appended by leader: 17, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } }
I20260923 19:50:03.758529 6175 tablet_service.cc:1511] Processing CreateTablet for tablet c19298691d5d4209b2d1147a1aad2f6f (DEFAULT_TABLE table=default.Table_22f84157ac664f81ae5266143e743737 [id=4bf839f09513412ea20c5e0afece9c37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.759178 6164 tablet_service.cc:1511] Processing CreateTablet for tablet 12f4abb573bd4be6961b55c27c684d06 (DEFAULT_TABLE table=default.Table_f3099aec2da54c33b79ac8261f13f6a2 [id=e15861b2c6c2424a862634f2dc347039]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.760422 6168 tablet_service.cc:1511] Processing CreateTablet for tablet d09faa67bdc54d31a7f7a1b012de9ba1 (DEFAULT_TABLE table=default.Table_ab743ed22da14340a2986998869db477 [id=834c18797d8e48a79c45628c5180b80b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.762971 6791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } } }
I20260923 19:50:03.763890 6166 tablet_service.cc:1511] Processing CreateTablet for tablet 35f46a1be80c4194b592c5d00fe1f342 (DEFAULT_TABLE table=default.Table_a5e5938cb98d49b2828f047807b2b784 [id=d6a2d0fc236a4056b224d01249f045b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.764920 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 0e123b69877e4b1fbcdb2b27960864e9 (DEFAULT_TABLE table=default.Table_0562db93b14243108d8731231ae538c1 [id=74e85060f50e45069c378e7fd4cc7dba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.765312 6454 tablet_bootstrap.cc:492] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:03.765726 6791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:50:03.765602 6766 sys_catalog.cc:565] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:50:03.765793 6646 raft_consensus.cc:493] T e52d78a941a341d186dc00bbe7df96bf P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:03.767089 6173 tablet_service.cc:1511] Processing CreateTablet for tablet 6a2564a99c274e07a7e43da739a2458b (DEFAULT_TABLE table=default.Table_504b18d33ff6487da9b8f40467850853 [id=97f3cda15d6f4e258eece32745c45b50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.761679 5995 leader_election.cc:304] T 033c2d772c8a44d2a0e671664bb9085d P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:03.771816 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edb52bd88b424129bbdc45de89b56efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.773355 6176 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e781ccf4aa343fc924138c3cc2b04e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:03.754417 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 474e34e902064764864ba06ef41b1d94 (DEFAULT_TABLE table=default.Table_1587e5e79036480bbea0019663e71ef4 [id=2d69a962a7234afeb8366c66555b91e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.774248 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 66739afdf147413787acb0363aa37df6 (DEFAULT_TABLE table=default.Table_973f7a2560ab48ad8d84aeb2f4fc235b [id=72c42d0bf8264d809c5ec888d05db821]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:03.774740 5995 consensus_peers.cc:597] T 87afbdb11c6e4e58affd2f2d7995e1f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:03.775229 6179 tablet_service.cc:1511] Processing CreateTablet for tablet 474e34e902064764864ba06ef41b1d94 (DEFAULT_TABLE table=default.Table_1587e5e79036480bbea0019663e71ef4 [id=2d69a962a7234afeb8366c66555b91e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.775522 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a2564a99c274e07a7e43da739a2458b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.775627 6035 tablet_service.cc:1511] Processing CreateTablet for tablet 35f46a1be80c4194b592c5d00fe1f342 (DEFAULT_TABLE table=default.Table_a5e5938cb98d49b2828f047807b2b784 [id=d6a2d0fc236a4056b224d01249f045b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.776108 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35f46a1be80c4194b592c5d00fe1f342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.776392 6022 tablet_service.cc:1511] Processing CreateTablet for tablet d09faa67bdc54d31a7f7a1b012de9ba1 (DEFAULT_TABLE table=default.Table_ab743ed22da14340a2986998869db477 [id=834c18797d8e48a79c45628c5180b80b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.776671 6031 tablet_service.cc:1511] Processing CreateTablet for tablet 6a2564a99c274e07a7e43da739a2458b (DEFAULT_TABLE table=default.Table_504b18d33ff6487da9b8f40467850853 [id=97f3cda15d6f4e258eece32745c45b50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.777202 6032 tablet_service.cc:1511] Processing CreateTablet for tablet c19298691d5d4209b2d1147a1aad2f6f (DEFAULT_TABLE table=default.Table_22f84157ac664f81ae5266143e743737 [id=4bf839f09513412ea20c5e0afece9c37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:03.778079 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 474e34e902064764864ba06ef41b1d94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.782636 6461 ts_tablet_manager.cc:1929] T f7e282b6699a4ce9837d221132a1f54e P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260923 19:50:03.797600 5791 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 85d35ebef3c24a2e89233dd900b63513 (table default.Table_41c4d80198a246a78955ae6ab79f3532 [id=da91b06e11c64bb0aaec37a0188b5586], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 85d35ebef3c24a2e89233dd900b63513 consensus state has no leader
I20260923 19:50:03.785027 6457 tablet_bootstrap.cc:492] T d70b7662d85a4f64a11420448c4d140d P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
W20260923 19:50:03.785390 5995 consensus_peers.cc:597] T a10110f4a2b34b61a4cc586d65981606 P e546f660e7e541d1aa9ae38e5ee5b9c0 -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:03.802254 6457 ts_tablet_manager.cc:1403] T d70b7662d85a4f64a11420448c4d140d P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.198s user 0.006s sys 0.028s
I20260923 19:50:03.796376 6755 raft_consensus.cc:2749] T 033c2d772c8a44d2a0e671664bb9085d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:03.799279 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d09faa67bdc54d31a7f7a1b012de9ba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.807741 6457 raft_consensus.cc:359] T d70b7662d85a4f64a11420448c4d140d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.808352 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 474e34e902064764864ba06ef41b1d94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.811959 6457 raft_consensus.cc:385] T d70b7662d85a4f64a11420448c4d140d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:03.812088 6457 raft_consensus.cc:740] T d70b7662d85a4f64a11420448c4d140d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:03.812788 6457 consensus_queue.cc:260] T d70b7662d85a4f64a11420448c4d140d P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.813468 6457 ts_tablet_manager.cc:1434] T d70b7662d85a4f64a11420448c4d140d P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260923 19:50:03.813773 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c19298691d5d4209b2d1147a1aad2f6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.815073 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a2564a99c274e07a7e43da739a2458b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.818452 6457 tablet_bootstrap.cc:492] T a1e8b8e638ec438a86f05fa147cdb27c P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:03.824509 6778 raft_consensus.cc:493] T c817af3eb83a43a3b6d4e9c83a9eefbb P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e546f660e7e541d1aa9ae38e5ee5b9c0)
I20260923 19:50:03.824719 6778 raft_consensus.cc:515] T c817af3eb83a43a3b6d4e9c83a9eefbb P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.826160 6778 leader_election.cc:290] T c817af3eb83a43a3b6d4e9c83a9eefbb P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:03.827096 6279 leader_election.cc:343] T c817af3eb83a43a3b6d4e9c83a9eefbb P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: c817af3eb83a43a3b6d4e9c83a9eefbb
W20260923 19:50:03.829057 6280 leader_election.cc:343] T c817af3eb83a43a3b6d4e9c83a9eefbb P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Not found: Tablet not found: c817af3eb83a43a3b6d4e9c83a9eefbb
I20260923 19:50:03.829416 6280 leader_election.cc:304] T c817af3eb83a43a3b6d4e9c83a9eefbb P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:03.830026 6728 raft_consensus.cc:493] T f2d9f1a0fae849ae8083eba082055fe9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:03.830216 6728 raft_consensus.cc:515] T f2d9f1a0fae849ae8083eba082055fe9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.831157 6728 leader_election.cc:290] T f2d9f1a0fae849ae8083eba082055fe9 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:03.831372 6728 raft_consensus.cc:2749] T c817af3eb83a43a3b6d4e9c83a9eefbb P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 19:50:03.813059 6454 ts_tablet_manager.cc:1403] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.214s user 0.002s sys 0.003s
I20260923 19:50:03.833266 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d9f1a0fae849ae8083eba082055fe9" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:03.815124 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efc63a151f6444dfb03c3f15f6f54473. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:03.836985 6280 leader_election.cc:343] T f2d9f1a0fae849ae8083eba082055fe9 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:03.838959 6454 raft_consensus.cc:359] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.839386 6454 raft_consensus.cc:385] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:03.839545 6454 raft_consensus.cc:740] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:03.839984 6454 consensus_queue.cc:260] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.841096 6454 ts_tablet_manager.cc:1434] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260923 19:50:03.841617 6454 tablet_bootstrap.cc:492] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:03.845757 6057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d9f1a0fae849ae8083eba082055fe9" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
W20260923 19:50:03.847497 6279 leader_election.cc:343] T f2d9f1a0fae849ae8083eba082055fe9 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:03.847781 6279 leader_election.cc:304] T f2d9f1a0fae849ae8083eba082055fe9 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:03.810077 6461 log.cc:1199] T f7e282b6699a4ce9837d221132a1f54e P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/f7e282b6699a4ce9837d221132a1f54e
I20260923 19:50:03.851111 6778 raft_consensus.cc:2749] T f2d9f1a0fae849ae8083eba082055fe9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:03.843186 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35f46a1be80c4194b592c5d00fe1f342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.876085 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12f4abb573bd4be6961b55c27c684d06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.812633 6172 tablet_service.cc:1558] Processing DeleteTablet for tablet a224ae69503e4ab588d6269086317f09 with delete_type TABLET_DATA_DELETED (replaced by tablet d6d3601a392f4723b4ca00f6e12b950c) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:03.818928 6646 raft_consensus.cc:515] T e52d78a941a341d186dc00bbe7df96bf P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.888708 6457 tablet_bootstrap.cc:654] T a1e8b8e638ec438a86f05fa147cdb27c P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:03.881189 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e123b69877e4b1fbcdb2b27960864e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.898514 6175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c19298691d5d4209b2d1147a1aad2f6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.902202 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d09faa67bdc54d31a7f7a1b012de9ba1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:03.902637 6139 leader_election.cc:343] T e52d78a941a341d186dc00bbe7df96bf P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: e52d78a941a341d186dc00bbe7df96bf
I20260923 19:50:03.905618 6646 leader_election.cc:290] T e52d78a941a341d186dc00bbe7df96bf P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:03.910081 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66739afdf147413787acb0363aa37df6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:03.820700 6459 raft_consensus.cc:2243] T 259e4faa58f549699538317019be5daf P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:03.918408 6459 raft_consensus.cc:2272] T 259e4faa58f549699538317019be5daf P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:03.919306 6137 leader_election.cc:343] T e52d78a941a341d186dc00bbe7df96bf P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: e52d78a941a341d186dc00bbe7df96bf
I20260923 19:50:03.919521 6137 leader_election.cc:304] T e52d78a941a341d186dc00bbe7df96bf P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:03.919751 6459 ts_tablet_manager.cc:1916] T 259e4faa58f549699538317019be5daf P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:03.920431 6733 raft_consensus.cc:2749] T e52d78a941a341d186dc00bbe7df96bf P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:03.921041 6755 raft_consensus.cc:493] T 6a34e178007b4e8ebed429cedf44e82a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:03.923695 6755 raft_consensus.cc:515] T 6a34e178007b4e8ebed429cedf44e82a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.925899 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a34e178007b4e8ebed429cedf44e82a" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:03.926180 6755 leader_election.cc:290] T 6a34e178007b4e8ebed429cedf44e82a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:03.927336 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a34e178007b4e8ebed429cedf44e82a" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:03.934407 6454 tablet_bootstrap.cc:654] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:03.940595 5805 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ba9e77809f194febb243d6dc37df3ee0" } modify_external_catalogs: true
I20260923 19:50:03.940851 5805 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ba9e77809f194febb243d6dc37df3ee0" } modify_external_catalogs: true
I20260923 19:50:03.941797 5803 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_3034bb02271e459ebedf3424b5f8f908" } modify_external_catalogs: true
I20260923 19:50:03.942001 5803 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_3034bb02271e459ebedf3424b5f8f908" } modify_external_catalogs: true
I20260923 19:50:03.949281 6248 heartbeater.cc:344] Connected to a master server at 127.5.143.252:45543
W20260923 19:50:03.952585 5796 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7e41501bf01e4765853c27e4cac21e2b consensus state has no leader
I20260923 19:50:03.953510 5801 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet f4e3e64fdf584743a3a88df5d6600b22
I20260923 19:50:03.954187 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_f8ddcdb63fd04bd7b8f2a95e97e449bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:03.955292 5804 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ab0854f0eab74c5da576ed87dc003ad8" } new_table_name: "default.Table_23c500b65dba4b6790b4349e5a5b0a07" modify_external_catalogs: true
I20260923 19:50:03.959129 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_9d716833c456436cbc514b6a9070c9e1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:03.959376 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_1587e5e79036480bbea0019663e71ef4" } new_table_name: "default.Table_71cd58805ce747c3bbe35af74bb03cd6" modify_external_catalogs: true
W20260923 19:50:03.959713 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9d716833c456436cbc514b6a9070c9e1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:03.962770 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f8ddcdb63fd04bd7b8f2a95e97e449bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:03.965662 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_65616076f4a1461e9b5798cd7d8a089e" } new_table_name: "default.Table_b7610081818744a5b76680621ab7212d" modify_external_catalogs: true
I20260923 19:50:03.966948 6172 tablet_service.cc:1558] Processing DeleteTablet for tablet f4e3e64fdf584743a3a88df5d6600b22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:03.967281 5995 leader_election.cc:343] T 6a34e178007b4e8ebed429cedf44e82a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:03.967573 5996 leader_election.cc:343] T 6a34e178007b4e8ebed429cedf44e82a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:03.967859 6461 ts_tablet_manager.cc:1950] T f7e282b6699a4ce9837d221132a1f54e P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:03.968349 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet f4e3e64fdf584743a3a88df5d6600b22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:03.968624 6390 heartbeater.cc:344] Connected to a master server at 127.5.143.252:45543
I20260923 19:50:03.969237 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_bbd58de358814dbb827a145793718a7d" } new_table_name: "default.Table_4d1a0d71d11f4c0a8c80b3ba7ea0c358" modify_external_catalogs: true
I20260923 19:50:03.970338 5996 leader_election.cc:304] T 6a34e178007b4e8ebed429cedf44e82a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:03.972396 5799 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_62802f9e844c4c16bf9cb0d04a630fa9 [id=498c667413e24c7c800fe5eae263cf22] alter complete (version 1)
I20260923 19:50:03.973806 5799 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f68f50c8c0a74d59826e623c007a41a8" } modify_external_catalogs: true
I20260923 19:50:03.974244 5799 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f68f50c8c0a74d59826e623c007a41a8" } modify_external_catalogs: true
I20260923 19:50:03.973323 5802 master_service.cc:960] ReplaceTablet: received request to replace tablet 3919b15a00eb4fb08008f065f556c760 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:03.975667 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_c4d3bcab16044711b665673ef8cfa646"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:03.976438 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c4d3bcab16044711b665673ef8cfa646 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:03.977092 6454 tablet_bootstrap.cc:492] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:03.984637 6454 ts_tablet_manager.cc:1403] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.143s user 0.005s sys 0.002s
I20260923 19:50:03.978773 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet c52da04e5fe0454ea76bf4d99a930fd7 with delete_type TABLET_DATA_DELETED (replaced by tablet b529b0e82c5b48edac54cc281ac4b4a6) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:03.991765 6454 raft_consensus.cc:359] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.994798 6454 raft_consensus.cc:385] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:03.995288 6454 raft_consensus.cc:740] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:03.996320 6454 consensus_queue.cc:260] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:03.999341 6456 ts_tablet_manager.cc:1434] T f2d9f1a0fae849ae8083eba082055fe9 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.401s user 0.001s sys 0.002s
I20260923 19:50:04.003288 6454 ts_tablet_manager.cc:1434] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
W20260923 19:50:04.006671 5804 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 85b7dcf131c54187a6e61f8503c797f8 has no consensus state
I20260923 19:50:04.008386 5804 master_service.cc:960] ReplaceTablet: received request to replace tablet 896bd068e6b343e48eb2a01679b49326 from {username='slave'} at 127.0.0.1:59912
W20260923 19:50:04.008786 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 474e34e902064764864ba06ef41b1d94 consensus state has no leader
I20260923 19:50:04.008819 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bf129dd52b84a4ea461ec454bc34fe8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:04.009502 5800 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b18548ba557f448880c5e617fc03cbe0 has no consensus state
I20260923 19:50:04.009562 6454 tablet_bootstrap.cc:492] T 77f111a495f3429cb243417824095d02 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
W20260923 19:50:04.009951 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2ce6378a6bd844a485aebb96081307e3 has no consensus state
I20260923 19:50:04.017396 6454 tablet_bootstrap.cc:654] T 77f111a495f3429cb243417824095d02 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:04.017807 6778 raft_consensus.cc:493] T b302820d329a41f0a9a54501c079fcd7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:04.018218 6778 raft_consensus.cc:515] T b302820d329a41f0a9a54501c079fcd7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:04.019466 6778 leader_election.cc:290] T b302820d329a41f0a9a54501c079fcd7 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:04.025364 6456 tablet_bootstrap.cc:492] T 7504a2be25b54ed4bc539eb10199fe15 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:04.028146 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet f7e282b6699a4ce9837d221132a1f54e (table default.Table_c0be6341515349798508cd7887abaa7e [id=b5b882261126409ea6b837b2c010dd9e]) successfully deleted
I20260923 19:50:04.020316 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302820d329a41f0a9a54501c079fcd7" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:04.031472 6280 leader_election.cc:343] T b302820d329a41f0a9a54501c079fcd7 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:04.031931 6031 tablet_service.cc:1558] Processing DeleteTablet for tablet f4e3e64fdf584743a3a88df5d6600b22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:04.032262 6755 raft_consensus.cc:2749] T 6a34e178007b4e8ebed429cedf44e82a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:04.032660 6057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302820d329a41f0a9a54501c079fcd7" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:04.033118 6786 tablet.cc:1751] T 115048f771764e41a3816e17a6c6cf94 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:04.034757 6461 tablet_replica.cc:333] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:04.036314 6057 raft_consensus.cc:2468] T b302820d329a41f0a9a54501c079fcd7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:04.037578 6279 leader_election.cc:304] T b302820d329a41f0a9a54501c079fcd7 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:04.038115 6778 raft_consensus.cc:2804] T b302820d329a41f0a9a54501c079fcd7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:04.038249 6778 raft_consensus.cc:493] T b302820d329a41f0a9a54501c079fcd7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:04.038358 6778 raft_consensus.cc:3060] T b302820d329a41f0a9a54501c079fcd7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:04.042173 6778 raft_consensus.cc:515] T b302820d329a41f0a9a54501c079fcd7 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:04.054963 6461 raft_consensus.cc:2243] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:04.055456 6461 raft_consensus.cc:2272] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:04.058125 5700 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 124603us
I20260923 19:50:04.064971 5799 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 5e711e48156b46b5a517b330d6d41309
I20260923 19:50:04.065601 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 6238d16b1be74dd88fd2e089fbd85d33
I20260923 19:50:04.066888 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 063fc0e77d294ddf8a02e9ab5968a5e3
I20260923 19:50:04.067592 6755 consensus_queue.cc:1048] T 8db0358af7634911820f99fe16605ca7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:04.070021 6315 tablet_service.cc:1558] Processing DeleteTablet for tablet 6238d16b1be74dd88fd2e089fbd85d33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:04.070617 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e711e48156b46b5a517b330d6d41309 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:04.070801 5802 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 115048f771764e41a3816e17a6c6cf94 (table default.Table_62802f9e844c4c16bf9cb0d04a630fa9 [id=498c667413e24c7c800fe5eae263cf22]). Expected version 1 got 0
I20260923 19:50:04.071154 5802 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 0a5ce253bcce410b9517449f133d39e8 (table default.Table_84d13e1ea6234e5ca45738376e83f537 [id=0d4f6a5bb30c4d2a937424cf0e651afd]). Expected version 1 got 0
I20260923 19:50:04.072010 6315 tablet_service.cc:1511] Processing CreateTablet for tablet a11ecef9a24f4e4a812ec220b6a92cc4 (DEFAULT_TABLE table=default.Table_ba859ce2dc954a94ac103be8f6037961 [id=712c6403e1b74895b79a3f7484db7347]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.072496 6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a11ecef9a24f4e4a812ec220b6a92cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.074290 6461 ts_tablet_manager.cc:1916] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:04.074596 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 896bd068e6b343e48eb2a01679b49326
I20260923 19:50:04.075049 5804 catalog_manager.cc:6934] ReplaceTablet: tablet 896bd068e6b343e48eb2a01679b49326 deleted and replaced by tablet 0c537304c32c44adaa1e05de4496293f
I20260923 19:50:04.078874 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet 063fc0e77d294ddf8a02e9ab5968a5e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:04.079886 6321 tablet_service.cc:1511] Processing CreateTablet for tablet 2ce6378a6bd844a485aebb96081307e3 (DEFAULT_TABLE table=default.Table_4d1a0d71d11f4c0a8c80b3ba7ea0c358 [id=ef9a6c259ceb4c189c8902a776fb3bfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.080330 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ce6378a6bd844a485aebb96081307e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.081682 6027 tablet_service.cc:1558] Processing DeleteTablet for tablet 6238d16b1be74dd88fd2e089fbd85d33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:04.082055 6035 tablet_service.cc:1511] Processing CreateTablet for tablet 9be4c46ee8eb4dbaad01d492b701a9e0 (DEFAULT_TABLE table=default.Table_bb91666519bc41aaaf1fc7f8e8b26691 [id=1b974d4dff8c4868947a4d7765208c97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.082687 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9be4c46ee8eb4dbaad01d492b701a9e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.085671 6028 tablet_service.cc:1511] Processing CreateTablet for tablet a11ecef9a24f4e4a812ec220b6a92cc4 (DEFAULT_TABLE table=default.Table_ba859ce2dc954a94ac103be8f6037961 [id=712c6403e1b74895b79a3f7484db7347]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.086515 6027 tablet_service.cc:1558] Processing DeleteTablet for tablet 063fc0e77d294ddf8a02e9ab5968a5e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:04.086753 6323 tablet_service.cc:1511] Processing CreateTablet for tablet 035abecfbee7474d9dd048f35e28e867 (DEFAULT_TABLE table=default.Table_5a1ffa59de984ef3adb370cdf1142f24 [id=d2e859af377f491dbc81f6f3d4111640]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.086884 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e711e48156b46b5a517b330d6d41309 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:04.087020 6057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302820d329a41f0a9a54501c079fcd7" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:04.087193 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 035abecfbee7474d9dd048f35e28e867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.087430 6031 tablet_service.cc:1511] Processing CreateTablet for tablet 28f9d03be14a4072aab7fd03834c3f6b (DEFAULT_TABLE table=default.Table_2b35ad69600645618a826140c33c4da8 [id=6a9d5cc3eb1a4dbdbf6a5acaafa07ec7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.087973 6025 tablet_service.cc:1511] Processing CreateTablet for tablet 2ce6378a6bd844a485aebb96081307e3 (DEFAULT_TABLE table=default.Table_4d1a0d71d11f4c0a8c80b3ba7ea0c358 [id=ef9a6c259ceb4c189c8902a776fb3bfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.088325 6057 raft_consensus.cc:3060] T b302820d329a41f0a9a54501c079fcd7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:04.091643 6057 raft_consensus.cc:2468] T b302820d329a41f0a9a54501c079fcd7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:04.092021 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a11ecef9a24f4e4a812ec220b6a92cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.097451 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ce6378a6bd844a485aebb96081307e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.097544 6313 tablet_service.cc:1558] Processing DeleteTablet for tablet 896bd068e6b343e48eb2a01679b49326 with delete_type TABLET_DATA_DELETED (replaced by tablet 0c537304c32c44adaa1e05de4496293f) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:04.098549 6313 tablet_service.cc:1511] Processing CreateTablet for tablet 58ea466d1b2b40e9b9b4cd5be51f79e0 (DEFAULT_TABLE table=default.Table_4e6fe5709a6947bb856cc36444f9fbe6 [id=3ee0e52e785f4cb39add98261628d513]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.099936 6320 tablet_service.cc:1511] Processing CreateTablet for tablet 22e37d5afa8047989928596b4092c4b9 (DEFAULT_TABLE table=default.Table_aa989ce1be2c4480b91e1102cef5a585 [id=c0f9d6a40e364dd0ad7ce95fa73b5930]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.102322 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28f9d03be14a4072aab7fd03834c3f6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.106493 6322 tablet_service.cc:1511] Processing CreateTablet for tablet 2398c59871d241f985bca1761e722180 (DEFAULT_TABLE table=default.Table_1a1905b61f0a4ba2bec7b293119af35c [id=4ec3992af15345ec89f8f727343e3df2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.106813 6039 tablet_service.cc:1558] Processing DeleteTablet for tablet 896bd068e6b343e48eb2a01679b49326 with delete_type TABLET_DATA_DELETED (replaced by tablet 0c537304c32c44adaa1e05de4496293f) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:04.107743 6317 tablet_service.cc:1511] Processing CreateTablet for tablet c504ec668a33451fb1249f697bb5e2bb (DEFAULT_TABLE table=default.Table_870cfa1b62c4442d866d3b9b1aec4bc7 [id=b8b525ace3444e3fb6548fb9f2064765]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.108157 6318 tablet_service.cc:1511] Processing CreateTablet for tablet 6238d16b1be74dd88fd2e089fbd85d33 (DEFAULT_TABLE table=default.Table_ba9e77809f194febb243d6dc37df3ee0 [id=6cacf523bb724ea58690207d93819846]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.108603 6309 tablet_service.cc:1511] Processing CreateTablet for tablet 15a9d1d4adaa402f90d774e77010c928 (DEFAULT_TABLE table=default.Table_21a1fa60dde7481e8ad7a7fe355a1e94 [id=9e398f48d86e4c5898cac7336d3c24bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.108880 6308 tablet_service.cc:1511] Processing CreateTablet for tablet 5e711e48156b46b5a517b330d6d41309 (DEFAULT_TABLE table=default.Table_f68f50c8c0a74d59826e623c007a41a8 [id=24509437bc6049aab27952daeb610184]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.109061 6310 tablet_service.cc:1511] Processing CreateTablet for tablet a53f2eb08330411ebe417d4e1e414db6 (DEFAULT_TABLE table=default.Table_eab0a85599f44d58b84847483e41ba6f [id=24a351e6e5744e70abf6776a741dbbe3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.109769 6024 tablet_service.cc:1511] Processing CreateTablet for tablet 58ea466d1b2b40e9b9b4cd5be51f79e0 (DEFAULT_TABLE table=default.Table_4e6fe5709a6947bb856cc36444f9fbe6 [id=3ee0e52e785f4cb39add98261628d513]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.111384 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 22e37d5afa8047989928596b4092c4b9 (DEFAULT_TABLE table=default.Table_aa989ce1be2c4480b91e1102cef5a585 [id=c0f9d6a40e364dd0ad7ce95fa73b5930]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.112155 6039 tablet_service.cc:1511] Processing CreateTablet for tablet 2398c59871d241f985bca1761e722180 (DEFAULT_TABLE table=default.Table_1a1905b61f0a4ba2bec7b293119af35c [id=4ec3992af15345ec89f8f727343e3df2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.112773 6027 tablet_service.cc:1558] Processing DeleteTablet for tablet d70b7662d85a4f64a11420448c4d140d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:04.112963 6024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58ea466d1b2b40e9b9b4cd5be51f79e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.113263 6307 tablet_service.cc:1511] Processing CreateTablet for tablet e4f00490b0364f0e9f1b9569b870808e (DEFAULT_TABLE table=default.Table_701c81d7fd4844f09fc1ccc28f0eda9c [id=67292e21e6b546298c5d629c6ebcb718]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.113785 6032 tablet_service.cc:1511] Processing CreateTablet for tablet 035abecfbee7474d9dd048f35e28e867 (DEFAULT_TABLE table=default.Table_5a1ffa59de984ef3adb370cdf1142f24 [id=d2e859af377f491dbc81f6f3d4111640]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.114118 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22e37d5afa8047989928596b4092c4b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.114300 6306 tablet_service.cc:1511] Processing CreateTablet for tablet d6d3601a392f4723b4ca00f6e12b950c (DEFAULT_TABLE table=default.Table_a079a188cf0c46a884c2de951b9f6bb5 [id=6c09f84a1d19402b8b59bbc60ae92bcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.118031 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 035abecfbee7474d9dd048f35e28e867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.118570 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2398c59871d241f985bca1761e722180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.119640 6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58ea466d1b2b40e9b9b4cd5be51f79e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.122393 6030 tablet_service.cc:1511] Processing CreateTablet for tablet c504ec668a33451fb1249f697bb5e2bb (DEFAULT_TABLE table=default.Table_870cfa1b62c4442d866d3b9b1aec4bc7 [id=b8b525ace3444e3fb6548fb9f2064765]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.123342 6027 tablet_service.cc:1511] Processing CreateTablet for tablet 6238d16b1be74dd88fd2e089fbd85d33 (DEFAULT_TABLE table=default.Table_ba9e77809f194febb243d6dc37df3ee0 [id=6cacf523bb724ea58690207d93819846]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.124946 6023 tablet_service.cc:1511] Processing CreateTablet for tablet 15a9d1d4adaa402f90d774e77010c928 (DEFAULT_TABLE table=default.Table_21a1fa60dde7481e8ad7a7fe355a1e94 [id=9e398f48d86e4c5898cac7336d3c24bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.125816 6040 tablet_service.cc:1511] Processing CreateTablet for tablet a53f2eb08330411ebe417d4e1e414db6 (DEFAULT_TABLE table=default.Table_eab0a85599f44d58b84847483e41ba6f [id=24a351e6e5744e70abf6776a741dbbe3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.126686 6038 tablet_service.cc:1511] Processing CreateTablet for tablet 5e711e48156b46b5a517b330d6d41309 (DEFAULT_TABLE table=default.Table_f68f50c8c0a74d59826e623c007a41a8 [id=24509437bc6049aab27952daeb610184]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.132257 5804 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet a10110f4a2b34b61a4cc586d65981606 (table default.Table_ccd00f21243a43deb385f4673958f88c [id=019ceccbcb1041cc9e5625274c45a0f3]). Expected version 2 got 0
I20260923 19:50:04.134223 6038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e711e48156b46b5a517b330d6d41309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.134378 5804 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d824a438d0804f58b8b89f6f0f0f964e" } modify_external_catalogs: true
I20260923 19:50:04.134604 5804 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d824a438d0804f58b8b89f6f0f0f964e" } modify_external_catalogs: true
I20260923 19:50:04.135275 6040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a53f2eb08330411ebe417d4e1e414db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.135715 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c504ec668a33451fb1249f697bb5e2bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.136096 6023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15a9d1d4adaa402f90d774e77010c928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.136271 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e711e48156b46b5a517b330d6d41309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.136502 6322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2398c59871d241f985bca1761e722180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.136518 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6238d16b1be74dd88fd2e089fbd85d33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.136451 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_b615fa2da8c94949bed2f458156fc128"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:04.137121 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b615fa2da8c94949bed2f458156fc128 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:04.146965 6778 leader_election.cc:290] T b302820d329a41f0a9a54501c079fcd7 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:04.149511 6456 tablet_bootstrap.cc:654] T 7504a2be25b54ed4bc539eb10199fe15 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:04.150874 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_da77a1d14aed4fba88200eb53fd16559"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:04.151490 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_da77a1d14aed4fba88200eb53fd16559 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:04.154484 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_125b7d46aef24091b6bc3c8e39e3dd99"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:04.155059 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_125b7d46aef24091b6bc3c8e39e3dd99 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:04.156462 6036 tablet_service.cc:1511] Processing CreateTablet for tablet e4f00490b0364f0e9f1b9569b870808e (DEFAULT_TABLE table=default.Table_701c81d7fd4844f09fc1ccc28f0eda9c [id=67292e21e6b546298c5d629c6ebcb718]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.156870 6036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f00490b0364f0e9f1b9569b870808e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.169845 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b302820d329a41f0a9a54501c079fcd7" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:04.172351 6646 raft_consensus.cc:493] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:04.184069 6174 tablet_service.cc:1511] Processing CreateTablet for tablet a11ecef9a24f4e4a812ec220b6a92cc4 (DEFAULT_TABLE table=default.Table_ba859ce2dc954a94ac103be8f6037961 [id=712c6403e1b74895b79a3f7484db7347]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.184643 6173 tablet_service.cc:1511] Processing CreateTablet for tablet 28f9d03be14a4072aab7fd03834c3f6b (DEFAULT_TABLE table=default.Table_2b35ad69600645618a826140c33c4da8 [id=6a9d5cc3eb1a4dbdbf6a5acaafa07ec7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.187427 6646 raft_consensus.cc:515] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:04.187493 6166 tablet_service.cc:1511] Processing CreateTablet for tablet 9be4c46ee8eb4dbaad01d492b701a9e0 (DEFAULT_TABLE table=default.Table_bb91666519bc41aaaf1fc7f8e8b26691 [id=1b974d4dff8c4868947a4d7765208c97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.188241 6646 leader_election.cc:290] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:04.191305 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_562543b3ee364c59a1a2a7fd61331c74"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:04.192504 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a11420ea5a314c55aed7538c702811ee" } new_table_name: "default.Table_e8d6483ff4364f578b5a1747840f7019" modify_external_catalogs: true
I20260923 19:50:04.194182 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_1a5602208673400faf5f272297ff82b9" } modify_external_catalogs: true
I20260923 19:50:04.194368 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_1a5602208673400faf5f272297ff82b9" } modify_external_catalogs: true
I20260923 19:50:04.194898 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_eb265406b1504d7b87248e40a9fb5ce2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:04.195698 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_109d63d522e24e3b8d45897a9c9ce09f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:04.197083 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_e544284af20d48f9a6f3ffe1bd235e41"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:04.198589 6306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6d3601a392f4723b4ca00f6e12b950c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:04.201502 6280 leader_election.cc:343] T b302820d329a41f0a9a54501c079fcd7 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:04.206445 6320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22e37d5afa8047989928596b4092c4b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.207603 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 9be4c46ee8eb4dbaad01d492b701a9e0 (DEFAULT_TABLE table=default.Table_bb91666519bc41aaaf1fc7f8e8b26691 [id=1b974d4dff8c4868947a4d7765208c97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.215142 5797 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a32dfccff8cd4459919a575fd2a136ad" } new_table_name: "default.Table_f57f8cacbedb49c6be509b51c824b960" modify_external_catalogs: true
I20260923 19:50:04.215274 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_aa989ce1be2c4480b91e1102cef5a585" } new_table_name: "default.Table_1141571b3d744e3b922ca1d9745fbadf" modify_external_catalogs: true
I20260923 19:50:04.225252 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e711e48156b46b5a517b330d6d41309 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:04.226426 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a11ecef9a24f4e4a812ec220b6a92cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.230773 6646 raft_consensus.cc:493] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:04.230971 6646 raft_consensus.cc:515] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:04.233599 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28f9d03be14a4072aab7fd03834c3f6b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:04.235371 6137 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.5.143.193:39887, user_credentials={real_user=slave}} blocked reactor thread for 121120us
I20260923 19:50:04.237129 6172 tablet_service.cc:1558] Processing DeleteTablet for tablet 6238d16b1be74dd88fd2e089fbd85d33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:04.238227 6176 tablet_service.cc:1558] Processing DeleteTablet for tablet 896bd068e6b343e48eb2a01679b49326 with delete_type TABLET_DATA_DELETED (replaced by tablet 0c537304c32c44adaa1e05de4496293f) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:04.239601 6182 tablet_service.cc:1511] Processing CreateTablet for tablet 58ea466d1b2b40e9b9b4cd5be51f79e0 (DEFAULT_TABLE table=default.Table_4e6fe5709a6947bb856cc36444f9fbe6 [id=3ee0e52e785f4cb39add98261628d513]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.242851 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9be4c46ee8eb4dbaad01d492b701a9e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.244845 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c504ec668a33451fb1249f697bb5e2bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.248764 6316 tablet_service.cc:1511] Processing CreateTablet for tablet b18548ba557f448880c5e617fc03cbe0 (DEFAULT_TABLE table=default.Table_b7610081818744a5b76680621ab7212d [id=8b14917d9dc6415dbb75917bccf09502]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.249104 6313 tablet_service.cc:1511] Processing CreateTablet for tablet 2948d729e1ec4dfca70789bcad513e52 (DEFAULT_TABLE table=default.Table_0fabac277720489788ff4ee29635ba66 [id=ff040ccffd9c4e24be8e0eaafa134785]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:04.266610 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_109d63d522e24e3b8d45897a9c9ce09f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:04.266629 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_562543b3ee364c59a1a2a7fd61331c74 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:04.269222 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eb265406b1504d7b87248e40a9fb5ce2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:04.270402 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e544284af20d48f9a6f3ffe1bd235e41 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:04.244275 6646 leader_election.cc:290] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:04.246587 6172 tablet_service.cc:1511] Processing CreateTablet for tablet 2ce6378a6bd844a485aebb96081307e3 (DEFAULT_TABLE table=default.Table_4d1a0d71d11f4c0a8c80b3ba7ea0c358 [id=ef9a6c259ceb4c189c8902a776fb3bfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.286398 6172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ce6378a6bd844a485aebb96081307e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.247572 6176 tablet_service.cc:1511] Processing CreateTablet for tablet 2398c59871d241f985bca1761e722180 (DEFAULT_TABLE table=default.Table_1a1905b61f0a4ba2bec7b293119af35c [id=4ec3992af15345ec89f8f727343e3df2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.250630 6170 tablet_service.cc:1511] Processing CreateTablet for tablet c504ec668a33451fb1249f697bb5e2bb (DEFAULT_TABLE table=default.Table_870cfa1b62c4442d866d3b9b1aec4bc7 [id=b8b525ace3444e3fb6548fb9f2064765]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.250792 6169 tablet_service.cc:1511] Processing CreateTablet for tablet 22e37d5afa8047989928596b4092c4b9 (DEFAULT_TABLE table=default.Table_aa989ce1be2c4480b91e1102cef5a585 [id=c0f9d6a40e364dd0ad7ce95fa73b5930]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.294027 6034 tablet_service.cc:1511] Processing CreateTablet for tablet a75c4436a67f453e973a7a7645de79b1 (DEFAULT_TABLE table=default.Table_30ce30e86cff4c8f9995423040b349c9 [id=e579cc40ccb84a7aa8c508342e6e19be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.294616 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a75c4436a67f453e973a7a7645de79b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.295768 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 85b7dcf131c54187a6e61f8503c797f8 (DEFAULT_TABLE table=default.Table_23c500b65dba4b6790b4349e5a5b0a07 [id=647997210f5349a68aa98d24e12a33cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.296264 6029 tablet_service.cc:1511] Processing CreateTablet for tablet d6d3601a392f4723b4ca00f6e12b950c (DEFAULT_TABLE table=default.Table_a079a188cf0c46a884c2de951b9f6bb5 [id=6c09f84a1d19402b8b59bbc60ae92bcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.299480 6026 tablet_service.cc:1511] Processing CreateTablet for tablet ed9fb0cab0bd43b7a05d7376125b187e (DEFAULT_TABLE table=default.Table_b980dd990237405ea45e67525bb34249 [id=445fa6e608d540d89758327dab79ca7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.299706 6033 tablet_service.cc:1511] Processing CreateTablet for tablet 2948d729e1ec4dfca70789bcad513e52 (DEFAULT_TABLE table=default.Table_0fabac277720489788ff4ee29635ba66 [id=ff040ccffd9c4e24be8e0eaafa134785]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.300329 6021 tablet_service.cc:1511] Processing CreateTablet for tablet 6ac04be575704a69994f98e00411a254 (DEFAULT_TABLE table=default.Table_4eba9023b25a445bb87c0b95ee9badaf [id=cefd3af14e2148c19281df9e59f07421]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:04.306974 6137 leader_election.cc:343] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 4bf129dd52b84a4ea461ec454bc34fe8
I20260923 19:50:04.308717 6182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58ea466d1b2b40e9b9b4cd5be51f79e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.310171 6171 tablet_service.cc:1511] Processing CreateTablet for tablet 15a9d1d4adaa402f90d774e77010c928 (DEFAULT_TABLE table=default.Table_21a1fa60dde7481e8ad7a7fe355a1e94 [id=9e398f48d86e4c5898cac7336d3c24bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.313333 6165 tablet_service.cc:1511] Processing CreateTablet for tablet 6238d16b1be74dd88fd2e089fbd85d33 (DEFAULT_TABLE table=default.Table_ba9e77809f194febb243d6dc37df3ee0 [id=6cacf523bb724ea58690207d93819846]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.314843 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 035abecfbee7474d9dd048f35e28e867 (DEFAULT_TABLE table=default.Table_5a1ffa59de984ef3adb370cdf1142f24 [id=d2e859af377f491dbc81f6f3d4111640]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.316285 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 28f9d03be14a4072aab7fd03834c3f6b (DEFAULT_TABLE table=default.Table_2b35ad69600645618a826140c33c4da8 [id=6a9d5cc3eb1a4dbdbf6a5acaafa07ec7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.320892 6025 tablet_service.cc:1511] Processing CreateTablet for tablet b18548ba557f448880c5e617fc03cbe0 (DEFAULT_TABLE table=default.Table_b7610081818744a5b76680621ab7212d [id=8b14917d9dc6415dbb75917bccf09502]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:04.314890 6137 leader_election.cc:343] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: c52da04e5fe0454ea76bf4d99a930fd7
I20260923 19:50:04.321120 6773 raft_consensus.cc:493] T d70b7662d85a4f64a11420448c4d140d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:04.314913 6176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2398c59871d241f985bca1761e722180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.322257 6773 raft_consensus.cc:515] T d70b7662d85a4f64a11420448c4d140d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:04.322867 6168 tablet_service.cc:1511] Processing CreateTablet for tablet 5e711e48156b46b5a517b330d6d41309 (DEFAULT_TABLE table=default.Table_f68f50c8c0a74d59826e623c007a41a8 [id=24509437bc6049aab27952daeb610184]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.323239 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85b7dcf131c54187a6e61f8503c797f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.323356 6457 tablet_bootstrap.cc:492] T a1e8b8e638ec438a86f05fa147cdb27c P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:04.325014 6458 ts_tablet_manager.cc:1929] T 8a2fbac8080441d4a9e03ff1d580bc8e P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:04.325222 6458 log.cc:1199] T 8a2fbac8080441d4a9e03ff1d580bc8e P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/8a2fbac8080441d4a9e03ff1d580bc8e
I20260923 19:50:04.325989 6037 tablet_service.cc:1511] Processing CreateTablet for tablet b7ba284e81bc4388bbd6456a41d1f9f4 (DEFAULT_TABLE table=default.Table_91a9675177604eb39c32e86718c59d31 [id=bf85ae2ea4884de58391fc9e7b140b7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.327198 6457 ts_tablet_manager.cc:1403] T a1e8b8e638ec438a86f05fa147cdb27c P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.507s user 0.004s sys 0.005s
I20260923 19:50:04.326787 6171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15a9d1d4adaa402f90d774e77010c928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.340221 6458 ts_tablet_manager.cc:1950] T 8a2fbac8080441d4a9e03ff1d580bc8e P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:04.341171 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 69) took 4630 ms. Trace:
I20260923 19:50:04.329138 6181 tablet_service.cc:1511] Processing CreateTablet for tablet e4f00490b0364f0e9f1b9569b870808e (DEFAULT_TABLE table=default.Table_701c81d7fd4844f09fc1ccc28f0eda9c [id=67292e21e6b546298c5d629c6ebcb718]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.329831 6177 tablet_service.cc:1511] Processing CreateTablet for tablet 6ac04be575704a69994f98e00411a254 (DEFAULT_TABLE table=default.Table_4eba9023b25a445bb87c0b95ee9badaf [id=cefd3af14e2148c19281df9e59f07421]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.329425 6180 tablet_service.cc:1511] Processing CreateTablet for tablet a75c4436a67f453e973a7a7645de79b1 (DEFAULT_TABLE table=default.Table_30ce30e86cff4c8f9995423040b349c9 [id=e579cc40ccb84a7aa8c508342e6e19be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.342727 6458 rpcz_store.cc:276] 0923 19:49:59.710469 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:49:59.710546 (+ 77us) service_pool.cc:224] Handling call
0923 19:50:03.555303 (+3844757us) ts_tablet_manager.cc:1151] Deleting tablet 8a2fbac8080441d4a9e03ff1d580bc8e
0923 19:50:03.555313 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:03.621952 (+ 66639us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:04.152885 (+530933us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:04.341128 (+188243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2349,"tablet-delete.queue_time_us":3844483}
I20260923 19:50:04.343252 6458 tablet_replica.cc:333] T 640a98d3a845461e8d4f07041ab515c7 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:04.343953 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 8a2fbac8080441d4a9e03ff1d580bc8e (table default.Table_bd91264aa4a0430eb1a8f69129fb0f3f [id=738ed1d070ef485e9299c1f3b1db008a]) successfully deleted
I20260923 19:50:04.344159 6454 tablet_bootstrap.cc:492] T 77f111a495f3429cb243417824095d02 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:04.345491 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf129dd52b84a4ea461ec454bc34fe8" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:04.345722 6344 raft_consensus.cc:2468] T 4bf129dd52b84a4ea461ec454bc34fe8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:04.328986 6164 tablet_service.cc:1511] Processing CreateTablet for tablet d6d3601a392f4723b4ca00f6e12b950c (DEFAULT_TABLE table=default.Table_a079a188cf0c46a884c2de951b9f6bb5 [id=6c09f84a1d19402b8b59bbc60ae92bcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.323791 6459 ts_tablet_manager.cc:1929] T 259e4faa58f549699538317019be5daf P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:04.350020 6458 raft_consensus.cc:2243] T 640a98d3a845461e8d4f07041ab515c7 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:04.350378 6458 pending_rounds.cc:70] T 640a98d3a845461e8d4f07041ab515c7 P 2bf41435f70447f19992d368ca6b46bd: Trying to abort 1 pending ops.
I20260923 19:50:04.351671 6314 tablet_service.cc:1511] Processing CreateTablet for tablet f74e7cb3e5f54dfdb2280c795ce2ce53 (DEFAULT_TABLE table=default.Table_20badc86d4ef4e2fb377e8e109782afd [id=8325a8f159124a2da260e2be3ce69500]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.352110 6323 tablet_service.cc:1511] Processing CreateTablet for tablet ad29d22a82434023991ffcacf7f9bee5 (DEFAULT_TABLE table=default.Table_6fc559685e30469ea0537af2f4cf6e1c [id=ea52a2330cd643e486e5b348dabbd295]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.354039 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52da04e5fe0454ea76bf4d99a930fd7" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:04.354264 6343 raft_consensus.cc:2468] T c52da04e5fe0454ea76bf4d99a930fd7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:04.354707 6458 pending_rounds.cc:77] T 640a98d3a845461e8d4f07041ab515c7 P 2bf41435f70447f19992d368ca6b46bd: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630541974392832 op_type: NO_OP noop_request { }
I20260923 19:50:04.355036 6309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15a9d1d4adaa402f90d774e77010c928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.355428 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28f9d03be14a4072aab7fd03834c3f6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.355571 6456 tablet_bootstrap.cc:492] T 7504a2be25b54ed4bc539eb10199fe15 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:04.356474 6778 raft_consensus.cc:493] T 09bb2ab5617a49d99e75191b3b48b85f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:04.357057 6458 raft_consensus.cc:2889] T 640a98d3a845461e8d4f07041ab515c7 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:04.357299 6324 tablet_service.cc:1511] Processing CreateTablet for tablet b7ba284e81bc4388bbd6456a41d1f9f4 (DEFAULT_TABLE table=default.Table_91a9675177604eb39c32e86718c59d31 [id=bf85ae2ea4884de58391fc9e7b140b7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.357666 6315 tablet_service.cc:1511] Processing CreateTablet for tablet a75c4436a67f453e973a7a7645de79b1 (DEFAULT_TABLE table=default.Table_30ce30e86cff4c8f9995423040b349c9 [id=e579cc40ccb84a7aa8c508342e6e19be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.358363 6778 raft_consensus.cc:515] T 09bb2ab5617a49d99e75191b3b48b85f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:04.360630 6139 leader_election.cc:304] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:04.361027 6646 raft_consensus.cc:2804] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:04.362816 6308 tablet_service.cc:1511] Processing CreateTablet for tablet 85b7dcf131c54187a6e61f8503c797f8 (DEFAULT_TABLE table=default.Table_23c500b65dba4b6790b4349e5a5b0a07 [id=647997210f5349a68aa98d24e12a33cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.362582 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet 063fc0e77d294ddf8a02e9ab5968a5e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:04.363348 6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2948d729e1ec4dfca70789bcad513e52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.364243 6458 raft_consensus.cc:2272] T 640a98d3a845461e8d4f07041ab515c7 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:04.364681 6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b18548ba557f448880c5e617fc03cbe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.365501 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9be4c46ee8eb4dbaad01d492b701a9e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.366544 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a53f2eb08330411ebe417d4e1e414db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.367301 6458 ts_tablet_manager.cc:1916] T 640a98d3a845461e8d4f07041ab515c7 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:04.374215 6318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6238d16b1be74dd88fd2e089fbd85d33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.375217 6307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f00490b0364f0e9f1b9569b870808e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.336894 6321 tablet_service.cc:1511] Processing CreateTablet for tablet 6ac04be575704a69994f98e00411a254 (DEFAULT_TABLE table=default.Table_4eba9023b25a445bb87c0b95ee9badaf [id=cefd3af14e2148c19281df9e59f07421]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.379976 6170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c504ec668a33451fb1249f697bb5e2bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.381022 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f74e7cb3e5f54dfdb2280c795ce2ce53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.384478 6454 ts_tablet_manager.cc:1403] T 77f111a495f3429cb243417824095d02 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.335s user 0.005s sys 0.002s
I20260923 19:50:04.385254 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad29d22a82434023991ffcacf7f9bee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.385335 6183 tablet_service.cc:1511] Processing CreateTablet for tablet a53f2eb08330411ebe417d4e1e414db6 (DEFAULT_TABLE table=default.Table_eab0a85599f44d58b84847483e41ba6f [id=24a351e6e5744e70abf6776a741dbbe3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.388891 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a75c4436a67f453e973a7a7645de79b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.389611 6167 tablet_service.cc:1511] Processing CreateTablet for tablet b7ba284e81bc4388bbd6456a41d1f9f4 (DEFAULT_TABLE table=default.Table_91a9675177604eb39c32e86718c59d31 [id=bf85ae2ea4884de58391fc9e7b140b7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.390396 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7ba284e81bc4388bbd6456a41d1f9f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.391716 6454 raft_consensus.cc:359] T 77f111a495f3429cb243417824095d02 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:04.394222 6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a75c4436a67f453e973a7a7645de79b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.394253 6646 raft_consensus.cc:493] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:04.394423 6646 raft_consensus.cc:3060] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:04.397197 6459 log.cc:1199] T 259e4faa58f549699538317019be5daf P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/259e4faa58f549699538317019be5daf
I20260923 19:50:04.398007 6459 ts_tablet_manager.cc:1950] T 259e4faa58f549699538317019be5daf P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:04.398536 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a53f2eb08330411ebe417d4e1e414db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.399827 6139 leader_election.cc:304] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:04.400378 6733 raft_consensus.cc:2804] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:04.403513 6733 raft_consensus.cc:493] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:04.403677 6733 raft_consensus.cc:3060] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:04.353770 6312 tablet_service.cc:1511] Processing CreateTablet for tablet ed9fb0cab0bd43b7a05d7376125b187e (DEFAULT_TABLE table=default.Table_b980dd990237405ea45e67525bb34249 [id=445fa6e608d540d89758327dab79ca7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.411032 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed9fb0cab0bd43b7a05d7376125b187e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.414513 6786 tablet.cc:1751] T a10110f4a2b34b61a4cc586d65981606 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:04.418903 6576 raft_consensus.cc:493] T 0a5ce253bcce410b9517449f133d39e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:04.419077 6576 raft_consensus.cc:515] T 0a5ce253bcce410b9517449f133d39e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:04.421603 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7ba284e81bc4388bbd6456a41d1f9f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.422119 6454 raft_consensus.cc:385] T 77f111a495f3429cb243417824095d02 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:04.422497 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22e37d5afa8047989928596b4092c4b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.424894 6038 tablet_service.cc:1511] Processing CreateTablet for tablet 6d29923f139445cc86379c80ac15df5d (DEFAULT_TABLE table=default.Table_0bf993fb53a243408934c3ce7812f300 [id=1dc5c4b9cfe242b099053cbb53aac5ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.427169 6022 tablet_service.cc:1511] Processing CreateTablet for tablet ad29d22a82434023991ffcacf7f9bee5 (DEFAULT_TABLE table=default.Table_6fc559685e30469ea0537af2f4cf6e1c [id=ea52a2330cd643e486e5b348dabbd295]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.427543 6032 tablet_service.cc:1511] Processing CreateTablet for tablet f74e7cb3e5f54dfdb2280c795ce2ce53 (DEFAULT_TABLE table=default.Table_20badc86d4ef4e2fb377e8e109782afd [id=8325a8f159124a2da260e2be3ce69500]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.427868 6033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2948d729e1ec4dfca70789bcad513e52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.428655 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad29d22a82434023991ffcacf7f9bee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.428825 6315 tablet_service.cc:1511] Processing CreateTablet for tablet b9c187ee1fa8438397c83bc2c2b16925 (DEFAULT_TABLE table=default.Table_76a4d42c4ee8417fa82124f036ec71de [id=220774101a2442309f08c3d6f8713956]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.429013 6454 raft_consensus.cc:740] T 77f111a495f3429cb243417824095d02 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:04.429265 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f74e7cb3e5f54dfdb2280c795ce2ce53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.429847 6038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d29923f139445cc86379c80ac15df5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.429976 6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9c187ee1fa8438397c83bc2c2b16925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.431442 6773 leader_election.cc:290] T d70b7662d85a4f64a11420448c4d140d P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:04.431560 6457 raft_consensus.cc:359] T a1e8b8e638ec438a86f05fa147cdb27c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:04.431740 6457 raft_consensus.cc:385] T a1e8b8e638ec438a86f05fa147cdb27c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:04.432540 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70b7662d85a4f64a11420448c4d140d" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:04.433010 6457 raft_consensus.cc:740] T a1e8b8e638ec438a86f05fa147cdb27c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:04.433344 6457 consensus_queue.cc:260] T a1e8b8e638ec438a86f05fa147cdb27c P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:04.433602 5996 leader_election.cc:343] T d70b7662d85a4f64a11420448c4d140d P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:04.436614 6177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ac04be575704a69994f98e00411a254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.437743 6027 tablet_service.cc:1511] Processing CreateTablet for tablet c012b2a92dc14f2ab5d9f4fe8a6a7779 (DEFAULT_TABLE table=default.Table_036d9052e0264e978bf3e3698ca8c08b [id=b2fef7fe862a41e493f5e1646b41bd5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.442113 6319 tablet_service.cc:1511] Processing CreateTablet for tablet c012b2a92dc14f2ab5d9f4fe8a6a7779 (DEFAULT_TABLE table=default.Table_036d9052e0264e978bf3e3698ca8c08b [id=b2fef7fe862a41e493f5e1646b41bd5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.442533 6319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c012b2a92dc14f2ab5d9f4fe8a6a7779. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.442812 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c012b2a92dc14f2ab5d9f4fe8a6a7779. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.442674 6035 tablet_service.cc:1511] Processing CreateTablet for tablet b9c187ee1fa8438397c83bc2c2b16925 (DEFAULT_TABLE table=default.Table_76a4d42c4ee8417fa82124f036ec71de [id=220774101a2442309f08c3d6f8713956]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.444634 6039 tablet_service.cc:1511] Processing CreateTablet for tablet f7cf45d4c4d3480288698682c1c85869 (DEFAULT_TABLE table=default.Table_4cb745719e44465b8bdd1ed8a1e04b8e [id=e107798635ee473eb50362535f76985d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.446333 6457 ts_tablet_manager.cc:1434] T a1e8b8e638ec438a86f05fa147cdb27c P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.107s user 0.002s sys 0.000s
I20260923 19:50:04.447008 6576 leader_election.cc:290] T 0a5ce253bcce410b9517449f133d39e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:04.449105 6454 consensus_queue.cc:260] T 77f111a495f3429cb243417824095d02 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:04.449604 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5ce253bcce410b9517449f133d39e8" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:04.449693 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 179) took 2233 ms. Trace:
W20260923 19:50:04.452288 5996 leader_election.cc:343] T 0a5ce253bcce410b9517449f133d39e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:04.452780 6165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6238d16b1be74dd88fd2e089fbd85d33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.452896 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85b7dcf131c54187a6e61f8503c797f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.454110 6279 leader_election.cc:304] T b302820d329a41f0a9a54501c079fcd7 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:04.454562 6728 raft_consensus.cc:2804] T b302820d329a41f0a9a54501c079fcd7 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:04.461297 6457 tablet_bootstrap.cc:492] T 3190d18f00234d71b0a58c2c334ef45f P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:04.464072 6322 tablet_service.cc:1511] Processing CreateTablet for tablet d8c8bfa9b7424b9f80f76e0bb05cbc0c (DEFAULT_TABLE table=default.Table_f9942fca28234830913277dada229375 [id=662eb0a4f944445486929d42c5ebfd01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.464651 6322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c8bfa9b7424b9f80f76e0bb05cbc0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.466418 6456 ts_tablet_manager.cc:1403] T 7504a2be25b54ed4bc539eb10199fe15 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.441s user 0.003s sys 0.014s
I20260923 19:50:04.468844 6456 raft_consensus.cc:359] T 7504a2be25b54ed4bc539eb10199fe15 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:04.469195 6456 raft_consensus.cc:385] T 7504a2be25b54ed4bc539eb10199fe15 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:04.469398 6456 raft_consensus.cc:740] T 7504a2be25b54ed4bc539eb10199fe15 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:04.469991 6456 consensus_queue.cc:260] T 7504a2be25b54ed4bc539eb10199fe15 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:04.470325 6778 leader_election.cc:290] T 09bb2ab5617a49d99e75191b3b48b85f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:04.473994 6576 consensus_queue.cc:1048] T e1752d6b46894796bdc94e6230e3327d P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:04.487043 6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed9fb0cab0bd43b7a05d7376125b187e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.475437 6459 rpcz_store.cc:276] 0923 19:50:02.167824 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:02.169131 (+ 1307us) service_pool.cc:224] Handling call
0923 19:50:03.688772 (+1519641us) ts_tablet_manager.cc:1151] Deleting tablet 259e4faa58f549699538317019be5daf
0923 19:50:03.720699 (+ 31927us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:04.022688 (+301989us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:04.304141 (+281453us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:04.400993 (+ 96852us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1452916}
I20260923 19:50:04.486114 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f00490b0364f0e9f1b9569b870808e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.494019 6646 raft_consensus.cc:515] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:04.494068 6175 tablet_service.cc:1511] Processing CreateTablet for tablet 2948d729e1ec4dfca70789bcad513e52 (DEFAULT_TABLE table=default.Table_0fabac277720489788ff4ee29635ba66 [id=ff040ccffd9c4e24be8e0eaafa134785]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.508922 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 259e4faa58f549699538317019be5daf (table default.Table_59963526245d437089bb2a1e5a276493 [id=15b32ad6fb42473abddb1188aa861441]) successfully deleted
I20260923 19:50:04.510510 6031 tablet_service.cc:1511] Processing CreateTablet for tablet d8c8bfa9b7424b9f80f76e0bb05cbc0c (DEFAULT_TABLE table=default.Table_f9942fca28234830913277dada229375 [id=662eb0a4f944445486929d42c5ebfd01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.510977 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7cf45d4c4d3480288698682c1c85869. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:04.511840 5995 consensus_peers.cc:597] T 8db0358af7634911820f99fe16605ca7 P e546f660e7e541d1aa9ae38e5ee5b9c0 -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:04.494400 6733 raft_consensus.cc:515] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:04.515935 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70b7662d85a4f64a11420448c4d140d" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:04.517864 6646 leader_election.cc:290] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:04.521668 6137 leader_election.cc:343] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 4bf129dd52b84a4ea461ec454bc34fe8
W20260923 19:50:04.521927 5995 leader_election.cc:343] T d70b7662d85a4f64a11420448c4d140d P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:04.522051 5995 leader_election.cc:304] T d70b7662d85a4f64a11420448c4d140d P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:04.523132 6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ac04be575704a69994f98e00411a254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.523694 6174 tablet_service.cc:1511] Processing CreateTablet for tablet ed9fb0cab0bd43b7a05d7376125b187e (DEFAULT_TABLE table=default.Table_b980dd990237405ea45e67525bb34249 [id=445fa6e608d540d89758327dab79ca7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.524406 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5ce253bcce410b9517449f133d39e8" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:04.524811 6576 raft_consensus.cc:2749] T d70b7662d85a4f64a11420448c4d140d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:04.524959 6175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2948d729e1ec4dfca70789bcad513e52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.526216 6030 tablet_service.cc:1511] Processing CreateTablet for tablet c7369a5fc87f4b70bcfbe052ef021771 (DEFAULT_TABLE table=default.Table_295f07d1ca7345d5a18a80da04089ca2 [id=26fc3d5dd42441098cdd17a5d73d219d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:04.522877 6179 consensus_meta.cc:287] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent flushing consensus metadata: real 0.525s user 0.004s sys 0.005s
I20260923 19:50:04.542649 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e711e48156b46b5a517b330d6d41309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.543835 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 194) took 2200 ms. Trace:
I20260923 19:50:04.543979 6459 rpcz_store.cc:276] 0923 19:50:02.326373 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:02.326421 (+ 48us) service_pool.cc:224] Handling call
0923 19:50:04.525176 (+2198755us) ts_tablet_manager.cc:1151] Deleting tablet 31b0bdf719554d37993a802831e324ee
0923 19:50:04.526842 (+ 1666us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:04.526946 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2168815}
W20260923 19:50:04.545055 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 31b0bdf719554d37993a802831e324ee because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31b0bdf719554d37993a802831e324ee already in progress: creating tablet
I20260923 19:50:04.545351 6459 tablet_replica.cc:333] T 0cdb778f87fa40b89dad97d166192a1e P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:04.545822 6733 leader_election.cc:290] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:04.547600 6137 leader_election.cc:343] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: c52da04e5fe0454ea76bf4d99a930fd7
W20260923 19:50:04.548612 5995 leader_election.cc:343] T 0a5ce253bcce410b9517449f133d39e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:04.550606 6459 raft_consensus.cc:2243] T 0cdb778f87fa40b89dad97d166192a1e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:04.551980 6024 tablet_service.cc:1511] Processing CreateTablet for tablet a926ff092e6e495e981be156421e8d72 (DEFAULT_TABLE table=default.Table_413519bded0c44f3b92a3710f13f69bb [id=8a617888464a4c8c85dbe8f93d6ef9fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.552333 6036 tablet_service.cc:1511] Processing CreateTablet for tablet a01a86b6fd4b44d3808c2040525d7b61 (DEFAULT_TABLE table=default.Table_d2249132d73a45758b64da97b668320e [id=bf20ac3f66704af69ceb4531253cbd15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.553673 6459 raft_consensus.cc:2272] T 0cdb778f87fa40b89dad97d166192a1e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:04.554365 6459 ts_tablet_manager.cc:1916] T 0cdb778f87fa40b89dad97d166192a1e P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:04.556707 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6d3601a392f4723b4ca00f6e12b950c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.558936 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9c187ee1fa8438397c83bc2c2b16925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.568461 6172 tablet_service.cc:1511] Processing CreateTablet for tablet 85b7dcf131c54187a6e61f8503c797f8 (DEFAULT_TABLE table=default.Table_23c500b65dba4b6790b4349e5a5b0a07 [id=647997210f5349a68aa98d24e12a33cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.568707 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed9fb0cab0bd43b7a05d7376125b187e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.568660 6040 tablet_service.cc:1511] Processing CreateTablet for tablet dbe06eba8067413a903e4a07c2768484 (DEFAULT_TABLE table=default.Table_85f67787052f46c2b29555acf4abc05c [id=98fdaeb42b5a426f8d96225de816958d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.570444 6024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a926ff092e6e495e981be156421e8d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.576284 6182 tablet_service.cc:1511] Processing CreateTablet for tablet ad29d22a82434023991ffcacf7f9bee5 (DEFAULT_TABLE table=default.Table_6fc559685e30469ea0537af2f4cf6e1c [id=ea52a2330cd643e486e5b348dabbd295]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.578682 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7ba284e81bc4388bbd6456a41d1f9f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.584271 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7369a5fc87f4b70bcfbe052ef021771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.586005 5995 leader_election.cc:304] T 0a5ce253bcce410b9517449f133d39e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:04.472180 6456 ts_tablet_manager.cc:1434] T 7504a2be25b54ed4bc539eb10199fe15 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260923 19:50:04.508507 6309 tablet_service.cc:1511] Processing CreateTablet for tablet dbe06eba8067413a903e4a07c2768484 (DEFAULT_TABLE table=default.Table_85f67787052f46c2b29555acf4abc05c [id=98fdaeb42b5a426f8d96225de816958d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.519497 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf129dd52b84a4ea461ec454bc34fe8" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:04.596942 6344 raft_consensus.cc:3060] T 4bf129dd52b84a4ea461ec454bc34fe8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:04.600034 6344 raft_consensus.cc:2468] T 4bf129dd52b84a4ea461ec454bc34fe8 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:04.526057 6306 tablet_service.cc:1511] Processing CreateTablet for tablet 6d29923f139445cc86379c80ac15df5d (DEFAULT_TABLE table=default.Table_0bf993fb53a243408934c3ce7812f300 [id=1dc5c4b9cfe242b099053cbb53aac5ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.527225 6319 tablet_service.cc:1511] Processing CreateTablet for tablet 658253ff3d014361803e1aeda978e59a (DEFAULT_TABLE table=default.Table_493eae9e089b423ca42a863b541f4ec4 [id=374e9291e4564d47a5a9bab50f013952]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.538926 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 1b1d9413e1e24547b491a160d851377b (DEFAULT_TABLE table=default.Table_a4bed55e26e74a499d9971feb59ba8bf [id=361a67b795ad41bb829dffbf0cc7dcc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.601574 6179 tablet_service.cc:1511] Processing CreateTablet for tablet b18548ba557f448880c5e617fc03cbe0 (DEFAULT_TABLE table=default.Table_b7610081818744a5b76680621ab7212d [id=8b14917d9dc6415dbb75917bccf09502]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.538957 6323 tablet_service.cc:1511] Processing CreateTablet for tablet f7cf45d4c4d3480288698682c1c85869 (DEFAULT_TABLE table=default.Table_4cb745719e44465b8bdd1ed8a1e04b8e [id=e107798635ee473eb50362535f76985d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.542392 6810 tablet.cc:1751] T a10110f4a2b34b61a4cc586d65981606 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:04.550348 6317 tablet_service.cc:1511] Processing CreateTablet for tablet 98f61ace3a984938ace1fedbaa1dafa3 (DEFAULT_TABLE table=default.Table_d937cfba979e408ebde3725792f5e4e2 [id=26caa02bc37e471abdf29bbbb3acba69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.603087 6172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85b7dcf131c54187a6e61f8503c797f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.559252 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 34d62ab3d4aa457f8fea283cd9248a41 (DEFAULT_TABLE table=default.Table_fc95f21fffc649e3953772b8c4ddbdfb [id=b4e8e3f2a48a4b5496f506080b415805]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.570333 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 7af330ae1aaa48209f2bd1880bcfebb1 (DEFAULT_TABLE table=default.Table_496c5379825d4fe8bb113e6a77b05390 [id=fda97d4d322f453296d283fffa052c35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.571406 6313 tablet_service.cc:1511] Processing CreateTablet for tablet c031d99a6f9844c29664236662e8d5f8 (DEFAULT_TABLE table=default.Table_2c882fb60c3a4a5685508054fe5fa20d [id=4f2f07c1e27c431299438af5105e9f2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.572320 6316 tablet_service.cc:1511] Processing CreateTablet for tablet b87872fb6cc0400c86eddffb29c898e8 (DEFAULT_TABLE table=default.Table_59a69335b281437498cea78a9cb3fadb [id=ac71e26491774bcd93d004a319b086c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.575251 6308 tablet_service.cc:1511] Processing CreateTablet for tablet 3d74560614b744188e759b981ad89a7d (DEFAULT_TABLE table=default.Table_ca447ba1a2d04e7ab8954432c4a42c97 [id=7a040306f6064b3d8d10bdb87ab32247]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.502789 6320 tablet_service.cc:1511] Processing CreateTablet for tablet 83dba06b0d0040889015fb052c642ec0 (DEFAULT_TABLE table=default.Table_cabd4e85a8824c7699003c51f4f0ead6 [id=33aab54b056646fe9324af773098823b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.503376 6312 tablet_service.cc:1511] Processing CreateTablet for tablet c7369a5fc87f4b70bcfbe052ef021771 (DEFAULT_TABLE table=default.Table_295f07d1ca7345d5a18a80da04089ca2 [id=26fc3d5dd42441098cdd17a5d73d219d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.504199 6314 tablet_service.cc:1511] Processing CreateTablet for tablet a926ff092e6e495e981be156421e8d72 (DEFAULT_TABLE table=default.Table_413519bded0c44f3b92a3710f13f69bb [id=8a617888464a4c8c85dbe8f93d6ef9fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.504834 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ac04be575704a69994f98e00411a254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.610131 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a926ff092e6e495e981be156421e8d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.611174 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 658253ff3d014361803e1aeda978e59a (DEFAULT_TABLE table=default.Table_493eae9e089b423ca42a863b541f4ec4 [id=374e9291e4564d47a5a9bab50f013952]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.612890 6456 tablet_bootstrap.cc:492] T f302f91c8ef44237b1c9909d88dacbff P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:04.614543 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d74560614b744188e759b981ad89a7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.615258 6456 tablet_bootstrap.cc:654] T f302f91c8ef44237b1c9909d88dacbff P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:04.505332 6324 tablet_service.cc:1511] Processing CreateTablet for tablet a01a86b6fd4b44d3808c2040525d7b61 (DEFAULT_TABLE table=default.Table_d2249132d73a45758b64da97b668320e [id=bf20ac3f66704af69ceb4531253cbd15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.618129 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a01a86b6fd4b44d3808c2040525d7b61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.622502 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 035abecfbee7474d9dd048f35e28e867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.623162 6319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 658253ff3d014361803e1aeda978e59a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:04.624378 6137 consensus_peers.cc:597] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a2fbac8080441d4a9e03ff1d580bc8e. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:04.624730 6576 raft_consensus.cc:2749] T 0a5ce253bcce410b9517449f133d39e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:04.626932 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7369a5fc87f4b70bcfbe052ef021771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.580523 6458 ts_tablet_manager.cc:1929] T 640a98d3a845461e8d4f07041ab515c7 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:04.630182 6458 log.cc:1199] T 640a98d3a845461e8d4f07041ab515c7 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/640a98d3a845461e8d4f07041ab515c7
W20260923 19:50:04.475111 6279 leader_election.cc:343] T 09bb2ab5617a49d99e75191b3b48b85f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 09bb2ab5617a49d99e75191b3b48b85f
W20260923 19:50:04.630693 6279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.193:39887, user_credentials={real_user=slave}} blocked reactor thread for 155561us
I20260923 19:50:04.630905 6458 ts_tablet_manager.cc:1950] T 640a98d3a845461e8d4f07041ab515c7 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:04.541023 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52da04e5fe0454ea76bf4d99a930fd7" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:04.631356 6341 raft_consensus.cc:3060] T c52da04e5fe0454ea76bf4d99a930fd7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:04.632339 6171 tablet_service.cc:1511] Processing CreateTablet for tablet f74e7cb3e5f54dfdb2280c795ce2ce53 (DEFAULT_TABLE table=default.Table_20badc86d4ef4e2fb377e8e109782afd [id=8325a8f159124a2da260e2be3ce69500]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.634063 6728 raft_consensus.cc:697] T b302820d329a41f0a9a54501c079fcd7 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
W20260923 19:50:04.634588 6280 leader_election.cc:343] T 09bb2ab5617a49d99e75191b3b48b85f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Not found: Tablet not found: 09bb2ab5617a49d99e75191b3b48b85f
I20260923 19:50:04.634517 6728 consensus_queue.cc:237] T b302820d329a41f0a9a54501c079fcd7 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:04.634831 6280 leader_election.cc:304] T 09bb2ab5617a49d99e75191b3b48b85f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:04.634968 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b18548ba557f448880c5e617fc03cbe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.635188 6457 tablet_bootstrap.cc:654] T 3190d18f00234d71b0a58c2c334ef45f P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:04.635215 6280 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 111382us
I20260923 19:50:04.635502 6814 raft_consensus.cc:2749] T 09bb2ab5617a49d99e75191b3b48b85f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:04.635798 6309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbe06eba8067413a903e4a07c2768484. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.636518 6023 tablet_service.cc:1511] Processing CreateTablet for tablet 83dba06b0d0040889015fb052c642ec0 (DEFAULT_TABLE table=default.Table_cabd4e85a8824c7699003c51f4f0ead6 [id=33aab54b056646fe9324af773098823b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:04.636940 5995 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 97902.1us
I20260923 19:50:04.637564 6173 tablet_service.cc:1511] Processing CreateTablet for tablet b9c187ee1fa8438397c83bc2c2b16925 (DEFAULT_TABLE table=default.Table_76a4d42c4ee8417fa82124f036ec71de [id=220774101a2442309f08c3d6f8713956]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.638078 6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c031d99a6f9844c29664236662e8d5f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.631363 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 73) took 4836 ms. Trace:
I20260923 19:50:04.638264 6458 rpcz_store.cc:276] 0923 19:49:59.795098 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:49:59.795155 (+ 57us) service_pool.cc:224] Handling call
0923 19:50:04.343154 (+4547999us) ts_tablet_manager.cc:1151] Deleting tablet 640a98d3a845461e8d4f07041ab515c7
0923 19:50:04.343165 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:04.501750 (+158585us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:04.580390 (+ 78640us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:04.631308 (+ 50918us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4547750}
I20260923 19:50:04.638876 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 640a98d3a845461e8d4f07041ab515c7 (table default.Table_655e0d86bc12407f9287ace4b3e76c29 [id=5bc43061f37b4defac5a530a1f174684]) successfully deleted
I20260923 19:50:04.639642 6458 tablet_replica.cc:333] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:04.641601 6454 ts_tablet_manager.cc:1434] T 77f111a495f3429cb243417824095d02 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.257s user 0.001s sys 0.013s
I20260923 19:50:04.642347 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7af330ae1aaa48209f2bd1880bcfebb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.646144 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34d62ab3d4aa457f8fea283cd9248a41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.646694 6454 tablet_bootstrap.cc:492] T 8db0358af7634911820f99fe16605ca7 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:04.650079 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98f61ace3a984938ace1fedbaa1dafa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.650024 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 98f61ace3a984938ace1fedbaa1dafa3 (DEFAULT_TABLE table=default.Table_d937cfba979e408ebde3725792f5e4e2 [id=26caa02bc37e471abdf29bbbb3acba69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.650803 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c8bfa9b7424b9f80f76e0bb05cbc0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.651674 6182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad29d22a82434023991ffcacf7f9bee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.654033 6306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d29923f139445cc86379c80ac15df5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.654947 6033 tablet_service.cc:1511] Processing CreateTablet for tablet 34d62ab3d4aa457f8fea283cd9248a41 (DEFAULT_TABLE table=default.Table_fc95f21fffc649e3953772b8c4ddbdfb [id=b4e8e3f2a48a4b5496f506080b415805]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.658222 6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b87872fb6cc0400c86eddffb29c898e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.660487 6320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83dba06b0d0040889015fb052c642ec0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.660972 6036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a01a86b6fd4b44d3808c2040525d7b61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.664572 6023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83dba06b0d0040889015fb052c642ec0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.664719 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7cf45d4c4d3480288698682c1c85869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.666060 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b18548ba557f448880c5e617fc03cbe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.669168 6040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbe06eba8067413a903e4a07c2768484. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.671804 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b1d9413e1e24547b491a160d851377b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.674495 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98f61ace3a984938ace1fedbaa1dafa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.682126 6171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f74e7cb3e5f54dfdb2280c795ce2ce53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.700419 6341 raft_consensus.cc:2468] T c52da04e5fe0454ea76bf4d99a930fd7 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:04.706568 6170 tablet_service.cc:1511] Processing CreateTablet for tablet 6d29923f139445cc86379c80ac15df5d (DEFAULT_TABLE table=default.Table_0bf993fb53a243408934c3ce7812f300 [id=1dc5c4b9cfe242b099053cbb53aac5ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.711139 6139 leader_election.cc:304] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:04.711597 6813 raft_consensus.cc:2804] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:04.711694 6139 leader_election.cc:304] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:04.711822 6813 raft_consensus.cc:697] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:04.712236 6646 raft_consensus.cc:2804] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:04.712359 6646 raft_consensus.cc:697] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:04.712284 6813 consensus_queue.cc:237] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:04.712657 6646 consensus_queue.cc:237] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:04.715221 6183 tablet_service.cc:1511] Processing CreateTablet for tablet c012b2a92dc14f2ab5d9f4fe8a6a7779 (DEFAULT_TABLE table=default.Table_036d9052e0264e978bf3e3698ca8c08b [id=b2fef7fe862a41e493f5e1646b41bd5f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:04.719147 6139 consensus_peers.cc:597] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Couldn't send request to peer 2bf41435f70447f19992d368ca6b46bd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a2fbac8080441d4a9e03ff1d580bc8e. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:04.720366 6176 tablet_service.cc:1511] Processing CreateTablet for tablet f7cf45d4c4d3480288698682c1c85869 (DEFAULT_TABLE table=default.Table_4cb745719e44465b8bdd1ed8a1e04b8e [id=e107798635ee473eb50362535f76985d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.722642 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6d3601a392f4723b4ca00f6e12b950c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.738400 5802 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_0b41cc085cff4695b3729e5b2ec8bbbb" } new_table_name: "default.Table_5812b40db6ab4814a5c5b3c869967f58" modify_external_catalogs: true
I20260923 19:50:04.739652 6814 raft_consensus.cc:493] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:04.739848 6814 raft_consensus.cc:515] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:04.740613 6814 leader_election.cc:290] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:04.742146 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc3b6d245c3e40cdabb20d7dcf07ec0e" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:04.742770 6280 leader_election.cc:343] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:04.758972 6458 raft_consensus.cc:2243] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:04.759248 6458 raft_consensus.cc:2272] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:04.760738 6458 ts_tablet_manager.cc:1916] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:04.770761 6027 tablet_service.cc:1511] Processing CreateTablet for tablet b87872fb6cc0400c86eddffb29c898e8 (DEFAULT_TABLE table=default.Table_59a69335b281437498cea78a9cb3fadb [id=ac71e26491774bcd93d004a319b086c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.772171 6022 tablet_service.cc:1511] Processing CreateTablet for tablet 1b1d9413e1e24547b491a160d851377b (DEFAULT_TABLE table=default.Table_a4bed55e26e74a499d9971feb59ba8bf [id=361a67b795ad41bb829dffbf0cc7dcc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.773450 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 7af330ae1aaa48209f2bd1880bcfebb1 (DEFAULT_TABLE table=default.Table_496c5379825d4fe8bb113e6a77b05390 [id=fda97d4d322f453296d283fffa052c35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.804775 6033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34d62ab3d4aa457f8fea283cd9248a41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.807602 6166 tablet_service.cc:1511] Processing CreateTablet for tablet 83dba06b0d0040889015fb052c642ec0 (DEFAULT_TABLE table=default.Table_cabd4e85a8824c7699003c51f4f0ead6 [id=33aab54b056646fe9324af773098823b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:04.814126 5791 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 6d29923f139445cc86379c80ac15df5d (table default.Table_0bf993fb53a243408934c3ce7812f300 [id=1dc5c4b9cfe242b099053cbb53aac5ce], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 6d29923f139445cc86379c80ac15df5d consensus state has no leader
W20260923 19:50:04.827644 6279 leader_election.cc:343] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: cc3b6d245c3e40cdabb20d7dcf07ec0e
I20260923 19:50:04.827847 6279 leader_election.cc:304] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:04.828351 6814 raft_consensus.cc:2749] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:04.828797 6821 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 83e97b26500048d0b75350a21a8ff96b)
I20260923 19:50:04.829469 6821 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } }
I20260923 19:50:04.831029 5814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" candidate_term: 4 candidate_status { last_received { term: 3 index: 418 } } ignore_live_leader: false dest_uuid: "83e97b26500048d0b75350a21a8ff96b" is_pre_election: true
I20260923 19:50:04.838387 6461 ts_tablet_manager.cc:1929] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260923 19:50:04.838635 6461 log.cc:1199] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/2f78261842744af08d86da64d37d708c
I20260923 19:50:04.839237 6461 ts_tablet_manager.cc:1950] T 2f78261842744af08d86da64d37d708c P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:04.839660 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 229) took 1475 ms. Trace:
I20260923 19:50:04.839886 6461 rpcz_store.cc:276] 0923 19:50:03.363880 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.380507 (+ 16627us) service_pool.cc:224] Handling call
0923 19:50:04.026229 (+645722us) ts_tablet_manager.cc:1151] Deleting tablet 2f78261842744af08d86da64d37d708c
0923 19:50:04.026241 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:04.490777 (+464536us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:04.767907 (+277130us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:04.839621 (+ 71714us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":641707}
I20260923 19:50:04.840517 6461 tablet_replica.cc:333] T 033c2d772c8a44d2a0e671664bb9085d P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:04.840865 6461 raft_consensus.cc:2243] T 033c2d772c8a44d2a0e671664bb9085d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:04.843660 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 2f78261842744af08d86da64d37d708c (table default.Table_a5d9d7b0e0b449ae8791e459b7d88f18 [id=7e9508e469b14579a0c697ac4ca5cc4a]) successfully deleted
I20260923 19:50:04.844110 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b1d9413e1e24547b491a160d851377b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.848924 6032 tablet_service.cc:1511] Processing CreateTablet for tablet 3d74560614b744188e759b981ad89a7d (DEFAULT_TABLE table=default.Table_ca447ba1a2d04e7ab8954432c4a42c97 [id=7a040306f6064b3d8d10bdb87ab32247]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.844341 6038 tablet_service.cc:1511] Processing CreateTablet for tablet c031d99a6f9844c29664236662e8d5f8 (DEFAULT_TABLE table=default.Table_2c882fb60c3a4a5685508054fe5fa20d [id=4f2f07c1e27c431299438af5105e9f2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.859019 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7af330ae1aaa48209f2bd1880bcfebb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.866855 6821 leader_election.cc:290] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83e97b26500048d0b75350a21a8ff96b (127.5.143.253:45285), 009ffee03a4d41db84df9f450aa84562 (127.5.143.252:45543)
I20260923 19:50:04.877825 6181 tablet_service.cc:1511] Processing CreateTablet for tablet d8c8bfa9b7424b9f80f76e0bb05cbc0c (DEFAULT_TABLE table=default.Table_f9942fca28234830913277dada229375 [id=662eb0a4f944445486929d42c5ebfd01]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:04.880626 5803 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 337f32eb47954689a6eb8f74408e01d9 consensus state has no leader
I20260923 19:50:04.883553 6456 tablet_bootstrap.cc:492] T f302f91c8ef44237b1c9909d88dacbff P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:04.883877 6456 ts_tablet_manager.cc:1403] T f302f91c8ef44237b1c9909d88dacbff P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.287s user 0.000s sys 0.005s
I20260923 19:50:04.885315 6456 raft_consensus.cc:359] T f302f91c8ef44237b1c9909d88dacbff P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:04.885694 6456 raft_consensus.cc:385] T f302f91c8ef44237b1c9909d88dacbff P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:04.887498 5803 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet a10110f4a2b34b61a4cc586d65981606 (table default.Table_ccd00f21243a43deb385f4673958f88c [id=019ceccbcb1041cc9e5625274c45a0f3]). Expected version 2 got 0
I20260923 19:50:04.888967 6461 raft_consensus.cc:2272] T 033c2d772c8a44d2a0e671664bb9085d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:04.890623 6755 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.651s user 0.003s sys 0.010s
W20260923 19:50:04.890731 6755 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.688s user 0.003s sys 0.010s
I20260923 19:50:04.895275 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d74560614b744188e759b981ad89a7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.901648 6165 tablet_service.cc:1511] Processing CreateTablet for tablet c7369a5fc87f4b70bcfbe052ef021771 (DEFAULT_TABLE table=default.Table_295f07d1ca7345d5a18a80da04089ca2 [id=26fc3d5dd42441098cdd17a5d73d219d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.904942 6175 tablet_service.cc:1511] Processing CreateTablet for tablet a926ff092e6e495e981be156421e8d72 (DEFAULT_TABLE table=default.Table_413519bded0c44f3b92a3710f13f69bb [id=8a617888464a4c8c85dbe8f93d6ef9fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.905400 6172 tablet_service.cc:1511] Processing CreateTablet for tablet a01a86b6fd4b44d3808c2040525d7b61 (DEFAULT_TABLE table=default.Table_d2249132d73a45758b64da97b668320e [id=bf20ac3f66704af69ceb4531253cbd15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.906006 6170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d29923f139445cc86379c80ac15df5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.907819 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83dba06b0d0040889015fb052c642ec0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.908020 6172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a01a86b6fd4b44d3808c2040525d7b61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.908586 6164 tablet_service.cc:1511] Processing CreateTablet for tablet 1b1d9413e1e24547b491a160d851377b (DEFAULT_TABLE table=default.Table_a4bed55e26e74a499d9971feb59ba8bf [id=361a67b795ad41bb829dffbf0cc7dcc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.913780 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 658253ff3d014361803e1aeda978e59a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.915980 6174 tablet_service.cc:1511] Processing CreateTablet for tablet dbe06eba8067413a903e4a07c2768484 (DEFAULT_TABLE table=default.Table_85f67787052f46c2b29555acf4abc05c [id=98fdaeb42b5a426f8d96225de816958d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.905910 6168 tablet_service.cc:1511] Processing CreateTablet for tablet 658253ff3d014361803e1aeda978e59a (DEFAULT_TABLE table=default.Table_493eae9e089b423ca42a863b541f4ec4 [id=374e9291e4564d47a5a9bab50f013952]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.920379 6177 tablet_service.cc:1511] Processing CreateTablet for tablet 98f61ace3a984938ace1fedbaa1dafa3 (DEFAULT_TABLE table=default.Table_d937cfba979e408ebde3725792f5e4e2 [id=26caa02bc37e471abdf29bbbb3acba69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.921353 6175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a926ff092e6e495e981be156421e8d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.938665 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 7af330ae1aaa48209f2bd1880bcfebb1 (DEFAULT_TABLE table=default.Table_496c5379825d4fe8bb113e6a77b05390 [id=fda97d4d322f453296d283fffa052c35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.889765 6458 ts_tablet_manager.cc:1929] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:04.885859 6456 raft_consensus.cc:740] T f302f91c8ef44237b1c9909d88dacbff P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:04.939350 6458 log.cc:1199] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/87afbdb11c6e4e58affd2f2d7995e1f8
I20260923 19:50:04.939651 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9c187ee1fa8438397c83bc2c2b16925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.939582 6456 consensus_queue.cc:260] T f302f91c8ef44237b1c9909d88dacbff P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:04.939823 6458 ts_tablet_manager.cc:1950] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:04.940714 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 74) took 5145 ms. Trace:
I20260923 19:50:04.940831 6458 rpcz_store.cc:276] 0923 19:49:59.795263 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:49:59.796034 (+ 771us) service_pool.cc:224] Handling call
0923 19:50:04.639480 (+4843446us) ts_tablet_manager.cc:1151] Deleting tablet 87afbdb11c6e4e58affd2f2d7995e1f8
0923 19:50:04.639499 (+ 19us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:04.806244 (+166745us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:04.889461 (+ 83217us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:04.940634 (+ 51173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":118893,"tablet-delete.queue_time_us":4843171}
I20260923 19:50:04.941282 6458 tablet_replica.cc:333] T 09bb2ab5617a49d99e75191b3b48b85f P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:04.941500 6458 raft_consensus.cc:2243] T 09bb2ab5617a49d99e75191b3b48b85f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:04.941710 6458 raft_consensus.cc:2272] T 09bb2ab5617a49d99e75191b3b48b85f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:04.942366 6458 ts_tablet_manager.cc:1916] T 09bb2ab5617a49d99e75191b3b48b85f P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:04.938269 5790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.143.254:37151, user_credentials={real_user=slave}} blocked reactor thread for 82547.1us
I20260923 19:50:04.949558 6728 raft_consensus.cc:493] T 7504a2be25b54ed4bc539eb10199fe15 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:04.949766 6728 raft_consensus.cc:515] T 7504a2be25b54ed4bc539eb10199fe15 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:04.951026 6728 leader_election.cc:290] T 7504a2be25b54ed4bc539eb10199fe15 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:04.951359 6458 ts_tablet_manager.cc:1929] T 09bb2ab5617a49d99e75191b3b48b85f P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:04.951475 6458 log.cc:1199] T 09bb2ab5617a49d99e75191b3b48b85f P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/09bb2ab5617a49d99e75191b3b48b85f
I20260923 19:50:04.951880 6458 ts_tablet_manager.cc:1950] T 09bb2ab5617a49d99e75191b3b48b85f P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:04.952714 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 75) took 5155 ms. Trace:
I20260923 19:50:04.952818 6458 rpcz_store.cc:276] 0923 19:49:59.797093 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:49:59.798016 (+ 923us) service_pool.cc:224] Handling call
0923 19:50:04.941183 (+5143167us) ts_tablet_manager.cc:1151] Deleting tablet 09bb2ab5617a49d99e75191b3b48b85f
0923 19:50:04.941195 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:04.947200 (+ 6005us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:04.951265 (+ 4065us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:04.952677 (+ 1412us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5142953}
I20260923 19:50:04.953158 6458 tablet_replica.cc:333] T 4bf129dd52b84a4ea461ec454bc34fe8 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:04.953361 6458 raft_consensus.cc:2243] T 4bf129dd52b84a4ea461ec454bc34fe8 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:04.953508 6458 raft_consensus.cc:2272] T 4bf129dd52b84a4ea461ec454bc34fe8 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:04.954114 6458 ts_tablet_manager.cc:1916] T 4bf129dd52b84a4ea461ec454bc34fe8 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:04.938154 6167 tablet_service.cc:1511] Processing CreateTablet for tablet c031d99a6f9844c29664236662e8d5f8 (DEFAULT_TABLE table=default.Table_2c882fb60c3a4a5685508054fe5fa20d [id=4f2f07c1e27c431299438af5105e9f2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.955453 6457 tablet_bootstrap.cc:492] T 3190d18f00234d71b0a58c2c334ef45f P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:04.959193 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7504a2be25b54ed4bc539eb10199fe15" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:04.960244 6280 leader_election.cc:343] T 7504a2be25b54ed4bc539eb10199fe15 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:04.965677 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 658253ff3d014361803e1aeda978e59a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.965548 6680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" candidate_term: 4 candidate_status { last_received { term: 3 index: 418 } } ignore_live_leader: false dest_uuid: "009ffee03a4d41db84df9f450aa84562" is_pre_election: true
W20260923 19:50:04.968375 5995 consensus_peers.cc:597] T e1752d6b46894796bdc94e6230e3327d P e546f660e7e541d1aa9ae38e5ee5b9c0 -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:04.969082 5720 leader_election.cc:304] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3d628214a34b4fa3ca0c1abe422bae; no voters: 009ffee03a4d41db84df9f450aa84562, 83e97b26500048d0b75350a21a8ff96b
I20260923 19:50:04.969580 6821 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260923 19:50:04.970984 6038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c031d99a6f9844c29664236662e8d5f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:04.977962 6182 tablet_service.cc:1511] Processing CreateTablet for tablet b87872fb6cc0400c86eddffb29c898e8 (DEFAULT_TABLE table=default.Table_59a69335b281437498cea78a9cb3fadb [id=ac71e26491774bcd93d004a319b086c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.979566 6459 ts_tablet_manager.cc:1929] T 0cdb778f87fa40b89dad97d166192a1e P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:04.979748 6459 log.cc:1199] T 0cdb778f87fa40b89dad97d166192a1e P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/0cdb778f87fa40b89dad97d166192a1e
I20260923 19:50:04.980206 6459 ts_tablet_manager.cc:1950] T 0cdb778f87fa40b89dad97d166192a1e P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:04.980571 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 202) took 2438 ms. Trace:
I20260923 19:50:04.980713 6459 rpcz_store.cc:276] 0923 19:50:02.542292 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:02.542336 (+ 44us) service_pool.cc:224] Handling call
0923 19:50:04.544345 (+2002009us) ts_tablet_manager.cc:1151] Deleting tablet 0cdb778f87fa40b89dad97d166192a1e
0923 19:50:04.544360 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:04.700823 (+156463us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:04.965929 (+265106us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:04.980524 (+ 14595us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2001777}
I20260923 19:50:04.981328 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 201) took 2439 ms. Trace:
I20260923 19:50:04.981441 6459 rpcz_store.cc:276] 0923 19:50:02.542203 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:02.554233 (+ 12030us) service_pool.cc:224] Handling call
0923 19:50:04.981135 (+2426902us) ts_tablet_manager.cc:1151] Deleting tablet daafbafae5004b8499e7ea93342c0517
0923 19:50:04.981148 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:04.981274 (+ 126us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2426627}
I20260923 19:50:04.981542 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 0cdb778f87fa40b89dad97d166192a1e (table default.Table_8b11b0f74b55400080d37799143edfac [id=e16f8e50cfeb444eae29278b7a4b65df]) successfully deleted
W20260923 19:50:04.981990 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet daafbafae5004b8499e7ea93342c0517 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet daafbafae5004b8499e7ea93342c0517 already in progress: creating tablet
I20260923 19:50:04.981840 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 204) took 2353 ms. Trace:
I20260923 19:50:04.968897 6169 tablet_service.cc:1511] Processing CreateTablet for tablet 34d62ab3d4aa457f8fea283cd9248a41 (DEFAULT_TABLE table=default.Table_fc95f21fffc649e3953772b8c4ddbdfb [id=b4e8e3f2a48a4b5496f506080b415805]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:04.986981 6177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98f61ace3a984938ace1fedbaa1dafa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.001282 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c8bfa9b7424b9f80f76e0bb05cbc0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.002764 6461 ts_tablet_manager.cc:1916] T 033c2d772c8a44d2a0e671664bb9085d P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:05.004940 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b1d9413e1e24547b491a160d851377b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.005399 6176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7cf45d4c4d3480288698682c1c85869. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:05.006721 5995 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 45588.3us
I20260923 19:50:05.009256 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b87872fb6cc0400c86eddffb29c898e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.009864 6459 rpcz_store.cc:276] 0923 19:50:02.628403 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:02.628594 (+ 191us) service_pool.cc:224] Handling call
0923 19:50:04.981703 (+2353109us) ts_tablet_manager.cc:1151] Deleting tablet 2f627b7b9ff74750bd8dd59840bf77db
0923 19:50:04.981711 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:04.981799 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2352851}
I20260923 19:50:05.011396 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 206) took 2376 ms. Trace:
I20260923 19:50:05.012670 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbe06eba8067413a903e4a07c2768484. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.014922 6180 tablet_service.cc:1511] Processing CreateTablet for tablet 3d74560614b744188e759b981ad89a7d (DEFAULT_TABLE table=default.Table_ca447ba1a2d04e7ab8954432c4a42c97 [id=7a040306f6064b3d8d10bdb87ab32247]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.017905 6182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b87872fb6cc0400c86eddffb29c898e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.020309 6456 ts_tablet_manager.cc:1434] T f302f91c8ef44237b1c9909d88dacbff P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.136s user 0.000s sys 0.003s
I20260923 19:50:05.021368 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7af330ae1aaa48209f2bd1880bcfebb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.024483 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c012b2a92dc14f2ab5d9f4fe8a6a7779. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.026024 6456 tablet_bootstrap.cc:492] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:05.027469 6165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7369a5fc87f4b70bcfbe052ef021771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.024042 6459 rpcz_store.cc:276] 0923 19:50:02.634881 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:02.634939 (+ 58us) service_pool.cc:224] Handling call
0923 19:50:05.011125 (+2376186us) ts_tablet_manager.cc:1151] Deleting tablet c48d4a8371fa4454b7c67291db3ab796
0923 19:50:05.011141 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.011334 (+ 193us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2375926}
I20260923 19:50:05.030349 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c031d99a6f9844c29664236662e8d5f8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:05.030297 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet c48d4a8371fa4454b7c67291db3ab796 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c48d4a8371fa4454b7c67291db3ab796 already in progress: creating tablet
I20260923 19:50:05.034399 6457 ts_tablet_manager.cc:1403] T 3190d18f00234d71b0a58c2c334ef45f P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.509s user 0.007s sys 0.007s
I20260923 19:50:05.036863 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34d62ab3d4aa457f8fea283cd9248a41. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:05.039072 6279 leader_election.cc:343] T 7504a2be25b54ed4bc539eb10199fe15 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 7504a2be25b54ed4bc539eb10199fe15
I20260923 19:50:05.039268 6279 leader_election.cc:304] T 7504a2be25b54ed4bc539eb10199fe15 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:05.039744 6728 raft_consensus.cc:2749] T 7504a2be25b54ed4bc539eb10199fe15 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:05.063436 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 205) took 2423 ms. Trace:
I20260923 19:50:05.072429 6457 raft_consensus.cc:359] T 3190d18f00234d71b0a58c2c334ef45f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.074049 6459 rpcz_store.cc:276] 0923 19:50:02.628521 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:02.638491 (+ 9970us) service_pool.cc:224] Handling call
0923 19:50:05.031534 (+2393043us) ts_tablet_manager.cc:1151] Deleting tablet cd02244c52ad4d2ab3915108a92a6f97
0923 19:50:05.031548 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.051863 (+ 20315us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2392662}
I20260923 19:50:05.074491 6459 tablet_replica.cc:333] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
W20260923 19:50:05.075314 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet cd02244c52ad4d2ab3915108a92a6f97 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd02244c52ad4d2ab3915108a92a6f97 already in progress: creating tablet
I20260923 19:50:05.075649 6459 raft_consensus.cc:2243] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:05.075883 6459 raft_consensus.cc:2272] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:05.076515 6457 raft_consensus.cc:385] T 3190d18f00234d71b0a58c2c334ef45f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:05.076674 6457 raft_consensus.cc:740] T 3190d18f00234d71b0a58c2c334ef45f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:05.077564 6457 consensus_queue.cc:260] T 3190d18f00234d71b0a58c2c334ef45f P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.088634 6454 tablet_bootstrap.cc:654] T 8db0358af7634911820f99fe16605ca7 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:05.090245 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d74560614b744188e759b981ad89a7d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:05.102101 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 22e37d5afa8047989928596b4092c4b9 consensus state has no leader
W20260923 19:50:05.102155 5797 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b2762648045b4378bcc2c1234460c352 consensus state has no leader
I20260923 19:50:05.107743 6458 ts_tablet_manager.cc:1929] T 4bf129dd52b84a4ea461ec454bc34fe8 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:05.107956 6458 log.cc:1199] T 4bf129dd52b84a4ea461ec454bc34fe8 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/4bf129dd52b84a4ea461ec454bc34fe8
I20260923 19:50:05.114153 6459 ts_tablet_manager.cc:1916] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:05.120759 6681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49234 (request call id 0) took 1394 ms. Trace:
I20260923 19:50:05.108922 6458 ts_tablet_manager.cc:1950] T 4bf129dd52b84a4ea461ec454bc34fe8 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:05.122457 6820 raft_consensus.cc:493] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 83e97b26500048d0b75350a21a8ff96b)
I20260923 19:50:05.122704 6820 raft_consensus.cc:515] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } }
I20260923 19:50:05.123533 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 76) took 5323 ms. Trace:
I20260923 19:50:05.123633 6458 rpcz_store.cc:276] 0923 19:49:59.800250 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:49:59.800303 (+ 53us) service_pool.cc:224] Handling call
0923 19:50:04.953085 (+5152782us) ts_tablet_manager.cc:1151] Deleting tablet 4bf129dd52b84a4ea461ec454bc34fe8
0923 19:50:04.953096 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:04.970672 (+ 17576us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.107621 (+136949us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.123457 (+ 15836us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5152582}
I20260923 19:50:05.124181 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 98) took 4979 ms. Trace:
I20260923 19:50:05.124267 6458 rpcz_store.cc:276] 0923 19:50:00.144522 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:00.144788 (+ 266us) service_pool.cc:224] Handling call
0923 19:50:05.123965 (+4979177us) ts_tablet_manager.cc:1151] Deleting tablet 5455beff354a4616a68d8746e3e4f9a8
0923 19:50:05.123977 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.124129 (+ 152us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4949643}
I20260923 19:50:05.124341 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 4bf129dd52b84a4ea461ec454bc34fe8 (table default.Table_75d1617a325e4c6591795f8378cfa93d [id=5e08f31834ac4ba188ce1b23889287a4]) successfully deleted
I20260923 19:50:05.124629 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 100) took 4949 ms. Trace:
W20260923 19:50:05.124788 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 5455beff354a4616a68d8746e3e4f9a8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5455beff354a4616a68d8746e3e4f9a8 already in progress: creating tablet
I20260923 19:50:05.124752 6458 rpcz_store.cc:276] 0923 19:50:00.175306 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:00.175485 (+ 179us) service_pool.cc:224] Handling call
0923 19:50:05.124479 (+4948994us) ts_tablet_manager.cc:1151] Deleting tablet d70b7662d85a4f64a11420448c4d140d
0923 19:50:05.124487 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.124568 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4943849}
I20260923 19:50:05.125053 6458 tablet_replica.cc:333] T e1752d6b46894796bdc94e6230e3327d P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
W20260923 19:50:05.125151 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet d70b7662d85a4f64a11420448c4d140d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d70b7662d85a4f64a11420448c4d140d already in progress: creating tablet
I20260923 19:50:05.125245 6458 raft_consensus.cc:2243] T e1752d6b46894796bdc94e6230e3327d P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:05.110517 6456 tablet_bootstrap.cc:654] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:05.125754 6820 leader_election.cc:290] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b3d628214a34b4fa3ca0c1abe422bae (127.5.143.254:37151), 83e97b26500048d0b75350a21a8ff96b (127.5.143.253:45285)
I20260923 19:50:05.126734 6791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83e97b26500048d0b75350a21a8ff96b. Latest consensus state: current_term: 3 leader_uuid: "83e97b26500048d0b75350a21a8ff96b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } } }
I20260923 19:50:05.127056 6791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:50:05.145828 6456 tablet_bootstrap.cc:492] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:05.147316 6456 ts_tablet_manager.cc:1403] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.122s user 0.000s sys 0.006s
I20260923 19:50:05.150661 6458 raft_consensus.cc:2272] T e1752d6b46894796bdc94e6230e3327d P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:05.150889 6728 raft_consensus.cc:493] T f302f91c8ef44237b1c9909d88dacbff P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:05.152480 6728 raft_consensus.cc:515] T f302f91c8ef44237b1c9909d88dacbff P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.153167 6728 leader_election.cc:290] T f302f91c8ef44237b1c9909d88dacbff P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:05.154187 6458 ts_tablet_manager.cc:1916] T e1752d6b46894796bdc94e6230e3327d P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:05.155905 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f302f91c8ef44237b1c9909d88dacbff" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:05.156715 6280 leader_election.cc:343] T f302f91c8ef44237b1c9909d88dacbff P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:05.151664 6456 raft_consensus.cc:359] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.157270 6456 raft_consensus.cc:385] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:05.157411 6456 raft_consensus.cc:740] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:05.157706 6456 consensus_queue.cc:260] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.166085 6456 ts_tablet_manager.cc:1434] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.018s user 0.000s sys 0.002s
I20260923 19:50:05.193619 6457 ts_tablet_manager.cc:1434] T 3190d18f00234d71b0a58c2c334ef45f P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.095s user 0.003s sys 0.000s
I20260923 19:50:05.181188 6456 tablet_bootstrap.cc:492] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:05.183075 6458 ts_tablet_manager.cc:1929] T e1752d6b46894796bdc94e6230e3327d P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:05.198066 6458 log.cc:1199] T e1752d6b46894796bdc94e6230e3327d P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/e1752d6b46894796bdc94e6230e3327d
I20260923 19:50:05.198594 6458 ts_tablet_manager.cc:1950] T e1752d6b46894796bdc94e6230e3327d P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:05.199715 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 99) took 5043 ms. Trace:
I20260923 19:50:05.199864 6458 rpcz_store.cc:276] 0923 19:50:00.155755 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:00.155885 (+ 130us) service_pool.cc:224] Handling call
0923 19:50:05.124966 (+4969081us) ts_tablet_manager.cc:1151] Deleting tablet e1752d6b46894796bdc94e6230e3327d
0923 19:50:05.124973 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.171264 (+ 46291us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.182951 (+ 11687us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.199648 (+ 16697us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4941525}
I20260923 19:50:05.200336 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 105) took 4501 ms. Trace:
I20260923 19:50:05.200434 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet e1752d6b46894796bdc94e6230e3327d (table default.Table_7c9010170aac47fdbbc0aa6b197ecac3 [id=387269136a564b4f9bc782c785066dd8]) successfully deleted
I20260923 19:50:05.200451 6458 rpcz_store.cc:276] 0923 19:50:00.698712 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:00.698771 (+ 59us) service_pool.cc:224] Handling call
0923 19:50:05.200169 (+4501398us) ts_tablet_manager.cc:1151] Deleting tablet b7f372b952804ac58e602998d9b77d72
0923 19:50:05.200180 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.200296 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4494033}
I20260923 19:50:05.200752 6458 tablet_replica.cc:333] T 8db0358af7634911820f99fe16605ca7 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:05.201001 6458 raft_consensus.cc:2243] T 8db0358af7634911820f99fe16605ca7 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:05.201217 6458 raft_consensus.cc:2272] T 8db0358af7634911820f99fe16605ca7 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:05.201212 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet b7f372b952804ac58e602998d9b77d72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b7f372b952804ac58e602998d9b77d72 already in progress: creating tablet
I20260923 19:50:05.202673 6458 ts_tablet_manager.cc:1916] T 8db0358af7634911820f99fe16605ca7 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:05.210114 6456 tablet_bootstrap.cc:654] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:05.222985 6458 ts_tablet_manager.cc:1929] T 8db0358af7634911820f99fe16605ca7 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:05.223197 6458 log.cc:1199] T 8db0358af7634911820f99fe16605ca7 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/8db0358af7634911820f99fe16605ca7
I20260923 19:50:05.223587 6458 ts_tablet_manager.cc:1950] T 8db0358af7634911820f99fe16605ca7 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:05.224246 5814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "009ffee03a4d41db84df9f450aa84562" candidate_term: 4 candidate_status { last_received { term: 3 index: 378 } } ignore_live_leader: false dest_uuid: "83e97b26500048d0b75350a21a8ff96b" is_pre_election: true
I20260923 19:50:05.224414 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 106) took 4525 ms. Trace:
I20260923 19:50:05.224519 6458 rpcz_store.cc:276] 0923 19:50:00.698870 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:00.698911 (+ 41us) service_pool.cc:224] Handling call
0923 19:50:05.200684 (+4501773us) ts_tablet_manager.cc:1151] Deleting tablet 8db0358af7634911820f99fe16605ca7
0923 19:50:05.200692 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.206652 (+ 5960us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.222891 (+ 16239us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.224350 (+ 1459us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4493405}
I20260923 19:50:05.224905 6458 tablet_replica.cc:333] T f7e282b6699a4ce9837d221132a1f54e P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:05.225184 6458 raft_consensus.cc:2243] T f7e282b6699a4ce9837d221132a1f54e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:05.225380 6458 raft_consensus.cc:2272] T f7e282b6699a4ce9837d221132a1f54e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:05.225628 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 8db0358af7634911820f99fe16605ca7 (table default.Table_02aee02d3b8746ce98cba010a0ac8149 [id=47c37093044c462993bba6cb00bd296a]) successfully deleted
I20260923 19:50:05.226650 6456 tablet_bootstrap.cc:492] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:05.227319 6842 catalog_manager.cc:1308] Loaded cluster ID: bb53aae1ed8841f4b400598d36bb10de
I20260923 19:50:05.227643 6456 ts_tablet_manager.cc:1403] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.061s user 0.002s sys 0.003s
I20260923 19:50:05.228027 5744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "009ffee03a4d41db84df9f450aa84562" candidate_term: 4 candidate_status { last_received { term: 3 index: 378 } } ignore_live_leader: false dest_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" is_pre_election: true
I20260923 19:50:05.228744 6621 leader_election.cc:304] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 009ffee03a4d41db84df9f450aa84562; no voters: 6b3d628214a34b4fa3ca0c1abe422bae, 83e97b26500048d0b75350a21a8ff96b
I20260923 19:50:05.228943 6842 catalog_manager.cc:1601] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562: loading cluster ID for follower catalog manager: success
I20260923 19:50:05.230863 6456 raft_consensus.cc:359] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.231170 6456 raft_consensus.cc:385] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:05.231297 6456 raft_consensus.cc:740] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:05.231585 6456 consensus_queue.cc:260] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.233774 6458 ts_tablet_manager.cc:1916] T f7e282b6699a4ce9837d221132a1f54e P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:05.238145 6456 ts_tablet_manager.cc:1434] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260923 19:50:05.238560 6456 tablet_bootstrap.cc:492] T b7f372b952804ac58e602998d9b77d72 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:05.241664 6456 tablet_bootstrap.cc:654] T b7f372b952804ac58e602998d9b77d72 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:05.244267 6728 raft_consensus.cc:493] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:05.244412 6728 raft_consensus.cc:515] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.245067 6728 leader_election.cc:290] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:05.245850 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2762648045b4378bcc2c1234460c352" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:05.246637 6280 leader_election.cc:343] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:05.255735 6458 ts_tablet_manager.cc:1929] T f7e282b6699a4ce9837d221132a1f54e P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:05.255867 6458 log.cc:1199] T f7e282b6699a4ce9837d221132a1f54e P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/f7e282b6699a4ce9837d221132a1f54e
I20260923 19:50:05.256248 6458 ts_tablet_manager.cc:1950] T f7e282b6699a4ce9837d221132a1f54e P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:05.257014 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 107) took 4549 ms. Trace:
I20260923 19:50:05.257135 6458 rpcz_store.cc:276] 0923 19:50:00.707194 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:00.707750 (+ 556us) service_pool.cc:224] Handling call
0923 19:50:05.224818 (+4517068us) ts_tablet_manager.cc:1151] Deleting tablet f7e282b6699a4ce9837d221132a1f54e
0923 19:50:05.224826 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.240928 (+ 16102us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.255641 (+ 14713us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.256970 (+ 1329us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4513154}
I20260923 19:50:05.257515 6458 tablet_replica.cc:333] T c52da04e5fe0454ea76bf4d99a930fd7 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:05.257728 6458 raft_consensus.cc:2243] T c52da04e5fe0454ea76bf4d99a930fd7 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:05.257813 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet f7e282b6699a4ce9837d221132a1f54e (table default.Table_c0be6341515349798508cd7887abaa7e [id=b5b882261126409ea6b837b2c010dd9e]) successfully deleted
I20260923 19:50:05.261407 6456 tablet_bootstrap.cc:492] T b7f372b952804ac58e602998d9b77d72 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:05.261616 6456 ts_tablet_manager.cc:1403] T b7f372b952804ac58e602998d9b77d72 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.023s user 0.005s sys 0.013s
I20260923 19:50:05.262475 6458 raft_consensus.cc:2272] T c52da04e5fe0454ea76bf4d99a930fd7 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:05.262527 6456 raft_consensus.cc:359] T b7f372b952804ac58e602998d9b77d72 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.262997 6456 raft_consensus.cc:385] T b7f372b952804ac58e602998d9b77d72 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:05.263144 6456 raft_consensus.cc:740] T b7f372b952804ac58e602998d9b77d72 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:05.263500 6458 ts_tablet_manager.cc:1916] T c52da04e5fe0454ea76bf4d99a930fd7 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:05.263459 6456 consensus_queue.cc:260] T b7f372b952804ac58e602998d9b77d72 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.264174 6456 ts_tablet_manager.cc:1434] T b7f372b952804ac58e602998d9b77d72 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:50:05.264710 6456 tablet_bootstrap.cc:492] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:05.266525 6456 tablet_bootstrap.cc:654] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:05.229262 6791 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260923 19:50:05.120944 6681 rpcz_store.cc:276] 0923 19:50:03.726560 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.726630 (+ 70us) service_pool.cc:224] Handling call
0923 19:50:03.974359 (+247729us) raft_consensus.cc:1471] Updating replica for 361 ops
0923 19:50:04.166969 (+192610us) raft_consensus.cc:1534] Early marking committed up to index 0
0923 19:50:04.166979 (+ 10us) raft_consensus.cc:1539] Triggering prepare for 361 ops
0923 19:50:04.172770 (+ 5791us) write_op.cc:270] Start()
0923 19:50:04.172849 (+ 79us) write_op.cc:276] Timestamp: P: 1790192997592140 usec, L: 0
0923 19:50:04.217244 (+ 44395us) write_op.cc:270] Start()
0923 19:50:04.217279 (+ 35us) write_op.cc:276] Timestamp: P: 1790192997607870 usec, L: 0
0923 19:50:04.217522 (+ 243us) write_op.cc:270] Start()
0923 19:50:04.217557 (+ 35us) write_op.cc:276] Timestamp: P: 1790192997632949 usec, L: 0
0923 19:50:04.217724 (+ 167us) write_op.cc:270] Start()
0923 19:50:04.217746 (+ 22us) write_op.cc:276] Timestamp: P: 1790192997634049 usec, L: 0
0923 19:50:04.217929 (+ 183us) write_op.cc:270] Start()
0923 19:50:04.217950 (+ 21us) write_op.cc:276] Timestamp: P: 1790192997637272 usec, L: 0
0923 19:50:04.218110 (+ 160us) write_op.cc:270] Start()
0923 19:50:04.218129 (+ 19us) write_op.cc:276] Timestamp: P: 1790192997637800 usec, L: 0
0923 19:50:04.218265 (+ 136us) write_op.cc:270] Start()
0923 19:50:04.218327 (+ 62us) write_op.cc:276] Timestamp: P: 1790192997638431 usec, L: 0
0923 19:50:04.218521 (+ 194us) write_op.cc:270] Start()
0923 19:50:04.218541 (+ 20us) write_op.cc:276] Timestamp: P: 1790192997641147 usec, L: 0
0923 19:50:04.218745 (+ 204us) write_op.cc:270] Start()
0923 19:50:04.218767 (+ 22us) write_op.cc:276] Timestamp: P: 1790192997695085 usec, L: 0
0923 19:50:04.218920 (+ 153us) write_op.cc:270] Start()
0923 19:50:04.218941 (+ 21us) write_op.cc:276] Timestamp: P: 1790192997704927 usec, L: 0
0923 19:50:04.219087 (+ 146us) write_op.cc:270] Start()
0923 19:50:04.219106 (+ 19us) write_op.cc:276] Timestamp: P: 1790192997716347 usec, L: 0
0923 19:50:04.219244 (+ 138us) write_op.cc:270] Start()
0923 19:50:04.219263 (+ 19us) write_op.cc:276] Timestamp: P: 1790192997718864 usec, L: 0
0923 19:50:04.219393 (+ 130us) write_op.cc:270] Start()
0923 19:50:04.219411 (+ 18us) write_op.cc:276] Timestamp: P: 1790192997752622 usec, L: 0
0923 19:50:04.219583 (+ 172us) write_op.cc:270] Start()
0923 19:50:04.219608 (+ 25us) write_op.cc:276] Timestamp: P: 1790192997792158 usec, L: 0
0923 19:50:04.219766 (+ 158us) write_op.cc:270] Start()
0923 19:50:04.219787 (+ 21us) write_op.cc:276] Timestamp: P: 1790192997816406 usec, L: 0
0923 19:50:04.219920 (+ 133us) write_op.cc:270] Start()
0923 19:50:04.219939 (+ 19us) write_op.cc:276] Timestamp: P: 1790192997818949 usec, L: 0
0923 19:50:04.220075 (+ 136us) write_op.cc:270] Start()
0923 19:50:04.220100 (+ 25us) write_op.cc:276] Timestamp: P: 1790192997822744 usec, L: 0
0923 19:50:04.220263 (+ 163us) write_op.cc:270] Start()
0923 19:50:04.220291 (+ 28us) write_op.cc:276] Timestamp: P: 1790192997823565 usec, L: 0
0923 19:50:04.220469 (+ 178us) write_op.cc:270] Start()
0923 19:50:04.220489 (+ 20us) write_op.cc:276] Timestamp: P: 1790192997824324 usec, L: 0
0923 19:50:04.220623 (+ 134us) write_op.cc:270] Start()
0923 19:50:04.220641 (+ 18us) write_op.cc:276] Timestamp: P: 1790192997825015 usec, L: 0
0923 19:50:04.220839 (+ 198us) write_op.cc:270] Start()
0923 19:50:04.220866 (+ 27us) write_op.cc:276] Timestamp: P: 1790192997825685 usec, L: 0
0923 19:50:04.221051 (+ 185us) write_op.cc:270] Start()
0923 19:50:04.221071 (+ 20us) write_op.cc:276] Timestamp: P: 1790192997852408 usec, L: 0
0923 19:50:04.221224 (+ 153us) write_op.cc:270] Start()
0923 19:50:04.221248 (+ 24us) write_op.cc:276] Timestamp: P: 1790192997852978 usec, L: 0
0923 19:50:04.221379 (+ 131us) write_op.cc:270] Start()
0923 19:50:04.221400 (+ 21us) write_op.cc:276] Timestamp: P: 1790192997862864 usec, L: 0
0923 19:50:04.221568 (+ 168us) write_op.cc:270] Start()
0923 19:50:04.221587 (+ 19us) write_op.cc:276] Timestamp: P: 1790192997863668 usec, L: 0
0923 19:50:04.221728 (+ 141us) write_op.cc:270] Start()
0923 19:50:04.221751 (+ 23us) write_op.cc:276] Timestamp: P: 1790192997890853 usec, L: 0
0923 19:50:04.221914 (+ 163us) write_op.cc:270] Start()
0923 19:50:04.221934 (+ 20us) write_op.cc:276] Timestamp: P: 1790192997891430 usec, L: 0
0923 19:50:04.222092 (+ 158us) write_op.cc:270] Start()
0923 19:50:04.222116 (+ 24us) write_op.cc:276] Timestamp: P: 1790192997891920 usec, L: 0
0923 19:50:04.222309 (+ 193us) write_op.cc:270] Start()
0923 19:50:04.222334 (+ 25us) write_op.cc:276] Timestamp: P: 1790192997892364 usec, L: 0
0923 19:50:04.222480 (+ 146us) write_op.cc:270] Start()
0923 19:50:04.222502 (+ 22us) write_op.cc:276] Timestamp: P: 1790192997892943 usec, L: 0
0923 19:50:04.222690 (+ 188us) write_op.cc:270] Start()
0923 19:50:04.222713 (+ 23us) write_op.cc:276] Timestamp: P: 1790192997904251 usec, L: 0
0923 19:50:04.222853 (+ 140us) write_op.cc:270] Start()
0923 19:50:04.222875 (+ 22us) write_op.cc:276] Timestamp: P: 1790192997908871 usec, L: 0
0923 19:50:04.223031 (+ 156us) write_op.cc:270] Start()
0923 19:50:04.223054 (+ 23us) write_op.cc:276] Timestamp: P: 1790192997925961 usec, L: 0
0923 19:50:04.223203 (+ 149us) write_op.cc:270] Start()
0923 19:50:04.223225 (+ 22us) write_op.cc:276] Timestamp: P: 1790192997937721 usec, L: 0
0923 19:50:04.223365 (+ 140us) write_op.cc:270] Start()
0923 19:50:04.223386 (+ 21us) write_op.cc:276] Timestamp: P: 1790192997984074 usec, L: 0
0923 19:50:04.223541 (+ 155us) write_op.cc:270] Start()
0923 19:50:04.223563 (+ 22us) write_op.cc:276] Timestamp: P: 1790192997988079 usec, L: 0
0923 19:50:04.223691 (+ 128us) write_op.cc:270] Start()
0923 19:50:04.223728 (+ 37us) write_op.cc:276] Timestamp: P: 1790192997997780 usec, L: 0
0923 19:50:04.223879 (+ 151us) write_op.cc:270] Start()
0923 19:50:04.223897 (+ 18us) write_op.cc:276] Timestamp: P: 1790192998045511 usec, L: 0
0923 19:50:04.224016 (+ 119us) write_op.cc:270] Start()
0923 19:50:04.224032 (+ 16us) write_op.cc:276] Timestamp: P: 1790192998127434 usec, L: 0
0923 19:50:04.224138 (+ 106us) write_op.cc:270] Start()
0923 19:50:04.224155 (+ 17us) write_op.cc:276] Timestamp: P: 1790192998129403 usec, L: 0
0923 19:50:04.231713 (+ 7558us) write_op.cc:270] Start()
0923 19:50:04.231756 (+ 43us) write_op.cc:276] Timestamp: P: 1790192998130776 usec, L: 0
0923 19:50:04.231962 (+ 206us) write_op.cc:270] Start()
0923 19:50:04.231982 (+ 20us) write_op.cc:276] Timestamp: P: 1790192998131391 usec, L: 0
0923 19:50:04.232163 (+ 181us) write_op.cc:270] Start()
0923 19:50:04.232192 (+ 29us) write_op.cc:276] Timestamp: P: 1790192998131933 usec, L: 0
0923 19:50:04.232384 (+ 192us) write_op.cc:270] Start()
0923 19:50:04.232416 (+ 32us) write_op.cc:276] Timestamp: P: 1790192998134800 usec, L: 0
0923 19:50:04.232609 (+ 193us) write_op.cc:270] Start()
0923 19:50:04.232637 (+ 28us) write_op.cc:276] Timestamp: P: 1790192998135782 usec, L: 0
0923 19:50:04.232827 (+ 190us) write_op.cc:270] Start()
0923 19:50:04.232855 (+ 28us) write_op.cc:276] Timestamp: P: 1790192998136985 usec, L: 0
0923 19:50:04.233052 (+ 197us) write_op.cc:270] Start()
0923 19:50:04.233081 (+ 29us) write_op.cc:276] Timestamp: P: 1790192998138090 usec, L: 0
0923 19:50:04.233404 (+ 323us) write_op.cc:270] Start()
0923 19:50:04.233521 (+ 117us) write_op.cc:276] Timestamp: P: 1790192998139257 usec, L: 0
0923 19:50:04.236498 (+ 2977us) write_op.cc:270] Start()
0923 19:50:04.236538 (+ 40us) write_op.cc:276] Timestamp: P: 1790192998154426 usec, L: 0
0923 19:50:04.236767 (+ 229us) write_op.cc:270] Start()
0923 19:50:04.237245 (+ 478us) write_op.cc:276] Timestamp: P: 1790192998167770 usec, L: 0
0923 19:50:04.237515 (+ 270us) write_op.cc:270] Start()
0923 19:50:04.237535 (+ 20us) write_op.cc:276] Timestamp: P: 1790192998245063 usec, L: 0
0923 19:50:04.237658 (+ 123us) write_op.cc:270] Start()
0923 19:50:04.237687 (+ 29us) write_op.cc:276] Timestamp: P: 1790192998251092 usec, L: 0
0923 19:50:04.237798 (+ 111us) write_op.cc:270] Start()
0923 19:50:04.237815 (+ 17us) write_op.cc:276] Timestamp: P: 1790192998260940 usec, L: 0
0923 19:50:04.238678 (+ 863us) write_op.cc:270] Start()
0923 19:50:04.238701 (+ 23us) write_op.cc:276] Timestamp: P: 1790192998320811 usec, L: 0
0923 19:50:04.238842 (+ 141us) write_op.cc:270] Start()
0923 19:50:04.238859 (+ 17us) write_op.cc:276] Timestamp: P: 1790192998331671 usec, L: 0
0923 19:50:04.238966 (+ 107us) write_op.cc:270] Start()
0923 19:50:04.238981 (+ 15us) write_op.cc:276] Timestamp: P: 1790192998368472 usec, L: 0
0923 19:50:04.239074 (+ 93us) write_op.cc:270] Start()
0923 19:50:04.239089 (+ 15us) write_op.cc:276] Timestamp: P: 1790192998371969 usec, L: 0
0923 19:50:04.239199 (+ 110us) write_op.cc:270] Start()
0923 19:50:04.239214 (+ 15us) write_op.cc:276] Timestamp: P: 1790192998402764 usec, L: 0
0923 19:50:04.239318 (+ 104us) write_op.cc:270] Start()
0923 19:50:04.239333 (+ 15us) write_op.cc:276] Timestamp: P: 1790192998405011 usec, L: 0
0923 19:50:04.239435 (+ 102us) write_op.cc:270] Start()
0923 19:50:04.239473 (+ 38us) write_op.cc:276] Timestamp: P: 1790192998443913 usec, L: 0
0923 19:50:04.239582 (+ 109us) write_op.cc:270] Start()
0923 19:50:04.239598 (+ 16us) write_op.cc:276] Timestamp: P: 1790192998453381 usec, L: 0
0923 19:50:04.239711 (+ 113us) write_op.cc:270] Start()
0923 19:50:04.239727 (+ 16us) write_op.cc:276] Timestamp: P: 1790192998639254 usec, L: 0
0923 19:50:04.239831 (+ 104us) write_op.cc:270] Start()
0923 19:50:04.239855 (+ 24us) write_op.cc:276] Timestamp: P: 1790192998650357 usec, L: 0
0923 19:50:04.239962 (+ 107us) write_op.cc:270] Start()
0923 19:50:04.239978 (+ 16us) write_op.cc:276] Timestamp: P: 1790192998670660 usec, L: 0
0923 19:50:04.240106 (+ 128us) write_op.cc:270] Start()
0923 19:50:04.240132 (+ 26us) write_op.cc:276] Timestamp: P: 1790192998757174 usec, L: 0
0923 19:50:04.240281 (+ 149us) write_op.cc:270] Start()
0923 19:50:04.240304 (+ 23us) write_op.cc:276] Timestamp: P: 1790192998758582 usec, L: 0
0923 19:50:04.247839 (+ 7535us) write_op.cc:270] Start()
0923 19:50:04.248228 (+ 389us) write_op.cc:276] Timestamp: P: 1790192998759655 usec, L: 0
0923 19:50:04.280074 (+ 31846us) write_op.cc:270] Start()
0923 19:50:04.280128 (+ 54us) write_op.cc:276] Timestamp: P: 1790192998760703 usec, L: 0
0923 19:50:04.284423 (+ 4295us) write_op.cc:270] Start()
0923 19:50:04.284479 (+ 56us) write_op.cc:276] Timestamp: P: 1790192998901977 usec, L: 0
0923 19:50:04.284757 (+ 278us) write_op.cc:270] Start()
0923 19:50:04.284799 (+ 42us) write_op.cc:276] Timestamp: P: 1790192998904666 usec, L: 0
0923 19:50:04.284927 (+ 128us) write_op.cc:270] Start()
0923 19:50:04.284944 (+ 17us) write_op.cc:276] Timestamp: P: 1790192998945746 usec, L: 0
0923 19:50:04.285067 (+ 123us) write_op.cc:270] Start()
0923 19:50:04.285084 (+ 17us) write_op.cc:276] Timestamp: P: 1790192998949841 usec, L: 0
0923 19:50:04.285197 (+ 113us) write_op.cc:270] Start()
0923 19:50:04.285213 (+ 16us) write_op.cc:276] Timestamp: P: 1790192999012641 usec, L: 0
0923 19:50:04.285317 (+ 104us) write_op.cc:270] Start()
0923 19:50:04.285332 (+ 15us) write_op.cc:276] Timestamp: P: 1790192999022720 usec, L: 0
0923 19:50:04.285424 (+ 92us) write_op.cc:270] Start()
0923 19:50:04.285439 (+ 15us) write_op.cc:276] Timestamp: P: 1790192999026592 usec, L: 0
0923 19:50:04.285532 (+ 93us) write_op.cc:270] Start()
0923 19:50:04.285546 (+ 14us) write_op.cc:276] Timestamp: P: 1790192999036079 usec, L: 0
0923 19:50:04.285678 (+ 132us) write_op.cc:270] Start()
0923 19:50:04.285695 (+ 17us) write_op.cc:276] Timestamp: P: 1790192999038770 usec, L: 0
0923 19:50:04.291029 (+ 5334us) write_op.cc:270] Start()
0923 19:50:04.291080 (+ 51us) write_op.cc:276] Timestamp: P: 1790192999039383 usec, L: 0
0923 19:50:04.291289 (+ 209us) write_op.cc:270] Start()
0923 19:50:04.291341 (+ 52us) write_op.cc:276] Timestamp: P: 1790192999059676 usec, L: 0
0923 19:50:04.291485 (+ 144us) write_op.cc:270] Start()
0923 19:50:04.291502 (+ 17us) write_op.cc:276] Timestamp: P: 1790192999063789 usec, L: 0
0923 19:50:04.291623 (+ 121us) write_op.cc:270] Start()
0923 19:50:04.291642 (+ 19us) write_op.cc:276] Timestamp: P: 1790192999068484 usec, L: 0
0923 19:50:04.291766 (+ 124us) write_op.cc:270] Start()
0923 19:50:04.291782 (+ 16us) write_op.cc:276] Timestamp: P: 1790192999105392 usec, L: 0
0923 19:50:04.291899 (+ 117us) write_op.cc:270] Start()
0923 19:50:04.291915 (+ 16us) write_op.cc:276] Timestamp: P: 1790192999112860 usec, L: 0
0923 19:50:04.292010 (+ 95us) write_op.cc:270] Start()
0923 19:50:04.292025 (+ 15us) write_op.cc:276] Timestamp: P: 1790192999115785 usec, L: 0
0923 19:50:04.292138 (+ 113us) write_op.cc:270] Start()
0923 19:50:04.292153 (+ 15us) write_op.cc:276] Timestamp: P: 1790192999148738 usec, L: 0
0923 19:50:04.292260 (+ 107us) write_op.cc:270] Start()
0923 19:50:04.292286 (+ 26us) write_op.cc:276] Timestamp: P: 1790192999149695 usec, L: 0
0923 19:50:04.292399 (+ 113us) write_op.cc:270] Start()
0923 19:50:04.292413 (+ 14us) write_op.cc:276] Timestamp: P: 1790192999165743 usec, L: 0
0923 19:50:04.292534 (+ 121us) write_op.cc:270] Start()
0923 19:50:04.292550 (+ 16us) write_op.cc:276] Timestamp: P: 1790192999179556 usec, L: 0
0923 19:50:04.292669 (+ 119us) write_op.cc:270] Start()
0923 19:50:04.292685 (+ 16us) write_op.cc:276] Timestamp: P: 1790192999225433 usec, L: 0
0923 19:50:04.292793 (+ 108us) write_op.cc:270] Start()
0923 19:50:04.292809 (+ 16us) write_op.cc:276] Timestamp: P: 1790192999249180 usec, L: 0
0923 19:50:04.292924 (+ 115us) write_op.cc:270] Start()
0923 19:50:04.292941 (+ 17us) write_op.cc:276] Timestamp: P: 1790192999250138 usec, L: 0
0923 19:50:04.293047 (+ 106us) write_op.cc:270] Start()
0923 19:50:04.293085 (+ 38us) write_op.cc:276] Timestamp: P: 1790192999378834 usec, L: 0
0923 19:50:04.293227 (+ 142us) write_op.cc:270] Start()
0923 19:50:04.293246 (+ 19us) write_op.cc:276] Timestamp: P: 1790192999408020 usec, L: 0
0923 19:50:04.293358 (+ 112us) write_op.cc:270] Start()
0923 19:50:04.293374 (+ 16us) write_op.cc:276] Timestamp: P: 1790192999409376 usec, L: 0
0923 19:50:04.293479 (+ 105us) write_op.cc:270] Start()
0923 19:50:04.293494 (+ 15us) write_op.cc:276] Timestamp: P: 1790192999410773 usec, L: 0
0923 19:50:04.293634 (+ 140us) write_op.cc:270] Start()
0923 19:50:04.293655 (+ 21us) write_op.cc:276] Timestamp: P: 1790192999411880 usec, L: 0
0923 19:50:04.293768 (+ 113us) write_op.cc:270] Start()
0923 19:50:04.293783 (+ 15us) write_op.cc:276] Timestamp: P: 1790192999413015 usec, L: 0
0923 19:50:04.303519 (+ 9736us) write_op.cc:270] Start()
0923 19:50:04.303567 (+ 48us) write_op.cc:276] Timestamp: P: 1790192999491813 usec, L: 0
0923 19:50:04.303789 (+ 222us) write_op.cc:270] Start()
0923 19:50:04.303807 (+ 18us) write_op.cc:276] Timestamp: P: 1790192999497436 usec, L: 0
0923 19:50:04.303917 (+ 110us) write_op.cc:270] Start()
0923 19:50:04.303933 (+ 16us) write_op.cc:276] Timestamp: P: 1790192999519519 usec, L: 0
0923 19:50:04.304044 (+ 111us) write_op.cc:270] Start()
0923 19:50:04.304060 (+ 16us) write_op.cc:276] Timestamp: P: 1790192999572391 usec, L: 0
0923 19:50:04.304190 (+ 130us) write_op.cc:270] Start()
0923 19:50:04.304206 (+ 16us) write_op.cc:276] Timestamp: P: 1790192999573158 usec, L: 0
0923 19:50:04.304303 (+ 97us) write_op.cc:270] Start()
0923 19:50:04.304318 (+ 15us) write_op.cc:276] Timestamp: P: 1790192999573754 usec, L: 0
0923 19:50:04.304417 (+ 99us) write_op.cc:270] Start()
0923 19:50:04.304438 (+ 21us) write_op.cc:276] Timestamp: P: 1790192999602421 usec, L: 0
0923 19:50:04.304558 (+ 120us) write_op.cc:270] Start()
0923 19:50:04.304574 (+ 16us) write_op.cc:276] Timestamp: P: 1790192999614868 usec, L: 0
0923 19:50:04.304670 (+ 96us) write_op.cc:270] Start()
0923 19:50:04.304685 (+ 15us) write_op.cc:276] Timestamp: P: 1790192999623415 usec, L: 0
0923 19:50:04.304792 (+ 107us) write_op.cc:270] Start()
0923 19:50:04.304807 (+ 15us) write_op.cc:276] Timestamp: P: 1790192999633084 usec, L: 0
0923 19:50:04.304901 (+ 94us) write_op.cc:270] Start()
0923 19:50:04.304916 (+ 15us) write_op.cc:276] Timestamp: P: 1790192999635385 usec, L: 0
0923 19:50:04.305015 (+ 99us) write_op.cc:270] Start()
0923 19:50:04.305032 (+ 17us) write_op.cc:276] Timestamp: P: 1790192999636951 usec, L: 0
0923 19:50:04.305160 (+ 128us) write_op.cc:270] Start()
0923 19:50:04.305177 (+ 17us) write_op.cc:276] Timestamp: P: 1790192999645458 usec, L: 0
0923 19:50:04.305280 (+ 103us) write_op.cc:270] Start()
0923 19:50:04.305295 (+ 15us) write_op.cc:276] Timestamp: P: 1790192999660662 usec, L: 0
0923 19:50:04.305417 (+ 122us) write_op.cc:270] Start()
0923 19:50:04.305434 (+ 17us) write_op.cc:276] Timestamp: P: 1790192999673048 usec, L: 0
0923 19:50:04.305556 (+ 122us) write_op.cc:270] Start()
0923 19:50:04.305574 (+ 18us) write_op.cc:276] Timestamp: P: 1790192999673737 usec, L: 0
0923 19:50:04.305726 (+ 152us) write_op.cc:270] Start()
0923 19:50:04.311393 (+ 5667us) write_op.cc:276] Timestamp: P: 1790192999674338 usec, L: 0
0923 19:50:04.311636 (+ 243us) write_op.cc:270] Start()
0923 19:50:04.311657 (+ 21us) write_op.cc:276] Timestamp: P: 1790192999674940 usec, L: 0
0923 19:50:04.311770 (+ 113us) write_op.cc:270] Start()
0923 19:50:04.311786 (+ 16us) write_op.cc:276] Timestamp: P: 1790192999698029 usec, L: 0
0923 19:50:04.311912 (+ 126us) write_op.cc:270] Start()
0923 19:50:04.311928 (+ 16us) write_op.cc:276] Timestamp: P: 1790192999699722 usec, L: 0
0923 19:50:04.312031 (+ 103us) write_op.cc:270] Start()
0923 19:50:04.312045 (+ 14us) write_op.cc:276] Timestamp: P: 1790192999719798 usec, L: 0
0923 19:50:04.312154 (+ 109us) write_op.cc:270] Start()
0923 19:50:04.312171 (+ 17us) write_op.cc:276] Timestamp: P: 1790192999733141 usec, L: 0
0923 19:50:04.312277 (+ 106us) write_op.cc:270] Start()
0923 19:50:04.312292 (+ 15us) write_op.cc:276] Timestamp: P: 1790192999764876 usec, L: 0
0923 19:50:04.312417 (+ 125us) write_op.cc:270] Start()
0923 19:50:04.312433 (+ 16us) write_op.cc:276] Timestamp: P: 1790192999765591 usec, L: 0
0923 19:50:04.312548 (+ 115us) write_op.cc:270] Start()
0923 19:50:04.312564 (+ 16us) write_op.cc:276] Timestamp: P: 1790192999767968 usec, L: 0
0923 19:50:04.312727 (+ 163us) write_op.cc:270] Start()
0923 19:50:04.312744 (+ 17us) write_op.cc:276] Timestamp: P: 1790192999768524 usec, L: 0
0923 19:50:04.312901 (+ 157us) write_op.cc:270] Start()
0923 19:50:04.312918 (+ 17us) write_op.cc:276] Timestamp: P: 1790192999770412 usec, L: 0
0923 19:50:04.313024 (+ 106us) write_op.cc:270] Start()
0923 19:50:04.313040 (+ 16us) write_op.cc:276] Timestamp: P: 1790192999785207 usec, L: 0
0923 19:50:04.313186 (+ 146us) write_op.cc:270] Start()
0923 19:50:04.313204 (+ 18us) write_op.cc:276] Timestamp: P: 1790192999785869 usec, L: 0
0923 19:50:04.313318 (+ 114us) write_op.cc:270] Start()
0923 19:50:04.313338 (+ 20us) write_op.cc:276] Timestamp: P: 1790192999810816 usec, L: 0
0923 19:50:04.313498 (+ 160us) write_op.cc:270] Start()
0923 19:50:04.313519 (+ 21us) write_op.cc:276] Timestamp: P: 1790192999815861 usec, L: 0
0923 19:50:04.313731 (+ 212us) write_op.cc:270] Start()
0923 19:50:04.313757 (+ 26us) write_op.cc:276] Timestamp: P: 1790192999854536 usec, L: 0
0923 19:50:04.313918 (+ 161us) write_op.cc:270] Start()
0923 19:50:04.313937 (+ 19us) write_op.cc:276] Timestamp: P: 1790192999855730 usec, L: 0
0923 19:50:04.314078 (+ 141us) write_op.cc:270] Start()
0923 19:50:04.314118 (+ 40us) write_op.cc:276] Timestamp: P: 1790192999861202 usec, L: 0
0923 19:50:04.314243 (+ 125us) write_op.cc:270] Start()
0923 19:50:04.314260 (+ 17us) write_op.cc:276] Timestamp: P: 1790192999862652 usec, L: 0
0923 19:50:04.314376 (+ 116us) write_op.cc:270] Start()
0923 19:50:04.314393 (+ 17us) write_op.cc:276] Timestamp: P: 1790192999894252 usec, L: 0
0923 19:50:04.314508 (+ 115us) write_op.cc:270] Start()
0923 19:50:04.314525 (+ 17us) write_op.cc:276] Timestamp: P: 1790192999897180 usec, L: 0
0923 19:50:04.314651 (+ 126us) write_op.cc:270] Start()
0923 19:50:04.314674 (+ 23us) write_op.cc:276] Timestamp: P: 1790192999898843 usec, L: 0
0923 19:50:04.314824 (+ 150us) write_op.cc:270] Start()
0923 19:50:04.314846 (+ 22us) write_op.cc:276] Timestamp: P: 1790192999928679 usec, L: 0
0923 19:50:04.314997 (+ 151us) write_op.cc:270] Start()
0923 19:50:04.315016 (+ 19us) write_op.cc:276] Timestamp: P: 1790192999929520 usec, L: 0
0923 19:50:04.315145 (+ 129us) write_op.cc:270] Start()
0923 19:50:04.315171 (+ 26us) write_op.cc:276] Timestamp: P: 1790192999934611 usec, L: 0
0923 19:50:04.315315 (+ 144us) write_op.cc:270] Start()
0923 19:50:04.315337 (+ 22us) write_op.cc:276] Timestamp: P: 1790192999936307 usec, L: 0
0923 19:50:04.315480 (+ 143us) write_op.cc:270] Start()
0923 19:50:04.315501 (+ 21us) write_op.cc:276] Timestamp: P: 1790192999937903 usec, L: 0
0923 19:50:04.315673 (+ 172us) write_op.cc:270] Start()
0923 19:50:04.315694 (+ 21us) write_op.cc:276] Timestamp: P: 1790192999942505 usec, L: 0
0923 19:50:04.315840 (+ 146us) write_op.cc:270] Start()
0923 19:50:04.315863 (+ 23us) write_op.cc:276] Timestamp: P: 1790192999957007 usec, L: 0
0923 19:50:04.315993 (+ 130us) write_op.cc:270] Start()
0923 19:50:04.316014 (+ 21us) write_op.cc:276] Timestamp: P: 1790192999986005 usec, L: 0
0923 19:50:04.316153 (+ 139us) write_op.cc:270] Start()
0923 19:50:04.316176 (+ 23us) write_op.cc:276] Timestamp: P: 1790192999991377 usec, L: 0
0923 19:50:04.316329 (+ 153us) write_op.cc:270] Start()
0923 19:50:04.316349 (+ 20us) write_op.cc:276] Timestamp: P: 1790193000045013 usec, L: 0
0923 19:50:04.316478 (+ 129us) write_op.cc:270] Start()
0923 19:50:04.316497 (+ 19us) write_op.cc:276] Timestamp: P: 1790193000065151 usec, L: 0
0923 19:50:04.316688 (+ 191us) write_op.cc:270] Start()
0923 19:50:04.316710 (+ 22us) write_op.cc:276] Timestamp: P: 1790193000065836 usec, L: 0
0923 19:50:04.316841 (+ 131us) write_op.cc:270] Start()
0923 19:50:04.316858 (+ 17us) write_op.cc:276] Timestamp: P: 1790193000077691 usec, L: 0
0923 19:50:04.316985 (+ 127us) write_op.cc:270] Start()
0923 19:50:04.317001 (+ 16us) write_op.cc:276] Timestamp: P: 1790193000126521 usec, L: 0
0923 19:50:04.317137 (+ 136us) write_op.cc:270] Start()
0923 19:50:04.317156 (+ 19us) write_op.cc:276] Timestamp: P: 1790193000134053 usec, L: 0
0923 19:50:04.317267 (+ 111us) write_op.cc:270] Start()
0923 19:50:04.317284 (+ 17us) write_op.cc:276] Timestamp: P: 1790193000147757 usec, L: 0
0923 19:50:04.317418 (+ 134us) write_op.cc:270] Start()
0923 19:50:04.317435 (+ 17us) write_op.cc:276] Timestamp: P: 1790193000149877 usec, L: 0
0923 19:50:04.317589 (+ 154us) write_op.cc:270] Start()
0923 19:50:04.317626 (+ 37us) write_op.cc:276] Timestamp: P: 1790193000253733 usec, L: 0
0923 19:50:04.317765 (+ 139us) write_op.cc:270] Start()
0923 19:50:04.317787 (+ 22us) write_op.cc:276] Timestamp: P: 1790193000254498 usec, L: 0
0923 19:50:04.462097 (+144310us) write_op.cc:270] Start()
0923 19:50:04.462156 (+ 59us) write_op.cc:276] Timestamp: P: 1790193000262790 usec, L: 0
0923 19:50:04.462420 (+ 264us) write_op.cc:270] Start()
0923 19:50:04.462447 (+ 27us) write_op.cc:276] Timestamp: P: 1790193000263464 usec, L: 0
0923 19:50:04.462613 (+ 166us) write_op.cc:270] Start()
0923 19:50:04.462636 (+ 23us) write_op.cc:276] Timestamp: P: 1790193000263981 usec, L: 0
0923 19:50:04.462786 (+ 150us) write_op.cc:270] Start()
0923 19:50:04.462810 (+ 24us) write_op.cc:276] Timestamp: P: 1790193000324870 usec, L: 0
0923 19:50:04.462971 (+ 161us) write_op.cc:270] Start()
0923 19:50:04.463028 (+ 57us) write_op.cc:276] Timestamp: P: 1790193000326295 usec, L: 0
0923 19:50:04.463193 (+ 165us) write_op.cc:270] Start()
0923 19:50:04.463216 (+ 23us) write_op.cc:276] Timestamp: P: 1790193000328536 usec, L: 0
0923 19:50:04.463379 (+ 163us) write_op.cc:270] Start()
0923 19:50:04.463404 (+ 25us) write_op.cc:276] Timestamp: P: 1790193000329939 usec, L: 0
0923 19:50:04.463545 (+ 141us) write_op.cc:270] Start()
0923 19:50:04.463570 (+ 25us) write_op.cc:276] Timestamp: P: 1790193000345962 usec, L: 0
0923 19:50:04.463723 (+ 153us) write_op.cc:270] Start()
0923 19:50:04.463744 (+ 21us) write_op.cc:276] Timestamp: P: 1790193000411472 usec, L: 0
0923 19:50:04.463899 (+ 155us) write_op.cc:270] Start()
0923 19:50:04.463923 (+ 24us) write_op.cc:276] Timestamp: P: 1790193000498467 usec, L: 0
0923 19:50:04.464071 (+ 148us) write_op.cc:270] Start()
0923 19:50:04.464092 (+ 21us) write_op.cc:276] Timestamp: P: 1790193000499205 usec, L: 0
0923 19:50:04.464253 (+ 161us) write_op.cc:270] Start()
0923 19:50:04.464281 (+ 28us) write_op.cc:276] Timestamp: P: 1790193000499819 usec, L: 0
0923 19:50:04.464481 (+ 200us) write_op.cc:270] Start()
0923 19:50:04.464564 (+ 83us) write_op.cc:276] Timestamp: P: 1790193000500444 usec, L: 0
0923 19:50:04.464779 (+ 215us) write_op.cc:270] Start()
0923 19:50:04.464803 (+ 24us) write_op.cc:276] Timestamp: P: 1790193000501539 usec, L: 0
0923 19:50:04.464953 (+ 150us) write_op.cc:270] Start()
0923 19:50:04.464976 (+ 23us) write_op.cc:276] Timestamp: P: 1790193000546010 usec, L: 0
0923 19:50:04.465115 (+ 139us) write_op.cc:270] Start()
0923 19:50:04.465139 (+ 24us) write_op.cc:276] Timestamp: P: 1790193000558410 usec, L: 0
0923 19:50:04.465307 (+ 168us) write_op.cc:270] Start()
0923 19:50:04.465341 (+ 34us) write_op.cc:276] Timestamp: P: 1790193000688415 usec, L: 0
0923 19:50:04.465498 (+ 157us) write_op.cc:270] Start()
0923 19:50:04.465519 (+ 21us) write_op.cc:276] Timestamp: P: 1790193000689585 usec, L: 0
0923 19:50:04.465652 (+ 133us) write_op.cc:270] Start()
0923 19:50:04.465670 (+ 18us) write_op.cc:276] Timestamp: P: 1790193000699298 usec, L: 0
0923 19:50:04.465795 (+ 125us) write_op.cc:270] Start()
0923 19:50:04.465813 (+ 18us) write_op.cc:276] Timestamp: P: 1790193000700392 usec, L: 0
0923 19:50:04.470031 (+ 4218us) write_op.cc:270] Start()
0923 19:50:04.470072 (+ 41us) write_op.cc:276] Timestamp: P: 1790193000701037 usec, L: 0
0923 19:50:04.470291 (+ 219us) write_op.cc:270] Start()
0923 19:50:04.470318 (+ 27us) write_op.cc:276] Timestamp: P: 1790193000703534 usec, L: 0
0923 19:50:04.470472 (+ 154us) write_op.cc:270] Start()
0923 19:50:04.470495 (+ 23us) write_op.cc:276] Timestamp: P: 1790193000723510 usec, L: 0
0923 19:50:04.470645 (+ 150us) write_op.cc:270] Start()
0923 19:50:04.470669 (+ 24us) write_op.cc:276] Timestamp: P: 1790193000725818 usec, L: 0
0923 19:50:04.470852 (+ 183us) write_op.cc:270] Start()
0923 19:50:04.470878 (+ 26us) write_op.cc:276] Timestamp: P: 1790193000879107 usec, L: 0
0923 19:50:04.471030 (+ 152us) write_op.cc:270] Start()
0923 19:50:04.471052 (+ 22us) write_op.cc:276] Timestamp: P: 1790193000881286 usec, L: 0
0923 19:50:04.471194 (+ 142us) write_op.cc:270] Start()
0923 19:50:04.471216 (+ 22us) write_op.cc:276] Timestamp: P: 1790193000888719 usec, L: 0
0923 19:50:04.471374 (+ 158us) write_op.cc:270] Start()
0923 19:50:04.471389 (+ 15us) write_op.cc:276] Timestamp: P: 1790193000896737 usec, L: 0
0923 19:50:04.471514 (+ 125us) write_op.cc:270] Start()
0923 19:50:04.471544 (+ 30us) write_op.cc:276] Timestamp: P: 1790193000908336 usec, L: 0
0923 19:50:04.471693 (+ 149us) write_op.cc:270] Start()
0923 19:50:04.471715 (+ 22us) write_op.cc:276] Timestamp: P: 1790193001004588 usec, L: 0
0923 19:50:04.471866 (+ 151us) write_op.cc:270] Start()
0923 19:50:04.471888 (+ 22us) write_op.cc:276] Timestamp: P: 1790193001005208 usec, L: 0
0923 19:50:04.472029 (+ 141us) write_op.cc:270] Start()
0923 19:50:04.472052 (+ 23us) write_op.cc:276] Timestamp: P: 1790193001005795 usec, L: 0
0923 19:50:04.472204 (+ 152us) write_op.cc:270] Start()
0923 19:50:04.472226 (+ 22us) write_op.cc:276] Timestamp: P: 1790193001006314 usec, L: 0
0923 19:50:04.472433 (+ 207us) write_op.cc:270] Start()
0923 19:50:04.472457 (+ 24us) write_op.cc:276] Timestamp: P: 1790193001006863 usec, L: 0
0923 19:50:04.472626 (+ 169us) write_op.cc:270] Start()
0923 19:50:04.472650 (+ 24us) write_op.cc:276] Timestamp: P: 1790193001061886 usec, L: 0
0923 19:50:04.472810 (+ 160us) write_op.cc:270] Start()
0923 19:50:04.472834 (+ 24us) write_op.cc:276] Timestamp: P: 1790193001064241 usec, L: 0
0923 19:50:04.472984 (+ 150us) write_op.cc:270] Start()
0923 19:50:04.473009 (+ 25us) write_op.cc:276] Timestamp: P: 1790193001066614 usec, L: 0
0923 19:50:04.473147 (+ 138us) write_op.cc:270] Start()
0923 19:50:04.473170 (+ 23us) write_op.cc:276] Timestamp: P: 1790193001123511 usec, L: 0
0923 19:50:04.473330 (+ 160us) write_op.cc:270] Start()
0923 19:50:04.473354 (+ 24us) write_op.cc:276] Timestamp: P: 1790193001129699 usec, L: 0
0923 19:50:04.473499 (+ 145us) write_op.cc:270] Start()
0923 19:50:04.473522 (+ 23us) write_op.cc:276] Timestamp: P: 1790193001165581 usec, L: 0
0923 19:50:04.473669 (+ 147us) write_op.cc:270] Start()
0923 19:50:04.473691 (+ 22us) write_op.cc:276] Timestamp: P: 1790193001174987 usec, L: 0
0923 19:50:04.473856 (+ 165us) write_op.cc:270] Start()
0923 19:50:04.479929 (+ 6073us) write_op.cc:276] Timestamp: P: 1790193001182890 usec, L: 0
0923 19:50:04.480226 (+ 297us) write_op.cc:270] Start()
0923 19:50:04.480278 (+ 52us) write_op.cc:276] Timestamp: P: 17901930
I20260923 19:50:05.276911 6660 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" instance_seqno: 1790192997444991) as {username='slave'} at 127.5.143.195:45281; Asking this server to re-register.
I20260923 19:50:05.278297 6390 heartbeater.cc:461] Registering TS with master...
I20260923 19:50:05.280568 6458 ts_tablet_manager.cc:1929] T c52da04e5fe0454ea76bf4d99a930fd7 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:05.280714 6458 log.cc:1199] T c52da04e5fe0454ea76bf4d99a930fd7 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/c52da04e5fe0454ea76bf4d99a930fd7
I20260923 19:50:05.281057 6458 ts_tablet_manager.cc:1950] T c52da04e5fe0454ea76bf4d99a930fd7 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:05.281260 6660 ts_manager.cc:194] Registered new tserver with Master: 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:05.281718 6825 raft_consensus.cc:493] T a1e8b8e638ec438a86f05fa147cdb27c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:05.281912 6825 raft_consensus.cc:515] T a1e8b8e638ec438a86f05fa147cdb27c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.282051 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 108) took 4574 ms. Trace:
I20260923 19:50:05.282626 6825 leader_election.cc:290] T a1e8b8e638ec438a86f05fa147cdb27c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:05.282961 6057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f302f91c8ef44237b1c9909d88dacbff" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:05.284296 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e8b8e638ec438a86f05fa147cdb27c" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:05.284487 6344 raft_consensus.cc:2468] T a1e8b8e638ec438a86f05fa147cdb27c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 0.
I20260923 19:50:05.286513 6456 tablet_bootstrap.cc:492] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:05.286733 6456 ts_tablet_manager.cc:1403] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.001s
I20260923 19:50:05.287531 6456 raft_consensus.cc:359] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.287694 6454 tablet_bootstrap.cc:492] T 8db0358af7634911820f99fe16605ca7 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:05.282608 6458 rpcz_store.cc:276] 0923 19:50:00.707358 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:00.707990 (+ 632us) service_pool.cc:224] Handling call
0923 19:50:05.257441 (+4549451us) ts_tablet_manager.cc:1151] Deleting tablet c52da04e5fe0454ea76bf4d99a930fd7
0923 19:50:05.257451 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.272933 (+ 15482us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.280495 (+ 7562us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.281999 (+ 1504us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4545656}
I20260923 19:50:05.287798 6456 raft_consensus.cc:385] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:05.287906 6456 raft_consensus.cc:740] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:05.288167 6456 consensus_queue.cc:260] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.288268 6454 ts_tablet_manager.cc:1403] T 8db0358af7634911820f99fe16605ca7 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.643s user 0.009s sys 0.020s
I20260923 19:50:05.288615 6457 tablet_bootstrap.cc:492] T f2d9f1a0fae849ae8083eba082055fe9 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:05.289168 6454 raft_consensus.cc:359] T 8db0358af7634911820f99fe16605ca7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.289337 6454 raft_consensus.cc:385] T 8db0358af7634911820f99fe16605ca7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:05.289417 6454 raft_consensus.cc:740] T 8db0358af7634911820f99fe16605ca7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:05.289640 6454 consensus_queue.cc:260] T 8db0358af7634911820f99fe16605ca7 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.290180 6456 ts_tablet_manager.cc:1434] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260923 19:50:05.290174 6454 ts_tablet_manager.cc:1434] T 8db0358af7634911820f99fe16605ca7 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:05.290346 6457 tablet_bootstrap.cc:654] T f2d9f1a0fae849ae8083eba082055fe9 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:05.290453 6454 tablet_bootstrap.cc:492] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:05.290463 6456 tablet_bootstrap.cc:492] T 5455beff354a4616a68d8746e3e4f9a8 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:05.291493 6058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2762648045b4378bcc2c1234460c352" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:05.291693 6058 raft_consensus.cc:2468] T b2762648045b4378bcc2c1234460c352 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:05.292171 6456 tablet_bootstrap.cc:654] T 5455beff354a4616a68d8746e3e4f9a8 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:05.292265 6454 tablet_bootstrap.cc:654] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:05.295086 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e8b8e638ec438a86f05fa147cdb27c" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:05.295251 6459 ts_tablet_manager.cc:1929] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:05.295390 6459 log.cc:1199] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/4dbc0e17d77140f6abe9ee26c8ec13ee
I20260923 19:50:05.295591 6279 leader_election.cc:304] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:05.295754 6459 ts_tablet_manager.cc:1950] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:05.296330 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet c52da04e5fe0454ea76bf4d99a930fd7 (table default.Table_504bdbe9702948d58b4f958360a2040b [id=ca73f0867b5d49cfb0bb7cd2315c47f2]) successfully deleted
I20260923 19:50:05.295871 6728 raft_consensus.cc:2804] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:05.296485 6728 raft_consensus.cc:493] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:05.283151 6057 raft_consensus.cc:2468] T f302f91c8ef44237b1c9909d88dacbff P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:05.296571 6728 raft_consensus.cc:3060] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:05.296628 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 208) took 2630 ms. Trace:
I20260923 19:50:05.296711 6459 rpcz_store.cc:276] 0923 19:50:02.666573 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:02.666636 (+ 63us) service_pool.cc:224] Handling call
0923 19:50:05.074420 (+2407784us) ts_tablet_manager.cc:1151] Deleting tablet 4dbc0e17d77140f6abe9ee26c8ec13ee
0923 19:50:05.074432 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.237514 (+163082us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.295163 (+ 57649us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.296556 (+ 1393us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2407387}
I20260923 19:50:05.297206 6459 tablet_replica.cc:333] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:05.297434 6279 leader_election.cc:304] T f302f91c8ef44237b1c9909d88dacbff P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:05.297665 6459 raft_consensus.cc:2243] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:05.297732 6814 raft_consensus.cc:2804] T f302f91c8ef44237b1c9909d88dacbff P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:05.297847 6814 raft_consensus.cc:493] T f302f91c8ef44237b1c9909d88dacbff P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:05.297973 6814 raft_consensus.cc:3060] T f302f91c8ef44237b1c9909d88dacbff P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:05.297996 6459 pending_rounds.cc:70] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:05.298053 6459 pending_rounds.cc:77] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630542381936640 op_type: NO_OP noop_request { }
I20260923 19:50:05.298161 6459 raft_consensus.cc:2889] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:05.298259 6459 raft_consensus.cc:2272] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:05.298808 6459 ts_tablet_manager.cc:1916] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:05.299609 6728 raft_consensus.cc:515] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.300292 6728 leader_election.cc:290] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:05.295744 6458 tablet_replica.cc:333] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:05.300593 6458 raft_consensus.cc:2243] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:05.300765 6458 raft_consensus.cc:2272] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:05.300861 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2762648045b4378bcc2c1234460c352" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:05.300907 6814 raft_consensus.cc:515] T f302f91c8ef44237b1c9909d88dacbff P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.301277 6458 ts_tablet_manager.cc:1916] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:05.301606 6280 leader_election.cc:343] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:05.301760 6814 leader_election.cc:290] T f302f91c8ef44237b1c9909d88dacbff P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:05.301993 6728 raft_consensus.cc:493] T b7f372b952804ac58e602998d9b77d72 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:05.302199 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f302f91c8ef44237b1c9909d88dacbff" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:05.302165 6728 raft_consensus.cc:515] T b7f372b952804ac58e602998d9b77d72 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.302878 6728 leader_election.cc:290] T b7f372b952804ac58e602998d9b77d72 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:05.302981 6280 leader_election.cc:343] T f302f91c8ef44237b1c9909d88dacbff P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:05.303471 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f372b952804ac58e602998d9b77d72" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:05.303982 6280 leader_election.cc:343] T b7f372b952804ac58e602998d9b77d72 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:05.306044 5996 leader_election.cc:304] T a1e8b8e638ec438a86f05fa147cdb27c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:05.309754 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 4dbc0e17d77140f6abe9ee26c8ec13ee (table default.Table_701c81d7fd4844f09fc1ccc28f0eda9c [id=67292e21e6b546298c5d629c6ebcb718]) successfully deleted
I20260923 19:50:05.311582 6825 raft_consensus.cc:493] T 3190d18f00234d71b0a58c2c334ef45f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:05.312108 6773 raft_consensus.cc:2804] T a1e8b8e638ec438a86f05fa147cdb27c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260923 19:50:05.312755 5995 leader_election.cc:343] T a1e8b8e638ec438a86f05fa147cdb27c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:05.318012 6773 raft_consensus.cc:493] T a1e8b8e638ec438a86f05fa147cdb27c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:05.326361 6825 raft_consensus.cc:515] T 3190d18f00234d71b0a58c2c334ef45f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.327421 5798 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:59912 (request call id 420) took 1144 ms. Trace:
I20260923 19:50:05.327512 5800 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:59912 (request call id 421) took 1144 ms. Trace:
I20260923 19:50:05.328240 5805 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:59912 (request call id 417) took 1146 ms. Trace:
I20260923 19:50:05.328328 5805 rpcz_store.cc:276] 0923 19:50:04.181273 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:04.181326 (+ 53us) service_pool.cc:224] Handling call
0923 19:50:04.197013 (+ 15687us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x616000022954. stack: 00007f7983c95366 00007f7983c95120 00007f7982c9f34d 00000000009a4cb4 00000000009a4c7d 00007f799320f65d 00007f799320f753 00007f798fd8cdb1 00007f7997b7bacd 00007f7997d0aef3 00007f798e6dbd16 00007f798e6dba45 00007f798addf63e 00007f798adde51e 00007f798ade4758 00007f798ade50bf
0923 19:50:04.270514 (+ 73501us) catalog_manager.cc:2140] Acquired catalog manager lock
0923 19:50:04.270965 (+ 451us) catalog_manager.cc:2186] Created new table and tablet info
0923 19:50:05.328026 (+1057061us) catalog_manager.cc:2246] Wrote table and tablets to system table
0923 19:50:05.328110 (+ 84us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0923 19:50:05.328183 (+ 73us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0923 19:50:04.927216 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0923 19:50:04.927307 (+ 91us) write_op.cc:432] Acquiring schema lock in shared mode
0923 19:50:04.927312 (+ 5us) write_op.cc:435] Acquired schema lock
0923 19:50:04.927315 (+ 3us) tablet.cc:662] Decoding operations
0923 19:50:04.927390 (+ 75us) write_op.cc:620] Acquiring the partition lock for write op
0923 19:50:04.927401 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0923 19:50:04.927407 (+ 6us) tablet.cc:685] Acquiring locks for 2 operations
0923 19:50:04.927480 (+ 73us) tablet.cc:701] Row locks acquired
0923 19:50:04.927484 (+ 4us) write_op.cc:260] PREPARE: finished
0923 19:50:04.927515 (+ 31us) write_op.cc:270] Start()
0923 19:50:04.927542 (+ 27us) write_op.cc:276] Timestamp: P: 1790193004927472 usec, L: 0
0923 19:50:04.927548 (+ 6us) op_driver.cc:348] REPLICATION: starting
0923 19:50:04.927695 (+ 147us) log.cc:844] Serialized 433 byte log entry
0923 19:50:05.324860 (+397165us) op_driver.cc:464] REPLICATION: finished
0923 19:50:05.326604 (+ 1744us) write_op.cc:301] APPLY: starting
0923 19:50:05.326614 (+ 10us) tablet.cc:1394] starting BulkCheckPresence
0923 19:50:05.326642 (+ 28us) tablet.cc:1397] finished BulkCheckPresence
0923 19:50:05.326663 (+ 21us) tablet.cc:1399] starting ApplyRowOperation cycle
0923 19:50:05.326749 (+ 86us) tablet.cc:1410] finished ApplyRowOperation cycle
0923 19:50:05.326779 (+ 30us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0923 19:50:05.326786 (+ 7us) write_op.cc:312] APPLY: finished
0923 19:50:05.326840 (+ 54us) log.cc:844] Serialized 29 byte log entry
0923 19:50:05.326890 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0923 19:50:05.326907 (+ 17us) write_op.cc:454] Released schema lock
0923 19:50:05.326915 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":35441536,"child_traces":[["op",{"apply.queue_time_us":1700,"apply.run_cpu_time_us":364,"apply.run_wall_time_us":364,"num_ops":2,"prepare.queue_time_us":655886,"prepare.run_cpu_time_us":537,"prepare.run_wall_time_us":537,"replication_time_us":397278,"threads_started":1}]]}
I20260923 19:50:05.329187 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3190d18f00234d71b0a58c2c334ef45f" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:05.327585 5798 rpcz_store.cc:276] 0923 19:50:04.183291 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:04.183430 (+ 139us) service_pool.cc:224] Handling call
0923 19:50:04.194820 (+ 11390us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x616000022954. stack: 00007f7983c95366 00007f7983c95120 00007f7982c9f34d 00000000009a4cb4 00000000009a4c7d 00007f799320f65d 00007f799320f753 00007f798fd8cdb1 00007f7997b7bacd 00007f7997d0aef3 00007f798e6dbd16 00007f798e6dba45 00007f798addf63e 00007f798adde51e 00007f798ade4758 00007f798ade50bf
0923 19:50:04.269350 (+ 74530us) catalog_manager.cc:2140] Acquired catalog manager lock
0923 19:50:04.269796 (+ 446us) catalog_manager.cc:2186] Created new table and tablet info
0923 19:50:05.327119 (+1057323us) catalog_manager.cc:2246] Wrote table and tablets to system table
0923 19:50:05.327238 (+ 119us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0923 19:50:05.327347 (+ 109us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0923 19:50:04.926605 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0923 19:50:04.926700 (+ 95us) write_op.cc:432] Acquiring schema lock in shared mode
0923 19:50:04.926704 (+ 4us) write_op.cc:435] Acquired schema lock
0923 19:50:04.926707 (+ 3us) tablet.cc:662] Decoding operations
0923 19:50:04.926787 (+ 80us) write_op.cc:620] Acquiring the partition lock for write op
0923 19:50:04.926797 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0923 19:50:04.926803 (+ 6us) tablet.cc:685] Acquiring locks for 2 operations
0923 19:50:04.926880 (+ 77us) tablet.cc:701] Row locks acquired
0923 19:50:04.926882 (+ 2us) write_op.cc:260] PREPARE: finished
0923 19:50:04.926913 (+ 31us) write_op.cc:270] Start()
0923 19:50:04.926938 (+ 25us) write_op.cc:276] Timestamp: P: 1790193004926870 usec, L: 0
0923 19:50:04.926941 (+ 3us) op_driver.cc:348] REPLICATION: starting
0923 19:50:04.927081 (+ 140us) log.cc:844] Serialized 433 byte log entry
0923 19:50:05.312002 (+384921us) op_driver.cc:464] REPLICATION: finished
0923 19:50:05.326128 (+ 14126us) write_op.cc:301] APPLY: starting
0923 19:50:05.326144 (+ 16us) tablet.cc:1394] starting BulkCheckPresence
0923 19:50:05.326192 (+ 48us) tablet.cc:1397] finished BulkCheckPresence
0923 19:50:05.326231 (+ 39us) tablet.cc:1399] starting ApplyRowOperation cycle
0923 19:50:05.326391 (+ 160us) tablet.cc:1410] finished ApplyRowOperation cycle
0923 19:50:05.326422 (+ 31us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0923 19:50:05.326430 (+ 8us) write_op.cc:312] APPLY: finished
0923 19:50:05.326514 (+ 84us) log.cc:844] Serialized 29 byte log entry
0923 19:50:05.326564 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0923 19:50:05.326724 (+ 160us) write_op.cc:454] Released schema lock
0923 19:50:05.326731 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0923 19:50:05.326811 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0923 19:50:05.326815 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":25663232,"child_traces":[["op",{"apply.queue_time_us":14046,"apply.run_cpu_time_us":569,"apply.run_wall_time_us":682,"num_ops":2,"prepare.queue_time_us":656341,"prepare.run_cpu_time_us":538,"prepare.run_wall_time_us":537,"replication_time_us":385048}]]}
I20260923 19:50:05.327612 5800 rpcz_store.cc:276] 0923 19:50:04.183408 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:04.183626 (+ 218us) service_pool.cc:224] Handling call
0923 19:50:04.195641 (+ 12015us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x616000022954. stack: 00007f7983c95366 00007f7983c95120 00007f7982c9f34d 00000000009a4cb4 00000000009a4c7d 00007f799320f65d 00007f799320f753 00007f798fd8cdb1 00007f7997b7bacd 00007f7997d0aef3 00007f798e6dbd16 00007f798e6dba45 00007f798addf63e 00007f798adde51e 00007f798ade4758 00007f798ade50bf
0923 19:50:04.266832 (+ 71191us) catalog_manager.cc:2140] Acquired catalog manager lock
0923 19:50:04.267461 (+ 629us) catalog_manager.cc:2186] Created new table and tablet info
0923 19:50:05.327317 (+1059856us) catalog_manager.cc:2246] Wrote table and tablets to system table
0923 19:50:05.327392 (+ 75us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0923 19:50:05.327465 (+ 73us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0923 19:50:04.925954 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0923 19:50:04.926070 (+ 116us) write_op.cc:432] Acquiring schema lock in shared mode
0923 19:50:04.926076 (+ 6us) write_op.cc:435] Acquired schema lock
0923 19:50:04.926080 (+ 4us) tablet.cc:662] Decoding operations
0923 19:50:04.926185 (+ 105us) write_op.cc:620] Acquiring the partition lock for write op
0923 19:50:04.926193 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0923 19:50:04.926197 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0923 19:50:04.926270 (+ 73us) tablet.cc:701] Row locks acquired
0923 19:50:04.926273 (+ 3us) write_op.cc:260] PREPARE: finished
0923 19:50:04.926303 (+ 30us) write_op.cc:270] Start()
0923 19:50:04.926333 (+ 30us) write_op.cc:276] Timestamp: P: 1790193004926260 usec, L: 0
0923 19:50:04.926338 (+ 5us) op_driver.cc:348] REPLICATION: starting
0923 19:50:04.926489 (+ 151us) log.cc:844] Serialized 433 byte log entry
0923 19:50:05.311930 (+385441us) op_driver.cc:464] REPLICATION: finished
0923 19:50:05.325960 (+ 14030us) write_op.cc:301] APPLY: starting
0923 19:50:05.325980 (+ 20us) tablet.cc:1394] starting BulkCheckPresence
0923 19:50:05.326028 (+ 48us) tablet.cc:1397] finished BulkCheckPresence
0923 19:50:05.326064 (+ 36us) tablet.cc:1399] starting ApplyRowOperation cycle
0923 19:50:05.326208 (+ 144us) tablet.cc:1410] finished ApplyRowOperation cycle
0923 19:50:05.326250 (+ 42us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0923 19:50:05.326258 (+ 8us) write_op.cc:312] APPLY: finished
0923 19:50:05.326352 (+ 94us) log.cc:844] Serialized 29 byte log entry
0923 19:50:05.326425 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0923 19:50:05.326446 (+ 21us) write_op.cc:454] Released schema lock
0923 19:50:05.326453 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0923 19:50:05.326531 (+ 78us) write_op.cc:489] Releasing partition, row and schema locks
0923 19:50:05.326534 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":26974336,"child_traces":[["op",{"apply.queue_time_us":13911,"apply.run_cpu_time_us":571,"apply.run_wall_time_us":571,"num_ops":2,"prepare.queue_time_us":657849,"prepare.run_cpu_time_us":597,"prepare.run_wall_time_us":596,"replication_time_us":385558}]]}
I20260923 19:50:05.329844 6461 ts_tablet_manager.cc:1929] T 033c2d772c8a44d2a0e671664bb9085d P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:05.332862 6458 ts_tablet_manager.cc:1929] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:05.332808 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3190d18f00234d71b0a58c2c334ef45f" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:05.333006 6458 log.cc:1199] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/cc3b6d245c3e40cdabb20d7dcf07ec0e
I20260923 19:50:05.333459 6458 ts_tablet_manager.cc:1950] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:05.334506 6773 raft_consensus.cc:3060] T a1e8b8e638ec438a86f05fa147cdb27c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:05.334575 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f372b952804ac58e602998d9b77d72" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:05.335758 6825 leader_election.cc:290] T 3190d18f00234d71b0a58c2c334ef45f P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:05.338961 6827 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "83e97b26500048d0b75350a21a8ff96b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } } }
I20260923 19:50:05.339272 6827 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [sys.catalog]: This master's current role is: LEADER
I20260923 19:50:05.339656 5799 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:59912 (request call id 418) took 1155 ms. Trace:
I20260923 19:50:05.341619 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 109) took 4625 ms. Trace:
I20260923 19:50:05.341750 6458 rpcz_store.cc:276] 0923 19:50:00.715920 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:00.715970 (+ 50us) service_pool.cc:224] Handling call
0923 19:50:05.295645 (+4579675us) ts_tablet_manager.cc:1151] Deleting tablet cc3b6d245c3e40cdabb20d7dcf07ec0e
0923 19:50:05.295657 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.329360 (+ 33703us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.332766 (+ 3406us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.341576 (+ 8810us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4579477}
I20260923 19:50:05.343048 6057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2762648045b4378bcc2c1234460c352" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:05.343231 6057 raft_consensus.cc:3060] T b2762648045b4378bcc2c1234460c352 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:05.343819 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 118) took 4291 ms. Trace:
I20260923 19:50:05.343950 6458 rpcz_store.cc:276] 0923 19:50:01.050497 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:01.051082 (+ 585us) service_pool.cc:224] Handling call
0923 19:50:05.342057 (+4290975us) ts_tablet_manager.cc:1151] Deleting tablet 4750e2a1b24e4bc7aafa4cd36afebbbd
0923 19:50:05.342068 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.342175 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4211453}
I20260923 19:50:05.344592 6458 tablet_replica.cc:333] T a1e8b8e638ec438a86f05fa147cdb27c P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:05.344698 6180 tablet_service.cc:1558] Processing DeleteTablet for tablet 77f111a495f3429cb243417824095d02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:05.344808 6458 raft_consensus.cc:2243] T a1e8b8e638ec438a86f05fa147cdb27c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:05.345001 6458 raft_consensus.cc:2272] T a1e8b8e638ec438a86f05fa147cdb27c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:05.345333 6058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f302f91c8ef44237b1c9909d88dacbff" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:05.345521 6058 raft_consensus.cc:3060] T f302f91c8ef44237b1c9909d88dacbff P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:05.345559 6458 ts_tablet_manager.cc:1916] T a1e8b8e638ec438a86f05fa147cdb27c P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:05.345548 5803 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_ccd00f21243a43deb385f4673958f88c [id=019ceccbcb1041cc9e5625274c45a0f3] alter complete (version 2)
I20260923 19:50:05.347031 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_cbf3c92cd0434d1d9d664d8af53e425e" } new_table_name: "default.Table_5c35e08897f74660ad23df9a2c751741" modify_external_catalogs: true
W20260923 19:50:05.350119 5996 consensus_peers.cc:597] T 87afbdb11c6e4e58affd2f2d7995e1f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 -> Peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Couldn't send request to peer 2bf41435f70447f19992d368ca6b46bd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 87afbdb11c6e4e58affd2f2d7995e1f8. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:05.350929 6029 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56924 (request call id 280) took 1139 ms. Trace:
I20260923 19:50:05.352684 6461 log.cc:1199] T 033c2d772c8a44d2a0e671664bb9085d P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/033c2d772c8a44d2a0e671664bb9085d
W20260923 19:50:05.353035 5802 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 601a0ff319cc4c9a898d52bbcb19184b consensus state has no leader
I20260923 19:50:05.353086 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_9927b4fde83442bda0a1c9737a8b239f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:05.354156 5802 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:59912 (request call id 424) took 1136 ms. Trace:
W20260923 19:50:05.354460 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9927b4fde83442bda0a1c9737a8b239f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:05.353452 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_1a74b652ec7a4165b28643c452000d6d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:05.355737 5803 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_24178fa82e3c4d878ed35fe32867eb98" } modify_external_catalogs: true
I20260923 19:50:05.355890 5803 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_24178fa82e3c4d878ed35fe32867eb98" } modify_external_catalogs: true
I20260923 19:50:05.355324 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_53cf6ab2721c4d7baa36065c8d48ffc1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:05.358140 6658 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" instance_seqno: 1790192996897020) as {username='slave'} at 127.5.143.194:60149; Asking this server to re-register.
I20260923 19:50:05.353549 5799 rpcz_store.cc:276] 0923 19:50:04.182750 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:04.182816 (+ 66us) service_pool.cc:224] Handling call
0923 19:50:04.191210 (+ 8394us) spinlock_profiling.cc:243] Waited 8.09 ms on lock 0x616000022954. stack: 00007f7983c95366 00007f7983c95120 00007f7982c9f34d 00000000009a4cb4 00000000009a4c7d 00007f799320f65d 00007f799320f753 00007f798fd8cdb1 00007f7997b7bacd 00007f7997d0aef3 00007f798e6dbd16 00007f798e6dba45 00007f798addf63e 00007f798adde51e 00007f798ade4758 00007f798ade50bf
0923 19:50:04.267272 (+ 76062us) catalog_manager.cc:2140] Acquired catalog manager lock
0923 19:50:04.268363 (+ 1091us) catalog_manager.cc:2186] Created new table and tablet info
0923 19:50:05.338272 (+1069909us) catalog_manager.cc:2246] Wrote table and tablets to system table
0923 19:50:05.338389 (+ 117us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0923 19:50:05.338477 (+ 88us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0923 19:50:04.927773 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0923 19:50:04.927884 (+ 111us) write_op.cc:432] Acquiring schema lock in shared mode
0923 19:50:04.927891 (+ 7us) write_op.cc:435] Acquired schema lock
0923 19:50:04.927893 (+ 2us) tablet.cc:662] Decoding operations
0923 19:50:04.927968 (+ 75us) write_op.cc:620] Acquiring the partition lock for write op
0923 19:50:04.927979 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0923 19:50:04.927983 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0923 19:50:04.928049 (+ 66us) tablet.cc:701] Row locks acquired
0923 19:50:04.928053 (+ 4us) write_op.cc:260] PREPARE: finished
0923 19:50:04.928083 (+ 30us) write_op.cc:270] Start()
0923 19:50:04.928110 (+ 27us) write_op.cc:276] Timestamp: P: 1790193004928041 usec, L: 0
0923 19:50:04.928115 (+ 5us) op_driver.cc:348] REPLICATION: starting
0923 19:50:04.928263 (+ 148us) log.cc:844] Serialized 433 byte log entry
0923 19:50:05.336963 (+408700us) op_driver.cc:464] REPLICATION: finished
0923 19:50:05.337197 (+ 234us) write_op.cc:301] APPLY: starting
0923 19:50:05.337212 (+ 15us) tablet.cc:1394] starting BulkCheckPresence
0923 19:50:05.337250 (+ 38us) tablet.cc:1397] finished BulkCheckPresence
0923 19:50:05.337284 (+ 34us) tablet.cc:1399] starting ApplyRowOperation cycle
0923 19:50:05.337412 (+ 128us) tablet.cc:1410] finished ApplyRowOperation cycle
0923 19:50:05.337453 (+ 41us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0923 19:50:05.337463 (+ 10us) write_op.cc:312] APPLY: finished
0923 19:50:05.337554 (+ 91us) log.cc:844] Serialized 29 byte log entry
0923 19:50:05.337619 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0923 19:50:05.337635 (+ 16us) write_op.cc:454] Released schema lock
0923 19:50:05.337641 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0923 19:50:05.337710 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0923 19:50:05.337714 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":18610816,"child_traces":[["op",{"apply.queue_time_us":156,"apply.run_cpu_time_us":522,"apply.run_wall_time_us":523,"num_ops":2,"prepare.queue_time_us":655871,"prepare.run_cpu_time_us":548,"prepare.run_wall_time_us":548,"replication_time_us":408816}]]}
I20260923 19:50:05.359650 6842 catalog_manager.cc:1623] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562: acquiring CA information for follower catalog manager: success
I20260923 19:50:05.360213 6248 heartbeater.cc:461] Registering TS with master...
I20260923 19:50:05.362334 6658 ts_manager.cc:194] Registered new tserver with Master: 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:05.363363 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet cc3b6d245c3e40cdabb20d7dcf07ec0e (table default.Table_41c4d80198a246a78955ae6ab79f3532 [id=da91b06e11c64bb0aaec37a0188b5586]) successfully deleted
I20260923 19:50:05.354262 5802 rpcz_store.cc:276] 0923 19:50:04.216613 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:04.221319 (+ 4706us) service_pool.cc:224] Handling call
0923 19:50:04.738293 (+516974us) spinlock_profiling.cc:243] Waited 30.2 ms on lock 0x616000022954. stack: 00007f7983c95366 00007f7983c95120 00007f7982c9f34d 00000000009a4cb4 00000000009a4c7d 00007f799320f65d 00007f799320f753 00007f798fd8cdb1 00007f7997b7bacd 00007f7997d0d186 00007f798e6df696 00007f798e6df3c5 00007f798addf63e 00007f798adde51e 00007f798ade4758 00007f798ade50bf
0923 19:50:04.738654 (+ 361us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0923 19:50:04.738860 (+ 206us) catalog_manager.cc:3764] Apply alter schema
0923 19:50:04.739073 (+ 213us) catalog_manager.cc:3796] Acquired catalog manager lock
0923 19:50:04.739302 (+ 229us) catalog_manager.cc:3954] Updating metadata on disk
0923 19:50:05.339530 (+600228us) catalog_manager.cc:3985] Committing alterations to in-memory state
0923 19:50:05.353194 (+ 13664us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0923 19:50:04.928363 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0923 19:50:04.928457 (+ 94us) write_op.cc:432] Acquiring schema lock in shared mode
0923 19:50:04.928461 (+ 4us) write_op.cc:435] Acquired schema lock
0923 19:50:04.928465 (+ 4us) tablet.cc:662] Decoding operations
0923 19:50:04.928553 (+ 88us) write_op.cc:620] Acquiring the partition lock for write op
0923 19:50:04.928564 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0923 19:50:04.928580 (+ 16us) tablet.cc:685] Acquiring locks for 1 operations
0923 19:50:04.928632 (+ 52us) tablet.cc:701] Row locks acquired
0923 19:50:04.928634 (+ 2us) write_op.cc:260] PREPARE: finished
0923 19:50:04.928658 (+ 24us) write_op.cc:270] Start()
0923 19:50:04.928683 (+ 25us) write_op.cc:276] Timestamp: P: 1790193004928617 usec, L: 0
0923 19:50:04.928688 (+ 5us) op_driver.cc:348] REPLICATION: starting
0923 19:50:05.092943 (+164255us) log.cc:844] Serialized 405 byte log entry
0923 19:50:05.337043 (+244100us) op_driver.cc:464] REPLICATION: finished
0923 19:50:05.337547 (+ 504us) write_op.cc:301] APPLY: starting
0923 19:50:05.337562 (+ 15us) tablet.cc:1394] starting BulkCheckPresence
0923 19:50:05.337593 (+ 31us) tablet.cc:1397] finished BulkCheckPresence
0923 19:50:05.337628 (+ 35us) tablet.cc:1399] starting ApplyRowOperation cycle
0923 19:50:05.337668 (+ 40us) tablet.cc:1410] finished ApplyRowOperation cycle
0923 19:50:05.337703 (+ 35us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0923 19:50:05.337715 (+ 12us) write_op.cc:312] APPLY: finished
0923 19:50:05.337777 (+ 62us) log.cc:844] Serialized 23 byte log entry
0923 19:50:05.337827 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0923 19:50:05.337840 (+ 13us) write_op.cc:454] Released schema lock
0923 19:50:05.337846 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0923 19:50:05.337936 (+ 90us) write_op.cc:489] Releasing partition, row and schema locks
0923 19:50:05.337940 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":69530880,"child_traces":[["op",{"apply.queue_time_us":467,"apply.run_cpu_time_us":383,"apply.run_wall_time_us":383,"num_ops":1,"prepare.queue_time_us":188528,"prepare.run_cpu_time_us":800,"prepare.run_wall_time_us":164734,"raft.queue_time_us":61,"raft.run_cpu_time_us":483,"raft.run_wall_time_us":483,"replication_time_us":408329}]]}
I20260923 19:50:05.364046 6842 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260923 19:50:05.363668 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 4750e2a1b24e4bc7aafa4cd36afebbbd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4750e2a1b24e4bc7aafa4cd36afebbbd already in progress: creating tablet
W20260923 19:50:05.366211 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a74b652ec7a4165b28643c452000d6d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:05.367391 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet 8db0358af7634911820f99fe16605ca7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:00 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:05.367669 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet e1752d6b46894796bdc94e6230e3327d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:05.367722 6459 ts_tablet_manager.cc:1929] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:05.367875 6459 log.cc:1199] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/8a2fbac8080441d4a9e03ff1d580bc8e
I20260923 19:50:05.368214 6458 ts_tablet_manager.cc:1929] T a1e8b8e638ec438a86f05fa147cdb27c P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:05.368172 6324 tablet_service.cc:1511] Processing CreateTablet for tablet fc151f4d78344efeada6d6e57af6eb9f (DEFAULT_TABLE table=default.Table_c4d3bcab16044711b665673ef8cfa646 [id=22bf03cd65ab4346af756b244875c007]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.368288 6459 ts_tablet_manager.cc:1950] T 8a2fbac8080441d4a9e03ff1d580bc8e P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:05.368353 6458 log.cc:1199] T a1e8b8e638ec438a86f05fa147cdb27c P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/a1e8b8e638ec438a86f05fa147cdb27c
I20260923 19:50:05.368664 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc151f4d78344efeada6d6e57af6eb9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.368693 6458 ts_tablet_manager.cc:1950] T a1e8b8e638ec438a86f05fa147cdb27c P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:05.369211 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 210) took 2498 ms. Trace:
I20260923 19:50:05.369302 6459 rpcz_store.cc:276] 0923 19:50:02.870999 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:02.871069 (+ 70us) service_pool.cc:224] Handling call
0923 19:50:05.297128 (+2426059us) ts_tablet_manager.cc:1151] Deleting tablet 8a2fbac8080441d4a9e03ff1d580bc8e
0923 19:50:05.297137 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.337786 (+ 40649us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.367627 (+ 29841us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.369154 (+ 1527us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2425678}
I20260923 19:50:05.372207 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 115) took 4322 ms. Trace:
I20260923 19:50:05.372304 6458 rpcz_store.cc:276] 0923 19:50:01.050111 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:01.061317 (+ 11206us) service_pool.cc:224] Handling call
0923 19:50:05.344519 (+4283202us) ts_tablet_manager.cc:1151] Deleting tablet a1e8b8e638ec438a86f05fa147cdb27c
0923 19:50:05.344529 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.361087 (+ 16558us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.368127 (+ 7040us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.372135 (+ 4008us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4201587}
I20260923 19:50:05.372689 6458 tablet_replica.cc:333] T f2d9f1a0fae849ae8083eba082055fe9 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:05.372925 6458 raft_consensus.cc:2243] T f2d9f1a0fae849ae8083eba082055fe9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:05.373155 6458 raft_consensus.cc:2272] T f2d9f1a0fae849ae8083eba082055fe9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:05.373746 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 211) took 2266 ms. Trace:
I20260923 19:50:05.373840 6459 rpcz_store.cc:276] 0923 19:50:03.107420 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.107481 (+ 61us) service_pool.cc:224] Handling call
0923 19:50:05.373552 (+2266071us) ts_tablet_manager.cc:1151] Deleting tablet 15c0dc02ba964af38ca9f76161722588
0923 19:50:05.373563 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.373690 (+ 127us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2221176}
I20260923 19:50:05.375419 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet a1e8b8e638ec438a86f05fa147cdb27c (table default.Table_abe1e48d70954781b8e1ca09411789d4 [id=cc4f14506e3d44649b2795f866ab8618]) successfully deleted
I20260923 19:50:05.373837 6458 ts_tablet_manager.cc:1916] T f2d9f1a0fae849ae8083eba082055fe9 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:05.378842 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 217) took 2222 ms. Trace:
I20260923 19:50:05.379449 6459 rpcz_store.cc:276] 0923 19:50:03.156141 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.158977 (+ 2836us) service_pool.cc:224] Handling call
0923 19:50:05.378606 (+2219629us) ts_tablet_manager.cc:1151] Deleting tablet d2298d814a104f5cb62196be3bf0dae6
0923 19:50:05.378623 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.378773 (+ 150us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2219429}
W20260923 19:50:05.379670 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_53cf6ab2721c4d7baa36065c8d48ffc1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:05.380206 6311 tablet_service.cc:1511] Processing CreateTablet for tablet e6e04d16675443fc923a5f8216e292b6 (DEFAULT_TABLE table=default.Table_036527853b5f467ab42e956cc35b2081 [id=5c206f48fb1a4be587f17803f654ce5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.380604 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 216) took 2224 ms. Trace:
I20260923 19:50:05.380628 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6e04d16675443fc923a5f8216e292b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.381000 6459 rpcz_store.cc:276] 0923 19:50:03.155979 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.158946 (+ 2967us) service_pool.cc:224] Handling call
0923 19:50:05.380449 (+2221503us) ts_tablet_manager.cc:1151] Deleting tablet b302820d329a41f0a9a54501c079fcd7
0923 19:50:05.380459 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.380552 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2220722}
I20260923 19:50:05.381807 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 215) took 2225 ms. Trace:
I20260923 19:50:05.382263 6459 rpcz_store.cc:276] 0923 19:50:03.155847 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.176573 (+ 20726us) service_pool.cc:224] Handling call
0923 19:50:05.381642 (+2205069us) ts_tablet_manager.cc:1151] Deleting tablet 3919b15a00eb4fb08008f065f556c760
0923 19:50:05.381650 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.381758 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2204820}
I20260923 19:50:05.383257 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 222) took 2196 ms. Trace:
I20260923 19:50:05.383790 6319 tablet_service.cc:1511] Processing CreateTablet for tablet 684eb2576b4b4730813b993e36b242df (DEFAULT_TABLE table=default.Table_af4eb1297d19460fade71cf33df073a4 [id=9673e7b97bef46628623a1926735866e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.384169 6319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 684eb2576b4b4730813b993e36b242df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.384441 6459 rpcz_store.cc:276] 0923 19:50:03.186745 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.186804 (+ 59us) service_pool.cc:224] Handling call
0923 19:50:05.383084 (+2196280us) ts_tablet_manager.cc:1151] Deleting tablet e071b9dd1db44af0a9d1b9e904f875a5
0923 19:50:05.383096 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.383197 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2195617}
I20260923 19:50:05.385107 6459 tablet_replica.cc:333] T 32c8333073574fe79bfc3e33f3249256 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:05.385295 6459 raft_consensus.cc:2243] T 32c8333073574fe79bfc3e33f3249256 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:05.385483 6459 raft_consensus.cc:2272] T 32c8333073574fe79bfc3e33f3249256 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:05.386221 6306 tablet_service.cc:1511] Processing CreateTablet for tablet 528fca12bfe04747830ad1d3bb323676 (DEFAULT_TABLE table=default.Table_141fc144025e434aa7d7a6e0ecb9c98d [id=f4622a8ebb6644cba5c5c4d18a9a22f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.386199 6180 tablet_service.cc:1511] Processing CreateTablet for tablet fc151f4d78344efeada6d6e57af6eb9f (DEFAULT_TABLE table=default.Table_c4d3bcab16044711b665673ef8cfa646 [id=22bf03cd65ab4346af756b244875c007]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.386574 6306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 528fca12bfe04747830ad1d3bb323676. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.386708 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc151f4d78344efeada6d6e57af6eb9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.386744 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 8a2fbac8080441d4a9e03ff1d580bc8e (table default.Table_bd91264aa4a0430eb1a8f69129fb0f3f [id=738ed1d070ef485e9299c1f3b1db008a]) successfully deleted
W20260923 19:50:05.387005 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 15c0dc02ba964af38ca9f76161722588 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15c0dc02ba964af38ca9f76161722588 already in progress: creating tablet
W20260923 19:50:05.387207 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet d2298d814a104f5cb62196be3bf0dae6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2298d814a104f5cb62196be3bf0dae6 already in progress: creating tablet
W20260923 19:50:05.387638 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet b302820d329a41f0a9a54501c079fcd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b302820d329a41f0a9a54501c079fcd7 already in progress: creating tablet
W20260923 19:50:05.387833 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 3919b15a00eb4fb08008f065f556c760 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3919b15a00eb4fb08008f065f556c760 already in progress: creating tablet
W20260923 19:50:05.388027 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet e071b9dd1db44af0a9d1b9e904f875a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e071b9dd1db44af0a9d1b9e904f875a5 already in progress: creating tablet
I20260923 19:50:05.390332 6309 tablet_service.cc:1511] Processing CreateTablet for tablet 0c537304c32c44adaa1e05de4496293f (DEFAULT_TABLE table=default.Table_5febe26a78884634a01aa0ec62f36604 [id=e2a29fc060074c45918b97001dd03207]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.390702 6309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c537304c32c44adaa1e05de4496293f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.394080 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_9d716833c456436cbc514b6a9070c9e1" } modify_external_catalogs: true
I20260923 19:50:05.394233 5801 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_0fabac277720489788ff4ee29635ba66" } modify_external_catalogs: true
I20260923 19:50:05.394282 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_9d716833c456436cbc514b6a9070c9e1" } modify_external_catalogs: true
I20260923 19:50:05.394392 5801 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_0fabac277720489788ff4ee29635ba66" } modify_external_catalogs: true
I20260923 19:50:05.395141 6169 tablet_service.cc:1511] Processing CreateTablet for tablet 554655516bb547ad9c2aa1ee66dc8deb (DEFAULT_TABLE table=default.Table_307ba44a8b0641cdaaa0ef43e10172e1 [id=648700f6ed984eb8942ecfc647e8c725]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.395525 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 554655516bb547ad9c2aa1ee66dc8deb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.395656 6323 tablet_service.cc:1511] Processing CreateTablet for tablet d39a64531dd24eb4aa1f7e0c418b985b (DEFAULT_TABLE table=default.Table_a0d1427301b14afd906023f389ea8b81 [id=a56799b0709846cf8308d7d7b727427c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.396040 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d39a64531dd24eb4aa1f7e0c418b985b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.396528 5799 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet f302f91c8ef44237b1c9909d88dacbff (table default.Table_b623e36133d64d72a070bb99a0b974ee [id=4300ad9818924415b6414ea9f89445ce]). Expected version 2 got 0
I20260923 19:50:05.396731 5799 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet b2762648045b4378bcc2c1234460c352 (table default.Table_f57f8cacbedb49c6be509b51c824b960 [id=ada5cc6ef65b4859bf027fd3af9ad0f2]). Expected version 2 got 0
I20260923 19:50:05.398245 6174 tablet_service.cc:1511] Processing CreateTablet for tablet e6e04d16675443fc923a5f8216e292b6 (DEFAULT_TABLE table=default.Table_036527853b5f467ab42e956cc35b2081 [id=5c206f48fb1a4be587f17803f654ce5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.398344 6458 ts_tablet_manager.cc:1929] T f2d9f1a0fae849ae8083eba082055fe9 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:05.398308 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_b02341c81d754834894152a71d2b3fef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:05.398459 6458 log.cc:1199] T f2d9f1a0fae849ae8083eba082055fe9 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/f2d9f1a0fae849ae8083eba082055fe9
I20260923 19:50:05.398614 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6e04d16675443fc923a5f8216e292b6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:05.398790 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b02341c81d754834894152a71d2b3fef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:05.398869 6458 ts_tablet_manager.cc:1950] T f2d9f1a0fae849ae8083eba082055fe9 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:05.399901 6316 tablet_service.cc:1558] Processing DeleteTablet for tablet b7f372b952804ac58e602998d9b77d72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:05.401616 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 127) took 4172 ms. Trace:
I20260923 19:50:05.402208 6167 tablet_service.cc:1511] Processing CreateTablet for tablet d39a64531dd24eb4aa1f7e0c418b985b (DEFAULT_TABLE table=default.Table_a0d1427301b14afd906023f389ea8b81 [id=a56799b0709846cf8308d7d7b727427c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.402592 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d39a64531dd24eb4aa1f7e0c418b985b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.403223 6458 rpcz_store.cc:276] 0923 19:50:01.229402 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:01.229843 (+ 441us) service_pool.cc:224] Handling call
0923 19:50:05.372596 (+4142753us) ts_tablet_manager.cc:1151] Deleting tablet f2d9f1a0fae849ae8083eba082055fe9
0923 19:50:05.372607 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.381486 (+ 8879us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.397592 (+ 16106us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.401581 (+ 3989us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4142302}
I20260923 19:50:05.404466 6458 tablet_replica.cc:333] T 77f111a495f3429cb243417824095d02 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:05.405418 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet f2d9f1a0fae849ae8083eba082055fe9 (table default.Table_607b21eb9423483daac43c4cb1507962 [id=7252ede56f734ff5b3d3dc7576201183]) successfully deleted
I20260923 19:50:05.405740 6458 raft_consensus.cc:2243] T 77f111a495f3429cb243417824095d02 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:05.405937 6458 raft_consensus.cc:2272] T 77f111a495f3429cb243417824095d02 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:05.406142 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 684eb2576b4b4730813b993e36b242df (DEFAULT_TABLE table=default.Table_af4eb1297d19460fade71cf33df073a4 [id=9673e7b97bef46628623a1926735866e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.406354 6316 tablet_service.cc:1511] Processing CreateTablet for tablet d35ff653bf8d41cfbcf83359402a8f6a (DEFAULT_TABLE table=default.Table_f8ddcdb63fd04bd7b8f2a95e97e449bf [id=3c751273c2a044e09499b3a07044b3db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.406471 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 684eb2576b4b4730813b993e36b242df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.406708 6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d35ff653bf8d41cfbcf83359402a8f6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.410148 6168 tablet_service.cc:1511] Processing CreateTablet for tablet 528fca12bfe04747830ad1d3bb323676 (DEFAULT_TABLE table=default.Table_141fc144025e434aa7d7a6e0ecb9c98d [id=f4622a8ebb6644cba5c5c4d18a9a22f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.410487 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 528fca12bfe04747830ad1d3bb323676. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.411353 6317 tablet_service.cc:1511] Processing CreateTablet for tablet a10d35bf564d45488524d3d21721f4e5 (DEFAULT_TABLE table=default.Table_c670311ee64c4e728677dc29691ea3f9 [id=fa0ce77597ba4d37aca817429efd86b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.411427 6458 ts_tablet_manager.cc:1916] T 77f111a495f3429cb243417824095d02 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:05.414170 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 0c537304c32c44adaa1e05de4496293f (DEFAULT_TABLE table=default.Table_5febe26a78884634a01aa0ec62f36604 [id=e2a29fc060074c45918b97001dd03207]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.414511 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c537304c32c44adaa1e05de4496293f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.417771 6314 tablet_service.cc:1511] Processing CreateTablet for tablet 1c43641327d14a888a2815e49a2762c8 (DEFAULT_TABLE table=default.Table_ceca0c9fd74649909ccd0fd70d2ccca0 [id=923a67e6f6534f4da28ce819cecd9171]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.421729 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a10d35bf564d45488524d3d21721f4e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.423410 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c43641327d14a888a2815e49a2762c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.423588 6164 tablet_service.cc:1511] Processing CreateTablet for tablet d35ff653bf8d41cfbcf83359402a8f6a (DEFAULT_TABLE table=default.Table_f8ddcdb63fd04bd7b8f2a95e97e449bf [id=3c751273c2a044e09499b3a07044b3db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.424124 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d35ff653bf8d41cfbcf83359402a8f6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.426234 6173 tablet_service.cc:1558] Processing DeleteTablet for tablet 8db0358af7634911820f99fe16605ca7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:00 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:05.426669 6176 tablet_service.cc:1511] Processing CreateTablet for tablet a10d35bf564d45488524d3d21721f4e5 (DEFAULT_TABLE table=default.Table_c670311ee64c4e728677dc29691ea3f9 [id=fa0ce77597ba4d37aca817429efd86b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.427009 6176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a10d35bf564d45488524d3d21721f4e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.430243 6165 tablet_service.cc:1511] Processing CreateTablet for tablet 1c43641327d14a888a2815e49a2762c8 (DEFAULT_TABLE table=default.Table_ceca0c9fd74649909ccd0fd70d2ccca0 [id=923a67e6f6534f4da28ce819cecd9171]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.430687 6165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c43641327d14a888a2815e49a2762c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.434161 6179 tablet_service.cc:1511] Processing CreateTablet for tablet e1de117713f34b51bbda0c712f0b837c (DEFAULT_TABLE table=default.Table_9d716833c456436cbc514b6a9070c9e1 [id=e3fafc4359af49c88437fb5815526518]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.434242 6458 ts_tablet_manager.cc:1929] T 77f111a495f3429cb243417824095d02 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:05.434557 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1de117713f34b51bbda0c712f0b837c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:05.444787 5995 leader_election.cc:343] T 3190d18f00234d71b0a58c2c334ef45f P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:05.444993 5995 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 111304us
I20260923 19:50:05.446303 6022 tablet_service.cc:1558] Processing DeleteTablet for tablet a1e8b8e638ec438a86f05fa147cdb27c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:00 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:05.446599 6279 leader_election.cc:343] T b7f372b952804ac58e602998d9b77d72 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:05.447420 6202 raft_consensus.cc:3060] T 8db0358af7634911820f99fe16605ca7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:05.451565 6037 tablet_service.cc:1511] Processing CreateTablet for tablet fc151f4d78344efeada6d6e57af6eb9f (DEFAULT_TABLE table=default.Table_c4d3bcab16044711b665673ef8cfa646 [id=22bf03cd65ab4346af756b244875c007]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.451968 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc151f4d78344efeada6d6e57af6eb9f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:05.456422 5996 leader_election.cc:343] T 3190d18f00234d71b0a58c2c334ef45f P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:05.462604 6646 raft_consensus.cc:493] T 77f111a495f3429cb243417824095d02 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:05.462812 6646 raft_consensus.cc:515] T 77f111a495f3429cb243417824095d02 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.463704 6646 leader_election.cc:290] T 77f111a495f3429cb243417824095d02 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:05.465559 6458 log.cc:1199] T 77f111a495f3429cb243417824095d02 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/77f111a495f3429cb243417824095d02
I20260923 19:50:05.467257 6058 raft_consensus.cc:2468] T f302f91c8ef44237b1c9909d88dacbff P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:05.467703 6279 leader_election.cc:304] T b7f372b952804ac58e602998d9b77d72 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:05.467724 5996 leader_election.cc:304] T 3190d18f00234d71b0a58c2c334ef45f P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:05.467659 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 554655516bb547ad9c2aa1ee66dc8deb (DEFAULT_TABLE table=default.Table_307ba44a8b0641cdaaa0ef43e10172e1 [id=648700f6ed984eb8942ecfc647e8c725]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:05.468068 5996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.195:32855, user_credentials={real_user=slave}} blocked reactor thread for 117688us
I20260923 19:50:05.468189 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 554655516bb547ad9c2aa1ee66dc8deb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.468089 6324 tablet_service.cc:1511] Processing CreateTablet for tablet 554655516bb547ad9c2aa1ee66dc8deb (DEFAULT_TABLE table=default.Table_307ba44a8b0641cdaaa0ef43e10172e1 [id=648700f6ed984eb8942ecfc647e8c725]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.468462 6825 raft_consensus.cc:2749] T 3190d18f00234d71b0a58c2c334ef45f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:05.469725 6033 tablet_service.cc:1511] Processing CreateTablet for tablet e6e04d16675443fc923a5f8216e292b6 (DEFAULT_TABLE table=default.Table_036527853b5f467ab42e956cc35b2081 [id=5c206f48fb1a4be587f17803f654ce5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.451238 6029 rpcz_store.cc:276] 0923 19:50:04.173012 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:04.174128 (+ 1116us) service_pool.cc:224] Handling call
0923 19:50:04.345928 (+171800us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0923 19:50:04.349948 (+ 4020us) ts_tablet_manager.cc:682] Creating new metadata...
0923 19:50:05.032133 (+682185us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.312371 (+280238us) tablet_replica.cc:206] Creating consensus instance
0923 19:50:05.312685 (+ 314us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260923 19:50:05.472913 6458 ts_tablet_manager.cc:1950] T 77f111a495f3429cb243417824095d02 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
W20260923 19:50:05.473644 6139 leader_election.cc:343] T 77f111a495f3429cb243417824095d02 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 77f111a495f3429cb243417824095d02
I20260923 19:50:05.474861 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 126) took 4250 ms. Trace:
I20260923 19:50:05.474961 6458 rpcz_store.cc:276] 0923 19:50:01.223663 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:01.234019 (+ 10356us) service_pool.cc:224] Handling call
0923 19:50:05.403512 (+4169493us) ts_tablet_manager.cc:1151] Deleting tablet 77f111a495f3429cb243417824095d02
0923 19:50:05.403521 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.427813 (+ 24292us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.434176 (+ 6363us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.473689 (+ 39513us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4034426}
I20260923 19:50:05.475585 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 77f111a495f3429cb243417824095d02 (table default.Table_552860e790be402a91af4ff2e2185d10 [id=e98e62b25556431abdccca23fa9d81e2]) successfully deleted
I20260923 19:50:05.477924 6458 tablet_replica.cc:333] T c817af3eb83a43a3b6d4e9c83a9eefbb P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:05.477931 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 554655516bb547ad9c2aa1ee66dc8deb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.478152 6728 raft_consensus.cc:2749] T b7f372b952804ac58e602998d9b77d72 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:05.478260 6458 raft_consensus.cc:2243] T c817af3eb83a43a3b6d4e9c83a9eefbb P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:05.478653 6458 raft_consensus.cc:2272] T c817af3eb83a43a3b6d4e9c83a9eefbb P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:05.478822 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 7b1601590508479c8f401cd09d9f4c3b
I20260923 19:50:05.478787 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 235b4b8081ad4a13937a7941344dbc33
I20260923 19:50:05.479067 5798 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:59912 (request call id 426) took 1262 ms. Trace:
I20260923 19:50:05.479223 6458 ts_tablet_manager.cc:1916] T c817af3eb83a43a3b6d4e9c83a9eefbb P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:05.479426 5796 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:59912 (request call id 419) took 1296 ms. Trace:
I20260923 19:50:05.479787 5800 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:59912 (request call id 427) took 1262 ms. Trace:
I20260923 19:50:05.480309 5804 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:59912 (request call id 412) took 1346 ms. Trace:
I20260923 19:50:05.479895 5800 rpcz_store.cc:276] 0923 19:50:04.216894 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.331042 (+1114148us) service_pool.cc:224] Handling call
0923 19:50:05.340330 (+ 9288us) spinlock_profiling.cc:243] Waited 8.99 ms on lock 0x616000022954. stack: 00007f7983c95366 00007f7983c95120 00007f7982c9f34d 00000000009a4cb4 00000000009a4c7d 00007f799320f65d 00007f799320f753 00007f798fd8cdb1 00007f7997b7bacd 00007f7997d0aef3 00007f798e6dbd16 00007f798e6dba45 00007f798addf63e 00007f798adde51e 00007f798ade4758 00007f798ade50bf
0923 19:50:05.366336 (+ 26006us) catalog_manager.cc:2140] Acquired catalog manager lock
0923 19:50:05.366785 (+ 449us) catalog_manager.cc:2186] Created new table and tablet info
0923 19:50:05.428729 (+ 61944us) catalog_manager.cc:2246] Wrote table and tablets to system table
0923 19:50:05.479668 (+ 50939us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0923 19:50:05.479745 (+ 77us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0923 19:50:05.392372 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0923 19:50:05.392454 (+ 82us) write_op.cc:432] Acquiring schema lock in shared mode
0923 19:50:05.392458 (+ 4us) write_op.cc:435] Acquired schema lock
0923 19:50:05.392461 (+ 3us) tablet.cc:662] Decoding operations
0923 19:50:05.392550 (+ 89us) write_op.cc:620] Acquiring the partition lock for write op
0923 19:50:05.392557 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0923 19:50:05.392562 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0923 19:50:05.392616 (+ 54us) tablet.cc:701] Row locks acquired
0923 19:50:05.392619 (+ 3us) write_op.cc:260] PREPARE: finished
0923 19:50:05.392641 (+ 22us) write_op.cc:270] Start()
0923 19:50:05.392662 (+ 21us) write_op.cc:276] Timestamp: P: 1790193005392603 usec, L: 0
0923 19:50:05.392664 (+ 2us) op_driver.cc:348] REPLICATION: starting
0923 19:50:05.392775 (+ 111us) log.cc:844] Serialized 433 byte log entry
0923 19:50:05.427355 (+ 34580us) op_driver.cc:464] REPLICATION: finished
0923 19:50:05.427677 (+ 322us) write_op.cc:301] APPLY: starting
0923 19:50:05.427694 (+ 17us) tablet.cc:1394] starting BulkCheckPresence
0923 19:50:05.427741 (+ 47us) tablet.cc:1397] finished BulkCheckPresence
0923 19:50:05.427778 (+ 37us) tablet.cc:1399] starting ApplyRowOperation cycle
0923 19:50:05.427892 (+ 114us) tablet.cc:1410] finished ApplyRowOperation cycle
0923 19:50:05.427928 (+ 36us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0923 19:50:05.427936 (+ 8us) write_op.cc:312] APPLY: finished
0923 19:50:05.428019 (+ 83us) log.cc:844] Serialized 29 byte log entry
0923 19:50:05.428084 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0923 19:50:05.428102 (+ 18us) write_op.cc:454] Released schema lock
0923 19:50:05.428108 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0923 19:50:05.428179 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0923 19:50:05.428184 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":20683136,"child_traces":[["op",{"apply.queue_time_us":223,"apply.run_cpu_time_us":504,"apply.run_wall_time_us":505,"num_ops":2,"prepare.queue_time_us":25096,"prepare.run_cpu_time_us":446,"prepare.run_wall_time_us":444,"replication_time_us":34623}]]}
I20260923 19:50:05.480690 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_4761dd5028c84fd1beaa780170cbec4e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:05.480888 5805 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7e41501bf01e4765853c27e4cac21e2b consensus state has no leader
I20260923 19:50:05.481043 5805 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:59912 (request call id 425) took 1264 ms. Trace:
W20260923 19:50:05.481303 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4761dd5028c84fd1beaa780170cbec4e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:05.481120 5805 rpcz_store.cc:276] 0923 19:50:04.216716 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.329326 (+1112610us) service_pool.cc:224] Handling call
0923 19:50:05.341863 (+ 12537us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x616000022954. stack: 00007f7983c95366 00007f7983c95120 00007f7982c9f34d 00000000009a4cb4 00000000009a4c7d 00007f799320f65d 00007f799320f753 00007f798fd8cdb1 00007f7997b7bacd 00007f7997d0d186 00007f798e6df696 00007f798e6df3c5 00007f798addf63e 00007f798adde51e 00007f798ade4758 00007f798ade50bf
0923 19:50:05.347216 (+ 5353us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0923 19:50:05.351011 (+ 3795us) catalog_manager.cc:3764] Apply alter schema
0923 19:50:05.351163 (+ 152us) catalog_manager.cc:3796] Acquired catalog manager lock
0923 19:50:05.351222 (+ 59us) catalog_manager.cc:3954] Updating metadata on disk
0923 19:50:05.413282 (+ 62060us) catalog_manager.cc:3985] Committing alterations to in-memory state
0923 19:50:05.480981 (+ 67699us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0923 19:50:05.391872 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0923 19:50:05.391976 (+ 104us) write_op.cc:432] Acquiring schema lock in shared mode
0923 19:50:05.391980 (+ 4us) write_op.cc:435] Acquired schema lock
0923 19:50:05.391981 (+ 1us) tablet.cc:662] Decoding operations
0923 19:50:05.392044 (+ 63us) write_op.cc:620] Acquiring the partition lock for write op
0923 19:50:05.392052 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0923 19:50:05.392056 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0923 19:50:05.392096 (+ 40us) tablet.cc:701] Row locks acquired
0923 19:50:05.392098 (+ 2us) write_op.cc:260] PREPARE: finished
0923 19:50:05.392119 (+ 21us) write_op.cc:270] Start()
0923 19:50:05.392139 (+ 20us) write_op.cc:276] Timestamp: P: 1790193005392082 usec, L: 0
0923 19:50:05.392142 (+ 3us) op_driver.cc:348] REPLICATION: starting
0923 19:50:05.392301 (+ 159us) log.cc:844] Serialized 405 byte log entry
0923 19:50:05.412040 (+ 19739us) op_driver.cc:464] REPLICATION: finished
0923 19:50:05.412672 (+ 632us) write_op.cc:301] APPLY: starting
0923 19:50:05.412684 (+ 12us) tablet.cc:1394] starting BulkCheckPresence
0923 19:50:05.412713 (+ 29us) tablet.cc:1397] finished BulkCheckPresence
0923 19:50:05.412754 (+ 41us) tablet.cc:1399] starting ApplyRowOperation cycle
0923 19:50:05.412797 (+ 43us) tablet.cc:1410] finished ApplyRowOperation cycle
0923 19:50:05.412828 (+ 31us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0923 19:50:05.412839 (+ 11us) write_op.cc:312] APPLY: finished
0923 19:50:05.412901 (+ 62us) log.cc:844] Serialized 23 byte log entry
0923 19:50:05.412938 (+ 37us) write_op.cc:489] Releasing partition, row and schema locks
0923 19:50:05.412949 (+ 11us) write_op.cc:454] Released schema lock
0923 19:50:05.412955 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":28337920,"child_traces":[["op",{"apply.queue_time_us":592,"apply.run_cpu_time_us":349,"apply.run_wall_time_us":349,"mutex_wait_us":19,"num_ops":1,"prepare.queue_time_us":34295,"prepare.run_cpu_time_us":471,"prepare.run_wall_time_us":469,"replication_time_us":19879,"thread_start_us":15003,"threads_started":1}]]}
I20260923 19:50:05.482086 5805 master_service.cc:960] ReplaceTablet: received request to replace tablet 6e781ccf4aa343fc924138c3cc2b04e6 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:05.482775 5805 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:59912 (request call id 434) took 1066 ms. Trace:
I20260923 19:50:05.482880 5805 rpcz_store.cc:276] 0923 19:50:04.416758 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.481999 (+1065241us) service_pool.cc:224] Handling call
0923 19:50:05.482735 (+ 736us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260923 19:50:05.483259 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_da274282ae7c4941a43506b4dfbaf430"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:05.483628 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 870db252d8414be7bbe613ea467b5f3a
W20260923 19:50:05.483764 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_da274282ae7c4941a43506b4dfbaf430 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:05.484158 5803 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:59912 (request call id 429) took 1212 ms. Trace:
I20260923 19:50:05.484270 5803 rpcz_store.cc:276] 0923 19:50:04.271638 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.351949 (+1080311us) service_pool.cc:224] Handling call
0923 19:50:05.355982 (+ 4033us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0923 19:50:05.356116 (+ 134us) catalog_manager.cc:2854] Modifying in-memory table state
0923 19:50:05.356191 (+ 75us) catalog_manager.cc:2863] Locking tablets
0923 19:50:05.356325 (+ 134us) catalog_manager.cc:2877] Removing table and tablets from system table
0923 19:50:05.412938 (+ 56613us) catalog_manager.cc:2895] Removing table from by-name map
0923 19:50:05.483464 (+ 70526us) catalog_manager.cc:2911] Committing in-memory state
0923 19:50:05.483498 (+ 34us) catalog_manager.cc:2915] Aborting table tasks
0923 19:50:05.484121 (+ 623us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0923 19:50:05.391243 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0923 19:50:05.391347 (+ 104us) write_op.cc:432] Acquiring schema lock in shared mode
0923 19:50:05.391353 (+ 6us) write_op.cc:435] Acquired schema lock
0923 19:50:05.391356 (+ 3us) tablet.cc:662] Decoding operations
0923 19:50:05.391479 (+ 123us) write_op.cc:620] Acquiring the partition lock for write op
0923 19:50:05.391492 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0923 19:50:05.391497 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0923 19:50:05.391606 (+ 109us) tablet.cc:701] Row locks acquired
0923 19:50:05.391609 (+ 3us) write_op.cc:260] PREPARE: finished
0923 19:50:05.391642 (+ 33us) write_op.cc:270] Start()
0923 19:50:05.391674 (+ 32us) write_op.cc:276] Timestamp: P: 1790193005391600 usec, L: 0
0923 19:50:05.391678 (+ 4us) op_driver.cc:348] REPLICATION: starting
0923 19:50:05.391799 (+ 121us) log.cc:844] Serialized 731 byte log entry
0923 19:50:05.411991 (+ 20192us) op_driver.cc:464] REPLICATION: finished
0923 19:50:05.412633 (+ 642us) write_op.cc:301] APPLY: starting
0923 19:50:05.412644 (+ 11us) tablet.cc:1394] starting BulkCheckPresence
0923 19:50:05.412672 (+ 28us) tablet.cc:1397] finished BulkCheckPresence
0923 19:50:05.412697 (+ 25us) tablet.cc:1399] starting ApplyRowOperation cycle
0923 19:50:05.412746 (+ 49us) tablet.cc:1410] finished ApplyRowOperation cycle
0923 19:50:05.412770 (+ 24us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0923 19:50:05.412777 (+ 7us) write_op.cc:312] APPLY: finished
0923 19:50:05.412826 (+ 49us) log.cc:844] Serialized 29 byte log entry
0923 19:50:05.412863 (+ 37us) write_op.cc:489] Releasing partition, row and schema locks
0923 19:50:05.412876 (+ 13us) write_op.cc:454] Released schema lock
0923 19:50:05.412881 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0923 19:50:05.412936 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0923 19:50:05.412941 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":607,"apply.run_cpu_time_us":299,"apply.run_wall_time_us":298,"num_ops":2,"prepare.queue_time_us":34056,"prepare.run_cpu_time_us":605,"prepare.run_wall_time_us":605,"replication_time_us":20298}]]}
I20260923 19:50:05.485020 5803 master_service.cc:960] ReplaceTablet: received request to replace tablet e071b9dd1db44af0a9d1b9e904f875a5 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:05.485488 5803 master_service.cc:960] ReplaceTablet: received request to replace tablet f7e282b6699a4ce9837d221132a1f54e from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:05.480415 5804 rpcz_store.cc:276] 0923 19:50:04.133952 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:04.134169 (+ 217us) service_pool.cc:224] Handling call
0923 19:50:04.134716 (+ 547us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0923 19:50:04.134855 (+ 139us) catalog_manager.cc:2854] Modifying in-memory table state
0923 19:50:04.134919 (+ 64us) catalog_manager.cc:2863] Locking tablets
0923 19:50:05.342300 (+1207381us) catalog_manager.cc:2877] Removing table and tablets from system table
0923 19:50:05.413092 (+ 70792us) catalog_manager.cc:2895] Removing table from by-name map
0923 19:50:05.478679 (+ 65587us) catalog_manager.cc:2911] Committing in-memory state
0923 19:50:05.478763 (+ 84us) catalog_manager.cc:2915] Aborting table tasks
0923 19:50:05.480273 (+ 1510us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0923 19:50:05.353489 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0923 19:50:05.353594 (+ 105us) write_op.cc:432] Acquiring schema lock in shared mode
0923 19:50:05.353601 (+ 7us) write_op.cc:435] Acquired schema lock
0923 19:50:05.353604 (+ 3us) tablet.cc:662] Decoding operations
0923 19:50:05.355446 (+ 1842us) write_op.cc:620] Acquiring the partition lock for write op
0923 19:50:05.355461 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0923 19:50:05.355466 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0923 19:50:05.355562 (+ 96us) tablet.cc:701] Row locks acquired
0923 19:50:05.355565 (+ 3us) write_op.cc:260] PREPARE: finished
0923 19:50:05.355604 (+ 39us) write_op.cc:270] Start()
0923 19:50:05.355636 (+ 32us) write_op.cc:276] Timestamp: P: 1790193005355564 usec, L: 0
0923 19:50:05.355639 (+ 3us) op_driver.cc:348] REPLICATION: starting
0923 19:50:05.355873 (+ 234us) log.cc:844] Serialized 731 byte log entry
0923 19:50:05.390260 (+ 34387us) spinlock_profiling.cc:243] Waited 32.6 ms on lock 0x616000023bb8. stack: 00007f7983c95366 00007f7983c95120 00007f7982c9f34d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f798fc939ef 00007f798fc616fb 00007f798fc6c691 00007f798fc6c37d 0000000000aaef9c 00007f7983cdb88f 00007f7983cdeb8b 00007f7983cdea08 0000000000aaef9c 00007f7983cbae18
0923 19:50:05.406971 (+ 16711us) op_driver.cc:464] REPLICATION: finished
0923 19:50:05.412096 (+ 5125us) write_op.cc:301] APPLY: starting
0923 19:50:05.412118 (+ 22us) tablet.cc:1394] starting BulkCheckPresence
0923 19:50:05.412162 (+ 44us) tablet.cc:1397] finished BulkCheckPresence
0923 19:50:05.412164 (+ 2us) tablet.cc:1399] starting ApplyRowOperation cycle
0923 19:50:05.412253 (+ 89us) tablet.cc:1410] finished ApplyRowOperation cycle
0923 19:50:05.412293 (+ 40us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0923 19:50:05.412303 (+ 10us) write_op.cc:312] APPLY: finished
0923 19:50:05.412387 (+ 84us) log.cc:844] Serialized 29 byte log entry
0923 19:50:05.412454 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0923 19:50:05.412476 (+ 22us) write_op.cc:454] Released schema lock
0923 19:50:05.412484 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0923 19:50:05.412582 (+ 98us) write_op.cc:489] Releasing partition, row and schema locks
0923 19:50:05.412589 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":5057,"apply.run_cpu_time_us":474,"apply.run_wall_time_us":473,"num_ops":2,"prepare.queue_time_us":50,"prepare.run_cpu_time_us":837,"prepare.run_wall_time_us":2507,"raft.queue_time_us":1373,"raft.run_cpu_time_us":1051,"raft.run_wall_time_us":33177,"replication_time_us":51297,"spinlock_wait_cycles":74905728}]]}
I20260923 19:50:05.485687 5804 master_service.cc:960] ReplaceTablet: received request to replace tablet 789c54477bec4636bb3669e1f62730e2 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:05.487701 6319 tablet_service.cc:1558] Processing DeleteTablet for tablet 870db252d8414be7bbe613ea467b5f3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:05.487998 6458 ts_tablet_manager.cc:1929] T c817af3eb83a43a3b6d4e9c83a9eefbb P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260923 19:50:05.488215 6458 log.cc:1199] T c817af3eb83a43a3b6d4e9c83a9eefbb P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/c817af3eb83a43a3b6d4e9c83a9eefbb
I20260923 19:50:05.488093 6311 tablet_service.cc:1511] Processing CreateTablet for tablet e1de117713f34b51bbda0c712f0b837c (DEFAULT_TABLE table=default.Table_9d716833c456436cbc514b6a9070c9e1 [id=e3fafc4359af49c88437fb5815526518]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.489054 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1de117713f34b51bbda0c712f0b837c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.485857 5803 master_service.cc:960] ReplaceTablet: received request to replace tablet 601a0ff319cc4c9a898d52bbcb19184b from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:05.490895 6458 ts_tablet_manager.cc:1950] T c817af3eb83a43a3b6d4e9c83a9eefbb P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:05.491719 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 128) took 4093 ms. Trace:
I20260923 19:50:05.492525 6458 rpcz_store.cc:276] 0923 19:50:01.398240 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:01.401797 (+ 3557us) service_pool.cc:224] Handling call
0923 19:50:05.475263 (+4073466us) ts_tablet_manager.cc:1151] Deleting tablet c817af3eb83a43a3b6d4e9c83a9eefbb
0923 19:50:05.475272 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.483415 (+ 8143us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.487903 (+ 4488us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.491684 (+ 3781us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4025729}
I20260923 19:50:05.493467 5799 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:59912 (request call id 432) took 1126 ms. Trace:
I20260923 19:50:05.494016 6458 tablet_replica.cc:333] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:05.493642 5799 rpcz_store.cc:276] 0923 19:50:04.367428 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.398088 (+1030660us) service_pool.cc:224] Handling call
0923 19:50:05.398877 (+ 789us) catalog_manager.cc:2140] Acquired catalog manager lock
0923 19:50:05.399899 (+ 1022us) catalog_manager.cc:2186] Created new table and tablet info
0923 19:50:05.433788 (+ 33889us) catalog_manager.cc:2246] Wrote table and tablets to system table
0923 19:50:05.493334 (+ 59546us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0923 19:50:05.493416 (+ 82us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0923 19:50:05.400400 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0923 19:50:05.400486 (+ 86us) write_op.cc:432] Acquiring schema lock in shared mode
0923 19:50:05.400491 (+ 5us) write_op.cc:435] Acquired schema lock
0923 19:50:05.400494 (+ 3us) tablet.cc:662] Decoding operations
0923 19:50:05.400573 (+ 79us) write_op.cc:620] Acquiring the partition lock for write op
0923 19:50:05.400582 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0923 19:50:05.400587 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0923 19:50:05.400646 (+ 59us) tablet.cc:701] Row locks acquired
0923 19:50:05.400648 (+ 2us) write_op.cc:260] PREPARE: finished
0923 19:50:05.400677 (+ 29us) write_op.cc:270] Start()
0923 19:50:05.400704 (+ 27us) write_op.cc:276] Timestamp: P: 1790193005400635 usec, L: 0
0923 19:50:05.400709 (+ 5us) op_driver.cc:348] REPLICATION: starting
0923 19:50:05.400849 (+ 140us) log.cc:844] Serialized 433 byte log entry
0923 19:50:05.432078 (+ 31229us) op_driver.cc:464] REPLICATION: finished
0923 19:50:05.432351 (+ 273us) write_op.cc:301] APPLY: starting
0923 19:50:05.432361 (+ 10us) tablet.cc:1394] starting BulkCheckPresence
0923 19:50:05.432389 (+ 28us) tablet.cc:1397] finished BulkCheckPresence
0923 19:50:05.432416 (+ 27us) tablet.cc:1399] starting ApplyRowOperation cycle
0923 19:50:05.432526 (+ 110us) tablet.cc:1410] finished ApplyRowOperation cycle
0923 19:50:05.432563 (+ 37us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0923 19:50:05.432571 (+ 8us) write_op.cc:312] APPLY: finished
0923 19:50:05.432628 (+ 57us) log.cc:844] Serialized 29 byte log entry
0923 19:50:05.432666 (+ 38us) write_op.cc:489] Releasing partition, row and schema locks
0923 19:50:05.432681 (+ 15us) write_op.cc:454] Released schema lock
0923 19:50:05.432686 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":150,"apply.run_cpu_time_us":384,"apply.run_wall_time_us":384,"num_ops":2,"prepare.queue_time_us":42,"prepare.run_cpu_time_us":506,"prepare.run_wall_time_us":507,"replication_time_us":31283}]]}
I20260923 19:50:05.494235 6458 raft_consensus.cc:2243] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:05.494403 6458 raft_consensus.cc:2272] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:05.495020 5799 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a4bed55e26e74a499d9971feb59ba8bf" } new_table_name: "default.Table_f1842456992c4765924d809a3a062c07" modify_external_catalogs: true
I20260923 19:50:05.496006 6173 tablet_service.cc:1558] Processing DeleteTablet for tablet 870db252d8414be7bbe613ea467b5f3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:05.496290 5996 consensus_peers.cc:597] T 8db0358af7634911820f99fe16605ca7 P e546f660e7e541d1aa9ae38e5ee5b9c0 -> Peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Couldn't send request to peer 2bf41435f70447f19992d368ca6b46bd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8db0358af7634911820f99fe16605ca7. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:05.496260 6773 raft_consensus.cc:515] T a1e8b8e638ec438a86f05fa147cdb27c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.496476 6022 tablet_service.cc:1511] Processing CreateTablet for tablet d39a64531dd24eb4aa1f7e0c418b985b (DEFAULT_TABLE table=default.Table_a0d1427301b14afd906023f389ea8b81 [id=a56799b0709846cf8308d7d7b727427c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.496816 6461 ts_tablet_manager.cc:1950] T 033c2d772c8a44d2a0e671664bb9085d P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
W20260923 19:50:05.497759 6137 leader_election.cc:343] T 77f111a495f3429cb243417824095d02 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 77f111a495f3429cb243417824095d02
I20260923 19:50:05.497922 6137 leader_election.cc:304] T 77f111a495f3429cb243417824095d02 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:05.499321 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet c817af3eb83a43a3b6d4e9c83a9eefbb (table default.Table_30f4ccabe7fa4c8ba92e008f3d9b2d80 [id=b9b7fe147b8645389ebef237fa735b2b]) successfully deleted
I20260923 19:50:05.499548 6456 tablet_bootstrap.cc:492] T 5455beff354a4616a68d8746e3e4f9a8 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:05.499691 6456 ts_tablet_manager.cc:1403] T 5455beff354a4616a68d8746e3e4f9a8 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.209s user 0.045s sys 0.044s
I20260923 19:50:05.499715 6646 raft_consensus.cc:2749] T 77f111a495f3429cb243417824095d02 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:05.500296 6316 tablet_service.cc:1558] Processing DeleteTablet for tablet 235b4b8081ad4a13937a7941344dbc33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:04 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:05.500517 6456 raft_consensus.cc:359] T 5455beff354a4616a68d8746e3e4f9a8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.500695 6456 raft_consensus.cc:385] T 5455beff354a4616a68d8746e3e4f9a8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:05.500602 6314 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b1601590508479c8f401cd09d9f4c3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:04 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:05.483281 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet e1de117713f34b51bbda0c712f0b837c
I20260923 19:50:05.500780 6456 raft_consensus.cc:740] T 5455beff354a4616a68d8746e3e4f9a8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:05.503319 5802 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:59912 (request call id 430) took 1231 ms. Trace:
I20260923 19:50:05.503527 6456 consensus_queue.cc:260] T 5455beff354a4616a68d8746e3e4f9a8 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.503429 5802 rpcz_store.cc:276] 0923 19:50:04.271766 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.363746 (+1091980us) service_pool.cc:224] Handling call
0923 19:50:05.394000 (+ 30254us) spinlock_profiling.cc:243] Waited 27.6 ms on lock 0x616000022954. stack: 00007f7983c95366 00007f7983c95120 00007f7982c9f34d 00000000009a4cb4 00000000009a4c7d 00007f799320f65d 00007f799320f753 00007f798fd8cdb1 00007f7997b7bacd 00007f7997d0bee6 00007f798e6dd9d6 00007f798e6dd705 00007f798addf63e 00007f798adde51e 00007f798ade4758 00007f798ade50bf
0923 19:50:05.394392 (+ 392us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0923 19:50:05.394526 (+ 134us) catalog_manager.cc:2854] Modifying in-memory table state
0923 19:50:05.394606 (+ 80us) catalog_manager.cc:2863] Locking tablets
0923 19:50:05.394767 (+ 161us) catalog_manager.cc:2877] Removing table and tablets from system table
0923 19:50:05.430735 (+ 35968us) catalog_manager.cc:2895] Removing table from by-name map
0923 19:50:05.483175 (+ 52440us) catalog_manager.cc:2911] Committing in-memory state
0923 19:50:05.483205 (+ 30us) catalog_manager.cc:2915] Aborting table tasks
0923 19:50:05.503279 (+ 20074us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0923 19:50:05.395476 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0923 19:50:05.395580 (+ 104us) write_op.cc:432] Acquiring schema lock in shared mode
0923 19:50:05.395585 (+ 5us) write_op.cc:435] Acquired schema lock
0923 19:50:05.395587 (+ 2us) tablet.cc:662] Decoding operations
0923 19:50:05.395678 (+ 91us) write_op.cc:620] Acquiring the partition lock for write op
0923 19:50:05.395685 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0923 19:50:05.395690 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0923 19:50:05.395777 (+ 87us) tablet.cc:701] Row locks acquired
0923 19:50:05.395779 (+ 2us) write_op.cc:260] PREPARE: finished
0923 19:50:05.395811 (+ 32us) write_op.cc:270] Start()
0923 19:50:05.395834 (+ 23us) write_op.cc:276] Timestamp: P: 1790193005395767 usec, L: 0
0923 19:50:05.395837 (+ 3us) op_driver.cc:348] REPLICATION: starting
0923 19:50:05.395976 (+ 139us) log.cc:844] Serialized 731 byte log entry
0923 19:50:05.430171 (+ 34195us) op_driver.cc:464] REPLICATION: finished
0923 19:50:05.430359 (+ 188us) write_op.cc:301] APPLY: starting
0923 19:50:05.430369 (+ 10us) tablet.cc:1394] starting BulkCheckPresence
0923 19:50:05.430396 (+ 27us) tablet.cc:1397] finished BulkCheckPresence
0923 19:50:05.430423 (+ 27us) tablet.cc:1399] starting ApplyRowOperation cycle
0923 19:50:05.430479 (+ 56us) tablet.cc:1410] finished ApplyRowOperation cycle
0923 19:50:05.430502 (+ 23us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0923 19:50:05.430509 (+ 7us) write_op.cc:312] APPLY: finished
0923 19:50:05.430568 (+ 59us) log.cc:844] Serialized 29 byte log entry
0923 19:50:05.430609 (+ 41us) write_op.cc:489] Releasing partition, row and schema locks
0923 19:50:05.430624 (+ 15us) write_op.cc:454] Released schema lock
0923 19:50:05.430630 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":63390976,"child_traces":[["op",{"apply.queue_time_us":79,"apply.run_cpu_time_us":325,"apply.run_wall_time_us":324,"num_ops":2,"prepare.queue_time_us":108,"prepare.run_cpu_time_us":550,"prepare.run_wall_time_us":550,"replication_time_us":34265}]]}
I20260923 19:50:05.504150 5802 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_95db9487259c45f5bbfdede6ebd6d1da" } new_table_name: "default.Table_9fa8f8bfc6124f398a4acdf5e1e0b33a" modify_external_catalogs: true
I20260923 19:50:05.488678 5801 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 2948d729e1ec4dfca70789bcad513e52
I20260923 19:50:05.507300 5801 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:59912 (request call id 431) took 1235 ms. Trace:
I20260923 19:50:05.507401 5801 rpcz_store.cc:276] 0923 19:50:04.271900 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.369230 (+1097330us) service_pool.cc:224] Handling call
0923 19:50:05.394151 (+ 24921us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x616000022954. stack: 00007f7983c95366 00007f7983c95120 00007f7982c9f34d 00000000009a4cb4 00000000009a4c7d 00007f799320f65d 00007f799320f753 00007f798fd8cdb1 00007f7997b7bacd 00007f7997d0bee6 00007f798e6dd9d6 00007f798e6dd705 00007f798addf63e 00007f798adde51e 00007f798ade4758 00007f798ade50bf
0923 19:50:05.394486 (+ 335us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0923 19:50:05.394618 (+ 132us) catalog_manager.cc:2854] Modifying in-memory table state
0923 19:50:05.394664 (+ 46us) catalog_manager.cc:2863] Locking tablets
0923 19:50:05.394823 (+ 159us) catalog_manager.cc:2877] Removing table and tablets from system table
0923 19:50:05.431666 (+ 36843us) catalog_manager.cc:2895] Removing table from by-name map
0923 19:50:05.488588 (+ 56922us) catalog_manager.cc:2911] Committing in-memory state
0923 19:50:05.488624 (+ 36us) catalog_manager.cc:2915] Aborting table tasks
0923 19:50:05.507262 (+ 18638us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0923 19:50:05.396056 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0923 19:50:05.396142 (+ 86us) write_op.cc:432] Acquiring schema lock in shared mode
0923 19:50:05.396146 (+ 4us) write_op.cc:435] Acquired schema lock
0923 19:50:05.396149 (+ 3us) tablet.cc:662] Decoding operations
0923 19:50:05.396250 (+ 101us) write_op.cc:620] Acquiring the partition lock for write op
0923 19:50:05.396257 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0923 19:50:05.396261 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0923 19:50:05.396335 (+ 74us) tablet.cc:701] Row locks acquired
0923 19:50:05.396338 (+ 3us) write_op.cc:260] PREPARE: finished
0923 19:50:05.396363 (+ 25us) write_op.cc:270] Start()
0923 19:50:05.396384 (+ 21us) write_op.cc:276] Timestamp: P: 1790193005396325 usec, L: 0
0923 19:50:05.396387 (+ 3us) op_driver.cc:348] REPLICATION: starting
0923 19:50:05.396505 (+ 118us) log.cc:844] Serialized 731 byte log entry
0923 19:50:05.431016 (+ 34511us) op_driver.cc:464] REPLICATION: finished
0923 19:50:05.431224 (+ 208us) write_op.cc:301] APPLY: starting
0923 19:50:05.431235 (+ 11us) tablet.cc:1394] starting BulkCheckPresence
0923 19:50:05.431268 (+ 33us) tablet.cc:1397] finished BulkCheckPresence
0923 19:50:05.431293 (+ 25us) tablet.cc:1399] starting ApplyRowOperation cycle
0923 19:50:05.431348 (+ 55us) tablet.cc:1410] finished ApplyRowOperation cycle
0923 19:50:05.431376 (+ 28us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0923 19:50:05.431382 (+ 6us) write_op.cc:312] APPLY: finished
0923 19:50:05.431434 (+ 52us) log.cc:844] Serialized 29 byte log entry
0923 19:50:05.431472 (+ 38us) write_op.cc:489] Releasing partition, row and schema locks
0923 19:50:05.431486 (+ 14us) write_op.cc:454] Released schema lock
0923 19:50:05.431493 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":33585408,"child_traces":[["op",{"apply.queue_time_us":105,"apply.run_cpu_time_us":328,"apply.run_wall_time_us":328,"num_ops":2,"prepare.queue_time_us":672,"prepare.run_cpu_time_us":499,"prepare.run_wall_time_us":498,"replication_time_us":34606}]]}
I20260923 19:50:05.508173 6456 ts_tablet_manager.cc:1434] T 5455beff354a4616a68d8746e3e4f9a8 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260923 19:50:05.509038 6314 tablet_service.cc:1558] Processing DeleteTablet for tablet e1de117713f34b51bbda0c712f0b837c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:05.488837 5797 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:59912 (request call id 428) took 1271 ms. Trace:
I20260923 19:50:05.509992 5797 rpcz_store.cc:276] 0923 19:50:04.217021 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.339471 (+1122450us) service_pool.cc:224] Handling call
0923 19:50:05.379794 (+ 40323us) catalog_manager.cc:2140] Acquired catalog manager lock
0923 19:50:05.380248 (+ 454us) catalog_manager.cc:2186] Created new table and tablet info
0923 19:50:05.429831 (+ 49583us) catalog_manager.cc:2246] Wrote table and tablets to system table
0923 19:50:05.488723 (+ 58892us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0923 19:50:05.488805 (+ 82us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0923 19:50:05.393385 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0923 19:50:05.393460 (+ 75us) write_op.cc:432] Acquiring schema lock in shared mode
0923 19:50:05.393464 (+ 4us) write_op.cc:435] Acquired schema lock
0923 19:50:05.393467 (+ 3us) tablet.cc:662] Decoding operations
0923 19:50:05.393523 (+ 56us) write_op.cc:620] Acquiring the partition lock for write op
0923 19:50:05.393530 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0923 19:50:05.393535 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0923 19:50:05.393585 (+ 50us) tablet.cc:701] Row locks acquired
0923 19:50:05.393587 (+ 2us) write_op.cc:260] PREPARE: finished
0923 19:50:05.393607 (+ 20us) write_op.cc:270] Start()
0923 19:50:05.393627 (+ 20us) write_op.cc:276] Timestamp: P: 1790193005393570 usec, L: 0
0923 19:50:05.393630 (+ 3us) op_driver.cc:348] REPLICATION: starting
0923 19:50:05.393730 (+ 100us) log.cc:844] Serialized 433 byte log entry
0923 19:50:05.429169 (+ 35439us) op_driver.cc:464] REPLICATION: finished
0923 19:50:05.429313 (+ 144us) write_op.cc:301] APPLY: starting
0923 19:50:05.429324 (+ 11us) tablet.cc:1394] starting BulkCheckPresence
0923 19:50:05.429351 (+ 27us) tablet.cc:1397] finished BulkCheckPresence
0923 19:50:05.429383 (+ 32us) tablet.cc:1399] starting ApplyRowOperation cycle
0923 19:50:05.429490 (+ 107us) tablet.cc:1410] finished ApplyRowOperation cycle
0923 19:50:05.429518 (+ 28us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0923 19:50:05.429540 (+ 22us) write_op.cc:312] APPLY: finished
0923 19:50:05.429605 (+ 65us) log.cc:844] Serialized 29 byte log entry
0923 19:50:05.429646 (+ 41us) write_op.cc:489] Releasing partition, row and schema locks
0923 19:50:05.429663 (+ 17us) write_op.cc:454] Released schema lock
0923 19:50:05.429670 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":57,"apply.run_cpu_time_us":415,"apply.run_wall_time_us":414,"num_ops":2,"prepare.queue_time_us":12662,"prepare.run_cpu_time_us":383,"prepare.run_wall_time_us":382,"replication_time_us":35468}]]}
I20260923 19:50:05.479158 5798 rpcz_store.cc:276] 0923 19:50:04.216800 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.330387 (+1113587us) service_pool.cc:224] Handling call
0923 19:50:05.344169 (+ 13782us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x616000022954. stack: 00007f7983c95366 00007f7983c95120 00007f7982c9f34d 00000000009a4cb4 00000000009a4c7d 00007f799320f65d 00007f799320f753 00007f798fd8cdb1 00007f7997b7bacd 00007f7997d0aef3 00007f798e6dbd16 00007f798e6dba45 00007f798addf63e 00007f798adde51e 00007f798ade4758 00007f798ade50bf
0923 19:50:05.354553 (+ 10384us) catalog_manager.cc:2140] Acquired catalog manager lock
0923 19:50:05.358324 (+ 3771us) catalog_manager.cc:2186] Created new table and tablet info
0923 19:50:05.428854 (+ 70530us) catalog_manager.cc:2246] Wrote table and tablets to system table
0923 19:50:05.478908 (+ 50054us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0923 19:50:05.479008 (+ 100us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0923 19:50:05.392855 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0923 19:50:05.392939 (+ 84us) write_op.cc:432] Acquiring schema lock in shared mode
0923 19:50:05.392944 (+ 5us) write_op.cc:435] Acquired schema lock
0923 19:50:05.392947 (+ 3us) tablet.cc:662] Decoding operations
0923 19:50:05.393042 (+ 95us) write_op.cc:620] Acquiring the partition lock for write op
0923 19:50:05.393052 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0923 19:50:05.393063 (+ 11us) tablet.cc:685] Acquiring locks for 2 operations
0923 19:50:05.393137 (+ 74us) tablet.cc:701] Row locks acquired
0923 19:50:05.393141 (+ 4us) write_op.cc:260] PREPARE: finished
0923 19:50:05.393177 (+ 36us) write_op.cc:270] Start()
0923 19:50:05.393199 (+ 22us) write_op.cc:276] Timestamp: P: 1790193005393129 usec, L: 0
0923 19:50:05.393202 (+ 3us) op_driver.cc:348] REPLICATION: starting
0923 19:50:05.393315 (+ 113us) log.cc:844] Serialized 433 byte log entry
0923 19:50:05.427556 (+ 34241us) op_driver.cc:464] REPLICATION: finished
0923 19:50:05.428251 (+ 695us) write_op.cc:301] APPLY: starting
0923 19:50:05.428263 (+ 12us) tablet.cc:1394] starting BulkCheckPresence
0923 19:50:05.428292 (+ 29us) tablet.cc:1397] finished BulkCheckPresence
0923 19:50:05.428314 (+ 22us) tablet.cc:1399] starting ApplyRowOperation cycle
0923 19:50:05.428446 (+ 132us) tablet.cc:1410] finished ApplyRowOperation cycle
0923 19:50:05.428474 (+ 28us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0923 19:50:05.428481 (+ 7us) write_op.cc:312] APPLY: finished
0923 19:50:05.428550 (+ 69us) log.cc:844] Serialized 29 byte log entry
0923 19:50:05.428593 (+ 43us) write_op.cc:489] Releasing partition, row and schema locks
0923 19:50:05.428605 (+ 12us) write_op.cc:454] Released schema lock
0923 19:50:05.428610 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":31107968,"child_traces":[["op",{"apply.queue_time_us":654,"apply.run_cpu_time_us":413,"apply.run_wall_time_us":413,"num_ops":2,"prepare.queue_time_us":18099,"prepare.run_cpu_time_us":502,"prepare.run_wall_time_us":501,"replication_time_us":34291}]]}
I20260923 19:50:05.511027 6456 tablet_bootstrap.cc:492] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:05.514017 6316 tablet_service.cc:1558] Processing DeleteTablet for tablet 2948d729e1ec4dfca70789bcad513e52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:05.514930 6456 tablet_bootstrap.cc:654] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:05.515192 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b1601590508479c8f401cd09d9f4c3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:04 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:05.515419 6168 tablet_service.cc:1558] Processing DeleteTablet for tablet 235b4b8081ad4a13937a7941344dbc33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:04 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:05.479532 5796 rpcz_store.cc:276] 0923 19:50:04.183196 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:04.183244 (+ 48us) service_pool.cc:224] Handling call
0923 19:50:04.194097 (+ 10853us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x616000022954. stack: 00007f7983c95366 00007f7983c95120 00007f7982c9f34d 00000000009a4cb4 00000000009a4c7d 00007f799320f65d 00007f799320f753 00007f798fd8cdb1 00007f7997b7bacd 00007f7997d0bee6 00007f798e6dd9d6 00007f798e6dd705 00007f798addf63e 00007f798adde51e 00007f798ade4758 00007f798ade50bf
0923 19:50:04.194463 (+ 366us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0923 19:50:04.194578 (+ 115us) catalog_manager.cc:2854] Modifying in-memory table state
0923 19:50:04.194626 (+ 48us) catalog_manager.cc:2863] Locking tablets
0923 19:50:05.340780 (+1146154us) catalog_manager.cc:2877] Removing table and tablets from system table
0923 19:50:05.412554 (+ 71774us) catalog_manager.cc:2895] Removing table from by-name map
0923 19:50:05.478679 (+ 66125us) catalog_manager.cc:2911] Committing in-memory state
0923 19:50:05.478716 (+ 37us) catalog_manager.cc:2915] Aborting table tasks
0923 19:50:05.479391 (+ 675us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0923 19:50:05.356021 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0923 19:50:05.356104 (+ 83us) write_op.cc:432] Acquiring schema lock in shared mode
0923 19:50:05.356109 (+ 5us) write_op.cc:435] Acquired schema lock
0923 19:50:05.356111 (+ 2us) tablet.cc:662] Decoding operations
0923 19:50:05.356203 (+ 92us) write_op.cc:620] Acquiring the partition lock for write op
0923 19:50:05.356211 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0923 19:50:05.356215 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0923 19:50:05.356298 (+ 83us) tablet.cc:701] Row locks acquired
0923 19:50:05.356300 (+ 2us) write_op.cc:260] PREPARE: finished
0923 19:50:05.356326 (+ 26us) write_op.cc:270] Start()
0923 19:50:05.356347 (+ 21us) write_op.cc:276] Timestamp: P: 1790193005356289 usec, L: 0
0923 19:50:05.356350 (+ 3us) op_driver.cc:348] REPLICATION: starting
0923 19:50:05.390956 (+ 34606us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x616000023bb8. stack: 00007f7983c95366 00007f7983c95120 00007f7982c9f34d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f798fc9f235 00007f798fd847ab 00007f798fd5f7a8 00007f798fd5f055 00007f799117cf55 00007f799117ba79 00007f7991183ea0 00007f7991183cad 0000000000aaef9c 00007f7983cdb88f
0923 19:50:05.391124 (+ 168us) log.cc:844] Serialized 731 byte log entry
0923 19:50:05.411930 (+ 20806us) op_driver.cc:464] REPLICATION: finished
0923 19:50:05.412093 (+ 163us) write_op.cc:301] APPLY: starting
0923 19:50:05.412110 (+ 17us) tablet.cc:1394] starting BulkCheckPresence
0923 19:50:05.412158 (+ 48us) tablet.cc:1397] finished BulkCheckPresence
0923 19:50:05.412173 (+ 15us) tablet.cc:1399] starting ApplyRowOperation cycle
0923 19:50:05.412249 (+ 76us) tablet.cc:1410] finished ApplyRowOperation cycle
0923 19:50:05.412283 (+ 34us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0923 19:50:05.412291 (+ 8us) write_op.cc:312] APPLY: finished
0923 19:50:05.412365 (+ 74us) log.cc:844] Serialized 29 byte log entry
0923 19:50:05.412422 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0923 19:50:05.412444 (+ 22us) write_op.cc:454] Released schema lock
0923 19:50:05.412451 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0923 19:50:05.412554 (+ 103us) write_op.cc:489] Releasing partition, row and schema locks
0923 19:50:05.412560 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":24437120,"child_traces":[["op",{"apply.queue_time_us":106,"apply.run_cpu_time_us":459,"apply.run_wall_time_us":458,"num_ops":2,"prepare.queue_time_us":2187,"prepare.run_cpu_time_us":1344,"prepare.run_wall_time_us":35179,"replication_time_us":55549,"spinlock_wait_cycles":77321984}]]}
I20260923 19:50:05.519726 6773 leader_election.cc:290] T a1e8b8e638ec438a86f05fa147cdb27c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:05.522137 6033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6e04d16675443fc923a5f8216e292b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.487560 5804 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a079a188cf0c46a884c2de951b9f6bb5" } new_table_name: "default.Table_74b3ada03dc14044b09a369b0e3782c7" modify_external_catalogs: true
I20260923 19:50:05.523922 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d39a64531dd24eb4aa1f7e0c418b985b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.526940 6458 ts_tablet_manager.cc:1916] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:05.527349 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet 5455beff354a4616a68d8746e3e4f9a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:05.528743 5805 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:59912 (request call id 435) took 1105 ms. Trace:
W20260923 19:50:05.528802 5996 leader_election.cc:343] T a1e8b8e638ec438a86f05fa147cdb27c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: a1e8b8e638ec438a86f05fa147cdb27c
I20260923 19:50:05.528877 5805 rpcz_store.cc:276] 0923 19:50:04.423044 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.483081 (+1060037us) service_pool.cc:224] Handling call
0923 19:50:05.483845 (+ 764us) catalog_manager.cc:2140] Acquired catalog manager lock
0923 19:50:05.484423 (+ 578us) catalog_manager.cc:2186] Created new table and tablet info
0923 19:50:05.528525 (+ 44102us) catalog_manager.cc:2246] Wrote table and tablets to system table
0923 19:50:05.528624 (+ 99us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0923 19:50:05.528706 (+ 82us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0923 19:50:05.484935 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0923 19:50:05.485031 (+ 96us) write_op.cc:432] Acquiring schema lock in shared mode
0923 19:50:05.485036 (+ 5us) write_op.cc:435] Acquired schema lock
0923 19:50:05.485038 (+ 2us) tablet.cc:662] Decoding operations
0923 19:50:05.485520 (+ 482us) write_op.cc:620] Acquiring the partition lock for write op
0923 19:50:05.485530 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0923 19:50:05.485536 (+ 6us) tablet.cc:685] Acquiring locks for 2 operations
0923 19:50:05.485637 (+ 101us) tablet.cc:701] Row locks acquired
0923 19:50:05.485640 (+ 3us) write_op.cc:260] PREPARE: finished
0923 19:50:05.485677 (+ 37us) write_op.cc:270] Start()
0923 19:50:05.485707 (+ 30us) write_op.cc:276] Timestamp: P: 1790193005485625 usec, L: 0
0923 19:50:05.485711 (+ 4us) op_driver.cc:348] REPLICATION: starting
0923 19:50:05.485913 (+ 202us) log.cc:844] Serialized 433 byte log entry
0923 19:50:05.527365 (+ 41452us) op_driver.cc:464] REPLICATION: finished
0923 19:50:05.528131 (+ 766us) write_op.cc:301] APPLY: starting
0923 19:50:05.528143 (+ 12us) tablet.cc:1394] starting BulkCheckPresence
0923 19:50:05.528172 (+ 29us) tablet.cc:1397] finished BulkCheckPresence
0923 19:50:05.528198 (+ 26us) tablet.cc:1399] starting ApplyRowOperation cycle
0923 19:50:05.528299 (+ 101us) tablet.cc:1410] finished ApplyRowOperation cycle
0923 19:50:05.528323 (+ 24us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0923 19:50:05.528331 (+ 8us) write_op.cc:312] APPLY: finished
0923 19:50:05.528400 (+ 69us) log.cc:844] Serialized 29 byte log entry
0923 19:50:05.528438 (+ 38us) write_op.cc:489] Releasing partition, row and schema locks
0923 19:50:05.528450 (+ 12us) write_op.cc:454] Released schema lock
0923 19:50:05.528454 (+ 4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":732,"apply.run_cpu_time_us":375,"apply.run_wall_time_us":374,"num_ops":2,"prepare.queue_time_us":64,"prepare.run_cpu_time_us":1069,"prepare.run_wall_time_us":1081,"raft.queue_time_us":727,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":100,"replication_time_us":41633,"spinlock_wait_cycles":204160}]]}
I20260923 19:50:05.530602 5800 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:59912 (request call id 433) took 1152 ms. Trace:
I20260923 19:50:05.530717 5800 rpcz_store.cc:276] 0923 19:50:04.378299 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.480485 (+1102186us) service_pool.cc:224] Handling call
0923 19:50:05.481379 (+ 894us) catalog_manager.cc:2140] Acquired catalog manager lock
0923 19:50:05.481848 (+ 469us) catalog_manager.cc:2186] Created new table and tablet info
0923 19:50:05.530381 (+ 48533us) catalog_manager.cc:2246] Wrote table and tablets to system table
0923 19:50:05.530474 (+ 93us) catalog_manager.cc:2280] Inserted table and tablets into CatalogManager maps
0923 19:50:05.530570 (+ 96us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0923 19:50:05.482465 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0923 19:50:05.482606 (+ 141us) write_op.cc:432] Acquiring schema lock in shared mode
0923 19:50:05.482615 (+ 9us) write_op.cc:435] Acquired schema lock
0923 19:50:05.482619 (+ 4us) tablet.cc:662] Decoding operations
0923 19:50:05.482757 (+ 138us) write_op.cc:620] Acquiring the partition lock for write op
0923 19:50:05.482774 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0923 19:50:05.482778 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0923 19:50:05.482856 (+ 78us) tablet.cc:701] Row locks acquired
0923 19:50:05.482859 (+ 3us) write_op.cc:260] PREPARE: finished
0923 19:50:05.482896 (+ 37us) write_op.cc:270] Start()
0923 19:50:05.482931 (+ 35us) write_op.cc:276] Timestamp: P: 1790193005482849 usec, L: 0
0923 19:50:05.482934 (+ 3us) op_driver.cc:348] REPLICATION: starting
0923 19:50:05.483126 (+ 192us) log.cc:844] Serialized 433 byte log entry
0923 19:50:05.527234 (+ 44108us) op_driver.cc:464] REPLICATION: finished
0923 19:50:05.527453 (+ 219us) write_op.cc:301] APPLY: starting
0923 19:50:05.527468 (+ 15us) tablet.cc:1394] starting BulkCheckPresence
0923 19:50:05.527516 (+ 48us) tablet.cc:1397] finished BulkCheckPresence
0923 19:50:05.527590 (+ 74us) tablet.cc:1399] starting ApplyRowOperation cycle
0923 19:50:05.527769 (+ 179us) tablet.cc:1410] finished ApplyRowOperation cycle
0923 19:50:05.527812 (+ 43us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0923 19:50:05.527819 (+ 7us) write_op.cc:312] APPLY: finished
0923 19:50:05.527899 (+ 80us) log.cc:844] Serialized 29 byte log entry
0923 19:50:05.527966 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0923 19:50:05.527983 (+ 17us) write_op.cc:454] Released schema lock
0923 19:50:05.527989 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0923 19:50:05.528059 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0923 19:50:05.528064 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":159,"apply.run_cpu_time_us":597,"apply.run_wall_time_us":598,"num_ops":2,"prepare.queue_time_us":53,"prepare.run_cpu_time_us":777,"prepare.run_wall_time_us":778,"raft.queue_time_us":3480,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":253,"replication_time_us":44263}]]}
I20260923 19:50:05.533499 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 684eb2576b4b4730813b993e36b242df (DEFAULT_TABLE table=default.Table_af4eb1297d19460fade71cf33df073a4 [id=9673e7b97bef46628623a1926735866e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.534006 6027 tablet_service.cc:1511] Processing CreateTablet for tablet 0c537304c32c44adaa1e05de4496293f (DEFAULT_TABLE table=default.Table_5febe26a78884634a01aa0ec62f36604 [id=e2a29fc060074c45918b97001dd03207]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.534289 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 601a0ff319cc4c9a898d52bbcb19184b
I20260923 19:50:05.534752 5803 catalog_manager.cc:6934] ReplaceTablet: tablet 601a0ff319cc4c9a898d52bbcb19184b deleted and replaced by tablet 02fa9052a7054659baf9b07b770bb538
W20260923 19:50:05.536643 5802 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8d87f05f29bd476386ff6516676ce31a consensus state has no leader
I20260923 19:50:05.536829 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 237) took 2109 ms. Trace:
I20260923 19:50:05.536950 6461 rpcz_store.cc:276] 0923 19:50:03.387369 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.387415 (+ 46us) service_pool.cc:224] Handling call
0923 19:50:04.840431 (+1453016us) ts_tablet_manager.cc:1151] Deleting tablet 033c2d772c8a44d2a0e671664bb9085d
0923 19:50:04.840444 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.183900 (+343456us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.329777 (+145877us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.497120 (+167343us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1452772}
I20260923 19:50:05.537249 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_9f93fd5514734871bf6a205b82e6e8ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:05.537595 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_8e3f5612c14448349fdc0fddeaead3d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:05.537846 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f93fd5514734871bf6a205b82e6e8ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:05.538022 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e3f5612c14448349fdc0fddeaead3d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:05.537835 6456 tablet_bootstrap.cc:492] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:05.538635 6456 ts_tablet_manager.cc:1403] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.005s
I20260923 19:50:05.539125 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_63a3afc2f4ac454cb8bb6551ba17376c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:05.539179 6023 tablet_service.cc:1511] Processing CreateTablet for tablet d35ff653bf8d41cfbcf83359402a8f6a (DEFAULT_TABLE table=default.Table_f8ddcdb63fd04bd7b8f2a95e97e449bf [id=3c751273c2a044e09499b3a07044b3db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.535254 6040 tablet_service.cc:1511] Processing CreateTablet for tablet 528fca12bfe04747830ad1d3bb323676 (DEFAULT_TABLE table=default.Table_141fc144025e434aa7d7a6e0ecb9c98d [id=f4622a8ebb6644cba5c5c4d18a9a22f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.539459 6456 raft_consensus.cc:359] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:05.539568 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63a3afc2f4ac454cb8bb6551ba17376c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:05.539559 6178 tablet_service.cc:1558] Processing DeleteTablet for tablet e1de117713f34b51bbda0c712f0b837c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:05.539655 6456 raft_consensus.cc:385] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:05.539722 6456 raft_consensus.cc:740] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:05.539069 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet 2948d729e1ec4dfca70789bcad513e52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:05.540357 5799 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1b1d9413e1e24547b491a160d851377b consensus state has no leader
I20260923 19:50:05.542135 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c537304c32c44adaa1e05de4496293f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.542996 6456 consensus_queue.cc:260] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.544220 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet 601a0ff319cc4c9a898d52bbcb19184b with delete_type TABLET_DATA_DELETED (replaced by tablet 02fa9052a7054659baf9b07b770bb538) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:05.546054 6461 tablet_replica.cc:333] T 6e726ee6a5494fd4b72c1ebef7d66b42 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:05.546257 6461 raft_consensus.cc:2243] T 6e726ee6a5494fd4b72c1ebef7d66b42 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:05.546440 6461 raft_consensus.cc:2272] T 6e726ee6a5494fd4b72c1ebef7d66b42 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:05.546988 6461 ts_tablet_manager.cc:1916] T 6e726ee6a5494fd4b72c1ebef7d66b42 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:05.547168 6032 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56924 (request call id 307) took 1092 ms. Trace:
I20260923 19:50:05.547291 6032 rpcz_store.cc:276] 0923 19:50:04.445828 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:04.780801 (+334973us) service_pool.cc:224] Handling call
0923 19:50:04.856652 (+ 75851us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0923 19:50:04.856697 (+ 45us) ts_tablet_manager.cc:682] Creating new metadata...
0923 19:50:05.068028 (+211331us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.537711 (+469683us) tablet_replica.cc:206] Creating consensus instance
0923 19:50:05.538756 (+ 1045us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260923 19:50:05.548487 6021 tablet_service.cc:1511] Processing CreateTablet for tablet a10d35bf564d45488524d3d21721f4e5 (DEFAULT_TABLE table=default.Table_c670311ee64c4e728677dc29691ea3f9 [id=fa0ce77597ba4d37aca817429efd86b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.549167 6057 raft_consensus.cc:2468] T b2762648045b4378bcc2c1234460c352 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:05.549418 6040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 528fca12bfe04747830ad1d3bb323676. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.550194 6023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d35ff653bf8d41cfbcf83359402a8f6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.550498 6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a10d35bf564d45488524d3d21721f4e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.551481 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 684eb2576b4b4730813b993e36b242df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.554267 6456 ts_tablet_manager.cc:1434] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260923 19:50:05.556346 6032 tablet_service.cc:1511] Processing CreateTablet for tablet 1c43641327d14a888a2815e49a2762c8 (DEFAULT_TABLE table=default.Table_ceca0c9fd74649909ccd0fd70d2ccca0 [id=923a67e6f6534f4da28ce819cecd9171]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.556787 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c43641327d14a888a2815e49a2762c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.557426 6457 tablet_bootstrap.cc:492] T f2d9f1a0fae849ae8083eba082055fe9 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:05.557588 6457 ts_tablet_manager.cc:1403] T f2d9f1a0fae849ae8083eba082055fe9 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.274s user 0.008s sys 0.004s
I20260923 19:50:05.558837 6031 tablet_service.cc:1511] Processing CreateTablet for tablet e1de117713f34b51bbda0c712f0b837c (DEFAULT_TABLE table=default.Table_9d716833c456436cbc514b6a9070c9e1 [id=e3fafc4359af49c88437fb5815526518]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.558948 6454 tablet_bootstrap.cc:492] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:05.559103 6454 ts_tablet_manager.cc:1403] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.269s user 0.008s sys 0.007s
I20260923 19:50:05.559213 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1de117713f34b51bbda0c712f0b837c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.559896 6454 raft_consensus.cc:359] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.560099 6454 raft_consensus.cc:385] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:05.560197 6454 raft_consensus.cc:740] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
W20260923 19:50:05.560216 5804 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d6d3601a392f4723b4ca00f6e12b950c consensus state has no leader
I20260923 19:50:05.560899 6454 consensus_queue.cc:260] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.561134 6025 tablet_service.cc:1558] Processing DeleteTablet for tablet 235b4b8081ad4a13937a7941344dbc33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:04 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:05.562129 6728 raft_consensus.cc:493] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:05.562294 6728 raft_consensus.cc:515] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.562978 6728 leader_election.cc:290] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:05.563587 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063fc0e77d294ddf8a02e9ab5968a5e3" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:05.564096 6280 leader_election.cc:343] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:05.565224 6025 tablet_service.cc:1558] Processing DeleteTablet for tablet 870db252d8414be7bbe613ea467b5f3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:05.565688 6456 tablet_bootstrap.cc:492] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:05.565688 6025 tablet_service.cc:1558] Processing DeleteTablet for tablet e1de117713f34b51bbda0c712f0b837c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:05.565834 6457 raft_consensus.cc:359] T f2d9f1a0fae849ae8083eba082055fe9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.566032 6457 raft_consensus.cc:385] T f2d9f1a0fae849ae8083eba082055fe9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:05.566179 6457 raft_consensus.cc:740] T f2d9f1a0fae849ae8083eba082055fe9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:05.566381 6457 consensus_queue.cc:260] T f2d9f1a0fae849ae8083eba082055fe9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.572754 6456 tablet_bootstrap.cc:654] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:05.574723 6458 ts_tablet_manager.cc:1929] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:05.574874 6458 log.cc:1199] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/64a38bbd3fbd4738a73e78e3f6436fe5
I20260923 19:50:05.575366 6458 ts_tablet_manager.cc:1950] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:05.575836 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_eb265406b1504d7b87248e40a9fb5ce2" } new_table_name: "default.Table_b6d74978fafc4efb936873a5b5be74db" modify_external_catalogs: true
I20260923 19:50:05.576223 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 125) took 4352 ms. Trace:
I20260923 19:50:05.576326 6458 rpcz_store.cc:276] 0923 19:50:01.223497 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:01.236482 (+ 12985us) service_pool.cc:224] Handling call
0923 19:50:05.493950 (+4257468us) ts_tablet_manager.cc:1151] Deleting tablet 64a38bbd3fbd4738a73e78e3f6436fe5
0923 19:50:05.493959 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.532794 (+ 38835us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.574651 (+ 41857us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.576164 (+ 1513us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3984863}
I20260923 19:50:05.576794 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 132) took 4068 ms. Trace:
I20260923 19:50:05.576884 6458 rpcz_store.cc:276] 0923 19:50:01.508252 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:01.508298 (+ 46us) service_pool.cc:224] Handling call
0923 19:50:05.576597 (+4068299us) ts_tablet_manager.cc:1151] Deleting tablet 789c54477bec4636bb3669e1f62730e2
0923 19:50:05.576607 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.576737 (+ 130us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4064817}
I20260923 19:50:05.577153 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_98e62ec3560b4093bdac39551e2c715f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:05.577266 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 131) took 4070 ms. Trace:
I20260923 19:50:05.577359 6458 rpcz_store.cc:276] 0923 19:50:01.506992 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:01.507440 (+ 448us) service_pool.cc:224] Handling call
0923 19:50:05.577125 (+4069685us) ts_tablet_manager.cc:1151] Deleting tablet 3190d18f00234d71b0a58c2c334ef45f
0923 19:50:05.577135 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.577214 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4064452}
W20260923 19:50:05.577714 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_98e62ec3560b4093bdac39551e2c715f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:05.577719 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 133) took 4065 ms. Trace:
I20260923 19:50:05.579118 6454 ts_tablet_manager.cc:1434] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.020s user 0.000s sys 0.003s
I20260923 19:50:05.579514 6454 tablet_bootstrap.cc:492] T f7e282b6699a4ce9837d221132a1f54e P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:05.579762 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 64a38bbd3fbd4738a73e78e3f6436fe5 (table default.Table_286d831d3cff4c89b493d45f28acbca2 [id=f02b0dcd479d46fea2683769212f2f40]) successfully deleted
I20260923 19:50:05.581144 6454 tablet_bootstrap.cc:654] T f7e282b6699a4ce9837d221132a1f54e P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:05.582433 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 789c54477bec4636bb3669e1f62730e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 789c54477bec4636bb3669e1f62730e2 already in progress: creating tablet
W20260923 19:50:05.584913 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 3190d18f00234d71b0a58c2c334ef45f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3190d18f00234d71b0a58c2c334ef45f already in progress: creating tablet
I20260923 19:50:05.587677 6459 ts_tablet_manager.cc:1916] T 32c8333073574fe79bfc3e33f3249256 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:05.589900 5800 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f1c1d4f73488499a9e5add81e9d5e2d6 has no consensus state
I20260923 19:50:05.577816 6458 rpcz_store.cc:276] 0923 19:50:01.512140 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:01.512226 (+ 86us) service_pool.cc:224] Handling call
0923 19:50:05.577573 (+4065347us) ts_tablet_manager.cc:1151] Deleting tablet f108ebdaecab42e7b57057c7ecfbe690
0923 19:50:05.577580 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.577654 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4061895}
W20260923 19:50:05.599623 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet f108ebdaecab42e7b57057c7ecfbe690 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f108ebdaecab42e7b57057c7ecfbe690 already in progress: creating tablet
I20260923 19:50:05.601083 6456 tablet_bootstrap.cc:492] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:05.601289 6456 ts_tablet_manager.cc:1403] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.002s
I20260923 19:50:05.602213 6456 raft_consensus.cc:359] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.602388 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 142) took 3897 ms. Trace:
I20260923 19:50:05.602469 6456 raft_consensus.cc:385] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:05.602653 6456 raft_consensus.cc:740] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
W20260923 19:50:05.604204 6280 consensus_peers.cc:597] T b302820d329a41f0a9a54501c079fcd7 P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:05.604486 6456 consensus_queue.cc:260] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.607910 6728 raft_consensus.cc:493] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:05.608065 6728 raft_consensus.cc:515] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.608721 6728 leader_election.cc:290] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:05.609419 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e726ee6a5494fd4b72c1ebef7d66b42" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:05.610337 6280 leader_election.cc:343] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:05.612396 6456 ts_tablet_manager.cc:1434] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260923 19:50:05.615720 6456 tablet_bootstrap.cc:492] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:05.617537 6456 tablet_bootstrap.cc:654] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:05.602507 6458 rpcz_store.cc:276] 0923 19:50:01.704728 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:01.706467 (+ 1739us) service_pool.cc:224] Handling call
0923 19:50:05.602182 (+3895715us) ts_tablet_manager.cc:1151] Deleting tablet 015c14b447fe4cd18d197b2d1ed5884e
0923 19:50:05.602192 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.602328 (+ 136us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3882387}
I20260923 19:50:05.619127 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 143) took 3881 ms. Trace:
W20260923 19:50:05.619238 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 015c14b447fe4cd18d197b2d1ed5884e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 015c14b447fe4cd18d197b2d1ed5884e already in progress: creating tablet
I20260923 19:50:05.619297 6458 rpcz_store.cc:276] 0923 19:50:01.737607 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:01.744185 (+ 6578us) service_pool.cc:224] Handling call
0923 19:50:05.618926 (+3874741us) ts_tablet_manager.cc:1151] Deleting tablet 9101e82501fd461f8a4b2dcd9dffbd74
0923 19:50:05.618935 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.619069 (+ 134us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3874464}
I20260923 19:50:05.619702 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 144) took 3875 ms. Trace:
W20260923 19:50:05.619815 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 9101e82501fd461f8a4b2dcd9dffbd74 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9101e82501fd461f8a4b2dcd9dffbd74 already in progress: creating tablet
I20260923 19:50:05.619792 6458 rpcz_store.cc:276] 0923 19:50:01.744353 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:01.744442 (+ 89us) service_pool.cc:224] Handling call
0923 19:50:05.619553 (+3875111us) ts_tablet_manager.cc:1151] Deleting tablet 5c0142f4e3ad42048803481d68f0ee5d
0923 19:50:05.619561 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.619637 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3874872}
I20260923 19:50:05.620144 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 148) took 3648 ms. Trace:
I20260923 19:50:05.620240 6458 rpcz_store.cc:276] 0923 19:50:01.971245 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:01.972784 (+ 1539us) service_pool.cc:224] Handling call
0923 19:50:05.620011 (+3647227us) ts_tablet_manager.cc:1151] Deleting tablet 623fb5b761134951a4b742ab2ba480a4
0923 19:50:05.620019 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.620087 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3646953}
I20260923 19:50:05.620566 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 150) took 3595 ms. Trace:
I20260923 19:50:05.620637 6458 rpcz_store.cc:276] 0923 19:50:02.024896 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:02.024947 (+ 51us) service_pool.cc:224] Handling call
0923 19:50:05.620448 (+3595501us) ts_tablet_manager.cc:1151] Deleting tablet 6fe14389e2a3487587dfcf7a8b4b242d
0923 19:50:05.620456 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.620524 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3595279}
W20260923 19:50:05.621472 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 5c0142f4e3ad42048803481d68f0ee5d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c0142f4e3ad42048803481d68f0ee5d already in progress: creating tablet
W20260923 19:50:05.621810 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 6fe14389e2a3487587dfcf7a8b4b242d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6fe14389e2a3487587dfcf7a8b4b242d already in progress: creating tablet
I20260923 19:50:05.620980 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 149) took 3596 ms. Trace:
I20260923 19:50:05.622072 6458 rpcz_store.cc:276] 0923 19:50:02.024794 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:02.025667 (+ 873us) service_pool.cc:224] Handling call
0923 19:50:05.620848 (+3595181us) ts_tablet_manager.cc:1151] Deleting tablet b4fc995819cc40bf9956d85966bcd330
0923 19:50:05.620855 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.620933 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3594996}
I20260923 19:50:05.622476 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 151) took 3578 ms. Trace:
I20260923 19:50:05.622568 6458 rpcz_store.cc:276] 0923 19:50:02.043754 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:02.043842 (+ 88us) service_pool.cc:224] Handling call
0923 19:50:05.622339 (+3578497us) ts_tablet_manager.cc:1151] Deleting tablet e9cbfaa34c924a678f23cbcbf1a6fb0a
0923 19:50:05.622348 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.622425 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3566146}
I20260923 19:50:05.622872 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 153) took 3497 ms. Trace:
W20260923 19:50:05.622992 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet b4fc995819cc40bf9956d85966bcd330 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4fc995819cc40bf9956d85966bcd330 already in progress: creating tablet
I20260923 19:50:05.622929 6458 rpcz_store.cc:276] 0923 19:50:02.125579 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:02.125640 (+ 61us) service_pool.cc:224] Handling call
0923 19:50:05.622764 (+3497124us) ts_tablet_manager.cc:1151] Deleting tablet 033c2d772c8a44d2a0e671664bb9085d
0923 19:50:05.622770 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.622835 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3496894}
I20260923 19:50:05.623723 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 156) took 3486 ms. Trace:
I20260923 19:50:05.623803 6458 rpcz_store.cc:276] 0923 19:50:02.137596 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:02.137657 (+ 61us) service_pool.cc:224] Handling call
0923 19:50:05.623576 (+3485919us) ts_tablet_manager.cc:1151] Deleting tablet 2ccfe6531fc44f86a0edc8bda1547442
0923 19:50:05.623586 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.623671 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3485631}
I20260923 19:50:05.624166 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 154) took 3488 ms. Trace:
I20260923 19:50:05.624241 6458 rpcz_store.cc:276] 0923 19:50:02.135677 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:02.135752 (+ 75us) service_pool.cc:224] Handling call
0923 19:50:05.624029 (+3488277us) ts_tablet_manager.cc:1151] Deleting tablet 495292cacf3b42a5b633ad40e5e01972
0923 19:50:05.624037 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.624105 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3473726}
I20260923 19:50:05.624574 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 157) took 3474 ms. Trace:
I20260923 19:50:05.624647 6458 rpcz_store.cc:276] 0923 19:50:02.150544 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:02.150598 (+ 54us) service_pool.cc:224] Handling call
0923 19:50:05.624449 (+3473851us) ts_tablet_manager.cc:1151] Deleting tablet 4b15b250f594459eb959b4871f7ae398
0923 19:50:05.624457 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.624532 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3473574}
I20260923 19:50:05.624897 6458 tablet_replica.cc:333] T 259e4faa58f549699538317019be5daf P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:05.625067 6458 raft_consensus.cc:2243] T 259e4faa58f549699538317019be5daf P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:05.625291 6458 raft_consensus.cc:2272] T 259e4faa58f549699538317019be5daf P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:05.625815 6458 ts_tablet_manager.cc:1916] T 259e4faa58f549699538317019be5daf P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:05.626098 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet 601a0ff319cc4c9a898d52bbcb19184b with delete_type TABLET_DATA_DELETED (replaced by tablet 02fa9052a7054659baf9b07b770bb538) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:05.626402 5952 log.cc:927] Time spent T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae: Append to log took a long time: real 0.107s user 0.000s sys 0.000s
W20260923 19:50:05.626417 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet e9cbfaa34c924a678f23cbcbf1a6fb0a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9cbfaa34c924a678f23cbcbf1a6fb0a already in progress: creating tablet
W20260923 19:50:05.626664 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 033c2d772c8a44d2a0e671664bb9085d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 033c2d772c8a44d2a0e671664bb9085d already in progress: creating tablet
W20260923 19:50:05.626894 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 2ccfe6531fc44f86a0edc8bda1547442 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ccfe6531fc44f86a0edc8bda1547442 already in progress: creating tablet
W20260923 19:50:05.627228 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 4b15b250f594459eb959b4871f7ae398 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b15b250f594459eb959b4871f7ae398 already in progress: creating tablet
I20260923 19:50:05.626900 5804 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet d91a56bace854494b7affd6c766b2847 (table default.Table_b3579cbf488c4d1eb5f605ab4e11c340 [id=a6dbcc9c44fb400b926e21aa6d683186]). Expected version 2 got 0
I20260923 19:50:05.631625 6038 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56924 (request call id 305) took 1185 ms. Trace:
I20260923 19:50:05.632048 5800 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet d91a56bace854494b7affd6c766b2847 (table default.Table_b3579cbf488c4d1eb5f605ab4e11c340 [id=a6dbcc9c44fb400b926e21aa6d683186]). Expected version 2 got 0
I20260923 19:50:05.633661 6180 tablet_service.cc:1511] Processing CreateTablet for tablet f1f1df47dc32413d9cc9456f4198dca5 (DEFAULT_TABLE table=default.Table_e544284af20d48f9a6f3ffe1bd235e41 [id=6d285eda96a948b2b14fa1ef456ca5b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.634142 6025 tablet_service.cc:1558] Processing DeleteTablet for tablet 2948d729e1ec4dfca70789bcad513e52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:05.634570 6454 tablet_bootstrap.cc:492] T f7e282b6699a4ce9837d221132a1f54e P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:05.634732 6454 ts_tablet_manager.cc:1403] T f7e282b6699a4ce9837d221132a1f54e P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.055s user 0.001s sys 0.002s
I20260923 19:50:05.634754 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1f1df47dc32413d9cc9456f4198dca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.635733 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 033c2d772c8a44d2a0e671664bb9085d (table default.Table_423256ac67c24899a4b67915596ef545 [id=c4756b4d81ce4fc2acf001ae879a5c3f]) successfully deleted
I20260923 19:50:05.637632 6660 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" instance_seqno: 1790192996360071) as {username='slave'} at 127.5.143.193:60379; Asking this server to re-register.
I20260923 19:50:05.638341 6057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063fc0e77d294ddf8a02e9ab5968a5e3" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:05.638831 6058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e726ee6a5494fd4b72c1ebef7d66b42" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:05.638988 6459 ts_tablet_manager.cc:1929] T 32c8333073574fe79bfc3e33f3249256 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:05.639092 6459 log.cc:1199] T 32c8333073574fe79bfc3e33f3249256 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/32c8333073574fe79bfc3e33f3249256
I20260923 19:50:05.639425 6459 ts_tablet_manager.cc:1950] T 32c8333073574fe79bfc3e33f3249256 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:05.639607 6105 heartbeater.cc:461] Registering TS with master...
I20260923 19:50:05.640156 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 223) took 2449 ms. Trace:
I20260923 19:50:05.642874 6660 ts_manager.cc:194] Registered new tserver with Master: e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:05.645859 6028 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56924 (request call id 300) took 1206 ms. Trace:
I20260923 19:50:05.646420 6026 tablet_service.cc:1511] Processing CreateTablet for tablet 670d9cb0e6e2414092f72ffd5e6b00ea (DEFAULT_TABLE table=default.Table_109d63d522e24e3b8d45897a9c9ce09f [id=8065910e86444becaf5f982fbdeb2aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.647197 6457 ts_tablet_manager.cc:1434] T f2d9f1a0fae849ae8083eba082055fe9 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260923 19:50:05.647380 6038 rpcz_store.cc:276] 0923 19:50:04.445691 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:04.729211 (+283520us) service_pool.cc:224] Handling call
0923 19:50:04.857216 (+128005us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0923 19:50:04.857243 (+ 27us) ts_tablet_manager.cc:682] Creating new metadata...
0923 19:50:05.325096 (+467853us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.572346 (+247250us) tablet_replica.cc:206] Creating consensus instance
0923 19:50:05.631579 (+ 59233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260923 19:50:05.647575 6025 tablet_service.cc:1558] Processing DeleteTablet for tablet 601a0ff319cc4c9a898d52bbcb19184b with delete_type TABLET_DATA_DELETED (replaced by tablet 02fa9052a7054659baf9b07b770bb538) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:05.628870 6324 tablet_service.cc:1511] Processing CreateTablet for tablet f1f1df47dc32413d9cc9456f4198dca5 (DEFAULT_TABLE table=default.Table_e544284af20d48f9a6f3ffe1bd235e41 [id=6d285eda96a948b2b14fa1ef456ca5b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.647665 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b1601590508479c8f401cd09d9f4c3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:04 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:05.647619 6030 tablet_service.cc:1511] Processing CreateTablet for tablet f1f1df47dc32413d9cc9456f4198dca5 (DEFAULT_TABLE table=default.Table_e544284af20d48f9a6f3ffe1bd235e41 [id=6d285eda96a948b2b14fa1ef456ca5b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.648643 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1f1df47dc32413d9cc9456f4198dca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.647804 6057 raft_consensus.cc:2468] T 063fc0e77d294ddf8a02e9ab5968a5e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:05.647943 6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 670d9cb0e6e2414092f72ffd5e6b00ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.635918 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e8b8e638ec438a86f05fa147cdb27c" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:05.635555 6454 raft_consensus.cc:359] T f7e282b6699a4ce9837d221132a1f54e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.642043 6164 tablet_service.cc:1511] Processing CreateTablet for tablet 670d9cb0e6e2414092f72ffd5e6b00ea (DEFAULT_TABLE table=default.Table_109d63d522e24e3b8d45897a9c9ce09f [id=8065910e86444becaf5f982fbdeb2aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.652104 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 670d9cb0e6e2414092f72ffd5e6b00ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.634918 6279 leader_election.cc:304] T f302f91c8ef44237b1c9909d88dacbff P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:05.654013 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1f1df47dc32413d9cc9456f4198dca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.654336 6279 leader_election.cc:304] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:05.642931 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 670d9cb0e6e2414092f72ffd5e6b00ea (DEFAULT_TABLE table=default.Table_109d63d522e24e3b8d45897a9c9ce09f [id=8065910e86444becaf5f982fbdeb2aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.655069 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 670d9cb0e6e2414092f72ffd5e6b00ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.658042 6814 raft_consensus.cc:2804] T f302f91c8ef44237b1c9909d88dacbff P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:05.658064 6728 raft_consensus.cc:2804] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:05.647990 6028 rpcz_store.cc:276] 0923 19:50:04.439905 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:04.610839 (+170934us) service_pool.cc:224] Handling call
0923 19:50:04.611400 (+ 561us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0923 19:50:04.611427 (+ 27us) ts_tablet_manager.cc:682] Creating new metadata...
0923 19:50:05.350155 (+738728us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.595956 (+245801us) tablet_replica.cc:206] Creating consensus instance
0923 19:50:05.645830 (+ 49874us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260923 19:50:05.664014 6454 raft_consensus.cc:385] T f7e282b6699a4ce9837d221132a1f54e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:05.664152 6454 raft_consensus.cc:740] T f7e282b6699a4ce9837d221132a1f54e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:05.665666 6454 consensus_queue.cc:260] T f7e282b6699a4ce9837d221132a1f54e P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.666236 6454 ts_tablet_manager.cc:1434] T f7e282b6699a4ce9837d221132a1f54e P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.031s user 0.003s sys 0.000s
I20260923 19:50:05.666524 6454 tablet_bootstrap.cc:492] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:05.667830 6646 raft_consensus.cc:493] T f7e282b6699a4ce9837d221132a1f54e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:05.668018 6457 tablet_bootstrap.cc:492] T a224ae69503e4ab588d6269086317f09 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:05.668036 6646 raft_consensus.cc:515] T f7e282b6699a4ce9837d221132a1f54e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.668824 6646 leader_election.cc:290] T f7e282b6699a4ce9837d221132a1f54e P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:05.670223 6139 leader_election.cc:343] T f7e282b6699a4ce9837d221132a1f54e P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: f7e282b6699a4ce9837d221132a1f54e
I20260923 19:50:05.670533 6457 tablet_bootstrap.cc:654] T a224ae69503e4ab588d6269086317f09 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:05.671514 6137 leader_election.cc:343] T f7e282b6699a4ce9837d221132a1f54e P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: f7e282b6699a4ce9837d221132a1f54e
I20260923 19:50:05.671653 6454 tablet_bootstrap.cc:654] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:05.671657 6137 leader_election.cc:304] T f7e282b6699a4ce9837d221132a1f54e P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:05.672709 6646 raft_consensus.cc:2749] T f7e282b6699a4ce9837d221132a1f54e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:05.675678 6867 consensus_queue.cc:1048] T b302820d329a41f0a9a54501c079fcd7 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:05.676050 6728 raft_consensus.cc:697] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:05.676080 6461 ts_tablet_manager.cc:1929] T 6e726ee6a5494fd4b72c1ebef7d66b42 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:05.676199 6461 log.cc:1199] T 6e726ee6a5494fd4b72c1ebef7d66b42 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/6e726ee6a5494fd4b72c1ebef7d66b42
I20260923 19:50:05.676504 6728 consensus_queue.cc:237] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.677946 6459 rpcz_store.cc:276] 0923 19:50:03.191034 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.191149 (+ 115us) service_pool.cc:224] Handling call
0923 19:50:05.385015 (+2193866us) ts_tablet_manager.cc:1151] Deleting tablet 32c8333073574fe79bfc3e33f3249256
0923 19:50:05.385024 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.595579 (+210555us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.638901 (+ 43322us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.640119 (+ 1218us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2193624}
I20260923 19:50:05.678539 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 32c8333073574fe79bfc3e33f3249256 (table default.Table_61c4c80bb6264458b904d9b0322596c0 [id=3fb7e854da784756b57db432e6c373db]) successfully deleted
I20260923 19:50:05.678978 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 225) took 2456 ms. Trace:
I20260923 19:50:05.679133 6459 rpcz_store.cc:276] 0923 19:50:03.222734 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.236798 (+ 14064us) service_pool.cc:224] Handling call
0923 19:50:05.678841 (+2442043us) ts_tablet_manager.cc:1151] Deleting tablet 7504a2be25b54ed4bc539eb10199fe15
0923 19:50:05.678852 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.678949 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2441798}
W20260923 19:50:05.679625 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 7504a2be25b54ed4bc539eb10199fe15 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7504a2be25b54ed4bc539eb10199fe15 already in progress: creating tablet
I20260923 19:50:05.680038 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 226) took 2439 ms. Trace:
I20260923 19:50:05.680202 6459 rpcz_store.cc:276] 0923 19:50:03.240425 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.240488 (+ 63us) service_pool.cc:224] Handling call
0923 19:50:05.679901 (+2439413us) ts_tablet_manager.cc:1151] Deleting tablet 194494af2c424a55a772f3858af63c2c
0923 19:50:05.679910 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.680004 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2439151}
W20260923 19:50:05.680706 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 194494af2c424a55a772f3858af63c2c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 194494af2c424a55a772f3858af63c2c already in progress: creating tablet
I20260923 19:50:05.680892 6461 ts_tablet_manager.cc:1950] T 6e726ee6a5494fd4b72c1ebef7d66b42 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:05.681056 6459 tablet_replica.cc:333] T 2f78261842744af08d86da64d37d708c P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:05.681396 6459 raft_consensus.cc:2243] T 2f78261842744af08d86da64d37d708c P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:05.682281 6459 raft_consensus.cc:2272] T 2f78261842744af08d86da64d37d708c P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:05.677016 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet 3190d18f00234d71b0a58c2c334ef45f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:05.684830 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 9c4a200d16464676976694656cbe28e2 (DEFAULT_TABLE table=default.Table_125b7d46aef24091b6bc3c8e39e3dd99 [id=5f2289c487ba40b9b7954c9d56918687]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.685302 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4a200d16464676976694656cbe28e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.686860 6324 tablet_service.cc:1511] Processing CreateTablet for tablet 92f94b93d1364bb1a2562eb577707cf1 (DEFAULT_TABLE table=default.Table_da77a1d14aed4fba88200eb53fd16559 [id=54986bca912743be8c7e5bcb2627d151]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:05.687103 5995 leader_election.cc:343] T a1e8b8e638ec438a86f05fa147cdb27c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:05.687243 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92f94b93d1364bb1a2562eb577707cf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.687255 5995 leader_election.cc:304] T a1e8b8e638ec438a86f05fa147cdb27c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:05.689859 5805 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5c35e08897f74660ad23df9a2c751741" } modify_external_catalogs: true
I20260923 19:50:05.690023 6773 raft_consensus.cc:2749] T a1e8b8e638ec438a86f05fa147cdb27c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260923 19:50:05.690090 5805 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5c35e08897f74660ad23df9a2c751741" } modify_external_catalogs: true
I20260923 19:50:05.689772 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_d115f4f641e04087a0ed990be1431c58"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:05.690584 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 231) took 2325 ms. Trace:
W20260923 19:50:05.690649 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d115f4f641e04087a0ed990be1431c58 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:05.690703 6461 rpcz_store.cc:276] 0923 19:50:03.365094 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.365140 (+ 46us) service_pool.cc:224] Handling call
0923 19:50:05.537262 (+2172122us) ts_tablet_manager.cc:1151] Deleting tablet 6e726ee6a5494fd4b72c1ebef7d66b42
0923 19:50:05.538613 (+ 1351us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.610722 (+ 72109us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.675990 (+ 65268us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.690547 (+ 14557us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2516,"tablet-delete.queue_time_us":2148503}
I20260923 19:50:05.691124 6461 tablet_replica.cc:333] T 87afbdb11c6e4e58affd2f2d7995e1f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:05.691341 6461 raft_consensus.cc:2243] T 87afbdb11c6e4e58affd2f2d7995e1f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:05.691424 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b7610081818744a5b76680621ab7212d" } modify_external_catalogs: true
I20260923 19:50:05.691587 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b7610081818744a5b76680621ab7212d" } modify_external_catalogs: true
I20260923 19:50:05.691634 6461 raft_consensus.cc:2272] T 87afbdb11c6e4e58affd2f2d7995e1f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:05.690112 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_c4d3bcab16044711b665673ef8cfa646" } new_table_name: "default.Table_412c7972d6ad4c9c9e44ad5763e7a6c7" modify_external_catalogs: true
I20260923 19:50:05.696532 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_76b550f8599f4650b443c16ae2483ba8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:05.697193 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_76b550f8599f4650b443c16ae2483ba8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:05.698611 6022 tablet_service.cc:1558] Processing DeleteTablet for tablet f2d9f1a0fae849ae8083eba082055fe9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:00 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:05.699811 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 9c4a200d16464676976694656cbe28e2 (DEFAULT_TABLE table=default.Table_125b7d46aef24091b6bc3c8e39e3dd99 [id=5f2289c487ba40b9b7954c9d56918687]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.684264 6164 tablet_service.cc:1511] Processing CreateTablet for tablet 9c4a200d16464676976694656cbe28e2 (DEFAULT_TABLE table=default.Table_125b7d46aef24091b6bc3c8e39e3dd99 [id=5f2289c487ba40b9b7954c9d56918687]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:05.685714 6137 consensus_peers.cc:597] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c52da04e5fe0454ea76bf4d99a930fd7. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:05.700850 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4a200d16464676976694656cbe28e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.686121 6454 tablet_bootstrap.cc:492] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:05.686479 6180 tablet_service.cc:1511] Processing CreateTablet for tablet 92f94b93d1364bb1a2562eb577707cf1 (DEFAULT_TABLE table=default.Table_da77a1d14aed4fba88200eb53fd16559 [id=54986bca912743be8c7e5bcb2627d151]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.701427 6454 ts_tablet_manager.cc:1403] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.001s
I20260923 19:50:05.702231 6454 raft_consensus.cc:359] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.703877 6459 ts_tablet_manager.cc:1916] T 2f78261842744af08d86da64d37d708c P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:05.704037 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 7e41501bf01e4765853c27e4cac21e2b
I20260923 19:50:05.705276 6316 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e41501bf01e4765853c27e4cac21e2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:05.702423 6454 raft_consensus.cc:385] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:05.705833 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e41501bf01e4765853c27e4cac21e2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:05.709714 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4a200d16464676976694656cbe28e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.709764 6454 raft_consensus.cc:740] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:05.710304 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92f94b93d1364bb1a2562eb577707cf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.721019 6461 ts_tablet_manager.cc:1916] T 87afbdb11c6e4e58affd2f2d7995e1f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:05.727041 6646 raft_consensus.cc:493] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:05.727412 6457 tablet_bootstrap.cc:492] T a224ae69503e4ab588d6269086317f09 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:05.727573 6457 ts_tablet_manager.cc:1403] T a224ae69503e4ab588d6269086317f09 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.060s user 0.004s sys 0.000s
I20260923 19:50:05.728348 6457 raft_consensus.cc:359] T a224ae69503e4ab588d6269086317f09 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.728538 6457 raft_consensus.cc:385] T a224ae69503e4ab588d6269086317f09 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:05.728612 6457 raft_consensus.cc:740] T a224ae69503e4ab588d6269086317f09 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:05.733321 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 92f94b93d1364bb1a2562eb577707cf1 (DEFAULT_TABLE table=default.Table_da77a1d14aed4fba88200eb53fd16559 [id=54986bca912743be8c7e5bcb2627d151]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.733853 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92f94b93d1364bb1a2562eb577707cf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.733805 6164 tablet_service.cc:1511] Processing CreateTablet for tablet 397ec5e49673406cb26a2efab0ad8401 (DEFAULT_TABLE table=default.Table_b615fa2da8c94949bed2f458156fc128 [id=0b80967a8fb94518ad872fbce9bae934]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.734009 6646 raft_consensus.cc:515] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.737749 6457 consensus_queue.cc:260] T a224ae69503e4ab588d6269086317f09 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.740058 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_a6113d227550419cb7147c6e2f97086c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:05.740077 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e41501bf01e4765853c27e4cac21e2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:05.740612 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6113d227550419cb7147c6e2f97086c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:05.742789 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_d178d42e78ae42b88975c9bc050e0041"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:05.743311 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d178d42e78ae42b88975c9bc050e0041 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:05.744436 5797 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_870cfa1b62c4442d866d3b9b1aec4bc7" } modify_external_catalogs: true
I20260923 19:50:05.744608 5797 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_870cfa1b62c4442d866d3b9b1aec4bc7" } modify_external_catalogs: true
I20260923 19:50:05.746064 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_0b7f0cec058c44798de4db8eeaf31ef4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:05.746198 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_85f67787052f46c2b29555acf4abc05c" } modify_external_catalogs: true
I20260923 19:50:05.746387 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_85f67787052f46c2b29555acf4abc05c" } modify_external_catalogs: true
W20260923 19:50:05.746604 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0b7f0cec058c44798de4db8eeaf31ef4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:05.735042 6454 consensus_queue.cc:260] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.747365 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet b18548ba557f448880c5e617fc03cbe0
I20260923 19:50:05.748086 5796 master_service.cc:960] ReplaceTablet: received request to replace tablet 908596339b2e4f7f8ddb7f9cd5bdcc3e from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:05.749145 6457 ts_tablet_manager.cc:1434] T a224ae69503e4ab588d6269086317f09 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.021s user 0.002s sys 0.000s
W20260923 19:50:05.750591 6137 leader_election.cc:343] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: cc3b6d245c3e40cdabb20d7dcf07ec0e
I20260923 19:50:05.754087 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet b18548ba557f448880c5e617fc03cbe0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:05.754716 6646 leader_election.cc:290] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:05.755851 5804 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_036d9052e0264e978bf3e3698ca8c08b" } modify_external_catalogs: true
I20260923 19:50:05.756042 5804 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_036d9052e0264e978bf3e3698ca8c08b" } modify_external_catalogs: true
I20260923 19:50:05.756616 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_792882a419914f80a8e5bb625dbe633e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:05.757091 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_792882a419914f80a8e5bb625dbe633e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:05.759022 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 397ec5e49673406cb26a2efab0ad8401. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:05.774088 5800 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fc151f4d78344efeada6d6e57af6eb9f consensus state has no leader
I20260923 19:50:05.775106 6022 tablet_service.cc:1511] Processing CreateTablet for tablet 397ec5e49673406cb26a2efab0ad8401 (DEFAULT_TABLE table=default.Table_b615fa2da8c94949bed2f458156fc128 [id=0b80967a8fb94518ad872fbce9bae934]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.775938 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 397ec5e49673406cb26a2efab0ad8401. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.777474 6454 ts_tablet_manager.cc:1434] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.076s user 0.002s sys 0.002s
I20260923 19:50:05.777925 6454 tablet_bootstrap.cc:492] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:05.780045 6454 tablet_bootstrap.cc:654] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:05.785012 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_df1bcb6c01a64dcebb3ce9b719acd5db" } new_table_name: "default.Table_124323035bb7418597ae00063fdffdf2" modify_external_catalogs: true
I20260923 19:50:05.785734 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet b18548ba557f448880c5e617fc03cbe0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:05.786239 6457 tablet_bootstrap.cc:492] T b7f372b952804ac58e602998d9b77d72 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:05.789127 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet cc3b6d245c3e40cdabb20d7dcf07ec0e with delete_type TABLET_DATA_DELETED (replaced by tablet 85d35ebef3c24a2e89233dd900b63513) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:05.789399 6176 tablet_service.cc:1511] Processing CreateTablet for tablet f1c1d4f73488499a9e5add81e9d5e2d6 (DEFAULT_TABLE table=default.Table_b6d74978fafc4efb936873a5b5be74db [id=80e3a84f7199464fa96426daeeeb84cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.790333 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 64e8951eb899461aa9c0b36e3f7555e2 (DEFAULT_TABLE table=default.Table_562543b3ee364c59a1a2a7fd61331c74 [id=d1195b250ce24d589296d3a776339d7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.790977 6178 tablet_service.cc:1558] Processing DeleteTablet for tablet f7e282b6699a4ce9837d221132a1f54e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:05.791610 6176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c1d4f73488499a9e5add81e9d5e2d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.792968 6180 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a5f682ef2794a1fb9f5c4c2c1ee52e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:05.794588 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64e8951eb899461aa9c0b36e3f7555e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.809360 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 64e8951eb899461aa9c0b36e3f7555e2 (DEFAULT_TABLE table=default.Table_562543b3ee364c59a1a2a7fd61331c74 [id=d1195b250ce24d589296d3a776339d7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.809863 6021 tablet_service.cc:1511] Processing CreateTablet for tablet f1c1d4f73488499a9e5add81e9d5e2d6 (DEFAULT_TABLE table=default.Table_b6d74978fafc4efb936873a5b5be74db [id=80e3a84f7199464fa96426daeeeb84cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.810398 6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c1d4f73488499a9e5add81e9d5e2d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.818512 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64e8951eb899461aa9c0b36e3f7555e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.823838 6457 tablet_bootstrap.cc:654] T b7f372b952804ac58e602998d9b77d72 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:05.823989 5799 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_2d93c35dfe11401d8c780bda7643cb4f" } new_table_name: "default.Table_22eef68f3e1e499db53058abaf7b3fab" modify_external_catalogs: true
I20260923 19:50:05.824744 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_c75bb0303c454c888dc2aa0d7b561339"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:05.825316 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c75bb0303c454c888dc2aa0d7b561339 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:05.828773 5792 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet fc151f4d78344efeada6d6e57af6eb9f (table default.Table_412c7972d6ad4c9c9e44ad5763e7a6c7 [id=22bf03cd65ab4346af756b244875c007], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet fc151f4d78344efeada6d6e57af6eb9f consensus state has no leader
I20260923 19:50:05.829500 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_b79ffd6b55d94f789da88e84cb293bb5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:05.829969 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet b18548ba557f448880c5e617fc03cbe0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:05.831096 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b79ffd6b55d94f789da88e84cb293bb5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:05.834597 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet c504ec668a33451fb1249f697bb5e2bb
I20260923 19:50:05.835491 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_145e4ce20b7d428da857269e35bbee83"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:05.835729 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet c504ec668a33451fb1249f697bb5e2bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:05.835577 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet c504ec668a33451fb1249f697bb5e2bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:05.836002 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_145e4ce20b7d428da857269e35bbee83 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:05.840065 6456 tablet_bootstrap.cc:492] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:05.842727 6456 ts_tablet_manager.cc:1403] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.225s user 0.008s sys 0.000s
I20260923 19:50:05.843585 6456 raft_consensus.cc:359] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.843845 6456 raft_consensus.cc:385] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:05.843950 6456 raft_consensus.cc:740] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:05.844290 6456 consensus_queue.cc:260] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.844965 6456 ts_tablet_manager.cc:1434] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:05.845199 6461 ts_tablet_manager.cc:1929] T 87afbdb11c6e4e58affd2f2d7995e1f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:05.845466 6461 log.cc:1199] T 87afbdb11c6e4e58affd2f2d7995e1f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/87afbdb11c6e4e58affd2f2d7995e1f8
I20260923 19:50:05.846176 6461 ts_tablet_manager.cc:1950] T 87afbdb11c6e4e58affd2f2d7995e1f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
W20260923 19:50:05.846380 6139 leader_election.cc:343] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: cc3b6d245c3e40cdabb20d7dcf07ec0e
I20260923 19:50:05.846550 6139 leader_election.cc:304] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:05.846830 6873 raft_consensus.cc:2749] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:05.847330 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 233) took 2479 ms. Trace:
W20260923 19:50:05.850955 6139 consensus_peers.cc:597] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Couldn't send request to peer 2bf41435f70447f19992d368ca6b46bd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4bf129dd52b84a4ea461ec454bc34fe8. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:05.845214 6324 tablet_service.cc:1511] Processing CreateTablet for tablet 397ec5e49673406cb26a2efab0ad8401 (DEFAULT_TABLE table=default.Table_b615fa2da8c94949bed2f458156fc128 [id=0b80967a8fb94518ad872fbce9bae934]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.865206 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 397ec5e49673406cb26a2efab0ad8401. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.868819 6459 ts_tablet_manager.cc:1929] T 2f78261842744af08d86da64d37d708c P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260923 19:50:05.868997 6459 log.cc:1199] T 2f78261842744af08d86da64d37d708c P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/2f78261842744af08d86da64d37d708c
I20260923 19:50:05.869477 6459 ts_tablet_manager.cc:1950] T 2f78261842744af08d86da64d37d708c P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:05.847440 6316 tablet_service.cc:1511] Processing CreateTablet for tablet 64e8951eb899461aa9c0b36e3f7555e2 (DEFAULT_TABLE table=default.Table_562543b3ee364c59a1a2a7fd61331c74 [id=d1195b250ce24d589296d3a776339d7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.870292 6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64e8951eb899461aa9c0b36e3f7555e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.848935 6314 tablet_service.cc:1511] Processing CreateTablet for tablet f1c1d4f73488499a9e5add81e9d5e2d6 (DEFAULT_TABLE table=default.Table_b6d74978fafc4efb936873a5b5be74db [id=80e3a84f7199464fa96426daeeeb84cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:05.874351 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c1d4f73488499a9e5add81e9d5e2d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:05.850699 6319 tablet_service.cc:1558] Processing DeleteTablet for tablet c504ec668a33451fb1249f697bb5e2bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:05.882328 6139 consensus_peers.cc:597] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Couldn't send request to peer 2bf41435f70447f19992d368ca6b46bd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c52da04e5fe0454ea76bf4d99a930fd7. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:05.883338 6454 tablet_bootstrap.cc:492] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:05.883536 6454 ts_tablet_manager.cc:1403] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.106s user 0.004s sys 0.019s
I20260923 19:50:05.884567 6454 raft_consensus.cc:359] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.884809 6454 raft_consensus.cc:385] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:05.884925 6454 raft_consensus.cc:740] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:05.885444 6454 consensus_queue.cc:260] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.885699 6873 raft_consensus.cc:493] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:05.885890 6873 raft_consensus.cc:515] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.886195 6454 ts_tablet_manager.cc:1434] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
W20260923 19:50:05.854825 5996 consensus_peers.cc:597] T e1752d6b46894796bdc94e6230e3327d P e546f660e7e541d1aa9ae38e5ee5b9c0 -> Peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Couldn't send request to peer 2bf41435f70447f19992d368ca6b46bd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e1752d6b46894796bdc94e6230e3327d. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:05.881789 6773 raft_consensus.cc:493] T f2d9f1a0fae849ae8083eba082055fe9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:05.886487 6773 raft_consensus.cc:515] T f2d9f1a0fae849ae8083eba082055fe9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.886672 6873 leader_election.cc:290] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:05.887147 6773 leader_election.cc:290] T f2d9f1a0fae849ae8083eba082055fe9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:05.887446 6461 rpcz_store.cc:276] 0923 19:50:03.368084 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.368441 (+ 357us) service_pool.cc:224] Handling call
0923 19:50:05.691056 (+2322615us) ts_tablet_manager.cc:1151] Deleting tablet 87afbdb11c6e4e58affd2f2d7995e1f8
0923 19:50:05.691066 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.725333 (+ 34267us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.845101 (+119768us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.847256 (+ 2155us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2302122}
W20260923 19:50:05.887633 6139 leader_election.cc:343] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 87afbdb11c6e4e58affd2f2d7995e1f8
I20260923 19:50:05.887959 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 87afbdb11c6e4e58affd2f2d7995e1f8 (table default.Table_f57f5ddf52f541ab91b4a9638fcf81a0 [id=e0da333ed7f44d6aa283da81b1cfbf17]) successfully deleted
I20260923 19:50:05.888625 6461 tablet_replica.cc:333] T 5455beff354a4616a68d8746e3e4f9a8 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:05.888823 6461 raft_consensus.cc:2243] T 5455beff354a4616a68d8746e3e4f9a8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260923 19:50:05.888825 6137 leader_election.cc:343] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 87afbdb11c6e4e58affd2f2d7995e1f8
I20260923 19:50:05.888924 6137 leader_election.cc:304] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:05.889005 6461 raft_consensus.cc:2272] T 5455beff354a4616a68d8746e3e4f9a8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:05.889341 6646 raft_consensus.cc:2749] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:05.889586 6461 ts_tablet_manager.cc:1916] T 5455beff354a4616a68d8746e3e4f9a8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:05.889639 5996 leader_election.cc:343] T f2d9f1a0fae849ae8083eba082055fe9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: f2d9f1a0fae849ae8083eba082055fe9
I20260923 19:50:05.892402 6456 tablet_bootstrap.cc:492] T 033c2d772c8a44d2a0e671664bb9085d P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
W20260923 19:50:05.897933 6279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.143.193:39887, user_credentials={real_user=slave}} blocked reactor thread for 186920us
W20260923 19:50:05.899801 6279 leader_election.cc:343] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Illegal state: Tablet not RUNNING: STOPPED
I20260923 19:50:05.900072 6279 leader_election.cc:304] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:05.900381 6867 raft_consensus.cc:2749] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:05.864758 6458 ts_tablet_manager.cc:1929] T 259e4faa58f549699538317019be5daf P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:05.900705 6458 log.cc:1199] T 259e4faa58f549699538317019be5daf P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/259e4faa58f549699538317019be5daf
I20260923 19:50:05.906075 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet dbe06eba8067413a903e4a07c2768484
I20260923 19:50:05.906473 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d9f1a0fae849ae8083eba082055fe9" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:05.906872 5802 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_702e4b2ed8dd4400b9e61073b984b3c4" } new_table_name: "default.Table_f92387e003d44b0eb22010e7ca6598af" modify_external_catalogs: true
W20260923 19:50:05.907253 5995 leader_election.cc:343] T f2d9f1a0fae849ae8083eba082055fe9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:05.907392 5995 leader_election.cc:304] T f2d9f1a0fae849ae8083eba082055fe9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:05.907817 6773 raft_consensus.cc:2749] T f2d9f1a0fae849ae8083eba082055fe9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:05.908527 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 231) took 2552 ms. Trace:
I20260923 19:50:05.908630 6459 rpcz_store.cc:276] 0923 19:50:03.355614 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.356029 (+ 415us) service_pool.cc:224] Handling call
0923 19:50:05.680999 (+2324970us) ts_tablet_manager.cc:1151] Deleting tablet 2f78261842744af08d86da64d37d708c
0923 19:50:05.681008 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.837364 (+156356us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.868725 (+ 31361us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.908455 (+ 39730us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2324694}
I20260923 19:50:05.910430 6454 tablet_bootstrap.cc:492] T a10110f4a2b34b61a4cc586d65981606 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:05.912603 6454 tablet_bootstrap.cc:654] T a10110f4a2b34b61a4cc586d65981606 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:05.913384 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 2f78261842744af08d86da64d37d708c (table default.Table_a5d9d7b0e0b449ae8791e459b7d88f18 [id=7e9508e469b14579a0c697ac4ca5cc4a]) successfully deleted
I20260923 19:50:05.913621 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet dbe06eba8067413a903e4a07c2768484 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:05.914029 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 234) took 2558 ms. Trace:
I20260923 19:50:05.914172 6459 rpcz_store.cc:276] 0923 19:50:03.355977 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.356341 (+ 364us) service_pool.cc:224] Handling call
0923 19:50:05.908916 (+2552575us) ts_tablet_manager.cc:1151] Deleting tablet 6e726ee6a5494fd4b72c1ebef7d66b42
0923 19:50:05.913781 (+ 4865us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.913959 (+ 178us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2552384}
I20260923 19:50:05.914491 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet dbe06eba8067413a903e4a07c2768484 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:05.914614 6459 tablet_replica.cc:333] T 9ed630e738c54ed38b9933f95fb552c5 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:05.914865 6459 raft_consensus.cc:2243] T 9ed630e738c54ed38b9933f95fb552c5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:05.915102 6459 raft_consensus.cc:2272] T 9ed630e738c54ed38b9933f95fb552c5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:05.917328 6456 tablet_bootstrap.cc:654] T 033c2d772c8a44d2a0e671664bb9085d P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:05.922230 6137 consensus_peers.cc:597] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4bf129dd52b84a4ea461ec454bc34fe8. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:05.922379 6459 ts_tablet_manager.cc:1916] T 9ed630e738c54ed38b9933f95fb552c5 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:05.923605 6458 ts_tablet_manager.cc:1950] T 259e4faa58f549699538317019be5daf P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:05.924497 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 159) took 3759 ms. Trace:
I20260923 19:50:05.932418 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_4e6fe5709a6947bb856cc36444f9fbe6" } new_table_name: "default.Table_c61ffa0e84514cddb714dc30da0a21f6" modify_external_catalogs: true
I20260923 19:50:05.933738 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet 87afbdb11c6e4e58affd2f2d7995e1f8 with delete_type TABLET_DATA_DELETED (replaced by tablet 5c0142f4e3ad42048803481d68f0ee5d) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:05.934353 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet c012b2a92dc14f2ab5d9f4fe8a6a7779
I20260923 19:50:05.935096 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_5bf3acc342a34bba8f50e005425b4c5d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:05.935662 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5bf3acc342a34bba8f50e005425b4c5d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:05.937601 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet c012b2a92dc14f2ab5d9f4fe8a6a7779 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:05.938832 6454 tablet_bootstrap.cc:492] T a10110f4a2b34b61a4cc586d65981606 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:05.939054 6454 ts_tablet_manager.cc:1403] T a10110f4a2b34b61a4cc586d65981606 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.005s
I20260923 19:50:05.939476 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet c012b2a92dc14f2ab5d9f4fe8a6a7779 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:05.939966 6454 raft_consensus.cc:359] T a10110f4a2b34b61a4cc586d65981606 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.940297 6454 raft_consensus.cc:385] T a10110f4a2b34b61a4cc586d65981606 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:05.940384 6454 raft_consensus.cc:740] T a10110f4a2b34b61a4cc586d65981606 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:05.940634 6454 consensus_queue.cc:260] T a10110f4a2b34b61a4cc586d65981606 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.941320 6454 ts_tablet_manager.cc:1434] T a10110f4a2b34b61a4cc586d65981606 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:50:05.944454 6454 tablet_bootstrap.cc:492] T f2d9f1a0fae849ae8083eba082055fe9 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:05.948300 6454 tablet_bootstrap.cc:654] T f2d9f1a0fae849ae8083eba082055fe9 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:05.953964 6316 tablet_service.cc:1558] Processing DeleteTablet for tablet dbe06eba8067413a903e4a07c2768484 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:05.954298 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet c012b2a92dc14f2ab5d9f4fe8a6a7779 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:05.955281 6814 raft_consensus.cc:697] T f302f91c8ef44237b1c9909d88dacbff P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:05.955657 6458 rpcz_store.cc:276] 0923 19:50:02.164728 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:02.165932 (+ 1204us) service_pool.cc:224] Handling call
0923 19:50:05.624829 (+3458897us) ts_tablet_manager.cc:1151] Deleting tablet 259e4faa58f549699538317019be5daf
0923 19:50:05.624836 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.710149 (+ 85313us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.864663 (+154514us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.924464 (+ 59801us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3458611}
I20260923 19:50:05.956344 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 172) took 3636 ms. Trace:
I20260923 19:50:05.956425 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 259e4faa58f549699538317019be5daf (table default.Table_59963526245d437089bb2a1e5a276493 [id=15b32ad6fb42473abddb1188aa861441]) successfully deleted
I20260923 19:50:05.956532 6458 rpcz_store.cc:276] 0923 19:50:02.319738 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:02.319795 (+ 57us) service_pool.cc:224] Handling call
0923 19:50:05.956178 (+3636383us) ts_tablet_manager.cc:1151] Deleting tablet 31b0bdf719554d37993a802831e324ee
0923 19:50:05.956193 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.956304 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3636064}
I20260923 19:50:05.956952 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 177) took 3426 ms. Trace:
W20260923 19:50:05.957079 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 31b0bdf719554d37993a802831e324ee because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31b0bdf719554d37993a802831e324ee already in progress: creating tablet
I20260923 19:50:05.957063 6458 rpcz_store.cc:276] 0923 19:50:02.530290 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:02.568090 (+ 37800us) service_pool.cc:224] Handling call
0923 19:50:05.956824 (+3388734us) ts_tablet_manager.cc:1151] Deleting tablet daafbafae5004b8499e7ea93342c0517
0923 19:50:05.956834 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.956914 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3388464}
I20260923 19:50:05.957417 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 182) took 3323 ms. Trace:
I20260923 19:50:05.957520 6458 rpcz_store.cc:276] 0923 19:50:02.634128 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:02.634182 (+ 54us) service_pool.cc:224] Handling call
0923 19:50:05.957296 (+3323114us) ts_tablet_manager.cc:1151] Deleting tablet c48d4a8371fa4454b7c67291db3ab796
0923 19:50:05.957303 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.957379 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3322884}
W20260923 19:50:05.957669 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet daafbafae5004b8499e7ea93342c0517 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet daafbafae5004b8499e7ea93342c0517 already in progress: creating tablet
I20260923 19:50:05.957955 6279 leader_election.cc:304] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
W20260923 19:50:05.958146 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet c48d4a8371fa4454b7c67291db3ab796 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c48d4a8371fa4454b7c67291db3ab796 already in progress: creating tablet
I20260923 19:50:05.958940 6867 raft_consensus.cc:2804] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:05.959079 6867 raft_consensus.cc:493] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:05.959232 6867 raft_consensus.cc:3060] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:05.961273 6461 ts_tablet_manager.cc:1929] T 5455beff354a4616a68d8746e3e4f9a8 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:05.962589 6867 raft_consensus.cc:515] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.963402 6867 leader_election.cc:290] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:05.963728 6814 consensus_queue.cc:237] T f302f91c8ef44237b1c9909d88dacbff P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.963856 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063fc0e77d294ddf8a02e9ab5968a5e3" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
W20260923 19:50:05.965246 6280 leader_election.cc:343] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:05.966660 6456 tablet_bootstrap.cc:492] T 033c2d772c8a44d2a0e671664bb9085d P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:05.966804 6456 ts_tablet_manager.cc:1403] T 033c2d772c8a44d2a0e671664bb9085d P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.075s user 0.000s sys 0.003s
I20260923 19:50:05.967549 6456 raft_consensus.cc:359] T 033c2d772c8a44d2a0e671664bb9085d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.967720 6456 raft_consensus.cc:385] T 033c2d772c8a44d2a0e671664bb9085d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:05.967799 6456 raft_consensus.cc:740] T 033c2d772c8a44d2a0e671664bb9085d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:05.965751 6058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063fc0e77d294ddf8a02e9ab5968a5e3" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:05.973570 6058 raft_consensus.cc:3060] T 063fc0e77d294ddf8a02e9ab5968a5e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:05.973570 6461 log.cc:1199] T 5455beff354a4616a68d8746e3e4f9a8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/5455beff354a4616a68d8746e3e4f9a8
I20260923 19:50:05.974581 6461 ts_tablet_manager.cc:1950] T 5455beff354a4616a68d8746e3e4f9a8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:05.977618 6058 raft_consensus.cc:2468] T 063fc0e77d294ddf8a02e9ab5968a5e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:05.978600 6279 leader_election.cc:304] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:05.979100 6867 raft_consensus.cc:2804] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:05.979360 6867 raft_consensus.cc:697] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:05.979635 6867 consensus_queue.cc:237] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.982504 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 236) took 2597 ms. Trace:
I20260923 19:50:05.982669 6459 ts_tablet_manager.cc:1929] T 9ed630e738c54ed38b9933f95fb552c5 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:05.982973 6459 log.cc:1199] T 9ed630e738c54ed38b9933f95fb552c5 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/9ed630e738c54ed38b9933f95fb552c5
I20260923 19:50:05.983150 6461 rpcz_store.cc:276] 0923 19:50:03.387195 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.388986 (+ 1791us) service_pool.cc:224] Handling call
0923 19:50:05.888535 (+2499549us) ts_tablet_manager.cc:1151] Deleting tablet 5455beff354a4616a68d8746e3e4f9a8
0923 19:50:05.888547 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.934970 (+ 46423us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.961126 (+ 26156us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.982451 (+ 21325us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2499350}
I20260923 19:50:05.983911 6459 ts_tablet_manager.cc:1950] T 9ed630e738c54ed38b9933f95fb552c5 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:05.986937 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 5455beff354a4616a68d8746e3e4f9a8 (table default.Table_a949ff6346b345ffa7ce8d5d9a390997 [id=b1c31f5e95b54ad6860aaeb11048d36b]) successfully deleted
I20260923 19:50:05.991228 6461 tablet_replica.cc:333] T 8db0358af7634911820f99fe16605ca7 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:05.987741 6454 tablet_bootstrap.cc:492] T f2d9f1a0fae849ae8083eba082055fe9 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:05.991633 6454 ts_tablet_manager.cc:1403] T f2d9f1a0fae849ae8083eba082055fe9 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.047s user 0.002s sys 0.003s
I20260923 19:50:05.993041 6454 raft_consensus.cc:359] T f2d9f1a0fae849ae8083eba082055fe9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.993430 6454 raft_consensus.cc:385] T f2d9f1a0fae849ae8083eba082055fe9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:05.993597 6454 raft_consensus.cc:740] T f2d9f1a0fae849ae8083eba082055fe9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:05.993975 6454 consensus_queue.cc:260] T f2d9f1a0fae849ae8083eba082055fe9 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:05.994957 6454 ts_tablet_manager.cc:1434] T f2d9f1a0fae849ae8083eba082055fe9 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:50:05.996001 6454 tablet_bootstrap.cc:492] T b302820d329a41f0a9a54501c079fcd7 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:05.998687 6454 tablet_bootstrap.cc:654] T b302820d329a41f0a9a54501c079fcd7 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:06.000427 6461 raft_consensus.cc:2243] T 8db0358af7634911820f99fe16605ca7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:06.001017 6461 raft_consensus.cc:2272] T 8db0358af7634911820f99fe16605ca7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:06.003247 6461 ts_tablet_manager.cc:1916] T 8db0358af7634911820f99fe16605ca7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:06.000015 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 232) took 2644 ms. Trace:
I20260923 19:50:06.003692 6459 rpcz_store.cc:276] 0923 19:50:03.355750 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.356557 (+ 807us) service_pool.cc:224] Handling call
0923 19:50:05.914509 (+2557952us) ts_tablet_manager.cc:1151] Deleting tablet 9ed630e738c54ed38b9933f95fb552c5
0923 19:50:05.914522 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.962578 (+ 48056us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.977519 (+ 14941us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:05.999970 (+ 22451us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2557761}
I20260923 19:50:06.006249 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 9ed630e738c54ed38b9933f95fb552c5 (table default.Table_f8e149be0f0d456894956d425be24693 [id=c97fdc3b0e4447c284ad90fab54a1fa5]) successfully deleted
I20260923 19:50:06.006994 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 235) took 2627 ms. Trace:
I20260923 19:50:06.009404 6459 rpcz_store.cc:276] 0923 19:50:03.379414 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.379498 (+ 84us) service_pool.cc:224] Handling call
0923 19:50:06.006486 (+2626988us) ts_tablet_manager.cc:1151] Deleting tablet 6a2564a99c274e07a7e43da739a2458b
0923 19:50:06.006498 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.006958 (+ 460us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2626732}
W20260923 19:50:06.010257 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 6a2564a99c274e07a7e43da739a2458b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6a2564a99c274e07a7e43da739a2458b already in progress: creating tablet
I20260923 19:50:06.010514 6456 consensus_queue.cc:260] T 033c2d772c8a44d2a0e671664bb9085d P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.013456 6459 tablet_replica.cc:333] T e52d78a941a341d186dc00bbe7df96bf P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:06.013803 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 908596339b2e4f7f8ddb7f9cd5bdcc3e
I20260923 19:50:06.014200 6459 raft_consensus.cc:2243] T e52d78a941a341d186dc00bbe7df96bf P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:06.014489 5796 catalog_manager.cc:6934] ReplaceTablet: tablet 908596339b2e4f7f8ddb7f9cd5bdcc3e deleted and replaced by tablet 688bb1055ba94c2996cdfea6dea76416
I20260923 19:50:06.015031 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet 908596339b2e4f7f8ddb7f9cd5bdcc3e with delete_type TABLET_DATA_DELETED (replaced by tablet 688bb1055ba94c2996cdfea6dea76416) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:06.017575 6459 raft_consensus.cc:2272] T e52d78a941a341d186dc00bbe7df96bf P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:06.017658 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet 908596339b2e4f7f8ddb7f9cd5bdcc3e with delete_type TABLET_DATA_DELETED (replaced by tablet 688bb1055ba94c2996cdfea6dea76416) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:06.018292 5805 master_service.cc:960] ReplaceTablet: received request to replace tablet d8c8bfa9b7424b9f80f76e0bb05cbc0c from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:06.019289 6459 ts_tablet_manager.cc:1916] T e52d78a941a341d186dc00bbe7df96bf P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:06.034343 6454 tablet_bootstrap.cc:492] T b302820d329a41f0a9a54501c079fcd7 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:06.035444 6454 ts_tablet_manager.cc:1403] T b302820d329a41f0a9a54501c079fcd7 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.039s user 0.006s sys 0.000s
I20260923 19:50:06.037672 6454 raft_consensus.cc:359] T b302820d329a41f0a9a54501c079fcd7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.038057 6454 raft_consensus.cc:385] T b302820d329a41f0a9a54501c079fcd7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:06.038224 6454 raft_consensus.cc:740] T b302820d329a41f0a9a54501c079fcd7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:06.038645 6454 consensus_queue.cc:260] T b302820d329a41f0a9a54501c079fcd7 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.039475 6454 ts_tablet_manager.cc:1434] T b302820d329a41f0a9a54501c079fcd7 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260923 19:50:06.042291 6454 tablet_bootstrap.cc:492] T b2762648045b4378bcc2c1234460c352 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:06.046669 6454 tablet_bootstrap.cc:654] T b2762648045b4378bcc2c1234460c352 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:06.026460 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet 908596339b2e4f7f8ddb7f9cd5bdcc3e with delete_type TABLET_DATA_DELETED (replaced by tablet 688bb1055ba94c2996cdfea6dea76416) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:06.041002 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 181) took 3341 ms. Trace:
I20260923 19:50:06.054785 6461 ts_tablet_manager.cc:1929] T 8db0358af7634911820f99fe16605ca7 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:06.054813 6458 rpcz_store.cc:276] 0923 19:50:02.616372 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:02.638092 (+ 21720us) service_pool.cc:224] Handling call
0923 19:50:05.957757 (+3319665us) ts_tablet_manager.cc:1151] Deleting tablet cd02244c52ad4d2ab3915108a92a6f97
0923 19:50:05.957765 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:05.957850 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3319325}
W20260923 19:50:06.055397 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet cd02244c52ad4d2ab3915108a92a6f97 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd02244c52ad4d2ab3915108a92a6f97 already in progress: creating tablet
I20260923 19:50:06.056084 6456 ts_tablet_manager.cc:1434] T 033c2d772c8a44d2a0e671664bb9085d P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.089s user 0.000s sys 0.002s
I20260923 19:50:06.059214 6456 tablet_bootstrap.cc:492] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:06.074386 6461 log.cc:1199] T 8db0358af7634911820f99fe16605ca7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/8db0358af7634911820f99fe16605ca7
I20260923 19:50:06.057140 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 180) took 3453 ms. Trace:
I20260923 19:50:06.074628 6458 rpcz_store.cc:276] 0923 19:50:02.603360 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:02.638949 (+ 35589us) service_pool.cc:224] Handling call
0923 19:50:06.056957 (+3418008us) ts_tablet_manager.cc:1151] Deleting tablet 2f627b7b9ff74750bd8dd59840bf77db
0923 19:50:06.056968 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.057107 (+ 139us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3417733}
I20260923 19:50:06.078429 6458 tablet_replica.cc:333] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:06.078588 6457 tablet_bootstrap.cc:492] T b7f372b952804ac58e602998d9b77d72 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:06.078650 6458 raft_consensus.cc:2243] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:06.078733 6457 ts_tablet_manager.cc:1403] T b7f372b952804ac58e602998d9b77d72 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.293s user 0.075s sys 0.104s
I20260923 19:50:06.078805 6458 raft_consensus.cc:2272] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:06.079336 6458 ts_tablet_manager.cc:1916] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:06.079479 6457 raft_consensus.cc:359] T b7f372b952804ac58e602998d9b77d72 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.079658 6457 raft_consensus.cc:385] T b7f372b952804ac58e602998d9b77d72 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:06.079746 6457 raft_consensus.cc:740] T b7f372b952804ac58e602998d9b77d72 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:06.083647 6461 ts_tablet_manager.cc:1950] T 8db0358af7634911820f99fe16605ca7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:06.086529 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 232) took 2718 ms. Trace:
W20260923 19:50:06.089442 5800 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fe5d081a41a3417b855656ca6e24f235 consensus state has no leader
I20260923 19:50:06.089555 6459 ts_tablet_manager.cc:1929] T e52d78a941a341d186dc00bbe7df96bf P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:06.089742 6459 log.cc:1199] T e52d78a941a341d186dc00bbe7df96bf P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/e52d78a941a341d186dc00bbe7df96bf
I20260923 19:50:06.090106 6459 ts_tablet_manager.cc:1950] T e52d78a941a341d186dc00bbe7df96bf P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:06.090844 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 237) took 2575 ms. Trace:
I20260923 19:50:06.090847 5800 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet a10110f4a2b34b61a4cc586d65981606 (table default.Table_ccd00f21243a43deb385f4673958f88c [id=019ceccbcb1041cc9e5625274c45a0f3]). Expected version 2 got 0
I20260923 19:50:06.090937 6459 rpcz_store.cc:276] 0923 19:50:03.514839 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.514888 (+ 49us) service_pool.cc:224] Handling call
0923 19:50:06.013368 (+2498480us) ts_tablet_manager.cc:1151] Deleting tablet e52d78a941a341d186dc00bbe7df96bf
0923 19:50:06.013384 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.062159 (+ 48775us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.089473 (+ 27314us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.090785 (+ 1312us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2498268}
I20260923 19:50:06.091377 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 236) took 2576 ms. Trace:
I20260923 19:50:06.091491 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet e52d78a941a341d186dc00bbe7df96bf (table default.Table_a04bbcc870f94f609935f519709a7d95 [id=ff751c756a0240a18ca02cbb9d44e73d]) successfully deleted
I20260923 19:50:06.091461 6459 rpcz_store.cc:276] 0923 19:50:03.514713 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.515178 (+ 465us) service_pool.cc:224] Handling call
0923 19:50:06.091202 (+2576024us) ts_tablet_manager.cc:1151] Deleting tablet 42e9cbcf77324d91abd029c12eaf950d
0923 19:50:06.091211 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.091325 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2575845}
I20260923 19:50:06.091781 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 238) took 2572 ms. Trace:
I20260923 19:50:06.091853 6459 rpcz_store.cc:276] 0923 19:50:03.518883 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.518954 (+ 71us) service_pool.cc:224] Handling call
0923 19:50:06.091655 (+2572701us) ts_tablet_manager.cc:1151] Deleting tablet 359b08ef348d4be68b14f9e871a5e519
0923 19:50:06.091662 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.091727 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2572389}
W20260923 19:50:06.091919 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 42e9cbcf77324d91abd029c12eaf950d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 42e9cbcf77324d91abd029c12eaf950d already in progress: creating tablet
I20260923 19:50:06.092196 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 245) took 2364 ms. Trace:
I20260923 19:50:06.092290 6459 rpcz_store.cc:276] 0923 19:50:03.727358 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.727893 (+ 535us) service_pool.cc:224] Handling call
0923 19:50:06.092041 (+2364148us) ts_tablet_manager.cc:1151] Deleting tablet c0ff8838ab17433ab733d3b293d4964f
0923 19:50:06.092048 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.092133 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2361295}
I20260923 19:50:06.092406 6461 rpcz_store.cc:276] 0923 19:50:03.367895 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.369944 (+ 2049us) service_pool.cc:224] Handling call
0923 19:50:05.991108 (+2621164us) ts_tablet_manager.cc:1151] Deleting tablet 8db0358af7634911820f99fe16605ca7
0923 19:50:05.991125 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.024126 (+ 33001us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.054668 (+ 30542us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.086476 (+ 31808us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2597819}
I20260923 19:50:06.093122 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 243) took 2365 ms. Trace:
I20260923 19:50:06.093220 6459 rpcz_store.cc:276] 0923 19:50:03.727176 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.732463 (+ 5287us) service_pool.cc:224] Handling call
0923 19:50:06.092543 (+2360080us) ts_tablet_manager.cc:1151] Deleting tablet 6e781ccf4aa343fc924138c3cc2b04e6
0923 19:50:06.092551 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.092625 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2319021}
W20260923 19:50:06.093369 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 359b08ef348d4be68b14f9e871a5e519 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 359b08ef348d4be68b14f9e871a5e519 already in progress: creating tablet
I20260923 19:50:06.084703 6457 consensus_queue.cc:260] T b7f372b952804ac58e602998d9b77d72 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:06.093626 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet c0ff8838ab17433ab733d3b293d4964f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c0ff8838ab17433ab733d3b293d4964f already in progress: creating tablet
I20260923 19:50:06.093657 5800 master_service.cc:960] ReplaceTablet: received request to replace tablet b2762648045b4378bcc2c1234460c352 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:06.093945 6457 ts_tablet_manager.cc:1434] T b7f372b952804ac58e602998d9b77d72 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260923 19:50:06.093216 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet f2d9f1a0fae849ae8083eba082055fe9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:00 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:06.094297 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 239) took 2367 ms. Trace:
I20260923 19:50:06.094429 6459 rpcz_store.cc:276] 0923 19:50:03.726585 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.758386 (+ 31801us) service_pool.cc:224] Handling call
0923 19:50:06.093448 (+2335062us) ts_tablet_manager.cc:1151] Deleting tablet a224ae69503e4ab588d6269086317f09
0923 19:50:06.093456 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.094233 (+ 777us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2209010}
W20260923 19:50:06.094514 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 6e781ccf4aa343fc924138c3cc2b04e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6e781ccf4aa343fc924138c3cc2b04e6 already in progress: creating tablet
W20260923 19:50:06.094877 5799 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet edb52bd88b424129bbdc45de89b56efb consensus state has no leader
I20260923 19:50:06.095180 5799 master_service.cc:960] ReplaceTablet: received request to replace tablet 87afbdb11c6e4e58affd2f2d7995e1f8 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:06.095502 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 8db0358af7634911820f99fe16605ca7 (table default.Table_02aee02d3b8746ce98cba010a0ac8149 [id=47c37093044c462993bba6cb00bd296a]) successfully deleted
I20260923 19:50:06.095731 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_a4db4b4f4a6b45eabe9a2ae50186a32c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:06.095892 6646 raft_consensus.cc:493] T a10110f4a2b34b61a4cc586d65981606 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:06.096033 6646 raft_consensus.cc:515] T a10110f4a2b34b61a4cc586d65981606 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:06.096349 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4db4b4f4a6b45eabe9a2ae50186a32c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:06.096679 6646 leader_election.cc:290] T a10110f4a2b34b61a4cc586d65981606 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:06.097213 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10110f4a2b34b61a4cc586d65981606" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:06.097568 6454 tablet_bootstrap.cc:492] T b2762648045b4378bcc2c1234460c352 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:06.097723 6454 ts_tablet_manager.cc:1403] T b2762648045b4378bcc2c1234460c352 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.056s user 0.005s sys 0.000s
I20260923 19:50:06.098023 6057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10110f4a2b34b61a4cc586d65981606" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:06.098730 6137 leader_election.cc:304] T a10110f4a2b34b61a4cc586d65981606 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:06.099126 6646 raft_consensus.cc:2749] T a10110f4a2b34b61a4cc586d65981606 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:06.099489 6457 tablet_bootstrap.cc:492] T d91a56bace854494b7affd6c766b2847 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:06.100006 6461 tablet_replica.cc:333] T 64a38bbd3fbd4738a73e78e3f6436fe5 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:06.100201 6461 raft_consensus.cc:2243] T 64a38bbd3fbd4738a73e78e3f6436fe5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:06.100383 6461 raft_consensus.cc:2272] T 64a38bbd3fbd4738a73e78e3f6436fe5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:06.100936 6461 ts_tablet_manager.cc:1916] T 64a38bbd3fbd4738a73e78e3f6436fe5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:06.101981 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet a224ae69503e4ab588d6269086317f09 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a224ae69503e4ab588d6269086317f09 already in progress: creating tablet
I20260923 19:50:06.106585 6454 raft_consensus.cc:359] T b2762648045b4378bcc2c1234460c352 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.106804 6454 raft_consensus.cc:385] T b2762648045b4378bcc2c1234460c352 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:06.108825 6457 tablet_bootstrap.cc:654] T d91a56bace854494b7affd6c766b2847 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:06.109238 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 253) took 2142 ms. Trace:
I20260923 19:50:06.110510 6459 rpcz_store.cc:276] 0923 19:50:03.966290 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.966831 (+ 541us) service_pool.cc:224] Handling call
0923 19:50:06.107667 (+2140836us) ts_tablet_manager.cc:1151] Deleting tablet f4e3e64fdf584743a3a88df5d6600b22
0923 19:50:06.107680 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.108298 (+ 618us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2140486}
W20260923 19:50:06.111251 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet f4e3e64fdf584743a3a88df5d6600b22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4e3e64fdf584743a3a88df5d6600b22 already in progress: creating tablet
I20260923 19:50:06.108925 6454 raft_consensus.cc:740] T b2762648045b4378bcc2c1234460c352 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:06.112486 6459 tablet_replica.cc:333] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:06.111883 6454 consensus_queue.cc:260] T b2762648045b4378bcc2c1234460c352 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.115654 6454 ts_tablet_manager.cc:1434] T b2762648045b4378bcc2c1234460c352 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20260923 19:50:06.116034 6459 raft_consensus.cc:2243] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:06.116062 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet b7f372b952804ac58e602998d9b77d72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:06.116361 6459 pending_rounds.cc:70] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:06.116428 6459 pending_rounds.cc:77] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630547306708992 op_type: NO_OP noop_request { }
I20260923 19:50:06.116556 6459 raft_consensus.cc:2889] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:06.116659 6459 raft_consensus.cc:2272] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:06.117206 6459 ts_tablet_manager.cc:1916] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:06.118075 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet b302820d329a41f0a9a54501c079fcd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:06.119978 6454 tablet_bootstrap.cc:492] T f302f91c8ef44237b1c9909d88dacbff P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:06.122974 6456 tablet_bootstrap.cc:654] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:06.126221 6454 tablet_bootstrap.cc:654] T f302f91c8ef44237b1c9909d88dacbff P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:06.130759 6457 tablet_bootstrap.cc:492] T d91a56bace854494b7affd6c766b2847 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:06.130983 6457 ts_tablet_manager.cc:1403] T d91a56bace854494b7affd6c766b2847 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.032s user 0.007s sys 0.000s
I20260923 19:50:06.132107 6457 raft_consensus.cc:359] T d91a56bace854494b7affd6c766b2847 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.132357 6457 raft_consensus.cc:385] T d91a56bace854494b7affd6c766b2847 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:06.132457 6457 raft_consensus.cc:740] T d91a56bace854494b7affd6c766b2847 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:06.132835 6457 consensus_queue.cc:260] T d91a56bace854494b7affd6c766b2847 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.135962 6457 ts_tablet_manager.cc:1434] T d91a56bace854494b7affd6c766b2847 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260923 19:50:06.136348 6457 tablet_bootstrap.cc:492] T 5c0142f4e3ad42048803481d68f0ee5d P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:06.138486 6457 tablet_bootstrap.cc:654] T 5c0142f4e3ad42048803481d68f0ee5d P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:06.146148 6461 ts_tablet_manager.cc:1929] T 64a38bbd3fbd4738a73e78e3f6436fe5 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:06.149989 6461 log.cc:1199] T 64a38bbd3fbd4738a73e78e3f6436fe5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/64a38bbd3fbd4738a73e78e3f6436fe5
I20260923 19:50:06.150609 6461 ts_tablet_manager.cc:1950] T 64a38bbd3fbd4738a73e78e3f6436fe5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:06.151681 6454 tablet_bootstrap.cc:492] T f302f91c8ef44237b1c9909d88dacbff P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:06.151966 6454 ts_tablet_manager.cc:1403] T f302f91c8ef44237b1c9909d88dacbff P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.000s
I20260923 19:50:06.153154 6454 raft_consensus.cc:359] T f302f91c8ef44237b1c9909d88dacbff P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.153501 6454 raft_consensus.cc:385] T f302f91c8ef44237b1c9909d88dacbff P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:06.153653 6454 raft_consensus.cc:740] T f302f91c8ef44237b1c9909d88dacbff P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:06.154040 6454 consensus_queue.cc:260] T f302f91c8ef44237b1c9909d88dacbff P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.154402 5803 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_c670311ee64c4e728677dc29691ea3f9" } modify_external_catalogs: true
I20260923 19:50:06.154618 5803 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_c670311ee64c4e728677dc29691ea3f9" } modify_external_catalogs: true
I20260923 19:50:06.156114 6454 ts_tablet_manager.cc:1434] T f302f91c8ef44237b1c9909d88dacbff P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260923 19:50:06.156867 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 240) took 2768 ms. Trace:
I20260923 19:50:06.157262 6454 tablet_bootstrap.cc:492] T 115048f771764e41a3816e17a6c6cf94 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
W20260923 19:50:06.157740 5802 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 688bb1055ba94c2996cdfea6dea76416 has no consensus state
I20260923 19:50:06.158196 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5365e890b976423aa339a9b5e8c8db7e" } modify_external_catalogs: true
I20260923 19:50:06.158360 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5365e890b976423aa339a9b5e8c8db7e" } modify_external_catalogs: true
I20260923 19:50:06.158933 5797 master_service.cc:960] ReplaceTablet: received request to replace tablet 87afbdb11c6e4e58affd2f2d7995e1f8 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:06.159433 5797 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_20badc86d4ef4e2fb377e8e109782afd" } new_table_name: "default.Table_64791d9d1cef4cfe9d420e405abe816e" modify_external_catalogs: true
W20260923 19:50:06.160712 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 58ea466d1b2b40e9b9b4cd5be51f79e0 consensus state has no leader
I20260923 19:50:06.162294 6867 raft_consensus.cc:493] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:06.162467 6867 raft_consensus.cc:515] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.163476 6867 leader_election.cc:290] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:06.163522 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91a56bace854494b7affd6c766b2847" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:06.164290 6454 tablet_bootstrap.cc:654] T 115048f771764e41a3816e17a6c6cf94 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:06.164258 6057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91a56bace854494b7affd6c766b2847" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:06.164523 6057 raft_consensus.cc:2468] T d91a56bace854494b7affd6c766b2847 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:06.165110 6279 leader_election.cc:304] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
W20260923 19:50:06.165361 6280 leader_election.cc:343] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:06.165727 6867 raft_consensus.cc:2804] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:06.165933 6867 raft_consensus.cc:493] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:06.166105 6867 raft_consensus.cc:3060] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:06.164441 6461 rpcz_store.cc:276] 0923 19:50:03.388319 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.390010 (+ 1691us) service_pool.cc:224] Handling call
0923 19:50:06.097286 (+2707276us) ts_tablet_manager.cc:1151] Deleting tablet 64a38bbd3fbd4738a73e78e3f6436fe5
0923 19:50:06.099927 (+ 2641us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.104490 (+ 4563us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.146041 (+ 41551us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.156827 (+ 10786us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2707109}
I20260923 19:50:06.166576 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 235) took 2786 ms. Trace:
I20260923 19:50:06.167502 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 64a38bbd3fbd4738a73e78e3f6436fe5 (table default.Table_286d831d3cff4c89b493d45f28acbca2 [id=f02b0dcd479d46fea2683769212f2f40]) successfully deleted
I20260923 19:50:06.167647 6461 rpcz_store.cc:276] 0923 19:50:03.380296 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.380352 (+ 56us) service_pool.cc:224] Handling call
0923 19:50:06.166432 (+2786080us) ts_tablet_manager.cc:1151] Deleting tablet 6a2564a99c274e07a7e43da739a2458b
0923 19:50:06.166444 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.166544 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2774365}
W20260923 19:50:06.168567 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 6a2564a99c274e07a7e43da739a2458b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6a2564a99c274e07a7e43da739a2458b already in progress: creating tablet
I20260923 19:50:06.168947 6461 tablet_replica.cc:333] T 640a98d3a845461e8d4f07041ab515c7 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:06.169287 6461 raft_consensus.cc:2243] T 640a98d3a845461e8d4f07041ab515c7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:06.169574 6461 raft_consensus.cc:2272] T 640a98d3a845461e8d4f07041ab515c7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:06.170718 6867 raft_consensus.cc:515] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.172147 6867 leader_election.cc:290] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:06.172560 6057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91a56bace854494b7affd6c766b2847" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:06.172744 6057 raft_consensus.cc:3060] T d91a56bace854494b7affd6c766b2847 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:06.172936 6461 ts_tablet_manager.cc:1916] T 640a98d3a845461e8d4f07041ab515c7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:06.166009 6459 ts_tablet_manager.cc:1929] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:06.171927 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91a56bace854494b7affd6c766b2847" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
W20260923 19:50:06.175091 6280 leader_election.cc:343] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:06.174461 6459 log.cc:1199] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/c52da04e5fe0454ea76bf4d99a930fd7
I20260923 19:50:06.177299 6459 ts_tablet_manager.cc:1950] T c52da04e5fe0454ea76bf4d99a930fd7 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:06.181068 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 252) took 2214 ms. Trace:
I20260923 19:50:06.183350 6773 raft_consensus.cc:493] T a224ae69503e4ab588d6269086317f09 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:06.183523 6773 raft_consensus.cc:515] T a224ae69503e4ab588d6269086317f09 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.184247 6773 leader_election.cc:290] T a224ae69503e4ab588d6269086317f09 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:06.186558 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a224ae69503e4ab588d6269086317f09" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:06.186636 6057 raft_consensus.cc:2468] T d91a56bace854494b7affd6c766b2847 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
W20260923 19:50:06.187268 5996 leader_election.cc:343] T a224ae69503e4ab588d6269086317f09 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:06.184933 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a224ae69503e4ab588d6269086317f09" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:06.187879 6459 rpcz_store.cc:276] 0923 19:50:03.966151 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.978667 (+ 12516us) service_pool.cc:224] Handling call
0923 19:50:06.112377 (+2133710us) ts_tablet_manager.cc:1151] Deleting tablet c52da04e5fe0454ea76bf4d99a930fd7
0923 19:50:06.112394 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.141686 (+ 29292us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.165933 (+ 24247us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.181006 (+ 15073us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2121690}
W20260923 19:50:06.188395 5995 leader_election.cc:343] T a224ae69503e4ab588d6269086317f09 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:06.188521 5995 leader_election.cc:304] T a224ae69503e4ab588d6269086317f09 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:06.189060 6773 raft_consensus.cc:2749] T a224ae69503e4ab588d6269086317f09 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:06.188884 6279 leader_election.cc:304] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:06.190591 6867 raft_consensus.cc:2804] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:06.191285 6867 raft_consensus.cc:697] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:06.191538 6459 tablet_replica.cc:333] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:06.191905 6459 raft_consensus.cc:2243] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:06.191915 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet c52da04e5fe0454ea76bf4d99a930fd7 (table default.Table_504bdbe9702948d58b4f958360a2040b [id=ca73f0867b5d49cfb0bb7cd2315c47f2]) successfully deleted
I20260923 19:50:06.191987 6867 consensus_queue.cc:237] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.192934 6459 pending_rounds.cc:70] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:06.193068 6459 pending_rounds.cc:77] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630547306459136 op_type: NO_OP noop_request { }
I20260923 19:50:06.193264 6459 raft_consensus.cc:2889] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:06.193418 6459 raft_consensus.cc:2272] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:06.193512 6457 tablet_bootstrap.cc:492] T 5c0142f4e3ad42048803481d68f0ee5d P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:06.193703 6457 ts_tablet_manager.cc:1403] T 5c0142f4e3ad42048803481d68f0ee5d P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.057s user 0.011s sys 0.017s
I20260923 19:50:06.194991 6457 raft_consensus.cc:359] T 5c0142f4e3ad42048803481d68f0ee5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.195269 6457 raft_consensus.cc:385] T 5c0142f4e3ad42048803481d68f0ee5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:06.195405 6457 raft_consensus.cc:740] T 5c0142f4e3ad42048803481d68f0ee5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:06.195681 6457 consensus_queue.cc:260] T 5c0142f4e3ad42048803481d68f0ee5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.196429 6459 ts_tablet_manager.cc:1916] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:06.201675 6457 ts_tablet_manager.cc:1434] T 5c0142f4e3ad42048803481d68f0ee5d P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260923 19:50:06.201959 6454 tablet_bootstrap.cc:492] T 115048f771764e41a3816e17a6c6cf94 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:06.202158 6454 ts_tablet_manager.cc:1403] T 115048f771764e41a3816e17a6c6cf94 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.045s user 0.004s sys 0.001s
I20260923 19:50:06.202817 6456 tablet_bootstrap.cc:492] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:06.203042 6456 ts_tablet_manager.cc:1403] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.144s user 0.002s sys 0.003s
I20260923 19:50:06.202999 6454 raft_consensus.cc:359] T 115048f771764e41a3816e17a6c6cf94 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.203261 6454 raft_consensus.cc:385] T 115048f771764e41a3816e17a6c6cf94 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:06.203394 6454 raft_consensus.cc:740] T 115048f771764e41a3816e17a6c6cf94 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:06.203965 6454 consensus_queue.cc:260] T 115048f771764e41a3816e17a6c6cf94 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.204046 6456 raft_consensus.cc:359] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.204288 6456 raft_consensus.cc:385] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:06.204421 6456 raft_consensus.cc:740] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:06.204869 6456 consensus_queue.cc:260] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.205628 6456 ts_tablet_manager.cc:1434] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:06.205978 6456 tablet_bootstrap.cc:492] T 6a34e178007b4e8ebed429cedf44e82a P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:06.206490 6457 tablet_bootstrap.cc:492] T 4b15b250f594459eb959b4871f7ae398 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:06.208072 6456 tablet_bootstrap.cc:654] T 6a34e178007b4e8ebed429cedf44e82a P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:06.208828 6454 ts_tablet_manager.cc:1434] T 115048f771764e41a3816e17a6c6cf94 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260923 19:50:06.209363 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_485a26957d3246788384f23059c2359f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:06.209647 6457 tablet_bootstrap.cc:654] T 4b15b250f594459eb959b4871f7ae398 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:06.209973 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_485a26957d3246788384f23059c2359f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:06.212006 5801 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet d91a56bace854494b7affd6c766b2847 (table default.Table_b3579cbf488c4d1eb5f605ab4e11c340 [id=a6dbcc9c44fb400b926e21aa6d683186]). Expected version 2 got 0
I20260923 19:50:06.212070 6454 tablet_bootstrap.cc:492] T 3190d18f00234d71b0a58c2c334ef45f P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:06.213797 6454 tablet_bootstrap.cc:654] T 3190d18f00234d71b0a58c2c334ef45f P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:06.214349 6176 tablet_service.cc:1511] Processing CreateTablet for tablet d3f7b33bbf3f453e8e841ee5d99c5b31 (DEFAULT_TABLE table=default.Table_8e3f5612c14448349fdc0fddeaead3d0 [id=57c63647576148739ad66655548492ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.214735 6176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3f7b33bbf3f453e8e841ee5d99c5b31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.214648 5796 catalog_manager.cc:5838] T f302f91c8ef44237b1c9909d88dacbff P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:06.215065 5796 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet f302f91c8ef44237b1c9909d88dacbff (table default.Table_b623e36133d64d72a070bb99a0b974ee [id=4300ad9818924415b6414ea9f89445ce]). Expected version 2 got 0
I20260923 19:50:06.215319 5796 catalog_manager.cc:5838] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:06.215476 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 21bf33904ede470b80a074dc9a458baf (DEFAULT_TABLE table=default.Table_9f93fd5514734871bf6a205b82e6e8ef [id=29a9cb5a2b5e41f6a20555efb499eb00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.215689 5796 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet b2762648045b4378bcc2c1234460c352 (table default.Table_f57f8cacbedb49c6be509b51c824b960 [id=ada5cc6ef65b4859bf027fd3af9ad0f2]). Expected version 2 got 0
I20260923 19:50:06.215883 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21bf33904ede470b80a074dc9a458baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.214668 6164 tablet_service.cc:1511] Processing CreateTablet for tablet f8052b05169b4673b387ac8b716ffc4e (DEFAULT_TABLE table=default.Table_98e62ec3560b4093bdac39551e2c715f [id=8bac5d4f5c9c41f7b121d81382633a49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.218858 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8052b05169b4673b387ac8b716ffc4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.219120 6461 ts_tablet_manager.cc:1929] T 640a98d3a845461e8d4f07041ab515c7 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:06.219259 6461 log.cc:1199] T 640a98d3a845461e8d4f07041ab515c7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/640a98d3a845461e8d4f07041ab515c7
I20260923 19:50:06.219323 6324 tablet_service.cc:1511] Processing CreateTablet for tablet f8052b05169b4673b387ac8b716ffc4e (DEFAULT_TABLE table=default.Table_98e62ec3560b4093bdac39551e2c715f [id=8bac5d4f5c9c41f7b121d81382633a49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.219861 6316 tablet_service.cc:1511] Processing CreateTablet for tablet d3f7b33bbf3f453e8e841ee5d99c5b31 (DEFAULT_TABLE table=default.Table_8e3f5612c14448349fdc0fddeaead3d0 [id=57c63647576148739ad66655548492ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.221911 6034 tablet_service.cc:1511] Processing CreateTablet for tablet f8052b05169b4673b387ac8b716ffc4e (DEFAULT_TABLE table=default.Table_98e62ec3560b4093bdac39551e2c715f [id=8bac5d4f5c9c41f7b121d81382633a49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.222254 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8052b05169b4673b387ac8b716ffc4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.226155 6037 tablet_service.cc:1511] Processing CreateTablet for tablet d3f7b33bbf3f453e8e841ee5d99c5b31 (DEFAULT_TABLE table=default.Table_8e3f5612c14448349fdc0fddeaead3d0 [id=57c63647576148739ad66655548492ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.226534 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3f7b33bbf3f453e8e841ee5d99c5b31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.230212 6022 tablet_service.cc:1511] Processing CreateTablet for tablet 21bf33904ede470b80a074dc9a458baf (DEFAULT_TABLE table=default.Table_9f93fd5514734871bf6a205b82e6e8ef [id=29a9cb5a2b5e41f6a20555efb499eb00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.230577 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21bf33904ede470b80a074dc9a458baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.234700 6314 tablet_service.cc:1511] Processing CreateTablet for tablet 21bf33904ede470b80a074dc9a458baf (DEFAULT_TABLE table=default.Table_9f93fd5514734871bf6a205b82e6e8ef [id=29a9cb5a2b5e41f6a20555efb499eb00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.236155 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 0e650824e4ae474787faeb6c22a4b43f (DEFAULT_TABLE table=default.Table_b02341c81d754834894152a71d2b3fef [id=bf2950f7469241d390951965f4e98f23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.236567 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e650824e4ae474787faeb6c22a4b43f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.236788 6319 tablet_service.cc:1511] Processing CreateTablet for tablet 0e650824e4ae474787faeb6c22a4b43f (DEFAULT_TABLE table=default.Table_b02341c81d754834894152a71d2b3fef [id=bf2950f7469241d390951965f4e98f23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.237193 6021 tablet_service.cc:1511] Processing CreateTablet for tablet 0e650824e4ae474787faeb6c22a4b43f (DEFAULT_TABLE table=default.Table_b02341c81d754834894152a71d2b3fef [id=bf2950f7469241d390951965f4e98f23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.237536 6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e650824e4ae474787faeb6c22a4b43f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.239117 6461 ts_tablet_manager.cc:1950] T 640a98d3a845461e8d4f07041ab515c7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:06.239981 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 238) took 2852 ms. Trace:
I20260923 19:50:06.243530 6176 tablet_service.cc:1511] Processing CreateTablet for tablet ba639d8c68cf49a49a5ec5729143cf6b (DEFAULT_TABLE table=default.Table_53cf6ab2721c4d7baa36065c8d48ffc1 [id=d4cdad465f1a405e8723d0dcb01e0508]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.243959 6311 tablet_service.cc:1511] Processing CreateTablet for tablet ba639d8c68cf49a49a5ec5729143cf6b (DEFAULT_TABLE table=default.Table_53cf6ab2721c4d7baa36065c8d48ffc1 [id=d4cdad465f1a405e8723d0dcb01e0508]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.244243 6029 tablet_service.cc:1511] Processing CreateTablet for tablet ba639d8c68cf49a49a5ec5729143cf6b (DEFAULT_TABLE table=default.Table_53cf6ab2721c4d7baa36065c8d48ffc1 [id=d4cdad465f1a405e8723d0dcb01e0508]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.244481 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8052b05169b4673b387ac8b716ffc4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.243990 6176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba639d8c68cf49a49a5ec5729143cf6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.244632 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba639d8c68cf49a49a5ec5729143cf6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.244701 6319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e650824e4ae474787faeb6c22a4b43f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.244882 6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3f7b33bbf3f453e8e841ee5d99c5b31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.244582 6164 tablet_service.cc:1511] Processing CreateTablet for tablet c5cb76fa5e084604aa58bf888cfe4852 (DEFAULT_TABLE table=default.Table_1a74b652ec7a4165b28643c452000d6d [id=74399f12686743ebbd14943c316be210]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.246711 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5cb76fa5e084604aa58bf888cfe4852. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.240237 6461 rpcz_store.cc:276] 0923 19:50:03.387851 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.387894 (+ 43us) service_pool.cc:224] Handling call
0923 19:50:06.168881 (+2780987us) ts_tablet_manager.cc:1151] Deleting tablet 640a98d3a845461e8d4f07041ab515c7
0923 19:50:06.168891 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.183299 (+ 14408us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.219027 (+ 35728us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.239918 (+ 20891us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2774692}
I20260923 19:50:06.252382 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 640a98d3a845461e8d4f07041ab515c7 (table default.Table_655e0d86bc12407f9287ace4b3e76c29 [id=5bc43061f37b4defac5a530a1f174684]) successfully deleted
I20260923 19:50:06.252787 6461 tablet_replica.cc:333] T e1752d6b46894796bdc94e6230e3327d P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:06.253016 6461 raft_consensus.cc:2243] T e1752d6b46894796bdc94e6230e3327d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:06.253389 6461 raft_consensus.cc:2272] T e1752d6b46894796bdc94e6230e3327d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:06.245191 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba639d8c68cf49a49a5ec5729143cf6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.259979 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21bf33904ede470b80a074dc9a458baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.250694 6323 tablet_service.cc:1511] Processing CreateTablet for tablet c5cb76fa5e084604aa58bf888cfe4852 (DEFAULT_TABLE table=default.Table_1a74b652ec7a4165b28643c452000d6d [id=74399f12686743ebbd14943c316be210]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.264549 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5cb76fa5e084604aa58bf888cfe4852. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.267540 6457 tablet_bootstrap.cc:492] T 4b15b250f594459eb959b4871f7ae398 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:06.267710 6457 ts_tablet_manager.cc:1403] T 4b15b250f594459eb959b4871f7ae398 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.061s user 0.009s sys 0.000s
I20260923 19:50:06.274885 6454 tablet_bootstrap.cc:492] T 3190d18f00234d71b0a58c2c334ef45f P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:06.275065 6454 ts_tablet_manager.cc:1403] T 3190d18f00234d71b0a58c2c334ef45f P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.063s user 0.003s sys 0.000s
I20260923 19:50:06.275857 6454 raft_consensus.cc:359] T 3190d18f00234d71b0a58c2c334ef45f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.276044 6454 raft_consensus.cc:385] T 3190d18f00234d71b0a58c2c334ef45f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:06.276108 6454 raft_consensus.cc:740] T 3190d18f00234d71b0a58c2c334ef45f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:06.276360 6454 consensus_queue.cc:260] T 3190d18f00234d71b0a58c2c334ef45f P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.277439 6176 tablet_service.cc:1511] Processing CreateTablet for tablet 2526884ab0ef404aaf93051cc842c695 (DEFAULT_TABLE table=default.Table_9927b4fde83442bda0a1c9737a8b239f [id=8b5af7ae4e48454e9204a5784912842d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.278324 6164 tablet_service.cc:1511] Processing CreateTablet for tablet 2e1c19a751904a6295897376e9c5ee56 (DEFAULT_TABLE table=default.Table_4761dd5028c84fd1beaa780170cbec4e [id=1b8502abd3df41d29e789b845fb0e984]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.278961 6167 tablet_service.cc:1511] Processing CreateTablet for tablet ea2ef507c6e24d369427048171dfec06 (DEFAULT_TABLE table=default.Table_d115f4f641e04087a0ed990be1431c58 [id=4d76230d0f7b4e5b9964f5e68525d0aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.279362 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea2ef507c6e24d369427048171dfec06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.281865 6027 tablet_service.cc:1511] Processing CreateTablet for tablet 2852e91ccd0c44b3b16f8189e57575d7 (DEFAULT_TABLE table=default.Table_63a3afc2f4ac454cb8bb6551ba17376c [id=5a6519f52d71406bac54e12459ef85a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.282047 6031 tablet_service.cc:1511] Processing CreateTablet for tablet ea2ef507c6e24d369427048171dfec06 (DEFAULT_TABLE table=default.Table_d115f4f641e04087a0ed990be1431c58 [id=4d76230d0f7b4e5b9964f5e68525d0aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.282297 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2852e91ccd0c44b3b16f8189e57575d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.282488 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea2ef507c6e24d369427048171dfec06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.285578 6323 tablet_service.cc:1511] Processing CreateTablet for tablet ea2ef507c6e24d369427048171dfec06 (DEFAULT_TABLE table=default.Table_d115f4f641e04087a0ed990be1431c58 [id=4d76230d0f7b4e5b9964f5e68525d0aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.286026 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea2ef507c6e24d369427048171dfec06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.286019 6032 tablet_service.cc:1511] Processing CreateTablet for tablet 40adb472162042e48fdbb496b342996a (DEFAULT_TABLE table=default.Table_da274282ae7c4941a43506b4dfbaf430 [id=8fe16214ad774a54982dbadeac1b4235]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.286378 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40adb472162042e48fdbb496b342996a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.286315 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 2e1c19a751904a6295897376e9c5ee56 (DEFAULT_TABLE table=default.Table_4761dd5028c84fd1beaa780170cbec4e [id=1b8502abd3df41d29e789b845fb0e984]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.286670 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e1c19a751904a6295897376e9c5ee56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.286850 6026 tablet_service.cc:1511] Processing CreateTablet for tablet 02fa9052a7054659baf9b07b770bb538 (DEFAULT_TABLE table=default.Table_5812b40db6ab4814a5c5b3c869967f58 [id=df481a17409f4078a57a0aef11bef720]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.286931 6814 raft_consensus.cc:493] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:06.287066 6459 ts_tablet_manager.cc:1929] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:06.287170 6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02fa9052a7054659baf9b07b770bb538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.287096 6814 raft_consensus.cc:515] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.287195 6459 log.cc:1199] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/4bf129dd52b84a4ea461ec454bc34fe8
I20260923 19:50:06.287590 6459 ts_tablet_manager.cc:1950] T 4bf129dd52b84a4ea461ec454bc34fe8 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:06.287786 6814 leader_election.cc:290] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:06.288590 6457 raft_consensus.cc:359] T 4b15b250f594459eb959b4871f7ae398 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.288815 6457 raft_consensus.cc:385] T 4b15b250f594459eb959b4871f7ae398 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:06.288897 6457 raft_consensus.cc:740] T 4b15b250f594459eb959b4871f7ae398 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:06.289153 6457 consensus_queue.cc:260] T 4b15b250f594459eb959b4871f7ae398 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.289685 6457 ts_tablet_manager.cc:1434] T 4b15b250f594459eb959b4871f7ae398 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.022s user 0.000s sys 0.000s
I20260923 19:50:06.290057 6457 tablet_bootstrap.cc:492] T 9101e82501fd461f8a4b2dcd9dffbd74 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:06.290207 6316 tablet_service.cc:1511] Processing CreateTablet for tablet 2852e91ccd0c44b3b16f8189e57575d7 (DEFAULT_TABLE table=default.Table_63a3afc2f4ac454cb8bb6551ba17376c [id=5a6519f52d71406bac54e12459ef85a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.290557 6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2852e91ccd0c44b3b16f8189e57575d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.291487 6057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adadf8caf5e4a9ab1107d0fb6a91735" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:06.291708 6057 raft_consensus.cc:2468] T 5adadf8caf5e4a9ab1107d0fb6a91735 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:06.291963 6457 tablet_bootstrap.cc:654] T 9101e82501fd461f8a4b2dcd9dffbd74 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:06.294103 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adadf8caf5e4a9ab1107d0fb6a91735" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:06.293707 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 2526884ab0ef404aaf93051cc842c695 (DEFAULT_TABLE table=default.Table_9927b4fde83442bda0a1c9737a8b239f [id=8b5af7ae4e48454e9204a5784912842d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.295785 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2526884ab0ef404aaf93051cc842c695. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.297695 6319 tablet_service.cc:1511] Processing CreateTablet for tablet 40adb472162042e48fdbb496b342996a (DEFAULT_TABLE table=default.Table_da274282ae7c4941a43506b4dfbaf430 [id=8fe16214ad774a54982dbadeac1b4235]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.298074 6461 ts_tablet_manager.cc:1916] T e1752d6b46894796bdc94e6230e3327d P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:06.298112 6280 leader_election.cc:343] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:06.298316 6319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40adb472162042e48fdbb496b342996a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.298316 6021 tablet_service.cc:1511] Processing CreateTablet for tablet c5cb76fa5e084604aa58bf888cfe4852 (DEFAULT_TABLE table=default.Table_1a74b652ec7a4165b28643c452000d6d [id=74399f12686743ebbd14943c316be210]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.298679 6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5cb76fa5e084604aa58bf888cfe4852. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.299984 6180 tablet_service.cc:1511] Processing CreateTablet for tablet 2852e91ccd0c44b3b16f8189e57575d7 (DEFAULT_TABLE table=default.Table_63a3afc2f4ac454cb8bb6551ba17376c [id=5a6519f52d71406bac54e12459ef85a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.300057 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 40adb472162042e48fdbb496b342996a (DEFAULT_TABLE table=default.Table_da274282ae7c4941a43506b4dfbaf430 [id=8fe16214ad774a54982dbadeac1b4235]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.300410 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40adb472162042e48fdbb496b342996a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.300627 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2852e91ccd0c44b3b16f8189e57575d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.304463 6324 tablet_service.cc:1511] Processing CreateTablet for tablet 2526884ab0ef404aaf93051cc842c695 (DEFAULT_TABLE table=default.Table_9927b4fde83442bda0a1c9737a8b239f [id=8b5af7ae4e48454e9204a5784912842d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.304976 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2526884ab0ef404aaf93051cc842c695. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.307435 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 254) took 2298 ms. Trace:
I20260923 19:50:06.307545 6459 rpcz_store.cc:276] 0923 19:50:04.008503 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:04.008703 (+ 200us) service_pool.cc:224] Handling call
0923 19:50:06.191392 (+2182689us) ts_tablet_manager.cc:1151] Deleting tablet 4bf129dd52b84a4ea461ec454bc34fe8
0923 19:50:06.191409 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.234095 (+ 42686us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.286999 (+ 52904us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.307372 (+ 20373us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2182298}
I20260923 19:50:06.311578 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 4bf129dd52b84a4ea461ec454bc34fe8 (table default.Table_75d1617a325e4c6591795f8378cfa93d [id=5e08f31834ac4ba188ce1b23889287a4]) successfully deleted
I20260923 19:50:06.244961 6458 ts_tablet_manager.cc:1929] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:06.313832 6458 log.cc:1199] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/4dbc0e17d77140f6abe9ee26c8ec13ee
I20260923 19:50:06.308017 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 258) took 2136 ms. Trace:
I20260923 19:50:06.314078 6459 rpcz_store.cc:276] 0923 19:50:04.171340 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:04.171538 (+ 198us) service_pool.cc:224] Handling call
0923 19:50:06.307819 (+2136281us) ts_tablet_manager.cc:1151] Deleting tablet 5e711e48156b46b5a517b330d6d41309
0923 19:50:06.307829 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.307970 (+ 141us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2082276}
I20260923 19:50:06.314260 6458 ts_tablet_manager.cc:1950] T 4dbc0e17d77140f6abe9ee26c8ec13ee P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:06.314684 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 259) took 2118 ms. Trace:
I20260923 19:50:06.315220 6459 rpcz_store.cc:276] 0923 19:50:04.196394 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:04.196564 (+ 170us) service_pool.cc:224] Handling call
0923 19:50:06.314526 (+2117962us) ts_tablet_manager.cc:1151] Deleting tablet 6238d16b1be74dd88fd2e089fbd85d33
0923 19:50:06.314536 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.314636 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2077201}
W20260923 19:50:06.315775 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 5e711e48156b46b5a517b330d6d41309 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e711e48156b46b5a517b330d6d41309 already in progress: creating tablet
I20260923 19:50:06.316045 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 263) took 2078 ms. Trace:
W20260923 19:50:06.316061 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 6238d16b1be74dd88fd2e089fbd85d33 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6238d16b1be74dd88fd2e089fbd85d33 already in progress: creating tablet
I20260923 19:50:06.316134 6459 rpcz_store.cc:276] 0923 19:50:04.237767 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:04.238127 (+ 360us) service_pool.cc:224] Handling call
0923 19:50:06.315893 (+2077766us) ts_tablet_manager.cc:1151] Deleting tablet 896bd068e6b343e48eb2a01679b49326
0923 19:50:06.315902 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.315995 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2077544}
W20260923 19:50:06.316529 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 896bd068e6b343e48eb2a01679b49326 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 896bd068e6b343e48eb2a01679b49326 already in progress: creating tablet
I20260923 19:50:06.318867 6279 leader_election.cc:304] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:06.319346 6814 raft_consensus.cc:2804] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:06.319440 6814 raft_consensus.cc:493] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:06.319535 6814 raft_consensus.cc:3060] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:06.322218 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 183) took 3656 ms. Trace:
I20260923 19:50:06.322378 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 260) took 2092 ms. Trace:
I20260923 19:50:06.322350 6458 rpcz_store.cc:276] 0923 19:50:02.666215 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:02.672970 (+ 6755us) service_pool.cc:224] Handling call
0923 19:50:06.078364 (+3405394us) ts_tablet_manager.cc:1151] Deleting tablet 4dbc0e17d77140f6abe9ee26c8ec13ee
0923 19:50:06.078376 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.148973 (+ 70597us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.244530 (+ 95557us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.322158 (+ 77628us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7012,"tablet-delete.queue_time_us":3405036}
I20260923 19:50:06.322474 6814 raft_consensus.cc:515] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.322818 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 4dbc0e17d77140f6abe9ee26c8ec13ee (table default.Table_701c81d7fd4844f09fc1ccc28f0eda9c [id=67292e21e6b546298c5d629c6ebcb718]) successfully deleted
I20260923 19:50:06.322943 6459 rpcz_store.cc:276] 0923 19:50:04.229936 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:04.230365 (+ 429us) service_pool.cc:224] Handling call
0923 19:50:06.322218 (+2091853us) ts_tablet_manager.cc:1151] Deleting tablet 063fc0e77d294ddf8a02e9ab5968a5e3
0923 19:50:06.322228 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.322328 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1959065}
I20260923 19:50:06.323295 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 184) took 3215 ms. Trace:
I20260923 19:50:06.323359 6814 leader_election.cc:290] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:06.323408 6458 rpcz_store.cc:276] 0923 19:50:03.108326 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.108403 (+ 77us) service_pool.cc:224] Handling call
0923 19:50:06.323131 (+3214728us) ts_tablet_manager.cc:1151] Deleting tablet 15c0dc02ba964af38ca9f76161722588
0923 19:50:06.323140 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.323239 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3203062}
W20260923 19:50:06.323930 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 15c0dc02ba964af38ca9f76161722588 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15c0dc02ba964af38ca9f76161722588 already in progress: creating tablet
I20260923 19:50:06.324311 6458 tablet_replica.cc:333] T b302820d329a41f0a9a54501c079fcd7 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:06.324587 6458 raft_consensus.cc:2243] T b302820d329a41f0a9a54501c079fcd7 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:06.325053 6458 raft_consensus.cc:2272] T b302820d329a41f0a9a54501c079fcd7 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:06.325711 6057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adadf8caf5e4a9ab1107d0fb6a91735" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:06.325927 6057 raft_consensus.cc:3060] T 5adadf8caf5e4a9ab1107d0fb6a91735 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:06.326767 6458 ts_tablet_manager.cc:1916] T b302820d329a41f0a9a54501c079fcd7 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:06.326718 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_d0220d5f0f8c461bb1c01dd67bdf55fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:06.327301 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d0220d5f0f8c461bb1c01dd67bdf55fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:06.328092 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 063fc0e77d294ddf8a02e9ab5968a5e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 063fc0e77d294ddf8a02e9ab5968a5e3 already in progress: creating tablet
I20260923 19:50:06.329070 6057 raft_consensus.cc:2468] T 5adadf8caf5e4a9ab1107d0fb6a91735 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:06.323879 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adadf8caf5e4a9ab1107d0fb6a91735" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:06.330201 6459 tablet_replica.cc:333] T 77f111a495f3429cb243417824095d02 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
W20260923 19:50:06.330610 6280 leader_election.cc:343] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:06.332844 6279 leader_election.cc:304] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:06.334131 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e1c19a751904a6295897376e9c5ee56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.335875 6314 tablet_service.cc:1511] Processing CreateTablet for tablet 2e1c19a751904a6295897376e9c5ee56 (DEFAULT_TABLE table=default.Table_4761dd5028c84fd1beaa780170cbec4e [id=1b8502abd3df41d29e789b845fb0e984]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.336306 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e1c19a751904a6295897376e9c5ee56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.341373 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_5d857e3696b8413faa0b7aee17bcbde9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:06.342253 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d857e3696b8413faa0b7aee17bcbde9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:06.345149 6176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2526884ab0ef404aaf93051cc842c695. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:06.347849 5797 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f74e7cb3e5f54dfdb2280c795ce2ce53 consensus state has no leader
I20260923 19:50:06.348237 5797 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_76a4d42c4ee8417fa82124f036ec71de" } modify_external_catalogs: true
I20260923 19:50:06.348420 5797 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_76a4d42c4ee8417fa82124f036ec71de" } modify_external_catalogs: true
I20260923 19:50:06.348107 6461 ts_tablet_manager.cc:1929] T e1752d6b46894796bdc94e6230e3327d P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:06.348727 6461 log.cc:1199] T e1752d6b46894796bdc94e6230e3327d P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/e1752d6b46894796bdc94e6230e3327d
I20260923 19:50:06.351094 6461 ts_tablet_manager.cc:1950] T e1752d6b46894796bdc94e6230e3327d P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:06.355438 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 239) took 2967 ms. Trace:
I20260923 19:50:06.355573 6461 rpcz_store.cc:276] 0923 19:50:03.388206 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.407892 (+ 19686us) service_pool.cc:224] Handling call
0923 19:50:06.252684 (+2844792us) ts_tablet_manager.cc:1151] Deleting tablet e1752d6b46894796bdc94e6230e3327d
0923 19:50:06.252695 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.310041 (+ 57346us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.336363 (+ 26322us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.355404 (+ 19041us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2844476}
I20260923 19:50:06.356033 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet e1752d6b46894796bdc94e6230e3327d (table default.Table_7c9010170aac47fdbbc0aa6b197ecac3 [id=387269136a564b4f9bc782c785066dd8]) successfully deleted
I20260923 19:50:06.356309 6027 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c0142f4e3ad42048803481d68f0ee5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:06.361420 5804 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_413519bded0c44f3b92a3710f13f69bb" } modify_external_catalogs: true
I20260923 19:50:06.361603 5804 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_413519bded0c44f3b92a3710f13f69bb" } modify_external_catalogs: true
I20260923 19:50:06.362109 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet a10d35bf564d45488524d3d21721f4e5
I20260923 19:50:06.362823 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_9acef25c391f4b8c9354ebc2c0a70c81"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:06.363358 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9acef25c391f4b8c9354ebc2c0a70c81 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:06.363654 6027 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b15b250f594459eb959b4871f7ae398 with delete_type TABLET_DATA_DELETED (replaced by tablet c19298691d5d4209b2d1147a1aad2f6f) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:06.365171 6026 tablet_service.cc:1558] Processing DeleteTablet for tablet a10d35bf564d45488524d3d21721f4e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:06.365504 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet a10d35bf564d45488524d3d21721f4e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:06.380035 6461 tablet_replica.cc:333] T b302820d329a41f0a9a54501c079fcd7 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:06.380640 6461 raft_consensus.cc:2243] T b302820d329a41f0a9a54501c079fcd7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:06.384564 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 623052a8c9c2436a828655da6cf6d379
I20260923 19:50:06.385103 6461 raft_consensus.cc:2272] T b302820d329a41f0a9a54501c079fcd7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:06.385444 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_0291d1f518d445cda50f5b95a4aee646" } modify_external_catalogs: true
I20260923 19:50:06.385699 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_0291d1f518d445cda50f5b95a4aee646" } modify_external_catalogs: true
I20260923 19:50:06.386150 6461 ts_tablet_manager.cc:1916] T b302820d329a41f0a9a54501c079fcd7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:06.387264 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_9f1adbf7034440cd8ec248d18c62ba63"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:06.387974 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f1adbf7034440cd8ec248d18c62ba63 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:06.389860 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet d8c8bfa9b7424b9f80f76e0bb05cbc0c
I20260923 19:50:06.391312 5805 catalog_manager.cc:6934] ReplaceTablet: tablet d8c8bfa9b7424b9f80f76e0bb05cbc0c deleted and replaced by tablet cf64073cdde748bc8ed3ce7580a71160
I20260923 19:50:06.391497 5805 master_service.cc:960] ReplaceTablet: received request to replace tablet b87872fb6cc0400c86eddffb29c898e8 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:06.395784 6178 tablet_service.cc:1558] Processing DeleteTablet for tablet d8c8bfa9b7424b9f80f76e0bb05cbc0c with delete_type TABLET_DATA_DELETED (replaced by tablet cf64073cdde748bc8ed3ce7580a71160) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:06.396134 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet 623052a8c9c2436a828655da6cf6d379 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:06.397578 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet b9c187ee1fa8438397c83bc2c2b16925
I20260923 19:50:06.399601 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 02fa9052a7054659baf9b07b770bb538 (DEFAULT_TABLE table=default.Table_5812b40db6ab4814a5c5b3c869967f58 [id=df481a17409f4078a57a0aef11bef720]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.400203 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02fa9052a7054659baf9b07b770bb538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.402750 6027 tablet_service.cc:1558] Processing DeleteTablet for tablet d8c8bfa9b7424b9f80f76e0bb05cbc0c with delete_type TABLET_DATA_DELETED (replaced by tablet cf64073cdde748bc8ed3ce7580a71160) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:06.405278 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet b9c187ee1fa8438397c83bc2c2b16925 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:06.409307 6814 raft_consensus.cc:2804] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:06.410320 6814 raft_consensus.cc:697] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:06.410667 6814 consensus_queue.cc:237] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.413031 6458 ts_tablet_manager.cc:1929] T b302820d329a41f0a9a54501c079fcd7 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:06.413165 6458 log.cc:1199] T b302820d329a41f0a9a54501c079fcd7 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/b302820d329a41f0a9a54501c079fcd7
I20260923 19:50:06.414286 6026 tablet_service.cc:1558] Processing DeleteTablet for tablet 623052a8c9c2436a828655da6cf6d379 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:06.417678 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet b9c187ee1fa8438397c83bc2c2b16925 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:06.418792 6866 raft_consensus.cc:493] T 5455beff354a4616a68d8746e3e4f9a8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:06.418987 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet a10d35bf564d45488524d3d21721f4e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:06.419669 6458 ts_tablet_manager.cc:1950] T b302820d329a41f0a9a54501c079fcd7 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:06.419713 6316 tablet_service.cc:1558] Processing DeleteTablet for tablet d8c8bfa9b7424b9f80f76e0bb05cbc0c with delete_type TABLET_DATA_DELETED (replaced by tablet cf64073cdde748bc8ed3ce7580a71160) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:06.419850 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet 623052a8c9c2436a828655da6cf6d379 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:06.420090 6319 tablet_service.cc:1558] Processing DeleteTablet for tablet b9c187ee1fa8438397c83bc2c2b16925 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:06.420110 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 189) took 3258 ms. Trace:
I20260923 19:50:06.420806 6319 tablet_service.cc:1511] Processing CreateTablet for tablet 02fa9052a7054659baf9b07b770bb538 (DEFAULT_TABLE table=default.Table_5812b40db6ab4814a5c5b3c869967f58 [id=df481a17409f4078a57a0aef11bef720]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.420895 6454 ts_tablet_manager.cc:1434] T 3190d18f00234d71b0a58c2c334ef45f P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.146s user 0.002s sys 0.000s
I20260923 19:50:06.420948 6459 raft_consensus.cc:2243] T 77f111a495f3429cb243417824095d02 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:06.421159 6459 raft_consensus.cc:2272] T 77f111a495f3429cb243417824095d02 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:06.421769 6459 ts_tablet_manager.cc:1916] T 77f111a495f3429cb243417824095d02 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:06.421909 6866 raft_consensus.cc:515] T 5455beff354a4616a68d8746e3e4f9a8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.422745 6456 tablet_bootstrap.cc:492] T 6a34e178007b4e8ebed429cedf44e82a P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:06.422906 6456 ts_tablet_manager.cc:1403] T 6a34e178007b4e8ebed429cedf44e82a P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.217s user 0.004s sys 0.000s
I20260923 19:50:06.423451 6454 tablet_bootstrap.cc:492] T 640a98d3a845461e8d4f07041ab515c7 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:06.423813 6456 raft_consensus.cc:359] T 6a34e178007b4e8ebed429cedf44e82a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.424022 6456 raft_consensus.cc:385] T 6a34e178007b4e8ebed429cedf44e82a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:06.424139 6456 raft_consensus.cc:740] T 6a34e178007b4e8ebed429cedf44e82a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:06.424384 6456 consensus_queue.cc:260] T 6a34e178007b4e8ebed429cedf44e82a P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.424793 6866 leader_election.cc:290] T 5455beff354a4616a68d8746e3e4f9a8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:06.424978 6319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02fa9052a7054659baf9b07b770bb538. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:06.427527 6279 leader_election.cc:343] T 5455beff354a4616a68d8746e3e4f9a8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 5455beff354a4616a68d8746e3e4f9a8
I20260923 19:50:06.429427 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5455beff354a4616a68d8746e3e4f9a8" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:06.426024 6458 rpcz_store.cc:276] 0923 19:50:03.161542 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.161967 (+ 425us) service_pool.cc:224] Handling call
0923 19:50:06.324223 (+3162256us) ts_tablet_manager.cc:1151] Deleting tablet b302820d329a41f0a9a54501c079fcd7
0923 19:50:06.324236 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.330397 (+ 6161us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.412259 (+ 81862us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.419991 (+ 7732us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3162013}
I20260923 19:50:06.430256 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 190) took 3268 ms. Trace:
I20260923 19:50:06.430606 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet b302820d329a41f0a9a54501c079fcd7 (table default.Table_a34330ce2a604efca09f754e4d3e2127 [id=18f1a98d21a2426faed4f4dbf4fc57d1]) successfully deleted
I20260923 19:50:06.431981 6458 rpcz_store.cc:276] 0923 19:50:03.161660 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.162249 (+ 589us) service_pool.cc:224] Handling call
0923 19:50:06.430106 (+3267857us) ts_tablet_manager.cc:1151] Deleting tablet d2298d814a104f5cb62196be3bf0dae6
0923 19:50:06.430117 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.430219 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3267698}
I20260923 19:50:06.432395 6456 ts_tablet_manager.cc:1434] T 6a34e178007b4e8ebed429cedf44e82a P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
W20260923 19:50:06.432562 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet d2298d814a104f5cb62196be3bf0dae6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2298d814a104f5cb62196be3bf0dae6 already in progress: creating tablet
W20260923 19:50:06.433774 6280 leader_election.cc:343] T 5455beff354a4616a68d8746e3e4f9a8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:06.433990 6456 tablet_bootstrap.cc:492] T a224ae69503e4ab588d6269086317f09 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:06.434203 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 194) took 3211 ms. Trace:
I20260923 19:50:06.434111 6280 leader_election.cc:304] T 5455beff354a4616a68d8746e3e4f9a8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:06.436012 6458 rpcz_store.cc:276] 0923 19:50:03.221002 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.222751 (+ 1749us) service_pool.cc:224] Handling call
0923 19:50:06.432326 (+3209575us) ts_tablet_manager.cc:1151] Deleting tablet e071b9dd1db44af0a9d1b9e904f875a5
0923 19:50:06.432334 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.432822 (+ 488us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3205393}
I20260923 19:50:06.437733 6454 tablet_bootstrap.cc:654] T 640a98d3a845461e8d4f07041ab515c7 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:06.438090 6458 tablet_replica.cc:333] T 7504a2be25b54ed4bc539eb10199fe15 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:06.438973 6867 raft_consensus.cc:2749] T 5455beff354a4616a68d8746e3e4f9a8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:06.439330 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_d7d1452530dc40018f8d5568a97f273b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:06.439960 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d7d1452530dc40018f8d5568a97f273b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:06.441226 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_1916c5305d984163ac72fcf98ce30e62"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:06.441736 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1916c5305d984163ac72fcf98ce30e62 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:06.442188 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_6fc559685e30469ea0537af2f4cf6e1c" } new_table_name: "default.Table_0eb28975495e4bedaf7c538454e525f6" modify_external_catalogs: true
I20260923 19:50:06.442394 5797 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_62802f9e844c4c16bf9cb0d04a630fa9" } new_table_name: "default.Table_0ebdc6bda57442b796dabb005f3779c5" modify_external_catalogs: true
I20260923 19:50:06.448091 6459 ts_tablet_manager.cc:1929] T 77f111a495f3429cb243417824095d02 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:06.448232 6459 log.cc:1199] T 77f111a495f3429cb243417824095d02 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/77f111a495f3429cb243417824095d02
I20260923 19:50:06.449105 6459 ts_tablet_manager.cc:1950] T 77f111a495f3429cb243417824095d02 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:06.450817 6457 tablet_bootstrap.cc:492] T 9101e82501fd461f8a4b2dcd9dffbd74 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:06.450990 6457 ts_tablet_manager.cc:1403] T 9101e82501fd461f8a4b2dcd9dffbd74 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.161s user 0.008s sys 0.006s
I20260923 19:50:06.452276 6457 raft_consensus.cc:359] T 9101e82501fd461f8a4b2dcd9dffbd74 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.452463 6457 raft_consensus.cc:385] T 9101e82501fd461f8a4b2dcd9dffbd74 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:06.452585 6457 raft_consensus.cc:740] T 9101e82501fd461f8a4b2dcd9dffbd74 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:06.452847 6457 consensus_queue.cc:260] T 9101e82501fd461f8a4b2dcd9dffbd74 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.453284 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet a926ff092e6e495e981be156421e8d72
I20260923 19:50:06.455255 6176 tablet_service.cc:1558] Processing DeleteTablet for tablet a926ff092e6e495e981be156421e8d72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:06.455847 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet a926ff092e6e495e981be156421e8d72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:06.456709 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet a926ff092e6e495e981be156421e8d72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:06.457990 6457 ts_tablet_manager.cc:1434] T 9101e82501fd461f8a4b2dcd9dffbd74 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.007s user 0.002s sys 0.002s
I20260923 19:50:06.462622 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 301) took 1119 ms. Trace:
I20260923 19:50:06.462845 6459 rpcz_store.cc:276] 0923 19:50:05.343190 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.344547 (+ 1357us) service_pool.cc:224] Handling call
0923 19:50:06.330117 (+985570us) ts_tablet_manager.cc:1151] Deleting tablet 77f111a495f3429cb243417824095d02
0923 19:50:06.330129 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.427732 (+ 97603us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.447993 (+ 20261us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.462568 (+ 14575us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90516,"tablet-delete.queue_time_us":985286}
I20260923 19:50:06.463263 6459 tablet_replica.cc:333] T 8db0358af7634911820f99fe16605ca7 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:06.463472 6459 raft_consensus.cc:2243] T 8db0358af7634911820f99fe16605ca7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:06.463431 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 77f111a495f3429cb243417824095d02 (table default.Table_552860e790be402a91af4ff2e2185d10 [id=e98e62b25556431abdccca23fa9d81e2]) successfully deleted
I20260923 19:50:06.463640 6459 raft_consensus.cc:2272] T 8db0358af7634911820f99fe16605ca7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:06.464035 6457 tablet_bootstrap.cc:492] T 4750e2a1b24e4bc7aafa4cd36afebbbd P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:06.465409 6457 tablet_bootstrap.cc:654] T 4750e2a1b24e4bc7aafa4cd36afebbbd P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:06.466902 6454 tablet_bootstrap.cc:492] T 640a98d3a845461e8d4f07041ab515c7 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:06.467067 6454 ts_tablet_manager.cc:1403] T 640a98d3a845461e8d4f07041ab515c7 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.046s user 0.002s sys 0.001s
I20260923 19:50:06.467746 6454 raft_consensus.cc:359] T 640a98d3a845461e8d4f07041ab515c7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.467814 6458 raft_consensus.cc:2243] T 7504a2be25b54ed4bc539eb10199fe15 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:06.467926 6454 raft_consensus.cc:385] T 640a98d3a845461e8d4f07041ab515c7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:06.468014 6454 raft_consensus.cc:740] T 640a98d3a845461e8d4f07041ab515c7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:06.468230 6454 consensus_queue.cc:260] T 640a98d3a845461e8d4f07041ab515c7 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.469063 6458 raft_consensus.cc:2272] T 7504a2be25b54ed4bc539eb10199fe15 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:06.469666 6458 ts_tablet_manager.cc:1916] T 7504a2be25b54ed4bc539eb10199fe15 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:06.471997 6454 ts_tablet_manager.cc:1434] T 640a98d3a845461e8d4f07041ab515c7 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260923 19:50:06.472959 6454 tablet_bootstrap.cc:492] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:06.475178 6454 tablet_bootstrap.cc:654] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:06.478399 6459 ts_tablet_manager.cc:1916] T 8db0358af7634911820f99fe16605ca7 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:06.484965 6454 tablet_bootstrap.cc:492] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:06.485177 6454 ts_tablet_manager.cc:1403] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20260923 19:50:06.485749 6456 tablet_bootstrap.cc:654] T a224ae69503e4ab588d6269086317f09 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:06.486621 6457 tablet_bootstrap.cc:492] T 4750e2a1b24e4bc7aafa4cd36afebbbd P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:06.486824 6454 raft_consensus.cc:359] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.487486 6457 ts_tablet_manager.cc:1403] T 4750e2a1b24e4bc7aafa4cd36afebbbd P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.001s
I20260923 19:50:06.489121 6454 raft_consensus.cc:385] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:06.490031 6457 raft_consensus.cc:359] T 4750e2a1b24e4bc7aafa4cd36afebbbd P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.490266 6454 raft_consensus.cc:740] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:06.492772 6454 consensus_queue.cc:260] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.497150 6454 ts_tablet_manager.cc:1434] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.012s user 0.001s sys 0.000s
I20260923 19:50:06.487293 6461 ts_tablet_manager.cc:1929] T b302820d329a41f0a9a54501c079fcd7 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:06.497520 6461 log.cc:1199] T b302820d329a41f0a9a54501c079fcd7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/b302820d329a41f0a9a54501c079fcd7
I20260923 19:50:06.498085 6461 ts_tablet_manager.cc:1950] T b302820d329a41f0a9a54501c079fcd7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:06.499238 6457 raft_consensus.cc:385] T 4750e2a1b24e4bc7aafa4cd36afebbbd P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:06.497618 6203 raft_consensus.cc:3060] T b2762648045b4378bcc2c1234460c352 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:06.499652 6454 tablet_bootstrap.cc:492] T e1752d6b46894796bdc94e6230e3327d P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:06.499879 6457 raft_consensus.cc:740] T 4750e2a1b24e4bc7aafa4cd36afebbbd P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:06.500166 6457 consensus_queue.cc:260] T 4750e2a1b24e4bc7aafa4cd36afebbbd P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.500679 6457 ts_tablet_manager.cc:1434] T 4750e2a1b24e4bc7aafa4cd36afebbbd P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20260923 19:50:06.498989 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 243) took 3056 ms. Trace:
I20260923 19:50:06.502409 6461 rpcz_store.cc:276] 0923 19:50:03.442850 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.443066 (+ 216us) service_pool.cc:224] Handling call
0923 19:50:06.379956 (+2936890us) ts_tablet_manager.cc:1151] Deleting tablet b302820d329a41f0a9a54501c079fcd7
0923 19:50:06.379969 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.419461 (+ 39492us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.487177 (+ 67716us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.498932 (+ 11755us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2936564}
I20260923 19:50:06.502805 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet b302820d329a41f0a9a54501c079fcd7 (table default.Table_a34330ce2a604efca09f754e4d3e2127 [id=18f1a98d21a2426faed4f4dbf4fc57d1]) successfully deleted
I20260923 19:50:06.503036 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 244) took 2987 ms. Trace:
I20260923 19:50:06.502992 6867 consensus_queue.cc:1048] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:06.506775 6457 tablet_bootstrap.cc:492] T 789c54477bec4636bb3669e1f62730e2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:06.508548 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_81d47fdf0e514f1eba3c801278533173"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:06.509132 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_81d47fdf0e514f1eba3c801278533173 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:06.512279 5800 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet b2762648045b4378bcc2c1234460c352
I20260923 19:50:06.512768 5800 catalog_manager.cc:6934] ReplaceTablet: tablet b2762648045b4378bcc2c1234460c352 deleted and replaced by tablet 7f47efa0cabd47aa8ed0deface7763ab
I20260923 19:50:06.514928 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_da274282ae7c4941a43506b4dfbaf430" } new_table_name: "default.Table_6525269b0ed345d9a2b2cb1dea0f47aa" modify_external_catalogs: true
I20260923 19:50:06.516330 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_485a26957d3246788384f23059c2359f" } new_table_name: "default.Table_3a666373aff54c2d8256d8fc785cfcc1" modify_external_catalogs: true
I20260923 19:50:06.518005 6319 tablet_service.cc:1558] Processing DeleteTablet for tablet b2762648045b4378bcc2c1234460c352 with delete_type TABLET_DATA_DELETED (replaced by tablet 7f47efa0cabd47aa8ed0deface7763ab) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:06.518185 6867 raft_consensus.cc:493] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:06.518356 6867 raft_consensus.cc:515] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.519006 6867 leader_election.cc:290] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:06.513394 6459 ts_tablet_manager.cc:1929] T 8db0358af7634911820f99fe16605ca7 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:06.520520 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5ce253bcce410b9517449f133d39e8" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:06.521100 6459 log.cc:1199] T 8db0358af7634911820f99fe16605ca7 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/8db0358af7634911820f99fe16605ca7
I20260923 19:50:06.520838 6176 tablet_service.cc:1558] Processing DeleteTablet for tablet b2762648045b4378bcc2c1234460c352 with delete_type TABLET_DATA_DELETED (replaced by tablet 7f47efa0cabd47aa8ed0deface7763ab) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:06.521600 6459 ts_tablet_manager.cc:1950] T 8db0358af7634911820f99fe16605ca7 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:06.510061 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet 9101e82501fd461f8a4b2dcd9dffbd74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:06.515074 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet 4750e2a1b24e4bc7aafa4cd36afebbbd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:00 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:06.517582 6026 tablet_service.cc:1558] Processing DeleteTablet for tablet b2762648045b4378bcc2c1234460c352 with delete_type TABLET_DATA_DELETED (replaced by tablet 7f47efa0cabd47aa8ed0deface7763ab) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:06.520614 6057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5ce253bcce410b9517449f133d39e8" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:06.522068 6057 raft_consensus.cc:2468] T 0a5ce253bcce410b9517449f133d39e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:06.522501 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 310) took 1099 ms. Trace:
I20260923 19:50:06.521548 6461 rpcz_store.cc:276] 0923 19:50:03.515727 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.519503 (+ 3776us) service_pool.cc:224] Handling call
0923 19:50:06.502867 (+2983364us) ts_tablet_manager.cc:1151] Deleting tablet 42e9cbcf77324d91abd029c12eaf950d
0923 19:50:06.502877 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.502985 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2982861}
I20260923 19:50:06.524372 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 245) took 3003 ms. Trace:
I20260923 19:50:06.525054 6461 rpcz_store.cc:276] 0923 19:50:03.520423 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.520493 (+ 70us) service_pool.cc:224] Handling call
0923 19:50:06.524196 (+3003703us) ts_tablet_manager.cc:1151] Deleting tablet 359b08ef348d4be68b14f9e871a5e519
0923 19:50:06.524220 (+ 24us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.524322 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3003049}
W20260923 19:50:06.525731 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 42e9cbcf77324d91abd029c12eaf950d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 42e9cbcf77324d91abd029c12eaf950d already in progress: creating tablet
W20260923 19:50:06.526031 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 359b08ef348d4be68b14f9e871a5e519 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 359b08ef348d4be68b14f9e871a5e519 already in progress: creating tablet
I20260923 19:50:06.526393 6461 tablet_replica.cc:333] T a224ae69503e4ab588d6269086317f09 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:06.526643 6461 raft_consensus.cc:2243] T a224ae69503e4ab588d6269086317f09 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:06.527663 6461 raft_consensus.cc:2272] T a224ae69503e4ab588d6269086317f09 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:06.524968 6454 tablet_bootstrap.cc:654] T e1752d6b46894796bdc94e6230e3327d P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:06.527766 6459 rpcz_store.cc:276] 0923 19:50:05.423019 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.426141 (+ 3122us) service_pool.cc:224] Handling call
0923 19:50:06.463184 (+1037043us) ts_tablet_manager.cc:1151] Deleting tablet 8db0358af7634911820f99fe16605ca7
0923 19:50:06.463197 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.483534 (+ 20337us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.513313 (+ 29779us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.522451 (+ 9138us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1036791}
I20260923 19:50:06.528326 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 8db0358af7634911820f99fe16605ca7 (table default.Table_02aee02d3b8746ce98cba010a0ac8149 [id=47c37093044c462993bba6cb00bd296a]) successfully deleted
I20260923 19:50:06.529121 6461 ts_tablet_manager.cc:1916] T a224ae69503e4ab588d6269086317f09 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:06.529466 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 316) took 1033 ms. Trace:
I20260923 19:50:06.529619 6459 rpcz_store.cc:276] 0923 19:50:05.495817 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.495927 (+ 110us) service_pool.cc:224] Handling call
0923 19:50:06.529310 (+1033383us) ts_tablet_manager.cc:1151] Deleting tablet 870db252d8414be7bbe613ea467b5f3a
0923 19:50:06.529318 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.529412 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1033169}
I20260923 19:50:06.529971 6457 tablet_bootstrap.cc:654] T 789c54477bec4636bb3669e1f62730e2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:06.532243 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 870db252d8414be7bbe613ea467b5f3a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 870db252d8414be7bbe613ea467b5f3a already in progress: creating tablet
I20260923 19:50:06.536074 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 315) took 1040 ms. Trace:
I20260923 19:50:06.536254 6459 rpcz_store.cc:276] 0923 19:50:05.495702 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.515088 (+ 19386us) service_pool.cc:224] Handling call
0923 19:50:06.533750 (+1018662us) ts_tablet_manager.cc:1151] Deleting tablet 7b1601590508479c8f401cd09d9f4c3b
0923 19:50:06.533763 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.536012 (+ 2249us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1018408}
W20260923 19:50:06.536834 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 7b1601590508479c8f401cd09d9f4c3b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7b1601590508479c8f401cd09d9f4c3b already in progress: creating tablet
I20260923 19:50:06.537344 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 314) took 1041 ms. Trace:
I20260923 19:50:06.539233 6459 rpcz_store.cc:276] 0923 19:50:05.495597 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.515359 (+ 19762us) service_pool.cc:224] Handling call
0923 19:50:06.537180 (+1021821us) ts_tablet_manager.cc:1151] Deleting tablet 235b4b8081ad4a13937a7941344dbc33
0923 19:50:06.537194 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.537291 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1021662}
W20260923 19:50:06.539846 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 235b4b8081ad4a13937a7941344dbc33 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 235b4b8081ad4a13937a7941344dbc33 already in progress: creating tablet
W20260923 19:50:06.540148 6280 leader_election.cc:343] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:06.540359 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 317) took 1018 ms. Trace:
I20260923 19:50:06.540452 6459 rpcz_store.cc:276] 0923 19:50:05.521757 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.539475 (+ 17718us) service_pool.cc:224] Handling call
0923 19:50:06.540202 (+1000727us) ts_tablet_manager.cc:1151] Deleting tablet e1de117713f34b51bbda0c712f0b837c
0923 19:50:06.540213 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.540309 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1000509}
I20260923 19:50:06.540699 6279 leader_election.cc:304] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
W20260923 19:50:06.540918 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet e1de117713f34b51bbda0c712f0b837c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e1de117713f34b51bbda0c712f0b837c already in progress: creating tablet
I20260923 19:50:06.541235 6866 raft_consensus.cc:2804] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:06.541282 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 318) took 1019 ms. Trace:
I20260923 19:50:06.541363 6459 rpcz_store.cc:276] 0923 19:50:05.521988 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.538977 (+ 16989us) service_pool.cc:224] Handling call
0923 19:50:06.541150 (+1002173us) ts_tablet_manager.cc:1151] Deleting tablet 2948d729e1ec4dfca70789bcad513e52
0923 19:50:06.541158 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.541235 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1001250}
W20260923 19:50:06.541800 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 2948d729e1ec4dfca70789bcad513e52 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2948d729e1ec4dfca70789bcad513e52 already in progress: creating tablet
I20260923 19:50:06.541932 6866 raft_consensus.cc:493] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:06.542055 6866 raft_consensus.cc:3060] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
W20260923 19:50:06.544999 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 601a0ff319cc4c9a898d52bbcb19184b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 601a0ff319cc4c9a898d52bbcb19184b already in progress: creating tablet
W20260923 19:50:06.549240 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 7e41501bf01e4765853c27e4cac21e2b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e41501bf01e4765853c27e4cac21e2b already in progress: creating tablet
I20260923 19:50:06.549695 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet b87872fb6cc0400c86eddffb29c898e8
W20260923 19:50:06.549993 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet b18548ba557f448880c5e617fc03cbe0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b18548ba557f448880c5e617fc03cbe0 already in progress: creating tablet
I20260923 19:50:06.550266 5805 catalog_manager.cc:6934] ReplaceTablet: tablet b87872fb6cc0400c86eddffb29c898e8 deleted and replaced by tablet 37769256de33432697e9d4fb235f473f
I20260923 19:50:06.550664 6176 tablet_service.cc:1558] Processing DeleteTablet for tablet b87872fb6cc0400c86eddffb29c898e8 with delete_type TABLET_DATA_DELETED (replaced by tablet 37769256de33432697e9d4fb235f473f) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:06.550704 6026 tablet_service.cc:1558] Processing DeleteTablet for tablet b87872fb6cc0400c86eddffb29c898e8 with delete_type TABLET_DATA_DELETED (replaced by tablet 37769256de33432697e9d4fb235f473f) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:06.551031 6459 tablet_replica.cc:333] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:06.551368 6459 raft_consensus.cc:2243] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:06.551632 6459 raft_consensus.cc:2272] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:06.552237 6459 ts_tablet_manager.cc:1916] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:06.554804 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet b985acc650334497832cf4505e1b0043
I20260923 19:50:06.555855 6176 tablet_service.cc:1558] Processing DeleteTablet for tablet b985acc650334497832cf4505e1b0043 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:06.557587 6026 tablet_service.cc:1558] Processing DeleteTablet for tablet b985acc650334497832cf4505e1b0043 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:06.563159 5803 master_service.cc:960] ReplaceTablet: received request to replace tablet 896bd068e6b343e48eb2a01679b49326 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:06.563609 5803 master_service.cc:960] ReplaceTablet: received request to replace tablet 5e711e48156b46b5a517b330d6d41309 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:06.564036 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_b0aaf57c3ec9414f89529017165bc65b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:06.564577 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b0aaf57c3ec9414f89529017165bc65b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:06.566105 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_2a3fec3aaca84ecbac231d0c5d5be419"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:06.566555 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a3fec3aaca84ecbac231d0c5d5be419 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:06.573350 6459 ts_tablet_manager.cc:1929] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260923 19:50:06.573462 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ad29d22a82434023991ffcacf7f9bee5 consensus state has no leader
I20260923 19:50:06.573820 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_1dc31225e50d46e582e8a8832c568190"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:06.574333 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1dc31225e50d46e582e8a8832c568190 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:06.569782 5802 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d937cfba979e408ebde3725792f5e4e2" } new_table_name: "default.Table_1d4cb0bc31f24833b90af35484c083e5" modify_external_catalogs: true
I20260923 19:50:06.577997 6459 log.cc:1199] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/cc3b6d245c3e40cdabb20d7dcf07ec0e
I20260923 19:50:06.578486 6459 ts_tablet_manager.cc:1950] T cc3b6d245c3e40cdabb20d7dcf07ec0e P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:06.578966 6458 ts_tablet_manager.cc:1929] T 7504a2be25b54ed4bc539eb10199fe15 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:06.579970 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet cc3b6d245c3e40cdabb20d7dcf07ec0e (table default.Table_41c4d80198a246a78955ae6ab79f3532 [id=da91b06e11c64bb0aaec37a0188b5586]) successfully deleted
I20260923 19:50:06.581413 6319 tablet_service.cc:1558] Processing DeleteTablet for tablet b87872fb6cc0400c86eddffb29c898e8 with delete_type TABLET_DATA_DELETED (replaced by tablet 37769256de33432697e9d4fb235f473f) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:06.581473 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet b985acc650334497832cf4505e1b0043 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:06.583312 6458 log.cc:1199] T 7504a2be25b54ed4bc539eb10199fe15 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/7504a2be25b54ed4bc539eb10199fe15
I20260923 19:50:06.583957 6866 raft_consensus.cc:515] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.585206 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5ce253bcce410b9517449f133d39e8" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
W20260923 19:50:06.585796 6280 leader_election.cc:343] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:06.586195 6866 leader_election.cc:290] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:06.587071 6057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5ce253bcce410b9517449f133d39e8" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:06.587311 6057 raft_consensus.cc:3060] T 0a5ce253bcce410b9517449f133d39e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:06.588567 6459 tablet_replica.cc:333] T f7e282b6699a4ce9837d221132a1f54e P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:06.588789 6459 raft_consensus.cc:2243] T f7e282b6699a4ce9837d221132a1f54e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:06.588940 6459 raft_consensus.cc:2272] T f7e282b6699a4ce9837d221132a1f54e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:06.589385 6461 ts_tablet_manager.cc:1929] T a224ae69503e4ab588d6269086317f09 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:06.589468 6459 ts_tablet_manager.cc:1916] T f7e282b6699a4ce9837d221132a1f54e P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:06.589526 6461 log.cc:1199] T a224ae69503e4ab588d6269086317f09 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/a224ae69503e4ab588d6269086317f09
I20260923 19:50:06.591504 6057 raft_consensus.cc:2468] T 0a5ce253bcce410b9517449f133d39e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:06.592221 6866 raft_consensus.cc:493] T 2f78261842744af08d86da64d37d708c P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e546f660e7e541d1aa9ae38e5ee5b9c0)
I20260923 19:50:06.592406 6866 raft_consensus.cc:515] T 2f78261842744af08d86da64d37d708c P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.594200 6457 tablet_bootstrap.cc:492] T 789c54477bec4636bb3669e1f62730e2 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:06.594355 6457 ts_tablet_manager.cc:1403] T 789c54477bec4636bb3669e1f62730e2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.088s user 0.004s sys 0.002s
I20260923 19:50:06.595095 6457 raft_consensus.cc:359] T 789c54477bec4636bb3669e1f62730e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.595266 6457 raft_consensus.cc:385] T 789c54477bec4636bb3669e1f62730e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:06.595343 6457 raft_consensus.cc:740] T 789c54477bec4636bb3669e1f62730e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:06.595381 6458 ts_tablet_manager.cc:1950] T 7504a2be25b54ed4bc539eb10199fe15 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:06.595544 6457 consensus_queue.cc:260] T 789c54477bec4636bb3669e1f62730e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.596005 6279 leader_election.cc:304] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:06.599170 6814 raft_consensus.cc:2804] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:06.599325 6814 raft_consensus.cc:697] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:06.599865 6456 tablet_bootstrap.cc:492] T a224ae69503e4ab588d6269086317f09 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:06.599892 6814 consensus_queue.cc:237] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.600505 6456 ts_tablet_manager.cc:1403] T a224ae69503e4ab588d6269086317f09 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.167s user 0.005s sys 0.001s
I20260923 19:50:06.602538 6457 ts_tablet_manager.cc:1434] T 789c54477bec4636bb3669e1f62730e2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260923 19:50:06.602631 6456 raft_consensus.cc:359] T a224ae69503e4ab588d6269086317f09 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.603737 6454 tablet_bootstrap.cc:492] T e1752d6b46894796bdc94e6230e3327d P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:06.603878 6454 ts_tablet_manager.cc:1403] T e1752d6b46894796bdc94e6230e3327d P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.104s user 0.003s sys 0.003s
I20260923 19:50:06.604557 6454 raft_consensus.cc:359] T e1752d6b46894796bdc94e6230e3327d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.604907 6454 raft_consensus.cc:385] T e1752d6b46894796bdc94e6230e3327d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:06.605057 6454 raft_consensus.cc:740] T e1752d6b46894796bdc94e6230e3327d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:06.605321 6454 consensus_queue.cc:260] T e1752d6b46894796bdc94e6230e3327d P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.605983 6454 ts_tablet_manager.cc:1434] T e1752d6b46894796bdc94e6230e3327d P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260923 19:50:06.606240 6280 leader_election.cc:343] T 2f78261842744af08d86da64d37d708c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Not found: Tablet not found: 2f78261842744af08d86da64d37d708c
I20260923 19:50:06.607260 6866 leader_election.cc:290] T 2f78261842744af08d86da64d37d708c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:06.607506 6456 raft_consensus.cc:385] T a224ae69503e4ab588d6269086317f09 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260923 19:50:06.607577 6279 leader_election.cc:343] T 2f78261842744af08d86da64d37d708c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 2f78261842744af08d86da64d37d708c
I20260923 19:50:06.607671 6456 raft_consensus.cc:740] T a224ae69503e4ab588d6269086317f09 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:06.607908 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 197) took 3371 ms. Trace:
I20260923 19:50:06.607963 6279 leader_election.cc:304] T 2f78261842744af08d86da64d37d708c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:06.608016 6458 rpcz_store.cc:276] 0923 19:50:03.225911 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.225962 (+ 51us) service_pool.cc:224] Handling call
0923 19:50:06.436663 (+3210701us) ts_tablet_manager.cc:1151] Deleting tablet 7504a2be25b54ed4bc539eb10199fe15
0923 19:50:06.438014 (+ 1351us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.473361 (+ 35347us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.541798 (+ 68437us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.597510 (+ 55712us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3208595}
I20260923 19:50:06.608897 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 7504a2be25b54ed4bc539eb10199fe15 (table default.Table_21a1fa60dde7481e8ad7a7fe355a1e94 [id=9e398f48d86e4c5898cac7336d3c24bf]) successfully deleted
I20260923 19:50:06.610498 6773 raft_consensus.cc:493] T 4b15b250f594459eb959b4871f7ae398 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:06.610632 6773 raft_consensus.cc:515] T 4b15b250f594459eb959b4871f7ae398 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.611287 6773 leader_election.cc:290] T 4b15b250f594459eb959b4871f7ae398 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:06.611490 6866 raft_consensus.cc:2749] T 2f78261842744af08d86da64d37d708c P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 19:50:06.611512 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 188) took 3447 ms. Trace:
I20260923 19:50:06.612152 6454 tablet_bootstrap.cc:492] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:06.612532 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b15b250f594459eb959b4871f7ae398" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:06.612989 6456 consensus_queue.cc:260] T a224ae69503e4ab588d6269086317f09 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.613634 6456 ts_tablet_manager.cc:1434] T a224ae69503e4ab588d6269086317f09 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260923 19:50:06.613632 6865 consensus_queue.cc:1048] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260923 19:50:06.615394 6458 rpcz_store.cc:276] 0923 19:50:03.161435 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.237139 (+ 75704us) service_pool.cc:224] Handling call
0923 19:50:06.608407 (+3371268us) ts_tablet_manager.cc:1151] Deleting tablet 3919b15a00eb4fb08008f065f556c760
0923 19:50:06.608418 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.608523 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3371018}
W20260923 19:50:06.615886 5995 leader_election.cc:343] T 4b15b250f594459eb959b4871f7ae398 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:06.616015 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 3919b15a00eb4fb08008f065f556c760 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3919b15a00eb4fb08008f065f556c760 already in progress: creating tablet
I20260923 19:50:06.616294 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b15b250f594459eb959b4871f7ae398" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:06.616448 6457 tablet_bootstrap.cc:492] T ec4cc8a742114e5fb07c5c9157ce09e8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
W20260923 19:50:06.616865 5996 leader_election.cc:343] T 4b15b250f594459eb959b4871f7ae398 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:06.617193 6456 tablet_bootstrap.cc:492] T d70b7662d85a4f64a11420448c4d140d P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:06.618922 6454 tablet_bootstrap.cc:654] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:06.619936 5996 leader_election.cc:304] T 4b15b250f594459eb959b4871f7ae398 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:06.620255 6773 raft_consensus.cc:2749] T 4b15b250f594459eb959b4871f7ae398 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:06.625072 6461 ts_tablet_manager.cc:1950] T a224ae69503e4ab588d6269086317f09 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:06.625967 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 198) took 3384 ms. Trace:
I20260923 19:50:06.626089 6458 rpcz_store.cc:276] 0923 19:50:03.233192 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.233239 (+ 47us) service_pool.cc:224] Handling call
0923 19:50:06.617145 (+3383906us) ts_tablet_manager.cc:1151] Deleting tablet 194494af2c424a55a772f3858af63c2c
0923 19:50:06.617156 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.617256 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3362560}
I20260923 19:50:06.625852 6457 tablet_bootstrap.cc:654] T ec4cc8a742114e5fb07c5c9157ce09e8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:06.626592 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 194494af2c424a55a772f3858af63c2c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 194494af2c424a55a772f3858af63c2c already in progress: creating tablet
I20260923 19:50:06.628495 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 246) took 3092 ms. Trace:
I20260923 19:50:06.628656 6461 rpcz_store.cc:276] 0923 19:50:03.535518 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.536580 (+ 1062us) service_pool.cc:224] Handling call
0923 19:50:06.525488 (+2988908us) ts_tablet_manager.cc:1151] Deleting tablet a224ae69503e4ab588d6269086317f09
0923 19:50:06.525799 (+ 311us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.585913 (+ 60114us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.589294 (+ 3381us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.628111 (+ 38817us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2988574}
I20260923 19:50:06.629199 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet a224ae69503e4ab588d6269086317f09 (table default.Table_74b3ada03dc14044b09a369b0e3782c7 [id=6c09f84a1d19402b8b59bbc60ae92bcb]) successfully deleted
I20260923 19:50:06.629423 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_82887fe31841462bafc075decf6acdbd" } modify_external_catalogs: true
I20260923 19:50:06.629617 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_82887fe31841462bafc075decf6acdbd" } modify_external_catalogs: true
I20260923 19:50:06.630057 6026 tablet_service.cc:1558] Processing DeleteTablet for tablet 789c54477bec4636bb3669e1f62730e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:06.630424 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 250) took 3004 ms. Trace:
I20260923 19:50:06.630520 6461 rpcz_store.cc:276] 0923 19:50:03.626480 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.628075 (+ 1595us) service_pool.cc:224] Handling call
0923 19:50:06.629932 (+3001857us) ts_tablet_manager.cc:1151] Deleting tablet 6e781ccf4aa343fc924138c3cc2b04e6
0923 19:50:06.629941 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.630394 (+ 453us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2977897}
W20260923 19:50:06.630891 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 6e781ccf4aa343fc924138c3cc2b04e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6e781ccf4aa343fc924138c3cc2b04e6 already in progress: creating tablet
I20260923 19:50:06.631945 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 253) took 2964 ms. Trace:
I20260923 19:50:06.632582 6461 rpcz_store.cc:276] 0923 19:50:03.667143 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.667316 (+ 173us) service_pool.cc:224] Handling call
0923 19:50:06.631824 (+2964508us) ts_tablet_manager.cc:1151] Deleting tablet c0ff8838ab17433ab733d3b293d4964f
0923 19:50:06.631832 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.631909 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2963819}
W20260923 19:50:06.633162 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8d20b59aa99f49f0b2f4d7dd861470f8 has no consensus state
I20260923 19:50:06.633534 5798 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_0562db93b14243108d8731231ae538c1" } modify_external_catalogs: true
I20260923 19:50:06.633697 5798 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_0562db93b14243108d8731231ae538c1" } modify_external_catalogs: true
I20260923 19:50:06.633987 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 260) took 2608 ms. Trace:
W20260923 19:50:06.634925 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet c0ff8838ab17433ab733d3b293d4964f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c0ff8838ab17433ab733d3b293d4964f already in progress: creating tablet
I20260923 19:50:06.634425 6461 rpcz_store.cc:276] 0923 19:50:04.025812 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:04.026990 (+ 1178us) service_pool.cc:224] Handling call
0923 19:50:06.633526 (+2606536us) ts_tablet_manager.cc:1151] Deleting tablet f4e3e64fdf584743a3a88df5d6600b22
0923 19:50:06.633535 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.633950 (+ 415us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2601442}
W20260923 19:50:06.635390 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet f4e3e64fdf584743a3a88df5d6600b22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4e3e64fdf584743a3a88df5d6600b22 already in progress: creating tablet
I20260923 19:50:06.636027 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 264) took 2555 ms. Trace:
I20260923 19:50:06.636914 6461 rpcz_store.cc:276] 0923 19:50:04.080245 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:04.080312 (+ 67us) service_pool.cc:224] Handling call
0923 19:50:06.635894 (+2555582us) ts_tablet_manager.cc:1151] Deleting tablet 6238d16b1be74dd88fd2e089fbd85d33
0923 19:50:06.635902 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.635994 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2554073}
W20260923 19:50:06.637818 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 6238d16b1be74dd88fd2e089fbd85d33 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6238d16b1be74dd88fd2e089fbd85d33 already in progress: creating tablet
I20260923 19:50:06.617769 6459 ts_tablet_manager.cc:1929] T f7e282b6699a4ce9837d221132a1f54e P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:06.639492 6459 log.cc:1199] T f7e282b6699a4ce9837d221132a1f54e P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/f7e282b6699a4ce9837d221132a1f54e
I20260923 19:50:06.639883 6459 ts_tablet_manager.cc:1950] T f7e282b6699a4ce9837d221132a1f54e P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:06.640558 6646 raft_consensus.cc:493] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:06.640722 6646 raft_consensus.cc:515] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.641359 6646 leader_election.cc:290] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:06.643299 6461 tablet_replica.cc:333] T 063fc0e77d294ddf8a02e9ab5968a5e3 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
W20260923 19:50:06.643813 5800 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 40adb472162042e48fdbb496b342996a consensus state has no leader
I20260923 19:50:06.644186 5800 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_bb91666519bc41aaaf1fc7f8e8b26691" } modify_external_catalogs: true
I20260923 19:50:06.644352 5800 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_bb91666519bc41aaaf1fc7f8e8b26691" } modify_external_catalogs: true
I20260923 19:50:06.645407 6461 raft_consensus.cc:2243] T 063fc0e77d294ddf8a02e9ab5968a5e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:06.646481 6461 raft_consensus.cc:2272] T 063fc0e77d294ddf8a02e9ab5968a5e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:06.646806 6137 leader_election.cc:343] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 1a5f682ef2794a1fb9f5c4c2c1ee52e7
I20260923 19:50:06.647189 6646 raft_consensus.cc:493] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:06.647332 6646 raft_consensus.cc:515] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.648070 6646 leader_election.cc:290] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:06.648697 6058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adadf8caf5e4a9ab1107d0fb6a91735" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:06.648844 6461 ts_tablet_manager.cc:1916] T 063fc0e77d294ddf8a02e9ab5968a5e3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:06.648947 6058 raft_consensus.cc:2393] T 5adadf8caf5e4a9ab1107d0fb6a91735 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61022dd7f2f14dc19aebe3af5f08f430 in current term 1: Already voted for candidate 2bf41435f70447f19992d368ca6b46bd in this term.
I20260923 19:50:06.654723 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_fe6466bce2884174b9bcdbcde0184466"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:06.655313 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fe6466bce2884174b9bcdbcde0184466 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:06.657229 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet f7e282b6699a4ce9837d221132a1f54e (table default.Table_c0be6341515349798508cd7887abaa7e [id=b5b882261126409ea6b837b2c010dd9e]) successfully deleted
I20260923 19:50:06.657727 6459 tablet_replica.cc:333] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:06.662094 6459 raft_consensus.cc:2243] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:06.662397 6459 raft_consensus.cc:2272] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:06.663038 6459 ts_tablet_manager.cc:1916] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:06.663385 6139 leader_election.cc:343] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 1a5f682ef2794a1fb9f5c4c2c1ee52e7
I20260923 19:50:06.667649 6139 leader_election.cc:304] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:06.667853 6139 raft_consensus.cc:2686] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 61022dd7f2f14dc19aebe3af5f08f430: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260923 19:50:06.669183 6457 tablet_bootstrap.cc:492] T ec4cc8a742114e5fb07c5c9157ce09e8 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:06.669369 6457 ts_tablet_manager.cc:1403] T ec4cc8a742114e5fb07c5c9157ce09e8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.053s user 0.001s sys 0.009s
I20260923 19:50:06.670832 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5adadf8caf5e4a9ab1107d0fb6a91735" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:06.671384 6458 tablet_replica.cc:333] T 9ed630e738c54ed38b9933f95fb552c5 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:06.671615 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_e980698a75d14d24afdd616fa2118c72"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:06.672312 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e980698a75d14d24afdd616fa2118c72 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:06.673888 6454 tablet_bootstrap.cc:492] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:06.674059 6454 ts_tablet_manager.cc:1403] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.062s user 0.006s sys 0.004s
I20260923 19:50:06.674496 6458 raft_consensus.cc:2243] T 9ed630e738c54ed38b9933f95fb552c5 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:06.674789 6454 raft_consensus.cc:359] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.675012 6139 leader_election.cc:304] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:06.675388 6454 raft_consensus.cc:385] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:06.675431 6646 raft_consensus.cc:3060] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:06.675482 6454 raft_consensus.cc:740] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:06.675706 6454 consensus_queue.cc:260] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.676266 6454 ts_tablet_manager.cc:1434] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:06.676384 6457 raft_consensus.cc:359] T ec4cc8a742114e5fb07c5c9157ce09e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.676580 6457 raft_consensus.cc:385] T ec4cc8a742114e5fb07c5c9157ce09e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:06.676750 6457 raft_consensus.cc:740] T ec4cc8a742114e5fb07c5c9157ce09e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:06.677038 6457 consensus_queue.cc:260] T ec4cc8a742114e5fb07c5c9157ce09e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.677539 6454 tablet_bootstrap.cc:492] T a224ae69503e4ab588d6269086317f09 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:06.679251 6646 raft_consensus.cc:2749] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:06.680480 6457 ts_tablet_manager.cc:1434] T ec4cc8a742114e5fb07c5c9157ce09e8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260923 19:50:06.680824 6457 tablet_bootstrap.cc:492] T 26031fe469d046518cdd0f1e955e19d1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
W20260923 19:50:06.681701 5802 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 98f61ace3a984938ace1fedbaa1dafa3 consensus state has no leader
I20260923 19:50:06.683313 6458 raft_consensus.cc:2272] T 9ed630e738c54ed38b9933f95fb552c5 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:06.684248 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_8cef71be2be0416bbd6357227c7ee3fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:06.684830 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8cef71be2be0416bbd6357227c7ee3fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:06.688731 6456 tablet_bootstrap.cc:654] T d70b7662d85a4f64a11420448c4d140d P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:06.688854 6646 raft_consensus.cc:493] T f2d9f1a0fae849ae8083eba082055fe9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:06.689018 6646 raft_consensus.cc:515] T f2d9f1a0fae849ae8083eba082055fe9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.689400 6458 ts_tablet_manager.cc:1916] T 9ed630e738c54ed38b9933f95fb552c5 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:06.690033 6646 leader_election.cc:290] T f2d9f1a0fae849ae8083eba082055fe9 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:06.690630 6058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d9f1a0fae849ae8083eba082055fe9" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:06.690852 6058 raft_consensus.cc:2468] T f2d9f1a0fae849ae8083eba082055fe9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:06.691533 6137 leader_election.cc:304] T f2d9f1a0fae849ae8083eba082055fe9 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:06.693579 6646 raft_consensus.cc:2804] T f2d9f1a0fae849ae8083eba082055fe9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:06.693737 6646 raft_consensus.cc:493] T f2d9f1a0fae849ae8083eba082055fe9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:06.693922 6646 raft_consensus.cc:3060] T f2d9f1a0fae849ae8083eba082055fe9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
W20260923 19:50:06.694819 6139 leader_election.cc:343] T f2d9f1a0fae849ae8083eba082055fe9 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: f2d9f1a0fae849ae8083eba082055fe9
I20260923 19:50:06.697628 6912 raft_consensus.cc:493] T b302820d329a41f0a9a54501c079fcd7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:06.697851 6646 raft_consensus.cc:515] T f2d9f1a0fae849ae8083eba082055fe9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.697779 6912 raft_consensus.cc:515] T b302820d329a41f0a9a54501c079fcd7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.698836 6912 leader_election.cc:290] T b302820d329a41f0a9a54501c079fcd7 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:06.698837 6058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d9f1a0fae849ae8083eba082055fe9" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:06.699033 6058 raft_consensus.cc:3060] T f2d9f1a0fae849ae8083eba082055fe9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
W20260923 19:50:06.702162 6139 leader_election.cc:343] T b302820d329a41f0a9a54501c079fcd7 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: b302820d329a41f0a9a54501c079fcd7
W20260923 19:50:06.702741 6137 leader_election.cc:343] T b302820d329a41f0a9a54501c079fcd7 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: b302820d329a41f0a9a54501c079fcd7
I20260923 19:50:06.702852 6137 leader_election.cc:304] T b302820d329a41f0a9a54501c079fcd7 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:06.703179 6912 raft_consensus.cc:2749] T b302820d329a41f0a9a54501c079fcd7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:06.703706 6058 raft_consensus.cc:2468] T f2d9f1a0fae849ae8083eba082055fe9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:06.704187 6137 leader_election.cc:304] T f2d9f1a0fae849ae8083eba082055fe9 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:06.704474 6912 raft_consensus.cc:2804] T f2d9f1a0fae849ae8083eba082055fe9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
W20260923 19:50:06.711036 6139 leader_election.cc:343] T f2d9f1a0fae849ae8083eba082055fe9 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: f2d9f1a0fae849ae8083eba082055fe9
I20260923 19:50:06.711692 6646 leader_election.cc:290] T f2d9f1a0fae849ae8083eba082055fe9 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:06.712828 6646 raft_consensus.cc:493] T f302f91c8ef44237b1c9909d88dacbff P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:06.713032 6646 raft_consensus.cc:515] T f302f91c8ef44237b1c9909d88dacbff P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.714022 6058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f302f91c8ef44237b1c9909d88dacbff" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:06.714311 6058 raft_consensus.cc:2393] T f302f91c8ef44237b1c9909d88dacbff P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61022dd7f2f14dc19aebe3af5f08f430 in current term 1: Already voted for candidate 2bf41435f70447f19992d368ca6b46bd in this term.
I20260923 19:50:06.716187 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f302f91c8ef44237b1c9909d88dacbff" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:06.716666 6461 ts_tablet_manager.cc:1929] T 063fc0e77d294ddf8a02e9ab5968a5e3 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:06.716730 6139 leader_election.cc:304] T f302f91c8ef44237b1c9909d88dacbff P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:06.716813 6461 log.cc:1199] T 063fc0e77d294ddf8a02e9ab5968a5e3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/063fc0e77d294ddf8a02e9ab5968a5e3
I20260923 19:50:06.717049 6646 leader_election.cc:290] T f302f91c8ef44237b1c9909d88dacbff P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:06.717170 6461 ts_tablet_manager.cc:1950] T 063fc0e77d294ddf8a02e9ab5968a5e3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:06.717543 6646 raft_consensus.cc:3060] T f302f91c8ef44237b1c9909d88dacbff P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:06.717777 6814 raft_consensus.cc:493] T 033c2d772c8a44d2a0e671664bb9085d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:06.718046 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 266) took 2632 ms. Trace:
I20260923 19:50:06.718024 6814 raft_consensus.cc:515] T 033c2d772c8a44d2a0e671664bb9085d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.718140 6461 rpcz_store.cc:276] 0923 19:50:04.085461 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:04.085570 (+ 109us) service_pool.cc:224] Handling call
0923 19:50:06.643237 (+2557667us) ts_tablet_manager.cc:1151] Deleting tablet 063fc0e77d294ddf8a02e9ab5968a5e3
0923 19:50:06.643246 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.664469 (+ 21223us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.716578 (+ 52109us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.717997 (+ 1419us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2556574}
I20260923 19:50:06.718609 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 263) took 2638 ms. Trace:
I20260923 19:50:06.718696 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 063fc0e77d294ddf8a02e9ab5968a5e3 (table default.Table_3034bb02271e459ebedf3424b5f8f908 [id=83a8f991844b4cb0a9008f5bc3dea17b]) successfully deleted
I20260923 19:50:06.718712 6461 rpcz_store.cc:276] 0923 19:50:04.080122 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:04.080460 (+ 338us) service_pool.cc:224] Handling call
0923 19:50:06.718444 (+2637984us) ts_tablet_manager.cc:1151] Deleting tablet 5e711e48156b46b5a517b330d6d41309
0923 19:50:06.718458 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.718557 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2631444}
I20260923 19:50:06.719079 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 270) took 2612 ms. Trace:
I20260923 19:50:06.719163 6461 rpcz_store.cc:276] 0923 19:50:04.106461 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:04.106723 (+ 262us) service_pool.cc:224] Handling call
0923 19:50:06.718944 (+2612221us) ts_tablet_manager.cc:1151] Deleting tablet 896bd068e6b343e48eb2a01679b49326
0923 19:50:06.718954 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.719034 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2611974}
W20260923 19:50:06.719265 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 5e711e48156b46b5a517b330d6d41309 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e711e48156b46b5a517b330d6d41309 already in progress: creating tablet
I20260923 19:50:06.719444 6461 tablet_replica.cc:333] T d70b7662d85a4f64a11420448c4d140d P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
W20260923 19:50:06.719878 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 896bd068e6b343e48eb2a01679b49326 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 896bd068e6b343e48eb2a01679b49326 already in progress: creating tablet
I20260923 19:50:06.720964 6457 tablet_bootstrap.cc:654] T 26031fe469d046518cdd0f1e955e19d1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:06.722204 6814 leader_election.cc:290] T 033c2d772c8a44d2a0e671664bb9085d P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:06.722762 6279 leader_election.cc:343] T 033c2d772c8a44d2a0e671664bb9085d P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 033c2d772c8a44d2a0e671664bb9085d
I20260923 19:50:06.679674 6454 tablet_bootstrap.cc:654] T a224ae69503e4ab588d6269086317f09 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:06.721335 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033c2d772c8a44d2a0e671664bb9085d" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:06.726471 6280 leader_election.cc:343] T 033c2d772c8a44d2a0e671664bb9085d P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:06.726624 6280 leader_election.cc:304] T 033c2d772c8a44d2a0e671664bb9085d P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:06.726886 6867 raft_consensus.cc:2749] T 033c2d772c8a44d2a0e671664bb9085d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:06.728466 6459 ts_tablet_manager.cc:1929] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:06.731053 6459 log.cc:1199] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/1a5f682ef2794a1fb9f5c4c2c1ee52e7
I20260923 19:50:06.732064 6459 ts_tablet_manager.cc:1950] T 1a5f682ef2794a1fb9f5c4c2c1ee52e7 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:06.732645 5801 master_service.cc:960] ReplaceTablet: received request to replace tablet 15a9d1d4adaa402f90d774e77010c928 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:06.734093 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 1a5f682ef2794a1fb9f5c4c2c1ee52e7 (table default.Table_3a938c91580b4d23a2a0fad133090624 [id=767c530f4e214408a45adcb31c9d0f28]) successfully deleted
W20260923 19:50:06.734867 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet c504ec668a33451fb1249f697bb5e2bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c504ec668a33451fb1249f697bb5e2bb already in progress: creating tablet
I20260923 19:50:06.735082 6461 raft_consensus.cc:2243] T d70b7662d85a4f64a11420448c4d140d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260923 19:50:06.735867 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet dbe06eba8067413a903e4a07c2768484 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dbe06eba8067413a903e4a07c2768484 already in progress: creating tablet
I20260923 19:50:06.736269 6458 ts_tablet_manager.cc:1929] T 9ed630e738c54ed38b9933f95fb552c5 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:06.736413 6458 log.cc:1199] T 9ed630e738c54ed38b9933f95fb552c5 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/9ed630e738c54ed38b9933f95fb552c5
I20260923 19:50:06.736763 6461 raft_consensus.cc:2272] T d70b7662d85a4f64a11420448c4d140d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:06.736814 6458 ts_tablet_manager.cc:1950] T 9ed630e738c54ed38b9933f95fb552c5 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:06.737665 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 203) took 3371 ms. Trace:
I20260923 19:50:06.737952 6459 tablet_replica.cc:333] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:06.737789 6458 rpcz_store.cc:276] 0923 19:50:03.365823 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.365906 (+ 83us) service_pool.cc:224] Handling call
0923 19:50:06.626863 (+3260957us) ts_tablet_manager.cc:1151] Deleting tablet 9ed630e738c54ed38b9933f95fb552c5
0923 19:50:06.626874 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.693840 (+ 66966us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.735949 (+ 42109us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.737630 (+ 1681us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":687,"tablet-delete.queue_time_us":3260730}
I20260923 19:50:06.738197 6458 tablet_replica.cc:333] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:06.738308 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 9ed630e738c54ed38b9933f95fb552c5 (table default.Table_f8e149be0f0d456894956d425be24693 [id=c97fdc3b0e4447c284ad90fab54a1fa5]) successfully deleted
I20260923 19:50:06.738416 6458 raft_consensus.cc:2243] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:06.738536 6459 raft_consensus.cc:2243] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:06.738586 6458 raft_consensus.cc:2272] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:06.738749 6459 raft_consensus.cc:2272] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:06.738885 6646 raft_consensus.cc:2749] T f302f91c8ef44237b1c9909d88dacbff P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:06.739122 6458 ts_tablet_manager.cc:1916] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:06.739622 6461 ts_tablet_manager.cc:1916] T d70b7662d85a4f64a11420448c4d140d P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:06.743444 6459 ts_tablet_manager.cc:1916] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:06.743701 6280 consensus_peers.cc:597] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:06.751622 6457 tablet_bootstrap.cc:492] T 26031fe469d046518cdd0f1e955e19d1 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:06.751863 6457 ts_tablet_manager.cc:1403] T 26031fe469d046518cdd0f1e955e19d1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.071s user 0.002s sys 0.002s
I20260923 19:50:06.751904 5804 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 0a5ce253bcce410b9517449f133d39e8 (table default.Table_84d13e1ea6234e5ca45738376e83f537 [id=0d4f6a5bb30c4d2a937424cf0e651afd]). Expected version 1 got 0
I20260923 19:50:06.752240 5804 catalog_manager.cc:5838] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:06.752635 5804 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 5adadf8caf5e4a9ab1107d0fb6a91735 (table default.Table_bd91264aa4a0430eb1a8f69129fb0f3f [id=738ed1d070ef485e9299c1f3b1db008a]). Expected version 2 got 0
I20260923 19:50:06.752787 6457 raft_consensus.cc:359] T 26031fe469d046518cdd0f1e955e19d1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.752941 6457 raft_consensus.cc:385] T 26031fe469d046518cdd0f1e955e19d1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:06.753011 6457 raft_consensus.cc:740] T 26031fe469d046518cdd0f1e955e19d1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:06.752874 5804 catalog_manager.cc:5838] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:06.753187 5804 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet d91a56bace854494b7affd6c766b2847 (table default.Table_b3579cbf488c4d1eb5f605ab4e11c340 [id=a6dbcc9c44fb400b926e21aa6d683186]). Expected version 2 got 0
I20260923 19:50:06.753194 6457 consensus_queue.cc:260] T 26031fe469d046518cdd0f1e955e19d1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.755043 6457 ts_tablet_manager.cc:1434] T 26031fe469d046518cdd0f1e955e19d1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260923 19:50:06.755344 6457 tablet_bootstrap.cc:492] T 42e9cbcf77324d91abd029c12eaf950d P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:06.757589 6319 tablet_service.cc:1511] Processing CreateTablet for tablet 3c713a0973dc45debf61c228a4bf13bf (DEFAULT_TABLE table=default.Table_9acef25c391f4b8c9354ebc2c0a70c81 [id=7a872158deeb4117ba99842f7878ec46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.758030 6319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c713a0973dc45debf61c228a4bf13bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.759639 6323 tablet_service.cc:1511] Processing CreateTablet for tablet d04b3a9ade7a405bb619704095fac279 (DEFAULT_TABLE table=default.Table_b79ffd6b55d94f789da88e84cb293bb5 [id=cd3183840770461faead259af133d3d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.759970 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d04b3a9ade7a405bb619704095fac279. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.762897 6324 tablet_service.cc:1511] Processing CreateTablet for tablet a263c0fc71424999b76ef01de9a51eda (DEFAULT_TABLE table=default.Table_d0220d5f0f8c461bb1c01dd67bdf55fe [id=59963339362940748a99a3ff36c31bbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.763260 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a263c0fc71424999b76ef01de9a51eda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.763932 6180 tablet_service.cc:1511] Processing CreateTablet for tablet d04b3a9ade7a405bb619704095fac279 (DEFAULT_TABLE table=default.Table_b79ffd6b55d94f789da88e84cb293bb5 [id=cd3183840770461faead259af133d3d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.764328 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d04b3a9ade7a405bb619704095fac279. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.764380 6164 tablet_service.cc:1511] Processing CreateTablet for tablet a263c0fc71424999b76ef01de9a51eda (DEFAULT_TABLE table=default.Table_d0220d5f0f8c461bb1c01dd67bdf55fe [id=59963339362940748a99a3ff36c31bbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.764739 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a263c0fc71424999b76ef01de9a51eda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.766202 6314 tablet_service.cc:1511] Processing CreateTablet for tablet ba0453ef529344dfbab1130daa985fef (DEFAULT_TABLE table=default.Table_a4db4b4f4a6b45eabe9a2ae50186a32c [id=3944a1ccbf364bb5a7920714dbe72c8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.766512 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba0453ef529344dfbab1130daa985fef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.768321 6306 tablet_service.cc:1511] Processing CreateTablet for tablet 688bb1055ba94c2996cdfea6dea76416 (DEFAULT_TABLE table=default.Table_f92387e003d44b0eb22010e7ca6598af [id=1e323f5b380a4af4acc3865649648e12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.768486 6179 tablet_service.cc:1511] Processing CreateTablet for tablet f4313a4d8a9c411fad593b05ad655fc4 (DEFAULT_TABLE table=default.Table_76b550f8599f4650b443c16ae2483ba8 [id=e4f5c7258f02460aad591023927c0dfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.768698 6306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 688bb1055ba94c2996cdfea6dea76416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.769016 6168 tablet_service.cc:1511] Processing CreateTablet for tablet 688bb1055ba94c2996cdfea6dea76416 (DEFAULT_TABLE table=default.Table_f92387e003d44b0eb22010e7ca6598af [id=1e323f5b380a4af4acc3865649648e12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.769388 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 688bb1055ba94c2996cdfea6dea76416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.770140 6316 tablet_service.cc:1511] Processing CreateTablet for tablet 22c89609da884c47b1dbc1470b37efbe (DEFAULT_TABLE table=default.Table_5bf3acc342a34bba8f50e005425b4c5d [id=a34c7ad2f3004c6e908b87fb99389632]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.770478 6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22c89609da884c47b1dbc1470b37efbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.771796 6309 tablet_service.cc:1511] Processing CreateTablet for tablet f8007918eca14c81947e5999fe13a705 (DEFAULT_TABLE table=default.Table_a6113d227550419cb7147c6e2f97086c [id=7eee19aa1d0348e08accd2764d2cfdce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.772338 6176 tablet_service.cc:1511] Processing CreateTablet for tablet 3c713a0973dc45debf61c228a4bf13bf (DEFAULT_TABLE table=default.Table_9acef25c391f4b8c9354ebc2c0a70c81 [id=7a872158deeb4117ba99842f7878ec46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.772734 6176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c713a0973dc45debf61c228a4bf13bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.774123 6183 tablet_service.cc:1511] Processing CreateTablet for tablet f8007918eca14c81947e5999fe13a705 (DEFAULT_TABLE table=default.Table_a6113d227550419cb7147c6e2f97086c [id=7eee19aa1d0348e08accd2764d2cfdce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.774619 6165 tablet_service.cc:1511] Processing CreateTablet for tablet f2799563250845b0b9d7d51b2367b16b (DEFAULT_TABLE table=default.Table_c75bb0303c454c888dc2aa0d7b561339 [id=b6e6ca970bea466f80938e694f770e67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.776077 6178 tablet_service.cc:1511] Processing CreateTablet for tablet ba0453ef529344dfbab1130daa985fef (DEFAULT_TABLE table=default.Table_a4db4b4f4a6b45eabe9a2ae50186a32c [id=3944a1ccbf364bb5a7920714dbe72c8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.776572 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 22c89609da884c47b1dbc1470b37efbe (DEFAULT_TABLE table=default.Table_5bf3acc342a34bba8f50e005425b4c5d [id=a34c7ad2f3004c6e908b87fb99389632]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.778756 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4313a4d8a9c411fad593b05ad655fc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.780452 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8007918eca14c81947e5999fe13a705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.780912 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22c89609da884c47b1dbc1470b37efbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.782148 6457 tablet_bootstrap.cc:654] T 42e9cbcf77324d91abd029c12eaf950d P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:06.782440 6165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2799563250845b0b9d7d51b2367b16b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.782461 6309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8007918eca14c81947e5999fe13a705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.783773 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba0453ef529344dfbab1130daa985fef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.784410 6202 raft_consensus.cc:3060] T a10110f4a2b34b61a4cc586d65981606 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:06.785256 6026 tablet_service.cc:1511] Processing CreateTablet for tablet 3c713a0973dc45debf61c228a4bf13bf (DEFAULT_TABLE table=default.Table_9acef25c391f4b8c9354ebc2c0a70c81 [id=7a872158deeb4117ba99842f7878ec46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.785490 6029 tablet_service.cc:1511] Processing CreateTablet for tablet d04b3a9ade7a405bb619704095fac279 (DEFAULT_TABLE table=default.Table_b79ffd6b55d94f789da88e84cb293bb5 [id=cd3183840770461faead259af133d3d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.785682 6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c713a0973dc45debf61c228a4bf13bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.786113 6021 tablet_service.cc:1511] Processing CreateTablet for tablet f4313a4d8a9c411fad593b05ad655fc4 (DEFAULT_TABLE table=default.Table_76b550f8599f4650b443c16ae2483ba8 [id=e4f5c7258f02460aad591023927c0dfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.786449 6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4313a4d8a9c411fad593b05ad655fc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.790130 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 688bb1055ba94c2996cdfea6dea76416 (DEFAULT_TABLE table=default.Table_f92387e003d44b0eb22010e7ca6598af [id=1e323f5b380a4af4acc3865649648e12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.790333 6032 tablet_service.cc:1511] Processing CreateTablet for tablet ba0453ef529344dfbab1130daa985fef (DEFAULT_TABLE table=default.Table_a4db4b4f4a6b45eabe9a2ae50186a32c [id=3944a1ccbf364bb5a7920714dbe72c8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.790506 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 688bb1055ba94c2996cdfea6dea76416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.790700 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba0453ef529344dfbab1130daa985fef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.791026 6022 tablet_service.cc:1511] Processing CreateTablet for tablet f8007918eca14c81947e5999fe13a705 (DEFAULT_TABLE table=default.Table_a6113d227550419cb7147c6e2f97086c [id=7eee19aa1d0348e08accd2764d2cfdce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.791328 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8007918eca14c81947e5999fe13a705. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.785256 6027 tablet_service.cc:1511] Processing CreateTablet for tablet 22c89609da884c47b1dbc1470b37efbe (DEFAULT_TABLE table=default.Table_5bf3acc342a34bba8f50e005425b4c5d [id=a34c7ad2f3004c6e908b87fb99389632]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.792589 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22c89609da884c47b1dbc1470b37efbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.790130 6034 tablet_service.cc:1511] Processing CreateTablet for tablet a263c0fc71424999b76ef01de9a51eda (DEFAULT_TABLE table=default.Table_d0220d5f0f8c461bb1c01dd67bdf55fe [id=59963339362940748a99a3ff36c31bbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.794281 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a263c0fc71424999b76ef01de9a51eda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.798000 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d04b3a9ade7a405bb619704095fac279. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.812386 6459 ts_tablet_manager.cc:1929] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:06.817059 6317 tablet_service.cc:1511] Processing CreateTablet for tablet f2799563250845b0b9d7d51b2367b16b (DEFAULT_TABLE table=default.Table_c75bb0303c454c888dc2aa0d7b561339 [id=b6e6ca970bea466f80938e694f770e67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.817471 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2799563250845b0b9d7d51b2367b16b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.822494 6461 ts_tablet_manager.cc:1929] T d70b7662d85a4f64a11420448c4d140d P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:06.822711 6461 log.cc:1199] T d70b7662d85a4f64a11420448c4d140d P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/d70b7662d85a4f64a11420448c4d140d
I20260923 19:50:06.826370 6461 ts_tablet_manager.cc:1950] T d70b7662d85a4f64a11420448c4d140d P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:06.826560 6459 log.cc:1199] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/87afbdb11c6e4e58affd2f2d7995e1f8
I20260923 19:50:06.827242 6459 ts_tablet_manager.cc:1950] T 87afbdb11c6e4e58affd2f2d7995e1f8 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:06.827883 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 269) took 2721 ms. Trace:
I20260923 19:50:06.829166 6461 rpcz_store.cc:276] 0923 19:50:04.106336 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:04.109464 (+ 3128us) service_pool.cc:224] Handling call
0923 19:50:06.719371 (+2609907us) ts_tablet_manager.cc:1151] Deleting tablet d70b7662d85a4f64a11420448c4d140d
0923 19:50:06.719379 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.765577 (+ 46198us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.822407 (+ 56830us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.827846 (+ 5439us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2606465}
I20260923 19:50:06.829958 6461 tablet_replica.cc:333] T a1e8b8e638ec438a86f05fa147cdb27c P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:06.829948 6454 tablet_bootstrap.cc:492] T a224ae69503e4ab588d6269086317f09 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:06.830370 6311 tablet_service.cc:1511] Processing CreateTablet for tablet f4313a4d8a9c411fad593b05ad655fc4 (DEFAULT_TABLE table=default.Table_76b550f8599f4650b443c16ae2483ba8 [id=e4f5c7258f02460aad591023927c0dfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.830803 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4313a4d8a9c411fad593b05ad655fc4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:06.831167 5790 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 40adb472162042e48fdbb496b342996a (table default.Table_6525269b0ed345d9a2b2cb1dea0f47aa [id=8fe16214ad774a54982dbadeac1b4235], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 40adb472162042e48fdbb496b342996a consensus state has no leader
I20260923 19:50:06.831359 6461 raft_consensus.cc:2243] T a1e8b8e638ec438a86f05fa147cdb27c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:06.831537 6461 raft_consensus.cc:2272] T a1e8b8e638ec438a86f05fa147cdb27c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:06.832036 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 87afbdb11c6e4e58affd2f2d7995e1f8 (table default.Table_f57f5ddf52f541ab91b4a9638fcf81a0 [id=e0da333ed7f44d6aa283da81b1cfbf17]) successfully deleted
I20260923 19:50:06.832018 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 85f5ba9097674f9d889e178eaea4f0d7 (DEFAULT_TABLE table=default.Table_0b7f0cec058c44798de4db8eeaf31ef4 [id=ae0f416afa6d49d4a3ab11ed40f0df48]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:06.832278 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet c012b2a92dc14f2ab5d9f4fe8a6a7779 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c012b2a92dc14f2ab5d9f4fe8a6a7779 already in progress: creating tablet
I20260923 19:50:06.832407 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85f5ba9097674f9d889e178eaea4f0d7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:06.832549 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 908596339b2e4f7f8ddb7f9cd5bdcc3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 908596339b2e4f7f8ddb7f9cd5bdcc3e already in progress: creating tablet
I20260923 19:50:06.833809 6022 tablet_service.cc:1511] Processing CreateTablet for tablet 9ee02922d2be45f5a1473a53a6f253c4 (DEFAULT_TABLE table=default.Table_792882a419914f80a8e5bb625dbe633e [id=2b72f46eeef54308965034c7d49f0947]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.834164 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ee02922d2be45f5a1473a53a6f253c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.835318 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet d70b7662d85a4f64a11420448c4d140d (table default.Table_faa53cf5cc5541afb7b391368bdc55f7 [id=4a8f28e842e94d628326ca83935f23c6]) successfully deleted
I20260923 19:50:06.835646 6312 tablet_service.cc:1511] Processing CreateTablet for tablet cb11d6e082784ad98cfb5253dbb88707 (DEFAULT_TABLE table=default.Table_d178d42e78ae42b88975c9bc050e0041 [id=e3da2a14cd094e53b0a99042f93cb576]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.835999 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb11d6e082784ad98cfb5253dbb88707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.835985 6021 tablet_service.cc:1511] Processing CreateTablet for tablet f2799563250845b0b9d7d51b2367b16b (DEFAULT_TABLE table=default.Table_c75bb0303c454c888dc2aa0d7b561339 [id=b6e6ca970bea466f80938e694f770e67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.836331 6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2799563250845b0b9d7d51b2367b16b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.835183 6320 tablet_service.cc:1511] Processing CreateTablet for tablet 9ee02922d2be45f5a1473a53a6f253c4 (DEFAULT_TABLE table=default.Table_792882a419914f80a8e5bb625dbe633e [id=2b72f46eeef54308965034c7d49f0947]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.838773 6027 tablet_service.cc:1511] Processing CreateTablet for tablet ce6b86f947ce420994eaa5ff39ad9c87 (DEFAULT_TABLE table=default.Table_145e4ce20b7d428da857269e35bbee83 [id=70f85c0de552418e98578790dded6b7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.840655 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce6b86f947ce420994eaa5ff39ad9c87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.836788 6457 tablet_bootstrap.cc:492] T 42e9cbcf77324d91abd029c12eaf950d P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:06.842459 6454 ts_tablet_manager.cc:1403] T a224ae69503e4ab588d6269086317f09 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.165s user 0.011s sys 0.001s
I20260923 19:50:06.831115 6459 tablet_replica.cc:333] T f2d9f1a0fae849ae8083eba082055fe9 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:06.832986 6165 tablet_service.cc:1511] Processing CreateTablet for tablet 85f5ba9097674f9d889e178eaea4f0d7 (DEFAULT_TABLE table=default.Table_0b7f0cec058c44798de4db8eeaf31ef4 [id=ae0f416afa6d49d4a3ab11ed40f0df48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.834075 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 9ee02922d2be45f5a1473a53a6f253c4 (DEFAULT_TABLE table=default.Table_792882a419914f80a8e5bb625dbe633e [id=2b72f46eeef54308965034c7d49f0947]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.834406 6179 tablet_service.cc:1511] Processing CreateTablet for tablet cb11d6e082784ad98cfb5253dbb88707 (DEFAULT_TABLE table=default.Table_d178d42e78ae42b88975c9bc050e0041 [id=e3da2a14cd094e53b0a99042f93cb576]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.844322 6165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85f5ba9097674f9d889e178eaea4f0d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.845029 6310 tablet_service.cc:1511] Processing CreateTablet for tablet ce6b86f947ce420994eaa5ff39ad9c87 (DEFAULT_TABLE table=default.Table_145e4ce20b7d428da857269e35bbee83 [id=70f85c0de552418e98578790dded6b7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.845372 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce6b86f947ce420994eaa5ff39ad9c87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.845990 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ee02922d2be45f5a1473a53a6f253c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.847349 6164 tablet_service.cc:1511] Processing CreateTablet for tablet cf64073cdde748bc8ed3ce7580a71160 (DEFAULT_TABLE table=default.Table_f9942fca28234830913277dada229375 [id=662eb0a4f944445486929d42c5ebfd01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.847708 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf64073cdde748bc8ed3ce7580a71160. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.851818 6320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ee02922d2be45f5a1473a53a6f253c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.852344 6308 tablet_service.cc:1511] Processing CreateTablet for tablet 8d20b59aa99f49f0b2f4d7dd861470f8 (DEFAULT_TABLE table=default.Table_3a666373aff54c2d8256d8fc785cfcc1 [id=57da80bd083d4763a5523608ea26f2bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.852730 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d20b59aa99f49f0b2f4d7dd861470f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.853832 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb11d6e082784ad98cfb5253dbb88707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.856570 6454 raft_consensus.cc:359] T a224ae69503e4ab588d6269086317f09 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.856781 6454 raft_consensus.cc:385] T a224ae69503e4ab588d6269086317f09 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:06.856874 6454 raft_consensus.cc:740] T a224ae69503e4ab588d6269086317f09 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:06.835067 6168 tablet_service.cc:1511] Processing CreateTablet for tablet ce6b86f947ce420994eaa5ff39ad9c87 (DEFAULT_TABLE table=default.Table_145e4ce20b7d428da857269e35bbee83 [id=70f85c0de552418e98578790dded6b7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.858558 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce6b86f947ce420994eaa5ff39ad9c87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.836926 6646 raft_consensus.cc:493] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:06.857132 6454 consensus_queue.cc:260] T a224ae69503e4ab588d6269086317f09 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.862062 6646 raft_consensus.cc:515] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.862535 6454 ts_tablet_manager.cc:1434] T a224ae69503e4ab588d6269086317f09 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.020s user 0.002s sys 0.000s
I20260923 19:50:06.863502 6646 leader_election.cc:290] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:06.864248 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e726ee6a5494fd4b72c1ebef7d66b42" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:06.864570 6454 tablet_bootstrap.cc:492] T 033c2d772c8a44d2a0e671664bb9085d P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
W20260923 19:50:06.864773 6139 leader_election.cc:343] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: Tablet not RUNNING: STOPPED
I20260923 19:50:06.839010 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 8d20b59aa99f49f0b2f4d7dd861470f8 (DEFAULT_TABLE table=default.Table_3a666373aff54c2d8256d8fc785cfcc1 [id=57da80bd083d4763a5523608ea26f2bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.866688 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d20b59aa99f49f0b2f4d7dd861470f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.866830 6454 tablet_bootstrap.cc:654] T 033c2d772c8a44d2a0e671664bb9085d P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:06.867714 6461 ts_tablet_manager.cc:1916] T a1e8b8e638ec438a86f05fa147cdb27c P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:06.867807 6321 tablet_service.cc:1511] Processing CreateTablet for tablet 4bbd8fcc5ea1431ab9e4fadb7d52269e (DEFAULT_TABLE table=default.Table_5d857e3696b8413faa0b7aee17bcbde9 [id=c78cb89827804212b0f520e4c7ac81c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.868165 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bbd8fcc5ea1431ab9e4fadb7d52269e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.869334 6773 raft_consensus.cc:493] T 789c54477bec4636bb3669e1f62730e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:06.869501 6773 raft_consensus.cc:515] T 789c54477bec4636bb3669e1f62730e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.870779 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c54477bec4636bb3669e1f62730e2" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:06.871474 6457 ts_tablet_manager.cc:1403] T 42e9cbcf77324d91abd029c12eaf950d P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.087s user 0.004s sys 0.001s
W20260923 19:50:06.872517 5996 leader_election.cc:343] T 789c54477bec4636bb3669e1f62730e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:06.873782 6031 tablet_service.cc:1511] Processing CreateTablet for tablet cf64073cdde748bc8ed3ce7580a71160 (DEFAULT_TABLE table=default.Table_f9942fca28234830913277dada229375 [id=662eb0a4f944445486929d42c5ebfd01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.874243 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf64073cdde748bc8ed3ce7580a71160. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.877413 6323 tablet_service.cc:1511] Processing CreateTablet for tablet cf64073cdde748bc8ed3ce7580a71160 (DEFAULT_TABLE table=default.Table_f9942fca28234830913277dada229375 [id=662eb0a4f944445486929d42c5ebfd01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.877657 6773 leader_election.cc:290] T 789c54477bec4636bb3669e1f62730e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:06.877960 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf64073cdde748bc8ed3ce7580a71160. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:06.869395 6137 leader_election.cc:343] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 6e726ee6a5494fd4b72c1ebef7d66b42
I20260923 19:50:06.881760 6137 leader_election.cc:304] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:06.882321 6646 raft_consensus.cc:2749] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:06.886929 6164 tablet_service.cc:1511] Processing CreateTablet for tablet 4bbd8fcc5ea1431ab9e4fadb7d52269e (DEFAULT_TABLE table=default.Table_5d857e3696b8413faa0b7aee17bcbde9 [id=c78cb89827804212b0f520e4c7ac81c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.887563 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bbd8fcc5ea1431ab9e4fadb7d52269e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.920558 6773 raft_consensus.cc:493] T 26031fe469d046518cdd0f1e955e19d1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:06.920665 6316 tablet_service.cc:1511] Processing CreateTablet for tablet 85f5ba9097674f9d889e178eaea4f0d7 (DEFAULT_TABLE table=default.Table_0b7f0cec058c44798de4db8eeaf31ef4 [id=ae0f416afa6d49d4a3ab11ed40f0df48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.921105 6773 raft_consensus.cc:515] T 26031fe469d046518cdd0f1e955e19d1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.921711 6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85f5ba9097674f9d889e178eaea4f0d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.921801 6773 leader_election.cc:290] T 26031fe469d046518cdd0f1e955e19d1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:06.922070 6029 tablet_service.cc:1511] Processing CreateTablet for tablet cb11d6e082784ad98cfb5253dbb88707 (DEFAULT_TABLE table=default.Table_d178d42e78ae42b88975c9bc050e0041 [id=e3da2a14cd094e53b0a99042f93cb576]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.922591 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb11d6e082784ad98cfb5253dbb88707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.922475 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26031fe469d046518cdd0f1e955e19d1" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:06.924862 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c54477bec4636bb3669e1f62730e2" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:06.925022 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26031fe469d046518cdd0f1e955e19d1" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:06.927376 6457 raft_consensus.cc:359] T 42e9cbcf77324d91abd029c12eaf950d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.928414 6646 raft_consensus.cc:493] T 115048f771764e41a3816e17a6c6cf94 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:06.928609 6646 raft_consensus.cc:515] T 115048f771764e41a3816e17a6c6cf94 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.929512 6646 leader_election.cc:290] T 115048f771764e41a3816e17a6c6cf94 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:06.930222 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115048f771764e41a3816e17a6c6cf94" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:06.931284 6026 tablet_service.cc:1511] Processing CreateTablet for tablet 8d20b59aa99f49f0b2f4d7dd861470f8 (DEFAULT_TABLE table=default.Table_3a666373aff54c2d8256d8fc785cfcc1 [id=57da80bd083d4763a5523608ea26f2bb]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:06.932663 5996 leader_election.cc:343] T 26031fe469d046518cdd0f1e955e19d1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:06.934782 5995 leader_election.cc:343] T 789c54477bec4636bb3669e1f62730e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:06.938220 6456 tablet_bootstrap.cc:492] T d70b7662d85a4f64a11420448c4d140d P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:06.938462 6456 ts_tablet_manager.cc:1403] T d70b7662d85a4f64a11420448c4d140d P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.325s user 0.007s sys 0.003s
I20260923 19:50:06.939512 6456 raft_consensus.cc:359] T d70b7662d85a4f64a11420448c4d140d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.939838 6456 raft_consensus.cc:385] T d70b7662d85a4f64a11420448c4d140d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:06.939996 6456 raft_consensus.cc:740] T d70b7662d85a4f64a11420448c4d140d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:06.940879 6456 consensus_queue.cc:260] T d70b7662d85a4f64a11420448c4d140d P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.944022 6456 ts_tablet_manager.cc:1434] T d70b7662d85a4f64a11420448c4d140d P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260923 19:50:06.944427 6456 tablet_bootstrap.cc:492] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:06.946247 6456 tablet_bootstrap.cc:654] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:06.946768 6912 raft_consensus.cc:697] T f2d9f1a0fae849ae8083eba082055fe9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:06.947232 6912 consensus_queue.cc:237] T f2d9f1a0fae849ae8083eba082055fe9 P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.956447 6461 ts_tablet_manager.cc:1929] T a1e8b8e638ec438a86f05fa147cdb27c P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:06.957218 5803 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet ec4cc8a742114e5fb07c5c9157ce09e8 (table default.Table_2adc87e06d81491498aa018f49fdc08d [id=89181985e6154c7fa946148e48bef2eb]). Expected version 2 got 0
I20260923 19:50:06.958437 5799 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f1de0114e81245fdb95e257431f5a975" } modify_external_catalogs: true
I20260923 19:50:06.958678 5799 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f1de0114e81245fdb95e257431f5a975" } modify_external_catalogs: true
I20260923 19:50:06.962213 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_974e2fbea82147a1a2bb48f3bae1fde1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:06.962308 6032 tablet_service.cc:1511] Processing CreateTablet for tablet 4bbd8fcc5ea1431ab9e4fadb7d52269e (DEFAULT_TABLE table=default.Table_5d857e3696b8413faa0b7aee17bcbde9 [id=c78cb89827804212b0f520e4c7ac81c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:06.962545 6459 raft_consensus.cc:2243] T f2d9f1a0fae849ae8083eba082055fe9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:06.963079 6459 pending_rounds.cc:70] T f2d9f1a0fae849ae8083eba082055fe9 P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:06.963165 6459 pending_rounds.cc:77] T f2d9f1a0fae849ae8083eba082055fe9 P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630556459147264 op_type: NO_OP noop_request { }
I20260923 19:50:06.963306 6459 raft_consensus.cc:2889] T f2d9f1a0fae849ae8083eba082055fe9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20260923 19:50:06.963238 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_974e2fbea82147a1a2bb48f3bae1fde1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:06.963421 6459 raft_consensus.cc:2272] T f2d9f1a0fae849ae8083eba082055fe9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:06.963761 6457 raft_consensus.cc:385] T 42e9cbcf77324d91abd029c12eaf950d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:06.963866 6457 raft_consensus.cc:740] T 42e9cbcf77324d91abd029c12eaf950d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:06.964120 6457 consensus_queue.cc:260] T 42e9cbcf77324d91abd029c12eaf950d P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.965739 6773 raft_consensus.cc:493] T b7f372b952804ac58e602998d9b77d72 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:06.965911 6773 raft_consensus.cc:515] T b7f372b952804ac58e602998d9b77d72 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:06.966073 6201 raft_consensus.cc:3060] T 115048f771764e41a3816e17a6c6cf94 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:06.966612 6773 leader_election.cc:290] T b7f372b952804ac58e602998d9b77d72 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:06.966871 6058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115048f771764e41a3816e17a6c6cf94" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:06.968849 6137 leader_election.cc:304] T 115048f771764e41a3816e17a6c6cf94 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:06.969807 5995 leader_election.cc:304] T 789c54477bec4636bb3669e1f62730e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
W20260923 19:50:06.970232 5995 leader_election.cc:343] T 26031fe469d046518cdd0f1e955e19d1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:06.970363 5995 leader_election.cc:304] T 26031fe469d046518cdd0f1e955e19d1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:06.971766 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f372b952804ac58e602998d9b77d72" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:06.974126 6773 raft_consensus.cc:2749] T 789c54477bec4636bb3669e1f62730e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:06.974323 6773 raft_consensus.cc:2749] T 26031fe469d046518cdd0f1e955e19d1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:06.974956 5995 leader_election.cc:343] T b7f372b952804ac58e602998d9b77d72 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:06.977638 6461 log.cc:1199] T a1e8b8e638ec438a86f05fa147cdb27c P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/a1e8b8e638ec438a86f05fa147cdb27c
I20260923 19:50:06.978264 6461 ts_tablet_manager.cc:1950] T a1e8b8e638ec438a86f05fa147cdb27c P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:06.979501 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 310) took 1533 ms. Trace:
I20260923 19:50:06.980471 6461 rpcz_store.cc:276] 0923 19:50:05.446068 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.446146 (+ 78us) service_pool.cc:224] Handling call
0923 19:50:06.829899 (+1383753us) ts_tablet_manager.cc:1151] Deleting tablet a1e8b8e638ec438a86f05fa147cdb27c
0923 19:50:06.829908 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.930655 (+100747us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.956369 (+ 25714us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:06.979449 (+ 23080us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1383417}
I20260923 19:50:06.981413 6457 ts_tablet_manager.cc:1434] T 42e9cbcf77324d91abd029c12eaf950d P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.110s user 0.001s sys 0.005s
I20260923 19:50:06.982131 6459 ts_tablet_manager.cc:1916] T f2d9f1a0fae849ae8083eba082055fe9 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:06.983778 6457 tablet_bootstrap.cc:492] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:06.981487 6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d20b59aa99f49f0b2f4d7dd861470f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:06.984180 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet a1e8b8e638ec438a86f05fa147cdb27c (table default.Table_abe1e48d70954781b8e1ca09411789d4 [id=cc4f14506e3d44649b2795f866ab8618]) successfully deleted
I20260923 19:50:06.986722 6457 tablet_bootstrap.cc:654] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:06.987813 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 321) took 1427 ms. Trace:
I20260923 19:50:06.987979 6461 rpcz_store.cc:276] 0923 19:50:05.560301 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.560352 (+ 51us) service_pool.cc:224] Handling call
0923 19:50:06.987643 (+1427291us) ts_tablet_manager.cc:1151] Deleting tablet 235b4b8081ad4a13937a7941344dbc33
0923 19:50:06.987652 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.987761 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1426378}
W20260923 19:50:06.988615 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 235b4b8081ad4a13937a7941344dbc33 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 235b4b8081ad4a13937a7941344dbc33 already in progress: creating tablet
I20260923 19:50:06.989087 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 323) took 1423 ms. Trace:
I20260923 19:50:06.989255 6461 rpcz_store.cc:276] 0923 19:50:05.565116 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.565160 (+ 44us) service_pool.cc:224] Handling call
0923 19:50:06.988932 (+1423772us) ts_tablet_manager.cc:1151] Deleting tablet 870db252d8414be7bbe613ea467b5f3a
0923 19:50:06.988941 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.989037 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1423568}
W20260923 19:50:06.989784 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 870db252d8414be7bbe613ea467b5f3a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 870db252d8414be7bbe613ea467b5f3a already in progress: creating tablet
I20260923 19:50:06.990484 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 324) took 1424 ms. Trace:
I20260923 19:50:06.990609 6461 rpcz_store.cc:276] 0923 19:50:05.565496 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.565534 (+ 38us) service_pool.cc:224] Handling call
0923 19:50:06.990080 (+1424546us) ts_tablet_manager.cc:1151] Deleting tablet e1de117713f34b51bbda0c712f0b837c
0923 19:50:06.990089 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.990436 (+ 347us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1424277}
W20260923 19:50:06.991053 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet e1de117713f34b51bbda0c712f0b837c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e1de117713f34b51bbda0c712f0b837c already in progress: creating tablet
I20260923 19:50:06.991460 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 325) took 1357 ms. Trace:
I20260923 19:50:06.991591 6459 ts_tablet_manager.cc:1929] T f2d9f1a0fae849ae8083eba082055fe9 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:06.991582 6461 rpcz_store.cc:276] 0923 19:50:05.633997 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.634065 (+ 68us) service_pool.cc:224] Handling call
0923 19:50:06.991326 (+1357261us) ts_tablet_manager.cc:1151] Deleting tablet 2948d729e1ec4dfca70789bcad513e52
0923 19:50:06.991334 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.991413 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1357043}
I20260923 19:50:06.991782 6459 log.cc:1199] T f2d9f1a0fae849ae8083eba082055fe9 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/f2d9f1a0fae849ae8083eba082055fe9
I20260923 19:50:06.992230 6459 ts_tablet_manager.cc:1950] T f2d9f1a0fae849ae8083eba082055fe9 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
W20260923 19:50:06.992691 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 2948d729e1ec4dfca70789bcad513e52 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2948d729e1ec4dfca70789bcad513e52 already in progress: creating tablet
I20260923 19:50:06.992937 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet f2d9f1a0fae849ae8083eba082055fe9 (table default.Table_607b21eb9423483daac43c4cb1507962 [id=7252ede56f734ff5b3d3dc7576201183]) successfully deleted
I20260923 19:50:06.993119 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 326) took 1358 ms. Trace:
I20260923 19:50:06.993221 6461 rpcz_store.cc:276] 0923 19:50:05.634471 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.634514 (+ 43us) service_pool.cc:224] Handling call
0923 19:50:06.992970 (+1358456us) ts_tablet_manager.cc:1151] Deleting tablet 601a0ff319cc4c9a898d52bbcb19184b
0923 19:50:06.992981 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:06.993071 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1344646}
W20260923 19:50:06.993607 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 601a0ff319cc4c9a898d52bbcb19184b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 601a0ff319cc4c9a898d52bbcb19184b already in progress: creating tablet
I20260923 19:50:06.994100 6459 tablet_replica.cc:333] T b302820d329a41f0a9a54501c079fcd7 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:06.994295 6459 raft_consensus.cc:2243] T b302820d329a41f0a9a54501c079fcd7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:06.994472 6459 raft_consensus.cc:2272] T b302820d329a41f0a9a54501c079fcd7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:06.994997 6459 ts_tablet_manager.cc:1916] T b302820d329a41f0a9a54501c079fcd7 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:06.995350 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5febe26a78884634a01aa0ec62f36604" } modify_external_catalogs: true
I20260923 19:50:06.995545 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5febe26a78884634a01aa0ec62f36604" } modify_external_catalogs: true
I20260923 19:50:06.998144 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet 42e9cbcf77324d91abd029c12eaf950d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:06.998189 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bbd8fcc5ea1431ab9e4fadb7d52269e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.003656 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 322) took 1438 ms. Trace:
I20260923 19:50:07.004187 6461 rpcz_store.cc:276] 0923 19:50:05.564986 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.565615 (+ 629us) service_pool.cc:224] Handling call
0923 19:50:07.003430 (+1437815us) ts_tablet_manager.cc:1151] Deleting tablet 7b1601590508479c8f401cd09d9f4c3b
0923 19:50:07.003445 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.003583 (+ 138us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1330520}
W20260923 19:50:07.006037 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 7b1601590508479c8f401cd09d9f4c3b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7b1601590508479c8f401cd09d9f4c3b already in progress: creating tablet
I20260923 19:50:07.007718 6457 tablet_bootstrap.cc:492] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:07.007939 6457 ts_tablet_manager.cc:1403] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.000s
I20260923 19:50:07.008777 6457 raft_consensus.cc:359] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.009055 6457 raft_consensus.cc:385] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:07.009274 6457 raft_consensus.cc:740] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:07.009613 6867 consensus_queue.cc:1048] T f302f91c8ef44237b1c9909d88dacbff P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20260923 19:50:07.009953 6457 consensus_queue.cc:260] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.010614 6457 ts_tablet_manager.cc:1434] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:50:07.012143 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f372b952804ac58e602998d9b77d72" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:07.014307 6454 tablet_bootstrap.cc:492] T 033c2d772c8a44d2a0e671664bb9085d P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:07.014621 6454 ts_tablet_manager.cc:1403] T 033c2d772c8a44d2a0e671664bb9085d P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.150s user 0.002s sys 0.023s
I20260923 19:50:07.015697 6454 raft_consensus.cc:359] T 033c2d772c8a44d2a0e671664bb9085d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.016026 6454 raft_consensus.cc:385] T 033c2d772c8a44d2a0e671664bb9085d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:07.016372 6454 raft_consensus.cc:740] T 033c2d772c8a44d2a0e671664bb9085d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:07.016994 6454 consensus_queue.cc:260] T 033c2d772c8a44d2a0e671664bb9085d P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.018838 6454 ts_tablet_manager.cc:1434] T 033c2d772c8a44d2a0e671664bb9085d P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260923 19:50:07.019351 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 0e123b69877e4b1fbcdb2b27960864e9
I20260923 19:50:07.022109 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e123b69877e4b1fbcdb2b27960864e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:07.020258 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e123b69877e4b1fbcdb2b27960864e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:07.022629 6454 tablet_bootstrap.cc:492] T a1e8b8e638ec438a86f05fa147cdb27c P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:07.023646 6926 tablet.cc:1751] T a10110f4a2b34b61a4cc586d65981606 P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:07.026304 6461 tablet_replica.cc:333] T 3190d18f00234d71b0a58c2c334ef45f P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:07.028646 6461 raft_consensus.cc:2243] T 3190d18f00234d71b0a58c2c334ef45f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:07.029297 6344 raft_consensus.cc:2468] T b7f372b952804ac58e602998d9b77d72 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 0.
I20260923 19:50:07.029981 5996 leader_election.cc:304] T b7f372b952804ac58e602998d9b77d72 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:07.030164 6461 raft_consensus.cc:2272] T 3190d18f00234d71b0a58c2c334ef45f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:07.030318 6928 raft_consensus.cc:2804] T b7f372b952804ac58e602998d9b77d72 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:07.030405 6928 raft_consensus.cc:493] T b7f372b952804ac58e602998d9b77d72 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:07.030521 6928 raft_consensus.cc:3060] T b7f372b952804ac58e602998d9b77d72 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:07.030807 6461 ts_tablet_manager.cc:1916] T 3190d18f00234d71b0a58c2c334ef45f P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:07.026721 6457 tablet_bootstrap.cc:492] T 623fb5b761134951a4b742ab2ba480a4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:07.037955 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_5d0c2a71e15a41e9a3200d2f16a36e16"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:07.038769 6321 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e123b69877e4b1fbcdb2b27960864e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:07.039701 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d0c2a71e15a41e9a3200d2f16a36e16 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:07.044487 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 58c24aa494bc4da28536dfa1df6123b7
I20260923 19:50:07.045252 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet 58c24aa494bc4da28536dfa1df6123b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:07.045269 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_fd787c6c31954875a5243becab2de8ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:07.045778 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd787c6c31954875a5243becab2de8ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:07.048303 6316 tablet_service.cc:1558] Processing DeleteTablet for tablet 58c24aa494bc4da28536dfa1df6123b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:07.048584 6773 raft_consensus.cc:493] T 5c0142f4e3ad42048803481d68f0ee5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:07.048806 6773 raft_consensus.cc:515] T 5c0142f4e3ad42048803481d68f0ee5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.049433 6773 leader_election.cc:290] T 5c0142f4e3ad42048803481d68f0ee5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:07.049541 6928 raft_consensus.cc:515] T b7f372b952804ac58e602998d9b77d72 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.050203 6928 leader_election.cc:290] T b7f372b952804ac58e602998d9b77d72 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:07.050854 5801 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 15a9d1d4adaa402f90d774e77010c928
I20260923 19:50:07.051329 5801 catalog_manager.cc:6934] ReplaceTablet: tablet 15a9d1d4adaa402f90d774e77010c928 deleted and replaced by tablet 1cf016ff0bb8418d84358d17876338bf
I20260923 19:50:07.052755 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c0142f4e3ad42048803481d68f0ee5d" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:07.052762 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f372b952804ac58e602998d9b77d72" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:07.053102 6343 raft_consensus.cc:3060] T b7f372b952804ac58e602998d9b77d72 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
W20260923 19:50:07.053428 5996 leader_election.cc:343] T 5c0142f4e3ad42048803481d68f0ee5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:07.053694 5800 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 9be4c46ee8eb4dbaad01d492b701a9e0
I20260923 19:50:07.053843 6457 tablet_bootstrap.cc:654] T 623fb5b761134951a4b742ab2ba480a4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:07.054278 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet 15a9d1d4adaa402f90d774e77010c928 with delete_type TABLET_DATA_DELETED (replaced by tablet 1cf016ff0bb8418d84358d17876338bf) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:07.055068 5805 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet f302f91c8ef44237b1c9909d88dacbff (table default.Table_b623e36133d64d72a070bb99a0b974ee [id=4300ad9818924415b6414ea9f89445ce]). Expected version 2 got 0
I20260923 19:50:07.055213 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet 9be4c46ee8eb4dbaad01d492b701a9e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:07.055269 5805 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 115048f771764e41a3816e17a6c6cf94 (table default.Table_62802f9e844c4c16bf9cb0d04a630fa9 [id=498c667413e24c7c800fe5eae263cf22]). Expected version 1 got 0
I20260923 19:50:07.055483 5805 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 5adadf8caf5e4a9ab1107d0fb6a91735 (table default.Table_bd91264aa4a0430eb1a8f69129fb0f3f [id=738ed1d070ef485e9299c1f3b1db008a]). Expected version 2 got 0
I20260923 19:50:07.056449 6343 raft_consensus.cc:2468] T b7f372b952804ac58e602998d9b77d72 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 1.
I20260923 19:50:07.057487 5996 leader_election.cc:304] T b7f372b952804ac58e602998d9b77d72 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:07.058815 6928 raft_consensus.cc:2804] T b7f372b952804ac58e602998d9b77d72 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:07.058977 6928 raft_consensus.cc:697] T b7f372b952804ac58e602998d9b77d72 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Becoming Leader. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Running, Role: LEADER
I20260923 19:50:07.059267 6928 consensus_queue.cc:237] T b7f372b952804ac58e602998d9b77d72 P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.061070 6459 ts_tablet_manager.cc:1929] T b302820d329a41f0a9a54501c079fcd7 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:07.061829 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet 15a9d1d4adaa402f90d774e77010c928 with delete_type TABLET_DATA_DELETED (replaced by tablet 1cf016ff0bb8418d84358d17876338bf) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:07.061977 6316 tablet_service.cc:1558] Processing DeleteTablet for tablet 033c2d772c8a44d2a0e671664bb9085d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:07.062332 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet 9be4c46ee8eb4dbaad01d492b701a9e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:07.061653 6454 tablet_bootstrap.cc:654] T a1e8b8e638ec438a86f05fa147cdb27c P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:07.064311 6321 tablet_service.cc:1558] Processing DeleteTablet for tablet b302820d329a41f0a9a54501c079fcd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:07.065568 6456 tablet_bootstrap.cc:492] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:07.065778 6456 ts_tablet_manager.cc:1403] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.121s user 0.009s sys 0.009s
I20260923 19:50:07.066665 6456 raft_consensus.cc:359] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.064591 6459 log.cc:1199] T b302820d329a41f0a9a54501c079fcd7 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/b302820d329a41f0a9a54501c079fcd7
I20260923 19:50:07.067354 6459 ts_tablet_manager.cc:1950] T b302820d329a41f0a9a54501c079fcd7 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:07.069062 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet 3190d18f00234d71b0a58c2c334ef45f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:07.069814 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet b302820d329a41f0a9a54501c079fcd7 (table default.Table_a34330ce2a604efca09f754e4d3e2127 [id=18f1a98d21a2426faed4f4dbf4fc57d1]) successfully deleted
I20260923 19:50:07.070523 6031 tablet_service.cc:1558] Processing DeleteTablet for tablet 9be4c46ee8eb4dbaad01d492b701a9e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:07.070727 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet 15a9d1d4adaa402f90d774e77010c928 with delete_type TABLET_DATA_DELETED (replaced by tablet 1cf016ff0bb8418d84358d17876338bf) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:07.070814 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f372b952804ac58e602998d9b77d72" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:07.070911 6026 tablet_service.cc:1558] Processing DeleteTablet for tablet 58c24aa494bc4da28536dfa1df6123b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:07.071426 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c0142f4e3ad42048803481d68f0ee5d" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:07.072556 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet 640a98d3a845461e8d4f07041ab515c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:07.073623 5995 leader_election.cc:343] T b7f372b952804ac58e602998d9b77d72 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:07.074666 6926 tablet.cc:1751] T 115048f771764e41a3816e17a6c6cf94 P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:07.075996 6456 raft_consensus.cc:385] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:07.076103 6456 raft_consensus.cc:740] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:07.076362 6456 consensus_queue.cc:260] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:07.077737 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet a10d35bf564d45488524d3d21721f4e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a10d35bf564d45488524d3d21721f4e5 already in progress: creating tablet
W20260923 19:50:07.078831 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet d8c8bfa9b7424b9f80f76e0bb05cbc0c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d8c8bfa9b7424b9f80f76e0bb05cbc0c already in progress: creating tablet
I20260923 19:50:07.081452 6920 raft_consensus.cc:493] T e1752d6b46894796bdc94e6230e3327d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260923 19:50:07.081550 5995 leader_election.cc:343] T 5c0142f4e3ad42048803481d68f0ee5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:07.081697 5995 leader_election.cc:304] T 5c0142f4e3ad42048803481d68f0ee5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:07.081672 6920 raft_consensus.cc:515] T e1752d6b46894796bdc94e6230e3327d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:07.081962 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 623052a8c9c2436a828655da6cf6d379 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 623052a8c9c2436a828655da6cf6d379 already in progress: creating tablet
I20260923 19:50:07.082000 6773 raft_consensus.cc:2749] T 5c0142f4e3ad42048803481d68f0ee5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:07.083106 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet b9c187ee1fa8438397c83bc2c2b16925 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9c187ee1fa8438397c83bc2c2b16925 already in progress: creating tablet
I20260923 19:50:07.083333 6920 leader_election.cc:290] T e1752d6b46894796bdc94e6230e3327d P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:07.083793 6456 ts_tablet_manager.cc:1434] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
W20260923 19:50:07.083811 6139 leader_election.cc:343] T e1752d6b46894796bdc94e6230e3327d P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: e1752d6b46894796bdc94e6230e3327d
W20260923 19:50:07.083966 6137 leader_election.cc:343] T e1752d6b46894796bdc94e6230e3327d P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: e1752d6b46894796bdc94e6230e3327d
I20260923 19:50:07.084084 6137 leader_election.cc:304] T e1752d6b46894796bdc94e6230e3327d P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:07.085283 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet a926ff092e6e495e981be156421e8d72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a926ff092e6e495e981be156421e8d72 already in progress: creating tablet
I20260923 19:50:07.086025 6459 tablet_replica.cc:333] T b2762648045b4378bcc2c1234460c352 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:07.086261 6459 raft_consensus.cc:2243] T b2762648045b4378bcc2c1234460c352 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:07.086467 6459 raft_consensus.cc:2272] T b2762648045b4378bcc2c1234460c352 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:07.088032 6920 raft_consensus.cc:2749] T e1752d6b46894796bdc94e6230e3327d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:07.091193 6646 raft_consensus.cc:2749] T 115048f771764e41a3816e17a6c6cf94 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:07.100055 5799 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 86473c5cbca54b5792b038aef445998c
I20260923 19:50:07.100911 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet 86473c5cbca54b5792b038aef445998c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:07.102851 6456 tablet_bootstrap.cc:492] T 3190d18f00234d71b0a58c2c334ef45f P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:07.104525 6456 tablet_bootstrap.cc:654] T 3190d18f00234d71b0a58c2c334ef45f P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:07.106266 6459 ts_tablet_manager.cc:1916] T b2762648045b4378bcc2c1234460c352 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:07.107035 6026 tablet_service.cc:1558] Processing DeleteTablet for tablet 86473c5cbca54b5792b038aef445998c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:07.107975 6814 raft_consensus.cc:493] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:07.108142 6814 raft_consensus.cc:515] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.108867 6814 leader_election.cc:290] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:07.110404 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c0142f4e3ad42048803481d68f0ee5d" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:07.111420 6280 leader_election.cc:343] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:07.111749 6814 consensus_queue.cc:1048] T f302f91c8ef44237b1c9909d88dacbff P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:07.115569 6058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c0142f4e3ad42048803481d68f0ee5d" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:07.115904 6058 raft_consensus.cc:2468] T 5c0142f4e3ad42048803481d68f0ee5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:07.117223 6279 leader_election.cc:304] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:07.117694 6914 raft_consensus.cc:2804] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:07.117863 6914 raft_consensus.cc:493] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:07.118083 6914 raft_consensus.cc:3060] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:07.119685 6316 tablet_service.cc:1558] Processing DeleteTablet for tablet 86473c5cbca54b5792b038aef445998c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:07.122051 6914 raft_consensus.cc:515] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.123627 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c0142f4e3ad42048803481d68f0ee5d" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
W20260923 19:50:07.124150 6280 leader_election.cc:343] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:07.124451 6058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c0142f4e3ad42048803481d68f0ee5d" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:07.124647 6058 raft_consensus.cc:3060] T 5c0142f4e3ad42048803481d68f0ee5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:07.130681 6773 raft_consensus.cc:493] T 9101e82501fd461f8a4b2dcd9dffbd74 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:07.130936 6461 ts_tablet_manager.cc:1929] T 3190d18f00234d71b0a58c2c334ef45f P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:07.131057 6461 log.cc:1199] T 3190d18f00234d71b0a58c2c334ef45f P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/3190d18f00234d71b0a58c2c334ef45f
I20260923 19:50:07.131033 6773 raft_consensus.cc:515] T 9101e82501fd461f8a4b2dcd9dffbd74 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.131440 6461 ts_tablet_manager.cc:1950] T 3190d18f00234d71b0a58c2c334ef45f P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:07.132817 6058 raft_consensus.cc:2468] T 5c0142f4e3ad42048803481d68f0ee5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:07.132843 6773 leader_election.cc:290] T 9101e82501fd461f8a4b2dcd9dffbd74 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:07.134847 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9101e82501fd461f8a4b2dcd9dffbd74" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:07.135110 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9101e82501fd461f8a4b2dcd9dffbd74" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:07.136139 6914 leader_election.cc:290] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
W20260923 19:50:07.136170 5995 leader_election.cc:343] T 9101e82501fd461f8a4b2dcd9dffbd74 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:07.136708 5996 leader_election.cc:343] T 9101e82501fd461f8a4b2dcd9dffbd74 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:07.136825 5996 leader_election.cc:304] T 9101e82501fd461f8a4b2dcd9dffbd74 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:07.137250 6773 raft_consensus.cc:2749] T 9101e82501fd461f8a4b2dcd9dffbd74 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:07.137343 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 329) took 1460 ms. Trace:
I20260923 19:50:07.137842 6279 leader_election.cc:304] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:07.138151 6914 raft_consensus.cc:2804] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:07.138353 6914 raft_consensus.cc:697] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:07.138701 6914 consensus_queue.cc:237] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.140192 6456 tablet_bootstrap.cc:492] T 3190d18f00234d71b0a58c2c334ef45f P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:07.142174 6456 ts_tablet_manager.cc:1403] T 3190d18f00234d71b0a58c2c334ef45f P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.058s user 0.002s sys 0.002s
I20260923 19:50:07.143056 6461 rpcz_store.cc:276] 0923 19:50:05.676647 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.676941 (+ 294us) service_pool.cc:224] Handling call
0923 19:50:07.010727 (+1333786us) ts_tablet_manager.cc:1151] Deleting tablet 3190d18f00234d71b0a58c2c334ef45f
0923 19:50:07.012901 (+ 2174us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.096730 (+ 83829us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:07.130840 (+ 34110us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:07.137303 (+ 6463us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1321930}
I20260923 19:50:07.144761 6461 tablet_replica.cc:333] T f2d9f1a0fae849ae8083eba082055fe9 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:07.144930 6814 raft_consensus.cc:493] T d70b7662d85a4f64a11420448c4d140d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:07.145072 6814 raft_consensus.cc:515] T d70b7662d85a4f64a11420448c4d140d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.145304 6461 raft_consensus.cc:2243] T f2d9f1a0fae849ae8083eba082055fe9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:07.145450 6461 raft_consensus.cc:2272] T f2d9f1a0fae849ae8083eba082055fe9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:07.145750 6814 leader_election.cc:290] T d70b7662d85a4f64a11420448c4d140d P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:07.146003 6461 ts_tablet_manager.cc:1916] T f2d9f1a0fae849ae8083eba082055fe9 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:07.146170 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 3190d18f00234d71b0a58c2c334ef45f (table default.Table_adfa6338ea024e4a87e614cbc086cbc3 [id=eedb3f35db9640d992be8887c071962f]) successfully deleted
W20260923 19:50:07.148891 6279 leader_election.cc:343] T d70b7662d85a4f64a11420448c4d140d P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: d70b7662d85a4f64a11420448c4d140d
I20260923 19:50:07.149426 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70b7662d85a4f64a11420448c4d140d" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:07.144445 6456 raft_consensus.cc:359] T 3190d18f00234d71b0a58c2c334ef45f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:07.151901 6280 leader_election.cc:343] T d70b7662d85a4f64a11420448c4d140d P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:07.152122 6280 leader_election.cc:304] T d70b7662d85a4f64a11420448c4d140d P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:07.152484 6814 raft_consensus.cc:2749] T d70b7662d85a4f64a11420448c4d140d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:07.152096 6456 raft_consensus.cc:385] T 3190d18f00234d71b0a58c2c334ef45f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:07.152911 6456 raft_consensus.cc:740] T 3190d18f00234d71b0a58c2c334ef45f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:07.153206 6456 consensus_queue.cc:260] T 3190d18f00234d71b0a58c2c334ef45f P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.153959 6456 ts_tablet_manager.cc:1434] T 3190d18f00234d71b0a58c2c334ef45f P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260923 19:50:07.154291 6456 tablet_bootstrap.cc:492] T 789c54477bec4636bb3669e1f62730e2 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:07.158018 6456 tablet_bootstrap.cc:654] T 789c54477bec4636bb3669e1f62730e2 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:07.158154 6914 consensus_queue.cc:1048] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260923 19:50:07.174073 6456 tablet_bootstrap.cc:492] T 789c54477bec4636bb3669e1f62730e2 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:07.174577 6456 ts_tablet_manager.cc:1403] T 789c54477bec4636bb3669e1f62730e2 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.000s
I20260923 19:50:07.176154 6456 raft_consensus.cc:359] T 789c54477bec4636bb3669e1f62730e2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.176559 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_e9566b6b8f85440db073d543e768b2ae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:07.177251 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e9566b6b8f85440db073d543e768b2ae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:07.177381 5799 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet f302f91c8ef44237b1c9909d88dacbff (table default.Table_b623e36133d64d72a070bb99a0b974ee [id=4300ad9818924415b6414ea9f89445ce]). Expected version 2 got 0
I20260923 19:50:07.178805 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_fc95f21fffc649e3953772b8c4ddbdfb" } new_table_name: "default.Table_71d7f590efb94aae8c345f9d9a620fc1" modify_external_catalogs: true
I20260923 19:50:07.179786 6456 raft_consensus.cc:385] T 789c54477bec4636bb3669e1f62730e2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:07.179877 6456 raft_consensus.cc:740] T 789c54477bec4636bb3669e1f62730e2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:07.180786 6456 consensus_queue.cc:260] T 789c54477bec4636bb3669e1f62730e2 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.180254 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_125b7d46aef24091b6bc3c8e39e3dd99" } new_table_name: "default.Table_1e9ebf5c3c644666a5b6c1966fde4ed5" modify_external_catalogs: true
I20260923 19:50:07.181716 6026 tablet_service.cc:1558] Processing DeleteTablet for tablet b4fc995819cc40bf9956d85966bcd330 with delete_type TABLET_DATA_DELETED (replaced by tablet efc63a151f6444dfb03c3f15f6f54473) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:07.180619 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_1c47528c587348289f80a95a809c70c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:07.183128 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c47528c587348289f80a95a809c70c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:07.181354 5797 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_4eba9023b25a445bb87c0b95ee9badaf" } new_table_name: "default.Table_346160aa15ec4313947a6b9f256cea06" modify_external_catalogs: true
I20260923 19:50:07.180143 5799 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 115048f771764e41a3816e17a6c6cf94 (table default.Table_0ebdc6bda57442b796dabb005f3779c5 [id=498c667413e24c7c800fe5eae263cf22]). Expected version 2 got 0
I20260923 19:50:07.186950 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet a224ae69503e4ab588d6269086317f09 with delete_type TABLET_DATA_DELETED (replaced by tablet d6d3601a392f4723b4ca00f6e12b950c) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:07.187114 6459 ts_tablet_manager.cc:1929] T b2762648045b4378bcc2c1234460c352 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:07.187407 6459 log.cc:1199] T b2762648045b4378bcc2c1234460c352 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/b2762648045b4378bcc2c1234460c352
I20260923 19:50:07.187906 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet 033c2d772c8a44d2a0e671664bb9085d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:07.188596 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e726ee6a5494fd4b72c1ebef7d66b42 with delete_type TABLET_DATA_DELETED (replaced by tablet 6238d16b1be74dd88fd2e089fbd85d33) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:07.188977 6456 ts_tablet_manager.cc:1434] T 789c54477bec4636bb3669e1f62730e2 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260923 19:50:07.189497 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet e1752d6b46894796bdc94e6230e3327d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:07.190207 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_5819e2b3c82046279b4be250aa5ca72b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:07.190868 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5819e2b3c82046279b4be250aa5ca72b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:07.191115 6457 tablet_bootstrap.cc:492] T 623fb5b761134951a4b742ab2ba480a4 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:07.191311 6457 ts_tablet_manager.cc:1403] T 623fb5b761134951a4b742ab2ba480a4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.165s user 0.008s sys 0.006s
I20260923 19:50:07.192786 6461 ts_tablet_manager.cc:1929] T f2d9f1a0fae849ae8083eba082055fe9 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:07.192938 6461 log.cc:1199] T f2d9f1a0fae849ae8083eba082055fe9 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/f2d9f1a0fae849ae8083eba082055fe9
I20260923 19:50:07.192996 6457 raft_consensus.cc:359] T 623fb5b761134951a4b742ab2ba480a4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.193205 6457 raft_consensus.cc:385] T 623fb5b761134951a4b742ab2ba480a4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:07.193286 6457 raft_consensus.cc:740] T 623fb5b761134951a4b742ab2ba480a4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:07.193334 6461 ts_tablet_manager.cc:1950] T f2d9f1a0fae849ae8083eba082055fe9 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:07.193531 6457 consensus_queue.cc:260] T 623fb5b761134951a4b742ab2ba480a4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.194120 6457 ts_tablet_manager.cc:1434] T 623fb5b761134951a4b742ab2ba480a4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260923 19:50:07.194397 6457 tablet_bootstrap.cc:492] T 495292cacf3b42a5b633ad40e5e01972 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:07.195981 6457 tablet_bootstrap.cc:654] T 495292cacf3b42a5b633ad40e5e01972 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:07.197378 6646 raft_consensus.cc:493] T 640a98d3a845461e8d4f07041ab515c7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:07.197541 6646 raft_consensus.cc:515] T 640a98d3a845461e8d4f07041ab515c7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.198374 6646 leader_election.cc:290] T 640a98d3a845461e8d4f07041ab515c7 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:07.198792 6940 log.cc:927] Time spent T 115048f771764e41a3816e17a6c6cf94 P 2bf41435f70447f19992d368ca6b46bd: Append to log took a long time: real 0.110s user 0.000s sys 0.000s
W20260923 19:50:07.200160 6137 leader_election.cc:343] T 640a98d3a845461e8d4f07041ab515c7 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 640a98d3a845461e8d4f07041ab515c7
W20260923 19:50:07.200330 6139 leader_election.cc:343] T 640a98d3a845461e8d4f07041ab515c7 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 640a98d3a845461e8d4f07041ab515c7
I20260923 19:50:07.200513 6139 leader_election.cc:304] T 640a98d3a845461e8d4f07041ab515c7 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:07.202983 6456 tablet_bootstrap.cc:492] T 4b15b250f594459eb959b4871f7ae398 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:07.203063 6646 raft_consensus.cc:2749] T 640a98d3a845461e8d4f07041ab515c7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:07.206187 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 0c537304c32c44adaa1e05de4496293f
I20260923 19:50:07.209280 6456 tablet_bootstrap.cc:654] T 4b15b250f594459eb959b4871f7ae398 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:07.210546 6316 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c537304c32c44adaa1e05de4496293f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:07.211686 6026 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c537304c32c44adaa1e05de4496293f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:07.211997 6454 tablet_bootstrap.cc:492] T a1e8b8e638ec438a86f05fa147cdb27c P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:07.212100 6456 tablet_bootstrap.cc:492] T 4b15b250f594459eb959b4871f7ae398 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:07.212287 6456 ts_tablet_manager.cc:1403] T 4b15b250f594459eb959b4871f7ae398 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.001s
I20260923 19:50:07.213394 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 330) took 1515 ms. Trace:
I20260923 19:50:07.214087 6456 raft_consensus.cc:359] T 4b15b250f594459eb959b4871f7ae398 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.212630 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c537304c32c44adaa1e05de4496293f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:07.215565 6454 ts_tablet_manager.cc:1403] T a1e8b8e638ec438a86f05fa147cdb27c P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.193s user 0.004s sys 0.013s
I20260923 19:50:07.215420 6461 rpcz_store.cc:276] 0923 19:50:05.698366 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.698530 (+ 164us) service_pool.cc:224] Handling call
0923 19:50:07.144685 (+1446155us) ts_tablet_manager.cc:1151] Deleting tablet f2d9f1a0fae849ae8083eba082055fe9
0923 19:50:07.144698 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.189424 (+ 44726us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:07.192710 (+ 3286us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:07.213337 (+ 20627us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1445874}
I20260923 19:50:07.215894 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 332) took 1507 ms. Trace:
I20260923 19:50:07.216065 6456 raft_consensus.cc:385] T 4b15b250f594459eb959b4871f7ae398 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:07.216233 6461 rpcz_store.cc:276] 0923 19:50:05.708433 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.734281 (+ 25848us) service_pool.cc:224] Handling call
0923 19:50:07.215726 (+1481445us) ts_tablet_manager.cc:1151] Deleting tablet 7e41501bf01e4765853c27e4cac21e2b
0923 19:50:07.215737 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.215847 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1475268}
I20260923 19:50:07.216892 6456 raft_consensus.cc:740] T 4b15b250f594459eb959b4871f7ae398 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:07.217420 6454 raft_consensus.cc:359] T a1e8b8e638ec438a86f05fa147cdb27c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.218451 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet f2d9f1a0fae849ae8083eba082055fe9 (table default.Table_607b21eb9423483daac43c4cb1507962 [id=7252ede56f734ff5b3d3dc7576201183]) successfully deleted
I20260923 19:50:07.218684 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 334) took 1465 ms. Trace:
W20260923 19:50:07.218777 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 7e41501bf01e4765853c27e4cac21e2b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e41501bf01e4765853c27e4cac21e2b already in progress: creating tablet
I20260923 19:50:07.218781 6461 rpcz_store.cc:276] 0923 19:50:05.753410 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.785647 (+ 32237us) service_pool.cc:224] Handling call
0923 19:50:07.218545 (+1432898us) ts_tablet_manager.cc:1151] Deleting tablet b18548ba557f448880c5e617fc03cbe0
0923 19:50:07.218554 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.218629 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1432581}
I20260923 19:50:07.219216 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 338) took 1383 ms. Trace:
W20260923 19:50:07.219583 6279 consensus_peers.cc:597] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 063fc0e77d294ddf8a02e9ab5968a5e3. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:07.219734 6454 raft_consensus.cc:385] T a1e8b8e638ec438a86f05fa147cdb27c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:07.219533 6456 consensus_queue.cc:260] T 4b15b250f594459eb959b4871f7ae398 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.219831 6454 raft_consensus.cc:740] T a1e8b8e638ec438a86f05fa147cdb27c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:07.220005 6461 rpcz_store.cc:276] 0923 19:50:05.835432 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.835481 (+ 49us) service_pool.cc:224] Handling call
0923 19:50:07.219027 (+1383546us) ts_tablet_manager.cc:1151] Deleting tablet c504ec668a33451fb1249f697bb5e2bb
0923 19:50:07.219035 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.219151 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1382762}
I20260923 19:50:07.220639 6456 ts_tablet_manager.cc:1434] T 4b15b250f594459eb959b4871f7ae398 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260923 19:50:07.221294 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 339) took 1310 ms. Trace:
I20260923 19:50:07.222505 6456 tablet_bootstrap.cc:492] T 9101e82501fd461f8a4b2dcd9dffbd74 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:07.222632 6461 rpcz_store.cc:276] 0923 19:50:05.910649 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.913510 (+ 2861us) service_pool.cc:224] Handling call
0923 19:50:07.221140 (+1307630us) ts_tablet_manager.cc:1151] Deleting tablet dbe06eba8067413a903e4a07c2768484
0923 19:50:07.221148 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.221240 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1307393}
W20260923 19:50:07.222733 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet b18548ba557f448880c5e617fc03cbe0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b18548ba557f448880c5e617fc03cbe0 already in progress: creating tablet
W20260923 19:50:07.223136 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet c504ec668a33451fb1249f697bb5e2bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c504ec668a33451fb1249f697bb5e2bb already in progress: creating tablet
W20260923 19:50:07.223394 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet dbe06eba8067413a903e4a07c2768484 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dbe06eba8067413a903e4a07c2768484 already in progress: creating tablet
W20260923 19:50:07.223870 6280 consensus_peers.cc:597] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:07.224022 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 340) took 1286 ms. Trace:
I20260923 19:50:07.224608 6646 raft_consensus.cc:493] T 3190d18f00234d71b0a58c2c334ef45f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:07.225934 6461 rpcz_store.cc:276] 0923 19:50:05.937424 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.937495 (+ 71us) service_pool.cc:224] Handling call
0923 19:50:07.223334 (+1285839us) ts_tablet_manager.cc:1151] Deleting tablet c012b2a92dc14f2ab5d9f4fe8a6a7779
0923 19:50:07.223343 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.223430 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1285491}
I20260923 19:50:07.226006 6646 raft_consensus.cc:515] T 3190d18f00234d71b0a58c2c334ef45f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:07.226554 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet c012b2a92dc14f2ab5d9f4fe8a6a7779 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c012b2a92dc14f2ab5d9f4fe8a6a7779 already in progress: creating tablet
I20260923 19:50:07.226745 6646 leader_election.cc:290] T 3190d18f00234d71b0a58c2c334ef45f P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:07.227492 6454 consensus_queue.cc:260] T a1e8b8e638ec438a86f05fa147cdb27c P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.227512 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3190d18f00234d71b0a58c2c334ef45f" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:07.227806 6343 raft_consensus.cc:2468] T 3190d18f00234d71b0a58c2c334ef45f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:07.228739 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 341) took 1212 ms. Trace:
I20260923 19:50:07.215461 6458 ts_tablet_manager.cc:1929] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:07.229005 6458 log.cc:1199] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/6e726ee6a5494fd4b72c1ebef7d66b42
I20260923 19:50:07.229146 6461 rpcz_store.cc:276] 0923 19:50:06.014696 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:06.014908 (+ 212us) service_pool.cc:224] Handling call
0923 19:50:07.227067 (+1212159us) ts_tablet_manager.cc:1151] Deleting tablet 908596339b2e4f7f8ddb7f9cd5bdcc3e
0923 19:50:07.227077 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.227180 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1211883}
W20260923 19:50:07.227802 6137 leader_election.cc:343] T 3190d18f00234d71b0a58c2c334ef45f P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 3190d18f00234d71b0a58c2c334ef45f
I20260923 19:50:07.229723 6458 ts_tablet_manager.cc:1950] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:07.230507 6139 leader_election.cc:304] T 3190d18f00234d71b0a58c2c334ef45f P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:07.230993 6646 raft_consensus.cc:2804] T 3190d18f00234d71b0a58c2c334ef45f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:07.231168 6646 raft_consensus.cc:493] T 3190d18f00234d71b0a58c2c334ef45f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:07.231530 6646 raft_consensus.cc:3060] T 3190d18f00234d71b0a58c2c334ef45f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
W20260923 19:50:07.231551 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 908596339b2e4f7f8ddb7f9cd5bdcc3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 908596339b2e4f7f8ddb7f9cd5bdcc3e already in progress: creating tablet
I20260923 19:50:07.231950 6461 tablet_replica.cc:333] T b7f372b952804ac58e602998d9b77d72 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:07.233139 6867 raft_consensus.cc:493] T 4b15b250f594459eb959b4871f7ae398 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:07.233299 6867 raft_consensus.cc:515] T 4b15b250f594459eb959b4871f7ae398 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.233575 6456 tablet_bootstrap.cc:654] T 9101e82501fd461f8a4b2dcd9dffbd74 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:07.233912 6867 leader_election.cc:290] T 4b15b250f594459eb959b4871f7ae398 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:07.235054 6646 raft_consensus.cc:515] T 3190d18f00234d71b0a58c2c334ef45f P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.235119 6057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b15b250f594459eb959b4871f7ae398" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:07.235322 6057 raft_consensus.cc:2468] T 4b15b250f594459eb959b4871f7ae398 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:07.235908 6279 leader_election.cc:304] T 4b15b250f594459eb959b4871f7ae398 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:07.236227 6914 raft_consensus.cc:2804] T 4b15b250f594459eb959b4871f7ae398 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:07.236380 6914 raft_consensus.cc:493] T 4b15b250f594459eb959b4871f7ae398 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:07.236465 6646 leader_election.cc:290] T 3190d18f00234d71b0a58c2c334ef45f P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:07.236519 6914 raft_consensus.cc:3060] T 4b15b250f594459eb959b4871f7ae398 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
W20260923 19:50:07.236568 6137 leader_election.cc:343] T 3190d18f00234d71b0a58c2c334ef45f P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 3190d18f00234d71b0a58c2c334ef45f
I20260923 19:50:07.239490 6454 ts_tablet_manager.cc:1434] T a1e8b8e638ec438a86f05fa147cdb27c P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.023s user 0.001s sys 0.001s
I20260923 19:50:07.239784 6454 tablet_bootstrap.cc:492] T 0a5ce253bcce410b9517449f133d39e8 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:07.240130 6914 raft_consensus.cc:515] T 4b15b250f594459eb959b4871f7ae398 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.236377 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3190d18f00234d71b0a58c2c334ef45f" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:07.241247 6343 raft_consensus.cc:3060] T 3190d18f00234d71b0a58c2c334ef45f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:07.241473 6454 tablet_bootstrap.cc:654] T 0a5ce253bcce410b9517449f133d39e8 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:07.229585 6926 tablet.cc:1751] T 115048f771764e41a3816e17a6c6cf94 P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:07.244017 6058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b15b250f594459eb959b4871f7ae398" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:07.244213 6058 raft_consensus.cc:3060] T 4b15b250f594459eb959b4871f7ae398 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:07.244482 6343 raft_consensus.cc:2468] T 3190d18f00234d71b0a58c2c334ef45f P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:07.247061 6139 leader_election.cc:304] T 3190d18f00234d71b0a58c2c334ef45f P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:07.248799 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b15b250f594459eb959b4871f7ae398" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:07.250474 6058 raft_consensus.cc:2468] T 4b15b250f594459eb959b4871f7ae398 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:07.250751 6461 raft_consensus.cc:2243] T b7f372b952804ac58e602998d9b77d72 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:07.251601 6279 leader_election.cc:304] T 4b15b250f594459eb959b4871f7ae398 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
W20260923 19:50:07.251905 6280 leader_election.cc:343] T 4b15b250f594459eb959b4871f7ae398 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:07.252200 6867 raft_consensus.cc:2804] T 4b15b250f594459eb959b4871f7ae398 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:07.252338 6867 raft_consensus.cc:697] T 4b15b250f594459eb959b4871f7ae398 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:07.252645 6867 consensus_queue.cc:237] T 4b15b250f594459eb959b4871f7ae398 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.259953 6461 pending_rounds.cc:70] T b7f372b952804ac58e602998d9b77d72 P e546f660e7e541d1aa9ae38e5ee5b9c0: Trying to abort 1 pending ops.
I20260923 19:50:07.260111 6461 pending_rounds.cc:77] T b7f372b952804ac58e602998d9b77d72 P e546f660e7e541d1aa9ae38e5ee5b9c0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630556917379072 op_type: NO_OP noop_request { }
I20260923 19:50:07.260322 6461 raft_consensus.cc:2889] T b7f372b952804ac58e602998d9b77d72 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:07.260509 6461 raft_consensus.cc:2272] T b7f372b952804ac58e602998d9b77d72 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:07.260581 6920 raft_consensus.cc:2804] T 3190d18f00234d71b0a58c2c334ef45f P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:07.260730 6920 raft_consensus.cc:697] T 3190d18f00234d71b0a58c2c334ef45f P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:07.260998 6920 consensus_queue.cc:237] T 3190d18f00234d71b0a58c2c334ef45f P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.261935 6912 raft_consensus.cc:493] T a1e8b8e638ec438a86f05fa147cdb27c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:07.262070 6912 raft_consensus.cc:515] T a1e8b8e638ec438a86f05fa147cdb27c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.262635 6912 leader_election.cc:290] T a1e8b8e638ec438a86f05fa147cdb27c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:07.263136 6461 ts_tablet_manager.cc:1916] T b7f372b952804ac58e602998d9b77d72 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:07.263765 6139 leader_election.cc:343] T a1e8b8e638ec438a86f05fa147cdb27c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: a1e8b8e638ec438a86f05fa147cdb27c
W20260923 19:50:07.263962 6137 leader_election.cc:343] T a1e8b8e638ec438a86f05fa147cdb27c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: a1e8b8e638ec438a86f05fa147cdb27c
I20260923 19:50:07.264179 6137 leader_election.cc:304] T a1e8b8e638ec438a86f05fa147cdb27c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:07.264765 6646 raft_consensus.cc:2749] T a1e8b8e638ec438a86f05fa147cdb27c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:07.269032 6928 raft_consensus.cc:493] T 4750e2a1b24e4bc7aafa4cd36afebbbd P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:07.269315 6928 raft_consensus.cc:515] T 4750e2a1b24e4bc7aafa4cd36afebbbd P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.270151 6928 leader_election.cc:290] T 4750e2a1b24e4bc7aafa4cd36afebbbd P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:07.270769 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4750e2a1b24e4bc7aafa4cd36afebbbd" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:07.271418 5995 leader_election.cc:343] T 4750e2a1b24e4bc7aafa4cd36afebbbd P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:07.271867 6914 leader_election.cc:290] T 4b15b250f594459eb959b4871f7ae398 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:07.272408 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b15b250f594459eb959b4871f7ae398" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:07.272750 6461 ts_tablet_manager.cc:1929] T b7f372b952804ac58e602998d9b77d72 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:07.272882 6461 log.cc:1199] T b7f372b952804ac58e602998d9b77d72 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/b7f372b952804ac58e602998d9b77d72
I20260923 19:50:07.273307 6461 ts_tablet_manager.cc:1950] T b7f372b952804ac58e602998d9b77d72 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
W20260923 19:50:07.273303 6280 leader_election.cc:343] T 4b15b250f594459eb959b4871f7ae398 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:07.273805 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4750e2a1b24e4bc7aafa4cd36afebbbd" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:07.274500 5996 leader_election.cc:343] T 4750e2a1b24e4bc7aafa4cd36afebbbd P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:07.274638 5996 leader_election.cc:304] T 4750e2a1b24e4bc7aafa4cd36afebbbd P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:07.274880 6928 raft_consensus.cc:2749] T 4750e2a1b24e4bc7aafa4cd36afebbbd P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:07.289801 6454 tablet_bootstrap.cc:492] T 0a5ce253bcce410b9517449f133d39e8 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:07.289958 6646 raft_consensus.cc:493] T a224ae69503e4ab588d6269086317f09 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:07.292342 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 343) took 1176 ms. Trace:
I20260923 19:50:07.293108 5802 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet f302f91c8ef44237b1c9909d88dacbff (table default.Table_b623e36133d64d72a070bb99a0b974ee [id=4300ad9818924415b6414ea9f89445ce]). Expected version 2 got 0
I20260923 19:50:07.293483 6461 rpcz_store.cc:276] 0923 19:50:06.115897 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:06.115968 (+ 71us) service_pool.cc:224] Handling call
0923 19:50:07.231863 (+1115895us) ts_tablet_manager.cc:1151] Deleting tablet b7f372b952804ac58e602998d9b77d72
0923 19:50:07.231875 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.259739 (+ 27864us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x616000240454. stack: 00007f5ff6e68366 00007f5ff6e68120 00007f5ff5e7234d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f6002f5ca70 00007f60042e5583 00007f6006eb28b7 00007f6006ee5a64 00007f6006ec63a0 00007f6006ec612d 0000000000aaef9c 00007f5ff6eae88f 00007f5ff6eb1b8b 00007f5ff6eb1a08
0923 19:50:07.269304 (+ 9565us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:07.272666 (+ 3362us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:07.292279 (+ 19613us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42644352,"tablet-delete.queue_time_us":1115677}
I20260923 19:50:07.293913 6461 tablet_replica.cc:333] T 5c0142f4e3ad42048803481d68f0ee5d P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:07.294040 6456 tablet_bootstrap.cc:492] T 9101e82501fd461f8a4b2dcd9dffbd74 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:07.294286 6456 ts_tablet_manager.cc:1403] T 9101e82501fd461f8a4b2dcd9dffbd74 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.072s user 0.002s sys 0.005s
I20260923 19:50:07.295218 6461 raft_consensus.cc:2243] T 5c0142f4e3ad42048803481d68f0ee5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:07.295194 6456 raft_consensus.cc:359] T 9101e82501fd461f8a4b2dcd9dffbd74 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.295499 6456 raft_consensus.cc:385] T 9101e82501fd461f8a4b2dcd9dffbd74 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:07.295634 6456 raft_consensus.cc:740] T 9101e82501fd461f8a4b2dcd9dffbd74 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:07.295986 6461 raft_consensus.cc:2272] T 5c0142f4e3ad42048803481d68f0ee5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:07.296098 6456 consensus_queue.cc:260] T 9101e82501fd461f8a4b2dcd9dffbd74 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.296825 6456 ts_tablet_manager.cc:1434] T 9101e82501fd461f8a4b2dcd9dffbd74 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:50:07.297021 6461 ts_tablet_manager.cc:1916] T 5c0142f4e3ad42048803481d68f0ee5d P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:07.297128 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet b7f372b952804ac58e602998d9b77d72 (table default.Table_7fca491d466748de94242c08e20984b6 [id=5e155553f7ae43eca827dbbafdd2bbe6]) successfully deleted
I20260923 19:50:07.297328 6456 tablet_bootstrap.cc:492] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:07.300546 6456 tablet_bootstrap.cc:654] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:07.300509 6957 tablet.cc:1751] T 115048f771764e41a3816e17a6c6cf94 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:07.307639 6646 raft_consensus.cc:515] T a224ae69503e4ab588d6269086317f09 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:07.307798 6280 consensus_peers.cc:597] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:07.308522 6646 leader_election.cc:290] T a224ae69503e4ab588d6269086317f09 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:07.309819 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a224ae69503e4ab588d6269086317f09" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:07.310184 6137 leader_election.cc:343] T a224ae69503e4ab588d6269086317f09 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: a224ae69503e4ab588d6269086317f09
I20260923 19:50:07.310190 6343 raft_consensus.cc:2468] T a224ae69503e4ab588d6269086317f09 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:07.310691 6454 ts_tablet_manager.cc:1403] T 0a5ce253bcce410b9517449f133d39e8 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.050s user 0.000s sys 0.004s
I20260923 19:50:07.310952 6139 leader_election.cc:304] T a224ae69503e4ab588d6269086317f09 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:07.315039 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 204) took 3948 ms. Trace:
I20260923 19:50:07.315802 6458 rpcz_store.cc:276] 0923 19:50:03.365996 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.366173 (+ 177us) service_pool.cc:224] Handling call
0923 19:50:06.738131 (+3371958us) ts_tablet_manager.cc:1151] Deleting tablet 6e726ee6a5494fd4b72c1ebef7d66b42
0923 19:50:06.738140 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.068273 (+330133us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:07.215393 (+147120us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:07.314637 (+ 99244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79091,"tablet-delete.queue_time_us":3344424}
I20260923 19:50:07.320657 6456 tablet_bootstrap.cc:492] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:07.320852 6456 ts_tablet_manager.cc:1403] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.000s
I20260923 19:50:07.321918 6456 raft_consensus.cc:359] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.322148 6456 raft_consensus.cc:385] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:07.322256 6456 raft_consensus.cc:740] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:07.322723 6456 consensus_queue.cc:260] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.323375 6456 ts_tablet_manager.cc:1434] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260923 19:50:07.323715 6456 tablet_bootstrap.cc:492] T b4fc995819cc40bf9956d85966bcd330 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:07.325856 6456 tablet_bootstrap.cc:654] T b4fc995819cc40bf9956d85966bcd330 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:07.328464 6957 tablet.cc:1751] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:07.331386 6914 raft_consensus.cc:493] T 6a34e178007b4e8ebed429cedf44e82a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:07.331527 6914 raft_consensus.cc:515] T 6a34e178007b4e8ebed429cedf44e82a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.332332 6914 leader_election.cc:290] T 6a34e178007b4e8ebed429cedf44e82a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:07.333096 6057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a34e178007b4e8ebed429cedf44e82a" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:07.333324 6057 raft_consensus.cc:2468] T 6a34e178007b4e8ebed429cedf44e82a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:07.333899 6279 leader_election.cc:304] T 6a34e178007b4e8ebed429cedf44e82a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:07.334164 6914 raft_consensus.cc:2804] T 6a34e178007b4e8ebed429cedf44e82a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:07.334280 6914 raft_consensus.cc:493] T 6a34e178007b4e8ebed429cedf44e82a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:07.334374 6914 raft_consensus.cc:3060] T 6a34e178007b4e8ebed429cedf44e82a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:07.338474 6914 raft_consensus.cc:515] T 6a34e178007b4e8ebed429cedf44e82a P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.339293 6928 raft_consensus.cc:493] T 623fb5b761134951a4b742ab2ba480a4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:07.339453 6928 raft_consensus.cc:515] T 623fb5b761134951a4b742ab2ba480a4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.339706 6914 leader_election.cc:290] T 6a34e178007b4e8ebed429cedf44e82a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:07.340155 6928 leader_election.cc:290] T 623fb5b761134951a4b742ab2ba480a4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:07.340405 6057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a34e178007b4e8ebed429cedf44e82a" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:07.340597 6057 raft_consensus.cc:3060] T 6a34e178007b4e8ebed429cedf44e82a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:07.341372 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623fb5b761134951a4b742ab2ba480a4" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:07.341938 5996 leader_election.cc:343] T 623fb5b761134951a4b742ab2ba480a4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:07.342218 6458 tablet_replica.cc:333] T 2f78261842744af08d86da64d37d708c P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:07.343160 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_4de2183ac1874f7eaf33c6ad5093c02d" } new_table_name: "default.Table_9bd23e83d2144f82a8487f44b70458fc" modify_external_catalogs: true
I20260923 19:50:07.187928 6459 ts_tablet_manager.cc:1950] T b2762648045b4378bcc2c1234460c352 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:07.344175 6057 raft_consensus.cc:2468] T 6a34e178007b4e8ebed429cedf44e82a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:07.345153 6458 raft_consensus.cc:2243] T 2f78261842744af08d86da64d37d708c P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:07.345475 6279 leader_election.cc:304] T 6a34e178007b4e8ebed429cedf44e82a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:07.345672 6461 ts_tablet_manager.cc:1929] T 5c0142f4e3ad42048803481d68f0ee5d P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:07.345845 6914 raft_consensus.cc:2804] T 6a34e178007b4e8ebed429cedf44e82a P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:07.346045 6914 raft_consensus.cc:697] T 6a34e178007b4e8ebed429cedf44e82a P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:07.346565 6461 log.cc:1199] T 5c0142f4e3ad42048803481d68f0ee5d P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/5c0142f4e3ad42048803481d68f0ee5d
I20260923 19:50:07.346583 6914 consensus_queue.cc:237] T 6a34e178007b4e8ebed429cedf44e82a P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.346930 6461 ts_tablet_manager.cc:1950] T 5c0142f4e3ad42048803481d68f0ee5d P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:07.348029 6458 raft_consensus.cc:2272] T 2f78261842744af08d86da64d37d708c P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:07.350749 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 356) took 1006 ms. Trace:
I20260923 19:50:07.350881 6461 rpcz_store.cc:276] 0923 19:50:06.344519 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:06.356232 (+ 11713us) service_pool.cc:224] Handling call
0923 19:50:07.293792 (+937560us) ts_tablet_manager.cc:1151] Deleting tablet 5c0142f4e3ad42048803481d68f0ee5d
0923 19:50:07.293801 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.314767 (+ 20966us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:07.345577 (+ 30810us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:07.350712 (+ 5135us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":936401}
I20260923 19:50:07.351253 6461 tablet_replica.cc:333] T 4b15b250f594459eb959b4871f7ae398 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:07.351408 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 5c0142f4e3ad42048803481d68f0ee5d (table default.Table_f57f5ddf52f541ab91b4a9638fcf81a0 [id=e0da333ed7f44d6aa283da81b1cfbf17]) successfully deleted
I20260923 19:50:07.351454 6461 raft_consensus.cc:2243] T 4b15b250f594459eb959b4871f7ae398 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:07.354348 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet b2762648045b4378bcc2c1234460c352 (table default.Table_f57f8cacbedb49c6be509b51c824b960 [id=ada5cc6ef65b4859bf027fd3af9ad0f2]) successfully deleted
W20260923 19:50:07.356619 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet b87872fb6cc0400c86eddffb29c898e8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b87872fb6cc0400c86eddffb29c898e8 already in progress: creating tablet
I20260923 19:50:07.356874 6461 raft_consensus.cc:2272] T 4b15b250f594459eb959b4871f7ae398 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:07.357825 6456 tablet_bootstrap.cc:492] T b4fc995819cc40bf9956d85966bcd330 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:07.358317 6456 ts_tablet_manager.cc:1403] T b4fc995819cc40bf9956d85966bcd330 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.035s user 0.000s sys 0.005s
I20260923 19:50:07.358780 6646 raft_consensus.cc:2804] T a224ae69503e4ab588d6269086317f09 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:07.359097 6456 raft_consensus.cc:359] T b4fc995819cc40bf9956d85966bcd330 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.359375 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623fb5b761134951a4b742ab2ba480a4" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:07.359954 5995 leader_election.cc:343] T 623fb5b761134951a4b742ab2ba480a4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:07.360067 6958 tablet.cc:1751] T b2762648045b4378bcc2c1234460c352 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:07.360131 5995 leader_election.cc:304] T 623fb5b761134951a4b742ab2ba480a4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:07.360742 6928 raft_consensus.cc:2749] T 623fb5b761134951a4b742ab2ba480a4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:07.361315 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a34e178007b4e8ebed429cedf44e82a" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:07.361578 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a34e178007b4e8ebed429cedf44e82a" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:07.362263 6646 raft_consensus.cc:493] T a224ae69503e4ab588d6269086317f09 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:07.362443 6461 ts_tablet_manager.cc:1916] T 4b15b250f594459eb959b4871f7ae398 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:07.370373 6646 raft_consensus.cc:3060] T a224ae69503e4ab588d6269086317f09 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:07.374878 6646 raft_consensus.cc:515] T a224ae69503e4ab588d6269086317f09 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.376137 6646 leader_election.cc:290] T a224ae69503e4ab588d6269086317f09 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:07.377334 6454 raft_consensus.cc:359] T 0a5ce253bcce410b9517449f133d39e8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.377554 6454 raft_consensus.cc:385] T 0a5ce253bcce410b9517449f133d39e8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:07.377646 6454 raft_consensus.cc:740] T 0a5ce253bcce410b9517449f133d39e8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:07.378084 6454 consensus_queue.cc:260] T 0a5ce253bcce410b9517449f133d39e8 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:07.378993 6137 leader_election.cc:343] T a224ae69503e4ab588d6269086317f09 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: a224ae69503e4ab588d6269086317f09
W20260923 19:50:07.362169 6280 leader_election.cc:343] T 6a34e178007b4e8ebed429cedf44e82a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:07.382164 6280 leader_election.cc:343] T 6a34e178007b4e8ebed429cedf44e82a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:07.383129 6914 consensus_queue.cc:1048] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:07.384878 6454 ts_tablet_manager.cc:1434] T 0a5ce253bcce410b9517449f133d39e8 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.074s user 0.002s sys 0.000s
I20260923 19:50:07.385617 6454 tablet_bootstrap.cc:492] T 7504a2be25b54ed4bc539eb10199fe15 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:07.377521 6458 ts_tablet_manager.cc:1916] T 2f78261842744af08d86da64d37d708c P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:07.390111 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a224ae69503e4ab588d6269086317f09" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:07.390209 6948 tablet.cc:1746] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd: Skipping requested alter to schema version 2, tablet already version 2
I20260923 19:50:07.390332 6343 raft_consensus.cc:3060] T a224ae69503e4ab588d6269086317f09 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
W20260923 19:50:07.391647 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet b985acc650334497832cf4505e1b0043 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b985acc650334497832cf4505e1b0043 already in progress: creating tablet
I20260923 19:50:07.392299 6454 tablet_bootstrap.cc:654] T 7504a2be25b54ed4bc539eb10199fe15 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:07.394706 6456 raft_consensus.cc:385] T b4fc995819cc40bf9956d85966bcd330 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:07.394790 6461 ts_tablet_manager.cc:1929] T 4b15b250f594459eb959b4871f7ae398 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:07.395082 6461 log.cc:1199] T 4b15b250f594459eb959b4871f7ae398 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/4b15b250f594459eb959b4871f7ae398
I20260923 19:50:07.398030 6461 ts_tablet_manager.cc:1950] T 4b15b250f594459eb959b4871f7ae398 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:07.399507 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 357) took 1037 ms. Trace:
I20260923 19:50:07.403039 6461 rpcz_store.cc:276] 0923 19:50:06.361618 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:06.363513 (+ 1895us) service_pool.cc:224] Handling call
0923 19:50:07.351184 (+987671us) ts_tablet_manager.cc:1151] Deleting tablet 4b15b250f594459eb959b4871f7ae398
0923 19:50:07.351193 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.369080 (+ 17887us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:07.394700 (+ 25620us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:07.398911 (+ 4211us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":987417}
I20260923 19:50:07.404565 6457 tablet_bootstrap.cc:492] T 495292cacf3b42a5b633ad40e5e01972 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:07.405098 6457 ts_tablet_manager.cc:1403] T 495292cacf3b42a5b633ad40e5e01972 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.211s user 0.009s sys 0.025s
I20260923 19:50:07.407091 6457 raft_consensus.cc:359] T 495292cacf3b42a5b633ad40e5e01972 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.407416 6457 raft_consensus.cc:385] T 495292cacf3b42a5b633ad40e5e01972 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:07.407575 6457 raft_consensus.cc:740] T 495292cacf3b42a5b633ad40e5e01972 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:07.407891 6457 consensus_queue.cc:260] T 495292cacf3b42a5b633ad40e5e01972 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.408526 6457 ts_tablet_manager.cc:1434] T 495292cacf3b42a5b633ad40e5e01972 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
W20260923 19:50:07.408854 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 0e123b69877e4b1fbcdb2b27960864e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e123b69877e4b1fbcdb2b27960864e9 already in progress: creating tablet
I20260923 19:50:07.409335 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 358) took 1046 ms. Trace:
I20260923 19:50:07.409336 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 4b15b250f594459eb959b4871f7ae398 (table default.Table_22f84157ac664f81ae5266143e743737 [id=4bf839f09513412ea20c5e0afece9c37]) successfully deleted
I20260923 19:50:07.409443 6461 rpcz_store.cc:276] 0923 19:50:06.363223 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:06.365110 (+ 1887us) service_pool.cc:224] Handling call
0923 19:50:07.409152 (+1044042us) ts_tablet_manager.cc:1151] Deleting tablet a10d35bf564d45488524d3d21721f4e5
0923 19:50:07.409162 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.409273 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1043779}
I20260923 19:50:07.409902 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 360) took 1007 ms. Trace:
W20260923 19:50:07.409981 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet a10d35bf564d45488524d3d21721f4e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a10d35bf564d45488524d3d21721f4e5 already in progress: creating tablet
I20260923 19:50:07.410007 6461 rpcz_store.cc:276] 0923 19:50:06.402518 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:06.402680 (+ 162us) service_pool.cc:224] Handling call
0923 19:50:07.409732 (+1007052us) ts_tablet_manager.cc:1151] Deleting tablet d8c8bfa9b7424b9f80f76e0bb05cbc0c
0923 19:50:07.409743 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.409827 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1006855}
I20260923 19:50:07.410395 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 359) took 1008 ms. Trace:
W20260923 19:50:07.410458 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet d8c8bfa9b7424b9f80f76e0bb05cbc0c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d8c8bfa9b7424b9f80f76e0bb05cbc0c already in progress: creating tablet
I20260923 19:50:07.410486 6461 rpcz_store.cc:276] 0923 19:50:06.402369 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:06.414179 (+ 11810us) service_pool.cc:224] Handling call
0923 19:50:07.410253 (+996074us) ts_tablet_manager.cc:1151] Deleting tablet 623052a8c9c2436a828655da6cf6d379
0923 19:50:07.410264 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.410340 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":993010}
I20260923 19:50:07.410866 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 361) took 1008 ms. Trace:
W20260923 19:50:07.410931 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 623052a8c9c2436a828655da6cf6d379 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 623052a8c9c2436a828655da6cf6d379 already in progress: creating tablet
I20260923 19:50:07.410959 6461 rpcz_store.cc:276] 0923 19:50:06.402637 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:06.417589 (+ 14952us) service_pool.cc:224] Handling call
0923 19:50:07.410702 (+993113us) ts_tablet_manager.cc:1151] Deleting tablet b9c187ee1fa8438397c83bc2c2b16925
0923 19:50:07.410713 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.410812 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":992463}
I20260923 19:50:07.412264 6454 tablet_bootstrap.cc:492] T 7504a2be25b54ed4bc539eb10199fe15 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:07.412467 6454 ts_tablet_manager.cc:1403] T 7504a2be25b54ed4bc539eb10199fe15 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.001s
I20260923 19:50:07.413389 6456 raft_consensus.cc:740] T b4fc995819cc40bf9956d85966bcd330 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:07.413421 6454 raft_consensus.cc:359] T 7504a2be25b54ed4bc539eb10199fe15 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.413678 6454 raft_consensus.cc:385] T 7504a2be25b54ed4bc539eb10199fe15 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:07.413810 6454 raft_consensus.cc:740] T 7504a2be25b54ed4bc539eb10199fe15 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:07.414117 6454 consensus_queue.cc:260] T 7504a2be25b54ed4bc539eb10199fe15 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.414894 6454 ts_tablet_manager.cc:1434] T 7504a2be25b54ed4bc539eb10199fe15 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260923 19:50:07.415288 6454 tablet_bootstrap.cc:492] T 5455beff354a4616a68d8746e3e4f9a8 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:07.416916 6814 consensus_queue.cc:1048] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260923 19:50:07.417840 6454 tablet_bootstrap.cc:654] T 5455beff354a4616a68d8746e3e4f9a8 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:07.418535 6343 raft_consensus.cc:2468] T a224ae69503e4ab588d6269086317f09 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:07.419047 6139 leader_election.cc:304] T a224ae69503e4ab588d6269086317f09 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:07.419544 6920 raft_consensus.cc:2804] T a224ae69503e4ab588d6269086317f09 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:07.419760 6920 raft_consensus.cc:697] T a224ae69503e4ab588d6269086317f09 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:07.420077 6920 consensus_queue.cc:237] T a224ae69503e4ab588d6269086317f09 P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.418493 6773 raft_consensus.cc:493] T 42e9cbcf77324d91abd029c12eaf950d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:07.421438 6773 raft_consensus.cc:515] T 42e9cbcf77324d91abd029c12eaf950d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.422201 6773 leader_election.cc:290] T 42e9cbcf77324d91abd029c12eaf950d P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:07.422783 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9cbcf77324d91abd029c12eaf950d" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:07.422955 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9cbcf77324d91abd029c12eaf950d" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:07.423401 5995 leader_election.cc:343] T 42e9cbcf77324d91abd029c12eaf950d P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:07.423712 5996 leader_election.cc:343] T 42e9cbcf77324d91abd029c12eaf950d P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:07.423846 5996 leader_election.cc:304] T 42e9cbcf77324d91abd029c12eaf950d P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
W20260923 19:50:07.423905 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet b9c187ee1fa8438397c83bc2c2b16925 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9c187ee1fa8438397c83bc2c2b16925 already in progress: creating tablet
I20260923 19:50:07.424170 6773 raft_consensus.cc:2749] T 42e9cbcf77324d91abd029c12eaf950d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:07.426090 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet a926ff092e6e495e981be156421e8d72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a926ff092e6e495e981be156421e8d72 already in progress: creating tablet
I20260923 19:50:07.426631 6457 tablet_bootstrap.cc:492] T ec4284d6a0fa416ca95b4d675c8e3912 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:07.426734 6461 tablet_replica.cc:333] T 9101e82501fd461f8a4b2dcd9dffbd74 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:07.426944 6461 raft_consensus.cc:2243] T 9101e82501fd461f8a4b2dcd9dffbd74 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:07.427947 6461 raft_consensus.cc:2272] T 9101e82501fd461f8a4b2dcd9dffbd74 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:07.428004 6456 consensus_queue.cc:260] T b4fc995819cc40bf9956d85966bcd330 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.427574 6958 tablet.cc:1751] T 115048f771764e41a3816e17a6c6cf94 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:07.428555 6457 tablet_bootstrap.cc:654] T ec4284d6a0fa416ca95b4d675c8e3912 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:07.429188 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_449bda0ddfc44496b4af2e8287b56bb5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:07.429574 6461 ts_tablet_manager.cc:1916] T 9101e82501fd461f8a4b2dcd9dffbd74 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:07.429831 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_449bda0ddfc44496b4af2e8287b56bb5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:07.436779 6963 tablet.cc:1746] T b2762648045b4378bcc2c1234460c352 P e546f660e7e541d1aa9ae38e5ee5b9c0: Skipping requested alter to schema version 2, tablet already version 2
W20260923 19:50:07.438766 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 58c24aa494bc4da28536dfa1df6123b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58c24aa494bc4da28536dfa1df6123b7 already in progress: creating tablet
I20260923 19:50:07.438898 6456 ts_tablet_manager.cc:1434] T b4fc995819cc40bf9956d85966bcd330 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.080s user 0.002s sys 0.000s
I20260923 19:50:07.442878 6456 tablet_bootstrap.cc:492] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:07.443658 6773 raft_consensus.cc:493] T ec4cc8a742114e5fb07c5c9157ce09e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:07.443893 6773 raft_consensus.cc:515] T ec4cc8a742114e5fb07c5c9157ce09e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:07.444396 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 15a9d1d4adaa402f90d774e77010c928 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15a9d1d4adaa402f90d774e77010c928 already in progress: creating tablet
I20260923 19:50:07.444612 6773 leader_election.cc:290] T ec4cc8a742114e5fb07c5c9157ce09e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:07.447310 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4cc8a742114e5fb07c5c9157ce09e8" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:07.448491 5995 leader_election.cc:343] T ec4cc8a742114e5fb07c5c9157ce09e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:07.449142 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 9be4c46ee8eb4dbaad01d492b701a9e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9be4c46ee8eb4dbaad01d492b701a9e0 already in progress: creating tablet
I20260923 19:50:07.450126 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4cc8a742114e5fb07c5c9157ce09e8" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:07.450603 5996 leader_election.cc:343] T ec4cc8a742114e5fb07c5c9157ce09e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:07.450775 5996 leader_election.cc:304] T ec4cc8a742114e5fb07c5c9157ce09e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:07.451176 6928 raft_consensus.cc:2749] T ec4cc8a742114e5fb07c5c9157ce09e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:07.452684 6456 tablet_bootstrap.cc:654] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:07.454120 6459 tablet_replica.cc:333] T 3190d18f00234d71b0a58c2c334ef45f P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:07.454430 6459 raft_consensus.cc:2243] T 3190d18f00234d71b0a58c2c334ef45f P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:07.454795 6459 pending_rounds.cc:70] T 3190d18f00234d71b0a58c2c334ef45f P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:07.454953 6459 pending_rounds.cc:77] T 3190d18f00234d71b0a58c2c334ef45f P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630557743230976 op_type: NO_OP noop_request { }
I20260923 19:50:07.456724 6459 raft_consensus.cc:2889] T 3190d18f00234d71b0a58c2c334ef45f P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:07.456967 6459 raft_consensus.cc:2272] T 3190d18f00234d71b0a58c2c334ef45f P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:07.457944 6926 tablet.cc:1751] T f302f91c8ef44237b1c9909d88dacbff P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:07.458298 6948 tablet.cc:1751] T f302f91c8ef44237b1c9909d88dacbff P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:07.462993 6458 ts_tablet_manager.cc:1929] T 2f78261842744af08d86da64d37d708c P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260923 19:50:07.463110 6459 ts_tablet_manager.cc:1916] T 3190d18f00234d71b0a58c2c334ef45f P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:07.463155 6458 log.cc:1199] T 2f78261842744af08d86da64d37d708c P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/2f78261842744af08d86da64d37d708c
I20260923 19:50:07.463798 6458 ts_tablet_manager.cc:1950] T 2f78261842744af08d86da64d37d708c P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
W20260923 19:50:07.471669 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 34d62ab3d4aa457f8fea283cd9248a41 consensus state has no leader
I20260923 19:50:07.472024 5801 master_service.cc:960] ReplaceTablet: received request to replace tablet 18bab39d85f94f4283f0b18c1c9b48a2 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:07.457823 6454 tablet_bootstrap.cc:492] T 5455beff354a4616a68d8746e3e4f9a8 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:07.476675 6454 ts_tablet_manager.cc:1403] T 5455beff354a4616a68d8746e3e4f9a8 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.061s user 0.003s sys 0.001s
I20260923 19:50:07.481272 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 202) took 4122 ms. Trace:
I20260923 19:50:07.482039 6454 raft_consensus.cc:359] T 5455beff354a4616a68d8746e3e4f9a8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.482367 6454 raft_consensus.cc:385] T 5455beff354a4616a68d8746e3e4f9a8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:07.481423 6458 rpcz_store.cc:276] 0923 19:50:03.358579 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.363090 (+ 4511us) service_pool.cc:224] Handling call
0923 19:50:07.321360 (+3958270us) ts_tablet_manager.cc:1151] Deleting tablet 2f78261842744af08d86da64d37d708c
0923 19:50:07.321372 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.438037 (+116665us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:07.462894 (+ 24857us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:07.481217 (+ 18323us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3926136}
I20260923 19:50:07.485251 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 2f78261842744af08d86da64d37d708c (table default.Table_a5d9d7b0e0b449ae8791e459b7d88f18 [id=7e9508e469b14579a0c697ac4ca5cc4a]) successfully deleted
I20260923 19:50:07.487303 6967 tablet.cc:1751] T f302f91c8ef44237b1c9909d88dacbff P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:07.491081 6457 tablet_bootstrap.cc:492] T ec4284d6a0fa416ca95b4d675c8e3912 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:07.491268 6457 ts_tablet_manager.cc:1403] T ec4284d6a0fa416ca95b4d675c8e3912 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.065s user 0.006s sys 0.001s
I20260923 19:50:07.492013 6457 raft_consensus.cc:359] T ec4284d6a0fa416ca95b4d675c8e3912 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.492234 6457 raft_consensus.cc:385] T ec4284d6a0fa416ca95b4d675c8e3912 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:07.492317 6457 raft_consensus.cc:740] T ec4284d6a0fa416ca95b4d675c8e3912 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:07.492609 6457 consensus_queue.cc:260] T ec4284d6a0fa416ca95b4d675c8e3912 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:07.494827 5800 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9c4a200d16464676976694656cbe28e2 consensus state has no leader
I20260923 19:50:07.496932 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_d95a477b9f434e00bd0d307b9a42ea22"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:07.497536 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d95a477b9f434e00bd0d307b9a42ea22 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:07.498317 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_1f297daf5bc14178ad44933d06931e1f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:07.499161 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f297daf5bc14178ad44933d06931e1f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:07.499892 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 206) took 4113 ms. Trace:
I20260923 19:50:07.500038 6458 rpcz_store.cc:276] 0923 19:50:03.386671 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.386956 (+ 285us) service_pool.cc:224] Handling call
0923 19:50:07.499722 (+4112766us) ts_tablet_manager.cc:1151] Deleting tablet 6a2564a99c274e07a7e43da739a2458b
0923 19:50:07.499735 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.499854 (+ 119us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4098649}
I20260923 19:50:07.500438 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 208) took 3984 ms. Trace:
I20260923 19:50:07.500530 6458 rpcz_store.cc:276] 0923 19:50:03.516035 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.519363 (+ 3328us) service_pool.cc:224] Handling call
0923 19:50:07.500322 (+3980959us) ts_tablet_manager.cc:1151] Deleting tablet 42e9cbcf77324d91abd029c12eaf950d
0923 19:50:07.500330 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.500412 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3980611}
I20260923 19:50:07.500833 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 209) took 3980 ms. Trace:
I20260923 19:50:07.500944 6458 rpcz_store.cc:276] 0923 19:50:03.520305 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.522488 (+ 2183us) service_pool.cc:224] Handling call
0923 19:50:07.500713 (+3978225us) ts_tablet_manager.cc:1151] Deleting tablet 359b08ef348d4be68b14f9e871a5e519
0923 19:50:07.500720 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.500802 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3977712}
I20260923 19:50:07.501242 6458 tablet_replica.cc:333] T a224ae69503e4ab588d6269086317f09 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:07.501436 6458 raft_consensus.cc:2243] T a224ae69503e4ab588d6269086317f09 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:07.501590 6458 raft_consensus.cc:2272] T a224ae69503e4ab588d6269086317f09 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:07.502151 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 6a2564a99c274e07a7e43da739a2458b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6a2564a99c274e07a7e43da739a2458b already in progress: creating tablet
W20260923 19:50:07.502408 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 42e9cbcf77324d91abd029c12eaf950d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 42e9cbcf77324d91abd029c12eaf950d already in progress: creating tablet
W20260923 19:50:07.502671 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 359b08ef348d4be68b14f9e871a5e519 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 359b08ef348d4be68b14f9e871a5e519 already in progress: creating tablet
W20260923 19:50:07.503589 5797 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6ac04be575704a69994f98e00411a254 consensus state has no leader
I20260923 19:50:07.503857 5797 master_service.cc:960] ReplaceTablet: received request to replace tablet 474e34e902064764864ba06ef41b1d94 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:07.505491 6457 ts_tablet_manager.cc:1434] T ec4284d6a0fa416ca95b4d675c8e3912 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260923 19:50:07.505851 6457 tablet_bootstrap.cc:492] T 86473c5cbca54b5792b038aef445998c P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:07.513139 6458 ts_tablet_manager.cc:1916] T a224ae69503e4ab588d6269086317f09 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:07.514801 6456 tablet_bootstrap.cc:492] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:07.515036 6456 ts_tablet_manager.cc:1403] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.072s user 0.004s sys 0.002s
I20260923 19:50:07.515895 6456 raft_consensus.cc:359] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.516183 6456 raft_consensus.cc:385] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:07.516311 6456 raft_consensus.cc:740] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:07.516638 6456 consensus_queue.cc:260] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.523552 6456 ts_tablet_manager.cc:1434] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260923 19:50:07.533543 6456 tablet_bootstrap.cc:492] T 42e9cbcf77324d91abd029c12eaf950d P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:07.511679 6646 raft_consensus.cc:493] T 033c2d772c8a44d2a0e671664bb9085d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:07.515151 6920 raft_consensus.cc:493] T 7504a2be25b54ed4bc539eb10199fe15 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:07.534381 6646 raft_consensus.cc:515] T 033c2d772c8a44d2a0e671664bb9085d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.534461 6920 raft_consensus.cc:515] T 7504a2be25b54ed4bc539eb10199fe15 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.535137 6646 leader_election.cc:290] T 033c2d772c8a44d2a0e671664bb9085d P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:07.501168 6459 ts_tablet_manager.cc:1929] T 3190d18f00234d71b0a58c2c334ef45f P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:07.535676 6459 log.cc:1199] T 3190d18f00234d71b0a58c2c334ef45f P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/3190d18f00234d71b0a58c2c334ef45f
I20260923 19:50:07.536170 6459 ts_tablet_manager.cc:1950] T 3190d18f00234d71b0a58c2c334ef45f P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
W20260923 19:50:07.536711 6139 leader_election.cc:343] T 7504a2be25b54ed4bc539eb10199fe15 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 7504a2be25b54ed4bc539eb10199fe15
I20260923 19:50:07.536382 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033c2d772c8a44d2a0e671664bb9085d" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:07.535569 6456 tablet_bootstrap.cc:654] T 42e9cbcf77324d91abd029c12eaf950d P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:07.537173 6344 raft_consensus.cc:2468] T 033c2d772c8a44d2a0e671664bb9085d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:07.537355 5799 master_service.cc:960] ReplaceTablet: received request to replace tablet d09faa67bdc54d31a7f7a1b012de9ba1 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:07.537622 6139 leader_election.cc:304] T 033c2d772c8a44d2a0e671664bb9085d P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:07.538029 6646 raft_consensus.cc:2804] T 033c2d772c8a44d2a0e671664bb9085d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:07.538143 6646 raft_consensus.cc:493] T 033c2d772c8a44d2a0e671664bb9085d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:07.538264 6646 raft_consensus.cc:3060] T 033c2d772c8a44d2a0e671664bb9085d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:07.538264 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 3190d18f00234d71b0a58c2c334ef45f (table default.Table_adfa6338ea024e4a87e614cbc086cbc3 [id=eedb3f35db9640d992be8887c071962f]) successfully deleted
W20260923 19:50:07.539834 6137 leader_election.cc:343] T 033c2d772c8a44d2a0e671664bb9085d P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 033c2d772c8a44d2a0e671664bb9085d
W20260923 19:50:07.540634 6137 leader_election.cc:343] T 7504a2be25b54ed4bc539eb10199fe15 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 7504a2be25b54ed4bc539eb10199fe15
I20260923 19:50:07.537626 6459 tablet_replica.cc:333] T 640a98d3a845461e8d4f07041ab515c7 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:07.541185 6459 raft_consensus.cc:2243] T 640a98d3a845461e8d4f07041ab515c7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:07.541474 6459 raft_consensus.cc:2272] T 640a98d3a845461e8d4f07041ab515c7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:07.540771 6137 leader_election.cc:304] T 7504a2be25b54ed4bc539eb10199fe15 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:07.542299 6912 raft_consensus.cc:2749] T 7504a2be25b54ed4bc539eb10199fe15 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:07.542605 6459 ts_tablet_manager.cc:1916] T 640a98d3a845461e8d4f07041ab515c7 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:07.544026 6457 tablet_bootstrap.cc:654] T 86473c5cbca54b5792b038aef445998c P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:07.482538 6454 raft_consensus.cc:740] T 5455beff354a4616a68d8746e3e4f9a8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:07.545003 6454 consensus_queue.cc:260] T 5455beff354a4616a68d8746e3e4f9a8 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.536906 6920 leader_election.cc:290] T 7504a2be25b54ed4bc539eb10199fe15 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:07.545094 6646 raft_consensus.cc:515] T 033c2d772c8a44d2a0e671664bb9085d P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:07.548722 6137 leader_election.cc:343] T 033c2d772c8a44d2a0e671664bb9085d P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 033c2d772c8a44d2a0e671664bb9085d
I20260923 19:50:07.549121 6646 leader_election.cc:290] T 033c2d772c8a44d2a0e671664bb9085d P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:07.550280 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "033c2d772c8a44d2a0e671664bb9085d" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:07.550498 6344 raft_consensus.cc:3060] T 033c2d772c8a44d2a0e671664bb9085d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:07.551795 6458 ts_tablet_manager.cc:1929] T a224ae69503e4ab588d6269086317f09 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:07.551947 6458 log.cc:1199] T a224ae69503e4ab588d6269086317f09 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/a224ae69503e4ab588d6269086317f09
I20260923 19:50:07.552379 6458 ts_tablet_manager.cc:1950] T a224ae69503e4ab588d6269086317f09 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:07.554473 6459 ts_tablet_manager.cc:1929] T 640a98d3a845461e8d4f07041ab515c7 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:07.553867 6344 raft_consensus.cc:2468] T 033c2d772c8a44d2a0e671664bb9085d P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
W20260923 19:50:07.556846 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b92aaac328934d95a89e0fc08a80b0b1 consensus state has no leader
I20260923 19:50:07.561023 6459 log.cc:1199] T 640a98d3a845461e8d4f07041ab515c7 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/640a98d3a845461e8d4f07041ab515c7
I20260923 19:50:07.561488 6459 ts_tablet_manager.cc:1950] T 640a98d3a845461e8d4f07041ab515c7 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:07.562227 6316 tablet_service.cc:1511] Processing CreateTablet for tablet a6da9b3eea4547c9bb80b08bd26c5dc2 (DEFAULT_TABLE table=default.Table_2a3fec3aaca84ecbac231d0c5d5be419 [id=8996d40848d44ed09261ee25d61bb906]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.562670 6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6da9b3eea4547c9bb80b08bd26c5dc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.562726 6459 tablet_replica.cc:333] T a224ae69503e4ab588d6269086317f09 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:07.562942 6459 raft_consensus.cc:2243] T a224ae69503e4ab588d6269086317f09 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:07.562914 6032 tablet_service.cc:1511] Processing CreateTablet for tablet a6da9b3eea4547c9bb80b08bd26c5dc2 (DEFAULT_TABLE table=default.Table_2a3fec3aaca84ecbac231d0c5d5be419 [id=8996d40848d44ed09261ee25d61bb906]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.563179 6459 pending_rounds.cc:70] T a224ae69503e4ab588d6269086317f09 P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:07.563256 6459 pending_rounds.cc:77] T a224ae69503e4ab588d6269086317f09 P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630558395195392 op_type: NO_OP noop_request { }
I20260923 19:50:07.563334 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6da9b3eea4547c9bb80b08bd26c5dc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.563359 6459 raft_consensus.cc:2889] T a224ae69503e4ab588d6269086317f09 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:07.563480 6459 raft_consensus.cc:2272] T a224ae69503e4ab588d6269086317f09 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:07.566174 5805 catalog_manager.cc:5838] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:07.566860 5805 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 0a5ce253bcce410b9517449f133d39e8 (table default.Table_84d13e1ea6234e5ca45738376e83f537 [id=0d4f6a5bb30c4d2a937424cf0e651afd]). Expected version 1 got 0
I20260923 19:50:07.567588 6026 tablet_service.cc:1511] Processing CreateTablet for tablet 30fe07956e8940fcb7ba1e2e16ced463 (DEFAULT_TABLE table=default.Table_b0aaf57c3ec9414f89529017165bc65b [id=84b65375453448aebd9bce135f58bd90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.568178 6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30fe07956e8940fcb7ba1e2e16ced463. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.570830 6321 tablet_service.cc:1511] Processing CreateTablet for tablet 30fe07956e8940fcb7ba1e2e16ced463 (DEFAULT_TABLE table=default.Table_b0aaf57c3ec9414f89529017165bc65b [id=84b65375453448aebd9bce135f58bd90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.571381 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30fe07956e8940fcb7ba1e2e16ced463. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.573165 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 210) took 4039 ms. Trace:
I20260923 19:50:07.573318 6458 rpcz_store.cc:276] 0923 19:50:03.534135 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.534183 (+ 48us) service_pool.cc:224] Handling call
0923 19:50:07.501191 (+3967008us) ts_tablet_manager.cc:1151] Deleting tablet a224ae69503e4ab588d6269086317f09
0923 19:50:07.501198 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.520038 (+ 18840us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:07.551712 (+ 31674us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:07.573061 (+ 21349us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3966786}
I20260923 19:50:07.574074 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_5fddffc3232840a1897043b514d0e68b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:07.574774 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5fddffc3232840a1897043b514d0e68b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:07.574882 5802 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet f302f91c8ef44237b1c9909d88dacbff (table default.Table_b623e36133d64d72a070bb99a0b974ee [id=4300ad9818924415b6414ea9f89445ce]). Expected version 2 got 0
I20260923 19:50:07.575160 5802 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet d91a56bace854494b7affd6c766b2847 (table default.Table_b3579cbf488c4d1eb5f605ab4e11c340 [id=a6dbcc9c44fb400b926e21aa6d683186]). Expected version 2 got 0
I20260923 19:50:07.576546 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet a224ae69503e4ab588d6269086317f09 (table default.Table_74b3ada03dc14044b09a369b0e3782c7 [id=6c09f84a1d19402b8b59bbc60ae92bcb]) successfully deleted
I20260923 19:50:07.576773 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b79ffd6b55d94f789da88e84cb293bb5" } modify_external_catalogs: true
I20260923 19:50:07.576995 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b79ffd6b55d94f789da88e84cb293bb5" } modify_external_catalogs: true
I20260923 19:50:07.578439 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 214) took 3942 ms. Trace:
I20260923 19:50:07.578598 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet b7f372b952804ac58e602998d9b77d72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:07.578564 6458 rpcz_store.cc:276] 0923 19:50:03.635491 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.638619 (+ 3128us) service_pool.cc:224] Handling call
0923 19:50:07.578220 (+3939601us) ts_tablet_manager.cc:1151] Deleting tablet 6e781ccf4aa343fc924138c3cc2b04e6
0923 19:50:07.578234 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.578365 (+ 131us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3924512}
I20260923 19:50:07.578696 6459 ts_tablet_manager.cc:1916] T a224ae69503e4ab588d6269086317f09 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:07.579193 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 6e781ccf4aa343fc924138c3cc2b04e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6e781ccf4aa343fc924138c3cc2b04e6 already in progress: creating tablet
I20260923 19:50:07.579353 6139 leader_election.cc:304] T 033c2d772c8a44d2a0e671664bb9085d P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:07.579434 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 640a98d3a845461e8d4f07041ab515c7 (table default.Table_655e0d86bc12407f9287ace4b3e76c29 [id=5bc43061f37b4defac5a530a1f174684]) successfully deleted
W20260923 19:50:07.579749 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 86473c5cbca54b5792b038aef445998c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 86473c5cbca54b5792b038aef445998c already in progress: creating tablet
I20260923 19:50:07.579779 6646 raft_consensus.cc:493] T 0a5ce253bcce410b9517449f133d39e8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:07.579939 6646 raft_consensus.cc:515] T 0a5ce253bcce410b9517449f133d39e8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.580644 6646 leader_election.cc:290] T 0a5ce253bcce410b9517449f133d39e8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:07.580827 6646 raft_consensus.cc:2804] T 033c2d772c8a44d2a0e671664bb9085d P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:07.580981 6646 raft_consensus.cc:697] T 033c2d772c8a44d2a0e671664bb9085d P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:07.581020 6164 tablet_service.cc:1511] Processing CreateTablet for tablet a6da9b3eea4547c9bb80b08bd26c5dc2 (DEFAULT_TABLE table=default.Table_2a3fec3aaca84ecbac231d0c5d5be419 [id=8996d40848d44ed09261ee25d61bb906]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.581280 6646 consensus_queue.cc:237] T 033c2d772c8a44d2a0e671664bb9085d P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.581681 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 30fe07956e8940fcb7ba1e2e16ced463 (DEFAULT_TABLE table=default.Table_b0aaf57c3ec9414f89529017165bc65b [id=84b65375453448aebd9bce135f58bd90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.582235 6168 tablet_service.cc:1511] Processing CreateTablet for tablet 373d6442546d41e2b5567dfc92ae07b1 (DEFAULT_TABLE table=default.Table_1916c5305d984163ac72fcf98ce30e62 [id=666f42c33b8943a6a0362c47d38aa2b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.582984 6058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5ce253bcce410b9517449f133d39e8" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:07.583202 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 216) took 3919 ms. Trace:
I20260923 19:50:07.583287 6058 raft_consensus.cc:2393] T 0a5ce253bcce410b9517449f133d39e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61022dd7f2f14dc19aebe3af5f08f430 in current term 1: Already voted for candidate 2bf41435f70447f19992d368ca6b46bd in this term.
I20260923 19:50:07.583316 6458 rpcz_store.cc:276] 0923 19:50:03.663325 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.663380 (+ 55us) service_pool.cc:224] Handling call
0923 19:50:07.582967 (+3919587us) ts_tablet_manager.cc:1151] Deleting tablet c0ff8838ab17433ab733d3b293d4964f
0923 19:50:07.582980 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.583132 (+ 152us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3919347}
W20260923 19:50:07.583833 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet c0ff8838ab17433ab733d3b293d4964f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c0ff8838ab17433ab733d3b293d4964f already in progress: creating tablet
I20260923 19:50:07.584295 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 223) took 3618 ms. Trace:
I20260923 19:50:07.584455 6458 rpcz_store.cc:276] 0923 19:50:03.966309 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:03.968217 (+ 1908us) service_pool.cc:224] Handling call
0923 19:50:07.584108 (+3615891us) ts_tablet_manager.cc:1151] Deleting tablet f4e3e64fdf584743a3a88df5d6600b22
0923 19:50:07.584131 (+ 23us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.584238 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3615530}
I20260923 19:50:07.587883 5796 master_service.cc:960] ReplaceTablet: received request to replace tablet 58ea466d1b2b40e9b9b4cd5be51f79e0 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:07.588842 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6da9b3eea4547c9bb80b08bd26c5dc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.589520 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 373d6442546d41e2b5567dfc92ae07b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.589717 6454 ts_tablet_manager.cc:1434] T 5455beff354a4616a68d8746e3e4f9a8 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.113s user 0.001s sys 0.001s
I20260923 19:50:07.589733 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a5ce253bcce410b9517449f133d39e8" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:07.590054 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30fe07956e8940fcb7ba1e2e16ced463. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.590147 6454 tablet_bootstrap.cc:492] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:07.590384 6139 leader_election.cc:304] T 0a5ce253bcce410b9517449f133d39e8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:07.590848 6920 raft_consensus.cc:3060] T 0a5ce253bcce410b9517449f133d39e8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:07.592103 6454 tablet_bootstrap.cc:654] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:07.594962 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet f4e3e64fdf584743a3a88df5d6600b22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4e3e64fdf584743a3a88df5d6600b22 already in progress: creating tablet
I20260923 19:50:07.595919 6323 tablet_service.cc:1511] Processing CreateTablet for tablet 373d6442546d41e2b5567dfc92ae07b1 (DEFAULT_TABLE table=default.Table_1916c5305d984163ac72fcf98ce30e62 [id=666f42c33b8943a6a0362c47d38aa2b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.596359 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 373d6442546d41e2b5567dfc92ae07b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.596402 6320 tablet_service.cc:1511] Processing CreateTablet for tablet 0f90406b20f54787bd27255d5ae81d1c (DEFAULT_TABLE table=default.Table_9f1adbf7034440cd8ec248d18c62ba63 [id=cec162ada3144aaba98196d363cf587d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.596702 6320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f90406b20f54787bd27255d5ae81d1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.597307 6461 ts_tablet_manager.cc:1929] T 9101e82501fd461f8a4b2dcd9dffbd74 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:07.597436 6461 log.cc:1199] T 9101e82501fd461f8a4b2dcd9dffbd74 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/9101e82501fd461f8a4b2dcd9dffbd74
I20260923 19:50:07.600456 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 7f47efa0cabd47aa8ed0deface7763ab (DEFAULT_TABLE table=default.Table_f57f8cacbedb49c6be509b51c824b960 [id=ada5cc6ef65b4859bf027fd3af9ad0f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.600577 6319 tablet_service.cc:1511] Processing CreateTablet for tablet 559f3e3016aa470f9732a727b4528586 (DEFAULT_TABLE table=default.Table_d7d1452530dc40018f8d5568a97f273b [id=7ceb51c74b464ca4a1c59cdac4d65f2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.600893 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f47efa0cabd47aa8ed0deface7763ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.602016 6319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 559f3e3016aa470f9732a727b4528586. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.598905 6457 tablet_bootstrap.cc:492] T 86473c5cbca54b5792b038aef445998c P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:07.606297 6457 ts_tablet_manager.cc:1403] T 86473c5cbca54b5792b038aef445998c P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.101s user 0.002s sys 0.002s
I20260923 19:50:07.607188 6457 raft_consensus.cc:359] T 86473c5cbca54b5792b038aef445998c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.607401 6457 raft_consensus.cc:385] T 86473c5cbca54b5792b038aef445998c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:07.607487 6457 raft_consensus.cc:740] T 86473c5cbca54b5792b038aef445998c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:07.607741 6457 consensus_queue.cc:260] T 86473c5cbca54b5792b038aef445998c P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.609433 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 7f47efa0cabd47aa8ed0deface7763ab (DEFAULT_TABLE table=default.Table_f57f8cacbedb49c6be509b51c824b960 [id=ada5cc6ef65b4859bf027fd3af9ad0f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.609870 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f47efa0cabd47aa8ed0deface7763ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.612166 6457 ts_tablet_manager.cc:1434] T 86473c5cbca54b5792b038aef445998c P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260923 19:50:07.597851 6461 ts_tablet_manager.cc:1950] T 9101e82501fd461f8a4b2dcd9dffbd74 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:07.615468 6457 tablet_bootstrap.cc:492] T 5427b0f0218d4131b68a39e8e3bf02e7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:07.615868 6031 tablet_service.cc:1511] Processing CreateTablet for tablet 559f3e3016aa470f9732a727b4528586 (DEFAULT_TABLE table=default.Table_d7d1452530dc40018f8d5568a97f273b [id=7ceb51c74b464ca4a1c59cdac4d65f2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.616297 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 559f3e3016aa470f9732a727b4528586. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.617465 6032 tablet_service.cc:1511] Processing CreateTablet for tablet 373d6442546d41e2b5567dfc92ae07b1 (DEFAULT_TABLE table=default.Table_1916c5305d984163ac72fcf98ce30e62 [id=666f42c33b8943a6a0362c47d38aa2b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.618217 6026 tablet_service.cc:1511] Processing CreateTablet for tablet 0f90406b20f54787bd27255d5ae81d1c (DEFAULT_TABLE table=default.Table_9f1adbf7034440cd8ec248d18c62ba63 [id=cec162ada3144aaba98196d363cf587d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.620790 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 373d6442546d41e2b5567dfc92ae07b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.621330 6457 tablet_bootstrap.cc:654] T 5427b0f0218d4131b68a39e8e3bf02e7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:07.622385 6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f90406b20f54787bd27255d5ae81d1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.623673 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 228) took 3553 ms. Trace:
I20260923 19:50:07.623842 6458 rpcz_store.cc:276] 0923 19:50:04.069852 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:04.069927 (+ 75us) service_pool.cc:224] Handling call
0923 19:50:07.595733 (+3525806us) ts_tablet_manager.cc:1151] Deleting tablet 6238d16b1be74dd88fd2e089fbd85d33
0923 19:50:07.595744 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.623605 (+ 27861us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3525540}
I20260923 19:50:07.624158 6308 tablet_service.cc:1511] Processing CreateTablet for tablet 772ece5283a949408d849f6e56f5f17b (DEFAULT_TABLE table=default.Table_81d47fdf0e514f1eba3c801278533173 [id=909921effa834834ae8eed17dfd21976]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.624383 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 227) took 3554 ms. Trace:
I20260923 19:50:07.624557 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 772ece5283a949408d849f6e56f5f17b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.624478 6458 rpcz_store.cc:276] 0923 19:50:04.069731 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:04.070535 (+ 804us) service_pool.cc:224] Handling call
0923 19:50:07.624229 (+3553694us) ts_tablet_manager.cc:1151] Deleting tablet 5e711e48156b46b5a517b330d6d41309
0923 19:50:07.624243 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.624329 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3553470}
I20260923 19:50:07.624809 6458 tablet_replica.cc:333] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:07.625020 6458 raft_consensus.cc:2243] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:07.625365 6458 pending_rounds.cc:70] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd: Trying to abort 1 pending ops.
I20260923 19:50:07.625438 6458 pending_rounds.cc:77] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630552495108096 op_type: NO_OP noop_request { }
I20260923 19:50:07.625588 6458 raft_consensus.cc:2889] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:07.625694 6458 raft_consensus.cc:2272] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:07.626041 6309 tablet_service.cc:1511] Processing CreateTablet for tablet 37769256de33432697e9d4fb235f473f (DEFAULT_TABLE table=default.Table_59a69335b281437498cea78a9cb3fadb [id=ac71e26491774bcd93d004a319b086c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.626384 6309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37769256de33432697e9d4fb235f473f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.626358 6458 ts_tablet_manager.cc:1916] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:07.627084 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 6238d16b1be74dd88fd2e089fbd85d33 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6238d16b1be74dd88fd2e089fbd85d33 already in progress: creating tablet
W20260923 19:50:07.627414 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 5e711e48156b46b5a517b330d6d41309 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e711e48156b46b5a517b330d6d41309 already in progress: creating tablet
I20260923 19:50:07.623219 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 363) took 1113 ms. Trace:
I20260923 19:50:07.629142 6324 tablet_service.cc:1511] Processing CreateTablet for tablet 3acf4a03174f45d5aee9c9b1454784f8 (DEFAULT_TABLE table=default.Table_1dc31225e50d46e582e8a8832c568190 [id=f823ecf81f1b4b1098ea613c392d198c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.629510 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3acf4a03174f45d5aee9c9b1454784f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.635342 5803 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_0ebdc6bda57442b796dabb005f3779c5 [id=498c667413e24c7c800fe5eae263cf22] alter complete (version 2)
I20260923 19:50:07.643512 5800 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ee5fbb39c54a49c89eaaff48f72a9c3c" } modify_external_catalogs: true
I20260923 19:50:07.643759 5800 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ee5fbb39c54a49c89eaaff48f72a9c3c" } modify_external_catalogs: true
I20260923 19:50:07.650056 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 37769256de33432697e9d4fb235f473f (DEFAULT_TABLE table=default.Table_59a69335b281437498cea78a9cb3fadb [id=ac71e26491774bcd93d004a319b086c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.653708 6948 tablet.cc:1751] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:07.656009 6027 tablet_service.cc:1511] Processing CreateTablet for tablet 3acf4a03174f45d5aee9c9b1454784f8 (DEFAULT_TABLE table=default.Table_1dc31225e50d46e582e8a8832c568190 [id=f823ecf81f1b4b1098ea613c392d198c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.655990 6461 rpcz_store.cc:276] 0923 19:50:06.509902 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:06.509962 (+ 60us) service_pool.cc:224] Handling call
0923 19:50:07.426613 (+916651us) ts_tablet_manager.cc:1151] Deleting tablet 9101e82501fd461f8a4b2dcd9dffbd74
0923 19:50:07.426627 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.594008 (+167381us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:07.597212 (+ 3204us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:07.622827 (+ 25615us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":904781}
I20260923 19:50:07.659196 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37769256de33432697e9d4fb235f473f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.659632 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3acf4a03174f45d5aee9c9b1454784f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.659776 6958 tablet.cc:1751] T d91a56bace854494b7affd6c766b2847 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:07.660791 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 9101e82501fd461f8a4b2dcd9dffbd74 (table default.Table_b5e4b2595161409da2fb9a56664da184 [id=3ab47a5709f64cdf87575911498c5760]) successfully deleted
I20260923 19:50:07.662161 5804 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b623e36133d64d72a070bb99a0b974ee" } new_table_name: "default.Table_ff99741064094cc2b9debbfffc81526a" modify_external_catalogs: true
I20260923 19:50:07.664506 6928 raft_consensus.cc:493] T 86473c5cbca54b5792b038aef445998c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:07.665405 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 772ece5283a949408d849f6e56f5f17b (DEFAULT_TABLE table=default.Table_81d47fdf0e514f1eba3c801278533173 [id=909921effa834834ae8eed17dfd21976]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.666035 6180 tablet_service.cc:1511] Processing CreateTablet for tablet 3acf4a03174f45d5aee9c9b1454784f8 (DEFAULT_TABLE table=default.Table_1dc31225e50d46e582e8a8832c568190 [id=f823ecf81f1b4b1098ea613c392d198c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.666590 6165 tablet_service.cc:1511] Processing CreateTablet for tablet 7f47efa0cabd47aa8ed0deface7763ab (DEFAULT_TABLE table=default.Table_f57f8cacbedb49c6be509b51c824b960 [id=ada5cc6ef65b4859bf027fd3af9ad0f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.667194 6169 tablet_service.cc:1558] Processing DeleteTablet for tablet 3190d18f00234d71b0a58c2c334ef45f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:07.666603 6461 tablet_replica.cc:333] T 4750e2a1b24e4bc7aafa4cd36afebbbd P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:07.669481 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 772ece5283a949408d849f6e56f5f17b (DEFAULT_TABLE table=default.Table_81d47fdf0e514f1eba3c801278533173 [id=909921effa834834ae8eed17dfd21976]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.670292 6461 raft_consensus.cc:2243] T 4750e2a1b24e4bc7aafa4cd36afebbbd P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:07.670506 6461 raft_consensus.cc:2272] T 4750e2a1b24e4bc7aafa4cd36afebbbd P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:07.671011 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 0f90406b20f54787bd27255d5ae81d1c (DEFAULT_TABLE table=default.Table_9f1adbf7034440cd8ec248d18c62ba63 [id=cec162ada3144aaba98196d363cf587d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.671175 6461 ts_tablet_manager.cc:1916] T 4750e2a1b24e4bc7aafa4cd36afebbbd P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:07.667243 6928 raft_consensus.cc:515] T 86473c5cbca54b5792b038aef445998c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.672188 6928 leader_election.cc:290] T 86473c5cbca54b5792b038aef445998c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:07.672309 6176 tablet_service.cc:1511] Processing CreateTablet for tablet 37769256de33432697e9d4fb235f473f (DEFAULT_TABLE table=default.Table_59a69335b281437498cea78a9cb3fadb [id=ac71e26491774bcd93d004a319b086c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.672726 6814 raft_consensus.cc:493] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:07.673648 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86473c5cbca54b5792b038aef445998c" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:07.673234 6814 raft_consensus.cc:515] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.674511 6814 leader_election.cc:290] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:07.674916 6179 tablet_service.cc:1511] Processing CreateTablet for tablet 559f3e3016aa470f9732a727b4528586 (DEFAULT_TABLE table=default.Table_d7d1452530dc40018f8d5568a97f273b [id=7ceb51c74b464ca4a1c59cdac4d65f2a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:07.675014 5996 leader_election.cc:343] T 86473c5cbca54b5792b038aef445998c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:07.675192 6169 tablet_service.cc:1558] Processing DeleteTablet for tablet a1e8b8e638ec438a86f05fa147cdb27c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:00 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:07.678941 6058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623fb5b761134951a4b742ab2ba480a4" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:07.681998 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86473c5cbca54b5792b038aef445998c" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:07.682859 5695 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task5JtCX2/build/asan/bin/kudu pid 5703
I20260923 19:50:07.683751 6058 raft_consensus.cc:2468] T 623fb5b761134951a4b742ab2ba480a4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
W20260923 19:50:07.683897 5995 leader_election.cc:343] T 86473c5cbca54b5792b038aef445998c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:07.684082 5764 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:50:07.689564 5995 leader_election.cc:304] T 86473c5cbca54b5792b038aef445998c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:07.690440 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 772ece5283a949408d849f6e56f5f17b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.691428 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 772ece5283a949408d849f6e56f5f17b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.691715 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f90406b20f54787bd27255d5ae81d1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.693306 6928 raft_consensus.cc:2749] T 86473c5cbca54b5792b038aef445998c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:07.693787 5801 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 18bab39d85f94f4283f0b18c1c9b48a2
I20260923 19:50:07.694443 5801 catalog_manager.cc:6934] ReplaceTablet: tablet 18bab39d85f94f4283f0b18c1c9b48a2 deleted and replaced by tablet ebc288d8d453481592df11cd1bfed3ac
I20260923 19:50:07.694638 6456 tablet_bootstrap.cc:492] T 42e9cbcf77324d91abd029c12eaf950d P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:07.694902 5801 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5a1ffa59de984ef3adb370cdf1142f24" } modify_external_catalogs: true
I20260923 19:50:07.695111 5801 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5a1ffa59de984ef3adb370cdf1142f24" } modify_external_catalogs: true
I20260923 19:50:07.695179 6456 ts_tablet_manager.cc:1403] T 42e9cbcf77324d91abd029c12eaf950d P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.162s user 0.008s sys 0.000s
I20260923 19:50:07.702128 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 474e34e902064764864ba06ef41b1d94
I20260923 19:50:07.702596 5797 catalog_manager.cc:6934] ReplaceTablet: tablet 474e34e902064764864ba06ef41b1d94 deleted and replaced by tablet 12bda2ae961446bea2f34e792f4f1706
I20260923 19:50:07.703006 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_8eba59cb9a3843738a7bd980139febb7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:07.701577 6456 raft_consensus.cc:359] T 42e9cbcf77324d91abd029c12eaf950d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.703315 5803 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 5adadf8caf5e4a9ab1107d0fb6a91735 (table default.Table_bd91264aa4a0430eb1a8f69129fb0f3f [id=738ed1d070ef485e9299c1f3b1db008a]). Expected version 2 got 0
I20260923 19:50:07.703565 5803 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet d91a56bace854494b7affd6c766b2847 (table default.Table_b3579cbf488c4d1eb5f605ab4e11c340 [id=a6dbcc9c44fb400b926e21aa6d683186]). Expected version 2 got 0
W20260923 19:50:07.703616 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8eba59cb9a3843738a7bd980139febb7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:07.703764 5803 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet ec4284d6a0fa416ca95b4d675c8e3912 (table default.Table_00f5789c01e94f8e8c65077f98b164c2 [id=29a38060f3bf43f3900ad0ee42fbde9a]). Expected version 1 got 0
I20260923 19:50:07.703749 6456 raft_consensus.cc:385] T 42e9cbcf77324d91abd029c12eaf950d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:07.705229 6309 tablet_service.cc:1558] Processing DeleteTablet for tablet a224ae69503e4ab588d6269086317f09 with delete_type TABLET_DATA_DELETED (replaced by tablet d6d3601a392f4723b4ca00f6e12b950c) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:07.705516 6308 tablet_service.cc:1558] Processing DeleteTablet for tablet 474e34e902064764864ba06ef41b1d94 with delete_type TABLET_DATA_DELETED (replaced by tablet 12bda2ae961446bea2f34e792f4f1706) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:07.701732 5805 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_22f84157ac664f81ae5266143e743737" } modify_external_catalogs: true
I20260923 19:50:07.705921 5805 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_22f84157ac664f81ae5266143e743737" } modify_external_catalogs: true
I20260923 19:50:07.705603 6456 raft_consensus.cc:740] T 42e9cbcf77324d91abd029c12eaf950d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:07.709553 6456 consensus_queue.cc:260] T 42e9cbcf77324d91abd029c12eaf950d P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.713176 6031 tablet_service.cc:1558] Processing DeleteTablet for tablet 18bab39d85f94f4283f0b18c1c9b48a2 with delete_type TABLET_DATA_DELETED (replaced by tablet ebc288d8d453481592df11cd1bfed3ac) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:07.713641 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet 18bab39d85f94f4283f0b18c1c9b48a2 with delete_type TABLET_DATA_DELETED (replaced by tablet ebc288d8d453481592df11cd1bfed3ac) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:07.714150 6279 leader_election.cc:304] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:07.714663 6950 raft_consensus.cc:2804] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:07.714778 6950 raft_consensus.cc:493] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:07.714893 6950 raft_consensus.cc:3060] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:07.720348 6950 raft_consensus.cc:515] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.720882 6169 tablet_service.cc:1558] Processing DeleteTablet for tablet 18bab39d85f94f4283f0b18c1c9b48a2 with delete_type TABLET_DATA_DELETED (replaced by tablet ebc288d8d453481592df11cd1bfed3ac) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:07.721751 6950 leader_election.cc:290] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:07.722224 6022 tablet_service.cc:1558] Processing DeleteTablet for tablet 474e34e902064764864ba06ef41b1d94 with delete_type TABLET_DATA_DELETED (replaced by tablet 12bda2ae961446bea2f34e792f4f1706) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:07.722852 6058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623fb5b761134951a4b742ab2ba480a4" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:07.723311 6058 raft_consensus.cc:3060] T 623fb5b761134951a4b742ab2ba480a4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:07.723374 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 559f3e3016aa470f9732a727b4528586. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.725024 5799 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet d09faa67bdc54d31a7f7a1b012de9ba1
I20260923 19:50:07.724973 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623fb5b761134951a4b742ab2ba480a4" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:07.725543 5799 catalog_manager.cc:6934] ReplaceTablet: tablet d09faa67bdc54d31a7f7a1b012de9ba1 deleted and replaced by tablet 146a402ff29a4e0b834a9f270d61e21c
W20260923 19:50:07.726946 6280 leader_election.cc:343] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:07.732643 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet 474e34e902064764864ba06ef41b1d94 with delete_type TABLET_DATA_DELETED (replaced by tablet 12bda2ae961446bea2f34e792f4f1706) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:07.732851 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3acf4a03174f45d5aee9c9b1454784f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.737578 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet d09faa67bdc54d31a7f7a1b012de9ba1 with delete_type TABLET_DATA_DELETED (replaced by tablet 146a402ff29a4e0b834a9f270d61e21c) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:07.739113 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623fb5b761134951a4b742ab2ba480a4" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
W20260923 19:50:07.740399 6280 leader_election.cc:343] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:07.740897 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet d09faa67bdc54d31a7f7a1b012de9ba1 with delete_type TABLET_DATA_DELETED (replaced by tablet 146a402ff29a4e0b834a9f270d61e21c) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:07.741097 6165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f47efa0cabd47aa8ed0deface7763ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.742449 6814 raft_consensus.cc:493] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:07.742708 6814 raft_consensus.cc:515] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.744344 6814 leader_election.cc:290] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:07.745494 6321 tablet_service.cc:1558] Processing DeleteTablet for tablet d70b7662d85a4f64a11420448c4d140d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:07.745538 6176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37769256de33432697e9d4fb235f473f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.749730 5798 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d2249132d73a45758b64da97b668320e" } modify_external_catalogs: true
I20260923 19:50:07.749995 5798 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d2249132d73a45758b64da97b668320e" } modify_external_catalogs: true
I20260923 19:50:07.753686 6454 tablet_bootstrap.cc:492] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:07.753865 6454 ts_tablet_manager.cc:1403] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.164s user 0.002s sys 0.010s
I20260923 19:50:07.757786 6057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4750e2a1b24e4bc7aafa4cd36afebbbd" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
W20260923 19:50:07.762840 6279 leader_election.cc:343] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Illegal state: Tablet not RUNNING: STOPPED
I20260923 19:50:07.766891 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4750e2a1b24e4bc7aafa4cd36afebbbd" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:07.770490 6280 leader_election.cc:343] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:07.770659 6280 leader_election.cc:304] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:07.770989 6814 consensus_queue.cc:1048] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:07.771524 6814 raft_consensus.cc:2749] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:07.772904 6454 raft_consensus.cc:359] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.773120 6454 raft_consensus.cc:385] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:07.773237 6454 raft_consensus.cc:740] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:07.773530 6454 consensus_queue.cc:260] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.774720 6454 ts_tablet_manager.cc:1434] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.021s user 0.001s sys 0.001s
I20260923 19:50:07.779937 6457 tablet_bootstrap.cc:492] T 5427b0f0218d4131b68a39e8e3bf02e7 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:07.780230 6457 ts_tablet_manager.cc:1403] T 5427b0f0218d4131b68a39e8e3bf02e7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.165s user 0.002s sys 0.002s
I20260923 19:50:07.781056 6457 raft_consensus.cc:359] T 5427b0f0218d4131b68a39e8e3bf02e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.787166 6058 raft_consensus.cc:2468] T 623fb5b761134951a4b742ab2ba480a4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:07.792289 6279 leader_election.cc:304] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:07.792855 6950 raft_consensus.cc:2804] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:07.793172 6950 raft_consensus.cc:697] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:07.793505 6950 consensus_queue.cc:237] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.794042 6454 tablet_bootstrap.cc:492] T 6a34e178007b4e8ebed429cedf44e82a P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:07.794884 6457 raft_consensus.cc:385] T 5427b0f0218d4131b68a39e8e3bf02e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:07.797465 6459 ts_tablet_manager.cc:1929] T a224ae69503e4ab588d6269086317f09 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:07.797858 6459 log.cc:1199] T a224ae69503e4ab588d6269086317f09 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/a224ae69503e4ab588d6269086317f09
I20260923 19:50:07.798522 6459 ts_tablet_manager.cc:1950] T a224ae69503e4ab588d6269086317f09 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:07.797494 6920 raft_consensus.cc:2749] T 0a5ce253bcce410b9517449f133d39e8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:07.799388 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 58ea466d1b2b40e9b9b4cd5be51f79e0
I20260923 19:50:07.799606 6457 raft_consensus.cc:740] T 5427b0f0218d4131b68a39e8e3bf02e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:07.799896 5796 catalog_manager.cc:6934] ReplaceTablet: tablet 58ea466d1b2b40e9b9b4cd5be51f79e0 deleted and replaced by tablet 839bcf991b754f9e95a1dd6c4f826e71
I20260923 19:50:07.799906 6457 consensus_queue.cc:260] T 5427b0f0218d4131b68a39e8e3bf02e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.800104 5796 master_service.cc:960] ReplaceTablet: received request to replace tablet 5725a9cb95c448d0a5ea8114e90bc9fe from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:07.800750 6026 tablet_service.cc:1558] Processing DeleteTablet for tablet 58ea466d1b2b40e9b9b4cd5be51f79e0 with delete_type TABLET_DATA_DELETED (replaced by tablet 839bcf991b754f9e95a1dd6c4f826e71) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:07.801431 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet d09faa67bdc54d31a7f7a1b012de9ba1 with delete_type TABLET_DATA_DELETED (replaced by tablet 146a402ff29a4e0b834a9f270d61e21c) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:07.801957 6321 tablet_service.cc:1558] Processing DeleteTablet for tablet 58ea466d1b2b40e9b9b4cd5be51f79e0 with delete_type TABLET_DATA_DELETED (replaced by tablet 839bcf991b754f9e95a1dd6c4f826e71) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:07.801982 6459 tablet_replica.cc:333] T 033c2d772c8a44d2a0e671664bb9085d P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:07.802515 6459 raft_consensus.cc:2243] T 033c2d772c8a44d2a0e671664bb9085d P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:07.802893 6459 pending_rounds.cc:70] T 033c2d772c8a44d2a0e671664bb9085d P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:07.803052 6459 pending_rounds.cc:77] T 033c2d772c8a44d2a0e671664bb9085d P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630559055654912 op_type: NO_OP noop_request { }
I20260923 19:50:07.803289 6459 raft_consensus.cc:2889] T 033c2d772c8a44d2a0e671664bb9085d P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:07.803508 6459 raft_consensus.cc:2272] T 033c2d772c8a44d2a0e671664bb9085d P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:07.803638 6457 ts_tablet_manager.cc:1434] T 5427b0f0218d4131b68a39e8e3bf02e7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.023s user 0.001s sys 0.001s
I20260923 19:50:07.805176 6457 tablet_bootstrap.cc:492] T ab73e8a1b6774ca0b43e5be67da68fab P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:07.805801 6814 consensus_queue.cc:1048] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:07.805963 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet a224ae69503e4ab588d6269086317f09 (table default.Table_74b3ada03dc14044b09a369b0e3782c7 [id=6c09f84a1d19402b8b59bbc60ae92bcb]) successfully deleted
I20260923 19:50:07.769829 6461 ts_tablet_manager.cc:1929] T 4750e2a1b24e4bc7aafa4cd36afebbbd P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:07.815649 6461 log.cc:1199] T 4750e2a1b24e4bc7aafa4cd36afebbbd P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/4750e2a1b24e4bc7aafa4cd36afebbbd
I20260923 19:50:07.816156 6461 ts_tablet_manager.cc:1950] T 4750e2a1b24e4bc7aafa4cd36afebbbd P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:07.819267 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet d04b3a9ade7a405bb619704095fac279
I20260923 19:50:07.821013 6180 tablet_service.cc:1558] Processing DeleteTablet for tablet 58ea466d1b2b40e9b9b4cd5be51f79e0 with delete_type TABLET_DATA_DELETED (replaced by tablet 839bcf991b754f9e95a1dd6c4f826e71) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:07.821712 6321 tablet_service.cc:1558] Processing DeleteTablet for tablet d04b3a9ade7a405bb619704095fac279 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:07 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:07.821756 6459 ts_tablet_manager.cc:1916] T 033c2d772c8a44d2a0e671664bb9085d P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:07.823442 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet d04b3a9ade7a405bb619704095fac279 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:07 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:07.825840 6457 tablet_bootstrap.cc:654] T ab73e8a1b6774ca0b43e5be67da68fab P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:07.827711 6458 ts_tablet_manager.cc:1929] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:07.827908 6458 log.cc:1199] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/063fc0e77d294ddf8a02e9ab5968a5e3
I20260923 19:50:07.828336 6458 ts_tablet_manager.cc:1950] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:07.829173 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 230) took 3750 ms. Trace:
I20260923 19:50:07.829299 6458 rpcz_store.cc:276] 0923 19:50:04.078572 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:04.078792 (+ 220us) service_pool.cc:224] Handling call
0923 19:50:07.624730 (+3545938us) ts_tablet_manager.cc:1151] Deleting tablet 063fc0e77d294ddf8a02e9ab5968a5e3
0923 19:50:07.624737 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.659760 (+ 35023us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:07.738481 (+ 78721us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:07.829102 (+ 90621us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3545699}
I20260923 19:50:07.829823 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 234) took 3732 ms. Trace:
I20260923 19:50:07.829974 6458 rpcz_store.cc:276] 0923 19:50:04.096962 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:04.097435 (+ 473us) service_pool.cc:224] Handling call
0923 19:50:07.829630 (+3732195us) ts_tablet_manager.cc:1151] Deleting tablet 896bd068e6b343e48eb2a01679b49326
0923 19:50:07.829639 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.829759 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3731914}
I20260923 19:50:07.830340 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 272) took 2464 ms. Trace:
I20260923 19:50:07.830435 6458 rpcz_store.cc:276] 0923 19:50:05.365828 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.367284 (+ 1456us) service_pool.cc:224] Handling call
0923 19:50:07.830221 (+2462937us) ts_tablet_manager.cc:1151] Deleting tablet 8db0358af7634911820f99fe16605ca7
0923 19:50:07.830229 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.830291 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2462700}
I20260923 19:50:07.830291 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 063fc0e77d294ddf8a02e9ab5968a5e3 (table default.Table_3034bb02271e459ebedf3424b5f8f908 [id=83a8f991844b4cb0a9008f5bc3dea17b]) successfully deleted
I20260923 19:50:07.830777 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 273) took 2464 ms. Trace:
I20260923 19:50:07.830871 6458 rpcz_store.cc:276] 0923 19:50:05.365980 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.367560 (+ 1580us) service_pool.cc:224] Handling call
0923 19:50:07.830654 (+2463094us) ts_tablet_manager.cc:1151] Deleting tablet e1752d6b46894796bdc94e6230e3327d
0923 19:50:07.830672 (+ 18us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.830732 (+ 60us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2462854}
I20260923 19:50:07.831213 6458 tablet_replica.cc:333] T b7f372b952804ac58e602998d9b77d72 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:07.831491 6456 ts_tablet_manager.cc:1434] T 42e9cbcf77324d91abd029c12eaf950d P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.136s user 0.002s sys 0.002s
W20260923 19:50:07.831727 5792 catalog_manager.cc:5030] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 8db0358af7634911820f99fe16605ca7 because the tablet was not found. No further retry: Not found: Tablet not found: 8db0358af7634911820f99fe16605ca7
W20260923 19:50:07.832070 5792 catalog_manager.cc:5030] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet e1752d6b46894796bdc94e6230e3327d because the tablet was not found. No further retry: Not found: Tablet not found: e1752d6b46894796bdc94e6230e3327d
I20260923 19:50:07.832356 6456 tablet_bootstrap.cc:492] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:07.827695 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 365) took 1312 ms. Trace:
I20260923 19:50:07.840216 6461 rpcz_store.cc:276] 0923 19:50:06.514908 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:06.514962 (+ 54us) service_pool.cc:224] Handling call
0923 19:50:07.660604 (+1145642us) ts_tablet_manager.cc:1151] Deleting tablet 4750e2a1b24e4bc7aafa4cd36afebbbd
0923 19:50:07.660630 (+ 26us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.728973 (+ 68343us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:07.769748 (+ 40775us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:07.827638 (+ 57890us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1138688}
I20260923 19:50:07.840821 6461 tablet_replica.cc:333] T b2762648045b4378bcc2c1234460c352 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:07.841035 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 4750e2a1b24e4bc7aafa4cd36afebbbd (table default.Table_103c4095b9c641d7aed905489796806e [id=0747811756dc43fdb5cba790c9a319df]) successfully deleted
I20260923 19:50:07.841099 6461 raft_consensus.cc:2243] T b2762648045b4378bcc2c1234460c352 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:07.841353 6461 raft_consensus.cc:2272] T b2762648045b4378bcc2c1234460c352 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:07.842543 5789 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 34d62ab3d4aa457f8fea283cd9248a41 (table default.Table_71d7f590efb94aae8c345f9d9a620fc1 [id=b4e8e3f2a48a4b5496f506080b415805], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 34d62ab3d4aa457f8fea283cd9248a41 consensus state has no leader
I20260923 19:50:07.844903 6461 ts_tablet_manager.cc:1916] T b2762648045b4378bcc2c1234460c352 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:07.845826 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet d04b3a9ade7a405bb619704095fac279 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:07 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:07.846518 6456 tablet_bootstrap.cc:654] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:07.850623 6454 tablet_bootstrap.cc:654] T 6a34e178007b4e8ebed429cedf44e82a P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:07.851277 6458 raft_consensus.cc:2243] T b7f372b952804ac58e602998d9b77d72 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:07.852137 6458 raft_consensus.cc:2272] T b7f372b952804ac58e602998d9b77d72 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:07.858714 6458 ts_tablet_manager.cc:1916] T b7f372b952804ac58e602998d9b77d72 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:07.860941 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet a01a86b6fd4b44d3808c2040525d7b61
I20260923 19:50:07.862352 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_72a581bef73d4b24868e54dc6e544838"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:07.863365 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72a581bef73d4b24868e54dc6e544838 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:07.874471 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet a01a86b6fd4b44d3808c2040525d7b61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:07 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:07.877152 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_e14fb17a6d3146409662b5f989ee9f15"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:07.878531 6928 raft_consensus.cc:493] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:07.878746 6928 raft_consensus.cc:515] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:07.879244 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e14fb17a6d3146409662b5f989ee9f15 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:07.879530 6928 leader_election.cc:290] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:07.879654 6457 tablet_bootstrap.cc:492] T ab73e8a1b6774ca0b43e5be67da68fab P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:07.879801 6457 ts_tablet_manager.cc:1403] T ab73e8a1b6774ca0b43e5be67da68fab P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.075s user 0.004s sys 0.001s
I20260923 19:50:07.880594 6457 raft_consensus.cc:359] T ab73e8a1b6774ca0b43e5be67da68fab P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.880705 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet a01a86b6fd4b44d3808c2040525d7b61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:07 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:07.880765 6457 raft_consensus.cc:385] T ab73e8a1b6774ca0b43e5be67da68fab P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:07.880851 6457 raft_consensus.cc:740] T ab73e8a1b6774ca0b43e5be67da68fab P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:07.883157 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 5725a9cb95c448d0a5ea8114e90bc9fe
I20260923 19:50:07.883766 5796 catalog_manager.cc:6934] ReplaceTablet: tablet 5725a9cb95c448d0a5ea8114e90bc9fe deleted and replaced by tablet a367cf3788ef49148a5c8d6864f71d8e
I20260923 19:50:07.884197 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_7d7ca8e644fb4245b276ecea1534ff91"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:07.884573 6457 consensus_queue.cc:260] T ab73e8a1b6774ca0b43e5be67da68fab P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.884923 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_41c4d80198a246a78955ae6ab79f3532" } new_table_name: "default.Table_97b31aab6721460eb4c6ac8d6f6f1983" modify_external_catalogs: true
I20260923 19:50:07.885258 6457 ts_tablet_manager.cc:1434] T ab73e8a1b6774ca0b43e5be67da68fab P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
W20260923 19:50:07.885316 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7d7ca8e644fb4245b276ecea1534ff91 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:07.885609 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4fc995819cc40bf9956d85966bcd330" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:07.886492 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet 5725a9cb95c448d0a5ea8114e90bc9fe with delete_type TABLET_DATA_DELETED (replaced by tablet a367cf3788ef49148a5c8d6864f71d8e) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:07.886830 6457 tablet_bootstrap.cc:492] T 556b32b8ccd54c439f86b0069e2a5ce0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
W20260923 19:50:07.887058 5995 leader_election.cc:343] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:07.888844 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet 5725a9cb95c448d0a5ea8114e90bc9fe with delete_type TABLET_DATA_DELETED (replaced by tablet a367cf3788ef49148a5c8d6864f71d8e) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:07.891875 5797 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_fe6466bce2884174b9bcdbcde0184466" } new_table_name: "default.Table_462ef67f5c8445bb919cdd9a35d15cff" modify_external_catalogs: true
I20260923 19:50:07.894636 6457 tablet_bootstrap.cc:654] T 556b32b8ccd54c439f86b0069e2a5ce0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:07.897691 6459 ts_tablet_manager.cc:1929] T 033c2d772c8a44d2a0e671664bb9085d P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260923 19:50:07.900556 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 85d35ebef3c24a2e89233dd900b63513 consensus state has no leader
I20260923 19:50:07.901957 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_dc4eebd8c2d34e1b988008ab9b783cff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:07.902716 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc4eebd8c2d34e1b988008ab9b783cff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:07.903069 6461 ts_tablet_manager.cc:1929] T b2762648045b4378bcc2c1234460c352 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260923 19:50:07.903259 6461 log.cc:1199] T b2762648045b4378bcc2c1234460c352 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/b2762648045b4378bcc2c1234460c352
I20260923 19:50:07.905990 5796 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ceca0c9fd74649909ccd0fd70d2ccca0" } new_table_name: "default.Table_9cef595b51ff4654aa683f9f00aa6e24" modify_external_catalogs: true
I20260923 19:50:07.907238 6461 ts_tablet_manager.cc:1950] T b2762648045b4378bcc2c1234460c352 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
W20260923 19:50:07.907572 5797 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d2dd611746d741e88b6911bf5d51f3e5 has no consensus state
I20260923 19:50:07.908215 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 364) took 1393 ms. Trace:
I20260923 19:50:07.909631 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_a3fdc430d3554365b41daaa0baa5ebb8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:07.910394 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3fdc430d3554365b41daaa0baa5ebb8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:07.911566 6459 log.cc:1199] T 033c2d772c8a44d2a0e671664bb9085d P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/033c2d772c8a44d2a0e671664bb9085d
I20260923 19:50:07.912123 6459 ts_tablet_manager.cc:1950] T 033c2d772c8a44d2a0e671664bb9085d P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:07.912539 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_9927b4fde83442bda0a1c9737a8b239f" } new_table_name: "default.Table_3690c4b8c8334a47930dd2af3aaa23ae" modify_external_catalogs: true
I20260923 19:50:07.913159 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 033c2d772c8a44d2a0e671664bb9085d (table default.Table_423256ac67c24899a4b67915596ef545 [id=c4756b4d81ce4fc2acf001ae879a5c3f]) successfully deleted
I20260923 19:50:07.914752 6454 tablet_bootstrap.cc:492] T 6a34e178007b4e8ebed429cedf44e82a P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:07.914983 6454 ts_tablet_manager.cc:1403] T 6a34e178007b4e8ebed429cedf44e82a P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.121s user 0.005s sys 0.002s
I20260923 19:50:07.915838 6454 raft_consensus.cc:359] T 6a34e178007b4e8ebed429cedf44e82a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.916218 6454 raft_consensus.cc:385] T 6a34e178007b4e8ebed429cedf44e82a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:07.916344 6454 raft_consensus.cc:740] T 6a34e178007b4e8ebed429cedf44e82a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:07.916687 6454 consensus_queue.cc:260] T 6a34e178007b4e8ebed429cedf44e82a P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.916800 5799 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 5adadf8caf5e4a9ab1107d0fb6a91735 (table default.Table_bd91264aa4a0430eb1a8f69129fb0f3f [id=738ed1d070ef485e9299c1f3b1db008a]). Expected version 2 got 0
I20260923 19:50:07.917402 6454 ts_tablet_manager.cc:1434] T 6a34e178007b4e8ebed429cedf44e82a P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:07.917408 5799 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 0a5ce253bcce410b9517449f133d39e8 (table default.Table_84d13e1ea6234e5ca45738376e83f537 [id=0d4f6a5bb30c4d2a937424cf0e651afd]). Expected version 1 got 0
I20260923 19:50:07.917697 6454 tablet_bootstrap.cc:492] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:07.917788 5799 catalog_manager.cc:5838] T 6a34e178007b4e8ebed429cedf44e82a P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:07.920626 5800 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet efc63a151f6444dfb03c3f15f6f54473
I20260923 19:50:07.921471 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet efc63a151f6444dfb03c3f15f6f54473 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:07 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:07.921496 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_c6300cbac0064c74bbc5bd955433f5d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:07.922102 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c6300cbac0064c74bbc5bd955433f5d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:07.923386 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet c19298691d5d4209b2d1147a1aad2f6f
I20260923 19:50:07.923439 6454 tablet_bootstrap.cc:654] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:07.924108 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet c19298691d5d4209b2d1147a1aad2f6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:07 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:07.924289 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_52b79fc3cba74d7cbf3e52760f964edd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:07.924371 6176 tablet_service.cc:1558] Processing DeleteTablet for tablet c19298691d5d4209b2d1147a1aad2f6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:07 UTC) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:07.924784 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_52b79fc3cba74d7cbf3e52760f964edd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:07.926456 6176 tablet_service.cc:1511] Processing CreateTablet for tablet 664d849daee54b02b7b7e2bb340d92fa (DEFAULT_TABLE table=default.Table_449bda0ddfc44496b4af2e8287b56bb5 [id=3a747074a6a04ddbb009b135c67c25b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.926942 6176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 664d849daee54b02b7b7e2bb340d92fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.927086 6459 tablet_replica.cc:333] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:07.927320 6459 raft_consensus.cc:2243] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:07.927484 6459 raft_consensus.cc:2272] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:07.928035 6459 ts_tablet_manager.cc:1916] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:07.930562 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet 5725a9cb95c448d0a5ea8114e90bc9fe with delete_type TABLET_DATA_DELETED (replaced by tablet a367cf3788ef49148a5c8d6864f71d8e) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:07.930789 6321 tablet_service.cc:1558] Processing DeleteTablet for tablet a01a86b6fd4b44d3808c2040525d7b61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:07 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:07.930934 6308 tablet_service.cc:1558] Processing DeleteTablet for tablet efc63a151f6444dfb03c3f15f6f54473 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:07 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:07.932278 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4fc995819cc40bf9956d85966bcd330" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:07.933349 6308 tablet_service.cc:1558] Processing DeleteTablet for tablet c19298691d5d4209b2d1147a1aad2f6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:07 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:07.933643 6950 raft_consensus.cc:493] T b4fc995819cc40bf9956d85966bcd330 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:07.933771 6950 raft_consensus.cc:515] T b4fc995819cc40bf9956d85966bcd330 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.934561 6950 leader_election.cc:290] T b4fc995819cc40bf9956d85966bcd330 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:07.935050 6344 raft_consensus.cc:2468] T b4fc995819cc40bf9956d85966bcd330 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 0.
I20260923 19:50:07.936057 5996 leader_election.cc:304] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:07.936756 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4fc995819cc40bf9956d85966bcd330" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:07.937855 6280 leader_election.cc:343] T b4fc995819cc40bf9956d85966bcd330 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:07.940788 6928 raft_consensus.cc:2804] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:07.940901 6928 raft_consensus.cc:493] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:07.941006 6928 raft_consensus.cc:3060] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:07.943795 6928 raft_consensus.cc:515] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.944505 6928 leader_election.cc:290] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:07.945019 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4fc995819cc40bf9956d85966bcd330" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:07.945228 6344 raft_consensus.cc:3060] T b4fc995819cc40bf9956d85966bcd330 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:07.947221 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 664d849daee54b02b7b7e2bb340d92fa (DEFAULT_TABLE table=default.Table_449bda0ddfc44496b4af2e8287b56bb5 [id=3a747074a6a04ddbb009b135c67c25b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.947657 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 664d849daee54b02b7b7e2bb340d92fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.947829 6176 tablet_service.cc:1511] Processing CreateTablet for tablet 1ea8f44ac03b4ad196725f871a615cdd (DEFAULT_TABLE table=default.Table_5819e2b3c82046279b4be250aa5ca72b [id=56a9dcfc6ce14302ad8b4418f0bbddee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.948200 6176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ea8f44ac03b4ad196725f871a615cdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.948266 6344 raft_consensus.cc:2468] T b4fc995819cc40bf9956d85966bcd330 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 1.
I20260923 19:50:07.949174 5996 leader_election.cc:304] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:07.950466 6950 raft_consensus.cc:493] T 789c54477bec4636bb3669e1f62730e2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:07.950636 6950 raft_consensus.cc:515] T 789c54477bec4636bb3669e1f62730e2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.951330 6950 leader_election.cc:290] T 789c54477bec4636bb3669e1f62730e2 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:07.951802 6456 tablet_bootstrap.cc:492] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:07.951833 6308 tablet_service.cc:1511] Processing CreateTablet for tablet 664d849daee54b02b7b7e2bb340d92fa (DEFAULT_TABLE table=default.Table_449bda0ddfc44496b4af2e8287b56bb5 [id=3a747074a6a04ddbb009b135c67c25b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.951956 6456 ts_tablet_manager.cc:1403] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.120s user 0.006s sys 0.003s
I20260923 19:50:07.952171 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c54477bec4636bb3669e1f62730e2" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:07.952296 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 664d849daee54b02b7b7e2bb340d92fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.952684 6058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c54477bec4636bb3669e1f62730e2" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
W20260923 19:50:07.952764 6280 leader_election.cc:343] T 789c54477bec4636bb3669e1f62730e2 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:07.952883 6058 raft_consensus.cc:2468] T 789c54477bec4636bb3669e1f62730e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:07.952831 6456 raft_consensus.cc:359] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.954080 6279 leader_election.cc:304] T 789c54477bec4636bb3669e1f62730e2 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:07.954212 6057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4fc995819cc40bf9956d85966bcd330" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:07.954461 6057 raft_consensus.cc:2393] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2bf41435f70447f19992d368ca6b46bd in current term 1: Already voted for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in this term.
I20260923 19:50:07.954607 6950 raft_consensus.cc:2804] T 789c54477bec4636bb3669e1f62730e2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:07.954712 6950 raft_consensus.cc:493] T 789c54477bec4636bb3669e1f62730e2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:07.954824 6950 raft_consensus.cc:3060] T 789c54477bec4636bb3669e1f62730e2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:07.956710 6458 ts_tablet_manager.cc:1929] T b7f372b952804ac58e602998d9b77d72 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:07.956823 6458 log.cc:1199] T b7f372b952804ac58e602998d9b77d72 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/b7f372b952804ac58e602998d9b77d72
I20260923 19:50:07.957208 6458 ts_tablet_manager.cc:1950] T b7f372b952804ac58e602998d9b77d72 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:07.957742 6950 raft_consensus.cc:515] T 789c54477bec4636bb3669e1f62730e2 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.958410 6279 leader_election.cc:304] T b4fc995819cc40bf9956d85966bcd330 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:07.958715 6867 raft_consensus.cc:2749] T b4fc995819cc40bf9956d85966bcd330 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:07.959332 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 1ea8f44ac03b4ad196725f871a615cdd (DEFAULT_TABLE table=default.Table_5819e2b3c82046279b4be250aa5ca72b [id=56a9dcfc6ce14302ad8b4418f0bbddee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.959524 6950 leader_election.cc:290] T 789c54477bec4636bb3669e1f62730e2 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:07.959750 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ea8f44ac03b4ad196725f871a615cdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.953020 6456 raft_consensus.cc:385] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:07.960108 6456 raft_consensus.cc:740] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:07.960371 6456 consensus_queue.cc:260] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.962679 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c54477bec4636bb3669e1f62730e2" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
W20260923 19:50:07.966315 6280 leader_election.cc:343] T 789c54477bec4636bb3669e1f62730e2 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:07.966648 6456 ts_tablet_manager.cc:1434] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260923 19:50:07.967592 6928 raft_consensus.cc:2804] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:07.968639 6456 tablet_bootstrap.cc:492] T 5427b0f0218d4131b68a39e8e3bf02e7 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:07.969007 6057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789c54477bec4636bb3669e1f62730e2" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:07.969574 6057 raft_consensus.cc:3060] T 789c54477bec4636bb3669e1f62730e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:07.973809 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 89b950342b66486fa6ec0cdf03ad4881 (DEFAULT_TABLE table=default.Table_1c47528c587348289f80a95a809c70c3 [id=67234dd96dbe44c1b2f7a6a3931ed80a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.974376 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89b950342b66486fa6ec0cdf03ad4881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.979470 6456 tablet_bootstrap.cc:654] T 5427b0f0218d4131b68a39e8e3bf02e7 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:07.979363 6324 tablet_service.cc:1511] Processing CreateTablet for tablet 1ea8f44ac03b4ad196725f871a615cdd (DEFAULT_TABLE table=default.Table_5819e2b3c82046279b4be250aa5ca72b [id=56a9dcfc6ce14302ad8b4418f0bbddee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.979984 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ea8f44ac03b4ad196725f871a615cdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.983825 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 195d4fe5f92e4e2c9330dce34c303723 (DEFAULT_TABLE table=default.Table_e9566b6b8f85440db073d543e768b2ae [id=57f2abae03734c489c96cda418f2bf54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.984333 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 195d4fe5f92e4e2c9330dce34c303723. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.984642 6950 raft_consensus.cc:493] T 9101e82501fd461f8a4b2dcd9dffbd74 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:07.984913 6950 raft_consensus.cc:515] T 9101e82501fd461f8a4b2dcd9dffbd74 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:07.986419 6950 leader_election.cc:290] T 9101e82501fd461f8a4b2dcd9dffbd74 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:07.987190 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9101e82501fd461f8a4b2dcd9dffbd74" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:07.987062 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 281) took 2587 ms. Trace:
I20260923 19:50:07.987185 6321 tablet_service.cc:1511] Processing CreateTablet for tablet 89b950342b66486fa6ec0cdf03ad4881 (DEFAULT_TABLE table=default.Table_1c47528c587348289f80a95a809c70c3 [id=67234dd96dbe44c1b2f7a6a3931ed80a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.990228 6458 rpcz_store.cc:276] 0923 19:50:05.399717 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.399818 (+ 101us) service_pool.cc:224] Handling call
0923 19:50:07.831125 (+2431307us) ts_tablet_manager.cc:1151] Deleting tablet b7f372b952804ac58e602998d9b77d72
0923 19:50:07.831134 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.868304 (+ 37170us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:07.956620 (+ 88316us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:07.987008 (+ 30388us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19800,"tablet-delete.queue_time_us":2431112}
I20260923 19:50:07.990520 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89b950342b66486fa6ec0cdf03ad4881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:07.990758 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 288) took 2504 ms. Trace:
I20260923 19:50:07.990885 6458 rpcz_store.cc:276] 0923 19:50:05.486980 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.487601 (+ 621us) service_pool.cc:224] Handling call
0923 19:50:07.990599 (+2502998us) ts_tablet_manager.cc:1151] Deleting tablet 870db252d8414be7bbe613ea467b5f3a
0923 19:50:07.990610 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.990719 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2502740}
I20260923 19:50:07.991297 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 286) took 2504 ms. Trace:
I20260923 19:50:07.991410 6458 rpcz_store.cc:276] 0923 19:50:05.486390 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.500191 (+ 13801us) service_pool.cc:224] Handling call
0923 19:50:07.991107 (+2490916us) ts_tablet_manager.cc:1151] Deleting tablet 235b4b8081ad4a13937a7941344dbc33
0923 19:50:07.991116 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.991261 (+ 145us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2490636}
I20260923 19:50:07.991751 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 287) took 2505 ms. Trace:
I20260923 19:50:07.991858 6458 rpcz_store.cc:276] 0923 19:50:05.486519 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.500515 (+ 13996us) service_pool.cc:224] Handling call
0923 19:50:07.991634 (+2491119us) ts_tablet_manager.cc:1151] Deleting tablet 7b1601590508479c8f401cd09d9f4c3b
0923 19:50:07.991643 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.991716 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2490748}
I20260923 19:50:07.992182 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 289) took 2488 ms. Trace:
I20260923 19:50:07.992304 6458 rpcz_store.cc:276] 0923 19:50:05.503590 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.508927 (+ 5337us) service_pool.cc:224] Handling call
0923 19:50:07.992057 (+2483130us) ts_tablet_manager.cc:1151] Deleting tablet e1de117713f34b51bbda0c712f0b837c
0923 19:50:07.992065 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.992150 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2482907}
I20260923 19:50:07.992707 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 290) took 2484 ms. Trace:
I20260923 19:50:07.992820 6458 rpcz_store.cc:276] 0923 19:50:05.507790 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.513924 (+ 6134us) service_pool.cc:224] Handling call
0923 19:50:07.992592 (+2478668us) ts_tablet_manager.cc:1151] Deleting tablet 2948d729e1ec4dfca70789bcad513e52
0923 19:50:07.992600 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.992672 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2478445}
I20260923 19:50:07.993086 6458 tablet_replica.cc:333] T 5455beff354a4616a68d8746e3e4f9a8 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:07.993301 6458 raft_consensus.cc:2243] T 5455beff354a4616a68d8746e3e4f9a8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:07.993468 6458 raft_consensus.cc:2272] T 5455beff354a4616a68d8746e3e4f9a8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:07.994922 6178 tablet_service.cc:1511] Processing CreateTablet for tablet a83726da349c4cd1852e956c8fa2cda5 (DEFAULT_TABLE table=default.Table_974e2fbea82147a1a2bb48f3bae1fde1 [id=114c61097627471983e4bec86709dc5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:07.995512 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a83726da349c4cd1852e956c8fa2cda5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:07.987922 6280 leader_election.cc:343] T 9101e82501fd461f8a4b2dcd9dffbd74 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:07.998353 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet b7f372b952804ac58e602998d9b77d72 (table default.Table_7fca491d466748de94242c08e20984b6 [id=5e155553f7ae43eca827dbbafdd2bbe6]) successfully deleted
W20260923 19:50:07.998679 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 870db252d8414be7bbe613ea467b5f3a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 870db252d8414be7bbe613ea467b5f3a already in progress: creating tablet
W20260923 19:50:07.998936 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 235b4b8081ad4a13937a7941344dbc33 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 235b4b8081ad4a13937a7941344dbc33 already in progress: creating tablet
W20260923 19:50:07.999145 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 7b1601590508479c8f401cd09d9f4c3b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7b1601590508479c8f401cd09d9f4c3b already in progress: creating tablet
W20260923 19:50:07.999379 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet e1de117713f34b51bbda0c712f0b837c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e1de117713f34b51bbda0c712f0b837c already in progress: creating tablet
W20260923 19:50:07.999642 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 2948d729e1ec4dfca70789bcad513e52 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2948d729e1ec4dfca70789bcad513e52 already in progress: creating tablet
I20260923 19:50:08.000658 6309 tablet_service.cc:1511] Processing CreateTablet for tablet 195d4fe5f92e4e2c9330dce34c303723 (DEFAULT_TABLE table=default.Table_e9566b6b8f85440db073d543e768b2ae [id=57f2abae03734c489c96cda418f2bf54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.001209 6309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 195d4fe5f92e4e2c9330dce34c303723. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:08.005405 5700 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 69456.8us
I20260923 19:50:08.007647 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet efc63a151f6444dfb03c3f15f6f54473 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:07 UTC) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:08.011390 5796 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1c43641327d14a888a2815e49a2762c8 consensus state has no leader
I20260923 19:50:08.011420 5801 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 035abecfbee7474d9dd048f35e28e867
I20260923 19:50:08.014063 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4fc995819cc40bf9956d85966bcd330" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:08.020473 6928 raft_consensus.cc:697] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Becoming Leader. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Running, Role: LEADER
I20260923 19:50:08.020908 6928 consensus_queue.cc:237] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:08.023092 6279 leader_election.cc:343] T 9101e82501fd461f8a4b2dcd9dffbd74 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 9101e82501fd461f8a4b2dcd9dffbd74
I20260923 19:50:08.023283 6279 leader_election.cc:304] T 9101e82501fd461f8a4b2dcd9dffbd74 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:08.023363 6057 raft_consensus.cc:2468] T 789c54477bec4636bb3669e1f62730e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:08.023802 6773 raft_consensus.cc:493] T ab73e8a1b6774ca0b43e5be67da68fab P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:08.023949 6773 raft_consensus.cc:515] T ab73e8a1b6774ca0b43e5be67da68fab P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.024040 6950 raft_consensus.cc:2749] T 9101e82501fd461f8a4b2dcd9dffbd74 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:08.024412 5995 leader_election.cc:343] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:08.024682 6773 leader_election.cc:290] T ab73e8a1b6774ca0b43e5be67da68fab P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:08.025317 6279 leader_election.cc:304] T 789c54477bec4636bb3669e1f62730e2 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:08.025378 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab73e8a1b6774ca0b43e5be67da68fab" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:08.025599 6032 tablet_service.cc:1511] Processing CreateTablet for tablet a83726da349c4cd1852e956c8fa2cda5 (DEFAULT_TABLE table=default.Table_974e2fbea82147a1a2bb48f3bae1fde1 [id=114c61097627471983e4bec86709dc5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.025719 6950 raft_consensus.cc:2804] T 789c54477bec4636bb3669e1f62730e2 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:08.025899 6950 raft_consensus.cc:697] T 789c54477bec4636bb3669e1f62730e2 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:08.026044 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a83726da349c4cd1852e956c8fa2cda5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.026185 6950 consensus_queue.cc:237] T 789c54477bec4636bb3669e1f62730e2 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.028663 6026 tablet_service.cc:1558] Processing DeleteTablet for tablet 035abecfbee7474d9dd048f35e28e867 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:07 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:08.034109 5996 leader_election.cc:343] T ab73e8a1b6774ca0b43e5be67da68fab P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:08.034904 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet 035abecfbee7474d9dd048f35e28e867 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:07 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:08.035238 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 89b950342b66486fa6ec0cdf03ad4881 (DEFAULT_TABLE table=default.Table_1c47528c587348289f80a95a809c70c3 [id=67234dd96dbe44c1b2f7a6a3931ed80a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.035944 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89b950342b66486fa6ec0cdf03ad4881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.035058 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab73e8a1b6774ca0b43e5be67da68fab" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:08.037328 5995 leader_election.cc:343] T ab73e8a1b6774ca0b43e5be67da68fab P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:08.037487 5995 leader_election.cc:304] T ab73e8a1b6774ca0b43e5be67da68fab P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:08.037770 6773 raft_consensus.cc:2749] T ab73e8a1b6774ca0b43e5be67da68fab P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:08.038110 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 195d4fe5f92e4e2c9330dce34c303723 (DEFAULT_TABLE table=default.Table_e9566b6b8f85440db073d543e768b2ae [id=57f2abae03734c489c96cda418f2bf54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.038763 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 195d4fe5f92e4e2c9330dce34c303723. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.042968 6308 tablet_service.cc:1558] Processing DeleteTablet for tablet 035abecfbee7474d9dd048f35e28e867 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:07 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:08.046486 6458 ts_tablet_manager.cc:1916] T 5455beff354a4616a68d8746e3e4f9a8 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:08.051241 6459 ts_tablet_manager.cc:1929] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:08.051494 6459 log.cc:1199] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/6e726ee6a5494fd4b72c1ebef7d66b42
I20260923 19:50:08.051980 6459 ts_tablet_manager.cc:1950] T 6e726ee6a5494fd4b72c1ebef7d66b42 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:08.052783 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 6e726ee6a5494fd4b72c1ebef7d66b42 (table default.Table_ba9e77809f194febb243d6dc37df3ee0 [id=6cacf523bb724ea58690207d93819846]) successfully deleted
I20260923 19:50:08.058082 6459 tablet_replica.cc:333] T e1752d6b46894796bdc94e6230e3327d P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:08.058380 6459 raft_consensus.cc:2243] T e1752d6b46894796bdc94e6230e3327d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:08.058672 6459 raft_consensus.cc:2272] T e1752d6b46894796bdc94e6230e3327d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:08.059279 6459 ts_tablet_manager.cc:1916] T e1752d6b46894796bdc94e6230e3327d P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:08.066540 6461 rpcz_store.cc:276] 0923 19:50:06.514394 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:06.517507 (+ 3113us) service_pool.cc:224] Handling call
0923 19:50:07.840719 (+1323212us) ts_tablet_manager.cc:1151] Deleting tablet b2762648045b4378bcc2c1234460c352
0923 19:50:07.840733 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:07.868666 (+ 27933us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:07.902951 (+ 34285us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:07.908173 (+ 5222us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1318739}
I20260923 19:50:08.067495 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 366) took 1517 ms. Trace:
I20260923 19:50:08.067703 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet b2762648045b4378bcc2c1234460c352 (table default.Table_f57f8cacbedb49c6be509b51c824b960 [id=ada5cc6ef65b4859bf027fd3af9ad0f2]) successfully deleted
I20260923 19:50:08.067723 6461 rpcz_store.cc:276] 0923 19:50:06.550535 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:06.550603 (+ 68us) service_pool.cc:224] Handling call
0923 19:50:08.067321 (+1516718us) ts_tablet_manager.cc:1151] Deleting tablet b87872fb6cc0400c86eddffb29c898e8
0923 19:50:08.067334 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.067459 (+ 125us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1516458}
W20260923 19:50:08.068552 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet b87872fb6cc0400c86eddffb29c898e8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b87872fb6cc0400c86eddffb29c898e8 already in progress: creating tablet
I20260923 19:50:08.072553 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 367) took 1515 ms. Trace:
I20260923 19:50:08.072721 6461 rpcz_store.cc:276] 0923 19:50:06.557425 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:06.557477 (+ 52us) service_pool.cc:224] Handling call
0923 19:50:08.072347 (+1514870us) ts_tablet_manager.cc:1151] Deleting tablet b985acc650334497832cf4505e1b0043
0923 19:50:08.072361 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.072509 (+ 148us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1514626}
I20260923 19:50:08.073232 6461 tablet_replica.cc:333] T 789c54477bec4636bb3669e1f62730e2 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
W20260923 19:50:08.073195 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet b985acc650334497832cf4505e1b0043 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b985acc650334497832cf4505e1b0043 already in progress: creating tablet
I20260923 19:50:08.073480 6461 raft_consensus.cc:2243] T 789c54477bec4636bb3669e1f62730e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:08.073701 6461 raft_consensus.cc:2272] T 789c54477bec4636bb3669e1f62730e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:08.074415 6461 ts_tablet_manager.cc:1916] T 789c54477bec4636bb3669e1f62730e2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:08.074783 6454 tablet_bootstrap.cc:492] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:08.074997 6454 ts_tablet_manager.cc:1403] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.157s user 0.002s sys 0.010s
I20260923 19:50:08.075973 6454 raft_consensus.cc:359] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.076277 6454 raft_consensus.cc:385] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:08.076401 6454 raft_consensus.cc:740] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:08.076716 6454 consensus_queue.cc:260] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.077531 6454 ts_tablet_manager.cc:1434] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:08.080181 6324 tablet_service.cc:1511] Processing CreateTablet for tablet a83726da349c4cd1852e956c8fa2cda5 (DEFAULT_TABLE table=default.Table_974e2fbea82147a1a2bb48f3bae1fde1 [id=114c61097627471983e4bec86709dc5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.081475 6928 raft_consensus.cc:493] T ec4284d6a0fa416ca95b4d675c8e3912 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:08.081736 6928 raft_consensus.cc:515] T ec4284d6a0fa416ca95b4d675c8e3912 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.083328 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a83726da349c4cd1852e956c8fa2cda5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.083685 6928 leader_election.cc:290] T ec4284d6a0fa416ca95b4d675c8e3912 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:08.083796 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4284d6a0fa416ca95b4d675c8e3912" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:08.084404 5996 leader_election.cc:343] T ec4284d6a0fa416ca95b4d675c8e3912 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:08.087960 6179 tablet_service.cc:1511] Processing CreateTablet for tablet 431ad4da27544d68aa5666293984a86a (DEFAULT_TABLE table=default.Table_e980698a75d14d24afdd616fa2118c72 [id=0fc34fcbffe446c693df52715ddbe9e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.088253 6032 tablet_service.cc:1511] Processing CreateTablet for tablet 431ad4da27544d68aa5666293984a86a (DEFAULT_TABLE table=default.Table_e980698a75d14d24afdd616fa2118c72 [id=0fc34fcbffe446c693df52715ddbe9e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.088891 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 431ad4da27544d68aa5666293984a86a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.094439 6167 tablet_service.cc:1511] Processing CreateTablet for tablet d2dd611746d741e88b6911bf5d51f3e5 (DEFAULT_TABLE table=default.Table_462ef67f5c8445bb919cdd9a35d15cff [id=bb4d2afeaf104e949d52cced351b3bea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.094883 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4284d6a0fa416ca95b4d675c8e3912" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:08.095209 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 431ad4da27544d68aa5666293984a86a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:08.098413 5995 leader_election.cc:343] T ec4284d6a0fa416ca95b4d675c8e3912 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:08.099503 6454 tablet_bootstrap.cc:492] T 4b15b250f594459eb959b4871f7ae398 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
W20260923 19:50:08.101986 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2526884ab0ef404aaf93051cc842c695 consensus state has no leader
I20260923 19:50:08.102176 5995 leader_election.cc:304] T ec4284d6a0fa416ca95b4d675c8e3912 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:08.102339 5798 master_service.cc:960] ReplaceTablet: received request to replace tablet 6fe14389e2a3487587dfcf7a8b4b242d from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:08.103214 6928 raft_consensus.cc:2749] T ec4284d6a0fa416ca95b4d675c8e3912 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:08.104974 5802 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 0a5ce253bcce410b9517449f133d39e8 (table default.Table_84d13e1ea6234e5ca45738376e83f537 [id=0d4f6a5bb30c4d2a937424cf0e651afd]). Expected version 1 got 0
I20260923 19:50:08.105333 5802 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 5adadf8caf5e4a9ab1107d0fb6a91735 (table default.Table_bd91264aa4a0430eb1a8f69129fb0f3f [id=738ed1d070ef485e9299c1f3b1db008a]). Expected version 2 got 0
I20260923 19:50:08.107259 5803 master_service.cc:960] ReplaceTablet: received request to replace tablet 58ea466d1b2b40e9b9b4cd5be51f79e0 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:08.109676 6027 tablet_service.cc:1558] Processing DeleteTablet for tablet 495292cacf3b42a5b633ad40e5e01972 with delete_type TABLET_DATA_DELETED (replaced by tablet 6a2564a99c274e07a7e43da739a2458b) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:08.109970 6022 tablet_service.cc:1558] Processing DeleteTablet for tablet 623fb5b761134951a4b742ab2ba480a4 with delete_type TABLET_DATA_DELETED (replaced by tablet 05a2d1b0979c4788bccc3a71e1cd098e) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:08.110428 6031 tablet_service.cc:1511] Processing CreateTablet for tablet d2dd611746d741e88b6911bf5d51f3e5 (DEFAULT_TABLE table=default.Table_462ef67f5c8445bb919cdd9a35d15cff [id=bb4d2afeaf104e949d52cced351b3bea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.110723 6026 tablet_service.cc:1558] Processing DeleteTablet for tablet b2762648045b4378bcc2c1234460c352 with delete_type TABLET_DATA_DELETED (replaced by tablet 7f47efa0cabd47aa8ed0deface7763ab) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:08.111284 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2dd611746d741e88b6911bf5d51f3e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.111702 6180 tablet_service.cc:1558] Processing DeleteTablet for tablet 5455beff354a4616a68d8746e3e4f9a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:08.120206 6168 tablet_service.cc:1558] Processing DeleteTablet for tablet 033c2d772c8a44d2a0e671664bb9085d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:08.120616 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet 7504a2be25b54ed4bc539eb10199fe15 with delete_type TABLET_DATA_DELETED (replaced by tablet 15a9d1d4adaa402f90d774e77010c928) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:08.120836 6026 tablet_service.cc:1511] Processing CreateTablet for tablet 4e69656e9fc941e19eb7de5c87bc9050 (DEFAULT_TABLE table=default.Table_fd787c6c31954875a5243becab2de8ea [id=1337273e913b43e797c0fb356ca5085b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.121196 6022 tablet_service.cc:1511] Processing CreateTablet for tablet 1cf016ff0bb8418d84358d17876338bf (DEFAULT_TABLE table=default.Table_21a1fa60dde7481e8ad7a7fe355a1e94 [id=9e398f48d86e4c5898cac7336d3c24bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.121395 6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e69656e9fc941e19eb7de5c87bc9050. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.121636 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cf016ff0bb8418d84358d17876338bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.121932 6165 tablet_service.cc:1558] Processing DeleteTablet for tablet a224ae69503e4ab588d6269086317f09 with delete_type TABLET_DATA_DELETED (replaced by tablet d6d3601a392f4723b4ca00f6e12b950c) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:08.122788 6165 tablet_service.cc:1511] Processing CreateTablet for tablet 4e69656e9fc941e19eb7de5c87bc9050 (DEFAULT_TABLE table=default.Table_fd787c6c31954875a5243becab2de8ea [id=1337273e913b43e797c0fb356ca5085b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.123687 6165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e69656e9fc941e19eb7de5c87bc9050. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.126457 6928 raft_consensus.cc:493] T 495292cacf3b42a5b633ad40e5e01972 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:08.126729 6928 raft_consensus.cc:515] T 495292cacf3b42a5b633ad40e5e01972 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.128059 6928 leader_election.cc:290] T 495292cacf3b42a5b633ad40e5e01972 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:08.128757 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495292cacf3b42a5b633ad40e5e01972" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:08.129976 5995 leader_election.cc:343] T 495292cacf3b42a5b633ad40e5e01972 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:08.131575 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2dd611746d741e88b6911bf5d51f3e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.143380 6308 tablet_service.cc:1511] Processing CreateTablet for tablet 431ad4da27544d68aa5666293984a86a (DEFAULT_TABLE table=default.Table_e980698a75d14d24afdd616fa2118c72 [id=0fc34fcbffe446c693df52715ddbe9e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.143916 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495292cacf3b42a5b633ad40e5e01972" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:08.144711 5996 leader_election.cc:343] T 495292cacf3b42a5b633ad40e5e01972 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:08.144868 5996 leader_election.cc:304] T 495292cacf3b42a5b633ad40e5e01972 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:08.144906 6165 tablet_service.cc:1511] Processing CreateTablet for tablet 9756a1f8e23a436bb7c19c8cba7bdc05 (DEFAULT_TABLE table=default.Table_5d0c2a71e15a41e9a3200d2f16a36e16 [id=b76b9d93e83c4d80aba61d3aebcca78d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.145623 6165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9756a1f8e23a436bb7c19c8cba7bdc05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.147111 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 1985088eb56b40c1aeecc1ec7409bcdf (DEFAULT_TABLE table=default.Table_8cef71be2be0416bbd6357227c7ee3fd [id=e33a2afc0ace49b5926b11b2fd64c737]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.147436 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1985088eb56b40c1aeecc1ec7409bcdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.147897 6928 raft_consensus.cc:2749] T 495292cacf3b42a5b633ad40e5e01972 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:08.148030 6026 tablet_service.cc:1511] Processing CreateTablet for tablet 1985088eb56b40c1aeecc1ec7409bcdf (DEFAULT_TABLE table=default.Table_8cef71be2be0416bbd6357227c7ee3fd [id=e33a2afc0ace49b5926b11b2fd64c737]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.148476 6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1985088eb56b40c1aeecc1ec7409bcdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.148938 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 1cf016ff0bb8418d84358d17876338bf (DEFAULT_TABLE table=default.Table_21a1fa60dde7481e8ad7a7fe355a1e94 [id=9e398f48d86e4c5898cac7336d3c24bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.150671 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cf016ff0bb8418d84358d17876338bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.154249 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 9756a1f8e23a436bb7c19c8cba7bdc05 (DEFAULT_TABLE table=default.Table_5d0c2a71e15a41e9a3200d2f16a36e16 [id=b76b9d93e83c4d80aba61d3aebcca78d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.154675 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9756a1f8e23a436bb7c19c8cba7bdc05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.158118 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 431ad4da27544d68aa5666293984a86a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.159852 6457 tablet_bootstrap.cc:492] T 556b32b8ccd54c439f86b0069e2a5ce0 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:08.160012 6457 ts_tablet_manager.cc:1403] T 556b32b8ccd54c439f86b0069e2a5ce0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.273s user 0.001s sys 0.008s
I20260923 19:50:08.160554 6319 tablet_service.cc:1511] Processing CreateTablet for tablet 4e69656e9fc941e19eb7de5c87bc9050 (DEFAULT_TABLE table=default.Table_fd787c6c31954875a5243becab2de8ea [id=1337273e913b43e797c0fb356ca5085b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.160810 6457 raft_consensus.cc:359] T 556b32b8ccd54c439f86b0069e2a5ce0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.161027 6457 raft_consensus.cc:385] T 556b32b8ccd54c439f86b0069e2a5ce0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:08.161127 6457 raft_consensus.cc:740] T 556b32b8ccd54c439f86b0069e2a5ce0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:08.161435 6457 consensus_queue.cc:260] T 556b32b8ccd54c439f86b0069e2a5ce0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.162160 6457 ts_tablet_manager.cc:1434] T 556b32b8ccd54c439f86b0069e2a5ce0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:08.162287 6456 tablet_bootstrap.cc:492] T 5427b0f0218d4131b68a39e8e3bf02e7 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:08.163355 6457 tablet_bootstrap.cc:492] T e9cbfaa34c924a678f23cbcbf1a6fb0a P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:08.164232 6321 tablet_service.cc:1511] Processing CreateTablet for tablet d2dd611746d741e88b6911bf5d51f3e5 (DEFAULT_TABLE table=default.Table_462ef67f5c8445bb919cdd9a35d15cff [id=bb4d2afeaf104e949d52cced351b3bea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.164860 6323 tablet_service.cc:1511] Processing CreateTablet for tablet 1cf016ff0bb8418d84358d17876338bf (DEFAULT_TABLE table=default.Table_21a1fa60dde7481e8ad7a7fe355a1e94 [id=9e398f48d86e4c5898cac7336d3c24bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.165688 6309 tablet_service.cc:1511] Processing CreateTablet for tablet 9756a1f8e23a436bb7c19c8cba7bdc05 (DEFAULT_TABLE table=default.Table_5d0c2a71e15a41e9a3200d2f16a36e16 [id=b76b9d93e83c4d80aba61d3aebcca78d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.167146 6948 tablet.cc:1751] T f302f91c8ef44237b1c9909d88dacbff P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260923 19:50:08.170912 6958 tablet.cc:1751] T f302f91c8ef44237b1c9909d88dacbff P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260923 19:50:08.171579 6457 tablet_bootstrap.cc:654] T e9cbfaa34c924a678f23cbcbf1a6fb0a P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:08.173488 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 1985088eb56b40c1aeecc1ec7409bcdf (DEFAULT_TABLE table=default.Table_8cef71be2be0416bbd6357227c7ee3fd [id=e33a2afc0ace49b5926b11b2fd64c737]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.174679 6319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e69656e9fc941e19eb7de5c87bc9050. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.175442 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1985088eb56b40c1aeecc1ec7409bcdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.175693 6461 ts_tablet_manager.cc:1929] T 789c54477bec4636bb3669e1f62730e2 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:08.175839 6461 log.cc:1199] T 789c54477bec4636bb3669e1f62730e2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/789c54477bec4636bb3669e1f62730e2
I20260923 19:50:08.176239 6461 ts_tablet_manager.cc:1950] T 789c54477bec4636bb3669e1f62730e2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:08.176447 6309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9756a1f8e23a436bb7c19c8cba7bdc05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.177078 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2dd611746d741e88b6911bf5d51f3e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.179157 6456 ts_tablet_manager.cc:1403] T 5427b0f0218d4131b68a39e8e3bf02e7 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.194s user 0.004s sys 0.005s
I20260923 19:50:08.184677 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cf016ff0bb8418d84358d17876338bf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:08.189592 6280 consensus_peers.cc:597] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:08.207389 6456 raft_consensus.cc:359] T 5427b0f0218d4131b68a39e8e3bf02e7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.207772 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 368) took 1547 ms. Trace:
I20260923 19:50:08.207966 6461 rpcz_store.cc:276] 0923 19:50:06.629707 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:06.629935 (+ 228us) service_pool.cc:224] Handling call
0923 19:50:08.073163 (+1443228us) ts_tablet_manager.cc:1151] Deleting tablet 789c54477bec4636bb3669e1f62730e2
0923 19:50:08.073175 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.168289 (+ 95114us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:08.175618 (+ 7329us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:08.176984 (+ 1366us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1442987}
I20260923 19:50:08.208688 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 789c54477bec4636bb3669e1f62730e2 (table default.Table_655007916e0446c2bd045bee42d2592f [id=a29ffe556086466eb3f8602902a72517]) successfully deleted
I20260923 19:50:08.211577 6461 tablet_replica.cc:333] T 42e9cbcf77324d91abd029c12eaf950d P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:08.211829 6461 raft_consensus.cc:2243] T 42e9cbcf77324d91abd029c12eaf950d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:08.212059 6461 raft_consensus.cc:2272] T 42e9cbcf77324d91abd029c12eaf950d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:08.212683 6461 ts_tablet_manager.cc:1916] T 42e9cbcf77324d91abd029c12eaf950d P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:08.216171 6456 raft_consensus.cc:385] T 5427b0f0218d4131b68a39e8e3bf02e7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:08.216377 6456 raft_consensus.cc:740] T 5427b0f0218d4131b68a39e8e3bf02e7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
W20260923 19:50:08.226483 6280 consensus_peers.cc:597] T 4b15b250f594459eb959b4871f7ae398 P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:08.230382 6457 tablet_bootstrap.cc:492] T e9cbfaa34c924a678f23cbcbf1a6fb0a P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:08.230643 6457 ts_tablet_manager.cc:1403] T e9cbfaa34c924a678f23cbcbf1a6fb0a P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.067s user 0.012s sys 0.018s
I20260923 19:50:08.231776 6457 raft_consensus.cc:359] T e9cbfaa34c924a678f23cbcbf1a6fb0a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.232112 6457 raft_consensus.cc:385] T e9cbfaa34c924a678f23cbcbf1a6fb0a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:08.232271 6457 raft_consensus.cc:740] T e9cbfaa34c924a678f23cbcbf1a6fb0a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:08.232739 6457 consensus_queue.cc:260] T e9cbfaa34c924a678f23cbcbf1a6fb0a P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.233450 6457 ts_tablet_manager.cc:1434] T e9cbfaa34c924a678f23cbcbf1a6fb0a P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260923 19:50:08.234030 6457 tablet_bootstrap.cc:492] T f4e3e64fdf584743a3a88df5d6600b22 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:08.234267 6456 consensus_queue.cc:260] T 5427b0f0218d4131b68a39e8e3bf02e7 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.235155 6461 ts_tablet_manager.cc:1929] T 42e9cbcf77324d91abd029c12eaf950d P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:08.235910 6461 log.cc:1199] T 42e9cbcf77324d91abd029c12eaf950d P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/42e9cbcf77324d91abd029c12eaf950d
I20260923 19:50:08.236553 6457 tablet_bootstrap.cc:654] T f4e3e64fdf584743a3a88df5d6600b22 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:08.238252 6461 ts_tablet_manager.cc:1950] T 42e9cbcf77324d91abd029c12eaf950d P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:08.240592 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 385) took 1242 ms. Trace:
I20260923 19:50:08.246596 6461 rpcz_store.cc:276] 0923 19:50:06.997866 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:06.998053 (+ 187us) service_pool.cc:224] Handling call
0923 19:50:08.209113 (+1211060us) ts_tablet_manager.cc:1151] Deleting tablet 42e9cbcf77324d91abd029c12eaf950d
0923 19:50:08.209133 (+ 20us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.218334 (+ 9201us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:08.235042 (+ 16708us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:08.240558 (+ 5516us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1210768}
I20260923 19:50:08.247856 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 42e9cbcf77324d91abd029c12eaf950d (table default.Table_c49ba0c0c07142b6aefaab8632719193 [id=a2b5a27b4b93406b9bd6fd2248562a78]) successfully deleted
I20260923 19:50:08.248752 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 386) took 1226 ms. Trace:
I20260923 19:50:08.249352 6461 rpcz_store.cc:276] 0923 19:50:07.021978 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.022036 (+ 58us) service_pool.cc:224] Handling call
0923 19:50:08.248527 (+1226491us) ts_tablet_manager.cc:1151] Deleting tablet 0e123b69877e4b1fbcdb2b27960864e9
0923 19:50:08.248544 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.248697 (+ 153us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1226198}
I20260923 19:50:08.249692 6456 ts_tablet_manager.cc:1434] T 5427b0f0218d4131b68a39e8e3bf02e7 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.070s user 0.001s sys 0.001s
W20260923 19:50:08.250234 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 0e123b69877e4b1fbcdb2b27960864e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e123b69877e4b1fbcdb2b27960864e9 already in progress: creating tablet
I20260923 19:50:08.250773 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 389) took 1180 ms. Trace:
I20260923 19:50:08.251272 6461 rpcz_store.cc:276] 0923 19:50:07.070409 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.070452 (+ 43us) service_pool.cc:224] Handling call
0923 19:50:08.250640 (+1180188us) ts_tablet_manager.cc:1151] Deleting tablet 9be4c46ee8eb4dbaad01d492b701a9e0
0923 19:50:08.250651 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.250743 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1179990}
W20260923 19:50:08.252187 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 9be4c46ee8eb4dbaad01d492b701a9e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9be4c46ee8eb4dbaad01d492b701a9e0 already in progress: creating tablet
I20260923 19:50:08.252673 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 388) took 1182 ms. Trace:
I20260923 19:50:08.253157 6461 rpcz_store.cc:276] 0923 19:50:07.070301 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.070356 (+ 55us) service_pool.cc:224] Handling call
0923 19:50:08.252547 (+1182191us) ts_tablet_manager.cc:1151] Deleting tablet 15a9d1d4adaa402f90d774e77010c928
0923 19:50:08.252558 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.252645 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1181720}
I20260923 19:50:08.253509 5695 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task5JtCX2/build/asan/bin/kudu with pid 5703
W20260923 19:50:08.254030 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 15a9d1d4adaa402f90d774e77010c928 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15a9d1d4adaa402f90d774e77010c928 already in progress: creating tablet
I20260923 19:50:08.254956 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 387) took 1184 ms. Trace:
I20260923 19:50:08.255144 6456 tablet_bootstrap.cc:492] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:08.255373 6461 rpcz_store.cc:276] 0923 19:50:07.070181 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.070859 (+ 678us) service_pool.cc:224] Handling call
0923 19:50:08.254825 (+1183966us) ts_tablet_manager.cc:1151] Deleting tablet 58c24aa494bc4da28536dfa1df6123b7
0923 19:50:08.254834 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.254927 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1183830}
W20260923 19:50:08.256032 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 58c24aa494bc4da28536dfa1df6123b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58c24aa494bc4da28536dfa1df6123b7 already in progress: creating tablet
I20260923 19:50:08.256397 6461 tablet_replica.cc:333] T 86473c5cbca54b5792b038aef445998c P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:08.256820 6461 raft_consensus.cc:2243] T 86473c5cbca54b5792b038aef445998c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:08.257270 6461 raft_consensus.cc:2272] T 86473c5cbca54b5792b038aef445998c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:08.258606 6461 ts_tablet_manager.cc:1916] T 86473c5cbca54b5792b038aef445998c P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:08.262132 5800 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_1a74b652ec7a4165b28643c452000d6d" } modify_external_catalogs: true
I20260923 19:50:08.262351 5800 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_1a74b652ec7a4165b28643c452000d6d" } modify_external_catalogs: true
I20260923 19:50:08.263836 5803 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 0a5ce253bcce410b9517449f133d39e8 (table default.Table_84d13e1ea6234e5ca45738376e83f537 [id=0d4f6a5bb30c4d2a937424cf0e651afd]). Expected version 1 got 0
I20260923 19:50:08.265476 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_d3fd774b813349ad97efc22b5a85001d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:08.266325 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_3a2441d714924cc1ae24db6dd739f56e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:08.267027 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a2441d714924cc1ae24db6dd739f56e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:08.267633 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet d70b7662d85a4f64a11420448c4d140d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:08.267949 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet 9101e82501fd461f8a4b2dcd9dffbd74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:08.270509 5805 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 0a5ce253bcce410b9517449f133d39e8 (table default.Table_84d13e1ea6234e5ca45738376e83f537 [id=0d4f6a5bb30c4d2a937424cf0e651afd]). Expected version 1 got 0
I20260923 19:50:08.271396 5799 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_b3579cbf488c4d1eb5f605ab4e11c340 [id=a6dbcc9c44fb400b926e21aa6d683186] alter complete (version 2)
I20260923 19:50:08.272650 6461 ts_tablet_manager.cc:1929] T 86473c5cbca54b5792b038aef445998c P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:08.272835 6461 log.cc:1199] T 86473c5cbca54b5792b038aef445998c P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/86473c5cbca54b5792b038aef445998c
I20260923 19:50:08.273236 6461 ts_tablet_manager.cc:1950] T 86473c5cbca54b5792b038aef445998c P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:08.273651 5799 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_e8d6483ff4364f578b5a1747840f7019" } new_table_name: "default.Table_c80b112b6ce9402f87b07ee8a6e1b78b" modify_external_catalogs: true
I20260923 19:50:08.274922 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_85afd8d42b6445daa79f5fe22456ba77"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:08.275245 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_ebf069e144a848b88e93d7b5e2eebac9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:08.275590 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_85afd8d42b6445daa79f5fe22456ba77 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:08.275812 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ebf069e144a848b88e93d7b5e2eebac9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:08.276700 5797 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_493eae9e089b423ca42a863b541f4ec4" } modify_external_catalogs: true
I20260923 19:50:08.277168 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_1eb5249515fc4eab900531c4d0e96923"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:08.277773 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1eb5249515fc4eab900531c4d0e96923 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:08.278160 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d3fd774b813349ad97efc22b5a85001d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:08.279125 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_8f7f460e1af1407c99776ddc28c8b0c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:08.289189 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 390) took 1182 ms. Trace:
W20260923 19:50:08.280861 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f7f460e1af1407c99776ddc28c8b0c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:08.293718 5800 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet c5cb76fa5e084604aa58bf888cfe4852
I20260923 19:50:08.294023 6461 rpcz_store.cc:276] 0923 19:50:07.106854 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.106913 (+ 59us) service_pool.cc:224] Handling call
0923 19:50:08.256338 (+1149425us) ts_tablet_manager.cc:1151] Deleting tablet 86473c5cbca54b5792b038aef445998c
0923 19:50:08.256346 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.268781 (+ 12435us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:08.272543 (+ 3762us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:08.289109 (+ 16566us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1149171}
I20260923 19:50:08.294955 6461 tablet_replica.cc:333] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:08.295200 6461 raft_consensus.cc:2243] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:08.295517 6461 pending_rounds.cc:70] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0: Trying to abort 1 pending ops.
I20260923 19:50:08.295584 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 86473c5cbca54b5792b038aef445998c (table default.Table_f1de0114e81245fdb95e257431f5a975 [id=7f0d9665430447528c3829934eb4b634]) successfully deleted
I20260923 19:50:08.295578 6461 pending_rounds.cc:77] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630560857432064 op_type: NO_OP noop_request { }
I20260923 19:50:08.295746 6461 raft_consensus.cc:2889] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:08.295866 6461 raft_consensus.cc:2272] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:08.296533 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet c5cb76fa5e084604aa58bf888cfe4852 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:08.297611 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet c5cb76fa5e084604aa58bf888cfe4852 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:08.298652 6461 ts_tablet_manager.cc:1916] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:08.282217 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_0fd85280951f4a8586bf9aae46daa067" } new_table_name: "default.Table_e9cc7064dc8e4c6bb9eadb9fc3f33e09" modify_external_catalogs: true
I20260923 19:50:08.285730 5797 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_493eae9e089b423ca42a863b541f4ec4" } modify_external_catalogs: true
I20260923 19:50:08.306473 6457 tablet_bootstrap.cc:492] T f4e3e64fdf584743a3a88df5d6600b22 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:08.306730 6457 ts_tablet_manager.cc:1403] T f4e3e64fdf584743a3a88df5d6600b22 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.073s user 0.007s sys 0.004s
I20260923 19:50:08.307621 6457 raft_consensus.cc:359] T f4e3e64fdf584743a3a88df5d6600b22 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.307922 6457 raft_consensus.cc:385] T f4e3e64fdf584743a3a88df5d6600b22 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:08.308800 6457 raft_consensus.cc:740] T f4e3e64fdf584743a3a88df5d6600b22 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:08.309264 6457 consensus_queue.cc:260] T f4e3e64fdf584743a3a88df5d6600b22 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.310904 6457 ts_tablet_manager.cc:1434] T f4e3e64fdf584743a3a88df5d6600b22 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260923 19:50:08.311352 6457 tablet_bootstrap.cc:492] T 337f32eb47954689a6eb8f74408e01d9 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:08.318665 6201 raft_consensus.cc:3060] T 6a34e178007b4e8ebed429cedf44e82a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:08.321193 6457 tablet_bootstrap.cc:654] T 337f32eb47954689a6eb8f74408e01d9 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:08.323089 6454 tablet_bootstrap.cc:654] T 4b15b250f594459eb959b4871f7ae398 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:08.330493 5790 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.143.254:37151 (error 108) [suppressed 5 similar messages]
I20260923 19:50:08.332656 6461 ts_tablet_manager.cc:1929] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:08.332842 6461 log.cc:1199] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/b4fc995819cc40bf9956d85966bcd330
I20260923 19:50:08.279567 6316 tablet_service.cc:1558] Processing DeleteTablet for tablet 3190d18f00234d71b0a58c2c334ef45f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:08.333349 6461 ts_tablet_manager.cc:1950] T b4fc995819cc40bf9956d85966bcd330 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:08.279670 6320 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c0142f4e3ad42048803481d68f0ee5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:08.279770 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet 623fb5b761134951a4b742ab2ba480a4 with delete_type TABLET_DATA_DELETED (replaced by tablet 05a2d1b0979c4788bccc3a71e1cd098e) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:08.298482 6306 tablet_service.cc:1558] Processing DeleteTablet for tablet c5cb76fa5e084604aa58bf888cfe4852 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:08.314410 6310 tablet_service.cc:1558] Processing DeleteTablet for tablet 4750e2a1b24e4bc7aafa4cd36afebbbd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:00 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:08.314806 6321 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b15b250f594459eb959b4871f7ae398 with delete_type TABLET_DATA_DELETED (replaced by tablet c19298691d5d4209b2d1147a1aad2f6f) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:08.315205 6309 tablet_service.cc:1558] Processing DeleteTablet for tablet 789c54477bec4636bb3669e1f62730e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:08.315376 6319 tablet_service.cc:1558] Processing DeleteTablet for tablet 9101e82501fd461f8a4b2dcd9dffbd74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:08.315523 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet b4fc995819cc40bf9956d85966bcd330 with delete_type TABLET_DATA_DELETED (replaced by tablet efc63a151f6444dfb03c3f15f6f54473) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:08.334479 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 391) took 1152 ms. Trace:
I20260923 19:50:08.316448 6458 ts_tablet_manager.cc:1929] T 5455beff354a4616a68d8746e3e4f9a8 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:08.334712 6458 log.cc:1199] T 5455beff354a4616a68d8746e3e4f9a8 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/5455beff354a4616a68d8746e3e4f9a8
I20260923 19:50:08.329175 6867 consensus_queue.cc:1048] T 6a34e178007b4e8ebed429cedf44e82a P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260923 19:50:08.335062 6458 ts_tablet_manager.cc:1950] T 5455beff354a4616a68d8746e3e4f9a8 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:08.257261 6456 tablet_bootstrap.cc:654] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:08.339478 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_f4932230bae545a9966292f0a7f96b6f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:08.340349 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4932230bae545a9966292f0a7f96b6f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:08.340574 6461 rpcz_store.cc:276] 0923 19:50:07.181550 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.181620 (+ 70us) service_pool.cc:224] Handling call
0923 19:50:08.294825 (+1113205us) ts_tablet_manager.cc:1151] Deleting tablet b4fc995819cc40bf9956d85966bcd330
0923 19:50:08.294843 (+ 18us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.307287 (+ 12444us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:08.332567 (+ 25280us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:08.334402 (+ 1835us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1112943}
I20260923 19:50:08.341954 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 392) took 1130 ms. Trace:
I20260923 19:50:08.342399 6461 rpcz_store.cc:276] 0923 19:50:07.211497 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.211560 (+ 63us) service_pool.cc:224] Handling call
0923 19:50:08.341740 (+1130180us) ts_tablet_manager.cc:1151] Deleting tablet 0c537304c32c44adaa1e05de4496293f
0923 19:50:08.341753 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.341868 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1129914}
I20260923 19:50:08.343333 6454 tablet_bootstrap.cc:492] T 4b15b250f594459eb959b4871f7ae398 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:08.343523 6454 ts_tablet_manager.cc:1403] T 4b15b250f594459eb959b4871f7ae398 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.244s user 0.000s sys 0.010s
W20260923 19:50:08.343820 6279 consensus_peers.cc:597] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5c0142f4e3ad42048803481d68f0ee5d. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:08.344460 6454 raft_consensus.cc:359] T 4b15b250f594459eb959b4871f7ae398 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.344691 6454 raft_consensus.cc:385] T 4b15b250f594459eb959b4871f7ae398 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:08.344771 6454 raft_consensus.cc:740] T 4b15b250f594459eb959b4871f7ae398 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:08.345048 6454 consensus_queue.cc:260] T 4b15b250f594459eb959b4871f7ae398 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.345608 6454 ts_tablet_manager.cc:1434] T 4b15b250f594459eb959b4871f7ae398 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:50:08.346012 6454 tablet_bootstrap.cc:492] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:08.346802 6461 tablet_replica.cc:333] T 5725a9cb95c448d0a5ea8114e90bc9fe P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:08.347114 6461 raft_consensus.cc:2243] T 5725a9cb95c448d0a5ea8114e90bc9fe P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:08.347415 6461 raft_consensus.cc:2272] T 5725a9cb95c448d0a5ea8114e90bc9fe P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:08.350329 6279 consensus_peers.cc:597] T 4b15b250f594459eb959b4871f7ae398 P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4b15b250f594459eb959b4871f7ae398. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:08.350602 6461 ts_tablet_manager.cc:1916] T 5725a9cb95c448d0a5ea8114e90bc9fe P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:08.352588 6457 tablet_bootstrap.cc:492] T 337f32eb47954689a6eb8f74408e01d9 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:08.352754 6457 ts_tablet_manager.cc:1403] T 337f32eb47954689a6eb8f74408e01d9 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.042s user 0.005s sys 0.002s
I20260923 19:50:08.353315 6459 ts_tablet_manager.cc:1929] T e1752d6b46894796bdc94e6230e3327d P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:08.353606 6459 log.cc:1199] T e1752d6b46894796bdc94e6230e3327d P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/e1752d6b46894796bdc94e6230e3327d
I20260923 19:50:08.354084 6457 raft_consensus.cc:359] T 337f32eb47954689a6eb8f74408e01d9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.354218 6459 ts_tablet_manager.cc:1950] T e1752d6b46894796bdc94e6230e3327d P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:08.354310 6457 raft_consensus.cc:385] T 337f32eb47954689a6eb8f74408e01d9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:08.354429 6457 raft_consensus.cc:740] T 337f32eb47954689a6eb8f74408e01d9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:08.354691 6457 consensus_queue.cc:260] T 337f32eb47954689a6eb8f74408e01d9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.355224 6457 ts_tablet_manager.cc:1434] T 337f32eb47954689a6eb8f74408e01d9 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260923 19:50:08.361352 7000 negotiation.cc:336] Failed RPC negotiation. Trace:
0923 19:50:08.309178 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.5.143.254:37151 (local address 127.5.143.195:40823)
0923 19:50:08.317540 (+ 8362us) negotiation.cc:107] Waiting for socket to connect
0923 19:50:08.317562 (+ 22us) client_negotiation.cc:175] Beginning negotiation
0923 19:50:08.317710 (+ 148us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0923 19:50:08.361017 (+ 43307us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.143.254:37151: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":8227,"thread_start_us":8122,"threads_started":1}
I20260923 19:50:08.364200 6461 ts_tablet_manager.cc:1929] T 5725a9cb95c448d0a5ea8114e90bc9fe P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.6
I20260923 19:50:08.364423 6461 log.cc:1199] T 5725a9cb95c448d0a5ea8114e90bc9fe P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/5725a9cb95c448d0a5ea8114e90bc9fe
I20260923 19:50:08.364848 6461 ts_tablet_manager.cc:1950] T 5725a9cb95c448d0a5ea8114e90bc9fe P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:08.366508 6457 tablet_bootstrap.cc:492] T 2f627b7b9ff74750bd8dd59840bf77db P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:08.369441 6457 tablet_bootstrap.cc:654] T 2f627b7b9ff74750bd8dd59840bf77db P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:08.367744 6461 tablet_replica.cc:333] T 495292cacf3b42a5b633ad40e5e01972 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:08.374418 6461 raft_consensus.cc:2243] T 495292cacf3b42a5b633ad40e5e01972 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:08.374668 6461 raft_consensus.cc:2272] T 495292cacf3b42a5b633ad40e5e01972 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:08.374966 5804 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_145e4ce20b7d428da857269e35bbee83" } modify_external_catalogs: true
I20260923 19:50:08.375201 5804 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_145e4ce20b7d428da857269e35bbee83" } modify_external_catalogs: true
I20260923 19:50:08.375257 6461 ts_tablet_manager.cc:1916] T 495292cacf3b42a5b633ad40e5e01972 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:08.377491 6928 raft_consensus.cc:493] T 5427b0f0218d4131b68a39e8e3bf02e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:08.377691 6928 raft_consensus.cc:515] T 5427b0f0218d4131b68a39e8e3bf02e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.382486 6928 leader_election.cc:290] T 5427b0f0218d4131b68a39e8e3bf02e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:08.382498 6461 ts_tablet_manager.cc:1929] T 495292cacf3b42a5b633ad40e5e01972 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:08.382684 6461 log.cc:1199] T 495292cacf3b42a5b633ad40e5e01972 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/495292cacf3b42a5b633ad40e5e01972
I20260923 19:50:08.383014 6461 ts_tablet_manager.cc:1950] T 495292cacf3b42a5b633ad40e5e01972 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:08.383352 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5427b0f0218d4131b68a39e8e3bf02e7" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:08.383596 6344 raft_consensus.cc:2468] T 5427b0f0218d4131b68a39e8e3bf02e7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 0.
I20260923 19:50:08.383992 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 291) took 2856 ms. Trace:
I20260923 19:50:08.384140 6458 rpcz_store.cc:276] 0923 19:50:05.527089 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.527161 (+ 72us) service_pool.cc:224] Handling call
0923 19:50:07.993017 (+2465856us) ts_tablet_manager.cc:1151] Deleting tablet 5455beff354a4616a68d8746e3e4f9a8
0923 19:50:07.993029 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.078446 (+ 85417us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:08.316321 (+237875us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:08.383941 (+ 67620us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2465468}
I20260923 19:50:08.384334 6461 tablet_replica.cc:333] T 623fb5b761134951a4b742ab2ba480a4 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:08.384531 6461 raft_consensus.cc:2243] T 623fb5b761134951a4b742ab2ba480a4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:08.384763 6461 raft_consensus.cc:2272] T 623fb5b761134951a4b742ab2ba480a4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:08.384754 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 5455beff354a4616a68d8746e3e4f9a8 (table default.Table_a949ff6346b345ffa7ce8d5d9a390997 [id=b1c31f5e95b54ad6860aaeb11048d36b]) successfully deleted
I20260923 19:50:08.384501 5996 leader_election.cc:304] T 5427b0f0218d4131b68a39e8e3bf02e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:08.384873 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 292) took 2842 ms. Trace:
I20260923 19:50:08.385129 6458 rpcz_store.cc:276] 0923 19:50:05.542844 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.544129 (+ 1285us) service_pool.cc:224] Handling call
0923 19:50:08.384700 (+2840571us) ts_tablet_manager.cc:1151] Deleting tablet 601a0ff319cc4c9a898d52bbcb19184b
0923 19:50:08.384713 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.384823 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2840267}
I20260923 19:50:08.385329 6928 raft_consensus.cc:2804] T 5427b0f0218d4131b68a39e8e3bf02e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:08.385370 6461 ts_tablet_manager.cc:1916] T 623fb5b761134951a4b742ab2ba480a4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:08.385434 6928 raft_consensus.cc:493] T 5427b0f0218d4131b68a39e8e3bf02e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:08.385522 6928 raft_consensus.cc:3060] T 5427b0f0218d4131b68a39e8e3bf02e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:08.385989 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 297) took 2681 ms. Trace:
I20260923 19:50:08.386067 6458 rpcz_store.cc:276] 0923 19:50:05.704861 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.705143 (+ 282us) service_pool.cc:224] Handling call
0923 19:50:08.385788 (+2680645us) ts_tablet_manager.cc:1151] Deleting tablet 7e41501bf01e4765853c27e4cac21e2b
0923 19:50:08.385800 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.385931 (+ 131us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2680209}
I20260923 19:50:08.386561 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 298) took 2616 ms. Trace:
I20260923 19:50:08.386647 6458 rpcz_store.cc:276] 0923 19:50:05.770333 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.770378 (+ 45us) service_pool.cc:224] Handling call
0923 19:50:08.386428 (+2616050us) ts_tablet_manager.cc:1151] Deleting tablet b18548ba557f448880c5e617fc03cbe0
0923 19:50:08.386438 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.386514 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2556285}
I20260923 19:50:08.387151 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 302) took 2536 ms. Trace:
I20260923 19:50:08.387244 6458 rpcz_store.cc:276] 0923 19:50:05.850473 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.850639 (+ 166us) service_pool.cc:224] Handling call
0923 19:50:08.387019 (+2536380us) ts_tablet_manager.cc:1151] Deleting tablet c504ec668a33451fb1249f697bb5e2bb
0923 19:50:08.387027 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.387105 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2508973}
I20260923 19:50:08.387701 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 303) took 2464 ms. Trace:
I20260923 19:50:08.387777 6458 rpcz_store.cc:276] 0923 19:50:05.923510 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.924639 (+ 1129us) service_pool.cc:224] Handling call
0923 19:50:08.387565 (+2462926us) ts_tablet_manager.cc:1151] Deleting tablet dbe06eba8067413a903e4a07c2768484
0923 19:50:08.387575 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.387653 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2433367}
W20260923 19:50:08.388022 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 601a0ff319cc4c9a898d52bbcb19184b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 601a0ff319cc4c9a898d52bbcb19184b already in progress: creating tablet
W20260923 19:50:08.388340 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 7e41501bf01e4765853c27e4cac21e2b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e41501bf01e4765853c27e4cac21e2b already in progress: creating tablet
W20260923 19:50:08.388566 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet b18548ba557f448880c5e617fc03cbe0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b18548ba557f448880c5e617fc03cbe0 already in progress: creating tablet
I20260923 19:50:08.388620 5798 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_124323035bb7418597ae00063fdffdf2" } modify_external_catalogs: true
W20260923 19:50:08.388868 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet c504ec668a33451fb1249f697bb5e2bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c504ec668a33451fb1249f697bb5e2bb already in progress: creating tablet
I20260923 19:50:08.388870 5798 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_124323035bb7418597ae00063fdffdf2" } modify_external_catalogs: true
W20260923 19:50:08.389142 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet dbe06eba8067413a903e4a07c2768484 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dbe06eba8067413a903e4a07c2768484 already in progress: creating tablet
I20260923 19:50:08.391144 6928 raft_consensus.cc:515] T 5427b0f0218d4131b68a39e8e3bf02e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.392549 6928 leader_election.cc:290] T 5427b0f0218d4131b68a39e8e3bf02e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:08.392755 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5427b0f0218d4131b68a39e8e3bf02e7" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:08.392938 6344 raft_consensus.cc:3060] T 5427b0f0218d4131b68a39e8e3bf02e7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:08.395452 6461 ts_tablet_manager.cc:1929] T 623fb5b761134951a4b742ab2ba480a4 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:08.395583 6461 log.cc:1199] T 623fb5b761134951a4b742ab2ba480a4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/623fb5b761134951a4b742ab2ba480a4
I20260923 19:50:08.395874 6344 raft_consensus.cc:2468] T 5427b0f0218d4131b68a39e8e3bf02e7 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 1.
I20260923 19:50:08.395941 6461 ts_tablet_manager.cc:1950] T 623fb5b761134951a4b742ab2ba480a4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:08.398257 5996 leader_election.cc:304] T 5427b0f0218d4131b68a39e8e3bf02e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:08.398448 5803 master_service.cc:960] ReplaceTablet: received request to replace tablet 58c24aa494bc4da28536dfa1df6123b7 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:08.402650 6928 raft_consensus.cc:2804] T 5427b0f0218d4131b68a39e8e3bf02e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:08.403007 6928 raft_consensus.cc:697] T 5427b0f0218d4131b68a39e8e3bf02e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Becoming Leader. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Running, Role: LEADER
I20260923 19:50:08.403367 6928 consensus_queue.cc:237] T 5427b0f0218d4131b68a39e8e3bf02e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.406235 5803 master_service.cc:960] ReplaceTablet: received request to replace tablet 235b4b8081ad4a13937a7941344dbc33 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:08.406913 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ab743ed22da14340a2986998869db477" } new_table_name: "default.Table_8e43f2a7e2aa40e8afe8272232c65a8e" modify_external_catalogs: true
I20260923 19:50:08.362046 6995 tablet.cc:1751] T f302f91c8ef44237b1c9909d88dacbff P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260923 19:50:08.366207 6454 tablet_bootstrap.cc:654] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:08.417994 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_e1b933d20310499aab93b720704ea8d0" } modify_external_catalogs: true
I20260923 19:50:08.383664 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5427b0f0218d4131b68a39e8e3bf02e7" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:08.418228 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_e1b933d20310499aab93b720704ea8d0" } modify_external_catalogs: true
I20260923 19:50:08.393587 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5427b0f0218d4131b68a39e8e3bf02e7" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:08.401027 6920 raft_consensus.cc:493] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:08.418624 6920 raft_consensus.cc:515] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.419312 6920 leader_election.cc:290] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:08.422096 5995 leader_election.cc:343] T 5427b0f0218d4131b68a39e8e3bf02e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:08.422565 5995 leader_election.cc:343] T 5427b0f0218d4131b68a39e8e3bf02e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:08.423158 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70b7662d85a4f64a11420448c4d140d" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:08.423425 6344 raft_consensus.cc:2468] T d70b7662d85a4f64a11420448c4d140d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:08.424891 6773 raft_consensus.cc:493] T 556b32b8ccd54c439f86b0069e2a5ce0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:08.425096 6773 raft_consensus.cc:515] T 556b32b8ccd54c439f86b0069e2a5ce0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.425998 6773 leader_election.cc:290] T 556b32b8ccd54c439f86b0069e2a5ce0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:08.426795 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556b32b8ccd54c439f86b0069e2a5ce0" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:08.427232 6139 leader_election.cc:304] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
W20260923 19:50:08.427913 5996 leader_election.cc:343] T 556b32b8ccd54c439f86b0069e2a5ce0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:08.428225 6920 raft_consensus.cc:2804] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:08.428363 6920 raft_consensus.cc:493] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:08.428488 6920 raft_consensus.cc:3060] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:08.432744 6456 tablet_bootstrap.cc:492] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:08.432744 6920 raft_consensus.cc:515] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.432898 6456 ts_tablet_manager.cc:1403] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.178s user 0.002s sys 0.002s
I20260923 19:50:08.434719 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556b32b8ccd54c439f86b0069e2a5ce0" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:08.434892 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70b7662d85a4f64a11420448c4d140d" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:08.435047 6344 raft_consensus.cc:3060] T d70b7662d85a4f64a11420448c4d140d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
W20260923 19:50:08.435501 5995 leader_election.cc:343] T 556b32b8ccd54c439f86b0069e2a5ce0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:08.435640 5995 leader_election.cc:304] T 556b32b8ccd54c439f86b0069e2a5ce0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:08.436153 6773 raft_consensus.cc:2749] T 556b32b8ccd54c439f86b0069e2a5ce0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:08.433799 6456 raft_consensus.cc:359] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.437991 6456 raft_consensus.cc:385] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:08.438097 6456 raft_consensus.cc:740] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:08.438426 6456 consensus_queue.cc:260] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.439062 6456 ts_tablet_manager.cc:1434] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260923 19:50:08.439218 6454 tablet_bootstrap.cc:492] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:08.439371 6344 raft_consensus.cc:2468] T d70b7662d85a4f64a11420448c4d140d P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:08.439409 6454 ts_tablet_manager.cc:1403] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.094s user 0.004s sys 0.008s
I20260923 19:50:08.440419 6139 leader_election.cc:304] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:08.440423 6454 raft_consensus.cc:359] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.442703 6454 raft_consensus.cc:385] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:08.442821 6454 raft_consensus.cc:740] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:08.443106 6454 consensus_queue.cc:260] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.443233 6920 leader_election.cc:290] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:08.444408 6920 raft_consensus.cc:2804] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:08.444613 6920 raft_consensus.cc:697] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:08.444964 6920 consensus_queue.cc:237] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.456174 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 385) took 1266 ms. Trace:
I20260923 19:50:08.461525 6456 tablet_bootstrap.cc:492] T ec4284d6a0fa416ca95b4d675c8e3912 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:08.464530 6456 tablet_bootstrap.cc:654] T ec4284d6a0fa416ca95b4d675c8e3912 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:08.471441 5805 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7b455812687f42848df5290d0cdbc312 consensus state has no leader
I20260923 19:50:08.474119 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d95a477b9f434e00bd0d307b9a42ea22" } new_table_name: "default.Table_5f9a8360065c42c6b42e7ab6deb71bdf" modify_external_catalogs: true
W20260923 19:50:08.476419 5790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.143.254:37151, user_credentials={real_user=slave}} blocked reactor thread for 145904us
I20260923 19:50:08.478317 6459 rpcz_store.cc:276] 0923 19:50:07.189358 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.189403 (+ 45us) service_pool.cc:224] Handling call
0923 19:50:08.057979 (+868576us) ts_tablet_manager.cc:1151] Deleting tablet e1752d6b46894796bdc94e6230e3327d
0923 19:50:08.057993 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.138563 (+ 80570us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:08.353083 (+214520us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:08.456103 (+103020us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":868372}
I20260923 19:50:08.463950 6454 ts_tablet_manager.cc:1434] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.024s user 0.003s sys 0.004s
I20260923 19:50:08.479846 6454 tablet_bootstrap.cc:492] T d91a56bace854494b7affd6c766b2847 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:08.479806 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet e1752d6b46894796bdc94e6230e3327d (table default.Table_7c9010170aac47fdbbc0aa6b197ecac3 [id=387269136a564b4f9bc782c785066dd8]) successfully deleted
W20260923 19:50:08.480302 7005 negotiation.cc:336] Failed RPC negotiation. Trace:
0923 19:50:08.331535 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.5.143.254:37151 (local address 127.5.143.193:49851)
0923 19:50:08.461206 (+129671us) negotiation.cc:107] Waiting for socket to connect
0923 19:50:08.479428 (+ 18222us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.143.254:37151: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":129493,"thread_start_us":146360,"threads_started":1}
I20260923 19:50:08.481930 6454 tablet_bootstrap.cc:654] T d91a56bace854494b7affd6c766b2847 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:08.485065 7014 raft_consensus.cc:493] T 4b15b250f594459eb959b4871f7ae398 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260923 19:50:08.485123 6137 leader_election.cc:343] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: d70b7662d85a4f64a11420448c4d140d
I20260923 19:50:08.485292 7014 raft_consensus.cc:515] T 4b15b250f594459eb959b4871f7ae398 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.485595 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 386) took 1273 ms. Trace:
I20260923 19:50:08.485743 6459 rpcz_store.cc:276] 0923 19:50:07.212455 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.212544 (+ 89us) service_pool.cc:224] Handling call
0923 19:50:08.485429 (+1272885us) ts_tablet_manager.cc:1151] Deleting tablet 0c537304c32c44adaa1e05de4496293f
0923 19:50:08.485439 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.485548 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1269973}
W20260923 19:50:08.486387 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 0c537304c32c44adaa1e05de4496293f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c537304c32c44adaa1e05de4496293f already in progress: creating tablet
I20260923 19:50:08.485944 6454 tablet_bootstrap.cc:492] T d91a56bace854494b7affd6c766b2847 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:08.486765 7014 leader_election.cc:290] T 4b15b250f594459eb959b4871f7ae398 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:08.486857 7013 raft_consensus.cc:493] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:08.487033 7013 raft_consensus.cc:515] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.487905 7013 leader_election.cc:290] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:08.486869 6454 ts_tablet_manager.cc:1403] T d91a56bace854494b7affd6c766b2847 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.004s
I20260923 19:50:08.489540 6454 raft_consensus.cc:359] T d91a56bace854494b7affd6c766b2847 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:08.494982 5799 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 337f32eb47954689a6eb8f74408e01d9 consensus state has no leader
W20260923 19:50:08.496595 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 0c537304c32c44adaa1e05de4496293f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c537304c32c44adaa1e05de4496293f already in progress: creating tablet
W20260923 19:50:08.496848 5790 catalog_manager.cc:5030] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet b7f372b952804ac58e602998d9b77d72 because the tablet was not found. No further retry: Not found: Tablet not found: b7f372b952804ac58e602998d9b77d72
W20260923 19:50:08.497087 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 18bab39d85f94f4283f0b18c1c9b48a2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18bab39d85f94f4283f0b18c1c9b48a2 already in progress: creating tablet
W20260923 19:50:08.497346 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 474e34e902064764864ba06ef41b1d94 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 474e34e902064764864ba06ef41b1d94 already in progress: creating tablet
W20260923 19:50:08.497571 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 58ea466d1b2b40e9b9b4cd5be51f79e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58ea466d1b2b40e9b9b4cd5be51f79e0 already in progress: creating tablet
W20260923 19:50:08.497805 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet d09faa67bdc54d31a7f7a1b012de9ba1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d09faa67bdc54d31a7f7a1b012de9ba1 already in progress: creating tablet
W20260923 19:50:08.498081 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet d04b3a9ade7a405bb619704095fac279 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d04b3a9ade7a405bb619704095fac279 already in progress: creating tablet
W20260923 19:50:08.498394 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet a01a86b6fd4b44d3808c2040525d7b61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a01a86b6fd4b44d3808c2040525d7b61 already in progress: creating tablet
I20260923 19:50:08.498698 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 5725a9cb95c448d0a5ea8114e90bc9fe (table default.Table_da05e9879e314fd78f1b40a857a393fb [id=d3b60b7fc1d84a46aa49932d5c3363ea]) successfully deleted
W20260923 19:50:08.499007 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet efc63a151f6444dfb03c3f15f6f54473 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet efc63a151f6444dfb03c3f15f6f54473 already in progress: creating tablet
I20260923 19:50:08.500353 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_a1862929985946f7b4a445dab5afbab5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:08.504756 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1862929985946f7b4a445dab5afbab5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:08.504004 5791 catalog_manager.cc:5030] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 3190d18f00234d71b0a58c2c334ef45f because the tablet was not found. No further retry: Not found: Tablet not found: 3190d18f00234d71b0a58c2c334ef45f
W20260923 19:50:08.506595 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet c19298691d5d4209b2d1147a1aad2f6f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c19298691d5d4209b2d1147a1aad2f6f already in progress: creating tablet
W20260923 19:50:08.506903 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 035abecfbee7474d9dd048f35e28e867 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 035abecfbee7474d9dd048f35e28e867 already in progress: creating tablet
I20260923 19:50:08.507129 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 495292cacf3b42a5b633ad40e5e01972 (table default.Table_504b18d33ff6487da9b8f40467850853 [id=97f3cda15d6f4e258eece32745c45b50]) successfully deleted
I20260923 19:50:08.507447 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 623fb5b761134951a4b742ab2ba480a4 (table default.Table_526fa05830fd4679bd95ea4b8e9af682 [id=6cd1efd05c5d40d695658ba3aa1ddadc]) successfully deleted
W20260923 19:50:08.507702 5790 catalog_manager.cc:5030] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet b2762648045b4378bcc2c1234460c352 because the tablet was not found. No further retry: Not found: Tablet not found: b2762648045b4378bcc2c1234460c352
W20260923 19:50:08.507958 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet c5cb76fa5e084604aa58bf888cfe4852 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5cb76fa5e084604aa58bf888cfe4852 already in progress: creating tablet
W20260923 19:50:08.508244 5790 consensus_peers.cc:597] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b -> Peer 6b3d628214a34b4fa3ca0c1abe422bae (127.5.143.254:37151): Couldn't send request to peer 6b3d628214a34b4fa3ca0c1abe422bae. Status: Network error: Client connection negotiation failed: client connection to 127.5.143.254:37151: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:08.511539 6457 tablet_bootstrap.cc:492] T 2f627b7b9ff74750bd8dd59840bf77db P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:08.511737 6457 ts_tablet_manager.cc:1403] T 2f627b7b9ff74750bd8dd59840bf77db P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.145s user 0.033s sys 0.056s
I20260923 19:50:08.512516 6457 raft_consensus.cc:359] T 2f627b7b9ff74750bd8dd59840bf77db P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.512723 6457 raft_consensus.cc:385] T 2f627b7b9ff74750bd8dd59840bf77db P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:08.512789 6457 raft_consensus.cc:740] T 2f627b7b9ff74750bd8dd59840bf77db P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:08.513659 6457 consensus_queue.cc:260] T 2f627b7b9ff74750bd8dd59840bf77db P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.514230 6457 ts_tablet_manager.cc:1434] T 2f627b7b9ff74750bd8dd59840bf77db P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260923 19:50:08.514468 6454 raft_consensus.cc:385] T d91a56bace854494b7affd6c766b2847 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:08.514573 6454 raft_consensus.cc:740] T d91a56bace854494b7affd6c766b2847 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
W20260923 19:50:08.500013 6137 leader_election.cc:343] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: d70b7662d85a4f64a11420448c4d140d
I20260923 19:50:08.515013 6457 tablet_bootstrap.cc:492] T 359b08ef348d4be68b14f9e871a5e519 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
W20260923 19:50:08.502686 6139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.195:32855, user_credentials={real_user=slave}} blocked reactor thread for 62312.3us
I20260923 19:50:08.516776 6457 tablet_bootstrap.cc:654] T 359b08ef348d4be68b14f9e871a5e519 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:08.515054 6137 leader_election.cc:343] T 4b15b250f594459eb959b4871f7ae398 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 4b15b250f594459eb959b4871f7ae398
I20260923 19:50:08.462054 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 304) took 2508 ms. Trace:
I20260923 19:50:08.491250 6950 consensus_queue.cc:1048] T 6a34e178007b4e8ebed429cedf44e82a P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:08.515501 6920 raft_consensus.cc:493] T 5455beff354a4616a68d8746e3e4f9a8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:08.517335 6920 raft_consensus.cc:515] T 5455beff354a4616a68d8746e3e4f9a8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.515863 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9101e82501fd461f8a4b2dcd9dffbd74" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:08.517951 6343 raft_consensus.cc:2468] T 9101e82501fd461f8a4b2dcd9dffbd74 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
W20260923 19:50:08.518713 6137 leader_election.cc:343] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 9101e82501fd461f8a4b2dcd9dffbd74
I20260923 19:50:08.518857 6920 leader_election.cc:290] T 5455beff354a4616a68d8746e3e4f9a8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:08.519229 6139 leader_election.cc:304] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:08.516096 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b15b250f594459eb959b4871f7ae398" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:08.519629 6920 raft_consensus.cc:2804] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:08.519719 6920 raft_consensus.cc:493] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:08.519790 6920 raft_consensus.cc:3060] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:08.520830 6458 rpcz_store.cc:276] 0923 19:50:05.953991 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:05.954235 (+ 244us) service_pool.cc:224] Handling call
0923 19:50:08.461016 (+2506781us) ts_tablet_manager.cc:1151] Deleting tablet c012b2a92dc14f2ab5d9f4fe8a6a7779
0923 19:50:08.461812 (+ 796us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.461989 (+ 177us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2506556}
W20260923 19:50:08.522444 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet c012b2a92dc14f2ab5d9f4fe8a6a7779 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c012b2a92dc14f2ab5d9f4fe8a6a7779 already in progress: creating tablet
I20260923 19:50:08.522650 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 305) took 2503 ms. Trace:
I20260923 19:50:08.522742 6454 consensus_queue.cc:260] T d91a56bace854494b7affd6c766b2847 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.522786 6458 rpcz_store.cc:276] 0923 19:50:06.018943 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:06.026358 (+ 7415us) service_pool.cc:224] Handling call
0923 19:50:08.522417 (+2496059us) ts_tablet_manager.cc:1151] Deleting tablet 908596339b2e4f7f8ddb7f9cd5bdcc3e
0923 19:50:08.522432 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.522585 (+ 153us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2468113}
I20260923 19:50:08.523283 6454 ts_tablet_manager.cc:1434] T d91a56bace854494b7affd6c766b2847 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.035s user 0.001s sys 0.000s
W20260923 19:50:08.523284 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 908596339b2e4f7f8ddb7f9cd5bdcc3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 908596339b2e4f7f8ddb7f9cd5bdcc3e already in progress: creating tablet
I20260923 19:50:08.523515 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 317) took 2110 ms. Trace:
I20260923 19:50:08.523669 6454 tablet_bootstrap.cc:492] T 5c0142f4e3ad42048803481d68f0ee5d P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:08.523664 6458 rpcz_store.cc:276] 0923 19:50:06.413648 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:06.414594 (+ 946us) service_pool.cc:224] Handling call
0923 19:50:08.523287 (+2108693us) ts_tablet_manager.cc:1151] Deleting tablet a10d35bf564d45488524d3d21721f4e5
0923 19:50:08.523300 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.523465 (+ 165us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2104175}
W20260923 19:50:08.524292 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet a10d35bf564d45488524d3d21721f4e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a10d35bf564d45488524d3d21721f4e5 already in progress: creating tablet
I20260923 19:50:08.524322 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 319) took 2106 ms. Trace:
I20260923 19:50:08.524471 6458 rpcz_store.cc:276] 0923 19:50:06.417463 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:06.417657 (+ 194us) service_pool.cc:224] Handling call
0923 19:50:08.524137 (+2106480us) ts_tablet_manager.cc:1151] Deleting tablet d8c8bfa9b7424b9f80f76e0bb05cbc0c
0923 19:50:08.524148 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.524268 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2104325}
W20260923 19:50:08.524910 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet d8c8bfa9b7424b9f80f76e0bb05cbc0c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d8c8bfa9b7424b9f80f76e0bb05cbc0c already in progress: creating tablet
I20260923 19:50:08.525099 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 318) took 2107 ms. Trace:
I20260923 19:50:08.525429 6458 rpcz_store.cc:276] 0923 19:50:06.417263 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:06.417363 (+ 100us) service_pool.cc:224] Handling call
0923 19:50:08.524912 (+2107549us) ts_tablet_manager.cc:1151] Deleting tablet 623052a8c9c2436a828655da6cf6d379
0923 19:50:08.524923 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.525045 (+ 122us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2104970}
I20260923 19:50:08.525668 6454 tablet_bootstrap.cc:654] T 5c0142f4e3ad42048803481d68f0ee5d P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:08.525990 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 623052a8c9c2436a828655da6cf6d379 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 623052a8c9c2436a828655da6cf6d379 already in progress: creating tablet
I20260923 19:50:08.526252 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 320) took 2108 ms. Trace:
I20260923 19:50:08.526400 6458 rpcz_store.cc:276] 0923 19:50:06.417558 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:06.417678 (+ 120us) service_pool.cc:224] Handling call
0923 19:50:08.526005 (+2108327us) ts_tablet_manager.cc:1151] Deleting tablet b9c187ee1fa8438397c83bc2c2b16925
0923 19:50:08.526017 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.526191 (+ 174us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2105790}
W20260923 19:50:08.526889 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet b9c187ee1fa8438397c83bc2c2b16925 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9c187ee1fa8438397c83bc2c2b16925 already in progress: creating tablet
I20260923 19:50:08.527122 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 322) took 2072 ms. Trace:
I20260923 19:50:08.504248 6459 tablet_replica.cc:333] T a1e8b8e638ec438a86f05fa147cdb27c P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:08.530429 6458 rpcz_store.cc:276] 0923 19:50:06.455003 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:06.455076 (+ 73us) service_pool.cc:224] Handling call
0923 19:50:08.526894 (+2071818us) ts_tablet_manager.cc:1151] Deleting tablet a926ff092e6e495e981be156421e8d72
0923 19:50:08.526905 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.527063 (+ 158us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2070904}
W20260923 19:50:08.531059 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet a926ff092e6e495e981be156421e8d72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a926ff092e6e495e981be156421e8d72 already in progress: creating tablet
I20260923 19:50:08.531255 6458 tablet_replica.cc:333] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:08.531554 6458 raft_consensus.cc:2243] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:08.532151 6458 raft_consensus.cc:2272] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:08.532898 6458 ts_tablet_manager.cc:1916] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:08.536405 6139 leader_election.cc:343] T 5455beff354a4616a68d8746e3e4f9a8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 5455beff354a4616a68d8746e3e4f9a8
I20260923 19:50:08.536926 6139 leader_election.cc:304] T 4b15b250f594459eb959b4871f7ae398 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:08.538254 6920 raft_consensus.cc:515] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.538758 6459 raft_consensus.cc:2243] T a1e8b8e638ec438a86f05fa147cdb27c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:08.538863 7013 raft_consensus.cc:2749] T 4b15b250f594459eb959b4871f7ae398 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:08.538957 6459 raft_consensus.cc:2272] T a1e8b8e638ec438a86f05fa147cdb27c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:08.539633 6459 ts_tablet_manager.cc:1916] T a1e8b8e638ec438a86f05fa147cdb27c P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:08.541391 6920 leader_election.cc:290] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:08.542228 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9101e82501fd461f8a4b2dcd9dffbd74" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:08.542436 6344 raft_consensus.cc:3060] T 9101e82501fd461f8a4b2dcd9dffbd74 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:08.545423 6344 raft_consensus.cc:2468] T 9101e82501fd461f8a4b2dcd9dffbd74 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:08.549798 6139 leader_election.cc:304] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:08.550318 6920 raft_consensus.cc:2804] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:08.550593 6920 raft_consensus.cc:697] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:08.551783 6948 tablet.cc:1751] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:08.550922 6920 consensus_queue.cc:237] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.556623 6958 tablet.cc:1751] T 0a5ce253bcce410b9517449f133d39e8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:08.560636 6456 tablet_bootstrap.cc:492] T ec4284d6a0fa416ca95b4d675c8e3912 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:08.560866 6456 ts_tablet_manager.cc:1403] T ec4284d6a0fa416ca95b4d675c8e3912 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.099s user 0.000s sys 0.010s
I20260923 19:50:08.561683 6456 raft_consensus.cc:359] T ec4284d6a0fa416ca95b4d675c8e3912 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.561939 6456 raft_consensus.cc:385] T ec4284d6a0fa416ca95b4d675c8e3912 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:08.562034 6456 raft_consensus.cc:740] T ec4284d6a0fa416ca95b4d675c8e3912 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:08.562348 6456 consensus_queue.cc:260] T ec4284d6a0fa416ca95b4d675c8e3912 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.562978 6456 ts_tablet_manager.cc:1434] T ec4284d6a0fa416ca95b4d675c8e3912 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260923 19:50:08.563975 6456 tablet_bootstrap.cc:492] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:08.565816 6456 tablet_bootstrap.cc:654] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:08.567418 6457 tablet_bootstrap.cc:492] T 359b08ef348d4be68b14f9e871a5e519 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:08.567642 6457 ts_tablet_manager.cc:1403] T 359b08ef348d4be68b14f9e871a5e519 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.053s user 0.006s sys 0.008s
I20260923 19:50:08.568547 6457 raft_consensus.cc:359] T 359b08ef348d4be68b14f9e871a5e519 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.568749 6457 raft_consensus.cc:385] T 359b08ef348d4be68b14f9e871a5e519 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:08.568912 6457 raft_consensus.cc:740] T 359b08ef348d4be68b14f9e871a5e519 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:08.569159 6457 consensus_queue.cc:260] T 359b08ef348d4be68b14f9e871a5e519 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.569842 6457 ts_tablet_manager.cc:1434] T 359b08ef348d4be68b14f9e871a5e519 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:08.570176 6457 tablet_bootstrap.cc:492] T daafbafae5004b8499e7ea93342c0517 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:08.571889 6457 tablet_bootstrap.cc:654] T daafbafae5004b8499e7ea93342c0517 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:08.577538 6137 leader_election.cc:343] T 5455beff354a4616a68d8746e3e4f9a8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 5455beff354a4616a68d8746e3e4f9a8
I20260923 19:50:08.577864 6137 leader_election.cc:304] T 5455beff354a4616a68d8746e3e4f9a8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:08.578576 7013 raft_consensus.cc:2749] T 5455beff354a4616a68d8746e3e4f9a8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:08.580209 5803 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 146a402ff29a4e0b834a9f270d61e21c consensus state has no leader
W20260923 19:50:08.580397 6137 leader_election.cc:343] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 9101e82501fd461f8a4b2dcd9dffbd74
I20260923 19:50:08.581822 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 18a31ed6bea444e7888f374927f90a60 (DEFAULT_TABLE table=default.Table_52b79fc3cba74d7cbf3e52760f964edd [id=6f9ac3e4264245358d37624ba8d8fa73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.582408 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18a31ed6bea444e7888f374927f90a60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.583141 5801 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet ec4cc8a742114e5fb07c5c9157ce09e8 (table default.Table_2adc87e06d81491498aa018f49fdc08d [id=89181985e6154c7fa946148e48bef2eb]). Expected version 2 got 0
I20260923 19:50:08.583535 5801 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 0a5ce253bcce410b9517449f133d39e8 (table default.Table_84d13e1ea6234e5ca45738376e83f537 [id=0d4f6a5bb30c4d2a937424cf0e651afd]). Expected version 1 got 0
I20260923 19:50:08.584564 6165 tablet_service.cc:1511] Processing CreateTablet for tablet 18a31ed6bea444e7888f374927f90a60 (DEFAULT_TABLE table=default.Table_52b79fc3cba74d7cbf3e52760f964edd [id=6f9ac3e4264245358d37624ba8d8fa73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.585069 6165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18a31ed6bea444e7888f374927f90a60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.587513 6179 tablet_service.cc:1511] Processing CreateTablet for tablet 4c6f9953649a43aa9a0edd78b7bd47a4 (DEFAULT_TABLE table=default.Table_dc4eebd8c2d34e1b988008ab9b783cff [id=dda3ef495bce4b87bf1429ed45b3e194]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.588056 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c6f9953649a43aa9a0edd78b7bd47a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.594388 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 2bc47336948746d694d5a896730c501c (DEFAULT_TABLE table=default.Table_8eba59cb9a3843738a7bd980139febb7 [id=ae53e002c7f0400ab80f8d83a958e1b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.594980 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bc47336948746d694d5a896730c501c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.589833 6458 ts_tablet_manager.cc:1929] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260923 19:50:08.604033 6026 tablet_service.cc:1511] Processing CreateTablet for tablet 4c6f9953649a43aa9a0edd78b7bd47a4 (DEFAULT_TABLE table=default.Table_dc4eebd8c2d34e1b988008ab9b783cff [id=dda3ef495bce4b87bf1429ed45b3e194]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.604136 6022 tablet_service.cc:1511] Processing CreateTablet for tablet 839bcf991b754f9e95a1dd6c4f826e71 (DEFAULT_TABLE table=default.Table_c61ffa0e84514cddb714dc30da0a21f6 [id=3ee0e52e785f4cb39add98261628d513]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.604764 6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c6f9953649a43aa9a0edd78b7bd47a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.605849 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 14c917ac93fd436aa13fb0839fae883f (DEFAULT_TABLE table=default.Table_72a581bef73d4b24868e54dc6e544838 [id=f74ac9337bca41168a71a13e62116a09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.606197 6032 tablet_service.cc:1511] Processing CreateTablet for tablet 2bc47336948746d694d5a896730c501c (DEFAULT_TABLE table=default.Table_8eba59cb9a3843738a7bd980139febb7 [id=ae53e002c7f0400ab80f8d83a958e1b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.606377 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 12bda2ae961446bea2f34e792f4f1706 (DEFAULT_TABLE table=default.Table_71cd58805ce747c3bbe35af74bb03cd6 [id=2d69a962a7234afeb8366c66555b91e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.606390 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14c917ac93fd436aa13fb0839fae883f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.606763 6029 tablet_service.cc:1511] Processing CreateTablet for tablet d5d3f96ebf1c4d05aceb06ef53737e4f (DEFAULT_TABLE table=default.Table_d95a477b9f434e00bd0d307b9a42ea22 [id=1e1ce17e7c394d7cbb8a4ec6e64dee8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.607064 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5d3f96ebf1c4d05aceb06ef53737e4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.610220 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12bda2ae961446bea2f34e792f4f1706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.610340 6031 tablet_service.cc:1511] Processing CreateTablet for tablet 8b8a973b247343008a29d67dfa712a0b (DEFAULT_TABLE table=default.Table_1f297daf5bc14178ad44933d06931e1f [id=3081bd7d31f4419c86a4583312115999]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.610890 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b8a973b247343008a29d67dfa712a0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.614185 6027 tablet_service.cc:1511] Processing CreateTablet for tablet b6ef90ddd7a34dfdb8309d0e1c3688e7 (DEFAULT_TABLE table=default.Table_5fddffc3232840a1897043b514d0e68b [id=3382d05ca17e45efae6c9c6f4e854edf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.614609 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6ef90ddd7a34dfdb8309d0e1c3688e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.618193 6021 tablet_service.cc:1511] Processing CreateTablet for tablet 146a402ff29a4e0b834a9f270d61e21c (DEFAULT_TABLE table=default.Table_8e43f2a7e2aa40e8afe8272232c65a8e [id=834c18797d8e48a79c45628c5180b80b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.618588 6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 146a402ff29a4e0b834a9f270d61e21c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.622185 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 839bcf991b754f9e95a1dd6c4f826e71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.626042 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bc47336948746d694d5a896730c501c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.627243 6030 tablet_service.cc:1511] Processing CreateTablet for tablet f28da30d48454ffd9626df789a2f2063 (DEFAULT_TABLE table=default.Table_7d7ca8e644fb4245b276ecea1534ff91 [id=e319867d5e9c46c79d9f5a564faec3e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.627626 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f28da30d48454ffd9626df789a2f2063. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.634718 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 839bcf991b754f9e95a1dd6c4f826e71 (DEFAULT_TABLE table=default.Table_c61ffa0e84514cddb714dc30da0a21f6 [id=3ee0e52e785f4cb39add98261628d513]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.635223 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 839bcf991b754f9e95a1dd6c4f826e71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.640650 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 8b8a973b247343008a29d67dfa712a0b (DEFAULT_TABLE table=default.Table_1f297daf5bc14178ad44933d06931e1f [id=3081bd7d31f4419c86a4583312115999]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.641083 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b8a973b247343008a29d67dfa712a0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.642536 6028 tablet_service.cc:1511] Processing CreateTablet for tablet c013c07fd27a46f29a464d73fe752e10 (DEFAULT_TABLE table=default.Table_e14fb17a6d3146409662b5f989ee9f15 [id=57e6db69771648aa8952d2385f25ad45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.643148 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c013c07fd27a46f29a464d73fe752e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.646275 6034 tablet_service.cc:1511] Processing CreateTablet for tablet a367cf3788ef49148a5c8d6864f71d8e (DEFAULT_TABLE table=default.Table_da05e9879e314fd78f1b40a857a393fb [id=d3b60b7fc1d84a46aa49932d5c3363ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.646983 6176 tablet_service.cc:1511] Processing CreateTablet for tablet 12bda2ae961446bea2f34e792f4f1706 (DEFAULT_TABLE table=default.Table_71cd58805ce747c3bbe35af74bb03cd6 [id=2d69a962a7234afeb8366c66555b91e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.647156 6168 tablet_service.cc:1511] Processing CreateTablet for tablet 146a402ff29a4e0b834a9f270d61e21c (DEFAULT_TABLE table=default.Table_8e43f2a7e2aa40e8afe8272232c65a8e [id=834c18797d8e48a79c45628c5180b80b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.647408 6176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12bda2ae961446bea2f34e792f4f1706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.647667 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 146a402ff29a4e0b834a9f270d61e21c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.650676 6180 tablet_service.cc:1511] Processing CreateTablet for tablet a367cf3788ef49148a5c8d6864f71d8e (DEFAULT_TABLE table=default.Table_da05e9879e314fd78f1b40a857a393fb [id=d3b60b7fc1d84a46aa49932d5c3363ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.651152 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a367cf3788ef49148a5c8d6864f71d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.654357 6164 tablet_service.cc:1511] Processing CreateTablet for tablet c013c07fd27a46f29a464d73fe752e10 (DEFAULT_TABLE table=default.Table_e14fb17a6d3146409662b5f989ee9f15 [id=57e6db69771648aa8952d2385f25ad45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.654930 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c013c07fd27a46f29a464d73fe752e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.658355 6174 tablet_service.cc:1511] Processing CreateTablet for tablet f28da30d48454ffd9626df789a2f2063 (DEFAULT_TABLE table=default.Table_7d7ca8e644fb4245b276ecea1534ff91 [id=e319867d5e9c46c79d9f5a564faec3e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.658931 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f28da30d48454ffd9626df789a2f2063. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.659536 6454 tablet_bootstrap.cc:492] T 5c0142f4e3ad42048803481d68f0ee5d P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:08.659952 6454 ts_tablet_manager.cc:1403] T 5c0142f4e3ad42048803481d68f0ee5d P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.136s user 0.001s sys 0.004s
I20260923 19:50:08.661031 6454 raft_consensus.cc:359] T 5c0142f4e3ad42048803481d68f0ee5d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.662308 6169 tablet_service.cc:1511] Processing CreateTablet for tablet cf0caa6afcf546678c233a9333b77a2a (DEFAULT_TABLE table=default.Table_a3fdc430d3554365b41daaa0baa5ebb8 [id=f465f2caf6544a0ab7eda8fe4a377572]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.665752 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf0caa6afcf546678c233a9333b77a2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.667678 6323 tablet_service.cc:1511] Processing CreateTablet for tablet 18a31ed6bea444e7888f374927f90a60 (DEFAULT_TABLE table=default.Table_52b79fc3cba74d7cbf3e52760f964edd [id=6f9ac3e4264245358d37624ba8d8fa73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.668181 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18a31ed6bea444e7888f374927f90a60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.669854 6814 raft_consensus.cc:493] T 42e9cbcf77324d91abd029c12eaf950d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:08.670029 6814 raft_consensus.cc:515] T 42e9cbcf77324d91abd029c12eaf950d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.670756 6814 leader_election.cc:290] T 42e9cbcf77324d91abd029c12eaf950d P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:08.670994 6458 log.cc:1199] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/b2762648045b4378bcc2c1234460c352
I20260923 19:50:08.671085 6950 raft_consensus.cc:493] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:08.672391 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a367cf3788ef49148a5c8d6864f71d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.673000 6950 raft_consensus.cc:515] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.673683 6928 raft_consensus.cc:493] T e9cbfaa34c924a678f23cbcbf1a6fb0a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:08.673720 6950 leader_election.cc:290] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:08.674561 6928 raft_consensus.cc:515] T e9cbfaa34c924a678f23cbcbf1a6fb0a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.675184 6309 tablet_service.cc:1511] Processing CreateTablet for tablet 2bc47336948746d694d5a896730c501c (DEFAULT_TABLE table=default.Table_8eba59cb9a3843738a7bd980139febb7 [id=ae53e002c7f0400ab80f8d83a958e1b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.674646 6319 tablet_service.cc:1511] Processing CreateTablet for tablet 4c6f9953649a43aa9a0edd78b7bd47a4 (DEFAULT_TABLE table=default.Table_dc4eebd8c2d34e1b988008ab9b783cff [id=dda3ef495bce4b87bf1429ed45b3e194]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.676165 6458 ts_tablet_manager.cc:1950] T b2762648045b4378bcc2c1234460c352 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:08.677992 6928 leader_election.cc:290] T e9cbfaa34c924a678f23cbcbf1a6fb0a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:08.678357 6321 tablet_service.cc:1511] Processing CreateTablet for tablet d5d3f96ebf1c4d05aceb06ef53737e4f (DEFAULT_TABLE table=default.Table_d95a477b9f434e00bd0d307b9a42ea22 [id=1e1ce17e7c394d7cbb8a4ec6e64dee8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.678865 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 839bcf991b754f9e95a1dd6c4f826e71 (DEFAULT_TABLE table=default.Table_c61ffa0e84514cddb714dc30da0a21f6 [id=3ee0e52e785f4cb39add98261628d513]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.679373 6306 tablet_service.cc:1511] Processing CreateTablet for tablet 8b8a973b247343008a29d67dfa712a0b (DEFAULT_TABLE table=default.Table_1f297daf5bc14178ad44933d06931e1f [id=3081bd7d31f4419c86a4583312115999]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.679865 6311 tablet_service.cc:1511] Processing CreateTablet for tablet b6ef90ddd7a34dfdb8309d0e1c3688e7 (DEFAULT_TABLE table=default.Table_5fddffc3232840a1897043b514d0e68b [id=3382d05ca17e45efae6c9c6f4e854edf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.680101 6030 tablet_service.cc:1511] Processing CreateTablet for tablet cf0caa6afcf546678c233a9333b77a2a (DEFAULT_TABLE table=default.Table_a3fdc430d3554365b41daaa0baa5ebb8 [id=f465f2caf6544a0ab7eda8fe4a377572]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.680332 6320 tablet_service.cc:1511] Processing CreateTablet for tablet 14c917ac93fd436aa13fb0839fae883f (DEFAULT_TABLE table=default.Table_72a581bef73d4b24868e54dc6e544838 [id=f74ac9337bca41168a71a13e62116a09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.680409 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4cc8a742114e5fb07c5c9157ce09e8" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:08.680830 6059 raft_consensus.cc:2468] T ec4cc8a742114e5fb07c5c9157ce09e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:08.684521 6324 tablet_service.cc:1511] Processing CreateTablet for tablet a367cf3788ef49148a5c8d6864f71d8e (DEFAULT_TABLE table=default.Table_da05e9879e314fd78f1b40a857a393fb [id=d3b60b7fc1d84a46aa49932d5c3363ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.685863 6309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bc47336948746d694d5a896730c501c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.686620 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 323) took 2168 ms. Trace:
I20260923 19:50:08.686846 6458 rpcz_store.cc:276] 0923 19:50:06.517854 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:06.517932 (+ 78us) service_pool.cc:224] Handling call
0923 19:50:08.531061 (+2013129us) ts_tablet_manager.cc:1151] Deleting tablet b2762648045b4378bcc2c1234460c352
0923 19:50:08.531074 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.572254 (+ 41180us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:08.589685 (+ 17431us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:08.686571 (+ 96886us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2012929}
I20260923 19:50:08.687451 6320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14c917ac93fd436aa13fb0839fae883f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.688167 6316 tablet_service.cc:1511] Processing CreateTablet for tablet 146a402ff29a4e0b834a9f270d61e21c (DEFAULT_TABLE table=default.Table_8e43f2a7e2aa40e8afe8272232c65a8e [id=834c18797d8e48a79c45628c5180b80b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.687875 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet b2762648045b4378bcc2c1234460c352 (table default.Table_f57f8cacbedb49c6be509b51c824b960 [id=ada5cc6ef65b4859bf027fd3af9ad0f2]) successfully deleted
I20260923 19:50:08.688716 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf0caa6afcf546678c233a9333b77a2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.688678 6308 tablet_service.cc:1511] Processing CreateTablet for tablet 12bda2ae961446bea2f34e792f4f1706 (DEFAULT_TABLE table=default.Table_71cd58805ce747c3bbe35af74bb03cd6 [id=2d69a962a7234afeb8366c66555b91e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.688982 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 325) took 2120 ms. Trace:
I20260923 19:50:08.689267 6312 tablet_service.cc:1511] Processing CreateTablet for tablet c013c07fd27a46f29a464d73fe752e10 (DEFAULT_TABLE table=default.Table_e14fb17a6d3146409662b5f989ee9f15 [id=57e6db69771648aa8952d2385f25ad45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.689862 6314 tablet_service.cc:1511] Processing CreateTablet for tablet f28da30d48454ffd9626df789a2f2063 (DEFAULT_TABLE table=default.Table_7d7ca8e644fb4245b276ecea1534ff91 [id=e319867d5e9c46c79d9f5a564faec3e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.689567 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_aad0a22c213c44f9b67c092d40fd8455"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:08.690217 6029 tablet_service.cc:1511] Processing CreateTablet for tablet ebc288d8d453481592df11cd1bfed3ac (DEFAULT_TABLE table=default.Table_a0bee41bcb2d439fb8619a6c19152813 [id=8a710c10b5ca42548116d743cb0812c3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:08.690469 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aad0a22c213c44f9b67c092d40fd8455 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:08.690600 6317 tablet_service.cc:1511] Processing CreateTablet for tablet cf0caa6afcf546678c233a9333b77a2a (DEFAULT_TABLE table=default.Table_a3fdc430d3554365b41daaa0baa5ebb8 [id=f465f2caf6544a0ab7eda8fe4a377572]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:08.691062 6279 leader_election.cc:343] T 42e9cbcf77324d91abd029c12eaf950d P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 42e9cbcf77324d91abd029c12eaf950d
I20260923 19:50:08.691367 6279 leader_election.cc:304] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:08.691951 7018 raft_consensus.cc:2804] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:08.692057 7018 raft_consensus.cc:493] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:08.697165 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebc288d8d453481592df11cd1bfed3ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.698727 7018 raft_consensus.cc:3060] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
W20260923 19:50:08.698894 5805 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d5d3f96ebf1c4d05aceb06ef53737e4f consensus state has no leader
I20260923 19:50:08.699936 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5819e2b3c82046279b4be250aa5ca72b" } new_table_name: "default.Table_18c4ff5b068d4ee9a3591ef2714d5325" modify_external_catalogs: true
I20260923 19:50:08.700057 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cbfaa34c924a678f23cbcbf1a6fb0a" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:08.701212 5996 leader_election.cc:343] T e9cbfaa34c924a678f23cbcbf1a6fb0a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:08.702883 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6ef90ddd7a34dfdb8309d0e1c3688e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.704280 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5d3f96ebf1c4d05aceb06ef53737e4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.704522 6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 146a402ff29a4e0b834a9f270d61e21c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.704707 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf0caa6afcf546678c233a9333b77a2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.706915 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 839bcf991b754f9e95a1dd6c4f826e71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.707165 6319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c6f9953649a43aa9a0edd78b7bd47a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.707358 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c013c07fd27a46f29a464d73fe752e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.708432 6306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b8a973b247343008a29d67dfa712a0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.665786 6454 raft_consensus.cc:385] T 5c0142f4e3ad42048803481d68f0ee5d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:08.712955 5799 master_service.cc:960] ReplaceTablet: received request to replace tablet d91a56bace854494b7affd6c766b2847 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:08.713595 5796 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_ff99741064094cc2b9debbfffc81526a [id=4300ad9818924415b6414ea9f89445ce] alter complete (version 3)
I20260923 19:50:08.714107 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a367cf3788ef49148a5c8d6864f71d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.714835 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12bda2ae961446bea2f34e792f4f1706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.714864 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_416d1e6300c44657bdc13cbaa5cb5af0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:08.715090 5800 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_91a9675177604eb39c32e86718c59d31" } modify_external_catalogs: true
I20260923 19:50:08.715297 5800 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_91a9675177604eb39c32e86718c59d31" } modify_external_catalogs: true
I20260923 19:50:08.715451 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f28da30d48454ffd9626df789a2f2063. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:08.715488 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_416d1e6300c44657bdc13cbaa5cb5af0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:08.716732 6458 rpcz_store.cc:276] 0923 19:50:06.567411 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:06.567723 (+ 312us) service_pool.cc:224] Handling call
0923 19:50:08.687167 (+2119444us) ts_tablet_manager.cc:1151] Deleting tablet b985acc650334497832cf4505e1b0043
0923 19:50:08.687175 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.687720 (+ 545us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2105610}
I20260923 19:50:08.717188 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 324) took 2150 ms. Trace:
I20260923 19:50:08.717440 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_365f750c2926431db2f53e5b6dd09af4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:08.717969 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_365f750c2926431db2f53e5b6dd09af4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:08.720139 6178 tablet_service.cc:1511] Processing CreateTablet for tablet b6ef90ddd7a34dfdb8309d0e1c3688e7 (DEFAULT_TABLE table=default.Table_5fddffc3232840a1897043b514d0e68b [id=3382d05ca17e45efae6c9c6f4e854edf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.723023 7018 raft_consensus.cc:515] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.725395 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet ce6b86f947ce420994eaa5ff39ad9c87
I20260923 19:50:08.725541 7018 leader_election.cc:290] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:08.726089 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4cc8a742114e5fb07c5c9157ce09e8" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:08.726307 6059 raft_consensus.cc:3060] T ec4cc8a742114e5fb07c5c9157ce09e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:08.728679 5804 catalog_manager.cc:5838] T 5427b0f0218d4131b68a39e8e3bf02e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193). New cstate: current_term: 1 leader_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: UNKNOWN } } }
I20260923 19:50:08.729358 5804 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 337f32eb47954689a6eb8f74408e01d9 (table default.Table_c80b112b6ce9402f87b07ee8a6e1b78b [id=f509f74bbf6b4b6381509c265432cbd7]). Expected version 2 got 0
I20260923 19:50:08.729636 6059 raft_consensus.cc:2468] T ec4cc8a742114e5fb07c5c9157ce09e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:08.731422 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9cbcf77324d91abd029c12eaf950d" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:08.731766 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet b985acc650334497832cf4505e1b0043 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b985acc650334497832cf4505e1b0043 already in progress: creating tablet
I20260923 19:50:08.731899 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cbfaa34c924a678f23cbcbf1a6fb0a" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:08.733501 6279 leader_election.cc:304] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:08.734113 6458 rpcz_store.cc:276] 0923 19:50:06.566446 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:06.567156 (+ 710us) service_pool.cc:224] Handling call
0923 19:50:08.717040 (+2149884us) ts_tablet_manager.cc:1151] Deleting tablet b87872fb6cc0400c86eddffb29c898e8
0923 19:50:08.717050 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.717155 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39,"tablet-delete.queue_time_us":2135473}
I20260923 19:50:08.736025 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 342) took 1706 ms. Trace:
I20260923 19:50:08.737109 6458 rpcz_store.cc:276] 0923 19:50:07.029335 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.029420 (+ 85us) service_pool.cc:224] Handling call
0923 19:50:08.734954 (+1705534us) ts_tablet_manager.cc:1151] Deleting tablet 0e123b69877e4b1fbcdb2b27960864e9
0923 19:50:08.734965 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.735974 (+ 1009us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1696025}
W20260923 19:50:08.737450 5995 leader_election.cc:343] T e9cbfaa34c924a678f23cbcbf1a6fb0a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:08.737537 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 343) took 1690 ms. Trace:
I20260923 19:50:08.737591 5995 leader_election.cc:304] T e9cbfaa34c924a678f23cbcbf1a6fb0a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:08.738057 6928 raft_consensus.cc:2749] T e9cbfaa34c924a678f23cbcbf1a6fb0a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:08.735240 6165 tablet_service.cc:1511] Processing CreateTablet for tablet d5d3f96ebf1c4d05aceb06ef53737e4f (DEFAULT_TABLE table=default.Table_d95a477b9f434e00bd0d307b9a42ea22 [id=1e1ce17e7c394d7cbb8a4ec6e64dee8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.739502 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet fe5d081a41a3417b855656ca6e24f235
I20260923 19:50:08.739568 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet e9cbfaa34c924a678f23cbcbf1a6fb0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:08.739828 6461 tablet_replica.cc:333] T e9cbfaa34c924a678f23cbcbf1a6fb0a P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:08.740003 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet ce6b86f947ce420994eaa5ff39ad9c87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:08.740072 6461 raft_consensus.cc:2243] T e9cbfaa34c924a678f23cbcbf1a6fb0a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:08.740233 6461 raft_consensus.cc:2272] T e9cbfaa34c924a678f23cbcbf1a6fb0a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:08.740797 6461 ts_tablet_manager.cc:1916] T e9cbfaa34c924a678f23cbcbf1a6fb0a P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:08.742520 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet fe5d081a41a3417b855656ca6e24f235 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:08.742543 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet a08446fcf1794dab9d3181904507456f
I20260923 19:50:08.743059 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 658253ff3d014361803e1aeda978e59a
I20260923 19:50:08.743172 5802 master_service.cc:960] ReplaceTablet: received request to replace tablet 30fe07956e8940fcb7ba1e2e16ced463 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:08.743834 5797 master_service.cc:960] ReplaceTablet: received request to replace tablet 337f32eb47954689a6eb8f74408e01d9 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:08.745211 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet a08446fcf1794dab9d3181904507456f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:08.747524 6280 consensus_peers.cc:597] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:08.748689 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet 658253ff3d014361803e1aeda978e59a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:08.749931 7013 raft_consensus.cc:493] T d91a56bace854494b7affd6c766b2847 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:08.749846 6313 tablet_service.cc:1558] Processing DeleteTablet for tablet ce6b86f947ce420994eaa5ff39ad9c87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:08.751077 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4cc8a742114e5fb07c5c9157ce09e8" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:08.751202 6318 tablet_service.cc:1558] Processing DeleteTablet for tablet 42e9cbcf77324d91abd029c12eaf950d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:08.751572 6461 ts_tablet_manager.cc:1929] T e9cbfaa34c924a678f23cbcbf1a6fb0a P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:08.751657 6176 tablet_service.cc:1558] Processing DeleteTablet for tablet fe5d081a41a3417b855656ca6e24f235 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:08.751736 6461 log.cc:1199] T e9cbfaa34c924a678f23cbcbf1a6fb0a P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/e9cbfaa34c924a678f23cbcbf1a6fb0a
I20260923 19:50:08.752614 6461 ts_tablet_manager.cc:1950] T e9cbfaa34c924a678f23cbcbf1a6fb0a P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:08.744349 7018 raft_consensus.cc:2804] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:08.754279 7018 raft_consensus.cc:697] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:08.737641 6458 rpcz_store.cc:276] 0923 19:50:07.047330 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.048203 (+ 873us) service_pool.cc:224] Handling call
0923 19:50:08.737398 (+1689195us) ts_tablet_manager.cc:1151] Deleting tablet 58c24aa494bc4da28536dfa1df6123b7
0923 19:50:08.737411 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.737506 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1688913}
I20260923 19:50:08.755986 7018 consensus_queue.cc:237] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.757340 6457 tablet_bootstrap.cc:492] T daafbafae5004b8499e7ea93342c0517 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:08.757532 6457 ts_tablet_manager.cc:1403] T daafbafae5004b8499e7ea93342c0517 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.187s user 0.004s sys 0.001s
I20260923 19:50:08.758162 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet e9cbfaa34c924a678f23cbcbf1a6fb0a (table default.Table_7e1ef96ed9694a29966dfbace1a5f555 [id=94ef9897f5c44524ae14f2b721a586e1]) successfully deleted
I20260923 19:50:08.758389 6457 raft_consensus.cc:359] T daafbafae5004b8499e7ea93342c0517 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.758669 6457 raft_consensus.cc:385] T daafbafae5004b8499e7ea93342c0517 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:08.758747 6457 raft_consensus.cc:740] T daafbafae5004b8499e7ea93342c0517 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
W20260923 19:50:08.758285 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet b87872fb6cc0400c86eddffb29c898e8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b87872fb6cc0400c86eddffb29c898e8 already in progress: creating tablet
I20260923 19:50:08.759008 6457 consensus_queue.cc:260] T daafbafae5004b8499e7ea93342c0517 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:08.758460 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet ce6b86f947ce420994eaa5ff39ad9c87 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce6b86f947ce420994eaa5ff39ad9c87 already in progress: creating tablet
W20260923 19:50:08.759955 6280 leader_election.cc:343] T 42e9cbcf77324d91abd029c12eaf950d P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:08.760308 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet fe5d081a41a3417b855656ca6e24f235 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe5d081a41a3417b855656ca6e24f235 already in progress: creating tablet
W20260923 19:50:08.760576 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet a08446fcf1794dab9d3181904507456f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a08446fcf1794dab9d3181904507456f already in progress: creating tablet
W20260923 19:50:08.760974 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 658253ff3d014361803e1aeda978e59a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 658253ff3d014361803e1aeda978e59a already in progress: creating tablet
I20260923 19:50:08.761752 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 344) took 1694 ms. Trace:
I20260923 19:50:08.745687 6168 tablet_service.cc:1511] Processing CreateTablet for tablet ebc288d8d453481592df11cd1bfed3ac (DEFAULT_TABLE table=default.Table_a0bee41bcb2d439fb8619a6c19152813 [id=8a710c10b5ca42548116d743cb0812c3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:08.762379 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 0e123b69877e4b1fbcdb2b27960864e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e123b69877e4b1fbcdb2b27960864e9 already in progress: creating tablet
W20260923 19:50:08.762667 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 58c24aa494bc4da28536dfa1df6123b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58c24aa494bc4da28536dfa1df6123b7 already in progress: creating tablet
I20260923 19:50:08.762998 6457 ts_tablet_manager.cc:1434] T daafbafae5004b8499e7ea93342c0517 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260923 19:50:08.763442 6179 tablet_service.cc:1511] Processing CreateTablet for tablet 14c917ac93fd436aa13fb0839fae883f (DEFAULT_TABLE table=default.Table_72a581bef73d4b24868e54dc6e544838 [id=f74ac9337bca41168a71a13e62116a09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.763836 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6ef90ddd7a34dfdb8309d0e1c3688e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.767578 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet ce6b86f947ce420994eaa5ff39ad9c87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:08.767652 6457 tablet_bootstrap.cc:492] T 6e781ccf4aa343fc924138c3cc2b04e6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:08.767803 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet 4750e2a1b24e4bc7aafa4cd36afebbbd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:00 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:08.768086 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4cc8a742114e5fb07c5c9157ce09e8" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:08.768368 6165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5d3f96ebf1c4d05aceb06ef53737e4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.770038 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14c917ac93fd436aa13fb0839fae883f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.770251 6457 tablet_bootstrap.cc:654] T 6e781ccf4aa343fc924138c3cc2b04e6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:08.774729 6280 leader_election.cc:304] T 42e9cbcf77324d91abd029c12eaf950d P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:08.775048 6458 rpcz_store.cc:276] 0923 19:50:07.061639 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.061704 (+ 65us) service_pool.cc:224] Handling call
0923 19:50:08.755023 (+1693319us) ts_tablet_manager.cc:1151] Deleting tablet 15a9d1d4adaa402f90d774e77010c928
0923 19:50:08.755033 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.755804 (+ 771us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1692943}
I20260923 19:50:08.775436 6458 tablet_replica.cc:333] T 033c2d772c8a44d2a0e671664bb9085d P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:08.775681 6458 raft_consensus.cc:2243] T 033c2d772c8a44d2a0e671664bb9085d P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:08.775810 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet fe5d081a41a3417b855656ca6e24f235 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:08.775925 6318 tablet_service.cc:1558] Processing DeleteTablet for tablet a08446fcf1794dab9d3181904507456f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:08.776189 6313 tablet_service.cc:1558] Processing DeleteTablet for tablet 658253ff3d014361803e1aeda978e59a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:08.776592 6950 raft_consensus.cc:2749] T 42e9cbcf77324d91abd029c12eaf950d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:08.776850 6458 raft_consensus.cc:2272] T 033c2d772c8a44d2a0e671664bb9085d P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:08.777479 6458 ts_tablet_manager.cc:1916] T 033c2d772c8a44d2a0e671664bb9085d P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:08.779351 6280 leader_election.cc:343] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:08.779846 6280 leader_election.cc:343] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:08.780687 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 15a9d1d4adaa402f90d774e77010c928 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15a9d1d4adaa402f90d774e77010c928 already in progress: creating tablet
I20260923 19:50:08.781559 6995 tablet.cc:1751] T 0a5ce253bcce410b9517449f133d39e8 P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:08.783393 6313 tablet_service.cc:1511] Processing CreateTablet for tablet ebc288d8d453481592df11cd1bfed3ac (DEFAULT_TABLE table=default.Table_a0bee41bcb2d439fb8619a6c19152813 [id=8a710c10b5ca42548116d743cb0812c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.783831 6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebc288d8d453481592df11cd1bfed3ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.789288 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebc288d8d453481592df11cd1bfed3ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.790220 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 3a4b9d48f02a4372adce6d9eb80935f6 (DEFAULT_TABLE table=default.Table_c6300cbac0064c74bbc5bd955433f5d5 [id=9ef3551908034b10b7747e6e03256af1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.791215 6456 tablet_bootstrap.cc:492] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:08.791378 6456 ts_tablet_manager.cc:1403] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.228s user 0.000s sys 0.012s
I20260923 19:50:08.791621 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 3a4b9d48f02a4372adce6d9eb80935f6 (DEFAULT_TABLE table=default.Table_c6300cbac0064c74bbc5bd955433f5d5 [id=9ef3551908034b10b7747e6e03256af1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.791872 6457 tablet_bootstrap.cc:492] T 6e781ccf4aa343fc924138c3cc2b04e6 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:08.792083 6457 ts_tablet_manager.cc:1403] T 6e781ccf4aa343fc924138c3cc2b04e6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.001s
I20260923 19:50:08.792217 6456 raft_consensus.cc:359] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.792426 6456 raft_consensus.cc:385] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:08.792111 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a4b9d48f02a4372adce6d9eb80935f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.793188 6456 raft_consensus.cc:740] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:08.793991 6457 raft_consensus.cc:359] T 6e781ccf4aa343fc924138c3cc2b04e6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.794036 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_0f2148660919423195f95a973fb63500"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:08.794662 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f2148660919423195f95a973fb63500 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:08.794596 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_a856ec7fa0204ebc8d516514567a25ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:08.795115 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a856ec7fa0204ebc8d516514567a25ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:08.795892 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a4b9d48f02a4372adce6d9eb80935f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.802946 6182 tablet_service.cc:1558] Processing DeleteTablet for tablet 658253ff3d014361803e1aeda978e59a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:08.803110 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b15b250f594459eb959b4871f7ae398 with delete_type TABLET_DATA_DELETED (replaced by tablet c19298691d5d4209b2d1147a1aad2f6f) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:08.803010 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 3a4b9d48f02a4372adce6d9eb80935f6 (DEFAULT_TABLE table=default.Table_c6300cbac0064c74bbc5bd955433f5d5 [id=9ef3551908034b10b7747e6e03256af1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.802896 6173 tablet_service.cc:1558] Processing DeleteTablet for tablet a08446fcf1794dab9d3181904507456f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:08.802858 7013 raft_consensus.cc:515] T d91a56bace854494b7affd6c766b2847 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.803793 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a4b9d48f02a4372adce6d9eb80935f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.803907 7013 leader_election.cc:290] T d91a56bace854494b7affd6c766b2847 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:08.804864 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91a56bace854494b7affd6c766b2847" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:08.810123 6457 raft_consensus.cc:385] T 6e781ccf4aa343fc924138c3cc2b04e6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:08.810565 6457 raft_consensus.cc:740] T 6e781ccf4aa343fc924138c3cc2b04e6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:08.810873 6457 consensus_queue.cc:260] T 6e781ccf4aa343fc924138c3cc2b04e6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.812527 6827 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "83e97b26500048d0b75350a21a8ff96b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } } }
I20260923 19:50:08.812740 6827 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [sys.catalog]: This master's current role is: LEADER
I20260923 19:50:08.813006 6457 ts_tablet_manager.cc:1434] T 6e781ccf4aa343fc924138c3cc2b04e6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.021s user 0.002s sys 0.000s
W20260923 19:50:08.816300 5805 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1ea8f44ac03b4ad196725f871a615cdd consensus state has no leader
I20260923 19:50:08.816520 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91a56bace854494b7affd6c766b2847" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:08.816632 6457 tablet_bootstrap.cc:492] T 85d35ebef3c24a2e89233dd900b63513 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
W20260923 19:50:08.816817 6279 consensus_peers.cc:597] T 789c54477bec4636bb3669e1f62730e2 P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 789c54477bec4636bb3669e1f62730e2. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:08.817065 6454 raft_consensus.cc:740] T 5c0142f4e3ad42048803481d68f0ee5d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:08.817378 6454 consensus_queue.cc:260] T 5c0142f4e3ad42048803481d68f0ee5d P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.793474 6456 consensus_queue.cc:260] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.818444 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_1704ffca6cc6482f88bac19f06b8052c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:08.819497 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1704ffca6cc6482f88bac19f06b8052c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:08.821512 6139 leader_election.cc:304] T d91a56bace854494b7affd6c766b2847 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:08.825508 5799 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet d91a56bace854494b7affd6c766b2847
I20260923 19:50:08.826200 5800 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet b7ba284e81bc4388bbd6456a41d1f9f4
I20260923 19:50:08.827018 6928 raft_consensus.cc:493] T daafbafae5004b8499e7ea93342c0517 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:08.827215 6928 raft_consensus.cc:515] T daafbafae5004b8499e7ea93342c0517 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.827786 5799 catalog_manager.cc:6934] ReplaceTablet: tablet d91a56bace854494b7affd6c766b2847 deleted and replaced by tablet e55ab069a0fa48398b39bbb9e7c65cd1
I20260923 19:50:08.828037 7013 raft_consensus.cc:2749] T d91a56bace854494b7affd6c766b2847 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:08.827993 6928 leader_election.cc:290] T daafbafae5004b8499e7ea93342c0517 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:08.828773 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daafbafae5004b8499e7ea93342c0517" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:08.829324 6173 tablet_service.cc:1558] Processing DeleteTablet for tablet b7ba284e81bc4388bbd6456a41d1f9f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:08.830189 5995 leader_election.cc:343] T daafbafae5004b8499e7ea93342c0517 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:08.832253 6165 tablet_service.cc:1558] Processing DeleteTablet for tablet d91a56bace854494b7affd6c766b2847 with delete_type TABLET_DATA_DELETED (replaced by tablet e55ab069a0fa48398b39bbb9e7c65cd1) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:08.834748 6457 tablet_bootstrap.cc:654] T 85d35ebef3c24a2e89233dd900b63513 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:08.836064 6454 ts_tablet_manager.cc:1434] T 5c0142f4e3ad42048803481d68f0ee5d P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.176s user 0.001s sys 0.001s
I20260923 19:50:08.837538 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_3e33671b61984643885effdfc0f6b092"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:08.838450 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_ad0aa8bee51e471fa8ce53e180a1f78d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:08.838953 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad0aa8bee51e471fa8ce53e180a1f78d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:08.840065 6454 tablet_bootstrap.cc:492] T b7f372b952804ac58e602998d9b77d72 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:08.840278 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_21a1fa60dde7481e8ad7a7fe355a1e94" } new_table_name: "default.Table_0d5d4338177845959f91952ec7ff7855" modify_external_catalogs: true
W20260923 19:50:08.840413 6279 consensus_peers.cc:597] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 623fb5b761134951a4b742ab2ba480a4. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:08.841917 6454 tablet_bootstrap.cc:654] T b7f372b952804ac58e602998d9b77d72 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:08.842116 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f4932230bae545a9966292f0a7f96b6f" } new_table_name: "default.Table_eb0e9a67b9274e2ea8978f82929b81a8" modify_external_catalogs: true
I20260923 19:50:08.843300 6459 ts_tablet_manager.cc:1929] T a1e8b8e638ec438a86f05fa147cdb27c P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:08.843425 6459 log.cc:1199] T a1e8b8e638ec438a86f05fa147cdb27c P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/a1e8b8e638ec438a86f05fa147cdb27c
I20260923 19:50:08.843786 6459 ts_tablet_manager.cc:1950] T a1e8b8e638ec438a86f05fa147cdb27c P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:08.844278 6317 tablet_service.cc:1558] Processing DeleteTablet for tablet d91a56bace854494b7affd6c766b2847 with delete_type TABLET_DATA_DELETED (replaced by tablet e55ab069a0fa48398b39bbb9e7c65cd1) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:08.844482 6316 tablet_service.cc:1558] Processing DeleteTablet for tablet b7ba284e81bc4388bbd6456a41d1f9f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:08.849167 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e33671b61984643885effdfc0f6b092 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:08.849166 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 397) took 1180 ms. Trace:
I20260923 19:50:08.849273 6459 rpcz_store.cc:276] 0923 19:50:07.668388 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.668467 (+ 79us) service_pool.cc:224] Handling call
0923 19:50:08.504176 (+835709us) ts_tablet_manager.cc:1151] Deleting tablet a1e8b8e638ec438a86f05fa147cdb27c
0923 19:50:08.504184 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.577397 (+ 73213us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:08.843227 (+265830us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:08.849107 (+ 5880us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":828828}
W20260923 19:50:08.850884 5791 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet d5d3f96ebf1c4d05aceb06ef53737e4f (table default.Table_5f9a8360065c42c6b42e7ab6deb71bdf [id=1e1ce17e7c394d7cbb8a4ec6e64dee8f], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet d5d3f96ebf1c4d05aceb06ef53737e4f consensus state has no leader
I20260923 19:50:08.851017 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 398) took 1153 ms. Trace:
I20260923 19:50:08.851086 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet a1e8b8e638ec438a86f05fa147cdb27c (table default.Table_abe1e48d70954781b8e1ca09411789d4 [id=cc4f14506e3d44649b2795f866ab8618]) successfully deleted
I20260923 19:50:08.851109 6459 rpcz_store.cc:276] 0923 19:50:07.697249 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.697330 (+ 81us) service_pool.cc:224] Handling call
0923 19:50:08.850842 (+1153512us) ts_tablet_manager.cc:1151] Deleting tablet 18bab39d85f94f4283f0b18c1c9b48a2
0923 19:50:08.850853 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.850963 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1129442}
W20260923 19:50:08.851567 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 18bab39d85f94f4283f0b18c1c9b48a2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18bab39d85f94f4283f0b18c1c9b48a2 already in progress: creating tablet
I20260923 19:50:08.854108 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 399) took 1134 ms. Trace:
I20260923 19:50:08.854218 6459 rpcz_store.cc:276] 0923 19:50:07.719380 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.719445 (+ 65us) service_pool.cc:224] Handling call
0923 19:50:08.853937 (+1134492us) ts_tablet_manager.cc:1151] Deleting tablet 474e34e902064764864ba06ef41b1d94
0923 19:50:08.853947 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.854050 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1121122}
I20260923 19:50:08.854619 6456 ts_tablet_manager.cc:1434] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.028s user 0.001s sys 0.001s
W20260923 19:50:08.855011 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 474e34e902064764864ba06ef41b1d94 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 474e34e902064764864ba06ef41b1d94 already in progress: creating tablet
I20260923 19:50:08.856220 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 400) took 1115 ms. Trace:
I20260923 19:50:08.858548 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_b72aa27a80014ace84053df8c32cf34f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:08.861436 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b72aa27a80014ace84053df8c32cf34f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:08.861040 6137 consensus_peers.cc:597] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5725a9cb95c448d0a5ea8114e90bc9fe. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:08.862244 6459 rpcz_store.cc:276] 0923 19:50:07.740752 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.740814 (+ 62us) service_pool.cc:224] Handling call
0923 19:50:08.856033 (+1115219us) ts_tablet_manager.cc:1151] Deleting tablet d09faa67bdc54d31a7f7a1b012de9ba1
0923 19:50:08.856047 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.856149 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1114986}
I20260923 19:50:08.862898 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 401) took 1056 ms. Trace:
I20260923 19:50:08.864490 6456 tablet_bootstrap.cc:492] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
W20260923 19:50:08.863612 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet d09faa67bdc54d31a7f7a1b012de9ba1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d09faa67bdc54d31a7f7a1b012de9ba1 already in progress: creating tablet
I20260923 19:50:08.864646 6459 rpcz_store.cc:276] 0923 19:50:07.806335 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.820903 (+ 14568us) service_pool.cc:224] Handling call
0923 19:50:08.862732 (+1041829us) ts_tablet_manager.cc:1151] Deleting tablet 58ea466d1b2b40e9b9b4cd5be51f79e0
0923 19:50:08.862746 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.862848 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1041480}
W20260923 19:50:08.865175 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 58ea466d1b2b40e9b9b4cd5be51f79e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58ea466d1b2b40e9b9b4cd5be51f79e0 already in progress: creating tablet
I20260923 19:50:08.866837 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 402) took 1046 ms. Trace:
I20260923 19:50:08.867854 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 30fe07956e8940fcb7ba1e2e16ced463
I20260923 19:50:08.868563 5802 catalog_manager.cc:6934] ReplaceTablet: tablet 30fe07956e8940fcb7ba1e2e16ced463 deleted and replaced by tablet 2ed8d49f1b3d4bee80b1822df2a7f495
I20260923 19:50:08.869300 6459 rpcz_store.cc:276] 0923 19:50:07.819905 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.832036 (+ 12131us) service_pool.cc:224] Handling call
0923 19:50:08.866671 (+1034635us) ts_tablet_manager.cc:1151] Deleting tablet d04b3a9ade7a405bb619704095fac279
0923 19:50:08.866683 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.866783 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1020603}
W20260923 19:50:08.871721 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet d04b3a9ade7a405bb619704095fac279 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d04b3a9ade7a405bb619704095fac279 already in progress: creating tablet
I20260923 19:50:08.870093 6178 tablet_service.cc:1558] Processing DeleteTablet for tablet 30fe07956e8940fcb7ba1e2e16ced463 with delete_type TABLET_DATA_DELETED (replaced by tablet 2ed8d49f1b3d4bee80b1822df2a7f495) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:08.872030 5802 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_109d63d522e24e3b8d45897a9c9ce09f" } new_table_name: "default.Table_3cc4e61c61094959a908681364326b54" modify_external_catalogs: true
I20260923 19:50:08.872727 6459 tablet_replica.cc:333] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
W20260923 19:50:08.873561 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet a01a86b6fd4b44d3808c2040525d7b61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a01a86b6fd4b44d3808c2040525d7b61 already in progress: creating tablet
I20260923 19:50:08.874482 6459 raft_consensus.cc:2243] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:08.874904 6459 raft_consensus.cc:2272] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:08.875247 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet 30fe07956e8940fcb7ba1e2e16ced463 with delete_type TABLET_DATA_DELETED (replaced by tablet 2ed8d49f1b3d4bee80b1822df2a7f495) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:08.877050 6459 ts_tablet_manager.cc:1916] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:08.879093 6456 tablet_bootstrap.cc:654] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:08.883021 5805 rpcz_store.cc:275] Call kudu.master.MasterService.GetMasterRegistration from 127.0.0.1:59886 (request call id 15) took 2818 ms. Trace:
I20260923 19:50:08.883205 5805 rpcz_store.cc:276] 0923 19:50:06.065026 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.882226 (+2817200us) service_pool.cc:224] Handling call
0923 19:50:08.882967 (+ 741us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":994560}
W20260923 19:50:08.883577 5792 connection.cc:466] server connection from 127.0.0.1:59886 torn down before Call kudu.master.MasterService.GetMasterRegistration from 127.0.0.1:59886 (request call id 15) could send its response
I20260923 19:50:08.884704 5804 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_84d13e1ea6234e5ca45738376e83f537 [id=0d4f6a5bb30c4d2a937424cf0e651afd] alter complete (version 1)
I20260923 19:50:08.886780 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 337f32eb47954689a6eb8f74408e01d9
I20260923 19:50:08.887301 5797 catalog_manager.cc:6934] ReplaceTablet: tablet 337f32eb47954689a6eb8f74408e01d9 deleted and replaced by tablet 7d654b14cafa453185179fe57a25e2d9
I20260923 19:50:08.889283 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daafbafae5004b8499e7ea93342c0517" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:08.889423 6280 consensus_peers.cc:597] T 789c54477bec4636bb3669e1f62730e2 P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:08.890141 6201 raft_consensus.cc:3060] T d91a56bace854494b7affd6c766b2847 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:08.890170 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet b7ba284e81bc4388bbd6456a41d1f9f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:08.890836 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet d91a56bace854494b7affd6c766b2847 with delete_type TABLET_DATA_DELETED (replaced by tablet e55ab069a0fa48398b39bbb9e7c65cd1) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:08.891407 6461 tablet_replica.cc:333] T d91a56bace854494b7affd6c766b2847 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:08.891681 6461 raft_consensus.cc:2243] T d91a56bace854494b7affd6c766b2847 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:08.891965 6461 raft_consensus.cc:2272] T d91a56bace854494b7affd6c766b2847 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:08.892769 6461 ts_tablet_manager.cc:1916] T d91a56bace854494b7affd6c766b2847 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:08.892938 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet b7ba284e81bc4388bbd6456a41d1f9f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b7ba284e81bc4388bbd6456a41d1f9f4 already in progress: creating tablet
W20260923 19:50:08.893383 5996 leader_election.cc:343] T daafbafae5004b8499e7ea93342c0517 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:08.893515 5996 leader_election.cc:304] T daafbafae5004b8499e7ea93342c0517 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
W20260923 19:50:08.894244 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1cf016ff0bb8418d84358d17876338bf consensus state has no leader
I20260923 19:50:08.895294 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f627b7b9ff74750bd8dd59840bf77db with delete_type TABLET_DATA_DELETED (replaced by tablet d40327145d4d44009f12358eacacf0dd) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:08.895663 6030 tablet_service.cc:1558] Processing DeleteTablet for tablet 359b08ef348d4be68b14f9e871a5e519 with delete_type TABLET_DATA_DELETED (replaced by tablet b7ba284e81bc4388bbd6456a41d1f9f4) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:08.895787 6928 raft_consensus.cc:2749] T daafbafae5004b8499e7ea93342c0517 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:08.895876 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet f4e3e64fdf584743a3a88df5d6600b22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:08.896046 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet 337f32eb47954689a6eb8f74408e01d9 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d654b14cafa453185179fe57a25e2d9) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:08.896255 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet 30fe07956e8940fcb7ba1e2e16ced463 with delete_type TABLET_DATA_DELETED (replaced by tablet 2ed8d49f1b3d4bee80b1822df2a7f495) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:08.898082 6321 tablet_service.cc:1558] Processing DeleteTablet for tablet 337f32eb47954689a6eb8f74408e01d9 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d654b14cafa453185179fe57a25e2d9) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:08.900951 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 16144661b56c4f858c55e8e0d3999019 has no consensus state
I20260923 19:50:08.904134 6461 ts_tablet_manager.cc:1929] T d91a56bace854494b7affd6c766b2847 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:50:08.904570 6461 log.cc:1199] T d91a56bace854494b7affd6c766b2847 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/d91a56bace854494b7affd6c766b2847
I20260923 19:50:08.905141 6461 ts_tablet_manager.cc:1950] T d91a56bace854494b7affd6c766b2847 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:08.906596 6458 ts_tablet_manager.cc:1929] T 033c2d772c8a44d2a0e671664bb9085d P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:08.906752 6458 log.cc:1199] T 033c2d772c8a44d2a0e671664bb9085d P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/033c2d772c8a44d2a0e671664bb9085d
I20260923 19:50:08.906760 6461 tablet_replica.cc:333] T 2f627b7b9ff74750bd8dd59840bf77db P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:08.907145 6458 ts_tablet_manager.cc:1950] T 033c2d772c8a44d2a0e671664bb9085d P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:08.907156 6461 raft_consensus.cc:2243] T 2f627b7b9ff74750bd8dd59840bf77db P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:08.908772 6461 raft_consensus.cc:2272] T 2f627b7b9ff74750bd8dd59840bf77db P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:08.908908 6995 tablet.cc:1751] T d91a56bace854494b7affd6c766b2847 P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260923 19:50:08.909137 5802 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 670d9cb0e6e2414092f72ffd5e6b00ea consensus state has no leader
I20260923 19:50:08.911226 6461 ts_tablet_manager.cc:1916] T 2f627b7b9ff74750bd8dd59840bf77db P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:08.913622 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet daafbafae5004b8499e7ea93342c0517 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:08.914610 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 345) took 1852 ms. Trace:
I20260923 19:50:08.914855 6458 rpcz_store.cc:276] 0923 19:50:07.061790 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.061845 (+ 55us) service_pool.cc:224] Handling call
0923 19:50:08.775367 (+1713522us) ts_tablet_manager.cc:1151] Deleting tablet 033c2d772c8a44d2a0e671664bb9085d
0923 19:50:08.775380 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.882754 (+107374us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:08.906528 (+ 23774us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:08.914479 (+ 7951us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":986,"tablet-delete.queue_time_us":1713154}
I20260923 19:50:08.916352 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 347) took 1854 ms. Trace:
I20260923 19:50:08.916682 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e781ccf4aa343fc924138c3cc2b04e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:08.916740 6458 rpcz_store.cc:276] 0923 19:50:07.062143 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.062252 (+ 109us) service_pool.cc:224] Handling call
0923 19:50:08.915517 (+1853265us) ts_tablet_manager.cc:1151] Deleting tablet 9be4c46ee8eb4dbaad01d492b701a9e0
0923 19:50:08.915578 (+ 61us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.916161 (+ 583us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1852968}
I20260923 19:50:08.917608 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet d91a56bace854494b7affd6c766b2847 (table default.Table_b3579cbf488c4d1eb5f605ab4e11c340 [id=a6dbcc9c44fb400b926e21aa6d683186]) successfully deleted
I20260923 19:50:08.918823 6168 tablet_service.cc:1558] Processing DeleteTablet for tablet 337f32eb47954689a6eb8f74408e01d9 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d654b14cafa453185179fe57a25e2d9) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:08.918763 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 346) took 1856 ms. Trace:
I20260923 19:50:08.919824 6178 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c0142f4e3ad42048803481d68f0ee5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:08.919827 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 033c2d772c8a44d2a0e671664bb9085d (table default.Table_423256ac67c24899a4b67915596ef545 [id=c4756b4d81ce4fc2acf001ae879a5c3f]) successfully deleted
W20260923 19:50:08.920208 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 9be4c46ee8eb4dbaad01d492b701a9e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9be4c46ee8eb4dbaad01d492b701a9e0 already in progress: creating tablet
I20260923 19:50:08.919169 6458 rpcz_store.cc:276] 0923 19:50:07.061975 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.064245 (+ 2270us) service_pool.cc:224] Handling call
0923 19:50:08.918238 (+1853993us) ts_tablet_manager.cc:1151] Deleting tablet b302820d329a41f0a9a54501c079fcd7
0923 19:50:08.918251 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:08.918519 (+ 268us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1853655}
W20260923 19:50:08.921846 5792 catalog_manager.cc:5030] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet b302820d329a41f0a9a54501c079fcd7 because the tablet was not found. No further retry: Not found: Tablet not found: b302820d329a41f0a9a54501c079fcd7
I20260923 19:50:08.924703 6457 tablet_bootstrap.cc:492] T 85d35ebef3c24a2e89233dd900b63513 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:08.924981 6457 ts_tablet_manager.cc:1403] T 85d35ebef3c24a2e89233dd900b63513 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.109s user 0.013s sys 0.007s
I20260923 19:50:08.925817 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 16144661b56c4f858c55e8e0d3999019 (DEFAULT_TABLE table=default.Table_eb0e9a67b9274e2ea8978f82929b81a8 [id=bd93870aaa4b43b98dbef08030d8fb0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.926692 6168 tablet_service.cc:1511] Processing CreateTablet for tablet e996910398694686bd68ef31239ed15f (DEFAULT_TABLE table=default.Table_8f7f460e1af1407c99776ddc28c8b0c4 [id=9be19d72231e46eab436b439a57abba3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.926882 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 16144661b56c4f858c55e8e0d3999019 (DEFAULT_TABLE table=default.Table_eb0e9a67b9274e2ea8978f82929b81a8 [id=bd93870aaa4b43b98dbef08030d8fb0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.927340 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16144661b56c4f858c55e8e0d3999019. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.927788 5802 catalog_manager.cc:5838] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:08.933189 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16144661b56c4f858c55e8e0d3999019. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.934854 6165 tablet_service.cc:1511] Processing CreateTablet for tablet 83fdbb8a5352447b8ad6570e44674e97 (DEFAULT_TABLE table=default.Table_d3fd774b813349ad97efc22b5a85001d [id=d1e7a2e7077c4a528ace41121d86e28b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.935797 6173 tablet_service.cc:1511] Processing CreateTablet for tablet 17a105f389d041dbb0bf8b828f990d27 (DEFAULT_TABLE table=default.Table_3a2441d714924cc1ae24db6dd739f56e [id=553d29d5d07840c9a05771679cb2fbe5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.936905 6032 tablet_service.cc:1511] Processing CreateTablet for tablet e996910398694686bd68ef31239ed15f (DEFAULT_TABLE table=default.Table_8f7f460e1af1407c99776ddc28c8b0c4 [id=9be19d72231e46eab436b439a57abba3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.937268 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e996910398694686bd68ef31239ed15f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.937251 6182 tablet_service.cc:1511] Processing CreateTablet for tablet e9a5f103a5bf406e97f1384b9968da96 (DEFAULT_TABLE table=default.Table_ebf069e144a848b88e93d7b5e2eebac9 [id=cdafc559e97b45e4bdffb04ea94e5fab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.938516 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e996910398694686bd68ef31239ed15f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.939390 6183 tablet_service.cc:1511] Processing CreateTablet for tablet cf538da9dc8c47a8a391efe4e17bb3a5 (DEFAULT_TABLE table=default.Table_aad0a22c213c44f9b67c092d40fd8455 [id=e84f4a4fcfe441659dfa2f0e2c4cad3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.939881 6167 tablet_service.cc:1511] Processing CreateTablet for tablet c82bb40047b342d5b9468ecc374ef829 (DEFAULT_TABLE table=default.Table_1eb5249515fc4eab900531c4d0e96923 [id=0528ddbde624485da735361c8554a744]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.940153 6174 tablet_service.cc:1511] Processing CreateTablet for tablet 8b4c2a0ae64841c6971a0840c1d5b739 (DEFAULT_TABLE table=default.Table_85afd8d42b6445daa79f5fe22456ba77 [id=97afe6551b744d45a660bd41c28b87e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.940582 6179 tablet_service.cc:1511] Processing CreateTablet for tablet 2d6762b369d3496083947a4a47a51868 (DEFAULT_TABLE table=default.Table_a1862929985946f7b4a445dab5afbab5 [id=2cc4daef0a5a430691e945cdff900016]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.929793 5802 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet ec4cc8a742114e5fb07c5c9157ce09e8 (table default.Table_2adc87e06d81491498aa018f49fdc08d [id=89181985e6154c7fa946148e48bef2eb]). Expected version 2 got 0
I20260923 19:50:08.941607 5802 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 5adadf8caf5e4a9ab1107d0fb6a91735 (table default.Table_bd91264aa4a0430eb1a8f69129fb0f3f [id=738ed1d070ef485e9299c1f3b1db008a]). Expected version 2 got 0
I20260923 19:50:08.941903 5802 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet ec4284d6a0fa416ca95b4d675c8e3912 (table default.Table_00f5789c01e94f8e8c65077f98b164c2 [id=29a38060f3bf43f3900ad0ee42fbde9a]). Expected version 1 got 0
I20260923 19:50:08.943503 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_81d47fdf0e514f1eba3c801278533173" } new_table_name: "default.Table_f163b8d593ca45ecb37b794671a4bf8b" modify_external_catalogs: true
I20260923 19:50:08.943594 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_572d17eb83634c98b68bbcfedc88603e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:08.943857 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 83fdbb8a5352447b8ad6570e44674e97 (DEFAULT_TABLE table=default.Table_d3fd774b813349ad97efc22b5a85001d [id=d1e7a2e7077c4a528ace41121d86e28b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:08.944170 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_572d17eb83634c98b68bbcfedc88603e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:08.944255 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83fdbb8a5352447b8ad6570e44674e97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.945032 6182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9a5f103a5bf406e97f1384b9968da96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.945711 6037 tablet_service.cc:1511] Processing CreateTablet for tablet e9a5f103a5bf406e97f1384b9968da96 (DEFAULT_TABLE table=default.Table_ebf069e144a848b88e93d7b5e2eebac9 [id=cdafc559e97b45e4bdffb04ea94e5fab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.946283 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9a5f103a5bf406e97f1384b9968da96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.946573 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 8b4c2a0ae64841c6971a0840c1d5b739 (DEFAULT_TABLE table=default.Table_85afd8d42b6445daa79f5fe22456ba77 [id=97afe6551b744d45a660bd41c28b87e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.946959 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b4c2a0ae64841c6971a0840c1d5b739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.948280 6457 raft_consensus.cc:359] T 85d35ebef3c24a2e89233dd900b63513 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.948526 6457 raft_consensus.cc:385] T 85d35ebef3c24a2e89233dd900b63513 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:08.948614 6457 raft_consensus.cc:740] T 85d35ebef3c24a2e89233dd900b63513 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:08.949146 5798 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_9bd23e83d2144f82a8487f44b70458fc" } modify_external_catalogs: true
I20260923 19:50:08.949322 5798 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_9bd23e83d2144f82a8487f44b70458fc" } modify_external_catalogs: true
I20260923 19:50:08.946188 6030 tablet_service.cc:1511] Processing CreateTablet for tablet 17a105f389d041dbb0bf8b828f990d27 (DEFAULT_TABLE table=default.Table_3a2441d714924cc1ae24db6dd739f56e [id=553d29d5d07840c9a05771679cb2fbe5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.953361 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf538da9dc8c47a8a391efe4e17bb3a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.954033 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d6762b369d3496083947a4a47a51868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.955173 6029 tablet_service.cc:1511] Processing CreateTablet for tablet c82bb40047b342d5b9468ecc374ef829 (DEFAULT_TABLE table=default.Table_1eb5249515fc4eab900531c4d0e96923 [id=0528ddbde624485da735361c8554a744]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.956127 6323 tablet_service.cc:1511] Processing CreateTablet for tablet 16144661b56c4f858c55e8e0d3999019 (DEFAULT_TABLE table=default.Table_eb0e9a67b9274e2ea8978f82929b81a8 [id=bd93870aaa4b43b98dbef08030d8fb0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.956629 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16144661b56c4f858c55e8e0d3999019. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.956678 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 83fdbb8a5352447b8ad6570e44674e97 (DEFAULT_TABLE table=default.Table_d3fd774b813349ad97efc22b5a85001d [id=d1e7a2e7077c4a528ace41121d86e28b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.956983 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83fdbb8a5352447b8ad6570e44674e97. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:08.957370 5800 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 772ece5283a949408d849f6e56f5f17b consensus state has no leader
I20260923 19:50:08.958249 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_701c81d7fd4844f09fc1ccc28f0eda9c" } modify_external_catalogs: true
I20260923 19:50:08.958457 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_701c81d7fd4844f09fc1ccc28f0eda9c" } modify_external_catalogs: true
I20260923 19:50:08.956127 6324 tablet_service.cc:1511] Processing CreateTablet for tablet e996910398694686bd68ef31239ed15f (DEFAULT_TABLE table=default.Table_8f7f460e1af1407c99776ddc28c8b0c4 [id=9be19d72231e46eab436b439a57abba3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.959757 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e996910398694686bd68ef31239ed15f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.960227 5799 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_72a581bef73d4b24868e54dc6e544838" } modify_external_catalogs: true
I20260923 19:50:08.960403 5799 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_72a581bef73d4b24868e54dc6e544838" } modify_external_catalogs: true
I20260923 19:50:08.960855 6312 tablet_service.cc:1511] Processing CreateTablet for tablet 17a105f389d041dbb0bf8b828f990d27 (DEFAULT_TABLE table=default.Table_3a2441d714924cc1ae24db6dd739f56e [id=553d29d5d07840c9a05771679cb2fbe5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.961241 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17a105f389d041dbb0bf8b828f990d27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.961676 5800 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_365f750c2926431db2f53e5b6dd09af4" } modify_external_catalogs: true
I20260923 19:50:08.962221 5800 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_365f750c2926431db2f53e5b6dd09af4" } modify_external_catalogs: true
I20260923 19:50:08.964600 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_9775cad3e3fc483a925aead3e398478c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:08.965207 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9775cad3e3fc483a925aead3e398478c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:08.966637 6321 tablet_service.cc:1511] Processing CreateTablet for tablet 8b4c2a0ae64841c6971a0840c1d5b739 (DEFAULT_TABLE table=default.Table_85afd8d42b6445daa79f5fe22456ba77 [id=97afe6551b744d45a660bd41c28b87e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.967042 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b4c2a0ae64841c6971a0840c1d5b739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.973855 6454 tablet_bootstrap.cc:492] T b7f372b952804ac58e602998d9b77d72 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:08.974360 6928 raft_consensus.cc:493] T 359b08ef348d4be68b14f9e871a5e519 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:08.984042 6031 tablet_service.cc:1511] Processing CreateTablet for tablet cf538da9dc8c47a8a391efe4e17bb3a5 (DEFAULT_TABLE table=default.Table_aad0a22c213c44f9b67c092d40fd8455 [id=e84f4a4fcfe441659dfa2f0e2c4cad3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.984511 6022 tablet_service.cc:1511] Processing CreateTablet for tablet 2d6762b369d3496083947a4a47a51868 (DEFAULT_TABLE table=default.Table_a1862929985946f7b4a445dab5afbab5 [id=2cc4daef0a5a430691e945cdff900016]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.984670 6310 tablet_service.cc:1511] Processing CreateTablet for tablet e9a5f103a5bf406e97f1384b9968da96 (DEFAULT_TABLE table=default.Table_ebf069e144a848b88e93d7b5e2eebac9 [id=cdafc559e97b45e4bdffb04ea94e5fab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:08.984890 6928 raft_consensus.cc:515] T 359b08ef348d4be68b14f9e871a5e519 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:08.985168 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9a5f103a5bf406e97f1384b9968da96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.985594 6928 leader_election.cc:290] T 359b08ef348d4be68b14f9e871a5e519 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:08.986131 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c82bb40047b342d5b9468ecc374ef829. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.986598 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf538da9dc8c47a8a391efe4e17bb3a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.990036 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d6762b369d3496083947a4a47a51868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.996867 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17a105f389d041dbb0bf8b828f990d27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.998075 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c82bb40047b342d5b9468ecc374ef829. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:08.998564 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359b08ef348d4be68b14f9e871a5e519" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:08.999198 5996 leader_election.cc:343] T 359b08ef348d4be68b14f9e871a5e519 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:09.002040 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17a105f389d041dbb0bf8b828f990d27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.005419 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 2d6762b369d3496083947a4a47a51868 (DEFAULT_TABLE table=default.Table_a1862929985946f7b4a445dab5afbab5 [id=2cc4daef0a5a430691e945cdff900016]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.006693 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d6762b369d3496083947a4a47a51868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.017917 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet b92aaac328934d95a89e0fc08a80b0b1
I20260923 19:50:09.017848 6321 tablet_service.cc:1511] Processing CreateTablet for tablet cf538da9dc8c47a8a391efe4e17bb3a5 (DEFAULT_TABLE table=default.Table_aad0a22c213c44f9b67c092d40fd8455 [id=e84f4a4fcfe441659dfa2f0e2c4cad3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.018224 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359b08ef348d4be68b14f9e871a5e519" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:09.019011 5995 leader_election.cc:343] T 359b08ef348d4be68b14f9e871a5e519 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:09.019177 5995 leader_election.cc:304] T 359b08ef348d4be68b14f9e871a5e519 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:09.019495 6454 ts_tablet_manager.cc:1403] T b7f372b952804ac58e602998d9b77d72 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.135s user 0.001s sys 0.004s
I20260923 19:50:09.019738 6928 raft_consensus.cc:2749] T 359b08ef348d4be68b14f9e871a5e519 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:09.020035 6022 tablet_service.cc:1558] Processing DeleteTablet for tablet b92aaac328934d95a89e0fc08a80b0b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:09.020255 6457 consensus_queue.cc:260] T 85d35ebef3c24a2e89233dd900b63513 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.019544 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet b92aaac328934d95a89e0fc08a80b0b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:09.020834 6165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83fdbb8a5352447b8ad6570e44674e97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.022034 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf538da9dc8c47a8a391efe4e17bb3a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.025727 6456 tablet_bootstrap.cc:492] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:09.025961 6456 ts_tablet_manager.cc:1403] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.171s user 0.005s sys 0.004s
I20260923 19:50:09.026651 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b4c2a0ae64841c6971a0840c1d5b739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.026594 5797 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_8cef71be2be0416bbd6357227c7ee3fd" } new_table_name: "default.Table_c37dd4b246c24d57953eb81163b7b5f0" modify_external_catalogs: true
I20260923 19:50:09.029035 6457 ts_tablet_manager.cc:1434] T 85d35ebef3c24a2e89233dd900b63513 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.104s user 0.002s sys 0.000s
I20260923 19:50:09.029385 6456 raft_consensus.cc:359] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.029663 6456 raft_consensus.cc:385] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:09.029773 6456 raft_consensus.cc:740] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:09.030126 6456 consensus_queue.cc:260] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.033290 6457 tablet_bootstrap.cc:492] T 015c14b447fe4cd18d197b2d1ed5884e P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:09.033785 6928 raft_consensus.cc:493] T f4e3e64fdf584743a3a88df5d6600b22 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:09.034826 6928 raft_consensus.cc:515] T f4e3e64fdf584743a3a88df5d6600b22 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.035531 6928 leader_election.cc:290] T f4e3e64fdf584743a3a88df5d6600b22 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:09.036669 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4e3e64fdf584743a3a88df5d6600b22" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:09.037212 5996 leader_election.cc:343] T f4e3e64fdf584743a3a88df5d6600b22 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:09.037571 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4e3e64fdf584743a3a88df5d6600b22" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:09.038177 5995 leader_election.cc:343] T f4e3e64fdf584743a3a88df5d6600b22 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:09.038271 6456 ts_tablet_manager.cc:1434] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260923 19:50:09.038328 5995 leader_election.cc:304] T f4e3e64fdf584743a3a88df5d6600b22 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:09.038838 6928 raft_consensus.cc:2749] T f4e3e64fdf584743a3a88df5d6600b22 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:09.038033 6457 tablet_bootstrap.cc:654] T 015c14b447fe4cd18d197b2d1ed5884e P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:09.039645 6461 ts_tablet_manager.cc:1929] T 2f627b7b9ff74750bd8dd59840bf77db P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:09.039750 6456 tablet_bootstrap.cc:492] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:09.039790 6461 log.cc:1199] T 2f627b7b9ff74750bd8dd59840bf77db P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/2f627b7b9ff74750bd8dd59840bf77db
I20260923 19:50:09.040174 6461 ts_tablet_manager.cc:1950] T 2f627b7b9ff74750bd8dd59840bf77db P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:09.041314 6461 tablet_replica.cc:333] T 359b08ef348d4be68b14f9e871a5e519 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:09.041330 6456 tablet_bootstrap.cc:654] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:09.041450 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 2f627b7b9ff74750bd8dd59840bf77db (table default.Table_e6225c62c99144cdb7c222d165e1d7b5 [id=e54ebfe94bd640f59f7006d4d146a9da]) successfully deleted
I20260923 19:50:09.041510 6461 raft_consensus.cc:2243] T 359b08ef348d4be68b14f9e871a5e519 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:09.041692 6461 raft_consensus.cc:2272] T 359b08ef348d4be68b14f9e871a5e519 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:09.042424 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 349) took 1923 ms. Trace:
I20260923 19:50:09.042529 6458 rpcz_store.cc:276] 0923 19:50:07.119046 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.119232 (+ 186us) service_pool.cc:224] Handling call
0923 19:50:09.042257 (+1923025us) ts_tablet_manager.cc:1151] Deleting tablet 86473c5cbca54b5792b038aef445998c
0923 19:50:09.042268 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:09.042376 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1922432}
W20260923 19:50:09.043020 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 86473c5cbca54b5792b038aef445998c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 86473c5cbca54b5792b038aef445998c already in progress: creating tablet
I20260923 19:50:09.022517 6312 tablet_service.cc:1511] Processing CreateTablet for tablet c82bb40047b342d5b9468ecc374ef829 (DEFAULT_TABLE table=default.Table_1eb5249515fc4eab900531c4d0e96923 [id=0528ddbde624485da735361c8554a744]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.043689 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c82bb40047b342d5b9468ecc374ef829. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.044878 6461 ts_tablet_manager.cc:1916] T 359b08ef348d4be68b14f9e871a5e519 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:09.046691 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 350) took 1836 ms. Trace:
I20260923 19:50:09.046810 6458 rpcz_store.cc:276] 0923 19:50:07.210387 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.210449 (+ 62us) service_pool.cc:224] Handling call
0923 19:50:09.046501 (+1836052us) ts_tablet_manager.cc:1151] Deleting tablet 0c537304c32c44adaa1e05de4496293f
0923 19:50:09.046512 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:09.046622 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1835831}
I20260923 19:50:09.047250 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 366) took 1342 ms. Trace:
I20260923 19:50:09.047350 6458 rpcz_store.cc:276] 0923 19:50:07.705052 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.705121 (+ 69us) service_pool.cc:224] Handling call
0923 19:50:09.047115 (+1341994us) ts_tablet_manager.cc:1151] Deleting tablet a224ae69503e4ab588d6269086317f09
0923 19:50:09.047124 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:09.047188 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1341750}
I20260923 19:50:09.047734 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 367) took 1342 ms. Trace:
W20260923 19:50:09.047722 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 0c537304c32c44adaa1e05de4496293f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c537304c32c44adaa1e05de4496293f already in progress: creating tablet
I20260923 19:50:09.047823 6458 rpcz_store.cc:276] 0923 19:50:07.705217 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.705411 (+ 194us) service_pool.cc:224] Handling call
0923 19:50:09.047597 (+1342186us) ts_tablet_manager.cc:1151] Deleting tablet 474e34e902064764864ba06ef41b1d94
0923 19:50:09.047605 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:09.047684 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1341958}
I20260923 19:50:09.047982 6457 tablet_bootstrap.cc:492] T 015c14b447fe4cd18d197b2d1ed5884e P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:09.048116 6457 ts_tablet_manager.cc:1403] T 015c14b447fe4cd18d197b2d1ed5884e P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.006s
I20260923 19:50:09.048204 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 364) took 1352 ms. Trace:
I20260923 19:50:09.048295 6458 rpcz_store.cc:276] 0923 19:50:07.696019 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.713536 (+ 17517us) service_pool.cc:224] Handling call
0923 19:50:09.048051 (+1334515us) ts_tablet_manager.cc:1151] Deleting tablet 18bab39d85f94f4283f0b18c1c9b48a2
0923 19:50:09.048058 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:09.048157 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1334217}
I20260923 19:50:09.048619 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 368) took 1311 ms. Trace:
I20260923 19:50:09.048713 6458 rpcz_store.cc:276] 0923 19:50:07.736880 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.737469 (+ 589us) service_pool.cc:224] Handling call
0923 19:50:09.048476 (+1311007us) ts_tablet_manager.cc:1151] Deleting tablet d09faa67bdc54d31a7f7a1b012de9ba1
0923 19:50:09.048483 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:09.048556 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1310622}
I20260923 19:50:09.048982 6458 tablet_replica.cc:333] T d70b7662d85a4f64a11420448c4d140d P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:09.048942 6457 raft_consensus.cc:359] T 015c14b447fe4cd18d197b2d1ed5884e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.049216 6458 raft_consensus.cc:2243] T d70b7662d85a4f64a11420448c4d140d P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:09.049237 6457 raft_consensus.cc:385] T 015c14b447fe4cd18d197b2d1ed5884e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260923 19:50:09.049293 5792 catalog_manager.cc:5030] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet a224ae69503e4ab588d6269086317f09 because the tablet was not found. No further retry: Not found: Tablet not found: a224ae69503e4ab588d6269086317f09
I20260923 19:50:09.049377 6457 raft_consensus.cc:740] T 015c14b447fe4cd18d197b2d1ed5884e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:09.049412 6458 raft_consensus.cc:2272] T d70b7662d85a4f64a11420448c4d140d P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:09.049610 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 474e34e902064764864ba06ef41b1d94 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 474e34e902064764864ba06ef41b1d94 already in progress: creating tablet
I20260923 19:50:09.049626 6457 consensus_queue.cc:260] T 015c14b447fe4cd18d197b2d1ed5884e P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:09.049813 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 18bab39d85f94f4283f0b18c1c9b48a2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18bab39d85f94f4283f0b18c1c9b48a2 already in progress: creating tablet
W20260923 19:50:09.050068 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet d09faa67bdc54d31a7f7a1b012de9ba1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d09faa67bdc54d31a7f7a1b012de9ba1 already in progress: creating tablet
I20260923 19:50:09.051730 6457 ts_tablet_manager.cc:1434] T 015c14b447fe4cd18d197b2d1ed5884e P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260923 19:50:09.053103 6457 tablet_bootstrap.cc:492] T 6fe14389e2a3487587dfcf7a8b4b242d P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:09.053184 6454 raft_consensus.cc:359] T b7f372b952804ac58e602998d9b77d72 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.054931 6457 tablet_bootstrap.cc:654] T 6fe14389e2a3487587dfcf7a8b4b242d P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:09.055459 6458 ts_tablet_manager.cc:1916] T d70b7662d85a4f64a11420448c4d140d P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:09.055795 6454 raft_consensus.cc:385] T b7f372b952804ac58e602998d9b77d72 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:09.056565 7018 raft_consensus.cc:493] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:09.056710 7018 raft_consensus.cc:515] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.057401 7018 leader_election.cc:290] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:09.058308 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26031fe469d046518cdd0f1e955e19d1" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:09.058532 6059 raft_consensus.cc:2468] T 26031fe469d046518cdd0f1e955e19d1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:09.059065 6279 leader_election.cc:304] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:09.059422 7018 raft_consensus.cc:2804] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:09.059531 7018 raft_consensus.cc:493] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:09.059623 7018 raft_consensus.cc:3060] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:09.060200 6928 raft_consensus.cc:493] T 85d35ebef3c24a2e89233dd900b63513 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:09.060360 6928 raft_consensus.cc:515] T 85d35ebef3c24a2e89233dd900b63513 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.060976 6928 leader_election.cc:290] T 85d35ebef3c24a2e89233dd900b63513 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:09.063180 6456 tablet_bootstrap.cc:492] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:09.063345 6456 ts_tablet_manager.cc:1403] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.024s user 0.000s sys 0.003s
I20260923 19:50:09.063618 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d35ebef3c24a2e89233dd900b63513" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:09.064358 6456 raft_consensus.cc:359] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.064548 6456 raft_consensus.cc:385] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:09.064651 6456 raft_consensus.cc:740] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:09.064913 6456 consensus_queue.cc:260] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.065457 6456 ts_tablet_manager.cc:1434] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260923 19:50:09.065762 6456 tablet_bootstrap.cc:492] T 86473c5cbca54b5792b038aef445998c P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:09.065994 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d35ebef3c24a2e89233dd900b63513" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:09.067961 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet e4f00490b0364f0e9f1b9569b870808e
I20260923 19:50:09.068025 6461 ts_tablet_manager.cc:1929] T 359b08ef348d4be68b14f9e871a5e519 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:09.068135 6461 log.cc:1199] T 359b08ef348d4be68b14f9e871a5e519 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/359b08ef348d4be68b14f9e871a5e519
I20260923 19:50:09.068514 6461 ts_tablet_manager.cc:1950] T 359b08ef348d4be68b14f9e871a5e519 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:09.068771 6454 raft_consensus.cc:740] T b7f372b952804ac58e602998d9b77d72 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:09.069176 5800 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet f8f0077e218a478799c05c5f468f0190
I20260923 19:50:09.069392 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26031fe469d046518cdd0f1e955e19d1" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:09.069922 6454 consensus_queue.cc:260] T b7f372b952804ac58e602998d9b77d72 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.070243 6182 tablet_service.cc:1558] Processing DeleteTablet for tablet e4f00490b0364f0e9f1b9569b870808e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:09.070462 6454 ts_tablet_manager.cc:1434] T b7f372b952804ac58e602998d9b77d72 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.051s user 0.000s sys 0.002s
W20260923 19:50:09.071547 5995 leader_election.cc:343] T 85d35ebef3c24a2e89233dd900b63513 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:09.071879 6461 tablet_replica.cc:333] T f4e3e64fdf584743a3a88df5d6600b22 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:09.072084 6461 raft_consensus.cc:2243] T f4e3e64fdf584743a3a88df5d6600b22 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:09.072253 6461 raft_consensus.cc:2272] T f4e3e64fdf584743a3a88df5d6600b22 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:09.072865 6461 ts_tablet_manager.cc:1916] T f4e3e64fdf584743a3a88df5d6600b22 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:09.073341 5996 leader_election.cc:343] T 85d35ebef3c24a2e89233dd900b63513 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:09.073378 6280 leader_election.cc:343] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:09.073453 5996 leader_election.cc:304] T 85d35ebef3c24a2e89233dd900b63513 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:09.073899 6928 raft_consensus.cc:2749] T 85d35ebef3c24a2e89233dd900b63513 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:09.074491 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 359b08ef348d4be68b14f9e871a5e519 (table default.Table_91a9675177604eb39c32e86718c59d31 [id=bf85ae2ea4884de58391fc9e7b140b7f]) successfully deleted
I20260923 19:50:09.074828 6030 tablet_service.cc:1558] Processing DeleteTablet for tablet e4f00490b0364f0e9f1b9569b870808e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:09.076977 6928 raft_consensus.cc:493] T 015c14b447fe4cd18d197b2d1ed5884e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:09.077139 6928 raft_consensus.cc:515] T 015c14b447fe4cd18d197b2d1ed5884e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.077669 6454 tablet_bootstrap.cc:492] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:09.077795 6928 leader_election.cc:290] T 015c14b447fe4cd18d197b2d1ed5884e P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:09.078576 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015c14b447fe4cd18d197b2d1ed5884e" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:09.079358 6456 tablet_bootstrap.cc:654] T 86473c5cbca54b5792b038aef445998c P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:09.079526 6454 tablet_bootstrap.cc:654] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:09.079525 5995 leader_election.cc:343] T 015c14b447fe4cd18d197b2d1ed5884e P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:09.080876 6458 ts_tablet_manager.cc:1929] T d70b7662d85a4f64a11420448c4d140d P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:09.081020 6458 log.cc:1199] T d70b7662d85a4f64a11420448c4d140d P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/d70b7662d85a4f64a11420448c4d140d
I20260923 19:50:09.081470 6458 ts_tablet_manager.cc:1950] T d70b7662d85a4f64a11420448c4d140d P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:09.081984 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015c14b447fe4cd18d197b2d1ed5884e" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:09.082309 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 365) took 1377 ms. Trace:
I20260923 19:50:09.082422 6458 rpcz_store.cc:276] 0923 19:50:07.704860 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.745393 (+ 40533us) service_pool.cc:224] Handling call
0923 19:50:09.048906 (+1303513us) ts_tablet_manager.cc:1151] Deleting tablet d70b7662d85a4f64a11420448c4d140d
0923 19:50:09.048916 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:09.058897 (+ 9981us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:09.080786 (+ 21889us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:09.082276 (+ 1490us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1303264}
I20260923 19:50:09.082798 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 369) took 1281 ms. Trace:
I20260923 19:50:09.082904 6458 rpcz_store.cc:276] 0923 19:50:07.801731 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.801810 (+ 79us) service_pool.cc:224] Handling call
0923 19:50:09.082680 (+1280870us) ts_tablet_manager.cc:1151] Deleting tablet 58ea466d1b2b40e9b9b4cd5be51f79e0
0923 19:50:09.082689 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:09.082771 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1280581}
I20260923 19:50:09.083299 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 370) took 1261 ms. Trace:
I20260923 19:50:09.083405 6458 rpcz_store.cc:276] 0923 19:50:07.821502 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.821578 (+ 76us) service_pool.cc:224] Handling call
0923 19:50:09.083169 (+1261591us) ts_tablet_manager.cc:1151] Deleting tablet d04b3a9ade7a405bb619704095fac279
0923 19:50:09.083177 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:09.083269 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1261319}
I20260923 19:50:09.083681 6458 tablet_replica.cc:333] T 5725a9cb95c448d0a5ea8114e90bc9fe P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:09.083643 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet d70b7662d85a4f64a11420448c4d140d (table default.Table_faa53cf5cc5541afb7b391368bdc55f7 [id=4a8f28e842e94d628326ca83935f23c6]) successfully deleted
I20260923 19:50:09.083890 6458 raft_consensus.cc:2243] T 5725a9cb95c448d0a5ea8114e90bc9fe P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
W20260923 19:50:09.083958 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 58ea466d1b2b40e9b9b4cd5be51f79e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58ea466d1b2b40e9b9b4cd5be51f79e0 already in progress: creating tablet
I20260923 19:50:09.084133 6458 raft_consensus.cc:2272] T 5725a9cb95c448d0a5ea8114e90bc9fe P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:09.084892 6458 ts_tablet_manager.cc:1916] T 5725a9cb95c448d0a5ea8114e90bc9fe P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:09.086398 5996 leader_election.cc:343] T 015c14b447fe4cd18d197b2d1ed5884e P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:09.086566 5996 leader_election.cc:304] T 015c14b447fe4cd18d197b2d1ed5884e P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:09.086975 6928 raft_consensus.cc:2749] T 015c14b447fe4cd18d197b2d1ed5884e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:09.057382 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet b92aaac328934d95a89e0fc08a80b0b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:09.090121 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet d04b3a9ade7a405bb619704095fac279 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d04b3a9ade7a405bb619704095fac279 already in progress: creating tablet
I20260923 19:50:09.092134 6461 ts_tablet_manager.cc:1929] T f4e3e64fdf584743a3a88df5d6600b22 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:09.092334 6461 log.cc:1199] T f4e3e64fdf584743a3a88df5d6600b22 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/f4e3e64fdf584743a3a88df5d6600b22
I20260923 19:50:09.094221 6950 raft_consensus.cc:493] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:09.094424 6950 raft_consensus.cc:515] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.095183 6950 leader_election.cc:290] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:09.096967 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_8ab9cdc2d4a14b679b8c38c86766c132"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:09.097607 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8ab9cdc2d4a14b679b8c38c86766c132 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:09.099146 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_b9ef7fd7111541e58e18257db75147a8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:09.099673 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b9ef7fd7111541e58e18257db75147a8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:09.099718 5800 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5812b40db6ab4814a5c5b3c869967f58" } modify_external_catalogs: true
I20260923 19:50:09.099885 5800 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5812b40db6ab4814a5c5b3c869967f58" } modify_external_catalogs: true
I20260923 19:50:09.100323 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab73e8a1b6774ca0b43e5be67da68fab" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:09.100538 6059 raft_consensus.cc:2468] T ab73e8a1b6774ca0b43e5be67da68fab P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:09.100958 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_f51e1260e7444679912cdeb128be6704"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:09.101046 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_96ab135786f74ab697bb37601c264ece"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:09.101212 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab73e8a1b6774ca0b43e5be67da68fab" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:09.101511 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f51e1260e7444679912cdeb128be6704 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:09.101691 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_96ab135786f74ab697bb37601c264ece in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:09.101706 6279 leader_election.cc:304] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:09.102543 6950 raft_consensus.cc:2804] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:09.102715 6950 raft_consensus.cc:493] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:09.102833 6950 raft_consensus.cc:3060] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:09.104667 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_333fad3a38bb4b2781e372f8991a0f34"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:09.105194 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_333fad3a38bb4b2781e372f8991a0f34 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:09.105552 6280 leader_election.cc:343] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:09.106108 6458 ts_tablet_manager.cc:1929] T 5725a9cb95c448d0a5ea8114e90bc9fe P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.6
I20260923 19:50:09.106258 6458 log.cc:1199] T 5725a9cb95c448d0a5ea8114e90bc9fe P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/5725a9cb95c448d0a5ea8114e90bc9fe
I20260923 19:50:09.106685 6458 ts_tablet_manager.cc:1950] T 5725a9cb95c448d0a5ea8114e90bc9fe P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:09.107971 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet b7f372b952804ac58e602998d9b77d72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:49:59 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:09.110251 6461 ts_tablet_manager.cc:1950] T f4e3e64fdf584743a3a88df5d6600b22 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:09.111338 6461 tablet_replica.cc:333] T 337f32eb47954689a6eb8f74408e01d9 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:09.111552 6461 raft_consensus.cc:2243] T 337f32eb47954689a6eb8f74408e01d9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:09.111730 6461 raft_consensus.cc:2272] T 337f32eb47954689a6eb8f74408e01d9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:09.112274 6461 ts_tablet_manager.cc:1916] T 337f32eb47954689a6eb8f74408e01d9 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:09.114910 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet f4e3e64fdf584743a3a88df5d6600b22 (table default.Table_7342c845a15749d5b6bd089d55287f3a [id=d9b49a00239d40f3982556322a0143e4]) successfully deleted
I20260923 19:50:09.115892 6920 raft_consensus.cc:493] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:09.116117 6920 raft_consensus.cc:515] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.116839 6920 leader_election.cc:290] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:09.118490 6137 leader_election.cc:343] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 4750e2a1b24e4bc7aafa4cd36afebbbd
I20260923 19:50:09.118633 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4750e2a1b24e4bc7aafa4cd36afebbbd" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:09.118856 6344 raft_consensus.cc:2468] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:09.119803 6139 leader_election.cc:304] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:09.120366 6920 raft_consensus.cc:2804] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:09.120461 6920 raft_consensus.cc:493] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:09.120558 6920 raft_consensus.cc:3060] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:09.123603 6920 raft_consensus.cc:515] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.125727 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4750e2a1b24e4bc7aafa4cd36afebbbd" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
W20260923 19:50:09.125982 6137 leader_election.cc:343] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 4750e2a1b24e4bc7aafa4cd36afebbbd
I20260923 19:50:09.126089 6344 raft_consensus.cc:3060] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
W20260923 19:50:09.126363 5797 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1985088eb56b40c1aeecc1ec7409bcdf consensus state has no leader
I20260923 19:50:09.126682 5797 master_service.cc:960] ReplaceTablet: received request to replace tablet 789c54477bec4636bb3669e1f62730e2 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:09.127254 5797 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_1d4cb0bc31f24833b90af35484c083e5" } new_table_name: "default.Table_3be501518fae4ecdab998e08f25d6660" modify_external_catalogs: true
I20260923 19:50:09.128556 6867 raft_consensus.cc:493] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:09.128705 6867 raft_consensus.cc:515] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.129410 6867 leader_election.cc:290] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:09.130468 6344 raft_consensus.cc:2468] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:09.132014 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556b32b8ccd54c439f86b0069e2a5ce0" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:09.132213 6139 leader_election.cc:304] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:09.132277 6059 raft_consensus.cc:2468] T 556b32b8ccd54c439f86b0069e2a5ce0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:09.132558 7013 raft_consensus.cc:2804] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:09.132730 7013 raft_consensus.cc:697] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:09.133029 7013 consensus_queue.cc:237] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.133723 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 372) took 1203 ms. Trace:
I20260923 19:50:09.133855 6458 rpcz_store.cc:276] 0923 19:50:07.930238 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.930291 (+ 53us) service_pool.cc:224] Handling call
0923 19:50:09.083627 (+1153336us) ts_tablet_manager.cc:1151] Deleting tablet 5725a9cb95c448d0a5ea8114e90bc9fe
0923 19:50:09.083636 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:09.102392 (+ 18756us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:09.106028 (+ 3636us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:09.133656 (+ 27628us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1152916}
I20260923 19:50:09.134441 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 371) took 1204 ms. Trace:
I20260923 19:50:09.134531 6458 rpcz_store.cc:276] 0923 19:50:07.930060 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.930461 (+ 401us) service_pool.cc:224] Handling call
0923 19:50:09.134242 (+1203781us) ts_tablet_manager.cc:1151] Deleting tablet a01a86b6fd4b44d3808c2040525d7b61
0923 19:50:09.134256 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:09.134395 (+ 139us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1203358}
I20260923 19:50:09.134908 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 373) took 1204 ms. Trace:
I20260923 19:50:09.135002 6458 rpcz_store.cc:276] 0923 19:50:07.930383 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.930423 (+ 40us) service_pool.cc:224] Handling call
0923 19:50:09.134761 (+1204338us) ts_tablet_manager.cc:1151] Deleting tablet efc63a151f6444dfb03c3f15f6f54473
0923 19:50:09.134770 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:09.134848 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1203741}
I20260923 19:50:09.135346 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 374) took 1203 ms. Trace:
I20260923 19:50:09.135435 6458 rpcz_store.cc:276] 0923 19:50:07.932202 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.933242 (+ 1040us) service_pool.cc:224] Handling call
0923 19:50:09.135203 (+1201961us) ts_tablet_manager.cc:1151] Deleting tablet c19298691d5d4209b2d1147a1aad2f6f
0923 19:50:09.135211 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:09.135289 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1201733}
I20260923 19:50:09.135644 6279 leader_election.cc:304] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:09.135824 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 380) took 1100 ms. Trace:
I20260923 19:50:09.135953 6867 raft_consensus.cc:2804] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:09.136230 6867 raft_consensus.cc:493] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:09.136346 6867 raft_consensus.cc:3060] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:09.137280 5802 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 85d35ebef3c24a2e89233dd900b63513 (table default.Table_97b31aab6721460eb4c6ac8d6f6f1983 [id=da91b06e11c64bb0aaec37a0188b5586]). Expected version 2 got 0
I20260923 19:50:09.140547 6037 tablet_service.cc:1511] Processing CreateTablet for tablet ecd91bf5bd9447c0bb20ba43573ff08d (DEFAULT_TABLE table=default.Table_0f2148660919423195f95a973fb63500 [id=429f7e5fed0e4821b00a8799176b5dbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.140736 6022 tablet_service.cc:1511] Processing CreateTablet for tablet c462a9a5bde64e8094d7a2ca09740fc9 (DEFAULT_TABLE table=default.Table_b72aa27a80014ace84053df8c32cf34f [id=87cfaf39afaf4ad08c28a17b601de141]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.140779 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 2ca0280d7f6d486eaded141d233e5060 (DEFAULT_TABLE table=default.Table_ad0aa8bee51e471fa8ce53e180a1f78d [id=7563ab73e5694980b53e6d4cbf23f90e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.141031 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecd91bf5bd9447c0bb20ba43573ff08d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.140558 6030 tablet_service.cc:1511] Processing CreateTablet for tablet 7a6fca6d55b5493a9fb7f2e1cbf1ea29 (DEFAULT_TABLE table=default.Table_3e33671b61984643885effdfc0f6b092 [id=1691c4551e98475e93f8734ad7fe80e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.141242 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c462a9a5bde64e8094d7a2ca09740fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.141433 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a6fca6d55b5493a9fb7f2e1cbf1ea29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.141935 6031 tablet_service.cc:1511] Processing CreateTablet for tablet 2ed8d49f1b3d4bee80b1822df2a7f495 (DEFAULT_TABLE table=default.Table_b0aaf57c3ec9414f89529017165bc65b [id=84b65375453448aebd9bce135f58bd90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.142043 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ca0280d7f6d486eaded141d233e5060. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.142298 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ed8d49f1b3d4bee80b1822df2a7f495. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.135944 6458 rpcz_store.cc:276] 0923 19:50:08.034859 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.042882 (+ 8023us) service_pool.cc:224] Handling call
0923 19:50:09.135653 (+1092771us) ts_tablet_manager.cc:1151] Deleting tablet 035abecfbee7474d9dd048f35e28e867
0923 19:50:09.135662 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:09.135757 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1092436}
I20260923 19:50:09.147913 6458 tablet_replica.cc:333] T 3190d18f00234d71b0a58c2c334ef45f P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:09.148156 6458 raft_consensus.cc:2243] T 3190d18f00234d71b0a58c2c334ef45f P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:09.148368 6458 raft_consensus.cc:2272] T 3190d18f00234d71b0a58c2c334ef45f P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:09.131752 6461 ts_tablet_manager.cc:1929] T 337f32eb47954689a6eb8f74408e01d9 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:09.149020 6458 ts_tablet_manager.cc:1916] T 3190d18f00234d71b0a58c2c334ef45f P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:09.149307 6182 tablet_service.cc:1511] Processing CreateTablet for tablet 2ed8d49f1b3d4bee80b1822df2a7f495 (DEFAULT_TABLE table=default.Table_b0aaf57c3ec9414f89529017165bc65b [id=84b65375453448aebd9bce135f58bd90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.149772 6182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ed8d49f1b3d4bee80b1822df2a7f495. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.150436 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556b32b8ccd54c439f86b0069e2a5ce0" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:09.151638 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 5725a9cb95c448d0a5ea8114e90bc9fe (table default.Table_da05e9879e314fd78f1b40a857a393fb [id=d3b60b7fc1d84a46aa49932d5c3363ea]) successfully deleted
W20260923 19:50:09.151907 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet a01a86b6fd4b44d3808c2040525d7b61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a01a86b6fd4b44d3808c2040525d7b61 already in progress: creating tablet
W20260923 19:50:09.152150 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet efc63a151f6444dfb03c3f15f6f54473 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet efc63a151f6444dfb03c3f15f6f54473 already in progress: creating tablet
W20260923 19:50:09.152336 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet c19298691d5d4209b2d1147a1aad2f6f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c19298691d5d4209b2d1147a1aad2f6f already in progress: creating tablet
W20260923 19:50:09.152546 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 035abecfbee7474d9dd048f35e28e867 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 035abecfbee7474d9dd048f35e28e867 already in progress: creating tablet
W20260923 19:50:09.154167 6280 leader_election.cc:343] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:09.154512 6321 tablet_service.cc:1511] Processing CreateTablet for tablet 7a6fca6d55b5493a9fb7f2e1cbf1ea29 (DEFAULT_TABLE table=default.Table_3e33671b61984643885effdfc0f6b092 [id=1691c4551e98475e93f8734ad7fe80e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.154543 6169 tablet_service.cc:1511] Processing CreateTablet for tablet e55ab069a0fa48398b39bbb9e7c65cd1 (DEFAULT_TABLE table=default.Table_b3579cbf488c4d1eb5f605ab4e11c340 [id=a6dbcc9c44fb400b926e21aa6d683186]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.154955 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a6fca6d55b5493a9fb7f2e1cbf1ea29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.154959 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e55ab069a0fa48398b39bbb9e7c65cd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.157402 6310 tablet_service.cc:1511] Processing CreateTablet for tablet ecd91bf5bd9447c0bb20ba43573ff08d (DEFAULT_TABLE table=default.Table_0f2148660919423195f95a973fb63500 [id=429f7e5fed0e4821b00a8799176b5dbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.158245 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 2ed8d49f1b3d4bee80b1822df2a7f495 (DEFAULT_TABLE table=default.Table_b0aaf57c3ec9414f89529017165bc65b [id=84b65375453448aebd9bce135f58bd90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.161192 6920 leader_election.cc:290] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:09.163944 6950 raft_consensus.cc:515] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.164402 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecd91bf5bd9447c0bb20ba43573ff08d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.166761 6311 tablet_service.cc:1511] Processing CreateTablet for tablet e55ab069a0fa48398b39bbb9e7c65cd1 (DEFAULT_TABLE table=default.Table_b3579cbf488c4d1eb5f605ab4e11c340 [id=a6dbcc9c44fb400b926e21aa6d683186]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.167017 6164 tablet_service.cc:1511] Processing CreateTablet for tablet bfe87e992ca04ea293e354da508e4c67 (DEFAULT_TABLE table=default.Table_416d1e6300c44657bdc13cbaa5cb5af0 [id=d300c678613c463398eb51a1fd4121f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.167346 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e55ab069a0fa48398b39bbb9e7c65cd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.167536 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfe87e992ca04ea293e354da508e4c67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.171314 6201 raft_consensus.cc:3060] T 5c0142f4e3ad42048803481d68f0ee5d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:09.171350 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ed8d49f1b3d4bee80b1822df2a7f495. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.164486 7018 raft_consensus.cc:515] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.178915 7018 leader_election.cc:290] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:09.180086 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26031fe469d046518cdd0f1e955e19d1" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:09.180210 6179 tablet_service.cc:1511] Processing CreateTablet for tablet c462a9a5bde64e8094d7a2ca09740fc9 (DEFAULT_TABLE table=default.Table_b72aa27a80014ace84053df8c32cf34f [id=87cfaf39afaf4ad08c28a17b601de141]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.180655 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c462a9a5bde64e8094d7a2ca09740fc9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:09.180843 6280 leader_election.cc:343] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:09.164743 6867 raft_consensus.cc:515] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.182801 6867 leader_election.cc:290] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:09.183213 6183 tablet_service.cc:1511] Processing CreateTablet for tablet ecd91bf5bd9447c0bb20ba43573ff08d (DEFAULT_TABLE table=default.Table_0f2148660919423195f95a973fb63500 [id=429f7e5fed0e4821b00a8799176b5dbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.184101 6950 leader_election.cc:290] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:09.183773 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556b32b8ccd54c439f86b0069e2a5ce0" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:09.185365 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab73e8a1b6774ca0b43e5be67da68fab" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
W20260923 19:50:09.186976 6280 leader_election.cc:343] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:09.187342 6308 tablet_service.cc:1511] Processing CreateTablet for tablet bfe87e992ca04ea293e354da508e4c67 (DEFAULT_TABLE table=default.Table_416d1e6300c44657bdc13cbaa5cb5af0 [id=d300c678613c463398eb51a1fd4121f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.187757 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecd91bf5bd9447c0bb20ba43573ff08d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.188007 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfe87e992ca04ea293e354da508e4c67. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:09.187343 6280 leader_election.cc:343] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:09.190135 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 2ca0280d7f6d486eaded141d233e5060 (DEFAULT_TABLE table=default.Table_ad0aa8bee51e471fa8ce53e180a1f78d [id=7563ab73e5694980b53e6d4cbf23f90e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.190754 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ca0280d7f6d486eaded141d233e5060. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.194506 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 7a6fca6d55b5493a9fb7f2e1cbf1ea29 (DEFAULT_TABLE table=default.Table_3e33671b61984643885effdfc0f6b092 [id=1691c4551e98475e93f8734ad7fe80e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.196197 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a6fca6d55b5493a9fb7f2e1cbf1ea29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.198060 6461 log.cc:1199] T 337f32eb47954689a6eb8f74408e01d9 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/337f32eb47954689a6eb8f74408e01d9
I20260923 19:50:09.198172 6164 tablet_service.cc:1511] Processing CreateTablet for tablet 7d654b14cafa453185179fe57a25e2d9 (DEFAULT_TABLE table=default.Table_c80b112b6ce9402f87b07ee8a6e1b78b [id=f509f74bbf6b4b6381509c265432cbd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.201016 6950 raft_consensus.cc:493] T ec4284d6a0fa416ca95b4d675c8e3912 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:09.201684 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d654b14cafa453185179fe57a25e2d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.201660 6032 tablet_service.cc:1511] Processing CreateTablet for tablet e55ab069a0fa48398b39bbb9e7c65cd1 (DEFAULT_TABLE table=default.Table_b3579cbf488c4d1eb5f605ab4e11c340 [id=a6dbcc9c44fb400b926e21aa6d683186]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.201510 6950 raft_consensus.cc:515] T ec4284d6a0fa416ca95b4d675c8e3912 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.203078 6461 ts_tablet_manager.cc:1950] T 337f32eb47954689a6eb8f74408e01d9 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:09.203018 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26031fe469d046518cdd0f1e955e19d1" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:09.203276 6059 raft_consensus.cc:3060] T 26031fe469d046518cdd0f1e955e19d1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:09.203490 6950 leader_election.cc:290] T ec4284d6a0fa416ca95b4d675c8e3912 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:09.205034 6034 tablet_service.cc:1511] Processing CreateTablet for tablet bfe87e992ca04ea293e354da508e4c67 (DEFAULT_TABLE table=default.Table_416d1e6300c44657bdc13cbaa5cb5af0 [id=d300c678613c463398eb51a1fd4121f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.206064 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4284d6a0fa416ca95b4d675c8e3912" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:09.206732 6058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556b32b8ccd54c439f86b0069e2a5ce0" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:09.206909 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 337f32eb47954689a6eb8f74408e01d9 (table default.Table_c80b112b6ce9402f87b07ee8a6e1b78b [id=f509f74bbf6b4b6381509c265432cbd7]) successfully deleted
I20260923 19:50:09.207015 6058 raft_consensus.cc:3060] T 556b32b8ccd54c439f86b0069e2a5ce0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:09.207345 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e55ab069a0fa48398b39bbb9e7c65cd1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:09.207460 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 30fe07956e8940fcb7ba1e2e16ced463 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30fe07956e8940fcb7ba1e2e16ced463 already in progress: creating tablet
I20260923 19:50:09.208122 6461 tablet_replica.cc:333] T daafbafae5004b8499e7ea93342c0517 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
W20260923 19:50:09.208110 6280 leader_election.cc:343] T ec4284d6a0fa416ca95b4d675c8e3912 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:09.208299 6057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab73e8a1b6774ca0b43e5be67da68fab" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:09.208577 6057 raft_consensus.cc:3060] T ab73e8a1b6774ca0b43e5be67da68fab P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:09.216218 6461 raft_consensus.cc:2243] T daafbafae5004b8499e7ea93342c0517 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:09.216451 6461 raft_consensus.cc:2272] T daafbafae5004b8499e7ea93342c0517 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:09.217403 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfe87e992ca04ea293e354da508e4c67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.219266 6458 ts_tablet_manager.cc:1929] T 3190d18f00234d71b0a58c2c334ef45f P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:09.219393 6458 log.cc:1199] T 3190d18f00234d71b0a58c2c334ef45f P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/3190d18f00234d71b0a58c2c334ef45f
I20260923 19:50:09.219743 6458 ts_tablet_manager.cc:1950] T 3190d18f00234d71b0a58c2c334ef45f P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:09.214527 6056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4284d6a0fa416ca95b4d675c8e3912" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:09.221093 6056 raft_consensus.cc:2468] T ec4284d6a0fa416ca95b4d675c8e3912 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:09.221612 6279 leader_election.cc:304] T ec4284d6a0fa416ca95b4d675c8e3912 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:09.222090 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 3190d18f00234d71b0a58c2c334ef45f (table default.Table_adfa6338ea024e4a87e614cbc086cbc3 [id=eedb3f35db9640d992be8887c071962f]) successfully deleted
I20260923 19:50:09.222301 6950 raft_consensus.cc:2804] T ec4284d6a0fa416ca95b4d675c8e3912 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:09.222404 6950 raft_consensus.cc:493] T ec4284d6a0fa416ca95b4d675c8e3912 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:09.222507 6950 raft_consensus.cc:3060] T ec4284d6a0fa416ca95b4d675c8e3912 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:09.223660 6458 tablet_replica.cc:333] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:09.224009 6458 raft_consensus.cc:2243] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:09.224617 6458 pending_rounds.cc:70] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd: Trying to abort 1 pending ops.
I20260923 19:50:09.225062 6458 pending_rounds.cc:77] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630557255770112 op_type: NO_OP noop_request { }
I20260923 19:50:09.225443 6458 raft_consensus.cc:2889] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:09.226138 6458 raft_consensus.cc:2272] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:09.226258 6312 tablet_service.cc:1511] Processing CreateTablet for tablet c462a9a5bde64e8094d7a2ca09740fc9 (DEFAULT_TABLE table=default.Table_b72aa27a80014ace84053df8c32cf34f [id=87cfaf39afaf4ad08c28a17b601de141]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.229206 6458 ts_tablet_manager.cc:1916] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:09.229907 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet e4f00490b0364f0e9f1b9569b870808e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:09.231709 6867 raft_consensus.cc:493] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:09.231874 6867 raft_consensus.cc:515] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.232452 6323 tablet_service.cc:1511] Processing CreateTablet for tablet 7d654b14cafa453185179fe57a25e2d9 (DEFAULT_TABLE table=default.Table_c80b112b6ce9402f87b07ee8a6e1b78b [id=f509f74bbf6b4b6381509c265432cbd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.232656 6867 leader_election.cc:290] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:09.233446 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cbfaa34c924a678f23cbcbf1a6fb0a" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:09.234046 6280 leader_election.cc:343] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:09.234285 6279 leader_election.cc:343] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: e9cbfaa34c924a678f23cbcbf1a6fb0a
I20260923 19:50:09.234472 6279 leader_election.cc:304] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:09.229544 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c462a9a5bde64e8094d7a2ca09740fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.234799 6867 raft_consensus.cc:2749] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:09.234794 6324 tablet_service.cc:1511] Processing CreateTablet for tablet 2ca0280d7f6d486eaded141d233e5060 (DEFAULT_TABLE table=default.Table_ad0aa8bee51e471fa8ce53e180a1f78d [id=7563ab73e5694980b53e6d4cbf23f90e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.235826 6058 raft_consensus.cc:2468] T 556b32b8ccd54c439f86b0069e2a5ce0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:09.236523 6279 leader_election.cc:304] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:09.236835 6867 raft_consensus.cc:2804] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:09.236842 6173 tablet_service.cc:1511] Processing CreateTablet for tablet 950428e098994f2a9b5b17eeb36915cd (DEFAULT_TABLE table=default.Table_1704ffca6cc6482f88bac19f06b8052c [id=3f1aee81c53343468cca15adc570c588]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.236967 6867 raft_consensus.cc:697] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:09.237262 6867 consensus_queue.cc:237] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.237515 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 950428e098994f2a9b5b17eeb36915cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.240659 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d654b14cafa453185179fe57a25e2d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.242955 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ca0280d7f6d486eaded141d233e5060. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.244242 6031 tablet_service.cc:1511] Processing CreateTablet for tablet 7d654b14cafa453185179fe57a25e2d9 (DEFAULT_TABLE table=default.Table_c80b112b6ce9402f87b07ee8a6e1b78b [id=f509f74bbf6b4b6381509c265432cbd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.244778 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d654b14cafa453185179fe57a25e2d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.248450 6461 ts_tablet_manager.cc:1916] T daafbafae5004b8499e7ea93342c0517 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:09.251065 6950 raft_consensus.cc:515] T ec4284d6a0fa416ca95b4d675c8e3912 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.254658 6459 ts_tablet_manager.cc:1929] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.6
I20260923 19:50:09.260375 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 950428e098994f2a9b5b17eeb36915cd (DEFAULT_TABLE table=default.Table_1704ffca6cc6482f88bac19f06b8052c [id=3f1aee81c53343468cca15adc570c588]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.259179 6308 tablet_service.cc:1511] Processing CreateTablet for tablet 950428e098994f2a9b5b17eeb36915cd (DEFAULT_TABLE table=default.Table_1704ffca6cc6482f88bac19f06b8052c [id=3f1aee81c53343468cca15adc570c588]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.261624 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 950428e098994f2a9b5b17eeb36915cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.272589 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_bd91264aa4a0430eb1a8f69129fb0f3f" } new_table_name: "default.Table_bb0cff9e9bcd4de98b915af1c7e3bca2" modify_external_catalogs: true
I20260923 19:50:09.272950 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_81c9757c73ef447b84367e06b0dc1614"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:09.273468 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_81c9757c73ef447b84367e06b0dc1614 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:09.273904 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 950428e098994f2a9b5b17eeb36915cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.274115 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_0f595721f8434bcda65bc5803008bf06"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:09.274648 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f595721f8434bcda65bc5803008bf06 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:09.274706 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d0220d5f0f8c461bb1c01dd67bdf55fe" } new_table_name: "default.Table_634d169330774b228dacd2343d35d4e9" modify_external_catalogs: true
I20260923 19:50:09.275902 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_f022376095554ea9a858fae27248e742"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:09.276389 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f022376095554ea9a858fae27248e742 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:09.272627 5801 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 85d35ebef3c24a2e89233dd900b63513 (table default.Table_97b31aab6721460eb4c6ac8d6f6f1983 [id=da91b06e11c64bb0aaec37a0188b5586]). Expected version 2 got 0
I20260923 19:50:09.278504 5801 master_service.cc:960] ReplaceTablet: received request to replace tablet 4b15b250f594459eb959b4871f7ae398 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:09.279071 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b729507fea034866a46da1d40fde099c" } new_table_name: "default.Table_fa5d77accb2d4cb2a336e0394074518a" modify_external_catalogs: true
I20260923 19:50:09.280401 6059 raft_consensus.cc:2468] T 26031fe469d046518cdd0f1e955e19d1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:09.281317 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 015c14b447fe4cd18d197b2d1ed5884e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:09.281687 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_0e8b64b05f104a458762900a86b66629"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:09.282891 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0e8b64b05f104a458762900a86b66629 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:09.285566 5797 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 98f61ace3a984938ace1fedbaa1dafa3 consensus state has no leader
W20260923 19:50:09.290030 5700 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 174342us
I20260923 19:50:09.298609 6028 tablet_service.cc:1511] Processing CreateTablet for tablet a0743d5ac2264af6b045af0474cbf58c (DEFAULT_TABLE table=default.Table_a856ec7fa0204ebc8d516514567a25ac [id=1ea285626b994f8a83c5d1860f0c05eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.299186 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0743d5ac2264af6b045af0474cbf58c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.311483 5797 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_eb0e9a67b9274e2ea8978f82929b81a8" } modify_external_catalogs: true
I20260923 19:50:09.311743 5797 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_eb0e9a67b9274e2ea8978f82929b81a8" } modify_external_catalogs: true
I20260923 19:50:09.317202 6057 raft_consensus.cc:2468] T ab73e8a1b6774ca0b43e5be67da68fab P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:09.322847 5800 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 02fa9052a7054659baf9b07b770bb538
I20260923 19:50:09.324450 5799 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 14c917ac93fd436aa13fb0839fae883f
I20260923 19:50:09.330168 5799 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_af4eb1297d19460fade71cf33df073a4" } modify_external_catalogs: true
I20260923 19:50:09.330420 5799 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_af4eb1297d19460fade71cf33df073a4" } modify_external_catalogs: true
I20260923 19:50:09.335141 5803 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_0b7f0cec058c44798de4db8eeaf31ef4" } modify_external_catalogs: true
I20260923 19:50:09.335368 5803 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_0b7f0cec058c44798de4db8eeaf31ef4" } modify_external_catalogs: true
I20260923 19:50:09.335640 6030 tablet_service.cc:1558] Processing DeleteTablet for tablet 14c917ac93fd436aa13fb0839fae883f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:09.335988 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet 02fa9052a7054659baf9b07b770bb538 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:09.335999 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_b1d68ffe395448d195d5a18f8dae7539"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:09.336577 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b1d68ffe395448d195d5a18f8dae7539 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:09.338450 6461 ts_tablet_manager.cc:1929] T daafbafae5004b8499e7ea93342c0517 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:09.338644 6461 log.cc:1199] T daafbafae5004b8499e7ea93342c0517 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/daafbafae5004b8499e7ea93342c0517
I20260923 19:50:09.339084 6461 ts_tablet_manager.cc:1950] T daafbafae5004b8499e7ea93342c0517 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:09.340934 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet daafbafae5004b8499e7ea93342c0517 (table default.Table_4611fd8972c94dfdbbaf669673dbd540 [id=08d65b643de645c7b760d27d28eccafe]) successfully deleted
I20260923 19:50:09.346091 5802 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a856ec7fa0204ebc8d516514567a25ac" } new_table_name: "default.Table_b7de91eb86a441d0b48afb32ddbe99ca" modify_external_catalogs: true
I20260923 19:50:09.347084 6457 tablet_bootstrap.cc:492] T 6fe14389e2a3487587dfcf7a8b4b242d P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:09.347388 6457 ts_tablet_manager.cc:1403] T 6fe14389e2a3487587dfcf7a8b4b242d P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.294s user 0.022s sys 0.049s
I20260923 19:50:09.348419 6457 raft_consensus.cc:359] T 6fe14389e2a3487587dfcf7a8b4b242d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.348939 6457 raft_consensus.cc:385] T 6fe14389e2a3487587dfcf7a8b4b242d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:09.349289 6457 raft_consensus.cc:740] T 6fe14389e2a3487587dfcf7a8b4b242d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:09.349747 6457 consensus_queue.cc:260] T 6fe14389e2a3487587dfcf7a8b4b242d P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.356562 6457 ts_tablet_manager.cc:1434] T 6fe14389e2a3487587dfcf7a8b4b242d P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.009s user 0.000s sys 0.002s
I20260923 19:50:09.359408 6457 tablet_bootstrap.cc:492] T c48d4a8371fa4454b7c67291db3ab796 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:09.356971 6461 tablet_replica.cc:333] T 6e781ccf4aa343fc924138c3cc2b04e6 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:09.361972 7013 raft_consensus.cc:493] T b7f372b952804ac58e602998d9b77d72 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:09.362093 6459 log.cc:1199] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/5725a9cb95c448d0a5ea8114e90bc9fe
I20260923 19:50:09.362547 6461 raft_consensus.cc:2243] T 6e781ccf4aa343fc924138c3cc2b04e6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:09.362793 6461 raft_consensus.cc:2272] T 6e781ccf4aa343fc924138c3cc2b04e6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:09.363193 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a263c0fc71424999b76ef01de9a51eda consensus state has no leader
I20260923 19:50:09.363500 6461 ts_tablet_manager.cc:1916] T 6e781ccf4aa343fc924138c3cc2b04e6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:09.365734 6279 leader_election.cc:304] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:09.366117 6867 raft_consensus.cc:2804] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
W20260923 19:50:09.366195 6279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.193:39887, user_credentials={real_user=slave}} blocked reactor thread for 85084.2us
I20260923 19:50:09.368717 6867 raft_consensus.cc:697] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:09.369017 6867 consensus_queue.cc:237] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.369163 7013 raft_consensus.cc:515] T b7f372b952804ac58e602998d9b77d72 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.370082 6950 leader_election.cc:290] T ec4284d6a0fa416ca95b4d675c8e3912 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:09.370944 6310 tablet_service.cc:1511] Processing CreateTablet for tablet a0743d5ac2264af6b045af0474cbf58c (DEFAULT_TABLE table=default.Table_a856ec7fa0204ebc8d516514567a25ac [id=1ea285626b994f8a83c5d1860f0c05eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.371114 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_497399963ce44a7fa70b33a81e853df8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:09.371423 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0743d5ac2264af6b045af0474cbf58c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:09.371716 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_497399963ce44a7fa70b33a81e853df8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:09.376534 6457 tablet_bootstrap.cc:654] T c48d4a8371fa4454b7c67291db3ab796 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:09.385783 5695 external_mini_cluster.cc:1372] Running /tmp/dist-test-task5JtCX2/build/asan/bin/kudu
/tmp/dist-test-task5JtCX2/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.143.254:37151
--webserver_interface=127.5.143.254
--webserver_port=39441
--builtin_ntp_servers=127.5.143.212:38183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.143.254:37151,127.5.143.253:45285,127.5.143.252:45543
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260923 19:50:09.391111 6031 tablet_service.cc:1558] Processing DeleteTablet for tablet 6fe14389e2a3487587dfcf7a8b4b242d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:09.393525 6457 tablet_bootstrap.cc:492] T c48d4a8371fa4454b7c67291db3ab796 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:09.393823 6457 ts_tablet_manager.cc:1403] T c48d4a8371fa4454b7c67291db3ab796 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.035s user 0.000s sys 0.005s
I20260923 19:50:09.394933 6457 raft_consensus.cc:359] T c48d4a8371fa4454b7c67291db3ab796 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.395268 6457 raft_consensus.cc:385] T c48d4a8371fa4454b7c67291db3ab796 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:09.395421 6457 raft_consensus.cc:740] T c48d4a8371fa4454b7c67291db3ab796 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:09.395824 6457 consensus_queue.cc:260] T c48d4a8371fa4454b7c67291db3ab796 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.397620 6165 tablet_service.cc:1558] Processing DeleteTablet for tablet 14c917ac93fd436aa13fb0839fae883f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:09.399827 6457 ts_tablet_manager.cc:1434] T c48d4a8371fa4454b7c67291db3ab796 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
W20260923 19:50:09.400962 6137 leader_election.cc:343] T b7f372b952804ac58e602998d9b77d72 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: b7f372b952804ac58e602998d9b77d72
I20260923 19:50:09.406515 6457 tablet_bootstrap.cc:492] T f108ebdaecab42e7b57057c7ecfbe690 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:09.408278 7013 leader_election.cc:290] T b7f372b952804ac58e602998d9b77d72 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:09.408670 6168 tablet_service.cc:1558] Processing DeleteTablet for tablet 02fa9052a7054659baf9b07b770bb538 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:09.410280 6174 tablet_service.cc:1511] Processing CreateTablet for tablet a0743d5ac2264af6b045af0474cbf58c (DEFAULT_TABLE table=default.Table_a856ec7fa0204ebc8d516514567a25ac [id=1ea285626b994f8a83c5d1860f0c05eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.411141 6454 tablet_bootstrap.cc:492] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:09.411347 6454 ts_tablet_manager.cc:1403] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.341s user 0.004s sys 0.005s
I20260923 19:50:09.412266 6454 raft_consensus.cc:359] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.412551 6454 raft_consensus.cc:385] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:09.412781 6454 raft_consensus.cc:740] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:09.413160 6454 consensus_queue.cc:260] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.402762 6461 ts_tablet_manager.cc:1929] T 6e781ccf4aa343fc924138c3cc2b04e6 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:09.414158 6461 log.cc:1199] T 6e781ccf4aa343fc924138c3cc2b04e6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/6e781ccf4aa343fc924138c3cc2b04e6
I20260923 19:50:09.414589 6461 ts_tablet_manager.cc:1950] T 6e781ccf4aa343fc924138c3cc2b04e6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:09.415247 6457 tablet_bootstrap.cc:654] T f108ebdaecab42e7b57057c7ecfbe690 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:09.417171 6461 tablet_replica.cc:333] T 015c14b447fe4cd18d197b2d1ed5884e P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:09.417451 6461 raft_consensus.cc:2243] T 015c14b447fe4cd18d197b2d1ed5884e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:09.417675 6461 raft_consensus.cc:2272] T 015c14b447fe4cd18d197b2d1ed5884e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:09.418228 6459 ts_tablet_manager.cc:1950] T 5725a9cb95c448d0a5ea8114e90bc9fe P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:09.418613 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 404) took 1534 ms. Trace:
I20260923 19:50:09.418622 6461 ts_tablet_manager.cc:1916] T 015c14b447fe4cd18d197b2d1ed5884e P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:09.418821 6459 rpcz_store.cc:276] 0923 19:50:07.884123 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.888755 (+ 4632us) service_pool.cc:224] Handling call
0923 19:50:08.872648 (+983893us) ts_tablet_manager.cc:1151] Deleting tablet 5725a9cb95c448d0a5ea8114e90bc9fe
0923 19:50:08.872655 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:09.082488 (+209833us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:09.254548 (+172060us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:09.418582 (+164034us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":983640}
I20260923 19:50:09.419433 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 5725a9cb95c448d0a5ea8114e90bc9fe (table default.Table_da05e9879e314fd78f1b40a857a393fb [id=d3b60b7fc1d84a46aa49932d5c3363ea]) successfully deleted
I20260923 19:50:09.422113 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_2faafe31fd0c43caa3c83f70f72c1c62"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:09.422698 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2faafe31fd0c43caa3c83f70f72c1c62 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:09.425374 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0743d5ac2264af6b045af0474cbf58c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:09.425467 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ba4e9fee05994c0d8e7d1f21788280d3 consensus state has no leader
I20260923 19:50:09.425837 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_2450b2fff14d4d4ebd74a9ebf00fd118"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:09.426399 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2450b2fff14d4d4ebd74a9ebf00fd118 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:09.428143 6457 tablet_bootstrap.cc:492] T f108ebdaecab42e7b57057c7ecfbe690 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:09.428354 6457 ts_tablet_manager.cc:1403] T f108ebdaecab42e7b57057c7ecfbe690 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.001s
I20260923 19:50:09.429313 6457 raft_consensus.cc:359] T f108ebdaecab42e7b57057c7ecfbe690 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.429570 6457 raft_consensus.cc:385] T f108ebdaecab42e7b57057c7ecfbe690 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:09.429666 6457 raft_consensus.cc:740] T f108ebdaecab42e7b57057c7ecfbe690 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:09.430524 6458 ts_tablet_manager.cc:1929] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:09.430917 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet e9cbfaa34c924a678f23cbcbf1a6fb0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:09.430549 6457 consensus_queue.cc:260] T f108ebdaecab42e7b57057c7ecfbe690 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.431716 6279 leader_election.cc:304] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:09.432559 6458 log.cc:1199] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/5c0142f4e3ad42048803481d68f0ee5d
I20260923 19:50:09.434408 6457 ts_tablet_manager.cc:1434] T f108ebdaecab42e7b57057c7ecfbe690 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260923 19:50:09.436105 6057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4284d6a0fa416ca95b4d675c8e3912" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:09.436331 6057 raft_consensus.cc:3060] T ec4284d6a0fa416ca95b4d675c8e3912 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:09.439484 6057 raft_consensus.cc:2468] T ec4284d6a0fa416ca95b4d675c8e3912 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:09.442559 6279 leader_election.cc:304] T ec4284d6a0fa416ca95b4d675c8e3912 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:09.442927 6457 tablet_bootstrap.cc:492] T ffcf1a144f3c42719a5aa5deed537975 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:09.444869 6458 ts_tablet_manager.cc:1950] T 5c0142f4e3ad42048803481d68f0ee5d P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:09.445777 6457 tablet_bootstrap.cc:654] T ffcf1a144f3c42719a5aa5deed537975 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:09.446923 6202 raft_consensus.cc:3060] T 4b15b250f594459eb959b4871f7ae398 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:09.447434 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4284d6a0fa416ca95b4d675c8e3912" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:09.448405 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 406) took 1503 ms. Trace:
I20260923 19:50:09.448884 6459 rpcz_store.cc:276] 0923 19:50:07.924157 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:07.924225 (+ 68us) service_pool.cc:224] Handling call
0923 19:50:09.425244 (+1501019us) ts_tablet_manager.cc:1151] Deleting tablet c19298691d5d4209b2d1147a1aad2f6f
0923 19:50:09.425253 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:09.427527 (+ 2274us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1500753}
I20260923 19:50:09.449954 6950 raft_consensus.cc:2804] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:09.450899 7018 raft_consensus.cc:2804] T ec4284d6a0fa416ca95b4d675c8e3912 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:09.450879 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 405) took 1529 ms. Trace:
W20260923 19:50:09.451249 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet c19298691d5d4209b2d1147a1aad2f6f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c19298691d5d4209b2d1147a1aad2f6f already in progress: creating tablet
I20260923 19:50:09.454892 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 395) took 1166 ms. Trace:
I20260923 19:50:09.455680 6461 ts_tablet_manager.cc:1929] T 015c14b447fe4cd18d197b2d1ed5884e P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:09.455847 6461 log.cc:1199] T 015c14b447fe4cd18d197b2d1ed5884e P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/015c14b447fe4cd18d197b2d1ed5884e
I20260923 19:50:09.456313 6461 ts_tablet_manager.cc:1950] T 015c14b447fe4cd18d197b2d1ed5884e P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
W20260923 19:50:09.461714 6137 consensus_peers.cc:597] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d70b7662d85a4f64a11420448c4d140d. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:09.462445 6454 ts_tablet_manager.cc:1434] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.047s user 0.001s sys 0.001s
I20260923 19:50:09.464111 6461 tablet_replica.cc:333] T 6fe14389e2a3487587dfcf7a8b4b242d P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:09.464700 6461 raft_consensus.cc:2243] T 6fe14389e2a3487587dfcf7a8b4b242d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:09.464960 6461 raft_consensus.cc:2272] T 6fe14389e2a3487587dfcf7a8b4b242d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:09.467378 6457 tablet_bootstrap.cc:492] T ffcf1a144f3c42719a5aa5deed537975 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:09.467578 6457 ts_tablet_manager.cc:1403] T ffcf1a144f3c42719a5aa5deed537975 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.032s user 0.005s sys 0.001s
I20260923 19:50:09.468765 6457 raft_consensus.cc:359] T ffcf1a144f3c42719a5aa5deed537975 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.468997 6457 raft_consensus.cc:385] T ffcf1a144f3c42719a5aa5deed537975 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:09.469084 6457 raft_consensus.cc:740] T ffcf1a144f3c42719a5aa5deed537975 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:09.469636 6457 consensus_queue.cc:260] T ffcf1a144f3c42719a5aa5deed537975 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.471231 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 02fa9052a7054659baf9b07b770bb538 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:09.471413 5790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.143.254:37151, user_credentials={real_user=slave}} blocked reactor thread for 54951.4us
I20260923 19:50:09.473264 5805 master_service.cc:960] ReplaceTablet: received request to replace tablet 908596339b2e4f7f8ddb7f9cd5bdcc3e from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:09.473842 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 6e781ccf4aa343fc924138c3cc2b04e6 (table default.Table_973ceea94f2e4c6da7b1c722b99ac413 [id=c9f541017259420e858a2982f3e32141]) successfully deleted
W20260923 19:50:09.474148 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet b92aaac328934d95a89e0fc08a80b0b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b92aaac328934d95a89e0fc08a80b0b1 already in progress: creating tablet
W20260923 19:50:09.474406 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet e4f00490b0364f0e9f1b9569b870808e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4f00490b0364f0e9f1b9569b870808e already in progress: creating tablet
I20260923 19:50:09.474467 6031 tablet_service.cc:1558] Processing DeleteTablet for tablet c48d4a8371fa4454b7c67291db3ab796 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:09.474597 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 015c14b447fe4cd18d197b2d1ed5884e (table default.Table_e06d0ff4af234fa090feddba5bef4853 [id=5f2c892d7f794a6dbc1499fada9faf02]) successfully deleted
I20260923 19:50:09.474792 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet f108ebdaecab42e7b57057c7ecfbe690 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:09.474813 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 14c917ac93fd436aa13fb0839fae883f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 14c917ac93fd436aa13fb0839fae883f already in progress: creating tablet
W20260923 19:50:09.474990 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 02fa9052a7054659baf9b07b770bb538 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 02fa9052a7054659baf9b07b770bb538 already in progress: creating tablet
I20260923 19:50:09.477586 6457 ts_tablet_manager.cc:1434] T ffcf1a144f3c42719a5aa5deed537975 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20260923 19:50:09.462910 6459 rpcz_store.cc:276] 0923 19:50:07.921426 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.007489 (+ 86063us) service_pool.cc:224] Handling call
0923 19:50:09.450634 (+1443145us) ts_tablet_manager.cc:1151] Deleting tablet efc63a151f6444dfb03c3f15f6f54473
0923 19:50:09.450646 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:09.450762 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1442425}
I20260923 19:50:09.479511 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 16144661b56c4f858c55e8e0d3999019
I20260923 19:50:09.480180 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 412) took 1462 ms. Trace:
I20260923 19:50:09.480288 6459 rpcz_store.cc:276] 0923 19:50:08.018193 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.034802 (+ 16609us) service_pool.cc:224] Handling call
0923 19:50:09.480007 (+1445205us) ts_tablet_manager.cc:1151] Deleting tablet 035abecfbee7474d9dd048f35e28e867
0923 19:50:09.480021 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:09.480145 (+ 124us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1444383}
I20260923 19:50:09.480906 6459 tablet_replica.cc:333] T 5455beff354a4616a68d8746e3e4f9a8 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:09.481379 6457 tablet_bootstrap.cc:492] T 31b0bdf719554d37993a802831e324ee P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:09.484563 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet 16144661b56c4f858c55e8e0d3999019 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:09.486999 6459 raft_consensus.cc:2243] T 5455beff354a4616a68d8746e3e4f9a8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:09.482934 6454 tablet_bootstrap.cc:492] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:09.487524 6461 ts_tablet_manager.cc:1916] T 6fe14389e2a3487587dfcf7a8b4b242d P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:09.488754 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_7b0ae7c8259245379ef654b3a96718e0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:09.489137 6454 tablet_bootstrap.cc:654] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:09.489431 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b0ae7c8259245379ef654b3a96718e0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:09.492377 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_349043a7dfa34b3fa1ca4a2eb51ac77c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:09.493110 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_349043a7dfa34b3fa1ca4a2eb51ac77c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:09.493564 6457 tablet_bootstrap.cc:654] T 31b0bdf719554d37993a802831e324ee P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:09.497750 6459 raft_consensus.cc:2272] T 5455beff354a4616a68d8746e3e4f9a8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:09.498399 6459 ts_tablet_manager.cc:1916] T 5455beff354a4616a68d8746e3e4f9a8 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:09.499171 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet efc63a151f6444dfb03c3f15f6f54473 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet efc63a151f6444dfb03c3f15f6f54473 already in progress: creating tablet
W20260923 19:50:09.501565 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 035abecfbee7474d9dd048f35e28e867 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 035abecfbee7474d9dd048f35e28e867 already in progress: creating tablet
I20260923 19:50:09.504930 6461 ts_tablet_manager.cc:1929] T 6fe14389e2a3487587dfcf7a8b4b242d P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:09.505206 6461 log.cc:1199] T 6fe14389e2a3487587dfcf7a8b4b242d P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/6fe14389e2a3487587dfcf7a8b4b242d
I20260923 19:50:09.505637 6461 ts_tablet_manager.cc:1950] T 6fe14389e2a3487587dfcf7a8b4b242d P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:09.506217 6950 raft_consensus.cc:697] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:09.506563 6950 consensus_queue.cc:237] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.507522 6456 tablet_bootstrap.cc:492] T 86473c5cbca54b5792b038aef445998c P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:09.508046 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_52b79fc3cba74d7cbf3e52760f964edd" } new_table_name: "default.Table_2a3f607a23af430ba52036fcf8b35948" modify_external_catalogs: true
I20260923 19:50:09.509200 6457 tablet_bootstrap.cc:492] T 31b0bdf719554d37993a802831e324ee P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:09.509378 6457 ts_tablet_manager.cc:1403] T 31b0bdf719554d37993a802831e324ee P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.028s user 0.006s sys 0.000s
I20260923 19:50:09.510210 6457 raft_consensus.cc:359] T 31b0bdf719554d37993a802831e324ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.510428 6457 raft_consensus.cc:385] T 31b0bdf719554d37993a802831e324ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:09.510512 6457 raft_consensus.cc:740] T 31b0bdf719554d37993a802831e324ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
W20260923 19:50:09.510485 6280 leader_election.cc:343] T ec4284d6a0fa416ca95b4d675c8e3912 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:09.510799 6457 consensus_queue.cc:260] T 31b0bdf719554d37993a802831e324ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.512944 5799 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 684eb2576b4b4730813b993e36b242df
I20260923 19:50:09.514251 6457 ts_tablet_manager.cc:1434] T 31b0bdf719554d37993a802831e324ee P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260923 19:50:09.515625 6457 tablet_bootstrap.cc:492] T b529b0e82c5b48edac54cc281ac4b4a6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:09.516916 6456 ts_tablet_manager.cc:1403] T 86473c5cbca54b5792b038aef445998c P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.442s user 0.065s sys 0.098s
I20260923 19:50:09.517781 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet 684eb2576b4b4730813b993e36b242df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:09.519366 6457 tablet_bootstrap.cc:654] T b529b0e82c5b48edac54cc281ac4b4a6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:09.520218 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 6fe14389e2a3487587dfcf7a8b4b242d (table default.Table_654e78935bde491c95268be69d832a46 [id=db37d58a601f44c4a08efd4fcc3f115b]) successfully deleted
I20260923 19:50:09.521389 6461 tablet_replica.cc:333] T c48d4a8371fa4454b7c67291db3ab796 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:09.521649 6461 raft_consensus.cc:2243] T c48d4a8371fa4454b7c67291db3ab796 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:09.521953 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet 14c917ac93fd436aa13fb0839fae883f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:09.522113 6280 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 62506.1us
I20260923 19:50:09.522188 6458 rpcz_store.cc:276] 0923 19:50:08.279292 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.279598 (+ 306us) service_pool.cc:224] Handling call
0923 19:50:09.223256 (+943658us) ts_tablet_manager.cc:1151] Deleting tablet 5c0142f4e3ad42048803481d68f0ee5d
0923 19:50:09.223272 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:09.254787 (+ 31515us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:09.260860 (+ 6073us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:09.445784 (+184924us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":889663}
I20260923 19:50:09.522657 6458 tablet_replica.cc:333] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:09.523571 6461 raft_consensus.cc:2272] T c48d4a8371fa4454b7c67291db3ab796 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:09.524605 6461 ts_tablet_manager.cc:1916] T c48d4a8371fa4454b7c67291db3ab796 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:09.528025 5799 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_fcbdddfc239041ae96611a78df2b3303" } modify_external_catalogs: true
I20260923 19:50:09.528240 5799 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_fcbdddfc239041ae96611a78df2b3303" } modify_external_catalogs: true
I20260923 19:50:09.532226 6461 ts_tablet_manager.cc:1929] T c48d4a8371fa4454b7c67291db3ab796 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:09.535187 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 85f5ba9097674f9d889e178eaea4f0d7
I20260923 19:50:09.537742 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet 85f5ba9097674f9d889e178eaea4f0d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:09.538833 6461 log.cc:1199] T c48d4a8371fa4454b7c67291db3ab796 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/c48d4a8371fa4454b7c67291db3ab796
I20260923 19:50:09.539425 6461 ts_tablet_manager.cc:1950] T c48d4a8371fa4454b7c67291db3ab796 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:09.540043 6458 raft_consensus.cc:2243] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:09.541956 6461 tablet_replica.cc:333] T f108ebdaecab42e7b57057c7ecfbe690 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:09.542457 6461 raft_consensus.cc:2243] T f108ebdaecab42e7b57057c7ecfbe690 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:09.543104 6461 raft_consensus.cc:2272] T f108ebdaecab42e7b57057c7ecfbe690 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:09.543272 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet c48d4a8371fa4454b7c67291db3ab796 (table default.Table_42fbb36fdc75430881f49e0b2bb82fc3 [id=8a2bd1f24f824735a82439a9b4ce1f0a]) successfully deleted
I20260923 19:50:09.543972 6928 raft_consensus.cc:493] T 31b0bdf719554d37993a802831e324ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:09.544119 6928 raft_consensus.cc:515] T 31b0bdf719554d37993a802831e324ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.544770 6928 leader_election.cc:290] T 31b0bdf719554d37993a802831e324ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:09.545599 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b0bdf719554d37993a802831e324ee" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:09.546453 5802 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a0743d5ac2264af6b045af0474cbf58c consensus state has no leader
I20260923 19:50:09.546948 5802 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d22fe13ff3c946e8acdb140f7d73f71e" } new_table_name: "default.Table_2dcd13e928c349ff8820580efef4aad7" modify_external_catalogs: true
W20260923 19:50:09.547015 5996 leader_election.cc:343] T 31b0bdf719554d37993a802831e324ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:09.547178 6461 ts_tablet_manager.cc:1916] T f108ebdaecab42e7b57057c7ecfbe690 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:09.551069 5800 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_dc4eebd8c2d34e1b988008ab9b783cff" } modify_external_catalogs: true
I20260923 19:50:09.551272 5800 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_dc4eebd8c2d34e1b988008ab9b783cff" } modify_external_catalogs: true
I20260923 19:50:09.552574 6458 pending_rounds.cc:70] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd: Trying to abort 1 pending ops.
I20260923 19:50:09.553121 5797 master_service.cc:960] ReplaceTablet: received request to replace tablet 42e9cbcf77324d91abd029c12eaf950d from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:09.553989 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_f276fef2266243f0add02a76de24e3c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:09.554687 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f276fef2266243f0add02a76de24e3c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:09.555666 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet 31b0bdf719554d37993a802831e324ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:09.556232 6458 pending_rounds.cc:77] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630559925907456 op_type: NO_OP noop_request { }
I20260923 19:50:09.556399 6458 raft_consensus.cc:2889] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:09.556541 6458 raft_consensus.cc:2272] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:09.557173 6458 ts_tablet_manager.cc:1916] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:09.559659 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet 16144661b56c4f858c55e8e0d3999019 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:09.560882 6461 ts_tablet_manager.cc:1929] T f108ebdaecab42e7b57057c7ecfbe690 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:09.560952 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 5c0142f4e3ad42048803481d68f0ee5d (table default.Table_f57f5ddf52f541ab91b4a9638fcf81a0 [id=e0da333ed7f44d6aa283da81b1cfbf17]) successfully deleted
I20260923 19:50:09.561771 6928 consensus_queue.cc:1048] T 5427b0f0218d4131b68a39e8e3bf02e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:09.510056 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet 64a38bbd3fbd4738a73e78e3f6436fe5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:00 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:09.521561 6178 tablet_service.cc:1558] Processing DeleteTablet for tablet 16144661b56c4f858c55e8e0d3999019 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:09.522414 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet 684eb2576b4b4730813b993e36b242df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:09.565181 6461 log.cc:1199] T f108ebdaecab42e7b57057c7ecfbe690 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/f108ebdaecab42e7b57057c7ecfbe690
I20260923 19:50:09.543813 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet 85f5ba9097674f9d889e178eaea4f0d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:09.545838 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b0bdf719554d37993a802831e324ee" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:09.560514 6139 leader_election.cc:343] T b7f372b952804ac58e602998d9b77d72 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: b7f372b952804ac58e602998d9b77d72
I20260923 19:50:09.565620 6139 leader_election.cc:304] T b7f372b952804ac58e602998d9b77d72 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:09.565806 6461 ts_tablet_manager.cc:1950] T f108ebdaecab42e7b57057c7ecfbe690 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
W20260923 19:50:09.566182 6139 consensus_peers.cc:597] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Couldn't send request to peer 2bf41435f70447f19992d368ca6b46bd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d70b7662d85a4f64a11420448c4d140d. This is attempt 1: this message will repeat every 5th retry.
W20260923 19:50:09.566711 5995 leader_election.cc:343] T 31b0bdf719554d37993a802831e324ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:09.566849 5995 leader_election.cc:304] T 31b0bdf719554d37993a802831e324ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:09.567978 6928 raft_consensus.cc:2749] T 31b0bdf719554d37993a802831e324ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:09.568279 6920 raft_consensus.cc:2749] T b7f372b952804ac58e602998d9b77d72 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:09.568852 5995 consensus_peers.cc:597] T 5427b0f0218d4131b68a39e8e3bf02e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:09.569453 6461 tablet_replica.cc:333] T 31b0bdf719554d37993a802831e324ee P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:09.569823 6461 raft_consensus.cc:2243] T 31b0bdf719554d37993a802831e324ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:09.570318 6461 raft_consensus.cc:2272] T 31b0bdf719554d37993a802831e324ee P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:09.570676 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet 684eb2576b4b4730813b993e36b242df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:09.573002 6461 ts_tablet_manager.cc:1916] T 31b0bdf719554d37993a802831e324ee P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:09.574337 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet 85f5ba9097674f9d889e178eaea4f0d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:09.576967 5805 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 18a31ed6bea444e7888f374927f90a60 consensus state has no leader
I20260923 19:50:09.580734 6057 raft_consensus.cc:1275] T ec4cc8a742114e5fb07c5c9157ce09e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Refusing update from remote peer 2bf41435f70447f19992d368ca6b46bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:50:09.588040 6461 ts_tablet_manager.cc:1929] T 31b0bdf719554d37993a802831e324ee P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:09.591943 6461 log.cc:1199] T 31b0bdf719554d37993a802831e324ee P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/31b0bdf719554d37993a802831e324ee
I20260923 19:50:09.592613 6461 ts_tablet_manager.cc:1950] T 31b0bdf719554d37993a802831e324ee P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
W20260923 19:50:09.592866 6280 consensus_peers.cc:597] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:09.594220 6456 raft_consensus.cc:359] T 86473c5cbca54b5792b038aef445998c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.599377 5799 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet f1a4bccf6dd2411f83b86d782ecf5f40
I20260923 19:50:09.601256 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet f1a4bccf6dd2411f83b86d782ecf5f40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:09.602926 7018 raft_consensus.cc:697] T ec4284d6a0fa416ca95b4d675c8e3912 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:09.607190 6456 raft_consensus.cc:385] T 86473c5cbca54b5792b038aef445998c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:09.607523 6456 raft_consensus.cc:740] T 86473c5cbca54b5792b038aef445998c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:09.608078 6867 consensus_queue.cc:1048] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260923 19:50:09.609287 6456 consensus_queue.cc:260] T 86473c5cbca54b5792b038aef445998c P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.613230 6459 ts_tablet_manager.cc:1929] T 5455beff354a4616a68d8746e3e4f9a8 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:09.613301 6457 tablet_bootstrap.cc:492] T b529b0e82c5b48edac54cc281ac4b4a6 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:09.613464 6457 ts_tablet_manager.cc:1403] T b529b0e82c5b48edac54cc281ac4b4a6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.098s user 0.015s sys 0.019s
I20260923 19:50:09.614318 6457 raft_consensus.cc:359] T b529b0e82c5b48edac54cc281ac4b4a6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.614538 6457 raft_consensus.cc:385] T b529b0e82c5b48edac54cc281ac4b4a6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:09.614646 6457 raft_consensus.cc:740] T b529b0e82c5b48edac54cc281ac4b4a6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:09.617522 6456 ts_tablet_manager.cc:1434] T 86473c5cbca54b5792b038aef445998c P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.099s user 0.003s sys 0.000s
I20260923 19:50:09.618441 6457 consensus_queue.cc:260] T b529b0e82c5b48edac54cc281ac4b4a6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.620603 6456 tablet_bootstrap.cc:492] T f4e3e64fdf584743a3a88df5d6600b22 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:09.620627 6457 ts_tablet_manager.cc:1434] T b529b0e82c5b48edac54cc281ac4b4a6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260923 19:50:09.623533 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet f108ebdaecab42e7b57057c7ecfbe690 (table default.Table_f6c15bbc16984baa89deab54175d787a [id=ec60adadc27d45b19a9eec1b8709eecb]) successfully deleted
W20260923 19:50:09.623961 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 16144661b56c4f858c55e8e0d3999019 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16144661b56c4f858c55e8e0d3999019 already in progress: creating tablet
W20260923 19:50:09.624266 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 684eb2576b4b4730813b993e36b242df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 684eb2576b4b4730813b993e36b242df already in progress: creating tablet
I20260923 19:50:09.624333 6457 tablet_bootstrap.cc:492] T 3919b15a00eb4fb08008f065f556c760 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
W20260923 19:50:09.624562 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 85f5ba9097674f9d889e178eaea4f0d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 85f5ba9097674f9d889e178eaea4f0d7 already in progress: creating tablet
I20260923 19:50:09.625121 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 31b0bdf719554d37993a802831e324ee (table default.Table_b28fac33a5bd4feea5ac2c04b2bcecc4 [id=bf8666274f50416b80fcd282e4d1e2a3]) successfully deleted
I20260923 19:50:09.621431 7018 consensus_queue.cc:237] T ec4284d6a0fa416ca95b4d675c8e3912 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.626394 6457 tablet_bootstrap.cc:654] T 3919b15a00eb4fb08008f065f556c760 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:09.629403 6137 consensus_peers.cc:597] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9101e82501fd461f8a4b2dcd9dffbd74. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:09.633659 6459 log.cc:1199] T 5455beff354a4616a68d8746e3e4f9a8 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/5455beff354a4616a68d8746e3e4f9a8
I20260923 19:50:09.634533 6457 tablet_bootstrap.cc:492] T 3919b15a00eb4fb08008f065f556c760 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:09.634748 6457 ts_tablet_manager.cc:1403] T 3919b15a00eb4fb08008f065f556c760 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s
I20260923 19:50:09.635478 6459 ts_tablet_manager.cc:1950] T 5455beff354a4616a68d8746e3e4f9a8 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:09.637003 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 415) took 1526 ms. Trace:
I20260923 19:50:09.636936 6457 raft_consensus.cc:359] T 3919b15a00eb4fb08008f065f556c760 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.637148 6457 raft_consensus.cc:385] T 3919b15a00eb4fb08008f065f556c760 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:09.637214 6457 raft_consensus.cc:740] T 3919b15a00eb4fb08008f065f556c760 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:09.638495 6457 consensus_queue.cc:260] T 3919b15a00eb4fb08008f065f556c760 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.639065 6459 rpcz_store.cc:276] 0923 19:50:08.110778 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.111561 (+ 783us) service_pool.cc:224] Handling call
0923 19:50:09.480827 (+1369266us) ts_tablet_manager.cc:1151] Deleting tablet 5455beff354a4616a68d8746e3e4f9a8
0923 19:50:09.480840 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:09.593262 (+112422us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:09.613143 (+ 19881us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:09.636947 (+ 23804us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10456,"tablet-delete.queue_time_us":1368823}
I20260923 19:50:09.641928 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 416) took 1530 ms. Trace:
I20260923 19:50:09.642805 6459 rpcz_store.cc:276] 0923 19:50:08.110886 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.112061 (+ 1175us) service_pool.cc:224] Handling call
0923 19:50:09.641711 (+1529650us) ts_tablet_manager.cc:1151] Deleting tablet 033c2d772c8a44d2a0e671664bb9085d
0923 19:50:09.641727 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:09.641832 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1521231}
I20260923 19:50:09.645694 6457 ts_tablet_manager.cc:1434] T 3919b15a00eb4fb08008f065f556c760 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.011s user 0.004s sys 0.001s
I20260923 19:50:09.647771 6457 tablet_bootstrap.cc:492] T fe5d081a41a3417b855656ca6e24f235 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:09.649348 6459 tablet_replica.cc:333] T 7504a2be25b54ed4bc539eb10199fe15 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:09.649631 6459 raft_consensus.cc:2243] T 7504a2be25b54ed4bc539eb10199fe15 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:09.650034 6459 raft_consensus.cc:2272] T 7504a2be25b54ed4bc539eb10199fe15 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:09.650393 6454 tablet_bootstrap.cc:492] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:09.650564 6454 ts_tablet_manager.cc:1403] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.168s user 0.004s sys 0.000s
I20260923 19:50:09.650838 6459 ts_tablet_manager.cc:1916] T 7504a2be25b54ed4bc539eb10199fe15 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:09.641400 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 5455beff354a4616a68d8746e3e4f9a8 (table default.Table_a949ff6346b345ffa7ce8d5d9a390997 [id=b1c31f5e95b54ad6860aaeb11048d36b]) successfully deleted
I20260923 19:50:09.651788 6454 raft_consensus.cc:359] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.651988 6454 raft_consensus.cc:385] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:09.652114 6454 raft_consensus.cc:740] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
W20260923 19:50:09.652175 5791 catalog_manager.cc:5030] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 033c2d772c8a44d2a0e671664bb9085d because the tablet was not found. No further retry: Not found: Tablet not found: 033c2d772c8a44d2a0e671664bb9085d
I20260923 19:50:09.653023 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet f1a4bccf6dd2411f83b86d782ecf5f40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:09.654814 6457 tablet_bootstrap.cc:654] T fe5d081a41a3417b855656ca6e24f235 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:09.654897 5799 master_service.cc:960] ReplaceTablet: received request to replace tablet 1c26a2863fdd4912b6d357877af1eb42 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:09.654836 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_496c5379825d4fe8bb113e6a77b05390" } new_table_name: "default.Table_ce3b70141f6a4c24aa6d4f53fe8c97f8" modify_external_catalogs: true
W20260923 19:50:09.655236 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet f1a4bccf6dd2411f83b86d782ecf5f40 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1a4bccf6dd2411f83b86d782ecf5f40 already in progress: creating tablet
I20260923 19:50:09.656361 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_1690d3f3d0e848f3bfd0fd61fa3670c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:09.656939 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1690d3f3d0e848f3bfd0fd61fa3670c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:09.663816 5803 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7af330ae1aaa48209f2bd1880bcfebb1 consensus state has no leader
I20260923 19:50:09.666842 6950 raft_consensus.cc:493] T 86473c5cbca54b5792b038aef445998c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:09.667104 6950 raft_consensus.cc:515] T 86473c5cbca54b5792b038aef445998c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.668416 6950 leader_election.cc:290] T 86473c5cbca54b5792b038aef445998c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:09.669378 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86473c5cbca54b5792b038aef445998c" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:09.670282 6308 tablet_service.cc:1558] Processing DeleteTablet for tablet f1a4bccf6dd2411f83b86d782ecf5f40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:09.671787 6920 consensus_queue.cc:1048] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:09.681171 6457 tablet_bootstrap.cc:492] T fe5d081a41a3417b855656ca6e24f235 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
W20260923 19:50:09.681118 6279 leader_election.cc:343] T 86473c5cbca54b5792b038aef445998c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 86473c5cbca54b5792b038aef445998c
I20260923 19:50:09.681346 6457 ts_tablet_manager.cc:1403] T fe5d081a41a3417b855656ca6e24f235 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.008s
I20260923 19:50:09.681330 6454 consensus_queue.cc:260] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.682047 6454 ts_tablet_manager.cc:1434] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.031s user 0.002s sys 0.001s
I20260923 19:50:09.682219 6457 raft_consensus.cc:359] T fe5d081a41a3417b855656ca6e24f235 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.682410 6457 raft_consensus.cc:385] T fe5d081a41a3417b855656ca6e24f235 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:09.682515 6457 raft_consensus.cc:740] T fe5d081a41a3417b855656ca6e24f235 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:09.683152 6457 consensus_queue.cc:260] T fe5d081a41a3417b855656ca6e24f235 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.684067 6454 tablet_bootstrap.cc:492] T 789c54477bec4636bb3669e1f62730e2 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:09.684950 6457 ts_tablet_manager.cc:1434] T fe5d081a41a3417b855656ca6e24f235 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260923 19:50:09.686127 6457 tablet_bootstrap.cc:492] T b985acc650334497832cf4505e1b0043 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:09.687815 6457 tablet_bootstrap.cc:654] T b985acc650334497832cf4505e1b0043 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:09.687884 6280 leader_election.cc:343] T 86473c5cbca54b5792b038aef445998c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:09.689122 6280 leader_election.cc:304] T 86473c5cbca54b5792b038aef445998c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:09.689365 6454 tablet_bootstrap.cc:654] T 789c54477bec4636bb3669e1f62730e2 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:09.695945 6459 ts_tablet_manager.cc:1929] T 7504a2be25b54ed4bc539eb10199fe15 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:09.696178 6459 log.cc:1199] T 7504a2be25b54ed4bc539eb10199fe15 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/7504a2be25b54ed4bc539eb10199fe15
I20260923 19:50:09.696408 6457 tablet_bootstrap.cc:492] T b985acc650334497832cf4505e1b0043 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:09.696583 6457 ts_tablet_manager.cc:1403] T b985acc650334497832cf4505e1b0043 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.008s
I20260923 19:50:09.697454 6457 raft_consensus.cc:359] T b985acc650334497832cf4505e1b0043 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.697659 6457 raft_consensus.cc:385] T b985acc650334497832cf4505e1b0043 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:09.697795 6457 raft_consensus.cc:740] T b985acc650334497832cf4505e1b0043 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:09.698283 6459 ts_tablet_manager.cc:1950] T 7504a2be25b54ed4bc539eb10199fe15 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:09.698216 6457 consensus_queue.cc:260] T b985acc650334497832cf4505e1b0043 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.698941 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 418) took 1587 ms. Trace:
I20260923 19:50:09.699095 6459 rpcz_store.cc:276] 0923 19:50:08.111465 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.112204 (+ 739us) service_pool.cc:224] Handling call
0923 19:50:09.649257 (+1537053us) ts_tablet_manager.cc:1151] Deleting tablet 7504a2be25b54ed4bc539eb10199fe15
0923 19:50:09.649268 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:09.664387 (+ 15119us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:09.695849 (+ 31462us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:09.698909 (+ 3060us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1528540}
I20260923 19:50:09.699856 6457 ts_tablet_manager.cc:1434] T b985acc650334497832cf4505e1b0043 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:50:09.700639 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 417) took 1589 ms. Trace:
I20260923 19:50:09.701056 6457 tablet_bootstrap.cc:492] T 194494af2c424a55a772f3858af63c2c P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:09.701185 6459 rpcz_store.cc:276] 0923 19:50:08.111221 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.112176 (+ 955us) service_pool.cc:224] Handling call
0923 19:50:09.700356 (+1588180us) ts_tablet_manager.cc:1151] Deleting tablet a224ae69503e4ab588d6269086317f09
0923 19:50:09.700367 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:09.700508 (+ 141us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1578255}
I20260923 19:50:09.702682 6459 tablet_replica.cc:333] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:09.703189 6457 tablet_bootstrap.cc:654] T 194494af2c424a55a772f3858af63c2c P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:09.703739 6459 raft_consensus.cc:2243] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:09.704672 6456 tablet_bootstrap.cc:654] T f4e3e64fdf584743a3a88df5d6600b22 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:09.705312 6459 pending_rounds.cc:70] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:09.705960 6867 raft_consensus.cc:2749] T 86473c5cbca54b5792b038aef445998c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:09.705807 6459 pending_rounds.cc:77] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630562594447360 op_type: NO_OP noop_request { }
I20260923 19:50:09.707103 6459 raft_consensus.cc:2889] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:09.708981 6459 raft_consensus.cc:2272] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:09.712102 6457 tablet_bootstrap.cc:492] T 194494af2c424a55a772f3858af63c2c P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:09.712289 6457 ts_tablet_manager.cc:1403] T 194494af2c424a55a772f3858af63c2c P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.004s
I20260923 19:50:09.713102 6457 raft_consensus.cc:359] T 194494af2c424a55a772f3858af63c2c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.713305 6457 raft_consensus.cc:385] T 194494af2c424a55a772f3858af63c2c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:09.713399 6457 raft_consensus.cc:740] T 194494af2c424a55a772f3858af63c2c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:09.713423 6459 ts_tablet_manager.cc:1916] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:09.713691 6457 consensus_queue.cc:260] T 194494af2c424a55a772f3858af63c2c P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.715392 6457 ts_tablet_manager.cc:1434] T 194494af2c424a55a772f3858af63c2c P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260923 19:50:09.716555 6457 tablet_bootstrap.cc:492] T e071b9dd1db44af0a9d1b9e904f875a5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:09.718684 6457 tablet_bootstrap.cc:654] T e071b9dd1db44af0a9d1b9e904f875a5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:09.700084 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 7504a2be25b54ed4bc539eb10199fe15 (table default.Table_0d5d4338177845959f91952ec7ff7855 [id=9e398f48d86e4c5898cac7336d3c24bf]) successfully deleted
W20260923 19:50:09.723076 5791 catalog_manager.cc:5030] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet a224ae69503e4ab588d6269086317f09 because the tablet was not found. No further retry: Not found: Tablet not found: a224ae69503e4ab588d6269086317f09
I20260923 19:50:09.724745 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet 063fc0e77d294ddf8a02e9ab5968a5e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:09.727833 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_b065e06a599f4668a7ac9c2e0bd7d989"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:09.728482 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b065e06a599f4668a7ac9c2e0bd7d989 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:09.731396 5805 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d178d42e78ae42b88975c9bc050e0041" } modify_external_catalogs: true
I20260923 19:50:09.731570 5805 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d178d42e78ae42b88975c9bc050e0041" } modify_external_catalogs: true
I20260923 19:50:09.732270 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_51c1dbd7bcc14d55a1c28d38938f0baf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:09.732932 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51c1dbd7bcc14d55a1c28d38938f0baf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:09.735579 5801 master_service.cc:960] ReplaceTablet: received request to replace tablet 0c537304c32c44adaa1e05de4496293f from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:09.735579 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_562543b3ee364c59a1a2a7fd61331c74" } modify_external_catalogs: true
I20260923 19:50:09.735767 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_562543b3ee364c59a1a2a7fd61331c74" } modify_external_catalogs: true
I20260923 19:50:09.738117 5802 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_18c4ff5b068d4ee9a3591ef2714d5325" } new_table_name: "default.Table_1fc9244b78694fdc9006399969d4f536" modify_external_catalogs: true
I20260923 19:50:09.743247 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_4f9039a655f34e0b8d5c62f98a058b9d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:09.744086 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f9039a655f34e0b8d5c62f98a058b9d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:09.750576 6454 tablet_bootstrap.cc:492] T 789c54477bec4636bb3669e1f62730e2 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:09.750824 6454 ts_tablet_manager.cc:1403] T 789c54477bec4636bb3669e1f62730e2 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.067s user 0.004s sys 0.000s
I20260923 19:50:09.750965 5798 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a0bee41bcb2d439fb8619a6c19152813" } modify_external_catalogs: true
I20260923 19:50:09.751226 5798 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a0bee41bcb2d439fb8619a6c19152813" } modify_external_catalogs: true
I20260923 19:50:09.751919 6454 raft_consensus.cc:359] T 789c54477bec4636bb3669e1f62730e2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.752199 6454 raft_consensus.cc:385] T 789c54477bec4636bb3669e1f62730e2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:09.752343 6454 raft_consensus.cc:740] T 789c54477bec4636bb3669e1f62730e2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:09.752681 6454 consensus_queue.cc:260] T 789c54477bec4636bb3669e1f62730e2 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.754297 6454 ts_tablet_manager.cc:1434] T 789c54477bec4636bb3669e1f62730e2 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:50:09.755270 6454 tablet_bootstrap.cc:492] T b4fc995819cc40bf9956d85966bcd330 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
W20260923 19:50:09.753031 5802 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1ea8f44ac03b4ad196725f871a615cdd consensus state has no leader
I20260923 19:50:09.755890 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_fd787c6c31954875a5243becab2de8ea" } new_table_name: "default.Table_8a3be67d9a6c40bd90d313bff635b25a" modify_external_catalogs: true
I20260923 19:50:09.757587 6454 tablet_bootstrap.cc:654] T b4fc995819cc40bf9956d85966bcd330 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:09.757956 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_1a1e2c3e55034c179378dbfcbfd6b62f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:09.758618 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a1e2c3e55034c179378dbfcbfd6b62f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:09.767987 6454 tablet_bootstrap.cc:492] T b4fc995819cc40bf9956d85966bcd330 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:09.768477 6454 ts_tablet_manager.cc:1403] T b4fc995819cc40bf9956d85966bcd330 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.001s
I20260923 19:50:09.768553 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet 789c54477bec4636bb3669e1f62730e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:09.770329 6454 raft_consensus.cc:359] T b4fc995819cc40bf9956d85966bcd330 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.770977 6454 raft_consensus.cc:385] T b4fc995819cc40bf9956d85966bcd330 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:09.771255 6454 raft_consensus.cc:740] T b4fc995819cc40bf9956d85966bcd330 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:09.771776 6454 consensus_queue.cc:260] T b4fc995819cc40bf9956d85966bcd330 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.774026 6454 ts_tablet_manager.cc:1434] T b4fc995819cc40bf9956d85966bcd330 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
W20260923 19:50:09.774711 6279 consensus_peers.cc:597] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d91a56bace854494b7affd6c766b2847. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:09.775456 6454 tablet_bootstrap.cc:492] T 26031fe469d046518cdd0f1e955e19d1 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:09.777431 6454 tablet_bootstrap.cc:654] T 26031fe469d046518cdd0f1e955e19d1 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:09.778993 5797 catalog_manager.cc:5838] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:09.779556 5797 catalog_manager.cc:5838] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:09.784314 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet b4fc995819cc40bf9956d85966bcd330 with delete_type TABLET_DATA_DELETED (replaced by tablet efc63a151f6444dfb03c3f15f6f54473) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:09.788386 5803 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4e69656e9fc941e19eb7de5c87bc9050 consensus state has no leader
I20260923 19:50:09.789124 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_ab5bcf93ffdc4e0f99d62c9d56cb1447"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:09.790186 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab5bcf93ffdc4e0f99d62c9d56cb1447 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:09.791859 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_d8c7bae4e0c0497e99b6d8e96a5d4025"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:09.792572 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d8c7bae4e0c0497e99b6d8e96a5d4025 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:09.797492 5800 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 4c6f9953649a43aa9a0edd78b7bd47a4
I20260923 19:50:09.797894 5799 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 1c26a2863fdd4912b6d357877af1eb42
I20260923 19:50:09.798439 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_9c8dcd2021614daf8eb92e1310ca9675"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:09.799134 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9c8dcd2021614daf8eb92e1310ca9675 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:09.798440 5799 catalog_manager.cc:6934] ReplaceTablet: tablet 1c26a2863fdd4912b6d357877af1eb42 deleted and replaced by tablet 7f9ec2a95bad40f7b229482b275110a3
I20260923 19:50:09.803854 6457 tablet_bootstrap.cc:492] T e071b9dd1db44af0a9d1b9e904f875a5 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:09.804128 6457 ts_tablet_manager.cc:1403] T e071b9dd1db44af0a9d1b9e904f875a5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.088s user 0.010s sys 0.041s
I20260923 19:50:09.804620 6164 tablet_service.cc:1511] Processing CreateTablet for tablet c1347ea7774c40548975d10f6b3cba2a (DEFAULT_TABLE table=default.Table_96ab135786f74ab697bb37601c264ece [id=dc6240941b87434aa6037a3f08689920]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.805083 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet 1c26a2863fdd4912b6d357877af1eb42 with delete_type TABLET_DATA_DELETED (replaced by tablet 7f9ec2a95bad40f7b229482b275110a3) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:09.805068 6457 raft_consensus.cc:359] T e071b9dd1db44af0a9d1b9e904f875a5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.805163 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_873dad3f96014c24889e9b3f1ef09d79"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:09.805270 6457 raft_consensus.cc:385] T e071b9dd1db44af0a9d1b9e904f875a5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:09.805276 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c6f9953649a43aa9a0edd78b7bd47a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:09.805343 6457 raft_consensus.cc:740] T e071b9dd1db44af0a9d1b9e904f875a5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:09.805431 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 0697b038e1a040ec8dd525c6b43cbfb8 (DEFAULT_TABLE table=default.Table_f51e1260e7444679912cdeb128be6704 [id=9b6e7487f2ff439c9071f20f9ce694a5]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:09.805675 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_873dad3f96014c24889e9b3f1ef09d79 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:09.805630 6457 consensus_queue.cc:260] T e071b9dd1db44af0a9d1b9e904f875a5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.806074 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1347ea7774c40548975d10f6b3cba2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.807320 6457 ts_tablet_manager.cc:1434] T e071b9dd1db44af0a9d1b9e904f875a5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260923 19:50:09.808471 6457 tablet_bootstrap.cc:492] T 0d70deeda179486291195476e47a9ae6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:09.810001 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0697b038e1a040ec8dd525c6b43cbfb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.810251 6457 tablet_bootstrap.cc:654] T 0d70deeda179486291195476e47a9ae6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:09.811481 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 64e8951eb899461aa9c0b36e3f7555e2
I20260923 19:50:09.812340 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet cb11d6e082784ad98cfb5253dbb88707
I20260923 19:50:09.812521 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet 64e8951eb899461aa9c0b36e3f7555e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:09.813762 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet cb11d6e082784ad98cfb5253dbb88707 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:09.819470 6459 ts_tablet_manager.cc:1929] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:09.819727 6459 log.cc:1199] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/d70b7662d85a4f64a11420448c4d140d
I20260923 19:50:09.826098 6459 ts_tablet_manager.cc:1950] T d70b7662d85a4f64a11420448c4d140d P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:09.826710 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 423) took 1559 ms. Trace:
I20260923 19:50:09.826956 6459 rpcz_store.cc:276] 0923 19:50:08.267321 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.267549 (+ 228us) service_pool.cc:224] Handling call
0923 19:50:09.702433 (+1434884us) ts_tablet_manager.cc:1151] Deleting tablet d70b7662d85a4f64a11420448c4d140d
0923 19:50:09.702542 (+ 109us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:09.773780 (+ 71238us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:09.819354 (+ 45574us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:09.826664 (+ 7310us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1434637}
I20260923 19:50:09.828776 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet d70b7662d85a4f64a11420448c4d140d (table default.Table_faa53cf5cc5541afb7b391368bdc55f7 [id=4a8f28e842e94d628326ca83935f23c6]) successfully deleted
I20260923 19:50:09.829119 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet ebc288d8d453481592df11cd1bfed3ac
I20260923 19:50:09.829276 6459 tablet_replica.cc:333] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:09.830094 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet ebc288d8d453481592df11cd1bfed3ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:09.830436 6459 raft_consensus.cc:2243] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:09.832496 6459 pending_rounds.cc:70] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:09.836125 5800 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet ec4cc8a742114e5fb07c5c9157ce09e8 (table default.Table_2adc87e06d81491498aa018f49fdc08d [id=89181985e6154c7fa946148e48bef2eb]). Expected version 2 got 0
I20260923 19:50:09.836519 6459 pending_rounds.cc:77] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630563038527488 op_type: NO_OP noop_request { }
I20260923 19:50:09.836701 6459 raft_consensus.cc:2889] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:09.838165 6459 raft_consensus.cc:2272] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:09.838284 6454 tablet_bootstrap.cc:492] T 26031fe469d046518cdd0f1e955e19d1 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:09.838419 6454 ts_tablet_manager.cc:1403] T 26031fe469d046518cdd0f1e955e19d1 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.064s user 0.009s sys 0.015s
I20260923 19:50:09.839217 6454 raft_consensus.cc:359] T 26031fe469d046518cdd0f1e955e19d1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.839375 6454 raft_consensus.cc:385] T 26031fe469d046518cdd0f1e955e19d1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:09.839453 6454 raft_consensus.cc:740] T 26031fe469d046518cdd0f1e955e19d1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:09.839648 6454 consensus_queue.cc:260] T 26031fe469d046518cdd0f1e955e19d1 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.840165 6454 ts_tablet_manager.cc:1434] T 26031fe469d046518cdd0f1e955e19d1 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:50:09.841434 6454 tablet_bootstrap.cc:492] T 623fb5b761134951a4b742ab2ba480a4 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:09.842868 6459 ts_tablet_manager.cc:1916] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:09.844064 6454 tablet_bootstrap.cc:654] T 623fb5b761134951a4b742ab2ba480a4 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:09.844318 5800 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet b529b0e82c5b48edac54cc281ac4b4a6 (table default.Table_504bdbe9702948d58b4f958360a2040b [id=ca73f0867b5d49cfb0bb7cd2315c47f2]). Expected version 5 got 0
I20260923 19:50:09.844830 7071 raft_consensus.cc:493] T b529b0e82c5b48edac54cc281ac4b4a6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:09.845000 7071 raft_consensus.cc:515] T b529b0e82c5b48edac54cc281ac4b4a6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.845754 7071 leader_election.cc:290] T b529b0e82c5b48edac54cc281ac4b4a6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:09.849627 6457 tablet_bootstrap.cc:492] T 0d70deeda179486291195476e47a9ae6 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:09.849905 6457 ts_tablet_manager.cc:1403] T 0d70deeda179486291195476e47a9ae6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.015s
I20260923 19:50:09.852996 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c6f9953649a43aa9a0edd78b7bd47a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:09.853281 6031 tablet_service.cc:1558] Processing DeleteTablet for tablet 1c26a2863fdd4912b6d357877af1eb42 with delete_type TABLET_DATA_DELETED (replaced by tablet 7f9ec2a95bad40f7b229482b275110a3) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:09.853734 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 0697b038e1a040ec8dd525c6b43cbfb8 (DEFAULT_TABLE table=default.Table_f51e1260e7444679912cdeb128be6704 [id=9b6e7487f2ff439c9071f20f9ce694a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.854184 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0697b038e1a040ec8dd525c6b43cbfb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.856101 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b529b0e82c5b48edac54cc281ac4b4a6" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:09.856765 5798 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ba859ce2dc954a94ac103be8f6037961" } modify_external_catalogs: true
I20260923 19:50:09.856961 5798 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ba859ce2dc954a94ac103be8f6037961" } modify_external_catalogs: true
I20260923 19:50:09.857996 6030 tablet_service.cc:1558] Processing DeleteTablet for tablet 64e8951eb899461aa9c0b36e3f7555e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:09.856793 5804 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_e544284af20d48f9a6f3ffe1bd235e41" } new_table_name: "default.Table_7974afca44e444c8b6d147fe6539ee20" modify_external_catalogs: true
I20260923 19:50:09.858215 6022 tablet_service.cc:1558] Processing DeleteTablet for tablet cb11d6e082784ad98cfb5253dbb88707 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:09.858805 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet 1c26a2863fdd4912b6d357877af1eb42 with delete_type TABLET_DATA_DELETED (replaced by tablet 7f9ec2a95bad40f7b229482b275110a3) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:09.854193 6031 tablet_service.cc:1558] Processing DeleteTablet for tablet ebc288d8d453481592df11cd1bfed3ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:09.860016 5995 leader_election.cc:343] T b529b0e82c5b48edac54cc281ac4b4a6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:09.861104 6022 tablet_service.cc:1558] Processing DeleteTablet for tablet b985acc650334497832cf4505e1b0043 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:09.861780 6030 tablet_service.cc:1558] Processing DeleteTablet for tablet e071b9dd1db44af0a9d1b9e904f875a5 with delete_type TABLET_DATA_DELETED (replaced by tablet b18548ba557f448880c5e617fc03cbe0) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:09.862058 6031 tablet_service.cc:1558] Processing DeleteTablet for tablet fe5d081a41a3417b855656ca6e24f235 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:09.862183 6454 tablet_bootstrap.cc:492] T 623fb5b761134951a4b742ab2ba480a4 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:09.862272 6461 tablet_replica.cc:333] T b985acc650334497832cf4505e1b0043 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:09.862440 6454 ts_tablet_manager.cc:1403] T 623fb5b761134951a4b742ab2ba480a4 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.003s
I20260923 19:50:09.862476 6461 raft_consensus.cc:2243] T b985acc650334497832cf4505e1b0043 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:09.862663 6461 raft_consensus.cc:2272] T b985acc650334497832cf4505e1b0043 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:09.863520 6461 ts_tablet_manager.cc:1916] T b985acc650334497832cf4505e1b0043 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:09.863958 6164 tablet_service.cc:1511] Processing CreateTablet for tablet 13b21aadd7464b1aa2afe7a1ebc9e77f (DEFAULT_TABLE table=default.Table_9775cad3e3fc483a925aead3e398478c [id=cb6795bdff32412fbde77d27ba38390f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.864358 6454 raft_consensus.cc:359] T 623fb5b761134951a4b742ab2ba480a4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.864732 6454 raft_consensus.cc:385] T 623fb5b761134951a4b742ab2ba480a4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:09.864831 6454 raft_consensus.cc:740] T 623fb5b761134951a4b742ab2ba480a4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:09.865276 6454 consensus_queue.cc:260] T 623fb5b761134951a4b742ab2ba480a4 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.865777 6174 tablet_service.cc:1511] Processing CreateTablet for tablet a0d817069e664199bff0d7591548e2d7 (DEFAULT_TABLE table=default.Table_572d17eb83634c98b68bbcfedc88603e [id=7e1215217a574debb42c752695194f6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.866770 6183 tablet_service.cc:1511] Processing CreateTablet for tablet b898322439694b808c9bc71817a71752 (DEFAULT_TABLE table=default.Table_b9ef7fd7111541e58e18257db75147a8 [id=3b68dbcccece4b77b03e6d04d5f04f1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.868458 6179 tablet_service.cc:1511] Processing CreateTablet for tablet 0bf1a426b7dc489ea4d73b117a87e49b (DEFAULT_TABLE table=default.Table_8ab9cdc2d4a14b679b8c38c86766c132 [id=46bda7fbcac44d6d9188884e8dfb8a3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.868530 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 7dac9efee371479ab3547e06f0e580ad (DEFAULT_TABLE table=default.Table_333fad3a38bb4b2781e372f8991a0f34 [id=a27e465b43fb4b4f9164761377d239c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.869391 6454 ts_tablet_manager.cc:1434] T 623fb5b761134951a4b742ab2ba480a4 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260923 19:50:09.870187 6454 tablet_bootstrap.cc:492] T ec4cc8a742114e5fb07c5c9157ce09e8 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:09.871682 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet a11ecef9a24f4e4a812ec220b6a92cc4
W20260923 19:50:09.872383 5791 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 98f61ace3a984938ace1fedbaa1dafa3 (table default.Table_3be501518fae4ecdab998e08f25d6660 [id=26caa02bc37e471abdf29bbbb3acba69], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 98f61ace3a984938ace1fedbaa1dafa3 consensus state has no leader
W20260923 19:50:09.872640 5804 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f1f1df47dc32413d9cc9456f4198dca5 consensus state has no leader
I20260923 19:50:09.873147 6168 tablet_service.cc:1558] Processing DeleteTablet for tablet 623fb5b761134951a4b742ab2ba480a4 with delete_type TABLET_DATA_DELETED (replaced by tablet 05a2d1b0979c4788bccc3a71e1cd098e) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:09.873298 6454 tablet_bootstrap.cc:654] T ec4cc8a742114e5fb07c5c9157ce09e8 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:09.873440 6173 tablet_service.cc:1558] Processing DeleteTablet for tablet a11ecef9a24f4e4a812ec220b6a92cc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:09.875167 6461 ts_tablet_manager.cc:1929] T b985acc650334497832cf4505e1b0043 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:09.878161 6461 log.cc:1199] T b985acc650334497832cf4505e1b0043 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/b985acc650334497832cf4505e1b0043
I20260923 19:50:09.878698 6461 ts_tablet_manager.cc:1950] T b985acc650334497832cf4505e1b0043 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:09.876519 6457 raft_consensus.cc:359] T 0d70deeda179486291195476e47a9ae6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.881743 6457 raft_consensus.cc:385] T 0d70deeda179486291195476e47a9ae6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:09.881935 6457 raft_consensus.cc:740] T 0d70deeda179486291195476e47a9ae6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:09.882285 6457 consensus_queue.cc:260] T 0d70deeda179486291195476e47a9ae6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.884153 6202 raft_consensus.cc:3060] T 789c54477bec4636bb3669e1f62730e2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:09.885412 6457 ts_tablet_manager.cc:1434] T 0d70deeda179486291195476e47a9ae6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.035s user 0.000s sys 0.003s
I20260923 19:50:09.887158 6457 tablet_bootstrap.cc:492] T 15c0dc02ba964af38ca9f76161722588 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:09.889534 6454 tablet_bootstrap.cc:492] T ec4cc8a742114e5fb07c5c9157ce09e8 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:09.889990 6454 ts_tablet_manager.cc:1403] T ec4cc8a742114e5fb07c5c9157ce09e8 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.020s user 0.012s sys 0.000s
I20260923 19:50:09.890228 6461 tablet_replica.cc:333] T e071b9dd1db44af0a9d1b9e904f875a5 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:09.890578 6461 raft_consensus.cc:2243] T e071b9dd1db44af0a9d1b9e904f875a5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:09.892138 6461 raft_consensus.cc:2272] T e071b9dd1db44af0a9d1b9e904f875a5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:09.892530 6454 raft_consensus.cc:359] T ec4cc8a742114e5fb07c5c9157ce09e8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.892918 6454 raft_consensus.cc:385] T ec4cc8a742114e5fb07c5c9157ce09e8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:09.893069 6454 raft_consensus.cc:740] T ec4cc8a742114e5fb07c5c9157ce09e8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:09.893479 6454 consensus_queue.cc:260] T ec4cc8a742114e5fb07c5c9157ce09e8 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.894029 6461 ts_tablet_manager.cc:1916] T e071b9dd1db44af0a9d1b9e904f875a5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:09.895244 6308 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c6f9953649a43aa9a0edd78b7bd47a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:09.895551 6458 ts_tablet_manager.cc:1929] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:09.895706 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet cb11d6e082784ad98cfb5253dbb88707 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:09.896327 6454 ts_tablet_manager.cc:1434] T ec4cc8a742114e5fb07c5c9157ce09e8 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260923 19:50:09.896833 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 0697b038e1a040ec8dd525c6b43cbfb8 (DEFAULT_TABLE table=default.Table_f51e1260e7444679912cdeb128be6704 [id=9b6e7487f2ff439c9071f20f9ce694a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.896173 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b529b0e82c5b48edac54cc281ac4b4a6" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:09.897243 6454 tablet_bootstrap.cc:492] T f4e3e64fdf584743a3a88df5d6600b22 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:09.900331 6454 tablet_bootstrap.cc:654] T f4e3e64fdf584743a3a88df5d6600b22 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:09.902024 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet 64e8951eb899461aa9c0b36e3f7555e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:09.903194 5996 leader_election.cc:343] T b529b0e82c5b48edac54cc281ac4b4a6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:09.903389 5996 leader_election.cc:304] T b529b0e82c5b48edac54cc281ac4b4a6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:09.903550 5804 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet ec4cc8a742114e5fb07c5c9157ce09e8 (table default.Table_2adc87e06d81491498aa018f49fdc08d [id=89181985e6154c7fa946148e48bef2eb]). Expected version 2 got 0
I20260923 19:50:09.903910 6458 log.cc:1199] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/623fb5b761134951a4b742ab2ba480a4
I20260923 19:50:09.903904 7071 raft_consensus.cc:2749] T b529b0e82c5b48edac54cc281ac4b4a6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:09.904062 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet ebc288d8d453481592df11cd1bfed3ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:09.904404 6311 tablet_service.cc:1511] Processing CreateTablet for tablet a0d817069e664199bff0d7591548e2d7 (DEFAULT_TABLE table=default.Table_572d17eb83634c98b68bbcfedc88603e [id=7e1215217a574debb42c752695194f6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.904983 6312 tablet_service.cc:1511] Processing CreateTablet for tablet c1347ea7774c40548975d10f6b3cba2a (DEFAULT_TABLE table=default.Table_96ab135786f74ab697bb37601c264ece [id=dc6240941b87434aa6037a3f08689920]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.905802 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0697b038e1a040ec8dd525c6b43cbfb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.906198 6454 tablet_bootstrap.cc:492] T f4e3e64fdf584743a3a88df5d6600b22 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:09.906915 6454 ts_tablet_manager.cc:1403] T f4e3e64fdf584743a3a88df5d6600b22 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.003s
I20260923 19:50:09.896077 6457 tablet_bootstrap.cc:654] T 15c0dc02ba964af38ca9f76161722588 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:09.908546 6137 consensus_peers.cc:597] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4750e2a1b24e4bc7aafa4cd36afebbbd. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:09.908918 6323 tablet_service.cc:1511] Processing CreateTablet for tablet 13b21aadd7464b1aa2afe7a1ebc9e77f (DEFAULT_TABLE table=default.Table_9775cad3e3fc483a925aead3e398478c [id=cb6795bdff32412fbde77d27ba38390f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.909745 6458 ts_tablet_manager.cc:1950] T 623fb5b761134951a4b742ab2ba480a4 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:09.910856 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 396) took 1631 ms. Trace:
I20260923 19:50:09.911408 6454 raft_consensus.cc:359] T f4e3e64fdf584743a3a88df5d6600b22 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.911913 6454 raft_consensus.cc:385] T f4e3e64fdf584743a3a88df5d6600b22 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:09.912145 6454 raft_consensus.cc:740] T f4e3e64fdf584743a3a88df5d6600b22 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:09.912840 6454 consensus_queue.cc:260] T f4e3e64fdf584743a3a88df5d6600b22 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.914557 6454 ts_tablet_manager.cc:1434] T f4e3e64fdf584743a3a88df5d6600b22 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.007s user 0.000s sys 0.003s
I20260923 19:50:09.915220 6454 tablet_bootstrap.cc:492] T ab73e8a1b6774ca0b43e5be67da68fab P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:09.916659 6457 tablet_bootstrap.cc:492] T 15c0dc02ba964af38ca9f76161722588 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:09.916920 6457 ts_tablet_manager.cc:1403] T 15c0dc02ba964af38ca9f76161722588 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.030s user 0.000s sys 0.005s
I20260923 19:50:09.910991 6458 rpcz_store.cc:276] 0923 19:50:08.279390 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.279697 (+ 307us) service_pool.cc:224] Handling call
0923 19:50:09.522540 (+1242843us) ts_tablet_manager.cc:1151] Deleting tablet 623fb5b761134951a4b742ab2ba480a4
0923 19:50:09.522555 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:09.565720 (+ 43165us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:09.784349 (+218629us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:09.910811 (+126462us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1188825}
I20260923 19:50:09.917825 6457 raft_consensus.cc:359] T 15c0dc02ba964af38ca9f76161722588 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.918176 6457 raft_consensus.cc:385] T 15c0dc02ba964af38ca9f76161722588 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:09.918310 6457 raft_consensus.cc:740] T 15c0dc02ba964af38ca9f76161722588 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:09.918649 6457 consensus_queue.cc:260] T 15c0dc02ba964af38ca9f76161722588 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.919893 6461 ts_tablet_manager.cc:1929] T e071b9dd1db44af0a9d1b9e904f875a5 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:09.920452 6461 log.cc:1199] T e071b9dd1db44af0a9d1b9e904f875a5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/e071b9dd1db44af0a9d1b9e904f875a5
I20260923 19:50:09.921109 6461 ts_tablet_manager.cc:1950] T e071b9dd1db44af0a9d1b9e904f875a5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:09.920506 6457 ts_tablet_manager.cc:1434] T 15c0dc02ba964af38ca9f76161722588 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:50:09.923569 6457 tablet_bootstrap.cc:492] T 623052a8c9c2436a828655da6cf6d379 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:09.925756 6461 tablet_replica.cc:333] T fe5d081a41a3417b855656ca6e24f235 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:09.926034 6461 raft_consensus.cc:2243] T fe5d081a41a3417b855656ca6e24f235 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:09.926493 6461 raft_consensus.cc:2272] T fe5d081a41a3417b855656ca6e24f235 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:09.926956 6457 tablet_bootstrap.cc:654] T 623052a8c9c2436a828655da6cf6d379 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:09.927654 6461 ts_tablet_manager.cc:1916] T fe5d081a41a3417b855656ca6e24f235 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:09.935634 5800 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 0d70deeda179486291195476e47a9ae6 (table default.Table_d130b4b675a14c5a86ff587918d83d7c [id=d1e262e6e34742538b2b26c5fae80a99]). Expected version 1 got 0
I20260923 19:50:09.937114 6454 tablet_bootstrap.cc:654] T ab73e8a1b6774ca0b43e5be67da68fab P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:09.939074 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b898322439694b808c9bc71817a71752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.939345 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13b21aadd7464b1aa2afe7a1ebc9e77f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.940873 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dac9efee371479ab3547e06f0e580ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.943575 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 0bf1a426b7dc489ea4d73b117a87e49b (DEFAULT_TABLE table=default.Table_8ab9cdc2d4a14b679b8c38c86766c132 [id=46bda7fbcac44d6d9188884e8dfb8a3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.944319 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 623fb5b761134951a4b742ab2ba480a4 (table default.Table_526fa05830fd4679bd95ea4b8e9af682 [id=6cd1efd05c5d40d695658ba3aa1ddadc]) successfully deleted
I20260923 19:50:09.945098 6321 tablet_service.cc:1558] Processing DeleteTablet for tablet a11ecef9a24f4e4a812ec220b6a92cc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:09.945951 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bf1a426b7dc489ea4d73b117a87e49b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.945950 6308 tablet_service.cc:1511] Processing CreateTablet for tablet 7dac9efee371479ab3547e06f0e580ad (DEFAULT_TABLE table=default.Table_333fad3a38bb4b2781e372f8991a0f34 [id=a27e465b43fb4b4f9164761377d239c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.946378 6324 tablet_service.cc:1511] Processing CreateTablet for tablet b898322439694b808c9bc71817a71752 (DEFAULT_TABLE table=default.Table_b9ef7fd7111541e58e18257db75147a8 [id=3b68dbcccece4b77b03e6d04d5f04f1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.946708 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1347ea7774c40548975d10f6b3cba2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.947698 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bf1a426b7dc489ea4d73b117a87e49b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.952924 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dac9efee371479ab3547e06f0e580ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.954093 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0d817069e664199bff0d7591548e2d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.959311 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13b21aadd7464b1aa2afe7a1ebc9e77f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.961550 6459 ts_tablet_manager.cc:1929] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:09.965938 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0d817069e664199bff0d7591548e2d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.969055 6461 ts_tablet_manager.cc:1929] T fe5d081a41a3417b855656ca6e24f235 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:09.970496 6461 log.cc:1199] T fe5d081a41a3417b855656ca6e24f235 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/fe5d081a41a3417b855656ca6e24f235
I20260923 19:50:09.970590 6459 log.cc:1199] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/9101e82501fd461f8a4b2dcd9dffbd74
I20260923 19:50:09.970366 6457 tablet_bootstrap.cc:492] T 623052a8c9c2436a828655da6cf6d379 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:09.970858 6457 ts_tablet_manager.cc:1403] T 623052a8c9c2436a828655da6cf6d379 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.047s user 0.020s sys 0.018s
I20260923 19:50:09.971079 6459 ts_tablet_manager.cc:1950] T 9101e82501fd461f8a4b2dcd9dffbd74 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:09.971422 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 424) took 1703 ms. Trace:
I20260923 19:50:09.971479 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 397) took 1646 ms. Trace:
I20260923 19:50:09.971546 6459 rpcz_store.cc:276] 0923 19:50:08.267474 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.267838 (+ 364us) service_pool.cc:224] Handling call
0923 19:50:09.829178 (+1561340us) ts_tablet_manager.cc:1151] Deleting tablet 9101e82501fd461f8a4b2dcd9dffbd74
0923 19:50:09.829193 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:09.948497 (+119304us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:09.961431 (+ 12934us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:09.971378 (+ 9947us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1561109}
I20260923 19:50:09.971989 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 425) took 1674 ms. Trace:
I20260923 19:50:09.972111 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 9101e82501fd461f8a4b2dcd9dffbd74 (table default.Table_b5e4b2595161409da2fb9a56664da184 [id=3ab47a5709f64cdf87575911498c5760]) successfully deleted
I20260923 19:50:09.972105 6459 rpcz_store.cc:276] 0923 19:50:08.297436 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.297508 (+ 72us) service_pool.cc:224] Handling call
0923 19:50:09.971838 (+1674330us) ts_tablet_manager.cc:1151] Deleting tablet c5cb76fa5e084604aa58bf888cfe4852
0923 19:50:09.971845 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:09.971955 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1674062}
W20260923 19:50:09.972625 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet c5cb76fa5e084604aa58bf888cfe4852 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5cb76fa5e084604aa58bf888cfe4852 already in progress: creating tablet
I20260923 19:50:09.975845 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b898322439694b808c9bc71817a71752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.977608 6458 rpcz_store.cc:276] 0923 19:50:08.298319 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.298383 (+ 64us) service_pool.cc:224] Handling call
0923 19:50:09.918367 (+1619984us) ts_tablet_manager.cc:1151] Deleting tablet c5cb76fa5e084604aa58bf888cfe4852
0923 19:50:09.918379 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:09.944748 (+ 26369us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1584544}
I20260923 19:50:09.978479 6458 tablet_replica.cc:333] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:09.979108 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 444) took 1230 ms. Trace:
W20260923 19:50:09.979761 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet c5cb76fa5e084604aa58bf888cfe4852 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5cb76fa5e084604aa58bf888cfe4852 already in progress: creating tablet
I20260923 19:50:09.981017 6457 raft_consensus.cc:359] T 623052a8c9c2436a828655da6cf6d379 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.981237 6457 raft_consensus.cc:385] T 623052a8c9c2436a828655da6cf6d379 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:09.981328 6457 raft_consensus.cc:740] T 623052a8c9c2436a828655da6cf6d379 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:09.982255 6457 consensus_queue.cc:260] T 623052a8c9c2436a828655da6cf6d379 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:09.985078 6461 ts_tablet_manager.cc:1950] T fe5d081a41a3417b855656ca6e24f235 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:09.986251 6457 ts_tablet_manager.cc:1434] T 623052a8c9c2436a828655da6cf6d379 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260923 19:50:09.986577 6457 tablet_bootstrap.cc:492] T f1a4bccf6dd2411f83b86d782ecf5f40 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:09.987556 5798 master_service.cc:960] ReplaceTablet: received request to replace tablet 66739afdf147413787acb0363aa37df6 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:09.990388 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_98f26974f07c4799981e0b2b01d7cd8d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:09.990608 6457 tablet_bootstrap.cc:654] T f1a4bccf6dd2411f83b86d782ecf5f40 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:09.991039 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_98f26974f07c4799981e0b2b01d7cd8d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:09.992515 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a6113d227550419cb7147c6e2f97086c" } new_table_name: "default.Table_7af64af6dab645518765ddc326d8b537" modify_external_catalogs: true
I20260923 19:50:09.994321 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_07e80ab9f3724d98963f992881d6eacc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:09.994926 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_07e80ab9f3724d98963f992881d6eacc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:09.996987 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 66739afdf147413787acb0363aa37df6
I20260923 19:50:09.997076 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_63a6947f3c8f4223b9f33e260bc77331"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:09.997494 5798 catalog_manager.cc:6934] ReplaceTablet: tablet 66739afdf147413787acb0363aa37df6 deleted and replaced by tablet e4ad9baac560463fabc80828074b46c1
W20260923 19:50:09.997594 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63a6947f3c8f4223b9f33e260bc77331 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:09.998306 6029 tablet_service.cc:1511] Processing CreateTablet for tablet c1347ea7774c40548975d10f6b3cba2a (DEFAULT_TABLE table=default.Table_96ab135786f74ab697bb37601c264ece [id=dc6240941b87434aa6037a3f08689920]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:09.998771 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1347ea7774c40548975d10f6b3cba2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:09.998873 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_3237cd4c60f34314a0570aacaf0b5349"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:09.999358 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3237cd4c60f34314a0570aacaf0b5349 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:10.000599 5799 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_2faafe31fd0c43caa3c83f70f72c1c62" } new_table_name: "default.Table_08e8b19223d8498983c3571f2e650e8c" modify_external_catalogs: true
I20260923 19:50:10.013062 5798 catalog_manager.cc:5838] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:10.014261 5798 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 6a34e178007b4e8ebed429cedf44e82a (table default.Table_2dcd13e928c349ff8820580efef4aad7 [id=0bc5dceb2ad84601aa35e4d2714f0b41]). Expected version 1 got 0
I20260923 19:50:10.014683 5798 catalog_manager.cc:5838] T ec4284d6a0fa416ca95b4d675c8e3912 P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } }
W20260923 19:50:10.015681 5805 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f8007918eca14c81947e5999fe13a705 consensus state has no leader
I20260923 19:50:10.018797 5798 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet ec4284d6a0fa416ca95b4d675c8e3912 (table default.Table_00f5789c01e94f8e8c65077f98b164c2 [id=29a38060f3bf43f3900ad0ee42fbde9a]). Expected version 1 got 0
W20260923 19:50:10.030572 5799 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ec5793bdec5244aa8cf13b7fb3b84b8a has no consensus state
I20260923 19:50:10.032229 5804 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_8f7f460e1af1407c99776ddc28c8b0c4" } new_table_name: "default.Table_18c12428fbbe40a394cbf271fbcd69f0" modify_external_catalogs: true
I20260923 19:50:10.034233 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_7ffebe5b17514f94a89896e0bdf59b31"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:10.034837 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7ffebe5b17514f94a89896e0bdf59b31 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:10.034952 6031 tablet_service.cc:1511] Processing CreateTablet for tablet a0d817069e664199bff0d7591548e2d7 (DEFAULT_TABLE table=default.Table_572d17eb83634c98b68bbcfedc88603e [id=7e1215217a574debb42c752695194f6b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:10.035040 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 4c6f9953649a43aa9a0edd78b7bd47a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4c6f9953649a43aa9a0edd78b7bd47a4 already in progress: creating tablet
I20260923 19:50:10.035420 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0d817069e664199bff0d7591548e2d7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:10.035378 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 1c26a2863fdd4912b6d357877af1eb42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1c26a2863fdd4912b6d357877af1eb42 already in progress: creating tablet
W20260923 19:50:10.035667 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 64e8951eb899461aa9c0b36e3f7555e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64e8951eb899461aa9c0b36e3f7555e2 already in progress: creating tablet
W20260923 19:50:10.036067 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet cb11d6e082784ad98cfb5253dbb88707 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb11d6e082784ad98cfb5253dbb88707 already in progress: creating tablet
W20260923 19:50:10.036379 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet ebc288d8d453481592df11cd1bfed3ac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ebc288d8d453481592df11cd1bfed3ac already in progress: creating tablet
I20260923 19:50:10.036753 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet b985acc650334497832cf4505e1b0043 (table default.Table_0291d1f518d445cda50f5b95a4aee646 [id=4dd6a10e3a9f465f816cc39c3a122468]) successfully deleted
I20260923 19:50:10.036711 7097 tablet.cc:1751] T ec4cc8a742114e5fb07c5c9157ce09e8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:10.036988 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet e071b9dd1db44af0a9d1b9e904f875a5 (table default.Table_b7610081818744a5b76680621ab7212d [id=8b14917d9dc6415dbb75917bccf09502]) successfully deleted
I20260923 19:50:10.037207 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet fe5d081a41a3417b855656ca6e24f235 (table default.Table_124323035bb7418597ae00063fdffdf2 [id=b4a404dd8b1b4bd1971ec4ae180bff02]) successfully deleted
I20260923 19:50:10.038195 6030 tablet_service.cc:1511] Processing CreateTablet for tablet b898322439694b808c9bc71817a71752 (DEFAULT_TABLE table=default.Table_b9ef7fd7111541e58e18257db75147a8 [id=3b68dbcccece4b77b03e6d04d5f04f1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.038621 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b898322439694b808c9bc71817a71752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.039417 7094 tablet.cc:1751] T 5adadf8caf5e4a9ab1107d0fb6a91735 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260923 19:50:10.041199 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 0bf1a426b7dc489ea4d73b117a87e49b (DEFAULT_TABLE table=default.Table_8ab9cdc2d4a14b679b8c38c86766c132 [id=46bda7fbcac44d6d9188884e8dfb8a3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.041601 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bf1a426b7dc489ea4d73b117a87e49b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.042969 7097 tablet.cc:1751] T 6a34e178007b4e8ebed429cedf44e82a P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:10.043689 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet 194494af2c424a55a772f3858af63c2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:10.043956 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet 3919b15a00eb4fb08008f065f556c760 with delete_type TABLET_DATA_DELETED (replaced by tablet f74e7cb3e5f54dfdb2280c795ce2ce53) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:10.044163 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet a11ecef9a24f4e4a812ec220b6a92cc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:10.044482 6022 tablet_service.cc:1511] Processing CreateTablet for tablet 7dac9efee371479ab3547e06f0e580ad (DEFAULT_TABLE table=default.Table_333fad3a38bb4b2781e372f8991a0f34 [id=a27e465b43fb4b4f9164761377d239c7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:10.044620 5700 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 163089us
I20260923 19:50:10.045619 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 66739afdf147413787acb0363aa37df6 with delete_type TABLET_DATA_DELETED (replaced by tablet e4ad9baac560463fabc80828074b46c1) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:10.043763 6457 tablet_bootstrap.cc:492] T f1a4bccf6dd2411f83b86d782ecf5f40 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:10.048591 6457 ts_tablet_manager.cc:1403] T f1a4bccf6dd2411f83b86d782ecf5f40 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.062s user 0.012s sys 0.038s
I20260923 19:50:10.049487 6457 raft_consensus.cc:359] T f1a4bccf6dd2411f83b86d782ecf5f40 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.049762 6457 raft_consensus.cc:385] T f1a4bccf6dd2411f83b86d782ecf5f40 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:10.049924 6457 raft_consensus.cc:740] T f1a4bccf6dd2411f83b86d782ecf5f40 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:10.050239 6457 consensus_queue.cc:260] T f1a4bccf6dd2411f83b86d782ecf5f40 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.050923 6457 ts_tablet_manager.cc:1434] T f1a4bccf6dd2411f83b86d782ecf5f40 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:50:10.051880 6461 tablet_replica.cc:333] T 194494af2c424a55a772f3858af63c2c P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:10.052987 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dac9efee371479ab3547e06f0e580ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.053689 6461 raft_consensus.cc:2243] T 194494af2c424a55a772f3858af63c2c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:10.053946 6461 raft_consensus.cc:2272] T 194494af2c424a55a772f3858af63c2c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:10.055596 6461 ts_tablet_manager.cc:1916] T 194494af2c424a55a772f3858af63c2c P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:10.061029 5802 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet ec4cc8a742114e5fb07c5c9157ce09e8 (table default.Table_2adc87e06d81491498aa018f49fdc08d [id=89181985e6154c7fa946148e48bef2eb]). Expected version 2 got 0
I20260923 19:50:10.063306 6457 tablet_bootstrap.cc:492] T cd02244c52ad4d2ab3915108a92a6f97 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:10.066715 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 13b21aadd7464b1aa2afe7a1ebc9e77f (DEFAULT_TABLE table=default.Table_9775cad3e3fc483a925aead3e398478c [id=cb6795bdff32412fbde77d27ba38390f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.067348 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13b21aadd7464b1aa2afe7a1ebc9e77f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.068643 6458 raft_consensus.cc:2243] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:10.069710 6458 raft_consensus.cc:2272] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:10.069998 6457 tablet_bootstrap.cc:654] T cd02244c52ad4d2ab3915108a92a6f97 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:10.071583 6458 ts_tablet_manager.cc:1916] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:10.083564 6920 raft_consensus.cc:493] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:10.088228 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_71cd58805ce747c3bbe35af74bb03cd6" } new_table_name: "default.Table_3449983df42c4bd79b6f9f041a13ed95" modify_external_catalogs: true
I20260923 19:50:10.088927 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet 66739afdf147413787acb0363aa37df6 with delete_type TABLET_DATA_DELETED (replaced by tablet e4ad9baac560463fabc80828074b46c1) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:10.094120 6308 tablet_service.cc:1558] Processing DeleteTablet for tablet 86473c5cbca54b5792b038aef445998c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:10.095010 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ca447ba1a2d04e7ab8954432c4a42c97" } modify_external_catalogs: true
I20260923 19:50:10.095218 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ca447ba1a2d04e7ab8954432c4a42c97" } modify_external_catalogs: true
W20260923 19:50:10.099762 5804 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e996910398694686bd68ef31239ed15f consensus state has no leader
I20260923 19:50:10.100162 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_8e33c6465d2d4bc2bb7dc625ec2cfca3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:10.100818 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e33c6465d2d4bc2bb7dc625ec2cfca3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:10.108471 6461 ts_tablet_manager.cc:1929] T 194494af2c424a55a772f3858af63c2c P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:10.108881 6461 log.cc:1199] T 194494af2c424a55a772f3858af63c2c P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/194494af2c424a55a772f3858af63c2c
I20260923 19:50:10.109452 6461 ts_tablet_manager.cc:1950] T 194494af2c424a55a772f3858af63c2c P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:10.110172 7096 tablet.cc:1751] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260923 19:50:10.110587 6461 tablet_replica.cc:333] T 3919b15a00eb4fb08008f065f556c760 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:10.110929 6461 raft_consensus.cc:2243] T 3919b15a00eb4fb08008f065f556c760 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:10.111179 6461 raft_consensus.cc:2272] T 3919b15a00eb4fb08008f065f556c760 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:10.112402 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_6e87577be39e4d298db5528f71c6af62"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:10.113009 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e87577be39e4d298db5528f71c6af62 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:10.113267 6461 ts_tablet_manager.cc:1916] T 3919b15a00eb4fb08008f065f556c760 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:10.119095 5801 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_c49fa1ccdba34f098164e9732f9a750a" } modify_external_catalogs: true
I20260923 19:50:10.119318 5801 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_c49fa1ccdba34f098164e9732f9a750a" } modify_external_catalogs: true
I20260923 19:50:10.121942 5799 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_c61ffa0e84514cddb714dc30da0a21f6" } modify_external_catalogs: true
I20260923 19:50:10.122120 5799 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_c61ffa0e84514cddb714dc30da0a21f6" } modify_external_catalogs: true
I20260923 19:50:10.123950 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_72ac9bcffa734327aae54a672786184b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:10.124540 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72ac9bcffa734327aae54a672786184b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:10.127272 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 12bda2ae961446bea2f34e792f4f1706 consensus state has no leader
I20260923 19:50:10.128360 6461 ts_tablet_manager.cc:1929] T 3919b15a00eb4fb08008f065f556c760 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:10.130977 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 3d74560614b744188e759b981ad89a7d
I20260923 19:50:10.132103 6461 log.cc:1199] T 3919b15a00eb4fb08008f065f556c760 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/3919b15a00eb4fb08008f065f556c760
I20260923 19:50:10.132964 6461 ts_tablet_manager.cc:1950] T 3919b15a00eb4fb08008f065f556c760 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:10.133813 6308 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d74560614b744188e759b981ad89a7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:10.136193 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet 66739afdf147413787acb0363aa37df6 with delete_type TABLET_DATA_DELETED (replaced by tablet e4ad9baac560463fabc80828074b46c1) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:10.136477 6920 raft_consensus.cc:515] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.137125 6920 leader_election.cc:290] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:10.137279 6920 raft_consensus.cc:493] T ec4cc8a742114e5fb07c5c9157ce09e8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:10.137390 6920 raft_consensus.cc:515] T ec4cc8a742114e5fb07c5c9157ce09e8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.137892 6920 leader_election.cc:290] T ec4cc8a742114e5fb07c5c9157ce09e8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:10.138837 6058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4cc8a742114e5fb07c5c9157ce09e8" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
W20260923 19:50:10.139424 6137 leader_election.cc:343] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 64a38bbd3fbd4738a73e78e3f6436fe5
I20260923 19:50:10.140868 7096 tablet.cc:1751] T 6a34e178007b4e8ebed429cedf44e82a P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:10.140022 6459 rpcz_store.cc:276] 0923 19:50:08.748189 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.748265 (+ 76us) service_pool.cc:224] Handling call
0923 19:50:09.972379 (+1224114us) ts_tablet_manager.cc:1151] Deleting tablet fe5d081a41a3417b855656ca6e24f235
0923 19:50:09.972387 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:09.979062 (+ 6675us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1220576}
I20260923 19:50:10.142275 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 443) took 1409 ms. Trace:
I20260923 19:50:10.142464 5797 master_service.cc:960] ReplaceTablet: received request to replace tablet ce6b86f947ce420994eaa5ff39ad9c87 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:10.142547 6030 tablet_service.cc:1558] Processing DeleteTablet for tablet 15c0dc02ba964af38ca9f76161722588 with delete_type TABLET_DATA_DELETED (replaced by tablet 85b7dcf131c54187a6e61f8503c797f8) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:10.142807 6461 tablet_replica.cc:333] T 15c0dc02ba964af38ca9f76161722588 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:10.143044 6461 raft_consensus.cc:2243] T 15c0dc02ba964af38ca9f76161722588 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:10.143252 6461 raft_consensus.cc:2272] T 15c0dc02ba964af38ca9f76161722588 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:10.143491 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet fe5d081a41a3417b855656ca6e24f235 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe5d081a41a3417b855656ca6e24f235 already in progress: creating tablet
I20260923 19:50:10.143430 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_5fadfa5910764258a5909469ed37ebb7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:10.143882 6459 rpcz_store.cc:276] 0923 19:50:08.732827 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.733019 (+ 192us) service_pool.cc:224] Handling call
0923 19:50:10.142129 (+1409110us) ts_tablet_manager.cc:1151] Deleting tablet ce6b86f947ce420994eaa5ff39ad9c87
0923 19:50:10.142138 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.142242 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1374402}
W20260923 19:50:10.144058 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5fadfa5910764258a5909469ed37ebb7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:10.144958 6461 ts_tablet_manager.cc:1916] T 15c0dc02ba964af38ca9f76161722588 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:10.146145 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_5f13aeaf05304dadbdb2d0d720acd604"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:10.146445 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet ce6b86f947ce420994eaa5ff39ad9c87 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce6b86f947ce420994eaa5ff39ad9c87 already in progress: creating tablet
W20260923 19:50:10.146806 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f13aeaf05304dadbdb2d0d720acd604 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:10.146788 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d74560614b744188e759b981ad89a7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:10.148144 6459 tablet_replica.cc:333] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:10.148455 5798 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_c716115e5d0045b691616d451daec14d" } modify_external_catalogs: true
I20260923 19:50:10.148671 5798 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_c716115e5d0045b691616d451daec14d" } modify_external_catalogs: true
I20260923 19:50:10.149094 6459 raft_consensus.cc:2243] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:10.149381 6459 pending_rounds.cc:70] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:10.149467 6459 pending_rounds.cc:77] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630565411385344 op_type: NO_OP noop_request { }
I20260923 19:50:10.149644 6459 raft_consensus.cc:2889] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:10.149771 6459 raft_consensus.cc:2272] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:10.151738 5797 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet ec4cc8a742114e5fb07c5c9157ce09e8 (table default.Table_2adc87e06d81491498aa018f49fdc08d [id=89181985e6154c7fa946148e48bef2eb]). Expected version 2 got 0
I20260923 19:50:10.158766 6459 ts_tablet_manager.cc:1916] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:10.160786 6030 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d74560614b744188e759b981ad89a7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:10.162147 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 194494af2c424a55a772f3858af63c2c (table default.Table_41c2e67e9c7e4fa192fc124e05c2d34f [id=b5209bbe29cb42e6b2473caddc119f44]) successfully deleted
I20260923 19:50:10.163518 6461 ts_tablet_manager.cc:1929] T 15c0dc02ba964af38ca9f76161722588 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:10.169731 6461 log.cc:1199] T 15c0dc02ba964af38ca9f76161722588 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/15c0dc02ba964af38ca9f76161722588
I20260923 19:50:10.170738 6461 ts_tablet_manager.cc:1950] T 15c0dc02ba964af38ca9f76161722588 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:10.176767 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 3919b15a00eb4fb08008f065f556c760 (table default.Table_64791d9d1cef4cfe9d420e405abe816e [id=8325a8f159124a2da260e2be3ce69500]) successfully deleted
W20260923 19:50:10.178762 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet a11ecef9a24f4e4a812ec220b6a92cc4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a11ecef9a24f4e4a812ec220b6a92cc4 already in progress: creating tablet
I20260923 19:50:10.183347 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet f4e3e64fdf584743a3a88df5d6600b22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:10.184463 6199 raft_consensus.cc:3060] T 26031fe469d046518cdd0f1e955e19d1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:10.180485 5804 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_2adc87e06d81491498aa018f49fdc08d [id=89181985e6154c7fa946148e48bef2eb] alter complete (version 2)
W20260923 19:50:10.186199 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 66739afdf147413787acb0363aa37df6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66739afdf147413787acb0363aa37df6 already in progress: creating tablet
I20260923 19:50:10.186434 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 15c0dc02ba964af38ca9f76161722588 (table default.Table_23c500b65dba4b6790b4349e5a5b0a07 [id=647997210f5349a68aa98d24e12a33cd]) successfully deleted
W20260923 19:50:10.186664 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 3d74560614b744188e759b981ad89a7d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3d74560614b744188e759b981ad89a7d already in progress: creating tablet
I20260923 19:50:10.192247 7055 consensus_queue.cc:1048] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:10.194201 6454 tablet_bootstrap.cc:492] T ab73e8a1b6774ca0b43e5be67da68fab P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:10.194393 6454 ts_tablet_manager.cc:1403] T ab73e8a1b6774ca0b43e5be67da68fab P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.279s user 0.009s sys 0.009s
I20260923 19:50:10.195241 6454 raft_consensus.cc:359] T ab73e8a1b6774ca0b43e5be67da68fab P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.195438 6454 raft_consensus.cc:385] T ab73e8a1b6774ca0b43e5be67da68fab P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:10.195545 6454 raft_consensus.cc:740] T ab73e8a1b6774ca0b43e5be67da68fab P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:10.195770 6454 consensus_queue.cc:260] T ab73e8a1b6774ca0b43e5be67da68fab P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.200847 5801 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet f5cb8dd5dcf54df9989dd808fe148ce6
I20260923 19:50:10.203974 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet f5cb8dd5dcf54df9989dd808fe148ce6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:10.203979 6308 tablet_service.cc:1558] Processing DeleteTablet for tablet f5cb8dd5dcf54df9989dd808fe148ce6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:10.204552 6454 ts_tablet_manager.cc:1434] T ab73e8a1b6774ca0b43e5be67da68fab P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260923 19:50:10.206156 6454 tablet_bootstrap.cc:492] T 86473c5cbca54b5792b038aef445998c P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:10.208303 6454 tablet_bootstrap.cc:654] T 86473c5cbca54b5792b038aef445998c P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:10.212884 6030 tablet_service.cc:1558] Processing DeleteTablet for tablet f5cb8dd5dcf54df9989dd808fe148ce6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:10.221262 6459 ts_tablet_manager.cc:1929] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:10.223304 5799 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 839bcf991b754f9e95a1dd6c4f826e71
I20260923 19:50:10.225495 6308 tablet_service.cc:1558] Processing DeleteTablet for tablet 839bcf991b754f9e95a1dd6c4f826e71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:10.227692 7071 raft_consensus.cc:493] T ffcf1a144f3c42719a5aa5deed537975 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:10.227916 7071 raft_consensus.cc:515] T ffcf1a144f3c42719a5aa5deed537975 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.228753 7071 leader_election.cc:290] T ffcf1a144f3c42719a5aa5deed537975 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:10.229135 7018 consensus_queue.cc:1048] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:10.229276 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcf1a144f3c42719a5aa5deed537975" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:10.229946 5996 leader_election.cc:343] T ffcf1a144f3c42719a5aa5deed537975 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:10.234220 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet f5cb8dd5dcf54df9989dd808fe148ce6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5cb8dd5dcf54df9989dd808fe148ce6 already in progress: creating tablet
I20260923 19:50:10.235354 6030 tablet_service.cc:1558] Processing DeleteTablet for tablet 839bcf991b754f9e95a1dd6c4f826e71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:10.237336 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 839bcf991b754f9e95a1dd6c4f826e71 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 839bcf991b754f9e95a1dd6c4f826e71 already in progress: creating tablet
I20260923 19:50:10.262708 6458 ts_tablet_manager.cc:1929] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:10.262913 6458 log.cc:1199] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/4750e2a1b24e4bc7aafa4cd36afebbbd
I20260923 19:50:10.263304 6458 ts_tablet_manager.cc:1950] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:10.274910 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_30ce30e86cff4c8f9995423040b349c9" } modify_external_catalogs: true
I20260923 19:50:10.275194 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_30ce30e86cff4c8f9995423040b349c9" } modify_external_catalogs: true
I20260923 19:50:10.275812 5802 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_1a1e2c3e55034c179378dbfcbfd6b62f" } new_table_name: "default.Table_e4788af31ab94b6eae62e66d4f0e8c93" modify_external_catalogs: true
I20260923 19:50:10.277477 5799 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_07e80ab9f3724d98963f992881d6eacc" } new_table_name: "default.Table_303e0707d7d8434aa96fc5b4d1d8bfe8" modify_external_catalogs: true
I20260923 19:50:10.278600 5801 master_service.cc:960] ReplaceTablet: received request to replace tablet 431ad4da27544d68aa5666293984a86a from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:10.303239 6457 tablet_bootstrap.cc:492] T cd02244c52ad4d2ab3915108a92a6f97 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:10.303781 6457 ts_tablet_manager.cc:1403] T cd02244c52ad4d2ab3915108a92a6f97 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.242s user 0.018s sys 0.035s
I20260923 19:50:10.304872 6457 raft_consensus.cc:359] T cd02244c52ad4d2ab3915108a92a6f97 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.305263 6457 raft_consensus.cc:385] T cd02244c52ad4d2ab3915108a92a6f97 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:10.305424 6457 raft_consensus.cc:740] T cd02244c52ad4d2ab3915108a92a6f97 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:10.305765 6457 consensus_queue.cc:260] T cd02244c52ad4d2ab3915108a92a6f97 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.308346 6457 ts_tablet_manager.cc:1434] T cd02244c52ad4d2ab3915108a92a6f97 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260923 19:50:10.309136 6457 tablet_bootstrap.cc:492] T a08446fcf1794dab9d3181904507456f P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:10.310863 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_3449983df42c4bd79b6f9f041a13ed95" } new_table_name: "default.Table_89c60db74742422086b6dcf76932a865" modify_external_catalogs: true
I20260923 19:50:10.312590 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_d8377901984e4886984600fc0b7e24a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:10.313243 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d8377901984e4886984600fc0b7e24a4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:10.313941 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_74ffa772df8d47a4b028a5290d1c8846"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:10.314365 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_74ffa772df8d47a4b028a5290d1c8846 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:10.315762 6457 tablet_bootstrap.cc:654] T a08446fcf1794dab9d3181904507456f P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:10.264240 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 393) took 1985 ms. Trace:
I20260923 19:50:10.268926 7101 tablet.cc:1751] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:10.315975 6458 rpcz_store.cc:276] 0923 19:50:08.279039 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.314123 (+ 35084us) service_pool.cc:224] Handling call
0923 19:50:09.978389 (+1664266us) ts_tablet_manager.cc:1151] Deleting tablet 4750e2a1b24e4bc7aafa4cd36afebbbd
0923 19:50:09.978402 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.126773 (+148371us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:10.262610 (+135837us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:10.264170 (+ 1560us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1644384}
I20260923 19:50:10.316512 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 4750e2a1b24e4bc7aafa4cd36afebbbd (table default.Table_103c4095b9c641d7aed905489796806e [id=0747811756dc43fdb5cba790c9a319df]) successfully deleted
I20260923 19:50:10.316895 6458 tablet_replica.cc:333] T 4b15b250f594459eb959b4871f7ae398 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:10.317173 6458 raft_consensus.cc:2243] T 4b15b250f594459eb959b4871f7ae398 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:10.317633 6458 raft_consensus.cc:2272] T 4b15b250f594459eb959b4871f7ae398 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:10.313793 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4cc8a742114e5fb07c5c9157ce09e8" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:10.278641 6456 tablet_bootstrap.cc:492] T f4e3e64fdf584743a3a88df5d6600b22 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:10.318579 6456 ts_tablet_manager.cc:1403] T f4e3e64fdf584743a3a88df5d6600b22 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.701s user 0.013s sys 0.008s
I20260923 19:50:10.319585 6456 raft_consensus.cc:359] T f4e3e64fdf584743a3a88df5d6600b22 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.319808 6456 raft_consensus.cc:385] T f4e3e64fdf584743a3a88df5d6600b22 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:10.319907 6456 raft_consensus.cc:740] T f4e3e64fdf584743a3a88df5d6600b22 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:10.320201 6456 consensus_queue.cc:260] T f4e3e64fdf584743a3a88df5d6600b22 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.321288 6456 ts_tablet_manager.cc:1434] T f4e3e64fdf584743a3a88df5d6600b22 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
W20260923 19:50:10.321744 5700 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 80156.2us
I20260923 19:50:10.322708 6456 tablet_bootstrap.cc:492] T 495292cacf3b42a5b633ad40e5e01972 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:10.325420 6456 tablet_bootstrap.cc:654] T 495292cacf3b42a5b633ad40e5e01972 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:10.325618 5804 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_2dcd13e928c349ff8820580efef4aad7 [id=0bc5dceb2ad84601aa35e4d2714f0b41] alter complete (version 1)
I20260923 19:50:10.327584 6030 tablet_service.cc:1558] Processing DeleteTablet for tablet 623052a8c9c2436a828655da6cf6d379 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:10.328061 6461 tablet_replica.cc:333] T 623052a8c9c2436a828655da6cf6d379 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:10.328264 6461 raft_consensus.cc:2243] T 623052a8c9c2436a828655da6cf6d379 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:10.328503 6461 raft_consensus.cc:2272] T 623052a8c9c2436a828655da6cf6d379 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:10.315372 6280 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 67552.7us
I20260923 19:50:10.329624 6461 ts_tablet_manager.cc:1916] T 623052a8c9c2436a828655da6cf6d379 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:10.224830 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet 839bcf991b754f9e95a1dd6c4f826e71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:10.276903 6920 raft_consensus.cc:493] T b4fc995819cc40bf9956d85966bcd330 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:10.330368 6920 raft_consensus.cc:515] T b4fc995819cc40bf9956d85966bcd330 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.331184 6920 leader_election.cc:290] T b4fc995819cc40bf9956d85966bcd330 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:10.314280 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcf1a144f3c42719a5aa5deed537975" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:10.332398 6137 leader_election.cc:343] T b4fc995819cc40bf9956d85966bcd330 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: b4fc995819cc40bf9956d85966bcd330
I20260923 19:50:10.332398 6459 log.cc:1199] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/4750e2a1b24e4bc7aafa4cd36afebbbd
I20260923 19:50:10.333045 6459 ts_tablet_manager.cc:1950] T 4750e2a1b24e4bc7aafa4cd36afebbbd P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:10.333380 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 442) took 1600 ms. Trace:
I20260923 19:50:10.333801 7101 tablet.cc:1746] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd: Skipping requested alter to schema version 2, tablet already version 2
I20260923 19:50:10.334125 7094 tablet.cc:1746] T ec4cc8a742114e5fb07c5c9157ce09e8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Skipping requested alter to schema version 2, tablet already version 2
I20260923 19:50:10.336393 6030 tablet_service.cc:1558] Processing DeleteTablet for tablet f1a4bccf6dd2411f83b86d782ecf5f40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:10.335807 6459 rpcz_store.cc:276] 0923 19:50:08.732655 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.733617 (+ 962us) service_pool.cc:224] Handling call
0923 19:50:10.144162 (+1410545us) ts_tablet_manager.cc:1151] Deleting tablet 4750e2a1b24e4bc7aafa4cd36afebbbd
0923 19:50:10.144170 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.217099 (+ 72929us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:10.221141 (+ 4042us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:10.333341 (+112200us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1376261}
I20260923 19:50:10.337067 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 4750e2a1b24e4bc7aafa4cd36afebbbd (table default.Table_103c4095b9c641d7aed905489796806e [id=0747811756dc43fdb5cba790c9a319df]) successfully deleted
I20260923 19:50:10.337775 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 446) took 1586 ms. Trace:
I20260923 19:50:10.339543 6461 ts_tablet_manager.cc:1929] T 623052a8c9c2436a828655da6cf6d379 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:10.339737 6461 log.cc:1199] T 623052a8c9c2436a828655da6cf6d379 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/623052a8c9c2436a828655da6cf6d379
I20260923 19:50:10.339869 6459 rpcz_store.cc:276] 0923 19:50:08.750855 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.750965 (+ 110us) service_pool.cc:224] Handling call
0923 19:50:10.337479 (+1586514us) ts_tablet_manager.cc:1151] Deleting tablet 658253ff3d014361803e1aeda978e59a
0923 19:50:10.337492 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.337604 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1534337}
I20260923 19:50:10.340371 6461 ts_tablet_manager.cc:1950] T 623052a8c9c2436a828655da6cf6d379 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
W20260923 19:50:10.341140 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 658253ff3d014361803e1aeda978e59a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 658253ff3d014361803e1aeda978e59a already in progress: creating tablet
I20260923 19:50:10.342397 6199 raft_consensus.cc:3060] T ab73e8a1b6774ca0b43e5be67da68fab P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:10.342767 6459 tablet_replica.cc:333] T 4b15b250f594459eb959b4871f7ae398 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:10.343823 6459 raft_consensus.cc:2243] T 4b15b250f594459eb959b4871f7ae398 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:10.344756 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_a479e36e3d0146cd99a8f7479236e5ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:10.345283 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a479e36e3d0146cd99a8f7479236e5ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:10.349294 5802 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 39261cedbdb54d1f8ae0e07ae1cfeb3e has no consensus state
W20260923 19:50:10.350490 6280 consensus_peers.cc:597] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:10.350826 7018 consensus_queue.cc:1048] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:10.363445 7113 raft_consensus.cc:493] T f4e3e64fdf584743a3a88df5d6600b22 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:10.364147 7113 raft_consensus.cc:515] T f4e3e64fdf584743a3a88df5d6600b22 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.368793 7115 consensus_queue.cc:1048] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260923 19:50:10.369349 6279 leader_election.cc:343] T f4e3e64fdf584743a3a88df5d6600b22 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: f4e3e64fdf584743a3a88df5d6600b22
I20260923 19:50:10.370414 6461 tablet_replica.cc:333] T f1a4bccf6dd2411f83b86d782ecf5f40 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:10.330044 7102 raft_consensus.cc:493] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:10.370687 6461 raft_consensus.cc:2243] T f1a4bccf6dd2411f83b86d782ecf5f40 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260923 19:50:10.314563 6139 leader_election.cc:343] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 64a38bbd3fbd4738a73e78e3f6436fe5
I20260923 19:50:10.366170 6458 ts_tablet_manager.cc:1916] T 4b15b250f594459eb959b4871f7ae398 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:10.374626 6461 raft_consensus.cc:2272] T f1a4bccf6dd2411f83b86d782ecf5f40 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:10.375103 7113 leader_election.cc:290] T f4e3e64fdf584743a3a88df5d6600b22 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:10.386081 6461 ts_tablet_manager.cc:1916] T f1a4bccf6dd2411f83b86d782ecf5f40 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:10.388724 5800 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 12bda2ae961446bea2f34e792f4f1706 consensus state has no leader
I20260923 19:50:10.388898 6459 raft_consensus.cc:2272] T 4b15b250f594459eb959b4871f7ae398 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:10.389739 6139 leader_election.cc:304] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:10.390518 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4e3e64fdf584743a3a88df5d6600b22" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:10.391383 6920 raft_consensus.cc:2749] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:10.391975 6454 tablet_bootstrap.cc:492] T 86473c5cbca54b5792b038aef445998c P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
W20260923 19:50:10.392246 6139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.195:32855, user_credentials={real_user=slave}} blocked reactor thread for 75954.1us
I20260923 19:50:10.381865 7102 raft_consensus.cc:515] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.399811 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4fc995819cc40bf9956d85966bcd330" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:10.400099 6344 raft_consensus.cc:2393] T b4fc995819cc40bf9956d85966bcd330 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61022dd7f2f14dc19aebe3af5f08f430 in current term 1: Already voted for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in this term.
I20260923 19:50:10.400370 6454 ts_tablet_manager.cc:1403] T 86473c5cbca54b5792b038aef445998c P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.186s user 0.021s sys 0.028s
W20260923 19:50:10.400874 5995 leader_election.cc:343] T ffcf1a144f3c42719a5aa5deed537975 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:10.401057 5995 leader_election.cc:304] T ffcf1a144f3c42719a5aa5deed537975 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:10.401213 6458 ts_tablet_manager.cc:1929] T 4b15b250f594459eb959b4871f7ae398 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:10.401332 6458 log.cc:1199] T 4b15b250f594459eb959b4871f7ae398 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/4b15b250f594459eb959b4871f7ae398
I20260923 19:50:10.401350 6199 raft_consensus.cc:2468] T f4e3e64fdf584743a3a88df5d6600b22 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:10.401533 7071 raft_consensus.cc:2749] T ffcf1a144f3c42719a5aa5deed537975 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:10.401760 6458 ts_tablet_manager.cc:1950] T 4b15b250f594459eb959b4871f7ae398 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:10.405887 5802 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_bb0cff9e9bcd4de98b915af1c7e3bca2 [id=738ed1d070ef485e9299c1f3b1db008a] alter complete (version 3)
I20260923 19:50:10.407791 6454 raft_consensus.cc:359] T 86473c5cbca54b5792b038aef445998c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.408993 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_e68b828ba396413d8284d20c9047243c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:10.409593 6137 leader_election.cc:343] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 063fc0e77d294ddf8a02e9ab5968a5e3
I20260923 19:50:10.410475 5802 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a0d1427301b14afd906023f389ea8b81" } new_table_name: "default.Table_b1d1d63c07d44208b5d0b2542e9590af" modify_external_catalogs: true
W20260923 19:50:10.412958 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e68b828ba396413d8284d20c9047243c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:10.370159 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 623052a8c9c2436a828655da6cf6d379 (table default.Table_5365e890b976423aa339a9b5e8c8db7e [id=c815692bfbde445ea9c331e95615a751]) successfully deleted
W20260923 19:50:10.415674 5790 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.5.143.193:39887, user_credentials={real_user=slave}} blocked reactor thread for 45547.2us
I20260923 19:50:10.415894 6139 leader_election.cc:304] T ec4cc8a742114e5fb07c5c9157ce09e8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:10.415057 7117 tablet.cc:1751] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260923 19:50:10.416983 6030 tablet_service.cc:1558] Processing DeleteTablet for tablet cd02244c52ad4d2ab3915108a92a6f97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:10.417281 6920 raft_consensus.cc:2749] T ec4cc8a742114e5fb07c5c9157ce09e8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:10.417804 6454 raft_consensus.cc:385] T 86473c5cbca54b5792b038aef445998c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:10.418236 6454 raft_consensus.cc:740] T 86473c5cbca54b5792b038aef445998c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:10.417937 6139 leader_election.cc:304] T b4fc995819cc40bf9956d85966bcd330 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:10.418254 7102 leader_election.cc:290] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:10.420506 6920 raft_consensus.cc:493] T 623fb5b761134951a4b742ab2ba480a4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:10.420463 6454 consensus_queue.cc:260] T 86473c5cbca54b5792b038aef445998c P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.420672 6920 raft_consensus.cc:515] T 623fb5b761134951a4b742ab2ba480a4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.420995 6454 ts_tablet_manager.cc:1434] T 86473c5cbca54b5792b038aef445998c P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.020s user 0.001s sys 0.001s
W20260923 19:50:10.421489 5799 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2f074ac09fe7412f9f20e26a98c63e5a has no consensus state
I20260923 19:50:10.422760 6454 tablet_bootstrap.cc:492] T 42e9cbcf77324d91abd029c12eaf950d P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:10.423077 6280 leader_election.cc:304] T f4e3e64fdf584743a3a88df5d6600b22 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:10.424798 7113 raft_consensus.cc:2804] T f4e3e64fdf584743a3a88df5d6600b22 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:10.424973 7113 raft_consensus.cc:493] T f4e3e64fdf584743a3a88df5d6600b22 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:10.420301 7119 tablet.cc:1751] T 6a34e178007b4e8ebed429cedf44e82a P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:10.425189 7113 raft_consensus.cc:3060] T f4e3e64fdf584743a3a88df5d6600b22 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:10.429854 7113 raft_consensus.cc:515] T f4e3e64fdf584743a3a88df5d6600b22 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:10.432582 6137 leader_election.cc:343] T 623fb5b761134951a4b742ab2ba480a4 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 623fb5b761134951a4b742ab2ba480a4
I20260923 19:50:10.434300 6920 leader_election.cc:290] T 623fb5b761134951a4b742ab2ba480a4 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:10.435062 7102 raft_consensus.cc:3060] T b4fc995819cc40bf9956d85966bcd330 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:10.436653 6454 tablet_bootstrap.cc:654] T 42e9cbcf77324d91abd029c12eaf950d P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:10.438720 6139 leader_election.cc:343] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 063fc0e77d294ddf8a02e9ab5968a5e3
I20260923 19:50:10.439508 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_76a8ffc5b25147c9af7758b6fe27a55d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:10.432669 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 391) took 2153 ms. Trace:
I20260923 19:50:10.440214 6458 rpcz_store.cc:276] 0923 19:50:08.278822 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.314626 (+ 35804us) service_pool.cc:224] Handling call
0923 19:50:10.316768 (+2002142us) ts_tablet_manager.cc:1151] Deleting tablet 4b15b250f594459eb959b4871f7ae398
0923 19:50:10.316782 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.388407 (+ 71625us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:10.401130 (+ 12723us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:10.432617 (+ 31487us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1982617}
W20260923 19:50:10.440452 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_76a8ffc5b25147c9af7758b6fe27a55d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:10.438856 6139 leader_election.cc:304] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:10.440965 6458 tablet_replica.cc:333] T 789c54477bec4636bb3669e1f62730e2 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:10.441175 6458 raft_consensus.cc:2243] T 789c54477bec4636bb3669e1f62730e2 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:10.441553 6458 raft_consensus.cc:2272] T 789c54477bec4636bb3669e1f62730e2 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:10.442430 6458 ts_tablet_manager.cc:1916] T 789c54477bec4636bb3669e1f62730e2 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:10.443027 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 4b15b250f594459eb959b4871f7ae398 (table default.Table_22f84157ac664f81ae5266143e743737 [id=4bf839f09513412ea20c5e0afece9c37]) successfully deleted
I20260923 19:50:10.445212 6459 ts_tablet_manager.cc:1916] T 4b15b250f594459eb959b4871f7ae398 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:10.445986 6139 leader_election.cc:343] T 623fb5b761134951a4b742ab2ba480a4 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 623fb5b761134951a4b742ab2ba480a4
I20260923 19:50:10.446168 6139 leader_election.cc:304] T 623fb5b761134951a4b742ab2ba480a4 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:10.446655 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_28e177d48f7949c4914feb2cf5143aeb" } new_table_name: "default.Table_bae34ce3ce95493d81bcd45d6806c756" modify_external_catalogs: true
I20260923 19:50:10.447227 6920 raft_consensus.cc:2749] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:10.452643 5804 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_295f07d1ca7345d5a18a80da04089ca2" } modify_external_catalogs: true
I20260923 19:50:10.452847 5804 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_295f07d1ca7345d5a18a80da04089ca2" } modify_external_catalogs: true
I20260923 19:50:10.457163 6920 raft_consensus.cc:2749] T 623fb5b761134951a4b742ab2ba480a4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:10.466024 6458 ts_tablet_manager.cc:1929] T 789c54477bec4636bb3669e1f62730e2 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:10.466269 6458 log.cc:1199] T 789c54477bec4636bb3669e1f62730e2 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/789c54477bec4636bb3669e1f62730e2
I20260923 19:50:10.468362 6458 ts_tablet_manager.cc:1950] T 789c54477bec4636bb3669e1f62730e2 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:10.468894 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_af3299e40526459183a95451e2320ae0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:10.469321 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 392) took 2190 ms. Trace:
W20260923 19:50:10.469506 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af3299e40526459183a95451e2320ae0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:10.476133 5802 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d39a64531dd24eb4aa1f7e0c418b985b consensus state has no leader
I20260923 19:50:10.469408 6458 rpcz_store.cc:276] 0923 19:50:08.278926 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.314841 (+ 35915us) service_pool.cc:224] Handling call
0923 19:50:10.440894 (+2126053us) ts_tablet_manager.cc:1151] Deleting tablet 789c54477bec4636bb3669e1f62730e2
0923 19:50:10.440905 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.445762 (+ 4857us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:10.448702 (+ 2940us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:10.469261 (+ 20559us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2106620}
I20260923 19:50:10.479127 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 789c54477bec4636bb3669e1f62730e2 (table default.Table_655007916e0446c2bd045bee42d2592f [id=a29ffe556086466eb3f8602902a72517]) successfully deleted
I20260923 19:50:10.479329 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_dad9b3f98a4745baac9606ed19421df1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:10.479506 6458 tablet_replica.cc:333] T 9101e82501fd461f8a4b2dcd9dffbd74 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:10.479700 6458 raft_consensus.cc:2243] T 9101e82501fd461f8a4b2dcd9dffbd74 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:10.479866 6458 pending_rounds.cc:70] T 9101e82501fd461f8a4b2dcd9dffbd74 P 2bf41435f70447f19992d368ca6b46bd: Trying to abort 1 pending ops.
W20260923 19:50:10.479887 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dad9b3f98a4745baac9606ed19421df1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:10.479923 6458 pending_rounds.cc:77] T 9101e82501fd461f8a4b2dcd9dffbd74 P 2bf41435f70447f19992d368ca6b46bd: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630563038527488 op_type: NO_OP noop_request { }
I20260923 19:50:10.480050 6458 raft_consensus.cc:2889] T 9101e82501fd461f8a4b2dcd9dffbd74 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:10.480161 6458 raft_consensus.cc:2272] T 9101e82501fd461f8a4b2dcd9dffbd74 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:10.482614 6458 ts_tablet_manager.cc:1916] T 9101e82501fd461f8a4b2dcd9dffbd74 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:10.492115 6279 leader_election.cc:343] T f4e3e64fdf584743a3a88df5d6600b22 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: f4e3e64fdf584743a3a88df5d6600b22
I20260923 19:50:10.493052 6456 tablet_bootstrap.cc:492] T 495292cacf3b42a5b633ad40e5e01972 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:10.493211 6456 ts_tablet_manager.cc:1403] T 495292cacf3b42a5b633ad40e5e01972 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.172s user 0.002s sys 0.002s
I20260923 19:50:10.494001 6456 raft_consensus.cc:359] T 495292cacf3b42a5b633ad40e5e01972 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.494210 6456 raft_consensus.cc:385] T 495292cacf3b42a5b633ad40e5e01972 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:10.494297 6456 raft_consensus.cc:740] T 495292cacf3b42a5b633ad40e5e01972 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:10.495581 6457 tablet_bootstrap.cc:492] T a08446fcf1794dab9d3181904507456f P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:10.495776 6457 ts_tablet_manager.cc:1403] T a08446fcf1794dab9d3181904507456f P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.187s user 0.058s sys 0.057s
I20260923 19:50:10.496680 6457 raft_consensus.cc:359] T a08446fcf1794dab9d3181904507456f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.496884 6457 raft_consensus.cc:385] T a08446fcf1794dab9d3181904507456f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:10.496970 6457 raft_consensus.cc:740] T a08446fcf1794dab9d3181904507456f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:10.497213 6457 consensus_queue.cc:260] T a08446fcf1794dab9d3181904507456f P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.501010 6457 ts_tablet_manager.cc:1434] T a08446fcf1794dab9d3181904507456f P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s
I20260923 19:50:10.501353 6457 tablet_bootstrap.cc:492] T 1c26a2863fdd4912b6d357877af1eb42 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
W20260923 19:50:10.501853 6280 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.5.143.253:45285, user_credentials={real_user=slave}} blocked reactor thread for 59699.3us
I20260923 19:50:10.504630 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4e3e64fdf584743a3a88df5d6600b22" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:10.505259 6458 ts_tablet_manager.cc:1929] T 9101e82501fd461f8a4b2dcd9dffbd74 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:10.505412 6458 log.cc:1199] T 9101e82501fd461f8a4b2dcd9dffbd74 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/9101e82501fd461f8a4b2dcd9dffbd74
I20260923 19:50:10.505822 6458 ts_tablet_manager.cc:1950] T 9101e82501fd461f8a4b2dcd9dffbd74 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:10.506428 6456 consensus_queue.cc:260] T 495292cacf3b42a5b633ad40e5e01972 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.506958 6456 ts_tablet_manager.cc:1434] T 495292cacf3b42a5b633ad40e5e01972 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260923 19:50:10.507269 6456 tablet_bootstrap.cc:492] T 337f32eb47954689a6eb8f74408e01d9 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:10.510421 6457 tablet_bootstrap.cc:654] T 1c26a2863fdd4912b6d357877af1eb42 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:10.511158 7113 leader_election.cc:290] T f4e3e64fdf584743a3a88df5d6600b22 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:10.511471 6202 raft_consensus.cc:3060] T f4e3e64fdf584743a3a88df5d6600b22 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
W20260923 19:50:10.505293 6139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.195:32855, user_credentials={real_user=slave}} blocked reactor thread for 64344.2us
I20260923 19:50:10.515930 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 390) took 2228 ms. Trace:
I20260923 19:50:10.516048 6458 rpcz_store.cc:276] 0923 19:50:08.278707 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.315264 (+ 36557us) service_pool.cc:224] Handling call
0923 19:50:10.479416 (+2164152us) ts_tablet_manager.cc:1151] Deleting tablet 9101e82501fd461f8a4b2dcd9dffbd74
0923 19:50:10.479428 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.495731 (+ 16303us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:10.505177 (+ 9446us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:10.506665 (+ 1488us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2145007}
I20260923 19:50:10.516903 6458 tablet_replica.cc:333] T b4fc995819cc40bf9956d85966bcd330 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:10.517102 6458 raft_consensus.cc:2243] T b4fc995819cc40bf9956d85966bcd330 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:10.517294 6458 raft_consensus.cc:2272] T b4fc995819cc40bf9956d85966bcd330 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:10.517338 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 9101e82501fd461f8a4b2dcd9dffbd74 (table default.Table_b5e4b2595161409da2fb9a56664da184 [id=3ab47a5709f64cdf87575911498c5760]) successfully deleted
I20260923 19:50:10.517794 7115 consensus_queue.cc:1048] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:10.519027 6202 raft_consensus.cc:2468] T f4e3e64fdf584743a3a88df5d6600b22 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:10.522432 6030 tablet_service.cc:1558] Processing DeleteTablet for tablet a08446fcf1794dab9d3181904507456f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:10.522857 6456 tablet_bootstrap.cc:654] T 337f32eb47954689a6eb8f74408e01d9 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:10.517858 6458 ts_tablet_manager.cc:1916] T b4fc995819cc40bf9956d85966bcd330 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:10.524233 6280 leader_election.cc:304] T f4e3e64fdf584743a3a88df5d6600b22 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:10.526813 7113 raft_consensus.cc:2804] T f4e3e64fdf584743a3a88df5d6600b22 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:10.527098 7113 raft_consensus.cc:697] T f4e3e64fdf584743a3a88df5d6600b22 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:10.527480 7113 consensus_queue.cc:237] T f4e3e64fdf584743a3a88df5d6600b22 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.529811 7102 raft_consensus.cc:2749] T b4fc995819cc40bf9956d85966bcd330 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:10.533185 6461 ts_tablet_manager.cc:1929] T f1a4bccf6dd2411f83b86d782ecf5f40 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:10.533354 6461 log.cc:1199] T f1a4bccf6dd2411f83b86d782ecf5f40 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/f1a4bccf6dd2411f83b86d782ecf5f40
I20260923 19:50:10.533751 6461 ts_tablet_manager.cc:1950] T f1a4bccf6dd2411f83b86d782ecf5f40 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:10.534799 6461 tablet_replica.cc:333] T cd02244c52ad4d2ab3915108a92a6f97 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:10.534989 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet f1a4bccf6dd2411f83b86d782ecf5f40 (table default.Table_fcbdddfc239041ae96611a78df2b3303 [id=24fd12b0465443c58bca97fcfea1f1d3]) successfully deleted
I20260923 19:50:10.535660 6454 tablet_bootstrap.cc:492] T 42e9cbcf77324d91abd029c12eaf950d P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:10.535853 6454 ts_tablet_manager.cc:1403] T 42e9cbcf77324d91abd029c12eaf950d P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.115s user 0.004s sys 0.004s
I20260923 19:50:10.536927 6454 raft_consensus.cc:359] T 42e9cbcf77324d91abd029c12eaf950d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.537143 6454 raft_consensus.cc:385] T 42e9cbcf77324d91abd029c12eaf950d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:10.537236 6454 raft_consensus.cc:740] T 42e9cbcf77324d91abd029c12eaf950d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:10.537473 6454 consensus_queue.cc:260] T 42e9cbcf77324d91abd029c12eaf950d P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.538170 6454 ts_tablet_manager.cc:1434] T 42e9cbcf77324d91abd029c12eaf950d P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260923 19:50:10.548960 5799 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_497399963ce44a7fa70b33a81e853df8" } modify_external_catalogs: true
I20260923 19:50:10.549103 6461 raft_consensus.cc:2243] T cd02244c52ad4d2ab3915108a92a6f97 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:10.549202 5799 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_497399963ce44a7fa70b33a81e853df8" } modify_external_catalogs: true
I20260923 19:50:10.551733 6461 raft_consensus.cc:2272] T cd02244c52ad4d2ab3915108a92a6f97 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:10.554675 6461 ts_tablet_manager.cc:1916] T cd02244c52ad4d2ab3915108a92a6f97 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:10.562166 6454 tablet_bootstrap.cc:492] T 495292cacf3b42a5b633ad40e5e01972 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:10.563946 6454 tablet_bootstrap.cc:654] T 495292cacf3b42a5b633ad40e5e01972 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:10.565843 5805 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_141fc144025e434aa7d7a6e0ecb9c98d" } modify_external_catalogs: true
I20260923 19:50:10.566097 5805 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_141fc144025e434aa7d7a6e0ecb9c98d" } modify_external_catalogs: true
I20260923 19:50:10.570390 6459 ts_tablet_manager.cc:1929] T 4b15b250f594459eb959b4871f7ae398 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:10.573058 6058 raft_consensus.cc:1275] T ec4284d6a0fa416ca95b4d675c8e3912 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Refusing update from remote peer 2bf41435f70447f19992d368ca6b46bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:50:10.573707 7115 consensus_queue.cc:1048] T ec4284d6a0fa416ca95b4d675c8e3912 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:10.574730 6456 tablet_bootstrap.cc:492] T 337f32eb47954689a6eb8f74408e01d9 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:10.574872 6456 ts_tablet_manager.cc:1403] T 337f32eb47954689a6eb8f74408e01d9 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.068s user 0.006s sys 0.004s
I20260923 19:50:10.577628 6456 raft_consensus.cc:359] T 337f32eb47954689a6eb8f74408e01d9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.577814 6456 raft_consensus.cc:385] T 337f32eb47954689a6eb8f74408e01d9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:10.577939 6456 raft_consensus.cc:740] T 337f32eb47954689a6eb8f74408e01d9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:10.578810 6457 tablet_bootstrap.cc:492] T 1c26a2863fdd4912b6d357877af1eb42 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:10.578751 6456 consensus_queue.cc:260] T 337f32eb47954689a6eb8f74408e01d9 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.578971 6457 ts_tablet_manager.cc:1403] T 1c26a2863fdd4912b6d357877af1eb42 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.078s user 0.009s sys 0.002s
I20260923 19:50:10.579319 6456 ts_tablet_manager.cc:1434] T 337f32eb47954689a6eb8f74408e01d9 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260923 19:50:10.579624 6456 tablet_bootstrap.cc:492] T 015c14b447fe4cd18d197b2d1ed5884e P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:10.580085 6457 raft_consensus.cc:359] T 1c26a2863fdd4912b6d357877af1eb42 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.580261 6457 raft_consensus.cc:385] T 1c26a2863fdd4912b6d357877af1eb42 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:10.581076 6457 raft_consensus.cc:740] T 1c26a2863fdd4912b6d357877af1eb42 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:10.581315 6457 consensus_queue.cc:260] T 1c26a2863fdd4912b6d357877af1eb42 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.582548 6457 ts_tablet_manager.cc:1434] T 1c26a2863fdd4912b6d357877af1eb42 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260923 19:50:10.582994 6457 tablet_bootstrap.cc:492] T 2db82e6f314f412385b41720c7efdef5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:10.586391 6457 tablet_bootstrap.cc:654] T 2db82e6f314f412385b41720c7efdef5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:10.587074 6280 consensus_peers.cc:597] T ec4284d6a0fa416ca95b4d675c8e3912 P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:10.588023 6456 tablet_bootstrap.cc:654] T 015c14b447fe4cd18d197b2d1ed5884e P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:10.592046 7101 tablet.cc:1751] T ec4284d6a0fa416ca95b4d675c8e3912 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:10.592839 7094 tablet.cc:1751] T ec4284d6a0fa416ca95b4d675c8e3912 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:10.594729 6461 ts_tablet_manager.cc:1929] T cd02244c52ad4d2ab3915108a92a6f97 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:10.594936 6461 log.cc:1199] T cd02244c52ad4d2ab3915108a92a6f97 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/cd02244c52ad4d2ab3915108a92a6f97
I20260923 19:50:10.595456 6461 ts_tablet_manager.cc:1950] T cd02244c52ad4d2ab3915108a92a6f97 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:10.596624 6461 tablet_replica.cc:333] T a08446fcf1794dab9d3181904507456f P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:10.596859 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet cd02244c52ad4d2ab3915108a92a6f97 (table default.Table_bc20a658edaf42818fb401723f10f95f [id=a36a23e5497a47e19f09ec8627152b1f]) successfully deleted
I20260923 19:50:10.596906 6461 raft_consensus.cc:2243] T a08446fcf1794dab9d3181904507456f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:10.597070 6461 raft_consensus.cc:2272] T a08446fcf1794dab9d3181904507456f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:10.607699 6308 tablet_service.cc:1558] Processing DeleteTablet for tablet 789c54477bec4636bb3669e1f62730e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:10.608248 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet f4e3e64fdf584743a3a88df5d6600b22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:10.609361 6459 log.cc:1199] T 4b15b250f594459eb959b4871f7ae398 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/4b15b250f594459eb959b4871f7ae398
I20260923 19:50:10.609354 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet ab73e8a1b6774ca0b43e5be67da68fab
I20260923 19:50:10.610385 6459 ts_tablet_manager.cc:1950] T 4b15b250f594459eb959b4871f7ae398 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:10.610496 5798 master_service.cc:960] ReplaceTablet: received request to replace tablet 7af330ae1aaa48209f2bd1880bcfebb1 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:10.609354 7094 tablet.cc:1751] T 556b32b8ccd54c439f86b0069e2a5ce0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:10.612336 6030 tablet_service.cc:1558] Processing DeleteTablet for tablet ab73e8a1b6774ca0b43e5be67da68fab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:10.612450 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet ab73e8a1b6774ca0b43e5be67da68fab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:10.614420 6458 ts_tablet_manager.cc:1929] T b4fc995819cc40bf9956d85966bcd330 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:10.614565 6458 log.cc:1199] T b4fc995819cc40bf9956d85966bcd330 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/b4fc995819cc40bf9956d85966bcd330
I20260923 19:50:10.614508 7101 tablet.cc:1751] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:10.614116 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet ab73e8a1b6774ca0b43e5be67da68fab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:10.616856 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 441) took 1884 ms. Trace:
I20260923 19:50:10.617362 6458 ts_tablet_manager.cc:1950] T b4fc995819cc40bf9956d85966bcd330 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:10.621322 6030 tablet_service.cc:1511] Processing CreateTablet for tablet 4a034eb9b02d4532b4b68e74c8e5b3fa (DEFAULT_TABLE table=default.Table_63a6947f3c8f4223b9f33e260bc77331 [id=89d7bede656f47bb86e54e502ffd1c33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.621735 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a034eb9b02d4532b4b68e74c8e5b3fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.619740 6456 tablet_bootstrap.cc:492] T 015c14b447fe4cd18d197b2d1ed5884e P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:10.624080 6456 ts_tablet_manager.cc:1403] T 015c14b447fe4cd18d197b2d1ed5884e P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.045s user 0.001s sys 0.006s
I20260923 19:50:10.624755 6457 tablet_bootstrap.cc:492] T 2db82e6f314f412385b41720c7efdef5 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:10.624919 6457 ts_tablet_manager.cc:1403] T 2db82e6f314f412385b41720c7efdef5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.042s user 0.003s sys 0.000s
I20260923 19:50:10.625078 6456 raft_consensus.cc:359] T 015c14b447fe4cd18d197b2d1ed5884e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.625319 6456 raft_consensus.cc:385] T 015c14b447fe4cd18d197b2d1ed5884e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:10.625656 6457 raft_consensus.cc:359] T 2db82e6f314f412385b41720c7efdef5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.625840 6457 raft_consensus.cc:385] T 2db82e6f314f412385b41720c7efdef5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:10.625962 6457 raft_consensus.cc:740] T 2db82e6f314f412385b41720c7efdef5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:10.625969 6456 raft_consensus.cc:740] T 015c14b447fe4cd18d197b2d1ed5884e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:10.626101 7071 raft_consensus.cc:493] T 0d70deeda179486291195476e47a9ae6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:10.626222 7071 raft_consensus.cc:515] T 0d70deeda179486291195476e47a9ae6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.626293 6457 consensus_queue.cc:260] T 2db82e6f314f412385b41720c7efdef5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.626331 6456 consensus_queue.cc:260] T 015c14b447fe4cd18d197b2d1ed5884e P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.626678 6461 ts_tablet_manager.cc:1916] T a08446fcf1794dab9d3181904507456f P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:10.626899 7071 leader_election.cc:290] T 0d70deeda179486291195476e47a9ae6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:10.628726 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d70deeda179486291195476e47a9ae6" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:10.630030 5996 leader_election.cc:343] T 0d70deeda179486291195476e47a9ae6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:10.631100 6456 ts_tablet_manager.cc:1434] T 015c14b447fe4cd18d197b2d1ed5884e P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260923 19:50:10.631678 6456 tablet_bootstrap.cc:492] T c48d4a8371fa4454b7c67291db3ab796 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:10.633502 6312 tablet_service.cc:1511] Processing CreateTablet for tablet 4a034eb9b02d4532b4b68e74c8e5b3fa (DEFAULT_TABLE table=default.Table_63a6947f3c8f4223b9f33e260bc77331 [id=89d7bede656f47bb86e54e502ffd1c33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.633961 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a034eb9b02d4532b4b68e74c8e5b3fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.635309 6456 tablet_bootstrap.cc:654] T c48d4a8371fa4454b7c67291db3ab796 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:10.636976 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 389) took 2358 ms. Trace:
I20260923 19:50:10.637096 6458 rpcz_store.cc:276] 0923 19:50:08.278563 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.315405 (+ 36842us) service_pool.cc:224] Handling call
0923 19:50:10.516806 (+2201401us) ts_tablet_manager.cc:1151] Deleting tablet b4fc995819cc40bf9956d85966bcd330
0923 19:50:10.516817 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.545789 (+ 28972us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:10.611131 (+ 65342us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:10.636938 (+ 25807us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2182273}
I20260923 19:50:10.637180 6030 tablet_service.cc:1511] Processing CreateTablet for tablet 349c0447464d4c5380cf15cb4aeb54a4 (DEFAULT_TABLE table=default.Table_ab5bcf93ffdc4e0f99d62c9d56cb1447 [id=af68de300f184a85bc90e1bcd3b5e69a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.637567 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 349c0447464d4c5380cf15cb4aeb54a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.638008 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet b4fc995819cc40bf9956d85966bcd330 (table default.Table_ee5fbb39c54a49c89eaaff48f72a9c3c [id=20b663f1b2504d4199c2a9a2e9667d5c]) successfully deleted
I20260923 19:50:10.620651 6174 tablet_service.cc:1511] Processing CreateTablet for tablet 4a034eb9b02d4532b4b68e74c8e5b3fa (DEFAULT_TABLE table=default.Table_63a6947f3c8f4223b9f33e260bc77331 [id=89d7bede656f47bb86e54e502ffd1c33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.638909 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a034eb9b02d4532b4b68e74c8e5b3fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.643040 6461 ts_tablet_manager.cc:1929] T a08446fcf1794dab9d3181904507456f P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:10.643231 6461 log.cc:1199] T a08446fcf1794dab9d3181904507456f P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/a08446fcf1794dab9d3181904507456f
I20260923 19:50:10.643319 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 6761b0568fbe4bb48eec6f800f6aaf74 (DEFAULT_TABLE table=default.Table_51c1dbd7bcc14d55a1c28d38938f0baf [id=5307575df4e344ed9aa6684eef40b249]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.643651 6461 ts_tablet_manager.cc:1950] T a08446fcf1794dab9d3181904507456f P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:10.643770 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6761b0568fbe4bb48eec6f800f6aaf74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.644704 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet a08446fcf1794dab9d3181904507456f (table default.Table_e1b933d20310499aab93b720704ea8d0 [id=c348e030b47641e7a407e9c2903215d6]) successfully deleted
I20260923 19:50:10.645035 6461 tablet_replica.cc:333] T ab73e8a1b6774ca0b43e5be67da68fab P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:10.645071 6179 tablet_service.cc:1511] Processing CreateTablet for tablet 1aed1eee3d914dcab3b837bf9e7a831d (DEFAULT_TABLE table=default.Table_1690d3f3d0e848f3bfd0fd61fa3670c4 [id=a9d80c0da2e241b392d5306228ecc7f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.645213 6461 raft_consensus.cc:2243] T ab73e8a1b6774ca0b43e5be67da68fab P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:10.645385 6461 raft_consensus.cc:2272] T ab73e8a1b6774ca0b43e5be67da68fab P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:10.645444 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aed1eee3d914dcab3b837bf9e7a831d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.630532 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d70deeda179486291195476e47a9ae6" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:10.646157 6022 tablet_service.cc:1511] Processing CreateTablet for tablet 6761b0568fbe4bb48eec6f800f6aaf74 (DEFAULT_TABLE table=default.Table_51c1dbd7bcc14d55a1c28d38938f0baf [id=5307575df4e344ed9aa6684eef40b249]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.646359 6459 rpcz_store.cc:276] 0923 19:50:08.732464 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.740454 (+ 7990us) service_pool.cc:224] Handling call
0923 19:50:10.342690 (+1602236us) ts_tablet_manager.cc:1151] Deleting tablet 4b15b250f594459eb959b4871f7ae398
0923 19:50:10.342701 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.510792 (+168091us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:10.570318 (+ 59526us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:10.616796 (+ 46478us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1539461}
I20260923 19:50:10.646548 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6761b0568fbe4bb48eec6f800f6aaf74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.646845 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 4b15b250f594459eb959b4871f7ae398 (table default.Table_22f84157ac664f81ae5266143e743737 [id=4bf839f09513412ea20c5e0afece9c37]) successfully deleted
I20260923 19:50:10.647229 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 445) took 1896 ms. Trace:
I20260923 19:50:10.647324 6459 rpcz_store.cc:276] 0923 19:50:08.750675 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.750727 (+ 52us) service_pool.cc:224] Handling call
0923 19:50:10.647058 (+1896331us) ts_tablet_manager.cc:1151] Deleting tablet a08446fcf1794dab9d3181904507456f
0923 19:50:10.647067 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.647175 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1843782}
W20260923 19:50:10.648214 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet a08446fcf1794dab9d3181904507456f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a08446fcf1794dab9d3181904507456f already in progress: creating tablet
I20260923 19:50:10.649279 6461 ts_tablet_manager.cc:1916] T ab73e8a1b6774ca0b43e5be67da68fab P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:10.634001 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 349c0447464d4c5380cf15cb4aeb54a4 (DEFAULT_TABLE table=default.Table_ab5bcf93ffdc4e0f99d62c9d56cb1447 [id=af68de300f184a85bc90e1bcd3b5e69a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.650836 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 349c0447464d4c5380cf15cb4aeb54a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.651432 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 449) took 1822 ms. Trace:
I20260923 19:50:10.651543 6459 rpcz_store.cc:276] 0923 19:50:08.829068 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.829117 (+ 49us) service_pool.cc:224] Handling call
0923 19:50:10.651210 (+1822093us) ts_tablet_manager.cc:1151] Deleting tablet b7ba284e81bc4388bbd6456a41d1f9f4
0923 19:50:10.651219 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.651305 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1821760}
W20260923 19:50:10.651978 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet b7ba284e81bc4388bbd6456a41d1f9f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b7ba284e81bc4388bbd6456a41d1f9f4 already in progress: creating tablet
I20260923 19:50:10.652320 6459 tablet_replica.cc:333] T d91a56bace854494b7affd6c766b2847 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:10.652568 6459 raft_consensus.cc:2243] T d91a56bace854494b7affd6c766b2847 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:10.652810 6459 raft_consensus.cc:2272] T d91a56bace854494b7affd6c766b2847 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:10.653405 6459 ts_tablet_manager.cc:1916] T d91a56bace854494b7affd6c766b2847 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:10.654590 5995 leader_election.cc:343] T 0d70deeda179486291195476e47a9ae6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:10.654752 5995 leader_election.cc:304] T 0d70deeda179486291195476e47a9ae6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:10.655144 7071 raft_consensus.cc:2749] T 0d70deeda179486291195476e47a9ae6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:10.661126 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_5d9ccbcf620b4f5fa715523f21426d97"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:10.661829 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d9ccbcf620b4f5fa715523f21426d97 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:10.663575 7071 raft_consensus.cc:493] T 2db82e6f314f412385b41720c7efdef5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:10.663753 7071 raft_consensus.cc:515] T 2db82e6f314f412385b41720c7efdef5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.654105 7113 raft_consensus.cc:493] T 495292cacf3b42a5b633ad40e5e01972 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:10.643026 6312 tablet_service.cc:1511] Processing CreateTablet for tablet 349c0447464d4c5380cf15cb4aeb54a4 (DEFAULT_TABLE table=default.Table_ab5bcf93ffdc4e0f99d62c9d56cb1447 [id=af68de300f184a85bc90e1bcd3b5e69a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.664016 7113 raft_consensus.cc:515] T 495292cacf3b42a5b633ad40e5e01972 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.664222 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 349c0447464d4c5380cf15cb4aeb54a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.664444 7071 leader_election.cc:290] T 2db82e6f314f412385b41720c7efdef5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:10.664721 7113 leader_election.cc:290] T 495292cacf3b42a5b633ad40e5e01972 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:10.665650 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db82e6f314f412385b41720c7efdef5" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:10.651113 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 415) took 1901 ms. Trace:
I20260923 19:50:10.654414 6308 tablet_service.cc:1511] Processing CreateTablet for tablet 6761b0568fbe4bb48eec6f800f6aaf74 (DEFAULT_TABLE table=default.Table_51c1dbd7bcc14d55a1c28d38938f0baf [id=5307575df4e344ed9aa6684eef40b249]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.665940 6458 rpcz_store.cc:276] 0923 19:50:08.749676 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.749742 (+ 66us) service_pool.cc:224] Handling call
0923 19:50:10.650954 (+1901212us) ts_tablet_manager.cc:1151] Deleting tablet ce6b86f947ce420994eaa5ff39ad9c87
0923 19:50:10.650965 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.651077 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1900049}
I20260923 19:50:10.666186 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6761b0568fbe4bb48eec6f800f6aaf74. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:10.666479 5996 leader_election.cc:343] T 2db82e6f314f412385b41720c7efdef5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:10.666752 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495292cacf3b42a5b633ad40e5e01972" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:10.666965 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet ce6b86f947ce420994eaa5ff39ad9c87 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce6b86f947ce420994eaa5ff39ad9c87 already in progress: creating tablet
I20260923 19:50:10.658650 6456 tablet_bootstrap.cc:492] T c48d4a8371fa4454b7c67291db3ab796 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:10.667307 6456 ts_tablet_manager.cc:1403] T c48d4a8371fa4454b7c67291db3ab796 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.036s user 0.000s sys 0.004s
I20260923 19:50:10.668303 6461 ts_tablet_manager.cc:1929] T ab73e8a1b6774ca0b43e5be67da68fab P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:10.668249 6456 raft_consensus.cc:359] T c48d4a8371fa4454b7c67291db3ab796 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.668406 6461 log.cc:1199] T ab73e8a1b6774ca0b43e5be67da68fab P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/ab73e8a1b6774ca0b43e5be67da68fab
I20260923 19:50:10.668467 6456 raft_consensus.cc:385] T c48d4a8371fa4454b7c67291db3ab796 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:10.668581 6456 raft_consensus.cc:740] T c48d4a8371fa4454b7c67291db3ab796 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:10.668872 6461 ts_tablet_manager.cc:1950] T ab73e8a1b6774ca0b43e5be67da68fab P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:10.668807 6456 consensus_queue.cc:260] T c48d4a8371fa4454b7c67291db3ab796 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:10.667307 6280 leader_election.cc:343] T 495292cacf3b42a5b633ad40e5e01972 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:10.669166 6458 tablet_replica.cc:333] T 42e9cbcf77324d91abd029c12eaf950d P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:10.669370 6458 raft_consensus.cc:2243] T 42e9cbcf77324d91abd029c12eaf950d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:10.669852 6457 ts_tablet_manager.cc:1434] T 2db82e6f314f412385b41720c7efdef5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.045s user 0.003s sys 0.000s
I20260923 19:50:10.671208 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet ab73e8a1b6774ca0b43e5be67da68fab (table default.Table_c716115e5d0045b691616d451daec14d [id=bb00103e5a52400b9e7fb4db39f27bd7]) successfully deleted
W20260923 19:50:10.671540 6279 leader_election.cc:343] T 495292cacf3b42a5b633ad40e5e01972 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 495292cacf3b42a5b633ad40e5e01972
I20260923 19:50:10.671622 6457 tablet_bootstrap.cc:492] T 2ccfe6531fc44f86a0edc8bda1547442 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:10.671658 6279 leader_election.cc:304] T 495292cacf3b42a5b633ad40e5e01972 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:10.672153 7113 raft_consensus.cc:2749] T 495292cacf3b42a5b633ad40e5e01972 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:10.672420 6458 raft_consensus.cc:2272] T 42e9cbcf77324d91abd029c12eaf950d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:10.672899 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db82e6f314f412385b41720c7efdef5" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:10.673010 6458 ts_tablet_manager.cc:1916] T 42e9cbcf77324d91abd029c12eaf950d P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:10.673619 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_bfda8ee8ad2148e7b534d1e778b74427"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:10.673797 6457 tablet_bootstrap.cc:654] T 2ccfe6531fc44f86a0edc8bda1547442 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:10.674374 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bfda8ee8ad2148e7b534d1e778b74427 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:10.674659 5995 leader_election.cc:343] T 2db82e6f314f412385b41720c7efdef5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:10.674809 5995 leader_election.cc:304] T 2db82e6f314f412385b41720c7efdef5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:10.675838 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_492aa1a4a9644f948b5bf137f57fac3d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:10.676101 6456 ts_tablet_manager.cc:1434] T c48d4a8371fa4454b7c67291db3ab796 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
W20260923 19:50:10.676338 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_492aa1a4a9644f948b5bf137f57fac3d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:10.676474 7134 raft_consensus.cc:2749] T 2db82e6f314f412385b41720c7efdef5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:10.678200 6456 tablet_bootstrap.cc:492] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:10.681464 6456 tablet_bootstrap.cc:654] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:10.686764 6454 tablet_bootstrap.cc:492] T 495292cacf3b42a5b633ad40e5e01972 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:10.687041 6454 ts_tablet_manager.cc:1403] T 495292cacf3b42a5b633ad40e5e01972 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.125s user 0.002s sys 0.001s
I20260923 19:50:10.687855 6454 raft_consensus.cc:359] T 495292cacf3b42a5b633ad40e5e01972 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.688088 6458 ts_tablet_manager.cc:1929] T 42e9cbcf77324d91abd029c12eaf950d P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:10.688241 6458 log.cc:1199] T 42e9cbcf77324d91abd029c12eaf950d P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/42e9cbcf77324d91abd029c12eaf950d
I20260923 19:50:10.688596 6458 ts_tablet_manager.cc:1950] T 42e9cbcf77324d91abd029c12eaf950d P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:10.689330 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 413) took 1954 ms. Trace:
I20260923 19:50:10.689440 6458 rpcz_store.cc:276] 0923 19:50:08.735309 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.735365 (+ 56us) service_pool.cc:224] Handling call
0923 19:50:10.666236 (+1930871us) ts_tablet_manager.cc:1151] Deleting tablet 42e9cbcf77324d91abd029c12eaf950d
0923 19:50:10.666245 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.680838 (+ 14593us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:10.688021 (+ 7183us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:10.689276 (+ 1255us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2881,"tablet-delete.queue_time_us":1914896}
I20260923 19:50:10.689936 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 42e9cbcf77324d91abd029c12eaf950d (table default.Table_c49ba0c0c07142b6aefaab8632719193 [id=a2b5a27b4b93406b9bd6fd2248562a78]) successfully deleted
I20260923 19:50:10.689901 6022 tablet_service.cc:1511] Processing CreateTablet for tablet 1aed1eee3d914dcab3b837bf9e7a831d (DEFAULT_TABLE table=default.Table_1690d3f3d0e848f3bfd0fd61fa3670c4 [id=a9d80c0da2e241b392d5306228ecc7f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.691229 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aed1eee3d914dcab3b837bf9e7a831d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.695288 6454 raft_consensus.cc:385] T 495292cacf3b42a5b633ad40e5e01972 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:10.695400 6454 raft_consensus.cc:740] T 495292cacf3b42a5b633ad40e5e01972 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:10.695695 6454 consensus_queue.cc:260] T 495292cacf3b42a5b633ad40e5e01972 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.696245 6454 ts_tablet_manager.cc:1434] T 495292cacf3b42a5b633ad40e5e01972 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.009s user 0.000s sys 0.000s
I20260923 19:50:10.692207 6459 ts_tablet_manager.cc:1929] T d91a56bace854494b7affd6c766b2847 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:50:10.698596 6459 log.cc:1199] T d91a56bace854494b7affd6c766b2847 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/d91a56bace854494b7affd6c766b2847
I20260923 19:50:10.699101 6312 tablet_service.cc:1511] Processing CreateTablet for tablet 1aed1eee3d914dcab3b837bf9e7a831d (DEFAULT_TABLE table=default.Table_1690d3f3d0e848f3bfd0fd61fa3670c4 [id=a9d80c0da2e241b392d5306228ecc7f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.699563 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aed1eee3d914dcab3b837bf9e7a831d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.699232 6459 ts_tablet_manager.cc:1950] T d91a56bace854494b7affd6c766b2847 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:10.700182 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 417) took 1936 ms. Trace:
I20260923 19:50:10.701102 6456 tablet_bootstrap.cc:492] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:10.701359 6456 ts_tablet_manager.cc:1403] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.004s
I20260923 19:50:10.702206 5801 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 431ad4da27544d68aa5666293984a86a
I20260923 19:50:10.702718 5801 catalog_manager.cc:6934] ReplaceTablet: tablet 431ad4da27544d68aa5666293984a86a deleted and replaced by tablet 68459111552949aab20982dd7c28f7d3
I20260923 19:50:10.702728 6456 raft_consensus.cc:359] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.702903 6456 raft_consensus.cc:385] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:10.702957 6456 raft_consensus.cc:740] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:10.703218 6022 tablet_service.cc:1558] Processing DeleteTablet for tablet 431ad4da27544d68aa5666293984a86a with delete_type TABLET_DATA_DELETED (replaced by tablet 68459111552949aab20982dd7c28f7d3) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:10.703179 6456 consensus_queue.cc:260] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:10.703896 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 431ad4da27544d68aa5666293984a86a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 431ad4da27544d68aa5666293984a86a already in progress: creating tablet
I20260923 19:50:10.705358 6456 ts_tablet_manager.cc:1434] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260923 19:50:10.705924 6456 tablet_bootstrap.cc:492] T 6fe14389e2a3487587dfcf7a8b4b242d P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:10.707476 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet 431ad4da27544d68aa5666293984a86a with delete_type TABLET_DATA_DELETED (replaced by tablet 68459111552949aab20982dd7c28f7d3) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:10.707604 6456 tablet_bootstrap.cc:654] T 6fe14389e2a3487587dfcf7a8b4b242d P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:10.708390 6458 rpcz_store.cc:276] 0923 19:50:08.763763 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.763878 (+ 115us) service_pool.cc:224] Handling call
0923 19:50:10.700020 (+1936142us) ts_tablet_manager.cc:1151] Deleting tablet a08446fcf1794dab9d3181904507456f
0923 19:50:10.700028 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.700129 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1924007}
W20260923 19:50:10.708882 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet a08446fcf1794dab9d3181904507456f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a08446fcf1794dab9d3181904507456f already in progress: creating tablet
I20260923 19:50:10.709257 6308 tablet_service.cc:1558] Processing DeleteTablet for tablet 431ad4da27544d68aa5666293984a86a with delete_type TABLET_DATA_DELETED (replaced by tablet 68459111552949aab20982dd7c28f7d3) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:10.710660 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 900726a4f2f84dde90e8bb3ab26b71c9 (DEFAULT_TABLE table=default.Table_349043a7dfa34b3fa1ca4a2eb51ac77c [id=6ecf0fc802d2487bbfc8876815b3bf2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.711138 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 418) took 1936 ms. Trace:
I20260923 19:50:10.711232 6458 rpcz_store.cc:276] 0923 19:50:08.774648 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.776071 (+ 1423us) service_pool.cc:224] Handling call
0923 19:50:10.710980 (+1934909us) ts_tablet_manager.cc:1151] Deleting tablet 658253ff3d014361803e1aeda978e59a
0923 19:50:10.710989 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.711092 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1934685}
W20260923 19:50:10.711671 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 658253ff3d014361803e1aeda978e59a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 658253ff3d014361803e1aeda978e59a already in progress: creating tablet
I20260923 19:50:10.712100 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 416) took 1949 ms. Trace:
I20260923 19:50:10.712674 6458 rpcz_store.cc:276] 0923 19:50:08.763202 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.763307 (+ 105us) service_pool.cc:224] Handling call
0923 19:50:10.711969 (+1948662us) ts_tablet_manager.cc:1151] Deleting tablet fe5d081a41a3417b855656ca6e24f235
0923 19:50:10.711977 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.712054 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1919033}
W20260923 19:50:10.713512 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet fe5d081a41a3417b855656ca6e24f235 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe5d081a41a3417b855656ca6e24f235 already in progress: creating tablet
I20260923 19:50:10.713896 6458 tablet_replica.cc:333] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:10.714124 6458 raft_consensus.cc:2243] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:10.714537 6458 raft_consensus.cc:2272] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:10.715140 6458 ts_tablet_manager.cc:1916] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:10.717726 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet 86473c5cbca54b5792b038aef445998c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:10.718284 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet 42e9cbcf77324d91abd029c12eaf950d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:10.722923 6456 tablet_bootstrap.cc:492] T 6fe14389e2a3487587dfcf7a8b4b242d P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:10.723079 6456 ts_tablet_manager.cc:1403] T 6fe14389e2a3487587dfcf7a8b4b242d P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.003s
I20260923 19:50:10.723784 6456 raft_consensus.cc:359] T 6fe14389e2a3487587dfcf7a8b4b242d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.723958 6456 raft_consensus.cc:385] T 6fe14389e2a3487587dfcf7a8b4b242d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:10.724040 6456 raft_consensus.cc:740] T 6fe14389e2a3487587dfcf7a8b4b242d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:10.724287 6456 consensus_queue.cc:260] T 6fe14389e2a3487587dfcf7a8b4b242d P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.726548 6456 ts_tablet_manager.cc:1434] T 6fe14389e2a3487587dfcf7a8b4b242d P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260923 19:50:10.727063 6456 tablet_bootstrap.cc:492] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:10.728780 6456 tablet_bootstrap.cc:654] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:10.735458 5700 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 164561us
I20260923 19:50:10.739923 6458 ts_tablet_manager.cc:1929] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:50:10.740057 6458 log.cc:1199] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/d91a56bace854494b7affd6c766b2847
I20260923 19:50:10.740455 6458 ts_tablet_manager.cc:1950] T d91a56bace854494b7affd6c766b2847 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:10.741217 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 422) took 1901 ms. Trace:
I20260923 19:50:10.741335 6458 rpcz_store.cc:276] 0923 19:50:08.839523 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.839860 (+ 337us) service_pool.cc:224] Handling call
0923 19:50:10.713790 (+1873930us) ts_tablet_manager.cc:1151] Deleting tablet d91a56bace854494b7affd6c766b2847
0923 19:50:10.713799 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.731275 (+ 17476us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:10.739839 (+ 8564us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:10.741182 (+ 1343us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1869371}
I20260923 19:50:10.742992 6022 tablet_service.cc:1511] Processing CreateTablet for tablet 900726a4f2f84dde90e8bb3ab26b71c9 (DEFAULT_TABLE table=default.Table_349043a7dfa34b3fa1ca4a2eb51ac77c [id=6ecf0fc802d2487bbfc8876815b3bf2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.743901 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 900726a4f2f84dde90e8bb3ab26b71c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.744042 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 4935c06f29cf4c729946f35829dfdf92 (DEFAULT_TABLE table=default.Table_2450b2fff14d4d4ebd74a9ebf00fd118 [id=0a696ff8894c4fc88b108914f3ebb326]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.746454 6031 tablet_service.cc:1511] Processing CreateTablet for tablet 4935c06f29cf4c729946f35829dfdf92 (DEFAULT_TABLE table=default.Table_2450b2fff14d4d4ebd74a9ebf00fd118 [id=0a696ff8894c4fc88b108914f3ebb326]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.746847 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4935c06f29cf4c729946f35829dfdf92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.747517 6179 tablet_service.cc:1511] Processing CreateTablet for tablet ec5793bdec5244aa8cf13b7fb3b84b8a (DEFAULT_TABLE table=default.Table_08e8b19223d8498983c3571f2e650e8c [id=e6aae39a1ff94da7bc727bbe5fb174ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.743470 6456 tablet_bootstrap.cc:492] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:10.749434 6174 tablet_service.cc:1511] Processing CreateTablet for tablet 6c33a99f88a9401fa296c4fefb8bcfc1 (DEFAULT_TABLE table=default.Table_0e8b64b05f104a458762900a86b66629 [id=d739d5b9249a4d9c91b883f4a81da8af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.749614 6456 ts_tablet_manager.cc:1403] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.023s user 0.001s sys 0.002s
I20260923 19:50:10.750177 6029 tablet_service.cc:1511] Processing CreateTablet for tablet ec5793bdec5244aa8cf13b7fb3b84b8a (DEFAULT_TABLE table=default.Table_08e8b19223d8498983c3571f2e650e8c [id=e6aae39a1ff94da7bc727bbe5fb174ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.750526 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 6c33a99f88a9401fa296c4fefb8bcfc1 (DEFAULT_TABLE table=default.Table_0e8b64b05f104a458762900a86b66629 [id=d739d5b9249a4d9c91b883f4a81da8af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.750535 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec5793bdec5244aa8cf13b7fb3b84b8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.752242 6164 tablet_service.cc:1511] Processing CreateTablet for tablet 39261cedbdb54d1f8ae0e07ae1cfeb3e (DEFAULT_TABLE table=default.Table_e4788af31ab94b6eae62e66d4f0e8c93 [id=e0ab7e7d051d48c0b86da6509cb659d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.753386 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 6c33a99f88a9401fa296c4fefb8bcfc1 (DEFAULT_TABLE table=default.Table_0e8b64b05f104a458762900a86b66629 [id=d739d5b9249a4d9c91b883f4a81da8af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.753793 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c33a99f88a9401fa296c4fefb8bcfc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.755214 6323 tablet_service.cc:1511] Processing CreateTablet for tablet ec5793bdec5244aa8cf13b7fb3b84b8a (DEFAULT_TABLE table=default.Table_08e8b19223d8498983c3571f2e650e8c [id=e6aae39a1ff94da7bc727bbe5fb174ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.755551 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec5793bdec5244aa8cf13b7fb3b84b8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.758610 6324 tablet_service.cc:1511] Processing CreateTablet for tablet 4935c06f29cf4c729946f35829dfdf92 (DEFAULT_TABLE table=default.Table_2450b2fff14d4d4ebd74a9ebf00fd118 [id=0a696ff8894c4fc88b108914f3ebb326]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.759006 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4935c06f29cf4c729946f35829dfdf92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.759130 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 900726a4f2f84dde90e8bb3ab26b71c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.761291 7113 raft_consensus.cc:493] T 6fe14389e2a3487587dfcf7a8b4b242d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:10.761443 7113 raft_consensus.cc:515] T 6fe14389e2a3487587dfcf7a8b4b242d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.762085 7113 leader_election.cc:290] T 6fe14389e2a3487587dfcf7a8b4b242d P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:10.762548 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 448) took 1933 ms. Trace:
I20260923 19:50:10.762672 6459 rpcz_store.cc:276] 0923 19:50:08.828920 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.832130 (+ 3210us) service_pool.cc:224] Handling call
0923 19:50:10.652214 (+1820084us) ts_tablet_manager.cc:1151] Deleting tablet d91a56bace854494b7affd6c766b2847
0923 19:50:10.652225 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.665574 (+ 13349us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:10.692099 (+ 26525us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:10.762486 (+ 70387us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1819770}
I20260923 19:50:10.762878 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fe14389e2a3487587dfcf7a8b4b242d" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:10.763118 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 450) took 1893 ms. Trace:
I20260923 19:50:10.763237 6459 rpcz_store.cc:276] 0923 19:50:08.869939 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.869991 (+ 52us) service_pool.cc:224] Handling call
0923 19:50:10.762983 (+1892992us) ts_tablet_manager.cc:1151] Deleting tablet 30fe07956e8940fcb7ba1e2e16ced463
0923 19:50:10.762991 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.763081 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1890904}
W20260923 19:50:10.763468 6280 leader_election.cc:343] T 6fe14389e2a3487587dfcf7a8b4b242d P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:10.763634 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 452) took 1861 ms. Trace:
I20260923 19:50:10.763742 6459 rpcz_store.cc:276] 0923 19:50:08.902595 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.918707 (+ 16112us) service_pool.cc:224] Handling call
0923 19:50:10.763446 (+1844739us) ts_tablet_manager.cc:1151] Deleting tablet 337f32eb47954689a6eb8f74408e01d9
0923 19:50:10.763456 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.763591 (+ 135us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1844249}
I20260923 19:50:10.764011 6459 tablet_replica.cc:333] T 5c0142f4e3ad42048803481d68f0ee5d P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:10.764248 6459 raft_consensus.cc:2243] T 5c0142f4e3ad42048803481d68f0ee5d P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:10.764413 6459 pending_rounds.cc:70] T 5c0142f4e3ad42048803481d68f0ee5d P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
W20260923 19:50:10.764391 6279 leader_election.cc:343] T 6fe14389e2a3487587dfcf7a8b4b242d P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 6fe14389e2a3487587dfcf7a8b4b242d
I20260923 19:50:10.764492 6459 pending_rounds.cc:77] T 5c0142f4e3ad42048803481d68f0ee5d P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630557255770112 op_type: NO_OP noop_request { }
I20260923 19:50:10.764508 6279 leader_election.cc:304] T 6fe14389e2a3487587dfcf7a8b4b242d P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:10.764616 6459 raft_consensus.cc:2889] T 5c0142f4e3ad42048803481d68f0ee5d P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:10.764729 6459 raft_consensus.cc:2272] T 5c0142f4e3ad42048803481d68f0ee5d P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:10.764918 7113 raft_consensus.cc:2749] T 6fe14389e2a3487587dfcf7a8b4b242d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:10.765286 6459 ts_tablet_manager.cc:1916] T 5c0142f4e3ad42048803481d68f0ee5d P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:10.765843 5790 consensus_peers.cc:597] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b -> Peer 6b3d628214a34b4fa3ca0c1abe422bae (127.5.143.254:37151): Couldn't send request to peer 6b3d628214a34b4fa3ca0c1abe422bae. Status: Network error: Client connection negotiation failed: client connection to 127.5.143.254:37151: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260923 19:50:10.766040 6308 tablet_service.cc:1511] Processing CreateTablet for tablet 900726a4f2f84dde90e8bb3ab26b71c9 (DEFAULT_TABLE table=default.Table_349043a7dfa34b3fa1ca4a2eb51ac77c [id=6ecf0fc802d2487bbfc8876815b3bf2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.766537 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 900726a4f2f84dde90e8bb3ab26b71c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.766659 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c33a99f88a9401fa296c4fefb8bcfc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.766315 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39261cedbdb54d1f8ae0e07ae1cfeb3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.770198 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4935c06f29cf4c729946f35829dfdf92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.770394 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c33a99f88a9401fa296c4fefb8bcfc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.776319 7113 raft_consensus.cc:493] T 337f32eb47954689a6eb8f74408e01d9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:10.776516 7113 raft_consensus.cc:515] T 337f32eb47954689a6eb8f74408e01d9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.777144 7113 leader_election.cc:290] T 337f32eb47954689a6eb8f74408e01d9 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:10.777544 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec5793bdec5244aa8cf13b7fb3b84b8a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:10.778563 6279 leader_election.cc:343] T 337f32eb47954689a6eb8f74408e01d9 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 337f32eb47954689a6eb8f74408e01d9
I20260923 19:50:10.778784 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet d91a56bace854494b7affd6c766b2847 (table default.Table_b3579cbf488c4d1eb5f605ab4e11c340 [id=a6dbcc9c44fb400b926e21aa6d683186]) successfully deleted
W20260923 19:50:10.779036 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 30fe07956e8940fcb7ba1e2e16ced463 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30fe07956e8940fcb7ba1e2e16ced463 already in progress: creating tablet
I20260923 19:50:10.779035 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "337f32eb47954689a6eb8f74408e01d9" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:10.779275 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 337f32eb47954689a6eb8f74408e01d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 337f32eb47954689a6eb8f74408e01d9 already in progress: creating tablet
W20260923 19:50:10.779538 6280 leader_election.cc:343] T 337f32eb47954689a6eb8f74408e01d9 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:10.779685 6280 leader_election.cc:304] T 337f32eb47954689a6eb8f74408e01d9 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:10.780117 7113 raft_consensus.cc:2749] T 337f32eb47954689a6eb8f74408e01d9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:10.782487 6454 tablet_bootstrap.cc:492] T 5427b0f0218d4131b68a39e8e3bf02e7 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:10.785851 6454 tablet_bootstrap.cc:654] T 5427b0f0218d4131b68a39e8e3bf02e7 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:10.786051 7102 raft_consensus.cc:493] T 42e9cbcf77324d91abd029c12eaf950d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:10.786262 7102 raft_consensus.cc:515] T 42e9cbcf77324d91abd029c12eaf950d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.786891 7102 leader_election.cc:290] T 42e9cbcf77324d91abd029c12eaf950d P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:10.788589 6137 leader_election.cc:343] T 42e9cbcf77324d91abd029c12eaf950d P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 42e9cbcf77324d91abd029c12eaf950d
W20260923 19:50:10.788748 6139 leader_election.cc:343] T 42e9cbcf77324d91abd029c12eaf950d P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 42e9cbcf77324d91abd029c12eaf950d
I20260923 19:50:10.788873 6139 leader_election.cc:304] T 42e9cbcf77324d91abd029c12eaf950d P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:10.789256 7102 raft_consensus.cc:2749] T 42e9cbcf77324d91abd029c12eaf950d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:10.791519 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 528fca12bfe04747830ad1d3bb323676
I20260923 19:50:10.793188 6308 tablet_service.cc:1558] Processing DeleteTablet for tablet 528fca12bfe04747830ad1d3bb323676 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:10.796797 6022 tablet_service.cc:1558] Processing DeleteTablet for tablet 528fca12bfe04747830ad1d3bb323676 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:10.797821 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 528fca12bfe04747830ad1d3bb323676 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 528fca12bfe04747830ad1d3bb323676 already in progress: creating tablet
I20260923 19:50:10.800390 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_416d1e6300c44657bdc13cbaa5cb5af0" } new_table_name: "default.Table_4d127601ed3742d99d70e54ea6381603" modify_external_catalogs: true
I20260923 19:50:10.802305 7113 raft_consensus.cc:493] T c48d4a8371fa4454b7c67291db3ab796 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:10.802479 7113 raft_consensus.cc:515] T c48d4a8371fa4454b7c67291db3ab796 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.803145 7113 leader_election.cc:290] T c48d4a8371fa4454b7c67291db3ab796 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:10.803694 6178 tablet_service.cc:1558] Processing DeleteTablet for tablet 495292cacf3b42a5b633ad40e5e01972 with delete_type TABLET_DATA_DELETED (replaced by tablet 6a2564a99c274e07a7e43da739a2458b) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:10.804232 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48d4a8371fa4454b7c67291db3ab796" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:10.805250 6280 leader_election.cc:343] T c48d4a8371fa4454b7c67291db3ab796 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:10.805665 6279 leader_election.cc:343] T c48d4a8371fa4454b7c67291db3ab796 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: c48d4a8371fa4454b7c67291db3ab796
I20260923 19:50:10.805809 6279 leader_election.cc:304] T c48d4a8371fa4454b7c67291db3ab796 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:10.806228 7113 raft_consensus.cc:2749] T c48d4a8371fa4454b7c67291db3ab796 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:10.809820 5799 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 7804d14acf5d491b9f637716f0046877
I20260923 19:50:10.811323 7113 raft_consensus.cc:493] T 015c14b447fe4cd18d197b2d1ed5884e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:10.811488 7113 raft_consensus.cc:515] T 015c14b447fe4cd18d197b2d1ed5884e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.812152 7113 leader_election.cc:290] T 015c14b447fe4cd18d197b2d1ed5884e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:10.813022 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015c14b447fe4cd18d197b2d1ed5884e" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:10.813104 6456 raft_consensus.cc:359] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.813719 6456 raft_consensus.cc:385] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:10.813807 6456 raft_consensus.cc:740] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
W20260923 19:50:10.814206 6280 leader_election.cc:343] T 015c14b447fe4cd18d197b2d1ed5884e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:10.814112 6456 consensus_queue.cc:260] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:10.815019 6279 leader_election.cc:343] T 015c14b447fe4cd18d197b2d1ed5884e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 015c14b447fe4cd18d197b2d1ed5884e
I20260923 19:50:10.815163 6279 leader_election.cc:304] T 015c14b447fe4cd18d197b2d1ed5884e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:10.815470 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet 7804d14acf5d491b9f637716f0046877 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:10.815585 7113 raft_consensus.cc:2749] T 015c14b447fe4cd18d197b2d1ed5884e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:10.815927 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet 7804d14acf5d491b9f637716f0046877 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:10.816576 6456 ts_tablet_manager.cc:1434] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.067s user 0.002s sys 0.001s
I20260923 19:50:10.816882 6456 tablet_bootstrap.cc:492] T 2f627b7b9ff74750bd8dd59840bf77db P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:10.817646 6457 tablet_bootstrap.cc:492] T 2ccfe6531fc44f86a0edc8bda1547442 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:10.817785 6457 ts_tablet_manager.cc:1403] T 2ccfe6531fc44f86a0edc8bda1547442 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.146s user 0.014s sys 0.005s
I20260923 19:50:10.818279 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet 7804d14acf5d491b9f637716f0046877 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:10.818562 5790 catalog_manager.cc:5030] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 7804d14acf5d491b9f637716f0046877 because the tablet was not found. No further retry: Not found: Tablet not found: 7804d14acf5d491b9f637716f0046877
I20260923 19:50:10.818887 5799 master_service.cc:960] ReplaceTablet: received request to replace tablet 1b1d9413e1e24547b491a160d851377b from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:10.818862 6457 raft_consensus.cc:359] T 2ccfe6531fc44f86a0edc8bda1547442 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.819377 6457 raft_consensus.cc:385] T 2ccfe6531fc44f86a0edc8bda1547442 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:10.819496 6457 raft_consensus.cc:740] T 2ccfe6531fc44f86a0edc8bda1547442 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:10.819530 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet 528fca12bfe04747830ad1d3bb323676 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:10.819713 6457 consensus_queue.cc:260] T 2ccfe6531fc44f86a0edc8bda1547442 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.820351 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet d91a56bace854494b7affd6c766b2847 (table default.Table_b3579cbf488c4d1eb5f605ab4e11c340 [id=a6dbcc9c44fb400b926e21aa6d683186]) successfully deleted
I20260923 19:50:10.821350 6457 ts_tablet_manager.cc:1434] T 2ccfe6531fc44f86a0edc8bda1547442 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260923 19:50:10.822606 6457 tablet_bootstrap.cc:492] T 235b4b8081ad4a13937a7941344dbc33 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:10.824890 6457 tablet_bootstrap.cc:654] T 235b4b8081ad4a13937a7941344dbc33 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:10.819315 6456 tablet_bootstrap.cc:654] T 2f627b7b9ff74750bd8dd59840bf77db P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:10.826392 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 421) took 1980 ms. Trace:
I20260923 19:50:10.826529 6458 rpcz_store.cc:276] 0923 19:50:08.839401 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.839939 (+ 538us) service_pool.cc:224] Handling call
0923 19:50:10.819875 (+1979936us) ts_tablet_manager.cc:1151] Deleting tablet b7ba284e81bc4388bbd6456a41d1f9f4
0923 19:50:10.819885 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.819985 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1975294}
W20260923 19:50:10.827258 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet b7ba284e81bc4388bbd6456a41d1f9f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b7ba284e81bc4388bbd6456a41d1f9f4 already in progress: creating tablet
I20260923 19:50:10.827494 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet a75c4436a67f453e973a7a7645de79b1
I20260923 19:50:10.827750 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 424) took 1953 ms. Trace:
I20260923 19:50:10.828379 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet a75c4436a67f453e973a7a7645de79b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:10.827849 6458 rpcz_store.cc:276] 0923 19:50:08.874643 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.875156 (+ 513us) service_pool.cc:224] Handling call
0923 19:50:10.827615 (+1952459us) ts_tablet_manager.cc:1151] Deleting tablet 30fe07956e8940fcb7ba1e2e16ced463
0923 19:50:10.827625 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.827721 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1952216}
W20260923 19:50:10.828913 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 30fe07956e8940fcb7ba1e2e16ced463 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30fe07956e8940fcb7ba1e2e16ced463 already in progress: creating tablet
I20260923 19:50:10.829275 6458 tablet_replica.cc:333] T 337f32eb47954689a6eb8f74408e01d9 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:10.830109 6459 ts_tablet_manager.cc:1929] T 5c0142f4e3ad42048803481d68f0ee5d P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:10.830416 6458 raft_consensus.cc:2243] T 337f32eb47954689a6eb8f74408e01d9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:10.830621 6458 raft_consensus.cc:2272] T 337f32eb47954689a6eb8f74408e01d9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:10.830904 6459 log.cc:1199] T 5c0142f4e3ad42048803481d68f0ee5d P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/5c0142f4e3ad42048803481d68f0ee5d
I20260923 19:50:10.831125 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet a75c4436a67f453e973a7a7645de79b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:10.831423 6459 ts_tablet_manager.cc:1950] T 5c0142f4e3ad42048803481d68f0ee5d P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:10.832273 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 451) took 1929 ms. Trace:
I20260923 19:50:10.832434 6459 rpcz_store.cc:276] 0923 19:50:08.902416 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.919719 (+ 17303us) service_pool.cc:224] Handling call
0923 19:50:10.763951 (+1844232us) ts_tablet_manager.cc:1151] Deleting tablet 5c0142f4e3ad42048803481d68f0ee5d
0923 19:50:10.763959 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.790242 (+ 26283us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:10.830003 (+ 39761us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:10.832234 (+ 2231us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1843879}
I20260923 19:50:10.833063 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 5c0142f4e3ad42048803481d68f0ee5d (table default.Table_f57f5ddf52f541ab91b4a9638fcf81a0 [id=e0da333ed7f44d6aa283da81b1cfbf17]) successfully deleted
I20260923 19:50:10.833161 6458 ts_tablet_manager.cc:1916] T 337f32eb47954689a6eb8f74408e01d9 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:10.833572 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 463) took 1763 ms. Trace:
I20260923 19:50:10.828688 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet a75c4436a67f453e973a7a7645de79b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:10.836316 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet a75c4436a67f453e973a7a7645de79b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a75c4436a67f453e973a7a7645de79b1 already in progress: creating tablet
I20260923 19:50:10.837604 6459 rpcz_store.cc:276] 0923 19:50:09.070100 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.070156 (+ 56us) service_pool.cc:224] Handling call
0923 19:50:10.833424 (+1763268us) ts_tablet_manager.cc:1151] Deleting tablet e4f00490b0364f0e9f1b9569b870808e
0923 19:50:10.833433 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.833539 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1763059}
W20260923 19:50:10.838799 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet e4f00490b0364f0e9f1b9569b870808e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4f00490b0364f0e9f1b9569b870808e already in progress: creating tablet
I20260923 19:50:10.839339 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 462) took 1818 ms. Trace:
I20260923 19:50:10.839808 6459 rpcz_store.cc:276] 0923 19:50:09.020651 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.036847 (+ 16196us) service_pool.cc:224] Handling call
0923 19:50:10.839197 (+1802350us) ts_tablet_manager.cc:1151] Deleting tablet b92aaac328934d95a89e0fc08a80b0b1
0923 19:50:10.839206 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.839307 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1750522}
I20260923 19:50:10.840085 5796 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_97b31aab6721460eb4c6ac8d6f6f1983" } new_table_name: "default.Table_ea5c2db0da154c51a706c771a367ab98" modify_external_catalogs: true
W20260923 19:50:10.840540 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet b92aaac328934d95a89e0fc08a80b0b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b92aaac328934d95a89e0fc08a80b0b1 already in progress: creating tablet
I20260923 19:50:10.840914 6459 tablet_replica.cc:333] T b7f372b952804ac58e602998d9b77d72 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:10.841121 6459 raft_consensus.cc:2243] T b7f372b952804ac58e602998d9b77d72 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:10.841293 6459 raft_consensus.cc:2272] T b7f372b952804ac58e602998d9b77d72 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:10.842799 6459 ts_tablet_manager.cc:1916] T b7f372b952804ac58e602998d9b77d72 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:10.846303 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet c7369a5fc87f4b70bcfbe052ef021771
I20260923 19:50:10.847268 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet c7369a5fc87f4b70bcfbe052ef021771 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:10.847903 7134 raft_consensus.cc:493] T 2ccfe6531fc44f86a0edc8bda1547442 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:10.848093 7134 raft_consensus.cc:515] T 2ccfe6531fc44f86a0edc8bda1547442 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.848896 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet c7369a5fc87f4b70bcfbe052ef021771 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:10.849049 7134 leader_election.cc:290] T 2ccfe6531fc44f86a0edc8bda1547442 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:10.849582 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccfe6531fc44f86a0edc8bda1547442" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:10.849735 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccfe6531fc44f86a0edc8bda1547442" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:10.850055 6458 ts_tablet_manager.cc:1929] T 337f32eb47954689a6eb8f74408e01d9 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:10.850207 6458 log.cc:1199] T 337f32eb47954689a6eb8f74408e01d9 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/337f32eb47954689a6eb8f74408e01d9
W20260923 19:50:10.850333 5995 leader_election.cc:343] T 2ccfe6531fc44f86a0edc8bda1547442 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:10.850540 5996 leader_election.cc:343] T 2ccfe6531fc44f86a0edc8bda1547442 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:10.850703 5996 leader_election.cc:304] T 2ccfe6531fc44f86a0edc8bda1547442 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:10.851001 7134 raft_consensus.cc:2749] T 2ccfe6531fc44f86a0edc8bda1547442 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:10.851066 6030 tablet_service.cc:1558] Processing DeleteTablet for tablet c7369a5fc87f4b70bcfbe052ef021771 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:10.851392 6458 ts_tablet_manager.cc:1950] T 337f32eb47954689a6eb8f74408e01d9 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:10.851847 5804 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_c75bb0303c454c888dc2aa0d7b561339" } new_table_name: "default.Table_bc33f65d5674483c9854966514392420" modify_external_catalogs: true
W20260923 19:50:10.852025 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet c7369a5fc87f4b70bcfbe052ef021771 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c7369a5fc87f4b70bcfbe052ef021771 already in progress: creating tablet
I20260923 19:50:10.852727 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 425) took 1964 ms. Trace:
I20260923 19:50:10.859041 6457 tablet_bootstrap.cc:492] T 235b4b8081ad4a13937a7941344dbc33 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:10.859318 6457 ts_tablet_manager.cc:1403] T 235b4b8081ad4a13937a7941344dbc33 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.037s user 0.002s sys 0.002s
I20260923 19:50:10.860173 6457 raft_consensus.cc:359] T 235b4b8081ad4a13937a7941344dbc33 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.860471 6457 raft_consensus.cc:385] T 235b4b8081ad4a13937a7941344dbc33 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:10.860581 6457 raft_consensus.cc:740] T 235b4b8081ad4a13937a7941344dbc33 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:10.860912 6457 consensus_queue.cc:260] T 235b4b8081ad4a13937a7941344dbc33 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.861703 6457 ts_tablet_manager.cc:1434] T 235b4b8081ad4a13937a7941344dbc33 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:10.862268 6457 tablet_bootstrap.cc:492] T d2298d814a104f5cb62196be3bf0dae6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:10.867450 6030 tablet_service.cc:1511] Processing CreateTablet for tablet 39261cedbdb54d1f8ae0e07ae1cfeb3e (DEFAULT_TABLE table=default.Table_e4788af31ab94b6eae62e66d4f0e8c93 [id=e0ab7e7d051d48c0b86da6509cb659d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.867451 6324 tablet_service.cc:1511] Processing CreateTablet for tablet 39261cedbdb54d1f8ae0e07ae1cfeb3e (DEFAULT_TABLE table=default.Table_e4788af31ab94b6eae62e66d4f0e8c93 [id=e0ab7e7d051d48c0b86da6509cb659d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.867888 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39261cedbdb54d1f8ae0e07ae1cfeb3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.868068 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39261cedbdb54d1f8ae0e07ae1cfeb3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.869697 6459 ts_tablet_manager.cc:1929] T b7f372b952804ac58e602998d9b77d72 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:10.872397 6457 tablet_bootstrap.cc:654] T d2298d814a104f5cb62196be3bf0dae6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:10.873569 6458 rpcz_store.cc:276] 0923 19:50:08.897900 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:08.897965 (+ 65us) service_pool.cc:224] Handling call
0923 19:50:10.829213 (+1931248us) ts_tablet_manager.cc:1151] Deleting tablet 337f32eb47954689a6eb8f74408e01d9
0923 19:50:10.829226 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.839194 (+ 9968us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:10.849374 (+ 10180us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:10.852637 (+ 3263us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1930923}
I20260923 19:50:10.874287 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 337f32eb47954689a6eb8f74408e01d9 (table default.Table_c80b112b6ce9402f87b07ee8a6e1b78b [id=f509f74bbf6b4b6381509c265432cbd7]) successfully deleted
I20260923 19:50:10.874859 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 435) took 1855 ms. Trace:
I20260923 19:50:10.875398 6458 rpcz_store.cc:276] 0923 19:50:09.019382 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.019435 (+ 53us) service_pool.cc:224] Handling call
0923 19:50:10.874656 (+1855221us) ts_tablet_manager.cc:1151] Deleting tablet b92aaac328934d95a89e0fc08a80b0b1
0923 19:50:10.874668 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.874805 (+ 137us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1853994}
W20260923 19:50:10.875905 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet b92aaac328934d95a89e0fc08a80b0b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b92aaac328934d95a89e0fc08a80b0b1 already in progress: creating tablet
I20260923 19:50:10.876338 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 436) took 1805 ms. Trace:
I20260923 19:50:10.876466 6458 rpcz_store.cc:276] 0923 19:50:09.071176 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.229624 (+158448us) service_pool.cc:224] Handling call
0923 19:50:10.876194 (+1646570us) ts_tablet_manager.cc:1151] Deleting tablet e4f00490b0364f0e9f1b9569b870808e
0923 19:50:10.876204 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.876286 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1646080}
W20260923 19:50:10.876959 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet e4f00490b0364f0e9f1b9569b870808e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4f00490b0364f0e9f1b9569b870808e already in progress: creating tablet
I20260923 19:50:10.877295 6458 tablet_replica.cc:333] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:10.877528 6458 raft_consensus.cc:2243] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:10.877774 6458 raft_consensus.cc:2272] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:10.878407 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_67f9d2537a904559b507c9fac72ece67"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:10.879609 6202 raft_consensus.cc:3060] T ec4cc8a742114e5fb07c5c9157ce09e8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:10.881637 6458 ts_tablet_manager.cc:1916] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:10.891346 6459 log.cc:1199] T b7f372b952804ac58e602998d9b77d72 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/b7f372b952804ac58e602998d9b77d72
I20260923 19:50:10.891772 6459 ts_tablet_manager.cc:1950] T b7f372b952804ac58e602998d9b77d72 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:10.891605 6454 tablet_bootstrap.cc:492] T 5427b0f0218d4131b68a39e8e3bf02e7 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
W20260923 19:50:10.893760 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_67f9d2537a904559b507c9fac72ece67 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:10.892869 6454 ts_tablet_manager.cc:1403] T 5427b0f0218d4131b68a39e8e3bf02e7 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.110s user 0.001s sys 0.004s
I20260923 19:50:10.898334 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 464) took 1803 ms. Trace:
I20260923 19:50:10.898451 6459 rpcz_store.cc:276] 0923 19:50:09.094362 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.107864 (+ 13502us) service_pool.cc:224] Handling call
0923 19:50:10.840855 (+1732991us) ts_tablet_manager.cc:1151] Deleting tablet b7f372b952804ac58e602998d9b77d72
0923 19:50:10.840864 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.859662 (+ 18798us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:10.869621 (+ 9959us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:10.898274 (+ 28653us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1732726}
I20260923 19:50:10.898940 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 476) took 1523 ms. Trace:
I20260923 19:50:10.899036 6459 rpcz_store.cc:276] 0923 19:50:09.375049 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.375099 (+ 50us) service_pool.cc:224] Handling call
0923 19:50:10.898764 (+1523665us) ts_tablet_manager.cc:1151] Deleting tablet 14c917ac93fd436aa13fb0839fae883f
0923 19:50:10.898775 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.898888 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1500995}
I20260923 19:50:10.899376 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 475) took 1525 ms. Trace:
I20260923 19:50:10.899459 6459 rpcz_store.cc:276] 0923 19:50:09.374059 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.374729 (+ 670us) service_pool.cc:224] Handling call
0923 19:50:10.899249 (+1524520us) ts_tablet_manager.cc:1151] Deleting tablet 02fa9052a7054659baf9b07b770bb538
0923 19:50:10.899257 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.899328 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1490401}
I20260923 19:50:10.899509 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet b7f372b952804ac58e602998d9b77d72 (table default.Table_7fca491d466748de94242c08e20984b6 [id=5e155553f7ae43eca827dbbafdd2bbe6]) successfully deleted
I20260923 19:50:10.900014 6459 tablet_replica.cc:333] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:10.900211 6459 raft_consensus.cc:2243] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260923 19:50:10.900282 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 14c917ac93fd436aa13fb0839fae883f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 14c917ac93fd436aa13fb0839fae883f already in progress: creating tablet
I20260923 19:50:10.900403 6459 raft_consensus.cc:2272] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:10.900542 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 02fa9052a7054659baf9b07b770bb538 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 02fa9052a7054659baf9b07b770bb538 already in progress: creating tablet
I20260923 19:50:10.900930 6459 ts_tablet_manager.cc:1916] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:10.903429 6457 tablet_bootstrap.cc:492] T d2298d814a104f5cb62196be3bf0dae6 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:10.903589 6457 ts_tablet_manager.cc:1403] T d2298d814a104f5cb62196be3bf0dae6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.004s
I20260923 19:50:10.904485 6457 raft_consensus.cc:359] T d2298d814a104f5cb62196be3bf0dae6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.904685 6457 raft_consensus.cc:385] T d2298d814a104f5cb62196be3bf0dae6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:10.904781 6457 raft_consensus.cc:740] T d2298d814a104f5cb62196be3bf0dae6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:10.905071 6457 consensus_queue.cc:260] T d2298d814a104f5cb62196be3bf0dae6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.905727 6457 ts_tablet_manager.cc:1434] T d2298d814a104f5cb62196be3bf0dae6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:10.907449 6458 ts_tablet_manager.cc:1929] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:10.907588 6458 log.cc:1199] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/e9cbfaa34c924a678f23cbcbf1a6fb0a
I20260923 19:50:10.907984 6458 ts_tablet_manager.cc:1950] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:10.908742 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 446) took 1603 ms. Trace:
I20260923 19:50:10.909335 6457 tablet_bootstrap.cc:492] T ba4e9fee05994c0d8e7d1f21788280d3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:10.910157 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 7af330ae1aaa48209f2bd1880bcfebb1
I20260923 19:50:10.910672 5798 catalog_manager.cc:6934] ReplaceTablet: tablet 7af330ae1aaa48209f2bd1880bcfebb1 deleted and replaced by tablet 55991fab89be47afba7fcd08673ef82f
I20260923 19:50:10.911114 6457 tablet_bootstrap.cc:654] T ba4e9fee05994c0d8e7d1f21788280d3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:10.911914 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet 7af330ae1aaa48209f2bd1880bcfebb1 with delete_type TABLET_DATA_DELETED (replaced by tablet 55991fab89be47afba7fcd08673ef82f) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:10.913268 6030 tablet_service.cc:1558] Processing DeleteTablet for tablet 7af330ae1aaa48209f2bd1880bcfebb1 with delete_type TABLET_DATA_DELETED (replaced by tablet 55991fab89be47afba7fcd08673ef82f) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:10.914081 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 7af330ae1aaa48209f2bd1880bcfebb1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7af330ae1aaa48209f2bd1880bcfebb1 already in progress: creating tablet
I20260923 19:50:10.915128 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet 7af330ae1aaa48209f2bd1880bcfebb1 with delete_type TABLET_DATA_DELETED (replaced by tablet 55991fab89be47afba7fcd08673ef82f) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:10.916419 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_a6baec3d4ff94a14a032737c8ae498ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:10.917016 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6baec3d4ff94a14a032737c8ae498ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:10.908862 6458 rpcz_store.cc:276] 0923 19:50:09.305359 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.305627 (+ 268us) service_pool.cc:224] Handling call
0923 19:50:10.877218 (+1571591us) ts_tablet_manager.cc:1151] Deleting tablet e9cbfaa34c924a678f23cbcbf1a6fb0a
0923 19:50:10.877227 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.888029 (+ 10802us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:10.907338 (+ 19309us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:10.908706 (+ 1368us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1446161}
I20260923 19:50:10.919621 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet e9cbfaa34c924a678f23cbcbf1a6fb0a (table default.Table_7e1ef96ed9694a29966dfbace1a5f555 [id=94ef9897f5c44524ae14f2b721a586e1]) successfully deleted
I20260923 19:50:10.919836 6456 tablet_bootstrap.cc:492] T 2f627b7b9ff74750bd8dd59840bf77db P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:10.919991 6456 ts_tablet_manager.cc:1403] T 2f627b7b9ff74750bd8dd59840bf77db P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.103s user 0.007s sys 0.009s
I20260923 19:50:10.920809 6456 raft_consensus.cc:359] T 2f627b7b9ff74750bd8dd59840bf77db P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.921002 6456 raft_consensus.cc:385] T 2f627b7b9ff74750bd8dd59840bf77db P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:10.921095 6456 raft_consensus.cc:740] T 2f627b7b9ff74750bd8dd59840bf77db P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:10.921131 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 449) took 1475 ms. Trace:
I20260923 19:50:10.921316 6458 rpcz_store.cc:276] 0923 19:50:09.445993 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.446080 (+ 87us) service_pool.cc:224] Handling call
0923 19:50:10.920825 (+1474745us) ts_tablet_manager.cc:1151] Deleting tablet 02fa9052a7054659baf9b07b770bb538
0923 19:50:10.920836 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.921051 (+ 215us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1449346}
I20260923 19:50:10.921397 6456 consensus_queue.cc:260] T 2f627b7b9ff74750bd8dd59840bf77db P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.921780 6030 tablet_service.cc:1511] Processing CreateTablet for tablet b0534795317747b28bef09df8a1c7244 (DEFAULT_TABLE table=default.Table_0f595721f8434bcda65bc5803008bf06 [id=cb50bcff3b964d88b72ae6913f71710a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.921867 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 450) took 1467 ms. Trace:
I20260923 19:50:10.921994 6458 rpcz_store.cc:276] 0923 19:50:09.454775 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.454839 (+ 64us) service_pool.cc:224] Handling call
0923 19:50:10.921718 (+1466879us) ts_tablet_manager.cc:1151] Deleting tablet 14c917ac93fd436aa13fb0839fae883f
0923 19:50:10.921728 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.921832 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1399608}
I20260923 19:50:10.922395 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0534795317747b28bef09df8a1c7244. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:10.922856 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 02fa9052a7054659baf9b07b770bb538 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 02fa9052a7054659baf9b07b770bb538 already in progress: creating tablet
I20260923 19:50:10.922991 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 452) took 1399 ms. Trace:
W20260923 19:50:10.923130 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 14c917ac93fd436aa13fb0839fae883f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 14c917ac93fd436aa13fb0839fae883f already in progress: creating tablet
I20260923 19:50:10.923303 6458 rpcz_store.cc:276] 0923 19:50:09.523295 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.523361 (+ 66us) service_pool.cc:224] Handling call
0923 19:50:10.922202 (+1398841us) ts_tablet_manager.cc:1151] Deleting tablet 16144661b56c4f858c55e8e0d3999019
0923 19:50:10.922348 (+ 146us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.922458 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1362403}
I20260923 19:50:10.923668 6179 tablet_service.cc:1511] Processing CreateTablet for tablet b0534795317747b28bef09df8a1c7244 (DEFAULT_TABLE table=default.Table_0f595721f8434bcda65bc5803008bf06 [id=cb50bcff3b964d88b72ae6913f71710a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.923969 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 453) took 1364 ms. Trace:
I20260923 19:50:10.924219 6458 rpcz_store.cc:276] 0923 19:50:09.559908 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.560646 (+ 738us) service_pool.cc:224] Handling call
0923 19:50:10.923542 (+1362896us) ts_tablet_manager.cc:1151] Deleting tablet 684eb2576b4b4730813b993e36b242df
0923 19:50:10.923844 (+ 302us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.923927 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1352707}
I20260923 19:50:10.924718 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 454) took 1353 ms. Trace:
I20260923 19:50:10.925169 6458 rpcz_store.cc:276] 0923 19:50:09.570978 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.571033 (+ 55us) service_pool.cc:224] Handling call
0923 19:50:10.924577 (+1353544us) ts_tablet_manager.cc:1151] Deleting tablet 85f5ba9097674f9d889e178eaea4f0d7
0923 19:50:10.924586 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.924682 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1350097}
I20260923 19:50:10.925264 6324 tablet_service.cc:1511] Processing CreateTablet for tablet b0534795317747b28bef09df8a1c7244 (DEFAULT_TABLE table=default.Table_0f595721f8434bcda65bc5803008bf06 [id=cb50bcff3b964d88b72ae6913f71710a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:10.925554 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 16144661b56c4f858c55e8e0d3999019 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16144661b56c4f858c55e8e0d3999019 already in progress: creating tablet
W20260923 19:50:10.925779 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 684eb2576b4b4730813b993e36b242df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 684eb2576b4b4730813b993e36b242df already in progress: creating tablet
I20260923 19:50:10.925858 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0534795317747b28bef09df8a1c7244. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.926826 6456 ts_tablet_manager.cc:1434] T 2f627b7b9ff74750bd8dd59840bf77db P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.007s user 0.001s sys 0.002s
I20260923 19:50:10.929193 6456 tablet_bootstrap.cc:492] T f108ebdaecab42e7b57057c7ecfbe690 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
W20260923 19:50:10.931277 5789 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet f1a4bccf6dd2411f83b86d782ecf5f40 (table default.Table_fcbdddfc239041ae96611a78df2b3303 [id=24fd12b0465443c58bca97fcfea1f1d3], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet f1a4bccf6dd2411f83b86d782ecf5f40 consensus state has no leader
I20260923 19:50:10.931463 6456 tablet_bootstrap.cc:654] T f108ebdaecab42e7b57057c7ecfbe690 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:10.933583 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_cb408624c0d145ca843187791183aa32"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:10.934214 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb408624c0d145ca843187791183aa32 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:10.936534 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 85f5ba9097674f9d889e178eaea4f0d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 85f5ba9097674f9d889e178eaea4f0d7 already in progress: creating tablet
I20260923 19:50:10.937222 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 455) took 1336 ms. Trace:
I20260923 19:50:10.938444 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 7804d14acf5d491b9f637716f0046877 (DEFAULT_TABLE table=default.Table_497399963ce44a7fa70b33a81e853df8 [id=b2d55216ab0d4430b164ddd6f97486e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.938898 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7804d14acf5d491b9f637716f0046877. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.941000 6458 rpcz_store.cc:276] 0923 19:50:09.600877 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.619010 (+ 18133us) service_pool.cc:224] Handling call
0923 19:50:10.937027 (+1318017us) ts_tablet_manager.cc:1151] Deleting tablet f1a4bccf6dd2411f83b86d782ecf5f40
0923 19:50:10.937041 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.937172 (+ 131us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1266557}
W20260923 19:50:10.941589 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet f1a4bccf6dd2411f83b86d782ecf5f40 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1a4bccf6dd2411f83b86d782ecf5f40 already in progress: creating tablet
I20260923 19:50:10.940404 6324 tablet_service.cc:1511] Processing CreateTablet for tablet 7804d14acf5d491b9f637716f0046877 (DEFAULT_TABLE table=default.Table_497399963ce44a7fa70b33a81e853df8 [id=b2d55216ab0d4430b164ddd6f97486e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.942216 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7804d14acf5d491b9f637716f0046877. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.946321 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 458) took 1087 ms. Trace:
I20260923 19:50:10.946805 6457 tablet_bootstrap.cc:492] T ba4e9fee05994c0d8e7d1f21788280d3 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:10.946981 6457 ts_tablet_manager.cc:1403] T ba4e9fee05994c0d8e7d1f21788280d3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.038s user 0.004s sys 0.000s
I20260923 19:50:10.946977 6458 rpcz_store.cc:276] 0923 19:50:09.858615 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.858701 (+ 86us) service_pool.cc:224] Handling call
0923 19:50:10.946095 (+1087394us) ts_tablet_manager.cc:1151] Deleting tablet 1c26a2863fdd4912b6d357877af1eb42
0923 19:50:10.946109 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.946263 (+ 154us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1087138}
I20260923 19:50:10.947826 6457 raft_consensus.cc:359] T ba4e9fee05994c0d8e7d1f21788280d3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.948037 6457 raft_consensus.cc:385] T ba4e9fee05994c0d8e7d1f21788280d3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:10.948117 6457 raft_consensus.cc:740] T ba4e9fee05994c0d8e7d1f21788280d3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:10.948369 6457 consensus_queue.cc:260] T ba4e9fee05994c0d8e7d1f21788280d3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:10.948581 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 1c26a2863fdd4912b6d357877af1eb42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1c26a2863fdd4912b6d357877af1eb42 already in progress: creating tablet
I20260923 19:50:10.949235 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 457) took 1090 ms. Trace:
I20260923 19:50:10.949380 6458 rpcz_store.cc:276] 0923 19:50:09.858451 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.864562 (+ 6111us) service_pool.cc:224] Handling call
0923 19:50:10.949109 (+1084547us) ts_tablet_manager.cc:1151] Deleting tablet 4c6f9953649a43aa9a0edd78b7bd47a4
0923 19:50:10.949119 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.949205 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1053704}
I20260923 19:50:10.950237 6457 ts_tablet_manager.cc:1434] T ba4e9fee05994c0d8e7d1f21788280d3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260923 19:50:10.952114 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 7804d14acf5d491b9f637716f0046877 (DEFAULT_TABLE table=default.Table_497399963ce44a7fa70b33a81e853df8 [id=b2d55216ab0d4430b164ddd6f97486e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.952503 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7804d14acf5d491b9f637716f0046877. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.952538 6457 tablet_bootstrap.cc:492] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:10.954054 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_0ebdc6bda57442b796dabb005f3779c5" } new_table_name: "default.Table_8eb6b4b05ff24ee58259da0d85d11148" modify_external_catalogs: true
I20260923 19:50:10.954180 7117 tablet.cc:1751] T ec4cc8a742114e5fb07c5c9157ce09e8 P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:10.954767 7102 raft_consensus.cc:493] T 86473c5cbca54b5792b038aef445998c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260923 19:50:10.955580 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 4c6f9953649a43aa9a0edd78b7bd47a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4c6f9953649a43aa9a0edd78b7bd47a4 already in progress: creating tablet
I20260923 19:50:10.955947 7102 raft_consensus.cc:515] T 86473c5cbca54b5792b038aef445998c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.956708 7102 leader_election.cc:290] T 86473c5cbca54b5792b038aef445998c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:10.958437 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86473c5cbca54b5792b038aef445998c" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:10.958730 6344 raft_consensus.cc:2468] T 86473c5cbca54b5792b038aef445998c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
W20260923 19:50:10.960561 6137 leader_election.cc:343] T 86473c5cbca54b5792b038aef445998c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 86473c5cbca54b5792b038aef445998c
I20260923 19:50:10.960744 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 63aa6f9be30346ebbdb5e0f044ddfe2a (DEFAULT_TABLE table=default.Table_873dad3f96014c24889e9b3f1ef09d79 [id=c83c235387794988ab8120d13c7a9655]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.961027 6139 leader_election.cc:304] T 86473c5cbca54b5792b038aef445998c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:10.961423 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63aa6f9be30346ebbdb5e0f044ddfe2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.962263 7102 raft_consensus.cc:2804] T 86473c5cbca54b5792b038aef445998c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:10.962386 7102 raft_consensus.cc:493] T 86473c5cbca54b5792b038aef445998c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:10.959306 6454 raft_consensus.cc:359] T 5427b0f0218d4131b68a39e8e3bf02e7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.963124 7102 raft_consensus.cc:3060] T 86473c5cbca54b5792b038aef445998c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:10.965746 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0534795317747b28bef09df8a1c7244. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.965793 6457 tablet_bootstrap.cc:654] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:10.967109 5802 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_00f5789c01e94f8e8c65077f98b164c2 [id=29a38060f3bf43f3900ad0ee42fbde9a] alter complete (version 1)
I20260923 19:50:10.969584 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet ab73e8a1b6774ca0b43e5be67da68fab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:10.969667 6030 tablet_service.cc:1558] Processing DeleteTablet for tablet 1c26a2863fdd4912b6d357877af1eb42 with delete_type TABLET_DATA_DELETED (replaced by tablet 7f9ec2a95bad40f7b229482b275110a3) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:10.970067 6461 tablet_replica.cc:333] T 1c26a2863fdd4912b6d357877af1eb42 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:10.970312 6461 raft_consensus.cc:2243] T 1c26a2863fdd4912b6d357877af1eb42 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:10.970486 6461 raft_consensus.cc:2272] T 1c26a2863fdd4912b6d357877af1eb42 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:10.970580 6308 tablet_service.cc:1558] Processing DeleteTablet for tablet 495292cacf3b42a5b633ad40e5e01972 with delete_type TABLET_DATA_DELETED (replaced by tablet 6a2564a99c274e07a7e43da739a2458b) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:10.970602 7102 raft_consensus.cc:515] T 86473c5cbca54b5792b038aef445998c P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:10.972046 6137 leader_election.cc:343] T 86473c5cbca54b5792b038aef445998c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 86473c5cbca54b5792b038aef445998c
I20260923 19:50:10.972383 6461 ts_tablet_manager.cc:1916] T 1c26a2863fdd4912b6d357877af1eb42 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:10.972836 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86473c5cbca54b5792b038aef445998c" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:10.972992 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet 337f32eb47954689a6eb8f74408e01d9 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d654b14cafa453185179fe57a25e2d9) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:10.973067 6344 raft_consensus.cc:3060] T 86473c5cbca54b5792b038aef445998c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
W20260923 19:50:10.973635 5790 catalog_manager.cc:5030] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet ab73e8a1b6774ca0b43e5be67da68fab because the tablet was not found. No further retry: Not found: Tablet not found: ab73e8a1b6774ca0b43e5be67da68fab
I20260923 19:50:10.976074 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_bfb22d30f8ca47129ca87852c8cd56bb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:10.976676 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bfb22d30f8ca47129ca87852c8cd56bb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:10.978106 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_2c27f94015dc496f9fb2233178799192"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:10.978571 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c27f94015dc496f9fb2233178799192 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:10.979580 6344 raft_consensus.cc:2468] T 86473c5cbca54b5792b038aef445998c P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:10.980520 6461 ts_tablet_manager.cc:1929] T 1c26a2863fdd4912b6d357877af1eb42 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:10.980551 6139 leader_election.cc:304] T 86473c5cbca54b5792b038aef445998c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:10.980758 6461 log.cc:1199] T 1c26a2863fdd4912b6d357877af1eb42 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/1c26a2863fdd4912b6d357877af1eb42
I20260923 19:50:10.980927 7123 raft_consensus.cc:2804] T 86473c5cbca54b5792b038aef445998c P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:10.981141 6461 ts_tablet_manager.cc:1950] T 1c26a2863fdd4912b6d357877af1eb42 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:10.981376 6323 tablet_service.cc:1511] Processing CreateTablet for tablet 63aa6f9be30346ebbdb5e0f044ddfe2a (DEFAULT_TABLE table=default.Table_873dad3f96014c24889e9b3f1ef09d79 [id=c83c235387794988ab8120d13c7a9655]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.981786 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63aa6f9be30346ebbdb5e0f044ddfe2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:10.982407 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 1c26a2863fdd4912b6d357877af1eb42 (table default.Table_53ff161409a94c28a2d7f0a67a6eb839 [id=b3a6838530c74581b0b5afbca24f80ad]) successfully deleted
I20260923 19:50:10.989302 7102 leader_election.cc:290] T 86473c5cbca54b5792b038aef445998c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:10.989673 6454 raft_consensus.cc:385] T 5427b0f0218d4131b68a39e8e3bf02e7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:10.993516 6454 raft_consensus.cc:740] T 5427b0f0218d4131b68a39e8e3bf02e7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:10.994143 6454 consensus_queue.cc:260] T 5427b0f0218d4131b68a39e8e3bf02e7 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:10.997040 6454 ts_tablet_manager.cc:1434] T 5427b0f0218d4131b68a39e8e3bf02e7 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.100s user 0.000s sys 0.003s
I20260923 19:50:10.998965 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 8d5b27a115cc4fd7bcb8d958aae459a0 (DEFAULT_TABLE table=default.Table_4f9039a655f34e0b8d5c62f98a058b9d [id=4376aa8061d44e608983973914631b85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:10.999467 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d5b27a115cc4fd7bcb8d958aae459a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.000823 6454 tablet_bootstrap.cc:492] T 556b32b8ccd54c439f86b0069e2a5ce0 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
W20260923 19:50:11.002892 5805 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bfe87e992ca04ea293e354da508e4c67 consensus state has no leader
I20260923 19:50:11.003233 6454 tablet_bootstrap.cc:654] T 556b32b8ccd54c439f86b0069e2a5ce0 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:11.008126 5805 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet ec4cc8a742114e5fb07c5c9157ce09e8 (table default.Table_2adc87e06d81491498aa018f49fdc08d [id=89181985e6154c7fa946148e48bef2eb]). Expected version 2 got 0
I20260923 19:50:11.009275 6164 tablet_service.cc:1511] Processing CreateTablet for tablet 8d5b27a115cc4fd7bcb8d958aae459a0 (DEFAULT_TABLE table=default.Table_4f9039a655f34e0b8d5c62f98a058b9d [id=4376aa8061d44e608983973914631b85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.009680 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d5b27a115cc4fd7bcb8d958aae459a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.012312 5805 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 85d35ebef3c24a2e89233dd900b63513 (table default.Table_97b31aab6721460eb4c6ac8d6f6f1983 [id=da91b06e11c64bb0aaec37a0188b5586]). Expected version 2 got 0
I20260923 19:50:11.014750 7117 tablet.cc:1746] T ec4cc8a742114e5fb07c5c9157ce09e8 P 61022dd7f2f14dc19aebe3af5f08f430: Skipping requested alter to schema version 2, tablet already version 2
I20260923 19:50:11.019855 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 461) took 1160 ms. Trace:
I20260923 19:50:11.027463 6164 tablet_service.cc:1511] Processing CreateTablet for tablet f9687b3f4b904e438d83533fb67cc92f (DEFAULT_TABLE table=default.Table_b1d68ffe395448d195d5a18f8dae7539 [id=27331fb9c47646388b3102f8480dbaaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.027962 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9687b3f4b904e438d83533fb67cc92f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.030009 6458 rpcz_store.cc:276] 0923 19:50:09.858942 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.859265 (+ 323us) service_pool.cc:224] Handling call
0923 19:50:11.019612 (+1160347us) ts_tablet_manager.cc:1151] Deleting tablet cb11d6e082784ad98cfb5253dbb88707
0923 19:50:11.019630 (+ 18us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:11.019789 (+ 159us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1123785}
W20260923 19:50:11.030771 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet cb11d6e082784ad98cfb5253dbb88707 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb11d6e082784ad98cfb5253dbb88707 already in progress: creating tablet
I20260923 19:50:11.020648 6323 tablet_service.cc:1511] Processing CreateTablet for tablet 8d5b27a115cc4fd7bcb8d958aae459a0 (DEFAULT_TABLE table=default.Table_4f9039a655f34e0b8d5c62f98a058b9d [id=4376aa8061d44e608983973914631b85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.031438 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d5b27a115cc4fd7bcb8d958aae459a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.038771 6029 tablet_service.cc:1511] Processing CreateTablet for tablet f9687b3f4b904e438d83533fb67cc92f (DEFAULT_TABLE table=default.Table_b1d68ffe395448d195d5a18f8dae7539 [id=27331fb9c47646388b3102f8480dbaaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.039287 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9687b3f4b904e438d83533fb67cc92f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.035804 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 460) took 1176 ms. Trace:
I20260923 19:50:11.040328 6458 rpcz_store.cc:276] 0923 19:50:09.858857 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.859425 (+ 568us) service_pool.cc:224] Handling call
0923 19:50:11.035581 (+1176156us) ts_tablet_manager.cc:1151] Deleting tablet 64e8951eb899461aa9c0b36e3f7555e2
0923 19:50:11.035597 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:11.035751 (+ 154us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1133390}
W20260923 19:50:11.041028 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 64e8951eb899461aa9c0b36e3f7555e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64e8951eb899461aa9c0b36e3f7555e2 already in progress: creating tablet
I20260923 19:50:11.042568 5799 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 1b1d9413e1e24547b491a160d851377b
I20260923 19:50:11.043078 5799 catalog_manager.cc:6934] ReplaceTablet: tablet 1b1d9413e1e24547b491a160d851377b deleted and replaced by tablet 355b2fc61d4f4efd918204079f1ebf35
I20260923 19:50:11.044461 6030 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b1d9413e1e24547b491a160d851377b with delete_type TABLET_DATA_DELETED (replaced by tablet 355b2fc61d4f4efd918204079f1ebf35) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:11.045204 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 1b1d9413e1e24547b491a160d851377b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b1d9413e1e24547b491a160d851377b already in progress: creating tablet
I20260923 19:50:11.046525 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 462) took 1187 ms. Trace:
I20260923 19:50:11.046715 6458 rpcz_store.cc:276] 0923 19:50:09.859089 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.859957 (+ 868us) service_pool.cc:224] Handling call
0923 19:50:11.046318 (+1186361us) ts_tablet_manager.cc:1151] Deleting tablet ebc288d8d453481592df11cd1bfed3ac
0923 19:50:11.046334 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:11.046479 (+ 145us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1142131}
I20260923 19:50:11.047333 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 469) took 1104 ms. Trace:
I20260923 19:50:11.047482 6308 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b1d9413e1e24547b491a160d851377b with delete_type TABLET_DATA_DELETED (replaced by tablet 355b2fc61d4f4efd918204079f1ebf35) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:11.047801 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet ebc288d8d453481592df11cd1bfed3ac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ebc288d8d453481592df11cd1bfed3ac already in progress: creating tablet
I20260923 19:50:11.048166 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b1d9413e1e24547b491a160d851377b with delete_type TABLET_DATA_DELETED (replaced by tablet 355b2fc61d4f4efd918204079f1ebf35) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:11.049571 7123 raft_consensus.cc:697] T 86473c5cbca54b5792b038aef445998c P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:11.050377 7123 consensus_queue.cc:237] T 86473c5cbca54b5792b038aef445998c P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.050681 5799 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 2db82e6f314f412385b41720c7efdef5 (table default.Table_fa1d82a491c04ba89f5cf3162578d550 [id=6d79e588fb9e4936aedf8cd500f68d60]). Expected version 3 got 0
I20260923 19:50:11.050904 5799 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet ba4e9fee05994c0d8e7d1f21788280d3 (table default.Table_fa5d77accb2d4cb2a336e0394074518a [id=49bb9f954b544f41b75f6035b1ea68b1]). Expected version 2 got 0
I20260923 19:50:11.053857 6459 ts_tablet_manager.cc:1929] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:11.055006 6308 tablet_service.cc:1511] Processing CreateTablet for tablet f9687b3f4b904e438d83533fb67cc92f (DEFAULT_TABLE table=default.Table_b1d68ffe395448d195d5a18f8dae7539 [id=27331fb9c47646388b3102f8480dbaaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.055538 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9687b3f4b904e438d83533fb67cc92f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.059850 6456 tablet_bootstrap.cc:492] T f108ebdaecab42e7b57057c7ecfbe690 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:11.060055 6456 ts_tablet_manager.cc:1403] T f108ebdaecab42e7b57057c7ecfbe690 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.131s user 0.034s sys 0.067s
I20260923 19:50:11.062580 6456 raft_consensus.cc:359] T f108ebdaecab42e7b57057c7ecfbe690 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.062776 6456 raft_consensus.cc:385] T f108ebdaecab42e7b57057c7ecfbe690 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:11.062851 6456 raft_consensus.cc:740] T f108ebdaecab42e7b57057c7ecfbe690 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:11.063107 6456 consensus_queue.cc:260] T f108ebdaecab42e7b57057c7ecfbe690 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.064653 6456 ts_tablet_manager.cc:1434] T f108ebdaecab42e7b57057c7ecfbe690 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260923 19:50:11.064672 6459 log.cc:1199] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/64a38bbd3fbd4738a73e78e3f6436fe5
I20260923 19:50:11.065105 6459 ts_tablet_manager.cc:1950] T 64a38bbd3fbd4738a73e78e3f6436fe5 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:11.064993 6456 tablet_bootstrap.cc:492] T 6e781ccf4aa343fc924138c3cc2b04e6 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:11.065946 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 478) took 1567 ms. Trace:
I20260923 19:50:11.067457 6456 tablet_bootstrap.cc:654] T 6e781ccf4aa343fc924138c3cc2b04e6 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:11.069478 6459 rpcz_store.cc:276] 0923 19:50:09.498571 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.509944 (+ 11373us) service_pool.cc:224] Handling call
0923 19:50:10.899636 (+1389692us) ts_tablet_manager.cc:1151] Deleting tablet 64a38bbd3fbd4738a73e78e3f6436fe5
0923 19:50:10.899655 (+ 19us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:10.920339 (+ 20684us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:11.053740 (+133401us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:11.065913 (+ 12173us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1334782}
I20260923 19:50:11.071485 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 64a38bbd3fbd4738a73e78e3f6436fe5 (table default.Table_286d831d3cff4c89b493d45f28acbca2 [id=f02b0dcd479d46fea2683769212f2f40]) successfully deleted
I20260923 19:50:11.054759 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 63aa6f9be30346ebbdb5e0f044ddfe2a (DEFAULT_TABLE table=default.Table_873dad3f96014c24889e9b3f1ef09d79 [id=c83c235387794988ab8120d13c7a9655]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.072247 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63aa6f9be30346ebbdb5e0f044ddfe2a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:11.072790 5796 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 85d35ebef3c24a2e89233dd900b63513 consensus state has no leader
I20260923 19:50:11.076715 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_f0ae26687ca54a6085e4b7cf494fc482"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:11.077291 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f0ae26687ca54a6085e4b7cf494fc482 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:11.055956 6454 tablet_bootstrap.cc:492] T 556b32b8ccd54c439f86b0069e2a5ce0 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:11.078078 6454 ts_tablet_manager.cc:1403] T 556b32b8ccd54c439f86b0069e2a5ce0 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.077s user 0.004s sys 0.001s
I20260923 19:50:11.079010 6454 raft_consensus.cc:359] T 556b32b8ccd54c439f86b0069e2a5ce0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.079399 6454 raft_consensus.cc:385] T 556b32b8ccd54c439f86b0069e2a5ce0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:11.079493 6454 raft_consensus.cc:740] T 556b32b8ccd54c439f86b0069e2a5ce0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:11.079770 7134 raft_consensus.cc:493] T ba4e9fee05994c0d8e7d1f21788280d3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:11.079989 7134 raft_consensus.cc:515] T ba4e9fee05994c0d8e7d1f21788280d3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.080681 6164 tablet_service.cc:1511] Processing CreateTablet for tablet e4375ff709a74bc6b8ef2073fb2c1d18 (DEFAULT_TABLE table=default.Table_98f26974f07c4799981e0b2b01d7cd8d [id=10d885fef8a6476e88b40043fe78b805]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.080991 6456 tablet_bootstrap.cc:492] T 6e781ccf4aa343fc924138c3cc2b04e6 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:11.081061 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4375ff709a74bc6b8ef2073fb2c1d18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.081122 7134 leader_election.cc:290] T ba4e9fee05994c0d8e7d1f21788280d3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:11.081374 6456 ts_tablet_manager.cc:1403] T 6e781ccf4aa343fc924138c3cc2b04e6 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.006s
I20260923 19:50:11.081771 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4e9fee05994c0d8e7d1f21788280d3" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:11.082269 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4e9fee05994c0d8e7d1f21788280d3" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:11.082319 5996 leader_election.cc:343] T ba4e9fee05994c0d8e7d1f21788280d3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:11.082697 6456 raft_consensus.cc:359] T 6e781ccf4aa343fc924138c3cc2b04e6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.082862 6456 raft_consensus.cc:385] T 6e781ccf4aa343fc924138c3cc2b04e6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260923 19:50:11.082917 5995 leader_election.cc:343] T ba4e9fee05994c0d8e7d1f21788280d3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:11.082954 6456 raft_consensus.cc:740] T 6e781ccf4aa343fc924138c3cc2b04e6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:11.083039 5995 leader_election.cc:304] T ba4e9fee05994c0d8e7d1f21788280d3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:11.083216 6456 consensus_queue.cc:260] T 6e781ccf4aa343fc924138c3cc2b04e6 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.083729 7134 raft_consensus.cc:2749] T ba4e9fee05994c0d8e7d1f21788280d3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:11.084055 6454 consensus_queue.cc:260] T 556b32b8ccd54c439f86b0069e2a5ce0 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.086221 6456 ts_tablet_manager.cc:1434] T 6e781ccf4aa343fc924138c3cc2b04e6 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260923 19:50:11.086685 6456 tablet_bootstrap.cc:492] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:11.090804 6457 tablet_bootstrap.cc:492] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:11.090962 6457 ts_tablet_manager.cc:1403] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.139s user 0.015s sys 0.008s
I20260923 19:50:11.091760 6457 raft_consensus.cc:359] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.091990 6457 raft_consensus.cc:385] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:11.092087 6457 raft_consensus.cc:740] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:11.092288 6457 consensus_queue.cc:260] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.092829 6457 ts_tablet_manager.cc:1434] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:11.093674 6029 tablet_service.cc:1511] Processing CreateTablet for tablet e4375ff709a74bc6b8ef2073fb2c1d18 (DEFAULT_TABLE table=default.Table_98f26974f07c4799981e0b2b01d7cd8d [id=10d885fef8a6476e88b40043fe78b805]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.093938 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 5bc33295d8684e8583508124a8db5b8a (DEFAULT_TABLE table=default.Table_81c9757c73ef447b84367e06b0dc1614 [id=c6dfcde05b6f479eae46ade38b9c9f63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.094389 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4375ff709a74bc6b8ef2073fb2c1d18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.094455 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bc33295d8684e8583508124a8db5b8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.101754 6458 rpcz_store.cc:276] 0923 19:50:09.943026 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.943944 (+ 918us) service_pool.cc:224] Handling call
0923 19:50:11.047086 (+1103142us) ts_tablet_manager.cc:1151] Deleting tablet a11ecef9a24f4e4a812ec220b6a92cc4
0923 19:50:11.047098 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:11.047287 (+ 189us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1101847}
W20260923 19:50:11.102305 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet a11ecef9a24f4e4a812ec220b6a92cc4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a11ecef9a24f4e4a812ec220b6a92cc4 already in progress: creating tablet
I20260923 19:50:11.103225 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 470) took 1033 ms. Trace:
I20260923 19:50:11.104522 6324 tablet_service.cc:1511] Processing CreateTablet for tablet e4375ff709a74bc6b8ef2073fb2c1d18 (DEFAULT_TABLE table=default.Table_98f26974f07c4799981e0b2b01d7cd8d [id=10d885fef8a6476e88b40043fe78b805]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:11.104696 5804 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f2799563250845b0b9d7d51b2367b16b consensus state has no leader
I20260923 19:50:11.104954 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4375ff709a74bc6b8ef2073fb2c1d18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.105809 6454 ts_tablet_manager.cc:1434] T 556b32b8ccd54c439f86b0069e2a5ce0 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.028s user 0.001s sys 0.001s
I20260923 19:50:11.106232 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 477) took 1608 ms. Trace:
I20260923 19:50:11.106366 6459 rpcz_store.cc:276] 0923 19:50:09.497653 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.521478 (+ 23825us) service_pool.cc:224] Handling call
0923 19:50:11.106083 (+1584605us) ts_tablet_manager.cc:1151] Deleting tablet 16144661b56c4f858c55e8e0d3999019
0923 19:50:11.106091 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:11.106190 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1541097}
W20260923 19:50:11.107337 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 16144661b56c4f858c55e8e0d3999019 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16144661b56c4f858c55e8e0d3999019 already in progress: creating tablet
I20260923 19:50:11.107509 6457 tablet_bootstrap.cc:492] T f5cb8dd5dcf54df9989dd808fe148ce6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:11.108354 6456 tablet_bootstrap.cc:654] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:11.112373 6454 tablet_bootstrap.cc:492] T ec4284d6a0fa416ca95b4d675c8e3912 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:11.112413 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_b6a984d11ea34876becc2d10cf242e3f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:11.113062 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b6a984d11ea34876becc2d10cf242e3f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:11.114078 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 479) took 1591 ms. Trace:
I20260923 19:50:11.114218 6459 rpcz_store.cc:276] 0923 19:50:09.522297 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.522352 (+ 55us) service_pool.cc:224] Handling call
0923 19:50:11.113912 (+1591560us) ts_tablet_manager.cc:1151] Deleting tablet 684eb2576b4b4730813b993e36b242df
0923 19:50:11.113923 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:11.114032 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1548638}
W20260923 19:50:11.114676 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 684eb2576b4b4730813b993e36b242df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 684eb2576b4b4730813b993e36b242df already in progress: creating tablet
I20260923 19:50:11.115116 6457 tablet_bootstrap.cc:654] T f5cb8dd5dcf54df9989dd808fe148ce6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:11.117941 5804 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_0d5d4338177845959f91952ec7ff7855" } new_table_name: "default.Table_527c2568db7446559d0c719602184b02" modify_external_catalogs: true
I20260923 19:50:11.121109 6454 tablet_bootstrap.cc:654] T ec4284d6a0fa416ca95b4d675c8e3912 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:11.121737 6456 tablet_bootstrap.cc:492] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:11.121941 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 5bc33295d8684e8583508124a8db5b8a (DEFAULT_TABLE table=default.Table_81c9757c73ef447b84367e06b0dc1614 [id=c6dfcde05b6f479eae46ade38b9c9f63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.121928 6456 ts_tablet_manager.cc:1403] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.035s user 0.004s sys 0.002s
I20260923 19:50:11.103332 6458 rpcz_store.cc:276] 0923 19:50:10.070020 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:10.070096 (+ 76us) service_pool.cc:224] Handling call
0923 19:50:11.103081 (+1032985us) ts_tablet_manager.cc:1151] Deleting tablet 66739afdf147413787acb0363aa37df6
0923 19:50:11.103091 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:11.103187 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1013803}
I20260923 19:50:11.122218 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 480) took 1583 ms. Trace:
I20260923 19:50:11.122339 6459 rpcz_store.cc:276] 0923 19:50:09.539190 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.543718 (+ 4528us) service_pool.cc:224] Handling call
0923 19:50:11.120229 (+1576511us) ts_tablet_manager.cc:1151] Deleting tablet 85f5ba9097674f9d889e178eaea4f0d7
0923 19:50:11.122064 (+ 1835us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:11.122180 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1550917}
W20260923 19:50:11.122488 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 66739afdf147413787acb0363aa37df6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66739afdf147413787acb0363aa37df6 already in progress: creating tablet
I20260923 19:50:11.122660 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bc33295d8684e8583508124a8db5b8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.122750 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 481) took 1521 ms. Trace:
I20260923 19:50:11.122869 6459 rpcz_store.cc:276] 0923 19:50:09.601100 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.601157 (+ 57us) service_pool.cc:224] Handling call
0923 19:50:11.122608 (+1521451us) ts_tablet_manager.cc:1151] Deleting tablet f1a4bccf6dd2411f83b86d782ecf5f40
0923 19:50:11.122617 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:11.122711 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1521185}
W20260923 19:50:11.122941 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 85f5ba9097674f9d889e178eaea4f0d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 85f5ba9097674f9d889e178eaea4f0d7 already in progress: creating tablet
W20260923 19:50:11.123394 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet f1a4bccf6dd2411f83b86d782ecf5f40 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1a4bccf6dd2411f83b86d782ecf5f40 already in progress: creating tablet
I20260923 19:50:11.123697 6459 tablet_replica.cc:333] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:11.123970 6459 raft_consensus.cc:2243] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:11.124228 6459 raft_consensus.cc:2272] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:11.124205 6323 tablet_service.cc:1511] Processing CreateTablet for tablet 5bc33295d8684e8583508124a8db5b8a (DEFAULT_TABLE table=default.Table_81c9757c73ef447b84367e06b0dc1614 [id=c6dfcde05b6f479eae46ade38b9c9f63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.124614 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bc33295d8684e8583508124a8db5b8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.126175 6459 ts_tablet_manager.cc:1916] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:11.129016 6458 tablet_replica.cc:333] T 86473c5cbca54b5792b038aef445998c P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:11.129228 6458 raft_consensus.cc:2243] T 86473c5cbca54b5792b038aef445998c P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:11.129392 6458 raft_consensus.cc:2272] T 86473c5cbca54b5792b038aef445998c P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:11.129930 6458 ts_tablet_manager.cc:1916] T 86473c5cbca54b5792b038aef445998c P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:11.130671 6456 raft_consensus.cc:359] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.130887 6456 raft_consensus.cc:385] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:11.130971 6456 raft_consensus.cc:740] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:11.131279 6456 consensus_queue.cc:260] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.133569 7123 raft_consensus.cc:493] T 5427b0f0218d4131b68a39e8e3bf02e7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:11.133734 7123 raft_consensus.cc:515] T 5427b0f0218d4131b68a39e8e3bf02e7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.134545 7123 leader_election.cc:290] T 5427b0f0218d4131b68a39e8e3bf02e7 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:11.135715 6057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5427b0f0218d4131b68a39e8e3bf02e7" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:11.136209 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5427b0f0218d4131b68a39e8e3bf02e7" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:11.137282 6137 leader_election.cc:304] T 5427b0f0218d4131b68a39e8e3bf02e7 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:11.137761 7123 raft_consensus.cc:2749] T 5427b0f0218d4131b68a39e8e3bf02e7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:11.140972 6456 ts_tablet_manager.cc:1434] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20260923 19:50:11.142058 6456 tablet_bootstrap.cc:492] T 31b0bdf719554d37993a802831e324ee P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:11.142925 5798 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 556b32b8ccd54c439f86b0069e2a5ce0 (table default.Table_bae34ce3ce95493d81bcd45d6806c756 [id=f329852cd968475584a70fbb8b1b1c3c]). Expected version 1 got 0
I20260923 19:50:11.143954 7113 raft_consensus.cc:493] T 6e781ccf4aa343fc924138c3cc2b04e6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:11.144106 7113 raft_consensus.cc:515] T 6e781ccf4aa343fc924138c3cc2b04e6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.144722 7113 leader_election.cc:290] T 6e781ccf4aa343fc924138c3cc2b04e6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:11.145371 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 2f074ac09fe7412f9f20e26a98c63e5a (DEFAULT_TABLE table=default.Table_303e0707d7d8434aa96fc5b4d1d8bfe8 [id=e3f19f9373a4412a8efe3471ad1f636c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.145757 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f074ac09fe7412f9f20e26a98c63e5a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:11.145732 6279 leader_election.cc:343] T 6e781ccf4aa343fc924138c3cc2b04e6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 6e781ccf4aa343fc924138c3cc2b04e6
I20260923 19:50:11.146605 6454 tablet_bootstrap.cc:492] T ec4284d6a0fa416ca95b4d675c8e3912 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:11.147044 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e781ccf4aa343fc924138c3cc2b04e6" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:11.147742 6280 leader_election.cc:343] T 6e781ccf4aa343fc924138c3cc2b04e6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:11.147872 6280 leader_election.cc:304] T 6e781ccf4aa343fc924138c3cc2b04e6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:11.147917 6457 tablet_bootstrap.cc:492] T f5cb8dd5dcf54df9989dd808fe148ce6 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:11.148082 6457 ts_tablet_manager.cc:1403] T f5cb8dd5dcf54df9989dd808fe148ce6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.055s user 0.002s sys 0.002s
I20260923 19:50:11.148377 7113 raft_consensus.cc:2749] T 6e781ccf4aa343fc924138c3cc2b04e6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:11.148734 6454 ts_tablet_manager.cc:1403] T ec4284d6a0fa416ca95b4d675c8e3912 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.001s
I20260923 19:50:11.148808 6457 raft_consensus.cc:359] T f5cb8dd5dcf54df9989dd808fe148ce6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.149006 6457 raft_consensus.cc:385] T f5cb8dd5dcf54df9989dd808fe148ce6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:11.149084 6457 raft_consensus.cc:740] T f5cb8dd5dcf54df9989dd808fe148ce6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:11.149345 6457 consensus_queue.cc:260] T f5cb8dd5dcf54df9989dd808fe148ce6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.150131 6457 ts_tablet_manager.cc:1434] T f5cb8dd5dcf54df9989dd808fe148ce6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:50:11.150576 6454 raft_consensus.cc:359] T ec4284d6a0fa416ca95b4d675c8e3912 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.151387 6454 raft_consensus.cc:385] T ec4284d6a0fa416ca95b4d675c8e3912 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:11.151537 6454 raft_consensus.cc:740] T ec4284d6a0fa416ca95b4d675c8e3912 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:11.151844 6454 consensus_queue.cc:260] T ec4284d6a0fa416ca95b4d675c8e3912 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.151012 6457 tablet_bootstrap.cc:492] T 58c24aa494bc4da28536dfa1df6123b7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:11.153388 6308 tablet_service.cc:1511] Processing CreateTablet for tablet 2f074ac09fe7412f9f20e26a98c63e5a (DEFAULT_TABLE table=default.Table_303e0707d7d8434aa96fc5b4d1d8bfe8 [id=e3f19f9373a4412a8efe3471ad1f636c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.153791 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f074ac09fe7412f9f20e26a98c63e5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.155575 6456 tablet_bootstrap.cc:654] T 31b0bdf719554d37993a802831e324ee P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:11.157374 6454 ts_tablet_manager.cc:1434] T ec4284d6a0fa416ca95b4d675c8e3912 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260923 19:50:11.157589 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 2f074ac09fe7412f9f20e26a98c63e5a (DEFAULT_TABLE table=default.Table_303e0707d7d8434aa96fc5b4d1d8bfe8 [id=e3f19f9373a4412a8efe3471ad1f636c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.158073 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f074ac09fe7412f9f20e26a98c63e5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.163172 6454 tablet_bootstrap.cc:492] T 359b08ef348d4be68b14f9e871a5e519 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:11.166601 6454 tablet_bootstrap.cc:654] T 359b08ef348d4be68b14f9e871a5e519 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:11.163661 6457 tablet_bootstrap.cc:654] T 58c24aa494bc4da28536dfa1df6123b7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:11.171082 6459 ts_tablet_manager.cc:1929] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:11.171285 6459 log.cc:1199] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/063fc0e77d294ddf8a02e9ab5968a5e3
I20260923 19:50:11.171783 6459 ts_tablet_manager.cc:1950] T 063fc0e77d294ddf8a02e9ab5968a5e3 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:11.172675 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 482) took 1448 ms. Trace:
I20260923 19:50:11.172845 6459 rpcz_store.cc:276] 0923 19:50:09.724540 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.724617 (+ 77us) service_pool.cc:224] Handling call
0923 19:50:11.123627 (+1399010us) ts_tablet_manager.cc:1151] Deleting tablet 063fc0e77d294ddf8a02e9ab5968a5e3
0923 19:50:11.123636 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:11.138486 (+ 14850us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:11.171007 (+ 32521us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:11.172623 (+ 1616us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1398708}
I20260923 19:50:11.173327 6459 tablet_replica.cc:333] T 789c54477bec4636bb3669e1f62730e2 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:11.173462 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 063fc0e77d294ddf8a02e9ab5968a5e3 (table default.Table_3034bb02271e459ebedf3424b5f8f908 [id=83a8f991844b4cb0a9008f5bc3dea17b]) successfully deleted
I20260923 19:50:11.173647 6459 raft_consensus.cc:2243] T 789c54477bec4636bb3669e1f62730e2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:11.173982 6459 raft_consensus.cc:2272] T 789c54477bec4636bb3669e1f62730e2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:11.175040 6456 tablet_bootstrap.cc:492] T 31b0bdf719554d37993a802831e324ee P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:11.175215 6456 ts_tablet_manager.cc:1403] T 31b0bdf719554d37993a802831e324ee P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.033s user 0.007s sys 0.001s
I20260923 19:50:11.175552 6459 ts_tablet_manager.cc:1916] T 789c54477bec4636bb3669e1f62730e2 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:11.176081 6456 raft_consensus.cc:359] T 31b0bdf719554d37993a802831e324ee P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.176280 6456 raft_consensus.cc:385] T 31b0bdf719554d37993a802831e324ee P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:11.176397 6456 raft_consensus.cc:740] T 31b0bdf719554d37993a802831e324ee P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:11.176695 6456 consensus_queue.cc:260] T 31b0bdf719554d37993a802831e324ee P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.180226 5803 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_e4788af31ab94b6eae62e66d4f0e8c93" } modify_external_catalogs: true
I20260923 19:50:11.180513 5803 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_e4788af31ab94b6eae62e66d4f0e8c93" } modify_external_catalogs: true
I20260923 19:50:11.183162 6456 ts_tablet_manager.cc:1434] T 31b0bdf719554d37993a802831e324ee P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260923 19:50:11.187968 5800 master_service.cc:960] ReplaceTablet: received request to replace tablet edb52bd88b424129bbdc45de89b56efb from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:11.188257 6456 tablet_bootstrap.cc:492] T ffcf1a144f3c42719a5aa5deed537975 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:11.190251 6456 tablet_bootstrap.cc:654] T ffcf1a144f3c42719a5aa5deed537975 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:11.191457 6030 tablet_service.cc:1511] Processing CreateTablet for tablet 1497ebe16d1a4eb6afbc1988dddf8951 (DEFAULT_TABLE table=default.Table_f276fef2266243f0add02a76de24e3c6 [id=aec60bb0625b4e7eae380d831e37a25c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.191869 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1497ebe16d1a4eb6afbc1988dddf8951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.192782 6179 tablet_service.cc:1511] Processing CreateTablet for tablet 29eb596f368c4143a6a32d47ebb5efd4 (DEFAULT_TABLE table=default.Table_9c8dcd2021614daf8eb92e1310ca9675 [id=2e1b93bcb41641ff8257c6dd9cf4b4b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.193162 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29eb596f368c4143a6a32d47ebb5efd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.194258 6312 tablet_service.cc:1511] Processing CreateTablet for tablet 29eb596f368c4143a6a32d47ebb5efd4 (DEFAULT_TABLE table=default.Table_9c8dcd2021614daf8eb92e1310ca9675 [id=2e1b93bcb41641ff8257c6dd9cf4b4b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.194626 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29eb596f368c4143a6a32d47ebb5efd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.194857 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 94a6af2036ae47cfbbd0f6940b596218 (DEFAULT_TABLE table=default.Table_7b0ae7c8259245379ef654b3a96718e0 [id=ce0933a5fc484f628b1140de4b6d47e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.195202 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94a6af2036ae47cfbbd0f6940b596218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.195829 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 29eb596f368c4143a6a32d47ebb5efd4 (DEFAULT_TABLE table=default.Table_9c8dcd2021614daf8eb92e1310ca9675 [id=2e1b93bcb41641ff8257c6dd9cf4b4b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.196172 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29eb596f368c4143a6a32d47ebb5efd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.200398 6202 raft_consensus.cc:3060] T 5427b0f0218d4131b68a39e8e3bf02e7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:11.212946 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_53cf6ab2721c4d7baa36065c8d48ffc1" } modify_external_catalogs: true
I20260923 19:50:11.213150 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_53cf6ab2721c4d7baa36065c8d48ffc1" } modify_external_catalogs: true
I20260923 19:50:11.219380 5799 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_bae34ce3ce95493d81bcd45d6806c756 [id=f329852cd968475584a70fbb8b1b1c3c] alter complete (version 1)
I20260923 19:50:11.223981 6310 tablet_service.cc:1558] Processing DeleteTablet for tablet 6fe14389e2a3487587dfcf7a8b4b242d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:11.224879 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet 015c14b447fe4cd18d197b2d1ed5884e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:11.224943 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f627b7b9ff74750bd8dd59840bf77db with delete_type TABLET_DATA_DELETED (replaced by tablet d40327145d4d44009f12358eacacf0dd) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:11.225124 6310 tablet_service.cc:1558] Processing DeleteTablet for tablet c48d4a8371fa4454b7c67291db3ab796 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:11.225282 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet 359b08ef348d4be68b14f9e871a5e519 with delete_type TABLET_DATA_DELETED (replaced by tablet b7ba284e81bc4388bbd6456a41d1f9f4) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:11.225867 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ccfe6531fc44f86a0edc8bda1547442 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:11.226109 6030 tablet_service.cc:1558] Processing DeleteTablet for tablet 235b4b8081ad4a13937a7941344dbc33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:04 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:11.226123 6022 tablet_service.cc:1558] Processing DeleteTablet for tablet d2298d814a104f5cb62196be3bf0dae6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:11.226572 6461 tablet_replica.cc:333] T 2ccfe6531fc44f86a0edc8bda1547442 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:11.226737 6461 raft_consensus.cc:2243] T 2ccfe6531fc44f86a0edc8bda1547442 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:11.226893 6461 raft_consensus.cc:2272] T 2ccfe6531fc44f86a0edc8bda1547442 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:11.227664 6461 ts_tablet_manager.cc:1916] T 2ccfe6531fc44f86a0edc8bda1547442 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:11.231823 6454 tablet_bootstrap.cc:492] T 359b08ef348d4be68b14f9e871a5e519 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:11.232065 6454 ts_tablet_manager.cc:1403] T 359b08ef348d4be68b14f9e871a5e519 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.069s user 0.006s sys 0.002s
I20260923 19:50:11.233173 6454 raft_consensus.cc:359] T 359b08ef348d4be68b14f9e871a5e519 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.233544 6454 raft_consensus.cc:385] T 359b08ef348d4be68b14f9e871a5e519 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:11.233642 6454 raft_consensus.cc:740] T 359b08ef348d4be68b14f9e871a5e519 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:11.234094 6454 consensus_queue.cc:260] T 359b08ef348d4be68b14f9e871a5e519 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.236002 6461 ts_tablet_manager.cc:1929] T 2ccfe6531fc44f86a0edc8bda1547442 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:11.236347 6461 log.cc:1199] T 2ccfe6531fc44f86a0edc8bda1547442 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/2ccfe6531fc44f86a0edc8bda1547442
I20260923 19:50:11.236769 6461 ts_tablet_manager.cc:1950] T 2ccfe6531fc44f86a0edc8bda1547442 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:11.237943 6454 ts_tablet_manager.cc:1434] T 359b08ef348d4be68b14f9e871a5e519 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.006s user 0.002s sys 0.002s
I20260923 19:50:11.238030 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 2ccfe6531fc44f86a0edc8bda1547442 (table default.Table_bbfd70af85d34f29bc8bbd6dbf85023d [id=d21707fbdafa4fb4a14990578cc7ab56]) successfully deleted
I20260923 19:50:11.238488 6461 tablet_replica.cc:333] T 235b4b8081ad4a13937a7941344dbc33 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:11.238758 6461 raft_consensus.cc:2243] T 235b4b8081ad4a13937a7941344dbc33 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:11.238981 6461 raft_consensus.cc:2272] T 235b4b8081ad4a13937a7941344dbc33 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:11.240696 6164 tablet_service.cc:1511] Processing CreateTablet for tablet 1497ebe16d1a4eb6afbc1988dddf8951 (DEFAULT_TABLE table=default.Table_f276fef2266243f0add02a76de24e3c6 [id=aec60bb0625b4e7eae380d831e37a25c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.241619 6308 tablet_service.cc:1511] Processing CreateTablet for tablet 1497ebe16d1a4eb6afbc1988dddf8951 (DEFAULT_TABLE table=default.Table_f276fef2266243f0add02a76de24e3c6 [id=aec60bb0625b4e7eae380d831e37a25c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.242676 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1497ebe16d1a4eb6afbc1988dddf8951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.243340 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1497ebe16d1a4eb6afbc1988dddf8951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.248000 7148 raft_consensus.cc:493] T 556b32b8ccd54c439f86b0069e2a5ce0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:11.248199 7148 raft_consensus.cc:515] T 556b32b8ccd54c439f86b0069e2a5ce0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.249181 7148 leader_election.cc:290] T 556b32b8ccd54c439f86b0069e2a5ce0 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:11.251371 6461 ts_tablet_manager.cc:1916] T 235b4b8081ad4a13937a7941344dbc33 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:11.252650 6057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556b32b8ccd54c439f86b0069e2a5ce0" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:11.254990 5805 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_59faad35003f4e6f95781fbb1895f6aa" } modify_external_catalogs: true
I20260923 19:50:11.255174 5805 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_59faad35003f4e6f95781fbb1895f6aa" } modify_external_catalogs: true
I20260923 19:50:11.256441 5801 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_63a3afc2f4ac454cb8bb6551ba17376c" } modify_external_catalogs: true
I20260923 19:50:11.256585 5801 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_63a3afc2f4ac454cb8bb6551ba17376c" } modify_external_catalogs: true
I20260923 19:50:11.257726 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_7ddfd6e3bbc7414e84d2785f412ed18f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:11.258440 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7ddfd6e3bbc7414e84d2785f412ed18f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:11.258344 6454 tablet_bootstrap.cc:492] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:11.259569 5799 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_3690c4b8c8334a47930dd2af3aaa23ae" } modify_external_catalogs: true
I20260923 19:50:11.259720 5799 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_3690c4b8c8334a47930dd2af3aaa23ae" } modify_external_catalogs: true
I20260923 19:50:11.261847 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 94a6af2036ae47cfbbd0f6940b596218 (DEFAULT_TABLE table=default.Table_7b0ae7c8259245379ef654b3a96718e0 [id=ce0933a5fc484f628b1140de4b6d47e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.262264 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94a6af2036ae47cfbbd0f6940b596218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.263398 6179 tablet_service.cc:1511] Processing CreateTablet for tablet e4ad9baac560463fabc80828074b46c1 (DEFAULT_TABLE table=default.Table_973f7a2560ab48ad8d84aeb2f4fc235b [id=72c42d0bf8264d809c5ec888d05db821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.263767 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4ad9baac560463fabc80828074b46c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.266300 6174 tablet_service.cc:1511] Processing CreateTablet for tablet 7f9ec2a95bad40f7b229482b275110a3 (DEFAULT_TABLE table=default.Table_53ff161409a94c28a2d7f0a67a6eb839 [id=b3a6838530c74581b0b5afbca24f80ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.266646 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f9ec2a95bad40f7b229482b275110a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.266641 6022 tablet_service.cc:1511] Processing CreateTablet for tablet e4ad9baac560463fabc80828074b46c1 (DEFAULT_TABLE table=default.Table_973f7a2560ab48ad8d84aeb2f4fc235b [id=72c42d0bf8264d809c5ec888d05db821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.267037 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4ad9baac560463fabc80828074b46c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.250392 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556b32b8ccd54c439f86b0069e2a5ce0" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:11.270210 6030 tablet_service.cc:1511] Processing CreateTablet for tablet 7539bd538c6343eda16bedfdf8545316 (DEFAULT_TABLE table=default.Table_b065e06a599f4668a7ac9c2e0bd7d989 [id=5d5f431801bb41ee9b9b4373e04d0ed9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.262123 6321 tablet_service.cc:1511] Processing CreateTablet for tablet 94a6af2036ae47cfbbd0f6940b596218 (DEFAULT_TABLE table=default.Table_7b0ae7c8259245379ef654b3a96718e0 [id=ce0933a5fc484f628b1140de4b6d47e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.270558 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7539bd538c6343eda16bedfdf8545316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.265069 6312 tablet_service.cc:1511] Processing CreateTablet for tablet 7539bd538c6343eda16bedfdf8545316 (DEFAULT_TABLE table=default.Table_b065e06a599f4668a7ac9c2e0bd7d989 [id=5d5f431801bb41ee9b9b4373e04d0ed9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.270815 6139 leader_election.cc:304] T 556b32b8ccd54c439f86b0069e2a5ce0 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:11.270944 6324 tablet_service.cc:1511] Processing CreateTablet for tablet e4ad9baac560463fabc80828074b46c1 (DEFAULT_TABLE table=default.Table_973f7a2560ab48ad8d84aeb2f4fc235b [id=72c42d0bf8264d809c5ec888d05db821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.271287 7123 raft_consensus.cc:2749] T 556b32b8ccd54c439f86b0069e2a5ce0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:11.271683 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94a6af2036ae47cfbbd0f6940b596218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.274019 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7539bd538c6343eda16bedfdf8545316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.274190 6031 tablet_service.cc:1511] Processing CreateTablet for tablet 7f9ec2a95bad40f7b229482b275110a3 (DEFAULT_TABLE table=default.Table_53ff161409a94c28a2d7f0a67a6eb839 [id=b3a6838530c74581b0b5afbca24f80ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.274524 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f9ec2a95bad40f7b229482b275110a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.274955 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 7539bd538c6343eda16bedfdf8545316 (DEFAULT_TABLE table=default.Table_b065e06a599f4668a7ac9c2e0bd7d989 [id=5d5f431801bb41ee9b9b4373e04d0ed9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.275326 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7539bd538c6343eda16bedfdf8545316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.278319 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 7f9ec2a95bad40f7b229482b275110a3 (DEFAULT_TABLE table=default.Table_53ff161409a94c28a2d7f0a67a6eb839 [id=b3a6838530c74581b0b5afbca24f80ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.278707 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f9ec2a95bad40f7b229482b275110a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.283895 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4ad9baac560463fabc80828074b46c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.284335 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 1d905af116d9446ab001555014b2a2d2 (DEFAULT_TABLE table=default.Table_f022376095554ea9a858fae27248e742 [id=bfc4384500734a0aa3e193ddcc1c782d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.284770 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d905af116d9446ab001555014b2a2d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.286078 6034 tablet_service.cc:1511] Processing CreateTablet for tablet b8d209f958cc452c8b864e010c9da6a0 (DEFAULT_TABLE table=default.Table_3237cd4c60f34314a0570aacaf0b5349 [id=26a627e9c7944f90b61000e0406dca73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.286432 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8d209f958cc452c8b864e010c9da6a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.286832 6174 tablet_service.cc:1511] Processing CreateTablet for tablet b8d209f958cc452c8b864e010c9da6a0 (DEFAULT_TABLE table=default.Table_3237cd4c60f34314a0570aacaf0b5349 [id=26a627e9c7944f90b61000e0406dca73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.287215 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8d209f958cc452c8b864e010c9da6a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.288977 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 14cce39682bd4c4c8dbaada51e54df57 (DEFAULT_TABLE table=default.Table_d8c7bae4e0c0497e99b6d8e96a5d4025 [id=4b8509c8748b41fd8853d3b456e1333a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.289364 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14cce39682bd4c4c8dbaada51e54df57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.290297 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 14cce39682bd4c4c8dbaada51e54df57 (DEFAULT_TABLE table=default.Table_d8c7bae4e0c0497e99b6d8e96a5d4025 [id=4b8509c8748b41fd8853d3b456e1333a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.290714 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14cce39682bd4c4c8dbaada51e54df57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.289971 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 1d905af116d9446ab001555014b2a2d2 (DEFAULT_TABLE table=default.Table_f022376095554ea9a858fae27248e742 [id=bfc4384500734a0aa3e193ddcc1c782d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.291536 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d905af116d9446ab001555014b2a2d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.294741 6032 tablet_service.cc:1511] Processing CreateTablet for tablet 14cce39682bd4c4c8dbaada51e54df57 (DEFAULT_TABLE table=default.Table_d8c7bae4e0c0497e99b6d8e96a5d4025 [id=4b8509c8748b41fd8853d3b456e1333a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.295109 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14cce39682bd4c4c8dbaada51e54df57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.284308 6312 tablet_service.cc:1511] Processing CreateTablet for tablet 1d905af116d9446ab001555014b2a2d2 (DEFAULT_TABLE table=default.Table_f022376095554ea9a858fae27248e742 [id=bfc4384500734a0aa3e193ddcc1c782d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.286386 6323 tablet_service.cc:1511] Processing CreateTablet for tablet b8d209f958cc452c8b864e010c9da6a0 (DEFAULT_TABLE table=default.Table_3237cd4c60f34314a0570aacaf0b5349 [id=26a627e9c7944f90b61000e0406dca73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.299443 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d905af116d9446ab001555014b2a2d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.299734 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8d209f958cc452c8b864e010c9da6a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.309993 6454 tablet_bootstrap.cc:654] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:11.311100 6456 tablet_bootstrap.cc:492] T ffcf1a144f3c42719a5aa5deed537975 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:11.311580 6456 ts_tablet_manager.cc:1403] T ffcf1a144f3c42719a5aa5deed537975 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.123s user 0.021s sys 0.017s
I20260923 19:50:11.312294 6459 ts_tablet_manager.cc:1929] T 789c54477bec4636bb3669e1f62730e2 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:11.313812 6456 raft_consensus.cc:359] T ffcf1a144f3c42719a5aa5deed537975 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.314364 6459 log.cc:1199] T 789c54477bec4636bb3669e1f62730e2 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/789c54477bec4636bb3669e1f62730e2
I20260923 19:50:11.319087 6461 ts_tablet_manager.cc:1929] T 235b4b8081ad4a13937a7941344dbc33 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:11.319499 6461 log.cc:1199] T 235b4b8081ad4a13937a7941344dbc33 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/235b4b8081ad4a13937a7941344dbc33
I20260923 19:50:11.320713 6461 ts_tablet_manager.cc:1950] T 235b4b8081ad4a13937a7941344dbc33 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:11.321911 6456 raft_consensus.cc:385] T ffcf1a144f3c42719a5aa5deed537975 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:11.321907 7113 raft_consensus.cc:493] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:11.322064 6456 raft_consensus.cc:740] T ffcf1a144f3c42719a5aa5deed537975 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:11.322569 7113 raft_consensus.cc:515] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.323297 7113 leader_election.cc:290] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:11.323791 6456 consensus_queue.cc:260] T ffcf1a144f3c42719a5aa5deed537975 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.324541 6456 ts_tablet_manager.cc:1434] T ffcf1a144f3c42719a5aa5deed537975 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260923 19:50:11.324932 6456 tablet_bootstrap.cc:492] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:11.327013 6456 tablet_bootstrap.cc:654] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:11.327989 6057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d35ebef3c24a2e89233dd900b63513" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:11.328220 6057 raft_consensus.cc:2468] T 85d35ebef3c24a2e89233dd900b63513 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:11.329198 6279 leader_election.cc:304] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:11.329658 7113 raft_consensus.cc:2804] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:11.329753 7113 raft_consensus.cc:493] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:11.329861 7113 raft_consensus.cc:3060] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:11.333130 7113 raft_consensus.cc:515] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.334173 6058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d35ebef3c24a2e89233dd900b63513" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:11.334332 6058 raft_consensus.cc:3060] T 85d35ebef3c24a2e89233dd900b63513 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:11.334399 7113 leader_election.cc:290] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:11.336090 6457 tablet_bootstrap.cc:492] T 58c24aa494bc4da28536dfa1df6123b7 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:11.336916 6457 ts_tablet_manager.cc:1403] T 58c24aa494bc4da28536dfa1df6123b7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.186s user 0.008s sys 0.007s
I20260923 19:50:11.337558 6457 raft_consensus.cc:359] T 58c24aa494bc4da28536dfa1df6123b7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.337714 6457 raft_consensus.cc:385] T 58c24aa494bc4da28536dfa1df6123b7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:11.337762 6457 raft_consensus.cc:740] T 58c24aa494bc4da28536dfa1df6123b7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:11.338129 6058 raft_consensus.cc:2468] T 85d35ebef3c24a2e89233dd900b63513 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:11.338868 6279 leader_election.cc:304] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:11.341981 7113 raft_consensus.cc:2804] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:11.343422 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet 908596339b2e4f7f8ddb7f9cd5bdcc3e with delete_type TABLET_DATA_DELETED (replaced by tablet 688bb1055ba94c2996cdfea6dea76416) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:11.343931 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet f5cb8dd5dcf54df9989dd808fe148ce6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:11.345417 6457 consensus_queue.cc:260] T 58c24aa494bc4da28536dfa1df6123b7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.346468 6457 ts_tablet_manager.cc:1434] T 58c24aa494bc4da28536dfa1df6123b7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260923 19:50:11.346778 6457 tablet_bootstrap.cc:492] T 896bd068e6b343e48eb2a01679b49326 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:11.349524 6310 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e781ccf4aa343fc924138c3cc2b04e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:11.350549 5804 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1cf016ff0bb8418d84358d17876338bf consensus state has no leader
I20260923 19:50:11.353112 5804 master_service.cc:960] ReplaceTablet: received request to replace tablet 0e123b69877e4b1fbcdb2b27960864e9 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:11.353675 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_cef826cee2414ab28c8dd4a4fc039c1f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:11.354477 6457 tablet_bootstrap.cc:654] T 896bd068e6b343e48eb2a01679b49326 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:11.357928 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet daafbafae5004b8499e7ea93342c0517 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:11.358454 6310 tablet_service.cc:1558] Processing DeleteTablet for tablet 31b0bdf719554d37993a802831e324ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:11.360644 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cef826cee2414ab28c8dd4a4fc039c1f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:11.362278 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_8d9c168e75b24278869d2281218a0ad5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:11.362932 5796 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet ec4284d6a0fa416ca95b4d675c8e3912 (table default.Table_00f5789c01e94f8e8c65077f98b164c2 [id=29a38060f3bf43f3900ad0ee42fbde9a]). Expected version 1 got 0
W20260923 19:50:11.363123 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d9c168e75b24278869d2281218a0ad5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:11.364313 5796 master_service.cc:960] ReplaceTablet: received request to replace tablet a0d817069e664199bff0d7591548e2d7 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:11.367192 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet 58c24aa494bc4da28536dfa1df6123b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:11.374087 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet f108ebdaecab42e7b57057c7ecfbe690 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:11.377677 6458 ts_tablet_manager.cc:1929] T 86473c5cbca54b5792b038aef445998c P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:11.377912 6458 log.cc:1199] T 86473c5cbca54b5792b038aef445998c P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/86473c5cbca54b5792b038aef445998c
I20260923 19:50:11.378381 6458 ts_tablet_manager.cc:1950] T 86473c5cbca54b5792b038aef445998c P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:11.379453 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 472) took 1288 ms. Trace:
I20260923 19:50:11.379604 6458 rpcz_store.cc:276] 0923 19:50:10.091133 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:10.091215 (+ 82us) service_pool.cc:224] Handling call
0923 19:50:11.128941 (+1037726us) ts_tablet_manager.cc:1151] Deleting tablet 86473c5cbca54b5792b038aef445998c
0923 19:50:11.128951 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:11.133226 (+ 4275us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:11.377567 (+244341us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:11.379367 (+ 1800us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1034572}
I20260923 19:50:11.380225 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 473) took 1246 ms. Trace:
I20260923 19:50:11.385315 6457 tablet_bootstrap.cc:492] T 896bd068e6b343e48eb2a01679b49326 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:11.385303 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 235b4b8081ad4a13937a7941344dbc33 (table default.Table_1a5602208673400faf5f272297ff82b9 [id=a7241c5e33894e8c97e723b3b90b8cc7]) successfully deleted
I20260923 19:50:11.385632 6461 tablet_replica.cc:333] T d2298d814a104f5cb62196be3bf0dae6 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:11.385830 6461 raft_consensus.cc:2243] T d2298d814a104f5cb62196be3bf0dae6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:11.386023 6461 raft_consensus.cc:2272] T d2298d814a104f5cb62196be3bf0dae6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:11.385591 6457 ts_tablet_manager.cc:1403] T 896bd068e6b343e48eb2a01679b49326 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.039s user 0.001s sys 0.002s
I20260923 19:50:11.386775 6461 ts_tablet_manager.cc:1916] T d2298d814a104f5cb62196be3bf0dae6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:11.387344 6457 raft_consensus.cc:359] T 896bd068e6b343e48eb2a01679b49326 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.387594 6457 raft_consensus.cc:385] T 896bd068e6b343e48eb2a01679b49326 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:11.387702 6457 raft_consensus.cc:740] T 896bd068e6b343e48eb2a01679b49326 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:11.387965 6457 consensus_queue.cc:260] T 896bd068e6b343e48eb2a01679b49326 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.388898 6457 ts_tablet_manager.cc:1434] T 896bd068e6b343e48eb2a01679b49326 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260923 19:50:11.391090 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 39261cedbdb54d1f8ae0e07ae1cfeb3e
I20260923 19:50:11.391607 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 86473c5cbca54b5792b038aef445998c (table default.Table_f1de0114e81245fdb95e257431f5a975 [id=7f0d9665430447528c3829934eb4b634]) successfully deleted
I20260923 19:50:11.392256 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet 39261cedbdb54d1f8ae0e07ae1cfeb3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:11.392820 6457 tablet_bootstrap.cc:492] T 1fcd1c1bfd2c437a955c34569605a6d4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:11.393306 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet 39261cedbdb54d1f8ae0e07ae1cfeb3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:11.393518 7173 raft_consensus.cc:493] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:11.393823 7173 raft_consensus.cc:515] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.394682 7173 leader_election.cc:290] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:11.395038 6457 tablet_bootstrap.cc:654] T 1fcd1c1bfd2c437a955c34569605a6d4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:11.399204 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_307ba44a8b0641cdaaa0ef43e10172e1" } new_table_name: "default.Table_bf20f5ba63594cce94f323629947c04c" modify_external_catalogs: true
I20260923 19:50:11.400110 7174 raft_consensus.cc:493] T 2f627b7b9ff74750bd8dd59840bf77db P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:11.400319 7174 raft_consensus.cc:515] T 2f627b7b9ff74750bd8dd59840bf77db P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.401126 7174 leader_election.cc:290] T 2f627b7b9ff74750bd8dd59840bf77db P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:11.403024 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d35ebef3c24a2e89233dd900b63513" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:11.403417 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d35ebef3c24a2e89233dd900b63513" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
W20260923 19:50:11.405287 6280 leader_election.cc:343] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:11.405659 6280 leader_election.cc:343] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:11.405781 7172 consensus_queue.cc:1048] T f4e3e64fdf584743a3a88df5d6600b22 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:11.406230 7134 raft_consensus.cc:493] T 896bd068e6b343e48eb2a01679b49326 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260923 19:50:11.406402 6279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.143.193:39887, user_credentials={real_user=slave}} blocked reactor thread for 66400.7us
I20260923 19:50:11.406356 7134 raft_consensus.cc:515] T 896bd068e6b343e48eb2a01679b49326 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.406654 7123 raft_consensus.cc:493] T 495292cacf3b42a5b633ad40e5e01972 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:11.406917 7134 leader_election.cc:290] T 896bd068e6b343e48eb2a01679b49326 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:11.407459 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896bd068e6b343e48eb2a01679b49326" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:11.408056 5996 leader_election.cc:343] T 896bd068e6b343e48eb2a01679b49326 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:11.408409 7113 raft_consensus.cc:697] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:11.408744 7113 consensus_queue.cc:237] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:11.410843 6279 leader_election.cc:343] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 359b08ef348d4be68b14f9e871a5e519
W20260923 19:50:11.411062 6279 leader_election.cc:343] T 2f627b7b9ff74750bd8dd59840bf77db P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 2f627b7b9ff74750bd8dd59840bf77db
I20260923 19:50:11.413909 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet 896bd068e6b343e48eb2a01679b49326 with delete_type TABLET_DATA_DELETED (replaced by tablet 0c537304c32c44adaa1e05de4496293f) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:11.414712 5800 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet edb52bd88b424129bbdc45de89b56efb
I20260923 19:50:11.415361 5800 catalog_manager.cc:6934] ReplaceTablet: tablet edb52bd88b424129bbdc45de89b56efb deleted and replaced by tablet 1f6df2c7b8c34ff2a358acdc58543991
I20260923 19:50:11.416543 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet edb52bd88b424129bbdc45de89b56efb with delete_type TABLET_DATA_DELETED (replaced by tablet 1f6df2c7b8c34ff2a358acdc58543991) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:11.416877 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet edb52bd88b424129bbdc45de89b56efb with delete_type TABLET_DATA_DELETED (replaced by tablet 1f6df2c7b8c34ff2a358acdc58543991) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:11.421723 5800 master_service.cc:960] ReplaceTablet: received request to replace tablet 18a31ed6bea444e7888f374927f90a60 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:11.422732 6459 ts_tablet_manager.cc:1950] T 789c54477bec4636bb3669e1f62730e2 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:11.424372 6457 tablet_bootstrap.cc:492] T 1fcd1c1bfd2c437a955c34569605a6d4 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:11.424517 6457 ts_tablet_manager.cc:1403] T 1fcd1c1bfd2c437a955c34569605a6d4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.032s user 0.000s sys 0.002s
I20260923 19:50:11.425138 6457 raft_consensus.cc:359] T 1fcd1c1bfd2c437a955c34569605a6d4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.425300 6457 raft_consensus.cc:385] T 1fcd1c1bfd2c437a955c34569605a6d4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:11.425352 6457 raft_consensus.cc:740] T 1fcd1c1bfd2c437a955c34569605a6d4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:11.425509 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896bd068e6b343e48eb2a01679b49326" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:11.426131 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet edb52bd88b424129bbdc45de89b56efb with delete_type TABLET_DATA_DELETED (replaced by tablet 1f6df2c7b8c34ff2a358acdc58543991) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:11.424276 7123 raft_consensus.cc:515] T 495292cacf3b42a5b633ad40e5e01972 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.428011 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495292cacf3b42a5b633ad40e5e01972" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:11.428221 6344 raft_consensus.cc:2468] T 495292cacf3b42a5b633ad40e5e01972 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:11.431283 6456 tablet_bootstrap.cc:492] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:11.431726 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet ba639d8c68cf49a49a5ec5729143cf6b
I20260923 19:50:11.431965 6456 ts_tablet_manager.cc:1403] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.107s user 0.004s sys 0.006s
W20260923 19:50:11.426198 5995 leader_election.cc:343] T 896bd068e6b343e48eb2a01679b49326 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:11.433739 6456 raft_consensus.cc:359] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.433827 5995 leader_election.cc:304] T 896bd068e6b343e48eb2a01679b49326 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:11.433938 6456 raft_consensus.cc:385] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:11.434029 6456 raft_consensus.cc:740] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:11.434077 7134 raft_consensus.cc:2749] T 896bd068e6b343e48eb2a01679b49326 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:11.434517 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet ba639d8c68cf49a49a5ec5729143cf6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:11.434661 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet ba639d8c68cf49a49a5ec5729143cf6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:11.435230 6456 consensus_queue.cc:260] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.425560 6457 consensus_queue.cc:260] T 1fcd1c1bfd2c437a955c34569605a6d4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.437460 7123 leader_election.cc:290] T 495292cacf3b42a5b633ad40e5e01972 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:11.439010 5802 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a5e5938cb98d49b2828f047807b2b784" } new_table_name: "default.Table_f6755f452e8d41c4b9d64c3ee2735188" modify_external_catalogs: true
I20260923 19:50:11.440398 6457 ts_tablet_manager.cc:1434] T 1fcd1c1bfd2c437a955c34569605a6d4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.016s user 0.000s sys 0.002s
I20260923 19:50:11.441674 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f627b7b9ff74750bd8dd59840bf77db" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:11.442267 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359b08ef348d4be68b14f9e871a5e519" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:11.442817 6280 leader_election.cc:343] T 2f627b7b9ff74750bd8dd59840bf77db P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:11.442970 6280 leader_election.cc:304] T 2f627b7b9ff74750bd8dd59840bf77db P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:11.443624 7176 raft_consensus.cc:2749] T 2f627b7b9ff74750bd8dd59840bf77db P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:11.445115 6457 tablet_bootstrap.cc:492] T 18bab39d85f94f4283f0b18c1c9b48a2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:11.446687 6457 tablet_bootstrap.cc:654] T 18bab39d85f94f4283f0b18c1c9b48a2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:11.446915 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet 39261cedbdb54d1f8ae0e07ae1cfeb3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:11.447088 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet 359b08ef348d4be68b14f9e871a5e519 with delete_type TABLET_DATA_DELETED (replaced by tablet b7ba284e81bc4388bbd6456a41d1f9f4) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:11.447654 6139 leader_election.cc:304] T 495292cacf3b42a5b633ad40e5e01972 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
W20260923 19:50:11.447858 6137 leader_election.cc:343] T 495292cacf3b42a5b633ad40e5e01972 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 495292cacf3b42a5b633ad40e5e01972
I20260923 19:50:11.448201 6178 tablet_service.cc:1558] Processing DeleteTablet for tablet ba639d8c68cf49a49a5ec5729143cf6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:11.448783 6201 raft_consensus.cc:2468] T 359b08ef348d4be68b14f9e871a5e519 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:11.449268 6280 leader_election.cc:304] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:11.449702 7123 raft_consensus.cc:2804] T 495292cacf3b42a5b633ad40e5e01972 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:11.449945 7176 raft_consensus.cc:2804] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:11.450145 7176 raft_consensus.cc:493] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:11.450165 7123 raft_consensus.cc:493] T 495292cacf3b42a5b633ad40e5e01972 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:11.450253 7176 raft_consensus.cc:3060] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:11.450275 7123 raft_consensus.cc:3060] T 495292cacf3b42a5b633ad40e5e01972 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:11.450407 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 483) took 1675 ms. Trace:
I20260923 19:50:11.452010 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 465371cfbe544ba98e6eea05033ecf05
I20260923 19:50:11.453939 6459 rpcz_store.cc:276] 0923 19:50:09.768348 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.768414 (+ 66us) service_pool.cc:224] Handling call
0923 19:50:11.173234 (+1404820us) ts_tablet_manager.cc:1151] Deleting tablet 789c54477bec4636bb3669e1f62730e2
0923 19:50:11.173244 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:11.182587 (+ 9343us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:11.312192 (+129605us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:11.444166 (+131974us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1404391}
I20260923 19:50:11.454329 6459 tablet_replica.cc:333] T b4fc995819cc40bf9956d85966bcd330 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:11.454569 6459 raft_consensus.cc:2243] T b4fc995819cc40bf9956d85966bcd330 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:11.454733 6459 raft_consensus.cc:2272] T b4fc995819cc40bf9956d85966bcd330 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:11.455272 6459 ts_tablet_manager.cc:1916] T b4fc995819cc40bf9956d85966bcd330 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:11.458027 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet 465371cfbe544ba98e6eea05033ecf05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:11.458470 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 789c54477bec4636bb3669e1f62730e2 (table default.Table_655007916e0446c2bd045bee42d2592f [id=a29ffe556086466eb3f8602902a72517]) successfully deleted
I20260923 19:50:11.458711 6178 tablet_service.cc:1558] Processing DeleteTablet for tablet 465371cfbe544ba98e6eea05033ecf05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:11.458875 7123 raft_consensus.cc:515] T 495292cacf3b42a5b633ad40e5e01972 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.459332 6454 tablet_bootstrap.cc:492] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:11.459535 6454 ts_tablet_manager.cc:1403] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.201s user 0.007s sys 0.003s
I20260923 19:50:11.459897 7123 leader_election.cc:290] T 495292cacf3b42a5b633ad40e5e01972 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:11.460292 6137 leader_election.cc:343] T 495292cacf3b42a5b633ad40e5e01972 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 495292cacf3b42a5b633ad40e5e01972
I20260923 19:50:11.460316 6454 raft_consensus.cc:359] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.462370 6454 raft_consensus.cc:385] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:11.462502 6454 raft_consensus.cc:740] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:11.462795 6454 consensus_queue.cc:260] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.463404 6454 ts_tablet_manager.cc:1434] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260923 19:50:11.463796 6454 tablet_bootstrap.cc:492] T 337f32eb47954689a6eb8f74408e01d9 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:11.479578 6459 ts_tablet_manager.cc:1929] T b4fc995819cc40bf9956d85966bcd330 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:11.481389 6457 tablet_bootstrap.cc:492] T 18bab39d85f94f4283f0b18c1c9b48a2 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:11.481534 6457 ts_tablet_manager.cc:1403] T 18bab39d85f94f4283f0b18c1c9b48a2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.036s user 0.000s sys 0.003s
I20260923 19:50:11.380345 6458 rpcz_store.cc:276] 0923 19:50:10.133522 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:10.133711 (+ 189us) service_pool.cc:224] Handling call
0923 19:50:11.379983 (+1246272us) ts_tablet_manager.cc:1151] Deleting tablet 3d74560614b744188e759b981ad89a7d
0923 19:50:11.379997 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:11.380161 (+ 164us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1245922}
I20260923 19:50:11.482438 6457 raft_consensus.cc:359] T 18bab39d85f94f4283f0b18c1c9b48a2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.482674 6457 raft_consensus.cc:385] T 18bab39d85f94f4283f0b18c1c9b48a2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:11.482723 6457 raft_consensus.cc:740] T 18bab39d85f94f4283f0b18c1c9b48a2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:11.482903 6457 consensus_queue.cc:260] T 18bab39d85f94f4283f0b18c1c9b48a2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.484640 6457 ts_tablet_manager.cc:1434] T 18bab39d85f94f4283f0b18c1c9b48a2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:50:11.497108 5801 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 2852e91ccd0c44b3b16f8189e57575d7
I20260923 19:50:11.484915 6457 tablet_bootstrap.cc:492] T 7b1601590508479c8f401cd09d9f4c3b P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
W20260923 19:50:11.497331 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 3d74560614b744188e759b981ad89a7d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3d74560614b744188e759b981ad89a7d already in progress: creating tablet
I20260923 19:50:11.494791 7182 tablet.cc:1751] T 115048f771764e41a3816e17a6c6cf94 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260923 19:50:11.480027 6459 log.cc:1199] T b4fc995819cc40bf9956d85966bcd330 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/b4fc995819cc40bf9956d85966bcd330
I20260923 19:50:11.495668 6461 ts_tablet_manager.cc:1929] T d2298d814a104f5cb62196be3bf0dae6 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:11.498322 6461 log.cc:1199] T d2298d814a104f5cb62196be3bf0dae6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/d2298d814a104f5cb62196be3bf0dae6
I20260923 19:50:11.498461 6459 ts_tablet_manager.cc:1950] T b4fc995819cc40bf9956d85966bcd330 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:11.498941 6461 ts_tablet_manager.cc:1950] T d2298d814a104f5cb62196be3bf0dae6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:11.499058 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet 2852e91ccd0c44b3b16f8189e57575d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:11.499526 6454 tablet_bootstrap.cc:654] T 337f32eb47954689a6eb8f74408e01d9 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:11.500460 6457 tablet_bootstrap.cc:654] T 7b1601590508479c8f401cd09d9f4c3b P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:11.501192 6461 tablet_replica.cc:333] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:11.501374 6461 raft_consensus.cc:2243] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:11.501533 6461 raft_consensus.cc:2272] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:11.501691 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 484) took 1717 ms. Trace:
I20260923 19:50:11.501791 6459 rpcz_store.cc:276] 0923 19:50:09.784165 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.784233 (+ 68us) service_pool.cc:224] Handling call
0923 19:50:11.454248 (+1670015us) ts_tablet_manager.cc:1151] Deleting tablet b4fc995819cc40bf9956d85966bcd330
0923 19:50:11.454261 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:11.466346 (+ 12085us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:11.479479 (+ 13133us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:11.501633 (+ 22154us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1669794}
I20260923 19:50:11.502252 6461 ts_tablet_manager.cc:1916] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:11.502233 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_72ac9bcffa734327aae54a672786184b" } new_table_name: "default.Table_14071e1a8af443939d9841cd4f672964" modify_external_catalogs: true
I20260923 19:50:11.502342 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 486) took 1703 ms. Trace:
I20260923 19:50:11.502424 6459 rpcz_store.cc:276] 0923 19:50:09.798788 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.798848 (+ 60us) service_pool.cc:224] Handling call
0923 19:50:11.502175 (+1703327us) ts_tablet_manager.cc:1151] Deleting tablet 1c26a2863fdd4912b6d357877af1eb42
0923 19:50:11.502185 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:11.502288 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1696966}
I20260923 19:50:11.502789 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 485) took 1704 ms. Trace:
I20260923 19:50:11.502866 6459 rpcz_store.cc:276] 0923 19:50:09.798632 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.798944 (+ 312us) service_pool.cc:224] Handling call
0923 19:50:11.502650 (+1703706us) ts_tablet_manager.cc:1151] Deleting tablet 4c6f9953649a43aa9a0edd78b7bd47a4
0923 19:50:11.502658 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:11.502743 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1697271}
I20260923 19:50:11.503172 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 489) took 1690 ms. Trace:
I20260923 19:50:11.503250 6459 rpcz_store.cc:276] 0923 19:50:09.812352 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.812419 (+ 67us) service_pool.cc:224] Handling call
0923 19:50:11.503053 (+1690634us) ts_tablet_manager.cc:1151] Deleting tablet 64e8951eb899461aa9c0b36e3f7555e2
0923 19:50:11.503061 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:11.503128 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1690401}
I20260923 19:50:11.503588 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 490) took 1690 ms. Trace:
I20260923 19:50:11.503676 6459 rpcz_store.cc:276] 0923 19:50:09.813591 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.813640 (+ 49us) service_pool.cc:224] Handling call
0923 19:50:11.503446 (+1689806us) ts_tablet_manager.cc:1151] Deleting tablet cb11d6e082784ad98cfb5253dbb88707
0923 19:50:11.503454 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:11.503525 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1689536}
I20260923 19:50:11.503991 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 491) took 1674 ms. Trace:
I20260923 19:50:11.504067 6459 rpcz_store.cc:276] 0923 19:50:09.829942 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.830004 (+ 62us) service_pool.cc:224] Handling call
0923 19:50:11.503873 (+1673869us) ts_tablet_manager.cc:1151] Deleting tablet ebc288d8d453481592df11cd1bfed3ac
0923 19:50:11.503880 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:11.503945 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1673631}
I20260923 19:50:11.504325 6459 tablet_replica.cc:333] T 623fb5b761134951a4b742ab2ba480a4 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:11.504411 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet d2298d814a104f5cb62196be3bf0dae6 (table default.Table_69bbed3a902143c0a4fc91ee4cf3fec4 [id=ba1f8e14938e4925b3fc8a8b72002231]) successfully deleted
I20260923 19:50:11.504499 6459 raft_consensus.cc:2243] T 623fb5b761134951a4b742ab2ba480a4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:11.504670 6459 raft_consensus.cc:2272] T 623fb5b761134951a4b742ab2ba480a4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:11.505164 6459 ts_tablet_manager.cc:1916] T 623fb5b761134951a4b742ab2ba480a4 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:11.506137 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet b4fc995819cc40bf9956d85966bcd330 (table default.Table_ee5fbb39c54a49c89eaaff48f72a9c3c [id=20b663f1b2504d4199c2a9a2e9667d5c]) successfully deleted
W20260923 19:50:11.506402 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 1c26a2863fdd4912b6d357877af1eb42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1c26a2863fdd4912b6d357877af1eb42 already in progress: creating tablet
W20260923 19:50:11.506623 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 4c6f9953649a43aa9a0edd78b7bd47a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4c6f9953649a43aa9a0edd78b7bd47a4 already in progress: creating tablet
W20260923 19:50:11.506811 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 64e8951eb899461aa9c0b36e3f7555e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64e8951eb899461aa9c0b36e3f7555e2 already in progress: creating tablet
W20260923 19:50:11.507000 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet cb11d6e082784ad98cfb5253dbb88707 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb11d6e082784ad98cfb5253dbb88707 already in progress: creating tablet
W20260923 19:50:11.507220 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet ebc288d8d453481592df11cd1bfed3ac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ebc288d8d453481592df11cd1bfed3ac already in progress: creating tablet
I20260923 19:50:11.514099 6461 ts_tablet_manager.cc:1929] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:11.518396 7123 raft_consensus.cc:493] T ec4284d6a0fa416ca95b4d675c8e3912 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:11.518628 7123 raft_consensus.cc:515] T ec4284d6a0fa416ca95b4d675c8e3912 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.519110 6461 log.cc:1199] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/908596339b2e4f7f8ddb7f9cd5bdcc3e
I20260923 19:50:11.519448 6461 ts_tablet_manager.cc:1950] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:11.519501 7123 leader_election.cc:290] T ec4284d6a0fa416ca95b4d675c8e3912 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:11.520378 6461 tablet_replica.cc:333] T f5cb8dd5dcf54df9989dd808fe148ce6 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:11.522130 6456 ts_tablet_manager.cc:1434] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.029s user 0.002s sys 0.000s
I20260923 19:50:11.521067 6457 tablet_bootstrap.cc:492] T 7b1601590508479c8f401cd09d9f4c3b P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:11.522516 6457 ts_tablet_manager.cc:1403] T 7b1601590508479c8f401cd09d9f4c3b P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.038s user 0.002s sys 0.002s
I20260923 19:50:11.522066 6057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4284d6a0fa416ca95b4d675c8e3912" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:11.523293 6457 raft_consensus.cc:359] T 7b1601590508479c8f401cd09d9f4c3b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.523448 6457 raft_consensus.cc:385] T 7b1601590508479c8f401cd09d9f4c3b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:11.523504 6457 raft_consensus.cc:740] T 7b1601590508479c8f401cd09d9f4c3b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:11.523707 6457 consensus_queue.cc:260] T 7b1601590508479c8f401cd09d9f4c3b P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.524118 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 908596339b2e4f7f8ddb7f9cd5bdcc3e (table default.Table_f92387e003d44b0eb22010e7ca6598af [id=1e323f5b380a4af4acc3865649648e12]) successfully deleted
I20260923 19:50:11.524600 6457 ts_tablet_manager.cc:1434] T 7b1601590508479c8f401cd09d9f4c3b P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:11.526026 6457 tablet_bootstrap.cc:492] T 7e41501bf01e4765853c27e4cac21e2b P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:11.526629 7134 raft_consensus.cc:493] T 1fcd1c1bfd2c437a955c34569605a6d4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:11.526654 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet 2852e91ccd0c44b3b16f8189e57575d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:11.526809 7134 raft_consensus.cc:515] T 1fcd1c1bfd2c437a955c34569605a6d4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.527431 7134 leader_election.cc:290] T 1fcd1c1bfd2c437a955c34569605a6d4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:11.527724 6457 tablet_bootstrap.cc:654] T 7e41501bf01e4765853c27e4cac21e2b P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:11.527953 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd1c1bfd2c437a955c34569605a6d4" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:11.528442 5995 leader_election.cc:343] T 1fcd1c1bfd2c437a955c34569605a6d4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:11.528669 6461 raft_consensus.cc:2243] T f5cb8dd5dcf54df9989dd808fe148ce6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:11.528815 6461 raft_consensus.cc:2272] T f5cb8dd5dcf54df9989dd808fe148ce6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:11.529513 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet 465371cfbe544ba98e6eea05033ecf05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:11.530655 7181 tablet.cc:1751] T 115048f771764e41a3816e17a6c6cf94 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260923 19:50:11.531409 6456 tablet_bootstrap.cc:492] T 3919b15a00eb4fb08008f065f556c760 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:11.532229 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495292cacf3b42a5b633ad40e5e01972" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:11.532490 6344 raft_consensus.cc:3060] T 495292cacf3b42a5b633ad40e5e01972 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:11.533615 6461 ts_tablet_manager.cc:1916] T f5cb8dd5dcf54df9989dd808fe148ce6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:11.533802 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 474) took 1294 ms. Trace:
I20260923 19:50:11.534191 6457 tablet_bootstrap.cc:492] T 7e41501bf01e4765853c27e4cac21e2b P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:11.534318 6457 ts_tablet_manager.cc:1403] T 7e41501bf01e4765853c27e4cac21e2b P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260923 19:50:11.534435 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4284d6a0fa416ca95b4d675c8e3912" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:11.535000 6457 raft_consensus.cc:359] T 7e41501bf01e4765853c27e4cac21e2b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.535157 6457 raft_consensus.cc:385] T 7e41501bf01e4765853c27e4cac21e2b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:11.535208 6457 raft_consensus.cc:740] T 7e41501bf01e4765853c27e4cac21e2b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:11.535310 6139 leader_election.cc:304] T ec4284d6a0fa416ca95b4d675c8e3912 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:11.535602 6457 consensus_queue.cc:260] T 7e41501bf01e4765853c27e4cac21e2b P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.535734 7123 raft_consensus.cc:2749] T ec4284d6a0fa416ca95b4d675c8e3912 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:11.536221 6457 ts_tablet_manager.cc:1434] T 7e41501bf01e4765853c27e4cac21e2b P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:50:11.536721 6457 tablet_bootstrap.cc:492] T 601a0ff319cc4c9a898d52bbcb19184b P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
W20260923 19:50:11.536841 6279 consensus_peers.cc:597] T f4e3e64fdf584743a3a88df5d6600b22 P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f4e3e64fdf584743a3a88df5d6600b22. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:11.534725 6458 rpcz_store.cc:276] 0923 19:50:10.203778 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:10.203854 (+ 76us) service_pool.cc:224] Handling call
0923 19:50:11.482070 (+1278216us) ts_tablet_manager.cc:1151] Deleting tablet f5cb8dd5dcf54df9989dd808fe148ce6
0923 19:50:11.487403 (+ 5333us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:11.497701 (+ 10298us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1277913}
I20260923 19:50:11.538614 6457 tablet_bootstrap.cc:654] T 601a0ff319cc4c9a898d52bbcb19184b P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:11.538631 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet f5cb8dd5dcf54df9989dd808fe148ce6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5cb8dd5dcf54df9989dd808fe148ce6 already in progress: creating tablet
I20260923 19:50:11.539028 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 475) took 1312 ms. Trace:
I20260923 19:50:11.539135 6458 rpcz_store.cc:276] 0923 19:50:10.225328 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:10.225396 (+ 68us) service_pool.cc:224] Handling call
0923 19:50:11.538096 (+1312700us) ts_tablet_manager.cc:1151] Deleting tablet 839bcf991b754f9e95a1dd6c4f826e71
0923 19:50:11.538107 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:11.538202 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1312423}
W20260923 19:50:11.540215 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 839bcf991b754f9e95a1dd6c4f826e71 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 839bcf991b754f9e95a1dd6c4f826e71 already in progress: creating tablet
W20260923 19:50:11.540496 5792 catalog_manager.cc:5030] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 789c54477bec4636bb3669e1f62730e2 because the tablet was not found. No further retry: Not found: Tablet not found: 789c54477bec4636bb3669e1f62730e2
I20260923 19:50:11.540815 6458 tablet_replica.cc:333] T f4e3e64fdf584743a3a88df5d6600b22 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:11.541085 6458 raft_consensus.cc:2243] T f4e3e64fdf584743a3a88df5d6600b22 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:11.549000 7176 raft_consensus.cc:515] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.551697 6459 ts_tablet_manager.cc:1929] T 623fb5b761134951a4b742ab2ba480a4 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:11.551847 6459 log.cc:1199] T 623fb5b761134951a4b742ab2ba480a4 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/623fb5b761134951a4b742ab2ba480a4
I20260923 19:50:11.552205 6459 ts_tablet_manager.cc:1950] T 623fb5b761134951a4b742ab2ba480a4 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:11.553020 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 497) took 1680 ms. Trace:
I20260923 19:50:11.553140 6459 rpcz_store.cc:276] 0923 19:50:09.872773 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.872982 (+ 209us) service_pool.cc:224] Handling call
0923 19:50:11.504251 (+1631269us) ts_tablet_manager.cc:1151] Deleting tablet 623fb5b761134951a4b742ab2ba480a4
0923 19:50:11.504258 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:11.523062 (+ 18804us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:11.551595 (+ 28533us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:11.552975 (+ 1380us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1630948}
W20260923 19:50:11.553488 6279 leader_election.cc:343] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 359b08ef348d4be68b14f9e871a5e519
I20260923 19:50:11.553750 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 623fb5b761134951a4b742ab2ba480a4 (table default.Table_526fa05830fd4679bd95ea4b8e9af682 [id=6cd1efd05c5d40d695658ba3aa1ddadc]) successfully deleted
I20260923 19:50:11.557646 6461 ts_tablet_manager.cc:1929] T f5cb8dd5dcf54df9989dd808fe148ce6 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:11.558072 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 498) took 1685 ms. Trace:
I20260923 19:50:11.558256 6459 rpcz_store.cc:276] 0923 19:50:09.872923 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:09.873349 (+ 426us) service_pool.cc:224] Handling call
0923 19:50:11.557894 (+1684545us) ts_tablet_manager.cc:1151] Deleting tablet a11ecef9a24f4e4a812ec220b6a92cc4
0923 19:50:11.557908 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:11.558028 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1684330}
W20260923 19:50:11.558976 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet a11ecef9a24f4e4a812ec220b6a92cc4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a11ecef9a24f4e4a812ec220b6a92cc4 already in progress: creating tablet
I20260923 19:50:11.559440 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 499) took 1556 ms. Trace:
I20260923 19:50:11.559598 6459 rpcz_store.cc:276] 0923 19:50:10.003297 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:10.036253 (+ 32956us) service_pool.cc:224] Handling call
0923 19:50:11.559308 (+1523055us) ts_tablet_manager.cc:1151] Deleting tablet 66739afdf147413787acb0363aa37df6
0923 19:50:11.559317 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:11.559406 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1422965}
W20260923 19:50:11.560092 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 66739afdf147413787acb0363aa37df6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66739afdf147413787acb0363aa37df6 already in progress: creating tablet
I20260923 19:50:11.560637 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 500) took 1424 ms. Trace:
I20260923 19:50:11.565197 5799 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 2526884ab0ef404aaf93051cc842c695
I20260923 19:50:11.566505 6459 rpcz_store.cc:276] 0923 19:50:10.136095 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:10.136158 (+ 63us) service_pool.cc:224] Handling call
0923 19:50:11.560509 (+1424351us) ts_tablet_manager.cc:1151] Deleting tablet 3d74560614b744188e759b981ad89a7d
0923 19:50:11.560518 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:11.560608 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1412386}
I20260923 19:50:11.567143 6459 tablet_replica.cc:333] T f4e3e64fdf584743a3a88df5d6600b22 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:11.567471 6459 raft_consensus.cc:2243] T f4e3e64fdf584743a3a88df5d6600b22 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:11.567723 6459 raft_consensus.cc:2272] T f4e3e64fdf584743a3a88df5d6600b22 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:11.568763 6459 ts_tablet_manager.cc:1916] T f4e3e64fdf584743a3a88df5d6600b22 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:11.568823 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet 2526884ab0ef404aaf93051cc842c695 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:11.569689 6461 log.cc:1199] T f5cb8dd5dcf54df9989dd808fe148ce6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/f5cb8dd5dcf54df9989dd808fe148ce6
I20260923 19:50:11.570331 6461 ts_tablet_manager.cc:1950] T f5cb8dd5dcf54df9989dd808fe148ce6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:11.571264 6461 tablet_replica.cc:333] T 58c24aa494bc4da28536dfa1df6123b7 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
W20260923 19:50:11.575683 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 3d74560614b744188e759b981ad89a7d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3d74560614b744188e759b981ad89a7d already in progress: creating tablet
I20260923 19:50:11.576061 6461 raft_consensus.cc:2243] T 58c24aa494bc4da28536dfa1df6123b7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:11.576284 6461 raft_consensus.cc:2272] T 58c24aa494bc4da28536dfa1df6123b7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:11.576339 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet 2526884ab0ef404aaf93051cc842c695 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:11.577097 6461 ts_tablet_manager.cc:1916] T 58c24aa494bc4da28536dfa1df6123b7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:11.577313 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet f5cb8dd5dcf54df9989dd808fe148ce6 (table default.Table_c49fa1ccdba34f098164e9732f9a750a [id=1b9a067155ad446db4ead7a1ece15427]) successfully deleted
I20260923 19:50:11.582360 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet 2852e91ccd0c44b3b16f8189e57575d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:11.586031 6456 tablet_bootstrap.cc:654] T 3919b15a00eb4fb08008f065f556c760 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:11.590123 7134 raft_consensus.cc:493] T 7b1601590508479c8f401cd09d9f4c3b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:11.590317 7134 raft_consensus.cc:515] T 7b1601590508479c8f401cd09d9f4c3b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.591104 7134 leader_election.cc:290] T 7b1601590508479c8f401cd09d9f4c3b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:11.591953 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b1601590508479c8f401cd09d9f4c3b" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:11.592630 5995 leader_election.cc:343] T 7b1601590508479c8f401cd09d9f4c3b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:11.597736 6459 ts_tablet_manager.cc:1929] T f4e3e64fdf584743a3a88df5d6600b22 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:11.597932 6459 log.cc:1199] T f4e3e64fdf584743a3a88df5d6600b22 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/f4e3e64fdf584743a3a88df5d6600b22
I20260923 19:50:11.598451 6459 ts_tablet_manager.cc:1950] T f4e3e64fdf584743a3a88df5d6600b22 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:11.598866 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 501) took 1415 ms. Trace:
I20260923 19:50:11.599020 6459 rpcz_store.cc:276] 0923 19:50:10.182993 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:10.183056 (+ 63us) service_pool.cc:224] Handling call
0923 19:50:11.567059 (+1384003us) ts_tablet_manager.cc:1151] Deleting tablet f4e3e64fdf584743a3a88df5d6600b22
0923 19:50:11.567072 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:11.575004 (+ 7932us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:11.597637 (+ 22633us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:11.598801 (+ 1164us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1383344}
I20260923 19:50:11.599563 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet f4e3e64fdf584743a3a88df5d6600b22 (table default.Table_7342c845a15749d5b6bd089d55287f3a [id=d9b49a00239d40f3982556322a0143e4]) successfully deleted
I20260923 19:50:11.600514 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 502) took 1396 ms. Trace:
I20260923 19:50:11.600648 6459 rpcz_store.cc:276] 0923 19:50:10.203805 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:10.203861 (+ 56us) service_pool.cc:224] Handling call
0923 19:50:11.599908 (+1396047us) ts_tablet_manager.cc:1151] Deleting tablet f5cb8dd5dcf54df9989dd808fe148ce6
0923 19:50:11.599921 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:11.600440 (+ 519us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1395783}
I20260923 19:50:11.600780 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet 2526884ab0ef404aaf93051cc842c695 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:11.600952 7176 leader_election.cc:290] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
W20260923 19:50:11.601226 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet f5cb8dd5dcf54df9989dd808fe148ce6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5cb8dd5dcf54df9989dd808fe148ce6 already in progress: creating tablet
I20260923 19:50:11.601521 6461 ts_tablet_manager.cc:1929] T 58c24aa494bc4da28536dfa1df6123b7 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:11.601773 6461 log.cc:1199] T 58c24aa494bc4da28536dfa1df6123b7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/58c24aa494bc4da28536dfa1df6123b7
I20260923 19:50:11.602231 6461 ts_tablet_manager.cc:1950] T 58c24aa494bc4da28536dfa1df6123b7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:11.603670 6461 tablet_replica.cc:333] T 896bd068e6b343e48eb2a01679b49326 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:11.603663 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 58c24aa494bc4da28536dfa1df6123b7 (table default.Table_82887fe31841462bafc075decf6acdbd [id=8bf9f0ca8abf4fa1a05458b12288cd12]) successfully deleted
I20260923 19:50:11.604043 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 503) took 1379 ms. Trace:
W20260923 19:50:11.604068 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 39261cedbdb54d1f8ae0e07ae1cfeb3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39261cedbdb54d1f8ae0e07ae1cfeb3e already in progress: creating tablet
I20260923 19:50:11.604216 6459 rpcz_store.cc:276] 0923 19:50:10.224618 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:10.224727 (+ 109us) service_pool.cc:224] Handling call
0923 19:50:11.603890 (+1379163us) ts_tablet_manager.cc:1151] Deleting tablet 839bcf991b754f9e95a1dd6c4f826e71
0923 19:50:11.603899 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:11.603991 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1273648}
W20260923 19:50:11.610008 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 839bcf991b754f9e95a1dd6c4f826e71 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 839bcf991b754f9e95a1dd6c4f826e71 already in progress: creating tablet
I20260923 19:50:11.610356 6344 raft_consensus.cc:2468] T 495292cacf3b42a5b633ad40e5e01972 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:11.610435 6459 tablet_replica.cc:333] T ab73e8a1b6774ca0b43e5be67da68fab P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:11.610689 6459 raft_consensus.cc:2243] T ab73e8a1b6774ca0b43e5be67da68fab P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:11.610944 6459 raft_consensus.cc:2272] T ab73e8a1b6774ca0b43e5be67da68fab P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:11.611052 6139 leader_election.cc:304] T 495292cacf3b42a5b633ad40e5e01972 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:11.611701 6459 ts_tablet_manager.cc:1916] T ab73e8a1b6774ca0b43e5be67da68fab P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:11.611737 7123 raft_consensus.cc:2804] T 495292cacf3b42a5b633ad40e5e01972 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:11.612272 7123 raft_consensus.cc:697] T 495292cacf3b42a5b633ad40e5e01972 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:11.612663 7123 consensus_queue.cc:237] T 495292cacf3b42a5b633ad40e5e01972 P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.614444 6461 raft_consensus.cc:2243] T 896bd068e6b343e48eb2a01679b49326 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:11.614605 6461 raft_consensus.cc:2272] T 896bd068e6b343e48eb2a01679b49326 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:11.615902 6461 ts_tablet_manager.cc:1916] T 896bd068e6b343e48eb2a01679b49326 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:11.637805 6459 ts_tablet_manager.cc:1929] T ab73e8a1b6774ca0b43e5be67da68fab P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:11.638329 6461 ts_tablet_manager.cc:1929] T 896bd068e6b343e48eb2a01679b49326 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:11.638499 6461 log.cc:1199] T 896bd068e6b343e48eb2a01679b49326 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/896bd068e6b343e48eb2a01679b49326
I20260923 19:50:11.638852 6461 ts_tablet_manager.cc:1950] T 896bd068e6b343e48eb2a01679b49326 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:11.640203 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 896bd068e6b343e48eb2a01679b49326 (table default.Table_5febe26a78884634a01aa0ec62f36604 [id=e2a29fc060074c45918b97001dd03207]) successfully deleted
I20260923 19:50:11.640684 6459 log.cc:1199] T ab73e8a1b6774ca0b43e5be67da68fab P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/ab73e8a1b6774ca0b43e5be67da68fab
I20260923 19:50:11.641299 6459 ts_tablet_manager.cc:1950] T ab73e8a1b6774ca0b43e5be67da68fab P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:11.641765 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 504) took 1027 ms. Trace:
W20260923 19:50:11.642328 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet edb52bd88b424129bbdc45de89b56efb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet edb52bd88b424129bbdc45de89b56efb already in progress: creating tablet
W20260923 19:50:11.643560 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet ba639d8c68cf49a49a5ec5729143cf6b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba639d8c68cf49a49a5ec5729143cf6b already in progress: creating tablet
I20260923 19:50:11.643863 6459 rpcz_store.cc:276] 0923 19:50:10.613958 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:10.614038 (+ 80us) service_pool.cc:224] Handling call
0923 19:50:11.610342 (+996304us) ts_tablet_manager.cc:1151] Deleting tablet ab73e8a1b6774ca0b43e5be67da68fab
0923 19:50:11.610353 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:11.621981 (+ 11628us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:11.637703 (+ 15722us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:11.641719 (+ 4016us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":994455}
I20260923 19:50:11.644546 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet ab73e8a1b6774ca0b43e5be67da68fab (table default.Table_c716115e5d0045b691616d451daec14d [id=bb00103e5a52400b9e7fb4db39f27bd7]) successfully deleted
I20260923 19:50:11.644611 6459 tablet_replica.cc:333] T 86473c5cbca54b5792b038aef445998c P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
W20260923 19:50:11.645018 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 431ad4da27544d68aa5666293984a86a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 431ad4da27544d68aa5666293984a86a already in progress: creating tablet
W20260923 19:50:11.645193 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 465371cfbe544ba98e6eea05033ecf05 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 465371cfbe544ba98e6eea05033ecf05 already in progress: creating tablet
I20260923 19:50:11.654059 6458 raft_consensus.cc:2272] T f4e3e64fdf584743a3a88df5d6600b22 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:11.654439 6459 raft_consensus.cc:2243] T 86473c5cbca54b5792b038aef445998c P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
W20260923 19:50:11.655393 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 2852e91ccd0c44b3b16f8189e57575d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2852e91ccd0c44b3b16f8189e57575d7 already in progress: creating tablet
W20260923 19:50:11.656283 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 2526884ab0ef404aaf93051cc842c695 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2526884ab0ef404aaf93051cc842c695 already in progress: creating tablet
W20260923 19:50:11.656371 6280 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 169456us
I20260923 19:50:11.656796 6459 pending_rounds.cc:70] T 86473c5cbca54b5792b038aef445998c P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:11.657152 6459 pending_rounds.cc:77] T 86473c5cbca54b5792b038aef445998c P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630573266608128 op_type: NO_OP noop_request { }
I20260923 19:50:11.657744 6458 ts_tablet_manager.cc:1916] T f4e3e64fdf584743a3a88df5d6600b22 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:11.658078 6459 raft_consensus.cc:2889] T 86473c5cbca54b5792b038aef445998c P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:11.658290 6459 raft_consensus.cc:2272] T 86473c5cbca54b5792b038aef445998c P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:11.658293 6454 tablet_bootstrap.cc:492] T 337f32eb47954689a6eb8f74408e01d9 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:11.658931 6454 ts_tablet_manager.cc:1403] T 337f32eb47954689a6eb8f74408e01d9 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.195s user 0.028s sys 0.044s
I20260923 19:50:11.659077 6459 ts_tablet_manager.cc:1916] T 86473c5cbca54b5792b038aef445998c P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:11.659737 6454 raft_consensus.cc:359] T 337f32eb47954689a6eb8f74408e01d9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.659934 6454 raft_consensus.cc:385] T 337f32eb47954689a6eb8f74408e01d9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:11.660012 6454 raft_consensus.cc:740] T 337f32eb47954689a6eb8f74408e01d9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:11.660260 6454 consensus_queue.cc:260] T 337f32eb47954689a6eb8f74408e01d9 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.660771 6454 ts_tablet_manager.cc:1434] T 337f32eb47954689a6eb8f74408e01d9 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:50:11.661085 6454 tablet_bootstrap.cc:492] T f108ebdaecab42e7b57057c7ecfbe690 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:11.662833 6454 tablet_bootstrap.cc:654] T f108ebdaecab42e7b57057c7ecfbe690 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:11.664832 6457 tablet_bootstrap.cc:492] T 601a0ff319cc4c9a898d52bbcb19184b P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:11.664973 6457 ts_tablet_manager.cc:1403] T 601a0ff319cc4c9a898d52bbcb19184b P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.128s user 0.019s sys 0.035s
I20260923 19:50:11.665712 6457 raft_consensus.cc:359] T 601a0ff319cc4c9a898d52bbcb19184b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.665930 6457 raft_consensus.cc:385] T 601a0ff319cc4c9a898d52bbcb19184b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:11.666003 6457 raft_consensus.cc:740] T 601a0ff319cc4c9a898d52bbcb19184b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:11.666247 6457 consensus_queue.cc:260] T 601a0ff319cc4c9a898d52bbcb19184b P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.670164 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "359b08ef348d4be68b14f9e871a5e519" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:11.670430 6199 raft_consensus.cc:3060] T 359b08ef348d4be68b14f9e871a5e519 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:11.672307 6457 ts_tablet_manager.cc:1434] T 601a0ff319cc4c9a898d52bbcb19184b P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260923 19:50:11.672618 6457 tablet_bootstrap.cc:492] T c0ff8838ab17433ab733d3b293d4964f P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:11.673782 6199 raft_consensus.cc:2468] T 359b08ef348d4be68b14f9e871a5e519 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:11.674710 6457 tablet_bootstrap.cc:654] T c0ff8838ab17433ab733d3b293d4964f P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:11.679388 6454 tablet_bootstrap.cc:492] T f108ebdaecab42e7b57057c7ecfbe690 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:11.679561 6454 ts_tablet_manager.cc:1403] T f108ebdaecab42e7b57057c7ecfbe690 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.000s
I20260923 19:50:11.680457 6454 raft_consensus.cc:359] T f108ebdaecab42e7b57057c7ecfbe690 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.680630 6454 raft_consensus.cc:385] T f108ebdaecab42e7b57057c7ecfbe690 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:11.680718 6454 raft_consensus.cc:740] T f108ebdaecab42e7b57057c7ecfbe690 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:11.680960 6454 consensus_queue.cc:260] T f108ebdaecab42e7b57057c7ecfbe690 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.681535 6454 ts_tablet_manager.cc:1434] T f108ebdaecab42e7b57057c7ecfbe690 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:50:11.684038 6459 ts_tablet_manager.cc:1929] T 86473c5cbca54b5792b038aef445998c P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:11.684186 6459 log.cc:1199] T 86473c5cbca54b5792b038aef445998c P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/86473c5cbca54b5792b038aef445998c
I20260923 19:50:11.684682 6459 ts_tablet_manager.cc:1950] T 86473c5cbca54b5792b038aef445998c P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:11.685578 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 86473c5cbca54b5792b038aef445998c (table default.Table_f1de0114e81245fdb95e257431f5a975 [id=7f0d9665430447528c3829934eb4b634]) successfully deleted
I20260923 19:50:11.685954 6459 tablet_replica.cc:333] T 42e9cbcf77324d91abd029c12eaf950d P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:11.686335 6454 tablet_bootstrap.cc:492] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:11.686360 6459 raft_consensus.cc:2243] T 42e9cbcf77324d91abd029c12eaf950d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:11.688010 7195 tablet.cc:1751] T 115048f771764e41a3816e17a6c6cf94 P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260923 19:50:11.688256 6459 raft_consensus.cc:2272] T 42e9cbcf77324d91abd029c12eaf950d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:11.688814 6459 ts_tablet_manager.cc:1916] T 42e9cbcf77324d91abd029c12eaf950d P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:11.688947 6279 consensus_peers.cc:597] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ab73e8a1b6774ca0b43e5be67da68fab. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:11.692301 6454 tablet_bootstrap.cc:654] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:11.694276 6457 tablet_bootstrap.cc:492] T c0ff8838ab17433ab733d3b293d4964f P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:11.694422 6457 ts_tablet_manager.cc:1403] T c0ff8838ab17433ab733d3b293d4964f P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.003s
I20260923 19:50:11.695161 6457 raft_consensus.cc:359] T c0ff8838ab17433ab733d3b293d4964f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.695326 6457 raft_consensus.cc:385] T c0ff8838ab17433ab733d3b293d4964f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:11.695384 6457 raft_consensus.cc:740] T c0ff8838ab17433ab733d3b293d4964f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:11.695621 6457 consensus_queue.cc:260] T c0ff8838ab17433ab733d3b293d4964f P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.696259 6457 ts_tablet_manager.cc:1434] T c0ff8838ab17433ab733d3b293d4964f P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:50:11.697326 6457 tablet_bootstrap.cc:492] T 465371cfbe544ba98e6eea05033ecf05 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:11.699091 6457 tablet_bootstrap.cc:654] T 465371cfbe544ba98e6eea05033ecf05 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:11.701757 6454 tablet_bootstrap.cc:492] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:11.701951 6454 ts_tablet_manager.cc:1403] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.003s
I20260923 19:50:11.702767 6454 raft_consensus.cc:359] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.702952 6454 raft_consensus.cc:385] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:11.703025 6454 raft_consensus.cc:740] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:11.703245 6454 consensus_queue.cc:260] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.703742 6454 ts_tablet_manager.cc:1434] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:50:11.705196 6454 tablet_bootstrap.cc:492] T c48d4a8371fa4454b7c67291db3ab796 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:11.707150 6454 tablet_bootstrap.cc:654] T c48d4a8371fa4454b7c67291db3ab796 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:11.708868 6459 ts_tablet_manager.cc:1929] T 42e9cbcf77324d91abd029c12eaf950d P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:11.709030 6459 log.cc:1199] T 42e9cbcf77324d91abd029c12eaf950d P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/42e9cbcf77324d91abd029c12eaf950d
I20260923 19:50:11.709609 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd1c1bfd2c437a955c34569605a6d4" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:11.710162 7189 raft_consensus.cc:493] T 31b0bdf719554d37993a802831e324ee P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:11.710394 7189 raft_consensus.cc:515] T 31b0bdf719554d37993a802831e324ee P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.710934 6457 tablet_bootstrap.cc:492] T 465371cfbe544ba98e6eea05033ecf05 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:11.711062 6457 ts_tablet_manager.cc:1403] T 465371cfbe544ba98e6eea05033ecf05 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20260923 19:50:11.711819 6457 raft_consensus.cc:359] T 465371cfbe544ba98e6eea05033ecf05 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.712004 6457 raft_consensus.cc:385] T 465371cfbe544ba98e6eea05033ecf05 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:11.712069 6457 raft_consensus.cc:740] T 465371cfbe544ba98e6eea05033ecf05 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:11.712263 6457 consensus_queue.cc:260] T 465371cfbe544ba98e6eea05033ecf05 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:11.712427 6279 leader_election.cc:343] T 31b0bdf719554d37993a802831e324ee P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 31b0bdf719554d37993a802831e324ee
I20260923 19:50:11.712827 7189 leader_election.cc:290] T 31b0bdf719554d37993a802831e324ee P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:11.713008 6457 ts_tablet_manager.cc:1434] T 465371cfbe544ba98e6eea05033ecf05 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:11.713380 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b1601590508479c8f401cd09d9f4c3b" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:11.713604 6457 tablet_bootstrap.cc:492] T 7b455812687f42848df5290d0cdbc312 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
W20260923 19:50:11.713949 5996 leader_election.cc:343] T 1fcd1c1bfd2c437a955c34569605a6d4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:11.714056 5996 leader_election.cc:304] T 1fcd1c1bfd2c437a955c34569605a6d4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:11.714254 7134 raft_consensus.cc:2749] T 1fcd1c1bfd2c437a955c34569605a6d4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:11.714564 6459 ts_tablet_manager.cc:1950] T 42e9cbcf77324d91abd029c12eaf950d P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:11.715101 6454 tablet_bootstrap.cc:492] T c48d4a8371fa4454b7c67291db3ab796 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:11.715240 6454 ts_tablet_manager.cc:1403] T c48d4a8371fa4454b7c67291db3ab796 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20260923 19:50:11.715225 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 42e9cbcf77324d91abd029c12eaf950d (table default.Table_c49ba0c0c07142b6aefaab8632719193 [id=a2b5a27b4b93406b9bd6fd2248562a78]) successfully deleted
I20260923 19:50:11.715607 6459 tablet_replica.cc:333] T 495292cacf3b42a5b633ad40e5e01972 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:11.715996 6454 raft_consensus.cc:359] T c48d4a8371fa4454b7c67291db3ab796 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.716153 6454 raft_consensus.cc:385] T c48d4a8371fa4454b7c67291db3ab796 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:11.716250 6454 raft_consensus.cc:740] T c48d4a8371fa4454b7c67291db3ab796 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:11.717338 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b0bdf719554d37993a802831e324ee" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:11.717902 6457 tablet_bootstrap.cc:654] T 7b455812687f42848df5290d0cdbc312 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:11.719542 6454 consensus_queue.cc:260] T c48d4a8371fa4454b7c67291db3ab796 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.720052 6454 ts_tablet_manager.cc:1434] T c48d4a8371fa4454b7c67291db3ab796 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260923 19:50:11.721930 6454 tablet_bootstrap.cc:492] T daafbafae5004b8499e7ea93342c0517 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
W20260923 19:50:11.722086 5996 leader_election.cc:343] T 7b1601590508479c8f401cd09d9f4c3b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:11.722188 5996 leader_election.cc:304] T 7b1601590508479c8f401cd09d9f4c3b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:11.722389 7134 raft_consensus.cc:2749] T 7b1601590508479c8f401cd09d9f4c3b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:11.722805 6280 leader_election.cc:304] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:11.723387 7172 raft_consensus.cc:2804] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:11.723538 7172 raft_consensus.cc:697] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:11.723788 7172 consensus_queue.cc:237] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.725159 6454 tablet_bootstrap.cc:654] T daafbafae5004b8499e7ea93342c0517 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:11.727463 6280 leader_election.cc:343] T 31b0bdf719554d37993a802831e324ee P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:11.727680 6280 leader_election.cc:304] T 31b0bdf719554d37993a802831e324ee P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:11.728384 7172 raft_consensus.cc:2749] T 31b0bdf719554d37993a802831e324ee P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:11.731886 6454 tablet_bootstrap.cc:492] T daafbafae5004b8499e7ea93342c0517 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:11.732052 6454 ts_tablet_manager.cc:1403] T daafbafae5004b8499e7ea93342c0517 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.004s
I20260923 19:50:11.732868 6454 raft_consensus.cc:359] T daafbafae5004b8499e7ea93342c0517 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.734227 6454 raft_consensus.cc:385] T daafbafae5004b8499e7ea93342c0517 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:11.734314 6454 raft_consensus.cc:740] T daafbafae5004b8499e7ea93342c0517 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:11.734300 7172 raft_consensus.cc:493] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:11.734472 7172 raft_consensus.cc:515] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.734612 6454 consensus_queue.cc:260] T daafbafae5004b8499e7ea93342c0517 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.734884 6457 tablet_bootstrap.cc:492] T 7b455812687f42848df5290d0cdbc312 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:11.735004 6457 ts_tablet_manager.cc:1403] T 7b455812687f42848df5290d0cdbc312 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.021s user 0.005s sys 0.001s
I20260923 19:50:11.735258 7172 leader_election.cc:290] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:11.735724 6457 raft_consensus.cc:359] T 7b455812687f42848df5290d0cdbc312 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.735857 6454 ts_tablet_manager.cc:1434] T daafbafae5004b8499e7ea93342c0517 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260923 19:50:11.735870 6457 raft_consensus.cc:385] T 7b455812687f42848df5290d0cdbc312 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:11.735911 6457 raft_consensus.cc:740] T 7b455812687f42848df5290d0cdbc312 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:11.736105 6457 consensus_queue.cc:260] T 7b455812687f42848df5290d0cdbc312 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.736402 6057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b529b0e82c5b48edac54cc281ac4b4a6" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:11.736572 6057 raft_consensus.cc:2468] T b529b0e82c5b48edac54cc281ac4b4a6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:11.737143 6279 leader_election.cc:304] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:11.737533 6454 tablet_bootstrap.cc:492] T 015c14b447fe4cd18d197b2d1ed5884e P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:11.737514 7172 raft_consensus.cc:2804] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:11.737605 7172 raft_consensus.cc:493] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:11.737695 7172 raft_consensus.cc:3060] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:11.737946 6457 ts_tablet_manager.cc:1434] T 7b455812687f42848df5290d0cdbc312 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:50:11.738222 6457 tablet_bootstrap.cc:492] T 86388fa08c454da9ad2ca0124dcba10b P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:11.739714 6454 tablet_bootstrap.cc:654] T 015c14b447fe4cd18d197b2d1ed5884e P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:11.745039 6457 tablet_bootstrap.cc:654] T 86388fa08c454da9ad2ca0124dcba10b P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:11.748142 6454 tablet_bootstrap.cc:492] T 015c14b447fe4cd18d197b2d1ed5884e P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:11.748309 6454 ts_tablet_manager.cc:1403] T 015c14b447fe4cd18d197b2d1ed5884e P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260923 19:50:11.748618 7172 raft_consensus.cc:515] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.749120 6454 raft_consensus.cc:359] T 015c14b447fe4cd18d197b2d1ed5884e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.749297 6454 raft_consensus.cc:385] T 015c14b447fe4cd18d197b2d1ed5884e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:11.749418 6454 raft_consensus.cc:740] T 015c14b447fe4cd18d197b2d1ed5884e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:11.749670 6454 consensus_queue.cc:260] T 015c14b447fe4cd18d197b2d1ed5884e P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.750137 6057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b529b0e82c5b48edac54cc281ac4b4a6" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:11.750304 6057 raft_consensus.cc:3060] T b529b0e82c5b48edac54cc281ac4b4a6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:11.751034 6454 ts_tablet_manager.cc:1434] T 015c14b447fe4cd18d197b2d1ed5884e P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:50:11.751914 6454 tablet_bootstrap.cc:492] T 85d35ebef3c24a2e89233dd900b63513 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:11.753273 6057 raft_consensus.cc:2468] T b529b0e82c5b48edac54cc281ac4b4a6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:11.753585 6454 tablet_bootstrap.cc:654] T 85d35ebef3c24a2e89233dd900b63513 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:11.754446 6279 leader_election.cc:304] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:11.756081 6457 tablet_bootstrap.cc:492] T 86388fa08c454da9ad2ca0124dcba10b P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:11.756227 6457 ts_tablet_manager.cc:1403] T 86388fa08c454da9ad2ca0124dcba10b P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.008s
I20260923 19:50:11.756408 6458 ts_tablet_manager.cc:1929] T f4e3e64fdf584743a3a88df5d6600b22 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:11.756537 6458 log.cc:1199] T f4e3e64fdf584743a3a88df5d6600b22 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/f4e3e64fdf584743a3a88df5d6600b22
I20260923 19:50:11.756958 6458 ts_tablet_manager.cc:1950] T f4e3e64fdf584743a3a88df5d6600b22 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:11.757118 6457 raft_consensus.cc:359] T 86388fa08c454da9ad2ca0124dcba10b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.757294 6457 raft_consensus.cc:385] T 86388fa08c454da9ad2ca0124dcba10b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:11.757349 6457 raft_consensus.cc:740] T 86388fa08c454da9ad2ca0124dcba10b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:11.757640 6457 consensus_queue.cc:260] T 86388fa08c454da9ad2ca0124dcba10b P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.758998 6457 ts_tablet_manager.cc:1434] T 86388fa08c454da9ad2ca0124dcba10b P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260923 19:50:11.759711 6457 tablet_bootstrap.cc:492] T 870db252d8414be7bbe613ea467b5f3a P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:11.762023 6457 tablet_bootstrap.cc:654] T 870db252d8414be7bbe613ea467b5f3a P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:11.773732 6459 raft_consensus.cc:2243] T 495292cacf3b42a5b633ad40e5e01972 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:11.774227 6459 pending_rounds.cc:70] T 495292cacf3b42a5b633ad40e5e01972 P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:11.774307 6459 pending_rounds.cc:77] T 495292cacf3b42a5b633ad40e5e01972 P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630575568433152 op_type: NO_OP noop_request { }
I20260923 19:50:11.774446 6459 raft_consensus.cc:2889] T 495292cacf3b42a5b633ad40e5e01972 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:11.774552 6459 raft_consensus.cc:2272] T 495292cacf3b42a5b633ad40e5e01972 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:11.775374 6459 ts_tablet_manager.cc:1916] T 495292cacf3b42a5b633ad40e5e01972 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:11.776152 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet a0d817069e664199bff0d7591548e2d7
W20260923 19:50:11.777056 5803 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 554655516bb547ad9c2aa1ee66dc8deb consensus state has no leader
I20260923 19:50:11.777434 5803 master_service.cc:960] ReplaceTablet: received request to replace tablet 66739afdf147413787acb0363aa37df6 from {username='slave'} at 127.0.0.1:59912
W20260923 19:50:11.777947 5802 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 35f46a1be80c4194b592c5d00fe1f342 consensus state has no leader
I20260923 19:50:11.778553 7134 raft_consensus.cc:493] T 465371cfbe544ba98e6eea05033ecf05 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:11.778687 7134 raft_consensus.cc:515] T 465371cfbe544ba98e6eea05033ecf05 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.779071 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b529b0e82c5b48edac54cc281ac4b4a6" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:11.779307 7134 leader_election.cc:290] T 465371cfbe544ba98e6eea05033ecf05 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:11.779461 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b529b0e82c5b48edac54cc281ac4b4a6" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:11.782296 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet a0d817069e664199bff0d7591548e2d7 with delete_type TABLET_DATA_DELETED (replaced by tablet d1258abcb244430ca8456ad146aa0e67) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:11.783927 6459 ts_tablet_manager.cc:1929] T 495292cacf3b42a5b633ad40e5e01972 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:11.784058 6459 log.cc:1199] T 495292cacf3b42a5b633ad40e5e01972 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/495292cacf3b42a5b633ad40e5e01972
I20260923 19:50:11.784509 6459 ts_tablet_manager.cc:1950] T 495292cacf3b42a5b633ad40e5e01972 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:11.785303 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 495292cacf3b42a5b633ad40e5e01972 (table default.Table_504b18d33ff6487da9b8f40467850853 [id=97f3cda15d6f4e258eece32745c45b50]) successfully deleted
W20260923 19:50:11.786491 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 7804d14acf5d491b9f637716f0046877 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7804d14acf5d491b9f637716f0046877 already in progress: creating tablet
W20260923 19:50:11.787120 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 528fca12bfe04747830ad1d3bb323676 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 528fca12bfe04747830ad1d3bb323676 already in progress: creating tablet
W20260923 19:50:11.787719 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet a75c4436a67f453e973a7a7645de79b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a75c4436a67f453e973a7a7645de79b1 already in progress: creating tablet
W20260923 19:50:11.788434 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet c7369a5fc87f4b70bcfbe052ef021771 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c7369a5fc87f4b70bcfbe052ef021771 already in progress: creating tablet
I20260923 19:50:11.790248 6459 tablet_replica.cc:333] T 359b08ef348d4be68b14f9e871a5e519 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:11.790323 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465371cfbe544ba98e6eea05033ecf05" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:11.757860 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 478) took 1150 ms. Trace:
I20260923 19:50:11.765920 7188 raft_consensus.cc:2804] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:11.791919 7188 raft_consensus.cc:697] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:11.792292 7188 consensus_queue.cc:237] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.793659 7173 raft_consensus.cc:493] T f108ebdaecab42e7b57057c7ecfbe690 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:11.793839 7173 raft_consensus.cc:515] T f108ebdaecab42e7b57057c7ecfbe690 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:11.793957 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 7af330ae1aaa48209f2bd1880bcfebb1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7af330ae1aaa48209f2bd1880bcfebb1 already in progress: creating tablet
W20260923 19:50:11.794237 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 1b1d9413e1e24547b491a160d851377b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b1d9413e1e24547b491a160d851377b already in progress: creating tablet
W20260923 19:50:11.794447 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet edb52bd88b424129bbdc45de89b56efb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet edb52bd88b424129bbdc45de89b56efb already in progress: creating tablet
I20260923 19:50:11.794616 7173 leader_election.cc:290] T f108ebdaecab42e7b57057c7ecfbe690 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
W20260923 19:50:11.794652 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 39261cedbdb54d1f8ae0e07ae1cfeb3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39261cedbdb54d1f8ae0e07ae1cfeb3e already in progress: creating tablet
I20260923 19:50:11.791520 6458 rpcz_store.cc:276] 0923 19:50:10.607412 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:10.608158 (+ 746us) service_pool.cc:224] Handling call
0923 19:50:11.539618 (+931460us) ts_tablet_manager.cc:1151] Deleting tablet f4e3e64fdf584743a3a88df5d6600b22
0923 19:50:11.539628 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:11.653718 (+114090us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x6170000b04f0. stack: 00007fcce587b366 00007fcce587b120 00007fcce488534d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007fccf184e3df 00007fccf18fef2c 00007fccf196fb53 00007fccf2cf8583 00007fccf58c58b7 00007fccf58f8a64 00007fccf58d93a0 00007fccf58d912d 0000000000aaef9c 00007fcce58c188f
0923 19:50:11.663380 (+ 9662us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:11.756312 (+ 92932us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:11.757819 (+ 1507us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":258296704,"tablet-delete.queue_time_us":931111}
I20260923 19:50:11.796392 6458 tablet_replica.cc:333] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:11.796622 6458 raft_consensus.cc:2243] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:11.796942 6458 raft_consensus.cc:2272] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:11.796669 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet f4e3e64fdf584743a3a88df5d6600b22 (table default.Table_7342c845a15749d5b6bd089d55287f3a [id=d9b49a00239d40f3982556322a0143e4]) successfully deleted
I20260923 19:50:11.790474 6459 raft_consensus.cc:2243] T 359b08ef348d4be68b14f9e871a5e519 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:11.802599 5796 catalog_manager.cc:6934] ReplaceTablet: tablet a0d817069e664199bff0d7591548e2d7 deleted and replaced by tablet d1258abcb244430ca8456ad146aa0e67
I20260923 19:50:11.802672 6459 raft_consensus.cc:2272] T 359b08ef348d4be68b14f9e871a5e519 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:11.803169 5796 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_2adc87e06d81491498aa018f49fdc08d" } new_table_name: "default.Table_609f0fa8001e4a40905d2d090fc739b1" modify_external_catalogs: true
I20260923 19:50:11.803684 6459 ts_tablet_manager.cc:1916] T 359b08ef348d4be68b14f9e871a5e519 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:11.804803 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5494818771f04f92b37a6991b73e40a6 has no consensus state
I20260923 19:50:11.805217 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_48edbb6cc7c2481a962e00014cdd921b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:11.805907 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_48edbb6cc7c2481a962e00014cdd921b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:11.806388 7123 raft_consensus.cc:493] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:11.806565 7123 raft_consensus.cc:515] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.807600 7123 leader_election.cc:290] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:11.807727 6458 ts_tablet_manager.cc:1916] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:11.808993 6139 leader_election.cc:343] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: e9cbfaa34c924a678f23cbcbf1a6fb0a
I20260923 19:50:11.809937 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_8d1b18b8cdb047b489016f3a439148ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:11.810612 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d1b18b8cdb047b489016f3a439148ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:11.812069 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_bf259d1800344a87933c314d8362033f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:11.812644 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf259d1800344a87933c314d8362033f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:11.815788 6458 ts_tablet_manager.cc:1929] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:11.815927 6458 log.cc:1199] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/ab73e8a1b6774ca0b43e5be67da68fab
I20260923 19:50:11.816342 6458 ts_tablet_manager.cc:1950] T ab73e8a1b6774ca0b43e5be67da68fab P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:11.816272 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_61a67edc9b154897b37cedf4df6485f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:11.816869 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_61a67edc9b154897b37cedf4df6485f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:11.817191 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 480) took 1205 ms. Trace:
I20260923 19:50:11.817454 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet e9cbfaa34c924a678f23cbcbf1a6fb0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:11.817894 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_17d1d2de473849f79d13c8d52085d52b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:11.818485 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_17d1d2de473849f79d13c8d52085d52b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:11.819773 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet f4e3e64fdf584743a3a88df5d6600b22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:11.828616 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_f0a0c094a432441db9c448896dc1b403"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:11.829344 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f0a0c094a432441db9c448896dc1b403 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:11.833493 7173 raft_consensus.cc:493] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:11.833699 7173 raft_consensus.cc:515] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.835419 7173 leader_election.cc:290] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:11.768283 7172 leader_election.cc:290] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:11.783547 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet a0d817069e664199bff0d7591548e2d7 with delete_type TABLET_DATA_DELETED (replaced by tablet d1258abcb244430ca8456ad146aa0e67) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:11.772961 6456 tablet_bootstrap.cc:492] T 3919b15a00eb4fb08008f065f556c760 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:11.836292 6456 ts_tablet_manager.cc:1403] T 3919b15a00eb4fb08008f065f556c760 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.314s user 0.009s sys 0.004s
I20260923 19:50:11.838012 6456 raft_consensus.cc:359] T 3919b15a00eb4fb08008f065f556c760 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.838243 6456 raft_consensus.cc:385] T 3919b15a00eb4fb08008f065f556c760 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:11.838315 6456 raft_consensus.cc:740] T 3919b15a00eb4fb08008f065f556c760 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:11.838660 6456 consensus_queue.cc:260] T 3919b15a00eb4fb08008f065f556c760 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.840924 6312 tablet_service.cc:1511] Processing CreateTablet for tablet ccbb8cd687924f0892464c6cb80d175c (DEFAULT_TABLE table=default.Table_a6baec3d4ff94a14a032737c8ae498ef [id=8b17b21567364cd5909b6ec1bc2344da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.841418 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccbb8cd687924f0892464c6cb80d175c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.843640 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_3be501518fae4ecdab998e08f25d6660" } new_table_name: "default.Table_c624a31c5179478cb6c54a36d7a36892" modify_external_catalogs: true
I20260923 19:50:11.844830 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 0e09a5dcef9e424e8cba58a9b15e6ea5 (DEFAULT_TABLE table=default.Table_e68b828ba396413d8284d20c9047243c [id=80b5f15f449d484aab546d60d6bcb25b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.845005 6310 tablet_service.cc:1511] Processing CreateTablet for tablet c4b7cd806c3d41dd9af0a365d84c1f12 (DEFAULT_TABLE table=default.Table_67f9d2537a904559b507c9fac72ece67 [id=b7de6cbea0c44165ab46342a14fbd685]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.845252 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e09a5dcef9e424e8cba58a9b15e6ea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.845546 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4b7cd806c3d41dd9af0a365d84c1f12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.848605 5797 catalog_manager.cc:5838] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:11.849041 5797 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 85d35ebef3c24a2e89233dd900b63513 (table default.Table_ea5c2db0da154c51a706c771a367ab98 [id=da91b06e11c64bb0aaec37a0188b5586]). Expected version 3 got 0
I20260923 19:50:11.851306 6174 tablet_service.cc:1511] Processing CreateTablet for tablet ccbb8cd687924f0892464c6cb80d175c (DEFAULT_TABLE table=default.Table_a6baec3d4ff94a14a032737c8ae498ef [id=8b17b21567364cd5909b6ec1bc2344da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.851497 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 0e09a5dcef9e424e8cba58a9b15e6ea5 (DEFAULT_TABLE table=default.Table_e68b828ba396413d8284d20c9047243c [id=80b5f15f449d484aab546d60d6bcb25b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.851716 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccbb8cd687924f0892464c6cb80d175c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.852069 6183 tablet_service.cc:1511] Processing CreateTablet for tablet c4b7cd806c3d41dd9af0a365d84c1f12 (DEFAULT_TABLE table=default.Table_67f9d2537a904559b507c9fac72ece67 [id=b7de6cbea0c44165ab46342a14fbd685]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.852397 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4b7cd806c3d41dd9af0a365d84c1f12. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:11.791342 6280 leader_election.cc:343] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:11.853771 6280 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 62461.2us
W20260923 19:50:11.854027 6280 leader_election.cc:343] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:11.854540 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465371cfbe544ba98e6eea05033ecf05" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:11.855087 6456 ts_tablet_manager.cc:1434] T 3919b15a00eb4fb08008f065f556c760 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20260923 19:50:11.855386 6456 tablet_bootstrap.cc:492] T fe5d081a41a3417b855656ca6e24f235 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
W20260923 19:50:11.856652 5996 leader_election.cc:343] T 465371cfbe544ba98e6eea05033ecf05 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:11.857468 6456 tablet_bootstrap.cc:654] T fe5d081a41a3417b855656ca6e24f235 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:11.858021 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e09a5dcef9e424e8cba58a9b15e6ea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.858696 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daafbafae5004b8499e7ea93342c0517" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:11.858870 6200 raft_consensus.cc:2468] T daafbafae5004b8499e7ea93342c0517 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:11.859258 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f108ebdaecab42e7b57057c7ecfbe690" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:11.859452 6199 raft_consensus.cc:2468] T f108ebdaecab42e7b57057c7ecfbe690 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:11.860240 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 5f1a3b9bd2754a868908973cc79262e2 (DEFAULT_TABLE table=default.Table_a479e36e3d0146cd99a8f7479236e5ea [id=64b15efc39cd40599a807e9e296ece9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.860600 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f1a3b9bd2754a868908973cc79262e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.864428 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_11804efbcd284ce0a6dc342000a70b98"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:11.865027 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11804efbcd284ce0a6dc342000a70b98 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:11.865869 6179 tablet_service.cc:1511] Processing CreateTablet for tablet 5494818771f04f92b37a6991b73e40a6 (DEFAULT_TABLE table=default.Table_14071e1a8af443939d9841cd4f672964 [id=bd0f3eeffd0f464c845737c35a6fda0e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:11.866142 5995 leader_election.cc:343] T 465371cfbe544ba98e6eea05033ecf05 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:11.866256 5995 leader_election.cc:304] T 465371cfbe544ba98e6eea05033ecf05 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:11.866838 7134 raft_consensus.cc:2749] T 465371cfbe544ba98e6eea05033ecf05 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:11.867321 6137 leader_election.cc:343] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: e9cbfaa34c924a678f23cbcbf1a6fb0a
I20260923 19:50:11.867516 6137 leader_election.cc:304] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:11.867921 7123 raft_consensus.cc:2749] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:11.870172 6164 tablet_service.cc:1511] Processing CreateTablet for tablet 47c261638f0d48bb82c78c9a04d487b2 (DEFAULT_TABLE table=default.Table_6e87577be39e4d298db5528f71c6af62 [id=b470ac69857e4028b16542decc95d528]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.876667 5803 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f163b8d593ca45ecb37b794671a4bf8b" } modify_external_catalogs: true
I20260923 19:50:11.876912 5803 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f163b8d593ca45ecb37b794671a4bf8b" } modify_external_catalogs: true
I20260923 19:50:11.879817 6457 tablet_bootstrap.cc:492] T 870db252d8414be7bbe613ea467b5f3a P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:11.879966 6457 ts_tablet_manager.cc:1403] T 870db252d8414be7bbe613ea467b5f3a P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.121s user 0.013s sys 0.028s
I20260923 19:50:11.880738 6457 raft_consensus.cc:359] T 870db252d8414be7bbe613ea467b5f3a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.880916 6457 raft_consensus.cc:385] T 870db252d8414be7bbe613ea467b5f3a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:11.880972 6457 raft_consensus.cc:740] T 870db252d8414be7bbe613ea467b5f3a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:11.881170 6457 consensus_queue.cc:260] T 870db252d8414be7bbe613ea467b5f3a P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.881327 5804 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_0f2148660919423195f95a973fb63500" } modify_external_catalogs: true
I20260923 19:50:11.881500 5804 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_0f2148660919423195f95a973fb63500" } modify_external_catalogs: true
I20260923 19:50:11.881843 6280 leader_election.cc:304] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:11.884316 6324 tablet_service.cc:1511] Processing CreateTablet for tablet 47c261638f0d48bb82c78c9a04d487b2 (DEFAULT_TABLE table=default.Table_6e87577be39e4d298db5528f71c6af62 [id=b470ac69857e4028b16542decc95d528]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.884994 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47c261638f0d48bb82c78c9a04d487b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.886037 6457 ts_tablet_manager.cc:1434] T 870db252d8414be7bbe613ea467b5f3a P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260923 19:50:11.886312 6457 tablet_bootstrap.cc:492] T b92aaac328934d95a89e0fc08a80b0b1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:11.887912 6457 tablet_bootstrap.cc:654] T b92aaac328934d95a89e0fc08a80b0b1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:11.887382 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 5494818771f04f92b37a6991b73e40a6 (DEFAULT_TABLE table=default.Table_14071e1a8af443939d9841cd4f672964 [id=bd0f3eeffd0f464c845737c35a6fda0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.889494 6310 tablet_service.cc:1511] Processing CreateTablet for tablet d31ef0f7e45340c1820031a51cc2bebb (DEFAULT_TABLE table=default.Table_7ffebe5b17514f94a89896e0bdf59b31 [id=f55422e39c9a41c2b0368eca09414035]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.890533 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d31ef0f7e45340c1820031a51cc2bebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.888144 6312 tablet_service.cc:1511] Processing CreateTablet for tablet 5f1a3b9bd2754a868908973cc79262e2 (DEFAULT_TABLE table=default.Table_a479e36e3d0146cd99a8f7479236e5ea [id=64b15efc39cd40599a807e9e296ece9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.892376 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5494818771f04f92b37a6991b73e40a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.892503 7172 raft_consensus.cc:2804] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:11.894068 7172 raft_consensus.cc:493] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:11.893815 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f1a3b9bd2754a868908973cc79262e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.894203 7172 raft_consensus.cc:3060] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:11.893946 6183 tablet_service.cc:1511] Processing CreateTablet for tablet d31ef0f7e45340c1820031a51cc2bebb (DEFAULT_TABLE table=default.Table_7ffebe5b17514f94a89896e0bdf59b31 [id=f55422e39c9a41c2b0368eca09414035]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.896216 6178 tablet_service.cc:1511] Processing CreateTablet for tablet c212b069c3f740ecac403c99d93de7d9 (DEFAULT_TABLE table=default.Table_5fadfa5910764258a5909469ed37ebb7 [id=e6d265d1e1af44c9b03187b91a1ffb9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.897063 7181 tablet.cc:1751] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260923 19:50:11.898478 6280 leader_election.cc:304] T f108ebdaecab42e7b57057c7ecfbe690 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:11.902418 7195 tablet.cc:1751] T ec4cc8a742114e5fb07c5c9157ce09e8 P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260923 19:50:11.904132 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5494818771f04f92b37a6991b73e40a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.904356 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47c261638f0d48bb82c78c9a04d487b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.908216 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c212b069c3f740ecac403c99d93de7d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.913509 7134 raft_consensus.cc:493] T c0ff8838ab17433ab733d3b293d4964f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:11.913713 7134 raft_consensus.cc:515] T c0ff8838ab17433ab733d3b293d4964f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.914371 7134 leader_election.cc:290] T c0ff8838ab17433ab733d3b293d4964f P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:11.916123 5799 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_bfb22d30f8ca47129ca87852c8cd56bb" } modify_external_catalogs: true
I20260923 19:50:11.916347 5799 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_bfb22d30f8ca47129ca87852c8cd56bb" } modify_external_catalogs: true
I20260923 19:50:11.918885 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d31ef0f7e45340c1820031a51cc2bebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.921816 5798 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_4d127601ed3742d99d70e54ea6381603" } modify_external_catalogs: true
I20260923 19:50:11.922462 5798 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_4d127601ed3742d99d70e54ea6381603" } modify_external_catalogs: true
I20260923 19:50:11.926527 6323 tablet_service.cc:1511] Processing CreateTablet for tablet c212b069c3f740ecac403c99d93de7d9 (DEFAULT_TABLE table=default.Table_5fadfa5910764258a5909469ed37ebb7 [id=e6d265d1e1af44c9b03187b91a1ffb9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.928335 7173 raft_consensus.cc:2804] T f108ebdaecab42e7b57057c7ecfbe690 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:11.928663 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 940d876042844020833ccc2347d67c4c (DEFAULT_TABLE table=default.Table_492aa1a4a9644f948b5bf137f57fac3d [id=eec9dccd37884607a7b5e616340c5b9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.928895 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c212b069c3f740ecac403c99d93de7d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.929172 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 940d876042844020833ccc2347d67c4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.929936 6459 ts_tablet_manager.cc:1929] T 359b08ef348d4be68b14f9e871a5e519 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:11.930055 6459 log.cc:1199] T 359b08ef348d4be68b14f9e871a5e519 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/359b08ef348d4be68b14f9e871a5e519
I20260923 19:50:11.930440 6459 ts_tablet_manager.cc:1950] T 359b08ef348d4be68b14f9e871a5e519 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:11.930878 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0ff8838ab17433ab733d3b293d4964f" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:11.931120 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 359b08ef348d4be68b14f9e871a5e519 (table default.Table_91a9675177604eb39c32e86718c59d31 [id=bf85ae2ea4884de58391fc9e7b140b7f]) successfully deleted
W20260923 19:50:11.932922 5996 leader_election.cc:343] T c0ff8838ab17433ab733d3b293d4964f P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:11.933427 5995 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 67297.6us
I20260923 19:50:11.933643 7173 raft_consensus.cc:493] T f108ebdaecab42e7b57057c7ecfbe690 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:11.933796 7173 raft_consensus.cc:3060] T f108ebdaecab42e7b57057c7ecfbe690 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:11.934578 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0ff8838ab17433ab733d3b293d4964f" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:11.936785 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet a0d817069e664199bff0d7591548e2d7 with delete_type TABLET_DATA_DELETED (replaced by tablet d1258abcb244430ca8456ad146aa0e67) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:11.937433 6029 tablet_service.cc:1511] Processing CreateTablet for tablet ccbb8cd687924f0892464c6cb80d175c (DEFAULT_TABLE table=default.Table_a6baec3d4ff94a14a032737c8ae498ef [id=8b17b21567364cd5909b6ec1bc2344da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.937834 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccbb8cd687924f0892464c6cb80d175c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.939075 6321 tablet_service.cc:1511] Processing CreateTablet for tablet 940d876042844020833ccc2347d67c4c (DEFAULT_TABLE table=default.Table_492aa1a4a9644f948b5bf137f57fac3d [id=eec9dccd37884607a7b5e616340c5b9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.940017 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 940d876042844020833ccc2347d67c4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.940168 6174 tablet_service.cc:1511] Processing CreateTablet for tablet f0915e6df24f42b3b8b1a558b7ebc7ff (DEFAULT_TABLE table=default.Table_76a8ffc5b25147c9af7758b6fe27a55d [id=ae4af211df5f4f009b89e9bf8dcde3fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.940572 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0915e6df24f42b3b8b1a558b7ebc7ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.942472 5800 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 18a31ed6bea444e7888f374927f90a60
I20260923 19:50:11.943048 5800 catalog_manager.cc:6934] ReplaceTablet: tablet 18a31ed6bea444e7888f374927f90a60 deleted and replaced by tablet ca73c91b58954537af373face5ad2f67
I20260923 19:50:11.944103 6173 tablet_service.cc:1558] Processing DeleteTablet for tablet 18a31ed6bea444e7888f374927f90a60 with delete_type TABLET_DATA_DELETED (replaced by tablet ca73c91b58954537af373face5ad2f67) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:11.944547 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_015ff0f9bdf44e38890887c344423b1f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:11.945103 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_015ff0f9bdf44e38890887c344423b1f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:11.945387 6308 tablet_service.cc:1558] Processing DeleteTablet for tablet 18a31ed6bea444e7888f374927f90a60 with delete_type TABLET_DATA_DELETED (replaced by tablet ca73c91b58954537af373face5ad2f67) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:11.946282 5995 leader_election.cc:343] T c0ff8838ab17433ab733d3b293d4964f P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:11.946408 5995 leader_election.cc:304] T c0ff8838ab17433ab733d3b293d4964f P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:11.946625 6030 tablet_service.cc:1511] Processing CreateTablet for tablet 5f1a3b9bd2754a868908973cc79262e2 (DEFAULT_TABLE table=default.Table_a479e36e3d0146cd99a8f7479236e5ea [id=64b15efc39cd40599a807e9e296ece9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.946973 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f1a3b9bd2754a868908973cc79262e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.947012 6029 tablet_service.cc:1511] Processing CreateTablet for tablet c4b7cd806c3d41dd9af0a365d84c1f12 (DEFAULT_TABLE table=default.Table_67f9d2537a904559b507c9fac72ece67 [id=b7de6cbea0c44165ab46342a14fbd685]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.947340 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4b7cd806c3d41dd9af0a365d84c1f12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.947957 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 5494818771f04f92b37a6991b73e40a6 (DEFAULT_TABLE table=default.Table_14071e1a8af443939d9841cd4f672964 [id=bd0f3eeffd0f464c845737c35a6fda0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.948271 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5494818771f04f92b37a6991b73e40a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.950145 6032 tablet_service.cc:1511] Processing CreateTablet for tablet 47c261638f0d48bb82c78c9a04d487b2 (DEFAULT_TABLE table=default.Table_6e87577be39e4d298db5528f71c6af62 [id=b470ac69857e4028b16542decc95d528]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.950455 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47c261638f0d48bb82c78c9a04d487b2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:11.946723 6279 leader_election.cc:343] T f108ebdaecab42e7b57057c7ecfbe690 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: f108ebdaecab42e7b57057c7ecfbe690
I20260923 19:50:11.945562 7173 raft_consensus.cc:515] T f108ebdaecab42e7b57057c7ecfbe690 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.954109 6034 tablet_service.cc:1511] Processing CreateTablet for tablet d31ef0f7e45340c1820031a51cc2bebb (DEFAULT_TABLE table=default.Table_7ffebe5b17514f94a89896e0bdf59b31 [id=f55422e39c9a41c2b0368eca09414035]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.954221 6454 tablet_bootstrap.cc:492] T 85d35ebef3c24a2e89233dd900b63513 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:11.954420 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d31ef0f7e45340c1820031a51cc2bebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.954409 6454 ts_tablet_manager.cc:1403] T 85d35ebef3c24a2e89233dd900b63513 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.203s user 0.014s sys 0.040s
I20260923 19:50:11.955142 6454 raft_consensus.cc:359] T 85d35ebef3c24a2e89233dd900b63513 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.955327 6454 raft_consensus.cc:385] T 85d35ebef3c24a2e89233dd900b63513 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:11.955394 6454 raft_consensus.cc:740] T 85d35ebef3c24a2e89233dd900b63513 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:11.955626 7172 raft_consensus.cc:515] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.955655 6454 consensus_queue.cc:260] T 85d35ebef3c24a2e89233dd900b63513 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.956115 6454 ts_tablet_manager.cc:1434] T 85d35ebef3c24a2e89233dd900b63513 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:50:11.956226 7172 leader_election.cc:290] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
W20260923 19:50:11.957705 6279 leader_election.cc:343] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: daafbafae5004b8499e7ea93342c0517
I20260923 19:50:11.946413 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 0e09a5dcef9e424e8cba58a9b15e6ea5 (DEFAULT_TABLE table=default.Table_e68b828ba396413d8284d20c9047243c [id=80b5f15f449d484aab546d60d6bcb25b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.958706 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 68459111552949aab20982dd7c28f7d3 (DEFAULT_TABLE table=default.Table_e980698a75d14d24afdd616fa2118c72 [id=0fc34fcbffe446c693df52715ddbe9e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.958964 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e09a5dcef9e424e8cba58a9b15e6ea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.959030 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68459111552949aab20982dd7c28f7d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.959252 6199 raft_consensus.cc:3060] T ec4284d6a0fa416ca95b4d675c8e3912 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:11.962350 6454 tablet_bootstrap.cc:492] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:11.962422 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daafbafae5004b8499e7ea93342c0517" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:11.962601 6201 raft_consensus.cc:3060] T daafbafae5004b8499e7ea93342c0517 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:11.964353 6454 tablet_bootstrap.cc:654] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:11.967013 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_0f07ebb3890d464f8787e3406572d342"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:11.967669 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f07ebb3890d464f8787e3406572d342 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:11.969458 6201 raft_consensus.cc:2468] T daafbafae5004b8499e7ea93342c0517 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:11.972313 6280 leader_election.cc:304] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:11.976037 6308 tablet_service.cc:1511] Processing CreateTablet for tablet f0915e6df24f42b3b8b1a558b7ebc7ff (DEFAULT_TABLE table=default.Table_76a8ffc5b25147c9af7758b6fe27a55d [id=ae4af211df5f4f009b89e9bf8dcde3fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.976480 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0915e6df24f42b3b8b1a558b7ebc7ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.984139 6309 tablet_service.cc:1511] Processing CreateTablet for tablet 2fa50f80b71b4946a1b394196217b774 (DEFAULT_TABLE table=default.Table_8e33c6465d2d4bc2bb7dc625ec2cfca3 [id=3fba066d479d4620ab53c2a4b5e1009f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.985478 6320 tablet_service.cc:1511] Processing CreateTablet for tablet c248ace574744b0197d90127701049d5 (DEFAULT_TABLE table=default.Table_2c27f94015dc496f9fb2233178799192 [id=b635e4f1a9b6411ab243277b508043a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.986023 7173 leader_election.cc:290] T f108ebdaecab42e7b57057c7ecfbe690 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:11.986994 6454 tablet_bootstrap.cc:492] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:11.987133 6454 ts_tablet_manager.cc:1403] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.002s
I20260923 19:50:11.988965 6454 raft_consensus.cc:359] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.989162 6454 raft_consensus.cc:385] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:11.989256 6454 raft_consensus.cc:740] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:11.989521 6454 consensus_queue.cc:260] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.990090 6454 ts_tablet_manager.cc:1434] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260923 19:50:11.990713 6179 tablet_service.cc:1511] Processing CreateTablet for tablet 88640e1a21154073ae0db18b171408b7 (DEFAULT_TABLE table=default.Table_dad9b3f98a4745baac9606ed19421df1 [id=7424b419c3ee4656a94540d90fa83deb]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:11.990732 5791 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 5494818771f04f92b37a6991b73e40a6 (table default.Table_14071e1a8af443939d9841cd4f672964 [id=bd0f3eeffd0f464c845737c35a6fda0e], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 5494818771f04f92b37a6991b73e40a6 consensus state has no leader
I20260923 19:50:11.991159 6173 tablet_service.cc:1511] Processing CreateTablet for tablet 8788f1917cb0449f84f92df2c81feff6 (DEFAULT_TABLE table=default.Table_af3299e40526459183a95451e2320ae0 [id=0a659817edec47808cdc37e8e9bca057]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.991485 6164 tablet_service.cc:1511] Processing CreateTablet for tablet c248ace574744b0197d90127701049d5 (DEFAULT_TABLE table=default.Table_2c27f94015dc496f9fb2233178799192 [id=b635e4f1a9b6411ab243277b508043a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.991184 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88640e1a21154073ae0db18b171408b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.992313 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 2fa50f80b71b4946a1b394196217b774 (DEFAULT_TABLE table=default.Table_8e33c6465d2d4bc2bb7dc625ec2cfca3 [id=3fba066d479d4620ab53c2a4b5e1009f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.992448 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8788f1917cb0449f84f92df2c81feff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.992659 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fa50f80b71b4946a1b394196217b774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.993073 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f108ebdaecab42e7b57057c7ecfbe690" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:11.993106 7123 raft_consensus.cc:493] T 337f32eb47954689a6eb8f74408e01d9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:11.993296 6201 raft_consensus.cc:3060] T f108ebdaecab42e7b57057c7ecfbe690 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:11.993338 7123 raft_consensus.cc:515] T 337f32eb47954689a6eb8f74408e01d9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:11.993558 6454 tablet_bootstrap.cc:492] T ffcf1a144f3c42719a5aa5deed537975 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:11.994509 7123 leader_election.cc:290] T 337f32eb47954689a6eb8f74408e01d9 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:11.995841 6454 tablet_bootstrap.cc:654] T ffcf1a144f3c42719a5aa5deed537975 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:11.996080 6137 leader_election.cc:343] T 337f32eb47954689a6eb8f74408e01d9 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 337f32eb47954689a6eb8f74408e01d9
I20260923 19:50:11.996941 6201 raft_consensus.cc:2468] T f108ebdaecab42e7b57057c7ecfbe690 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:11.997690 6174 tablet_service.cc:1511] Processing CreateTablet for tablet 29e6ea6b3eda4df88a539627d4505885 (DEFAULT_TABLE table=default.Table_74ffa772df8d47a4b028a5290d1c8846 [id=174fa09bf24f4c8294a5dfa5a2612afb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.999346 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 5a2e1e77494343ddb72c496d521151f1 (DEFAULT_TABLE table=default.Table_bfb22d30f8ca47129ca87852c8cd56bb [id=b1d646993d464e02a593aacbc4ef4b94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:11.999655 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c248ace574744b0197d90127701049d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:11.999831 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a2e1e77494343ddb72c496d521151f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.001966 6309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fa50f80b71b4946a1b394196217b774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.004761 6320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c248ace574744b0197d90127701049d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.006187 7172 raft_consensus.cc:2804] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:12.006413 6319 tablet_service.cc:1511] Processing CreateTablet for tablet 88640e1a21154073ae0db18b171408b7 (DEFAULT_TABLE table=default.Table_dad9b3f98a4745baac9606ed19421df1 [id=7424b419c3ee4656a94540d90fa83deb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.006870 6319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88640e1a21154073ae0db18b171408b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.009967 5796 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_8eb6b4b05ff24ee58259da0d85d11148 [id=498c667413e24c7c800fe5eae263cf22] alter complete (version 3)
I20260923 19:50:12.013433 7134 raft_consensus.cc:2749] T c0ff8838ab17433ab733d3b293d4964f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:12.013626 7134 raft_consensus.cc:493] T 601a0ff319cc4c9a898d52bbcb19184b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:12.013725 7134 raft_consensus.cc:515] T 601a0ff319cc4c9a898d52bbcb19184b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.014350 7134 leader_election.cc:290] T 601a0ff319cc4c9a898d52bbcb19184b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:12.015121 7172 raft_consensus.cc:697] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:12.015801 5796 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 7b455812687f42848df5290d0cdbc312 (table default.Table_e9cc7064dc8e4c6bb9eadb9fc3f33e09 [id=e263e510102443df8fd2b5886fa01053]). Expected version 1 got 0
I20260923 19:50:12.018838 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f92387e003d44b0eb22010e7ca6598af" } modify_external_catalogs: true
I20260923 19:50:12.019194 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f92387e003d44b0eb22010e7ca6598af" } modify_external_catalogs: true
I20260923 19:50:12.019731 7172 consensus_queue.cc:237] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:12.021477 5805 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 98f61ace3a984938ace1fedbaa1dafa3 consensus state has no leader
I20260923 19:50:12.022800 6280 leader_election.cc:304] T f108ebdaecab42e7b57057c7ecfbe690 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:12.023268 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 772ece5283a949408d849f6e56f5f17b
I20260923 19:50:12.023830 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet ecd91bf5bd9447c0bb20ba43573ff08d
W20260923 19:50:12.023885 6139 leader_election.cc:343] T 337f32eb47954689a6eb8f74408e01d9 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 337f32eb47954689a6eb8f74408e01d9
I20260923 19:50:12.024048 6324 tablet_service.cc:1511] Processing CreateTablet for tablet 29e6ea6b3eda4df88a539627d4505885 (DEFAULT_TABLE table=default.Table_74ffa772df8d47a4b028a5290d1c8846 [id=174fa09bf24f4c8294a5dfa5a2612afb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.024168 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29e6ea6b3eda4df88a539627d4505885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.024464 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29e6ea6b3eda4df88a539627d4505885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.024488 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 5a2e1e77494343ddb72c496d521151f1 (DEFAULT_TABLE table=default.Table_bfb22d30f8ca47129ca87852c8cd56bb [id=b1d646993d464e02a593aacbc4ef4b94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.024974 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a2e1e77494343ddb72c496d521151f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.025411 6321 tablet_service.cc:1558] Processing DeleteTablet for tablet ecd91bf5bd9447c0bb20ba43573ff08d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:12.026329 6458 rpcz_store.cc:276] 0923 19:50:10.611864 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:10.612376 (+ 512us) service_pool.cc:224] Handling call
0923 19:50:11.796314 (+1183938us) ts_tablet_manager.cc:1151] Deleting tablet ab73e8a1b6774ca0b43e5be67da68fab
0923 19:50:11.796327 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:11.811961 (+ 15634us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:11.815718 (+ 3757us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:11.817126 (+ 1408us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1183712}
I20260923 19:50:12.026746 7173 raft_consensus.cc:2804] T f108ebdaecab42e7b57057c7ecfbe690 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:12.026853 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet ab73e8a1b6774ca0b43e5be67da68fab (table default.Table_c716115e5d0045b691616d451daec14d [id=bb00103e5a52400b9e7fb4db39f27bd7]) successfully deleted
I20260923 19:50:12.026885 7173 raft_consensus.cc:697] T f108ebdaecab42e7b57057c7ecfbe690 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:12.027238 7173 consensus_queue.cc:237] T f108ebdaecab42e7b57057c7ecfbe690 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.027597 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 485) took 1320 ms. Trace:
I20260923 19:50:12.027696 6458 rpcz_store.cc:276] 0923 19:50:10.707257 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:10.709122 (+ 1865us) service_pool.cc:224] Handling call
0923 19:50:12.027410 (+1318288us) ts_tablet_manager.cc:1151] Deleting tablet 431ad4da27544d68aa5666293984a86a
0923 19:50:12.027421 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:12.027522 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1317987}
W20260923 19:50:12.028252 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 431ad4da27544d68aa5666293984a86a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 431ad4da27544d68aa5666293984a86a already in progress: creating tablet
I20260923 19:50:12.029017 6321 tablet_service.cc:1511] Processing CreateTablet for tablet 8788f1917cb0449f84f92df2c81feff6 (DEFAULT_TABLE table=default.Table_af3299e40526459183a95451e2320ae0 [id=0a659817edec47808cdc37e8e9bca057]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.029973 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "601a0ff319cc4c9a898d52bbcb19184b" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:12.030835 5996 leader_election.cc:343] T 601a0ff319cc4c9a898d52bbcb19184b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:12.031158 6313 tablet_service.cc:1511] Processing CreateTablet for tablet b8211238627b44468c8461bdc340b1bb (DEFAULT_TABLE table=default.Table_d8377901984e4886984600fc0b7e24a4 [id=9b0cf7215a5d43b99264e58ad27a1c90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.031494 6168 tablet_service.cc:1558] Processing DeleteTablet for tablet daafbafae5004b8499e7ea93342c0517 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:12.031610 6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8211238627b44468c8461bdc340b1bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.031693 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet 772ece5283a949408d849f6e56f5f17b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:12.031694 6139 leader_election.cc:304] T 337f32eb47954689a6eb8f74408e01d9 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:12.033047 6306 tablet_service.cc:1511] Processing CreateTablet for tablet 717101b8668f4cadb5180bb8e17939e9 (DEFAULT_TABLE table=default.Table_5f13aeaf05304dadbdb2d0d720acd604 [id=4501b432bc6e40c2ad1102cd453934a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.033383 6306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 717101b8668f4cadb5180bb8e17939e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.034909 6316 tablet_service.cc:1511] Processing CreateTablet for tablet 00eba27e9f2948e8a298c3fbca52a282 (DEFAULT_TABLE table=default.Table_5d9ccbcf620b4f5fa715523f21426d97 [id=d3ead5795ac041a8aa17dd5296ad6d20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.035254 6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00eba27e9f2948e8a298c3fbca52a282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.036624 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8788f1917cb0449f84f92df2c81feff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.038435 6459 tablet_replica.cc:333] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:12.040884 6457 tablet_bootstrap.cc:492] T b92aaac328934d95a89e0fc08a80b0b1 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:12.041076 6457 ts_tablet_manager.cc:1403] T b92aaac328934d95a89e0fc08a80b0b1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.155s user 0.024s sys 0.022s
I20260923 19:50:12.041155 7148 raft_consensus.cc:2749] T 337f32eb47954689a6eb8f74408e01d9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:12.041249 6454 tablet_bootstrap.cc:492] T ffcf1a144f3c42719a5aa5deed537975 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:12.041371 6165 tablet_service.cc:1558] Processing DeleteTablet for tablet 015c14b447fe4cd18d197b2d1ed5884e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:12.031925 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 68459111552949aab20982dd7c28f7d3 (DEFAULT_TABLE table=default.Table_e980698a75d14d24afdd616fa2118c72 [id=0fc34fcbffe446c693df52715ddbe9e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.041839 6457 raft_consensus.cc:359] T b92aaac328934d95a89e0fc08a80b0b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.042181 6457 raft_consensus.cc:385] T b92aaac328934d95a89e0fc08a80b0b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:12.042277 6457 raft_consensus.cc:740] T b92aaac328934d95a89e0fc08a80b0b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:12.042632 6457 consensus_queue.cc:260] T b92aaac328934d95a89e0fc08a80b0b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.043882 6457 ts_tablet_manager.cc:1434] T b92aaac328934d95a89e0fc08a80b0b1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260923 19:50:12.044193 6457 tablet_bootstrap.cc:492] T 8d87f05f29bd476386ff6516676ce31a P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:12.046265 6457 tablet_bootstrap.cc:654] T 8d87f05f29bd476386ff6516676ce31a P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:12.051628 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 490) took 1254 ms. Trace:
I20260923 19:50:12.058549 6312 tablet_service.cc:1511] Processing CreateTablet for tablet 9c1e6162afed49cfb88d2a0aa578c244 (DEFAULT_TABLE table=default.Table_cb408624c0d145ca843187791183aa32 [id=8c0f7c54034c4195aae17b4dcd78cc62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.061437 6314 tablet_service.cc:1511] Processing CreateTablet for tablet 355b2fc61d4f4efd918204079f1ebf35 (DEFAULT_TABLE table=default.Table_f1842456992c4765924d809a3a062c07 [id=361a67b795ad41bb829dffbf0cc7dcc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.062088 5799 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 5a2e1e77494343ddb72c496d521151f1
I20260923 19:50:12.066979 6317 tablet_service.cc:1511] Processing CreateTablet for tablet a57c91e5d3ab432dbc7e10eb11a020b8 (DEFAULT_TABLE table=default.Table_bfda8ee8ad2148e7b534d1e778b74427 [id=731af5872f3549cb945961f95729c8d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.068040 6457 tablet_bootstrap.cc:492] T 8d87f05f29bd476386ff6516676ce31a P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:12.068275 6457 ts_tablet_manager.cc:1403] T 8d87f05f29bd476386ff6516676ce31a P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.013s
I20260923 19:50:12.070135 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet bfe87e992ca04ea293e354da508e4c67
I20260923 19:50:12.070565 6457 raft_consensus.cc:359] T 8d87f05f29bd476386ff6516676ce31a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.070756 6457 raft_consensus.cc:385] T 8d87f05f29bd476386ff6516676ce31a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:12.070850 6457 raft_consensus.cc:740] T 8d87f05f29bd476386ff6516676ce31a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:12.071096 6457 consensus_queue.cc:260] T 8d87f05f29bd476386ff6516676ce31a P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.071910 6457 ts_tablet_manager.cc:1434] T 8d87f05f29bd476386ff6516676ce31a P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260923 19:50:12.072244 6457 tablet_bootstrap.cc:492] T 12f4abb573bd4be6961b55c27c684d06 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:12.074697 6457 tablet_bootstrap.cc:654] T 12f4abb573bd4be6961b55c27c684d06 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:12.062188 6458 rpcz_store.cc:276] 0923 19:50:10.793027 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:10.793077 (+ 50us) service_pool.cc:224] Handling call
0923 19:50:12.040363 (+1247286us) ts_tablet_manager.cc:1151] Deleting tablet 528fca12bfe04747830ad1d3bb323676
0923 19:50:12.043039 (+ 2676us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:12.047365 (+ 4326us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1246974}
I20260923 19:50:12.076673 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c1e6162afed49cfb88d2a0aa578c244. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.077666 6166 tablet_service.cc:1511] Processing CreateTablet for tablet 00eba27e9f2948e8a298c3fbca52a282 (DEFAULT_TABLE table=default.Table_5d9ccbcf620b4f5fa715523f21426d97 [id=d3ead5795ac041a8aa17dd5296ad6d20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.078128 6456 tablet_bootstrap.cc:492] T fe5d081a41a3417b855656ca6e24f235 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:12.078321 6456 ts_tablet_manager.cc:1403] T fe5d081a41a3417b855656ca6e24f235 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.223s user 0.004s sys 0.000s
I20260923 19:50:12.079217 6170 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a2e1e77494343ddb72c496d521151f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:12.079190 6456 raft_consensus.cc:359] T fe5d081a41a3417b855656ca6e24f235 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.079375 6456 raft_consensus.cc:385] T fe5d081a41a3417b855656ca6e24f235 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:12.079474 6456 raft_consensus.cc:740] T fe5d081a41a3417b855656ca6e24f235 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:12.079725 6456 consensus_queue.cc:260] T fe5d081a41a3417b855656ca6e24f235 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.080895 6456 ts_tablet_manager.cc:1434] T fe5d081a41a3417b855656ca6e24f235 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:50:12.081291 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 355b2fc61d4f4efd918204079f1ebf35. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:12.081357 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet ba639d8c68cf49a49a5ec5729143cf6b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba639d8c68cf49a49a5ec5729143cf6b already in progress: creating tablet
W20260923 19:50:12.081636 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 465371cfbe544ba98e6eea05033ecf05 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 465371cfbe544ba98e6eea05033ecf05 already in progress: creating tablet
W20260923 19:50:12.081912 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 2526884ab0ef404aaf93051cc842c695 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2526884ab0ef404aaf93051cc842c695 already in progress: creating tablet
W20260923 19:50:12.082154 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 2852e91ccd0c44b3b16f8189e57575d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2852e91ccd0c44b3b16f8189e57575d7 already in progress: creating tablet
W20260923 19:50:12.082448 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet a0d817069e664199bff0d7591548e2d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0d817069e664199bff0d7591548e2d7 already in progress: creating tablet
I20260923 19:50:12.085201 6318 tablet_service.cc:1511] Processing CreateTablet for tablet 55991fab89be47afba7fcd08673ef82f (DEFAULT_TABLE table=default.Table_ce3b70141f6a4c24aa6d4f53fe8c97f8 [id=fda97d4d322f453296d283fffa052c35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.087321 6457 tablet_bootstrap.cc:492] T 12f4abb573bd4be6961b55c27c684d06 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:12.087885 6457 ts_tablet_manager.cc:1403] T 12f4abb573bd4be6961b55c27c684d06 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.004s
I20260923 19:50:12.090001 6457 raft_consensus.cc:359] T 12f4abb573bd4be6961b55c27c684d06 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.090370 6457 raft_consensus.cc:385] T 12f4abb573bd4be6961b55c27c684d06 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:12.090514 6457 raft_consensus.cc:740] T 12f4abb573bd4be6961b55c27c684d06 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:12.091001 6457 consensus_queue.cc:260] T 12f4abb573bd4be6961b55c27c684d06 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.092168 6457 ts_tablet_manager.cc:1434] T 12f4abb573bd4be6961b55c27c684d06 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260923 19:50:12.092844 6457 tablet_bootstrap.cc:492] T 0e123b69877e4b1fbcdb2b27960864e9 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
W20260923 19:50:12.094413 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 528fca12bfe04747830ad1d3bb323676 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 528fca12bfe04747830ad1d3bb323676 already in progress: creating tablet
I20260923 19:50:12.096472 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 688bb1055ba94c2996cdfea6dea76416
I20260923 19:50:12.097716 6457 tablet_bootstrap.cc:654] T 0e123b69877e4b1fbcdb2b27960864e9 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:12.101424 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a57c91e5d3ab432dbc7e10eb11a020b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.103451 6307 tablet_service.cc:1558] Processing DeleteTablet for tablet bfe87e992ca04ea293e354da508e4c67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:12.105005 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 491) took 1272 ms. Trace:
I20260923 19:50:12.105738 6318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55991fab89be47afba7fcd08673ef82f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.106957 6456 tablet_bootstrap.cc:492] T 194494af2c424a55a772f3858af63c2c P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:12.109381 6307 tablet_service.cc:1558] Processing DeleteTablet for tablet 688bb1055ba94c2996cdfea6dea76416 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:12.112645 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a2e1e77494343ddb72c496d521151f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:12.113195 6457 tablet_bootstrap.cc:492] T 0e123b69877e4b1fbcdb2b27960864e9 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:12.113495 6457 ts_tablet_manager.cc:1403] T 0e123b69877e4b1fbcdb2b27960864e9 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.007s
I20260923 19:50:12.115550 6458 rpcz_store.cc:276] 0923 19:50:10.811747 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:10.815376 (+ 3629us) service_pool.cc:224] Handling call
0923 19:50:12.075466 (+1260090us) ts_tablet_manager.cc:1151] Deleting tablet 7804d14acf5d491b9f637716f0046877
0923 19:50:12.075478 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:12.083964 (+ 8486us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1259825}
I20260923 19:50:12.118068 6457 raft_consensus.cc:359] T 0e123b69877e4b1fbcdb2b27960864e9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.118637 6457 raft_consensus.cc:385] T 0e123b69877e4b1fbcdb2b27960864e9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260923 19:50:12.118742 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 7804d14acf5d491b9f637716f0046877 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7804d14acf5d491b9f637716f0046877 already in progress: creating tablet
I20260923 19:50:12.118898 6457 raft_consensus.cc:740] T 0e123b69877e4b1fbcdb2b27960864e9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:12.119370 6457 consensus_queue.cc:260] T 0e123b69877e4b1fbcdb2b27960864e9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.120399 6454 ts_tablet_manager.cc:1403] T ffcf1a144f3c42719a5aa5deed537975 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.048s user 0.002s sys 0.004s
I20260923 19:50:12.120347 7123 raft_consensus.cc:493] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:12.121464 6457 ts_tablet_manager.cc:1434] T 0e123b69877e4b1fbcdb2b27960864e9 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.008s user 0.001s sys 0.002s
I20260923 19:50:12.075963 6169 tablet_service.cc:1558] Processing DeleteTablet for tablet c48d4a8371fa4454b7c67291db3ab796 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:12.121791 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68459111552949aab20982dd7c28f7d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.122195 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00eba27e9f2948e8a298c3fbca52a282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.122916 6168 tablet_service.cc:1558] Processing DeleteTablet for tablet 337f32eb47954689a6eb8f74408e01d9 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d654b14cafa453185179fe57a25e2d9) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:12.123117 6457 tablet_bootstrap.cc:492] T efc63a151f6444dfb03c3f15f6f54473 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:12.126899 6457 tablet_bootstrap.cc:654] T efc63a151f6444dfb03c3f15f6f54473 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:12.127103 6182 tablet_service.cc:1558] Processing DeleteTablet for tablet 772ece5283a949408d849f6e56f5f17b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:12.127413 6180 tablet_service.cc:1558] Processing DeleteTablet for tablet ecd91bf5bd9447c0bb20ba43573ff08d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:12.129520 7211 raft_consensus.cc:493] T 18bab39d85f94f4283f0b18c1c9b48a2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:12.129647 7211 raft_consensus.cc:515] T 18bab39d85f94f4283f0b18c1c9b48a2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.129889 6176 tablet_service.cc:1511] Processing CreateTablet for tablet b8211238627b44468c8461bdc340b1bb (DEFAULT_TABLE table=default.Table_d8377901984e4886984600fc0b7e24a4 [id=9b0cf7215a5d43b99264e58ad27a1c90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.130434 6176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8211238627b44468c8461bdc340b1bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.130385 7211 leader_election.cc:290] T 18bab39d85f94f4283f0b18c1c9b48a2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:12.134558 5790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.143.254:37151, user_credentials={real_user=slave}} blocked reactor thread for 131715us
I20260923 19:50:12.135973 6037 tablet_service.cc:1511] Processing CreateTablet for tablet c212b069c3f740ecac403c99d93de7d9 (DEFAULT_TABLE table=default.Table_5fadfa5910764258a5909469ed37ebb7 [id=e6d265d1e1af44c9b03187b91a1ffb9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.136379 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c212b069c3f740ecac403c99d93de7d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.137949 6177 tablet_service.cc:1511] Processing CreateTablet for tablet 717101b8668f4cadb5180bb8e17939e9 (DEFAULT_TABLE table=default.Table_5f13aeaf05304dadbdb2d0d720acd604 [id=4501b432bc6e40c2ad1102cd453934a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.138384 6177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 717101b8668f4cadb5180bb8e17939e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.142204 6032 tablet_service.cc:1511] Processing CreateTablet for tablet 940d876042844020833ccc2347d67c4c (DEFAULT_TABLE table=default.Table_492aa1a4a9644f948b5bf137f57fac3d [id=eec9dccd37884607a7b5e616340c5b9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.142357 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bab39d85f94f4283f0b18c1c9b48a2" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:12.142588 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 940d876042844020833ccc2347d67c4c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:12.145183 5996 leader_election.cc:343] T 18bab39d85f94f4283f0b18c1c9b48a2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:12.146026 6165 tablet_service.cc:1558] Processing DeleteTablet for tablet f108ebdaecab42e7b57057c7ecfbe690 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:12.078781 6171 tablet_service.cc:1511] Processing CreateTablet for tablet a57c91e5d3ab432dbc7e10eb11a020b8 (DEFAULT_TABLE table=default.Table_bfda8ee8ad2148e7b534d1e778b74427 [id=731af5872f3549cb945961f95729c8d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.146555 6171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a57c91e5d3ab432dbc7e10eb11a020b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.148491 7172 raft_consensus.cc:493] T ffcf1a144f3c42719a5aa5deed537975 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:12.149987 6173 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f627b7b9ff74750bd8dd59840bf77db with delete_type TABLET_DATA_DELETED (replaced by tablet d40327145d4d44009f12358eacacf0dd) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:12.150378 6172 tablet_service.cc:1511] Processing CreateTablet for tablet 55991fab89be47afba7fcd08673ef82f (DEFAULT_TABLE table=default.Table_ce3b70141f6a4c24aa6d4f53fe8c97f8 [id=fda97d4d322f453296d283fffa052c35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.150763 6172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55991fab89be47afba7fcd08673ef82f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:12.151747 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet a0d817069e664199bff0d7591548e2d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0d817069e664199bff0d7591548e2d7 already in progress: creating tablet
I20260923 19:50:12.152977 5796 master_service.cc:960] ReplaceTablet: received request to replace tablet e4ad9baac560463fabc80828074b46c1 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:12.153424 5800 master_service.cc:960] ReplaceTablet: received request to replace tablet 684eb2576b4b4730813b993e36b242df from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:12.153949 6181 tablet_service.cc:1511] Processing CreateTablet for tablet 9c1e6162afed49cfb88d2a0aa578c244 (DEFAULT_TABLE table=default.Table_cb408624c0d145ca843187791183aa32 [id=8c0f7c54034c4195aae17b4dcd78cc62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.154330 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c1e6162afed49cfb88d2a0aa578c244. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.154239 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_08afceb3d6d0424281def7649bc0a3e4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:12.154793 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_08afceb3d6d0424281def7649bc0a3e4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:12.157363 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 492) took 1301 ms. Trace:
I20260923 19:50:12.158033 6175 tablet_service.cc:1511] Processing CreateTablet for tablet 355b2fc61d4f4efd918204079f1ebf35 (DEFAULT_TABLE table=default.Table_f1842456992c4765924d809a3a062c07 [id=361a67b795ad41bb829dffbf0cc7dcc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.158294 5802 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_cef826cee2414ab28c8dd4a4fc039c1f" } new_table_name: "default.Table_10cc33ba2656438aad3a4aa066bfa74e" modify_external_catalogs: true
I20260923 19:50:12.158457 6175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 355b2fc61d4f4efd918204079f1ebf35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.159616 7172 raft_consensus.cc:515] T ffcf1a144f3c42719a5aa5deed537975 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.160748 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b3579cbf488c4d1eb5f605ab4e11c340" } new_table_name: "default.Table_3f0fe2b329f64cdf9617315270900e4f" modify_external_catalogs: true
I20260923 19:50:12.163090 5799 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5d9ccbcf620b4f5fa715523f21426d97" } new_table_name: "default.Table_ebe7885970c7419aaa4094f753351c78" modify_external_catalogs: true
I20260923 19:50:12.165488 5804 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_8eb6b4b05ff24ee58259da0d85d11148" } new_table_name: "default.Table_7d19012d024e4648bce4b76d92e1a388" modify_external_catalogs: true
I20260923 19:50:12.167840 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_a9b0868c631e4f55a22ad70293408696"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:12.168345 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a9b0868c631e4f55a22ad70293408696 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:12.170830 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_07770b1d25f549b5bda7cb16b2dde82c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:12.171341 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_07770b1d25f549b5bda7cb16b2dde82c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:12.173835 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_2e5272f3f9b443fbbbb342873d0065b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:12.174364 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e5272f3f9b443fbbbb342873d0065b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:12.176978 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_ef9d322446c04ecca302603e02b14fe8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:12.177726 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ef9d322446c04ecca302603e02b14fe8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:12.179152 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e55ab069a0fa48398b39bbb9e7c65cd1 consensus state has no leader
W20260923 19:50:12.179683 5799 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 00eba27e9f2948e8a298c3fbca52a282 consensus state has no leader
I20260923 19:50:12.179987 7172 leader_election.cc:290] T ffcf1a144f3c42719a5aa5deed537975 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
W20260923 19:50:12.181173 5802 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7f7ecbb8d9054dde96b2bb511697dd47 has no consensus state
I20260923 19:50:12.184090 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "601a0ff319cc4c9a898d52bbcb19184b" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:12.186275 6457 tablet_bootstrap.cc:492] T efc63a151f6444dfb03c3f15f6f54473 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:12.186487 6457 ts_tablet_manager.cc:1403] T efc63a151f6444dfb03c3f15f6f54473 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.064s user 0.014s sys 0.038s
I20260923 19:50:12.187466 6457 raft_consensus.cc:359] T efc63a151f6444dfb03c3f15f6f54473 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.187706 6457 raft_consensus.cc:385] T efc63a151f6444dfb03c3f15f6f54473 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:12.187826 6457 raft_consensus.cc:740] T efc63a151f6444dfb03c3f15f6f54473 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:12.188087 6457 consensus_queue.cc:260] T efc63a151f6444dfb03c3f15f6f54473 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.189199 6457 ts_tablet_manager.cc:1434] T efc63a151f6444dfb03c3f15f6f54473 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260923 19:50:12.189723 6457 tablet_bootstrap.cc:492] T 66739afdf147413787acb0363aa37df6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:12.191854 6457 tablet_bootstrap.cc:654] T 66739afdf147413787acb0363aa37df6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:12.200438 6457 tablet_bootstrap.cc:492] T 66739afdf147413787acb0363aa37df6 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:12.200695 6457 ts_tablet_manager.cc:1403] T 66739afdf147413787acb0363aa37df6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.011s user 0.010s sys 0.000s
I20260923 19:50:12.201470 6457 raft_consensus.cc:359] T 66739afdf147413787acb0363aa37df6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.201802 6457 raft_consensus.cc:385] T 66739afdf147413787acb0363aa37df6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:12.201894 6457 raft_consensus.cc:740] T 66739afdf147413787acb0363aa37df6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:12.202224 6457 consensus_queue.cc:260] T 66739afdf147413787acb0363aa37df6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.203418 6457 ts_tablet_manager.cc:1434] T 66739afdf147413787acb0363aa37df6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:50:12.204763 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_dfda35b7191d4d5cb77451b06e244c47"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:12.204854 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_0ec899ce5bf64ab2b558e12b3c41133d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:12.205425 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0ec899ce5bf64ab2b558e12b3c41133d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:12.205693 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dfda35b7191d4d5cb77451b06e244c47 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:12.206279 6457 tablet_bootstrap.cc:492] T edb52bd88b424129bbdc45de89b56efb P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:12.208734 6457 tablet_bootstrap.cc:654] T edb52bd88b424129bbdc45de89b56efb P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:12.216949 6457 tablet_bootstrap.cc:492] T edb52bd88b424129bbdc45de89b56efb P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:12.217190 6457 ts_tablet_manager.cc:1403] T edb52bd88b424129bbdc45de89b56efb P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.004s
I20260923 19:50:12.218043 6457 raft_consensus.cc:359] T edb52bd88b424129bbdc45de89b56efb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.218305 6457 raft_consensus.cc:385] T edb52bd88b424129bbdc45de89b56efb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:12.218401 6457 raft_consensus.cc:740] T edb52bd88b424129bbdc45de89b56efb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:12.218720 6457 consensus_queue.cc:260] T edb52bd88b424129bbdc45de89b56efb P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.219372 6457 ts_tablet_manager.cc:1434] T edb52bd88b424129bbdc45de89b56efb P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:12.219702 6457 tablet_bootstrap.cc:492] T c19298691d5d4209b2d1147a1aad2f6f P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:12.221769 6457 tablet_bootstrap.cc:654] T c19298691d5d4209b2d1147a1aad2f6f P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:12.182557 6458 rpcz_store.cc:276] 0923 19:50:10.828238 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:10.828295 (+ 57us) service_pool.cc:224] Handling call
0923 19:50:12.119225 (+1290930us) ts_tablet_manager.cc:1151] Deleting tablet a75c4436a67f453e973a7a7645de79b1
0923 19:50:12.119240 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:12.129462 (+ 10222us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1290687}
W20260923 19:50:12.225026 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet a75c4436a67f453e973a7a7645de79b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a75c4436a67f453e973a7a7645de79b1 already in progress: creating tablet
I20260923 19:50:12.229561 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet e4ad9baac560463fabc80828074b46c1
I20260923 19:50:12.230170 5796 catalog_manager.cc:6934] ReplaceTablet: tablet e4ad9baac560463fabc80828074b46c1 deleted and replaced by tablet cffe24ab4df745e3a34f82e8ca7b39f5
I20260923 19:50:12.230635 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 493) took 1383 ms. Trace:
I20260923 19:50:12.230856 6458 rpcz_store.cc:276] 0923 19:50:10.847128 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:10.847196 (+ 68us) service_pool.cc:224] Handling call
0923 19:50:12.225385 (+1378189us) ts_tablet_manager.cc:1151] Deleting tablet c7369a5fc87f4b70bcfbe052ef021771
0923 19:50:12.225401 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:12.230554 (+ 5153us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1377898}
I20260923 19:50:12.231679 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 495) took 1320 ms. Trace:
I20260923 19:50:12.231812 6457 tablet_bootstrap.cc:492] T c19298691d5d4209b2d1147a1aad2f6f P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:12.231832 6458 rpcz_store.cc:276] 0923 19:50:10.911403 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:10.911782 (+ 379us) service_pool.cc:224] Handling call
0923 19:50:12.231511 (+1319729us) ts_tablet_manager.cc:1151] Deleting tablet 7af330ae1aaa48209f2bd1880bcfebb1
0923 19:50:12.231523 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:12.231623 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1319437}
I20260923 19:50:12.232177 6458 tablet_replica.cc:333] T 495292cacf3b42a5b633ad40e5e01972 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:12.232197 6457 ts_tablet_manager.cc:1403] T c19298691d5d4209b2d1147a1aad2f6f P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.008s
I20260923 19:50:12.232597 6458 raft_consensus.cc:2243] T 495292cacf3b42a5b633ad40e5e01972 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:12.233268 6457 raft_consensus.cc:359] T c19298691d5d4209b2d1147a1aad2f6f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.233577 6457 raft_consensus.cc:385] T c19298691d5d4209b2d1147a1aad2f6f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:12.233711 6457 raft_consensus.cc:740] T c19298691d5d4209b2d1147a1aad2f6f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
W20260923 19:50:12.234004 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet c7369a5fc87f4b70bcfbe052ef021771 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c7369a5fc87f4b70bcfbe052ef021771 already in progress: creating tablet
I20260923 19:50:12.234043 6457 consensus_queue.cc:260] T c19298691d5d4209b2d1147a1aad2f6f P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:12.234359 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 7af330ae1aaa48209f2bd1880bcfebb1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7af330ae1aaa48209f2bd1880bcfebb1 already in progress: creating tablet
I20260923 19:50:12.234923 6457 ts_tablet_manager.cc:1434] T c19298691d5d4209b2d1147a1aad2f6f P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:50:12.235718 6457 tablet_bootstrap.cc:492] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:12.236670 6459 raft_consensus.cc:2243] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:12.236951 6459 raft_consensus.cc:2272] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:12.237601 6459 ts_tablet_manager.cc:1916] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:12.237748 6457 tablet_bootstrap.cc:654] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:12.239028 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet 18a31ed6bea444e7888f374927f90a60 with delete_type TABLET_DATA_DELETED (replaced by tablet ca73c91b58954537af373face5ad2f67) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:12.240666 6037 tablet_service.cc:1511] Processing CreateTablet for tablet f0915e6df24f42b3b8b1a558b7ebc7ff (DEFAULT_TABLE table=default.Table_76a8ffc5b25147c9af7758b6fe27a55d [id=ae4af211df5f4f009b89e9bf8dcde3fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.238715 7123 raft_consensus.cc:515] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.241118 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0915e6df24f42b3b8b1a558b7ebc7ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.242978 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 45e7232e2b26488dbc33ea7865d710f3 (DEFAULT_TABLE table=default.Table_11804efbcd284ce0a6dc342000a70b98 [id=7cdb1f6c949f4f8a96e6f57c4b1b45e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.243556 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45e7232e2b26488dbc33ea7865d710f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.243772 7211 raft_consensus.cc:493] T 0e123b69877e4b1fbcdb2b27960864e9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:12.243932 7211 raft_consensus.cc:515] T 0e123b69877e4b1fbcdb2b27960864e9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.245569 7211 leader_election.cc:290] T 0e123b69877e4b1fbcdb2b27960864e9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:12.248032 6456 tablet_bootstrap.cc:654] T 194494af2c424a55a772f3858af63c2c P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:12.248103 6169 tablet_service.cc:1558] Processing DeleteTablet for tablet bfe87e992ca04ea293e354da508e4c67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:12.248956 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 68459111552949aab20982dd7c28f7d3 (DEFAULT_TABLE table=default.Table_e980698a75d14d24afdd616fa2118c72 [id=0fc34fcbffe446c693df52715ddbe9e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.249464 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68459111552949aab20982dd7c28f7d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.249594 6321 tablet_service.cc:1558] Processing DeleteTablet for tablet e4ad9baac560463fabc80828074b46c1 with delete_type TABLET_DATA_DELETED (replaced by tablet cffe24ab4df745e3a34f82e8ca7b39f5) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:12.249959 6137 leader_election.cc:343] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 2f627b7b9ff74750bd8dd59840bf77db
I20260923 19:50:12.250442 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e123b69877e4b1fbcdb2b27960864e9" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:12.250689 6458 raft_consensus.cc:2272] T 495292cacf3b42a5b633ad40e5e01972 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:12.251794 6457 tablet_bootstrap.cc:492] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:12.252008 6457 ts_tablet_manager.cc:1403] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.004s
I20260923 19:50:12.253011 6457 raft_consensus.cc:359] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.253286 6457 raft_consensus.cc:385] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260923 19:50:12.253712 5996 leader_election.cc:343] T 0e123b69877e4b1fbcdb2b27960864e9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:12.253453 6457 raft_consensus.cc:740] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:12.254231 6457 consensus_queue.cc:260] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.254794 6032 tablet_service.cc:1511] Processing CreateTablet for tablet 5a2e1e77494343ddb72c496d521151f1 (DEFAULT_TABLE table=default.Table_bfb22d30f8ca47129ca87852c8cd56bb [id=b1d646993d464e02a593aacbc4ef4b94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.254961 6457 ts_tablet_manager.cc:1434] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260923 19:50:12.255214 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a2e1e77494343ddb72c496d521151f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.255252 6457 tablet_bootstrap.cc:492] T 6a2564a99c274e07a7e43da739a2458b P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:12.257176 6457 tablet_bootstrap.cc:654] T 6a2564a99c274e07a7e43da739a2458b P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:12.260454 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f627b7b9ff74750bd8dd59840bf77db" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:12.261060 6458 ts_tablet_manager.cc:1916] T 495292cacf3b42a5b633ad40e5e01972 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:12.261118 6344 raft_consensus.cc:2468] T 2f627b7b9ff74750bd8dd59840bf77db P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:12.261646 6321 tablet_service.cc:1511] Processing CreateTablet for tablet a4c5fdd14ecb467eadfd5036dfb3783f (DEFAULT_TABLE table=default.Table_f0a0c094a432441db9c448896dc1b403 [id=540995bffc6a4a6eaa49531aad0a3d25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.265257 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4c5fdd14ecb467eadfd5036dfb3783f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.266976 7211 raft_consensus.cc:493] T 12f4abb573bd4be6961b55c27c684d06 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:12.267095 6314 tablet_service.cc:1511] Processing CreateTablet for tablet 441ec1cea9a74dd3ac4dc139d2b0baa2 (DEFAULT_TABLE table=default.Table_61a67edc9b154897b37cedf4df6485f7 [id=606b76fabc8c42dc9d2c7b0061eee58f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.267143 7211 raft_consensus.cc:515] T 12f4abb573bd4be6961b55c27c684d06 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.268254 7211 leader_election.cc:290] T 12f4abb573bd4be6961b55c27c684d06 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:12.268767 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 3dead6c00e2c4516aa01547496a207fe (DEFAULT_TABLE table=default.Table_17d1d2de473849f79d13c8d52085d52b [id=efff804e3f994ba484af2a8bd93d9850]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.270458 5796 catalog_manager.cc:5838] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:12.270875 5796 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet b529b0e82c5b48edac54cc281ac4b4a6 (table default.Table_504bdbe9702948d58b4f958360a2040b [id=ca73f0867b5d49cfb0bb7cd2315c47f2]). Expected version 5 got 0
I20260923 19:50:12.271473 5796 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 115048f771764e41a3816e17a6c6cf94 (table default.Table_7d19012d024e4648bce4b76d92e1a388 [id=498c667413e24c7c800fe5eae263cf22]). Expected version 4 got 3
I20260923 19:50:12.273988 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f4abb573bd4be6961b55c27c684d06" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:12.274564 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 441ec1cea9a74dd3ac4dc139d2b0baa2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:12.274669 5996 leader_election.cc:343] T 12f4abb573bd4be6961b55c27c684d06 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:12.276736 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dead6c00e2c4516aa01547496a207fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.288733 5796 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_609f0fa8001e4a40905d2d090fc739b1 [id=89181985e6154c7fa946148e48bef2eb] alter complete (version 3)
I20260923 19:50:12.292826 6318 tablet_service.cc:1558] Processing DeleteTablet for tablet 3919b15a00eb4fb08008f065f556c760 with delete_type TABLET_DATA_DELETED (replaced by tablet f74e7cb3e5f54dfdb2280c795ce2ce53) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:12.293447 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 7418058b0f5a44d189888b0b1714eb2e (DEFAULT_TABLE table=default.Table_bf259d1800344a87933c314d8362033f [id=41bc1e16f1224881ab414bf6c4659e06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.293849 7123 leader_election.cc:290] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:12.294436 6032 tablet_service.cc:1511] Processing CreateTablet for tablet 29e6ea6b3eda4df88a539627d4505885 (DEFAULT_TABLE table=default.Table_74ffa772df8d47a4b028a5290d1c8846 [id=174fa09bf24f4c8294a5dfa5a2612afb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.294914 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29e6ea6b3eda4df88a539627d4505885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.296051 6456 tablet_bootstrap.cc:492] T 194494af2c424a55a772f3858af63c2c P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:12.296437 6456 ts_tablet_manager.cc:1403] T 194494af2c424a55a772f3858af63c2c P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.195s user 0.004s sys 0.002s
I20260923 19:50:12.298051 6169 tablet_service.cc:1558] Processing DeleteTablet for tablet e4ad9baac560463fabc80828074b46c1 with delete_type TABLET_DATA_DELETED (replaced by tablet cffe24ab4df745e3a34f82e8ca7b39f5) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:12.299899 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 2fa50f80b71b4946a1b394196217b774 (DEFAULT_TABLE table=default.Table_8e33c6465d2d4bc2bb7dc625ec2cfca3 [id=3fba066d479d4620ab53c2a4b5e1009f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.300336 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fa50f80b71b4946a1b394196217b774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.303746 6139 leader_election.cc:304] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:12.304386 6168 tablet_service.cc:1558] Processing DeleteTablet for tablet 688bb1055ba94c2996cdfea6dea76416 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:12.307940 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 8788f1917cb0449f84f92df2c81feff6 (DEFAULT_TABLE table=default.Table_af3299e40526459183a95451e2320ae0 [id=0a659817edec47808cdc37e8e9bca057]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.308387 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8788f1917cb0449f84f92df2c81feff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.311599 6201 raft_consensus.cc:3060] T 85d35ebef3c24a2e89233dd900b63513 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:12.307947 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 88640e1a21154073ae0db18b171408b7 (DEFAULT_TABLE table=default.Table_dad9b3f98a4745baac9606ed19421df1 [id=7424b419c3ee4656a94540d90fa83deb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.314390 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88640e1a21154073ae0db18b171408b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.317239 7181 tablet.cc:1751] T 115048f771764e41a3816e17a6c6cf94 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260923 19:50:12.326174 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcf1a144f3c42719a5aa5deed537975" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:12.326304 6034 tablet_service.cc:1511] Processing CreateTablet for tablet c248ace574744b0197d90127701049d5 (DEFAULT_TABLE table=default.Table_2c27f94015dc496f9fb2233178799192 [id=b635e4f1a9b6411ab243277b508043a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.326747 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c248ace574744b0197d90127701049d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.326717 6173 tablet_service.cc:1511] Processing CreateTablet for tablet 3dead6c00e2c4516aa01547496a207fe (DEFAULT_TABLE table=default.Table_17d1d2de473849f79d13c8d52085d52b [id=efff804e3f994ba484af2a8bd93d9850]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.327276 7123 raft_consensus.cc:493] T c48d4a8371fa4454b7c67291db3ab796 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:12.327924 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7418058b0f5a44d189888b0b1714eb2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.329506 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dead6c00e2c4516aa01547496a207fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.335734 6170 tablet_service.cc:1511] Processing CreateTablet for tablet 441ec1cea9a74dd3ac4dc139d2b0baa2 (DEFAULT_TABLE table=default.Table_61a67edc9b154897b37cedf4df6485f7 [id=606b76fabc8c42dc9d2c7b0061eee58f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.336210 6170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 441ec1cea9a74dd3ac4dc139d2b0baa2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:12.337621 6280 leader_election.cc:343] T ffcf1a144f3c42719a5aa5deed537975 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:12.338038 6317 tablet_service.cc:1558] Processing DeleteTablet for tablet fe5d081a41a3417b855656ca6e24f235 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:12.339025 6030 tablet_service.cc:1558] Processing DeleteTablet for tablet 601a0ff319cc4c9a898d52bbcb19184b with delete_type TABLET_DATA_DELETED (replaced by tablet 02fa9052a7054659baf9b07b770bb538) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:12.339264 6461 tablet_replica.cc:333] T 601a0ff319cc4c9a898d52bbcb19184b P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:12.339470 6461 raft_consensus.cc:2243] T 601a0ff319cc4c9a898d52bbcb19184b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:12.339645 6461 raft_consensus.cc:2272] T 601a0ff319cc4c9a898d52bbcb19184b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:12.340209 6461 ts_tablet_manager.cc:1916] T 601a0ff319cc4c9a898d52bbcb19184b P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:12.341995 7148 raft_consensus.cc:2804] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:12.342116 7148 raft_consensus.cc:493] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:12.337174 6168 tablet_service.cc:1511] Processing CreateTablet for tablet 45e7232e2b26488dbc33ea7865d710f3 (DEFAULT_TABLE table=default.Table_11804efbcd284ce0a6dc342000a70b98 [id=7cdb1f6c949f4f8a96e6f57c4b1b45e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.345057 7148 raft_consensus.cc:3060] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:12.345357 6169 tablet_service.cc:1511] Processing CreateTablet for tablet a4c5fdd14ecb467eadfd5036dfb3783f (DEFAULT_TABLE table=default.Table_f0a0c094a432441db9c448896dc1b403 [id=540995bffc6a4a6eaa49531aad0a3d25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.345409 7195 tablet.cc:1751] T 115048f771764e41a3816e17a6c6cf94 P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260923 19:50:12.343318 6454 raft_consensus.cc:359] T ffcf1a144f3c42719a5aa5deed537975 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.346433 6200 raft_consensus.cc:3060] T 556b32b8ccd54c439f86b0069e2a5ce0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:12.348007 6461 ts_tablet_manager.cc:1929] T 601a0ff319cc4c9a898d52bbcb19184b P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:12.349411 7123 raft_consensus.cc:515] T c48d4a8371fa4454b7c67291db3ab796 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.354051 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 18bab39d85f94f4283f0b18c1c9b48a2 with delete_type TABLET_DATA_DELETED (replaced by tablet ebc288d8d453481592df11cd1bfed3ac) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:12.354420 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e41501bf01e4765853c27e4cac21e2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:12.358938 6456 raft_consensus.cc:359] T 194494af2c424a55a772f3858af63c2c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.359735 6456 raft_consensus.cc:385] T 194494af2c424a55a772f3858af63c2c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:12.360049 6456 raft_consensus.cc:740] T 194494af2c424a55a772f3858af63c2c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:12.360491 6030 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b1601590508479c8f401cd09d9f4c3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:04 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:12.360996 6030 tablet_service.cc:1558] Processing DeleteTablet for tablet 772ece5283a949408d849f6e56f5f17b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:12.361378 6030 tablet_service.cc:1558] Processing DeleteTablet for tablet ecd91bf5bd9447c0bb20ba43573ff08d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:12.361116 6456 consensus_queue.cc:260] T 194494af2c424a55a772f3858af63c2c P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.362062 6030 tablet_service.cc:1511] Processing CreateTablet for tablet b8211238627b44468c8461bdc340b1bb (DEFAULT_TABLE table=default.Table_d8377901984e4886984600fc0b7e24a4 [id=9b0cf7215a5d43b99264e58ad27a1c90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.362481 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8211238627b44468c8461bdc340b1bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.362831 6456 ts_tablet_manager.cc:1434] T 194494af2c424a55a772f3858af63c2c P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.066s user 0.004s sys 0.000s
I20260923 19:50:12.363555 6456 tablet_bootstrap.cc:492] T e071b9dd1db44af0a9d1b9e904f875a5 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:12.369982 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 465371cfbe544ba98e6eea05033ecf05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:12.370318 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet c0ff8838ab17433ab733d3b293d4964f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:12.372089 7148 raft_consensus.cc:515] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.373219 6201 raft_consensus.cc:1275] T 85d35ebef3c24a2e89233dd900b63513 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Refusing update from remote peer 2bf41435f70447f19992d368ca6b46bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:50:12.373508 6179 tablet_service.cc:1511] Processing CreateTablet for tablet 7418058b0f5a44d189888b0b1714eb2e (DEFAULT_TABLE table=default.Table_bf259d1800344a87933c314d8362033f [id=41bc1e16f1224881ab414bf6c4659e06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.375368 7173 consensus_queue.cc:1048] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:12.377405 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f627b7b9ff74750bd8dd59840bf77db" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:12.377740 6344 raft_consensus.cc:3060] T 2f627b7b9ff74750bd8dd59840bf77db P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:12.377641 6030 tablet_service.cc:1511] Processing CreateTablet for tablet 00eba27e9f2948e8a298c3fbca52a282 (DEFAULT_TABLE table=default.Table_5d9ccbcf620b4f5fa715523f21426d97 [id=d3ead5795ac041a8aa17dd5296ad6d20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.378932 5797 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_449bda0ddfc44496b4af2e8287b56bb5" } new_table_name: "default.Table_5462319331504a0b829c0181aa5b0cd6" modify_external_catalogs: true
I20260923 19:50:12.379880 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00eba27e9f2948e8a298c3fbca52a282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.379881 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48d4a8371fa4454b7c67291db3ab796" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:12.380147 6343 raft_consensus.cc:2468] T c48d4a8371fa4454b7c67291db3ab796 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:12.380403 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_ca513ce9b8f64f38a09c5a1d6b534a97"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:12.380885 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca513ce9b8f64f38a09c5a1d6b534a97 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:12.384407 5801 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f0a0c094a432441db9c448896dc1b403" } modify_external_catalogs: true
I20260923 19:50:12.384923 5801 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f0a0c094a432441db9c448896dc1b403" } modify_external_catalogs: true
I20260923 19:50:12.386783 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_6e87577be39e4d298db5528f71c6af62" } modify_external_catalogs: true
I20260923 19:50:12.386971 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_6e87577be39e4d298db5528f71c6af62" } modify_external_catalogs: true
W20260923 19:50:12.390693 5797 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 664d849daee54b02b7b7e2bb340d92fa consensus state has no leader
W20260923 19:50:12.390929 6137 leader_election.cc:343] T c48d4a8371fa4454b7c67291db3ab796 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: c48d4a8371fa4454b7c67291db3ab796
I20260923 19:50:12.392369 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_0275ce58991948e781ef59d63b7ce7e9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:12.392803 5803 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_462ef67f5c8445bb919cdd9a35d15cff" } modify_external_catalogs: true
I20260923 19:50:12.392974 5803 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_462ef67f5c8445bb919cdd9a35d15cff" } modify_external_catalogs: true
I20260923 19:50:12.394367 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_aace4bdffc84478db1c7cca8eb7be0be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:12.394810 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aace4bdffc84478db1c7cca8eb7be0be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:12.396016 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_665360e7a88a494cb401803f629f9cf3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:12.396472 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_665360e7a88a494cb401803f629f9cf3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:12.392976 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0275ce58991948e781ef59d63b7ce7e9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:12.408476 6454 raft_consensus.cc:385] T ffcf1a144f3c42719a5aa5deed537975 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:12.408624 6454 raft_consensus.cc:740] T ffcf1a144f3c42719a5aa5deed537975 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:12.409427 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 5815d903076e43f79d370261a74ef990 (DEFAULT_TABLE table=default.Table_8d1b18b8cdb047b489016f3a439148ba [id=5ea1f18854994fc0b52938f49c463b72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.410351 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45e7232e2b26488dbc33ea7865d710f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.411275 7123 leader_election.cc:290] T c48d4a8371fa4454b7c67291db3ab796 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:12.416659 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5815d903076e43f79d370261a74ef990. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.412905 6139 leader_election.cc:304] T c48d4a8371fa4454b7c67291db3ab796 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:12.418723 6317 tablet_service.cc:1511] Processing CreateTablet for tablet 5815d903076e43f79d370261a74ef990 (DEFAULT_TABLE table=default.Table_8d1b18b8cdb047b489016f3a439148ba [id=5ea1f18854994fc0b52938f49c463b72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.419271 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5815d903076e43f79d370261a74ef990. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.420032 7172 raft_consensus.cc:493] T fe5d081a41a3417b855656ca6e24f235 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:12.420275 7172 raft_consensus.cc:515] T fe5d081a41a3417b855656ca6e24f235 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.421205 7172 leader_election.cc:290] T fe5d081a41a3417b855656ca6e24f235 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:12.422260 6137 leader_election.cc:343] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 2f627b7b9ff74750bd8dd59840bf77db
I20260923 19:50:12.422441 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4c5fdd14ecb467eadfd5036dfb3783f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.424291 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7418058b0f5a44d189888b0b1714eb2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.424335 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 717101b8668f4cadb5180bb8e17939e9 (DEFAULT_TABLE table=default.Table_5f13aeaf05304dadbdb2d0d720acd604 [id=4501b432bc6e40c2ad1102cd453934a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.424738 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 717101b8668f4cadb5180bb8e17939e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.427155 7134 raft_consensus.cc:493] T 86388fa08c454da9ad2ca0124dcba10b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:12.427294 7134 raft_consensus.cc:515] T 86388fa08c454da9ad2ca0124dcba10b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.427919 7134 leader_election.cc:290] T 86388fa08c454da9ad2ca0124dcba10b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:12.421940 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 9c1e6162afed49cfb88d2a0aa578c244 (DEFAULT_TABLE table=default.Table_cb408624c0d145ca843187791183aa32 [id=8c0f7c54034c4195aae17b4dcd78cc62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.428640 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c1e6162afed49cfb88d2a0aa578c244. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.428892 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86388fa08c454da9ad2ca0124dcba10b" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:12.429744 5996 leader_election.cc:343] T 86388fa08c454da9ad2ca0124dcba10b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:12.432654 7123 raft_consensus.cc:2804] T c48d4a8371fa4454b7c67291db3ab796 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:12.432773 7123 raft_consensus.cc:493] T c48d4a8371fa4454b7c67291db3ab796 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:12.432869 7123 raft_consensus.cc:3060] T c48d4a8371fa4454b7c67291db3ab796 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:12.433352 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5d081a41a3417b855656ca6e24f235" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:12.436250 6280 leader_election.cc:343] T fe5d081a41a3417b855656ca6e24f235 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:12.435297 7148 leader_election.cc:290] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:12.444785 7148 raft_consensus.cc:493] T 015c14b447fe4cd18d197b2d1ed5884e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:12.446291 7148 raft_consensus.cc:515] T 015c14b447fe4cd18d197b2d1ed5884e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.447484 7148 leader_election.cc:290] T 015c14b447fe4cd18d197b2d1ed5884e P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:12.448465 6137 leader_election.cc:343] T 015c14b447fe4cd18d197b2d1ed5884e P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 015c14b447fe4cd18d197b2d1ed5884e
I20260923 19:50:12.449332 6344 raft_consensus.cc:2468] T 2f627b7b9ff74750bd8dd59840bf77db P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:12.450332 6139 leader_election.cc:304] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:12.451076 7148 raft_consensus.cc:2804] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:12.451273 7148 raft_consensus.cc:697] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:12.452030 7148 consensus_queue.cc:237] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.450248 6454 consensus_queue.cc:260] T ffcf1a144f3c42719a5aa5deed537975 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.454854 6181 tablet_service.cc:1511] Processing CreateTablet for tablet b1670d13d05c4c63874223d479e3e192 (DEFAULT_TABLE table=default.Table_b6a984d11ea34876becc2d10cf242e3f [id=e37569484ee249e6a8224c3edf9e9e34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.455178 6454 ts_tablet_manager.cc:1434] T ffcf1a144f3c42719a5aa5deed537975 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.335s user 0.003s sys 0.000s
I20260923 19:50:12.459807 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015c14b447fe4cd18d197b2d1ed5884e" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:12.460156 6343 raft_consensus.cc:2468] T 015c14b447fe4cd18d197b2d1ed5884e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:12.462075 6139 leader_election.cc:304] T 015c14b447fe4cd18d197b2d1ed5884e P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:12.466483 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1670d13d05c4c63874223d479e3e192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.468621 7172 raft_consensus.cc:493] T 3919b15a00eb4fb08008f065f556c760 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:12.468878 7172 raft_consensus.cc:515] T 3919b15a00eb4fb08008f065f556c760 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.470165 7172 leader_election.cc:290] T 3919b15a00eb4fb08008f065f556c760 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:12.474640 6454 tablet_bootstrap.cc:492] T 31b0bdf719554d37993a802831e324ee P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:12.476503 6454 tablet_bootstrap.cc:654] T 31b0bdf719554d37993a802831e324ee P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:12.488104 7148 raft_consensus.cc:2804] T 015c14b447fe4cd18d197b2d1ed5884e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:12.488306 7148 raft_consensus.cc:493] T 015c14b447fe4cd18d197b2d1ed5884e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:12.488453 7148 raft_consensus.cc:3060] T 015c14b447fe4cd18d197b2d1ed5884e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:12.489322 7239 raft_consensus.cc:493] T ffcf1a144f3c42719a5aa5deed537975 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:12.489456 7123 raft_consensus.cc:515] T c48d4a8371fa4454b7c67291db3ab796 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.493039 7123 leader_election.cc:290] T c48d4a8371fa4454b7c67291db3ab796 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:12.493366 6318 tablet_service.cc:1511] Processing CreateTablet for tablet b1670d13d05c4c63874223d479e3e192 (DEFAULT_TABLE table=default.Table_b6a984d11ea34876becc2d10cf242e3f [id=e37569484ee249e6a8224c3edf9e9e34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.493988 6318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1670d13d05c4c63874223d479e3e192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.494558 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 47c261638f0d48bb82c78c9a04d487b2
I20260923 19:50:12.497938 5801 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet a4c5fdd14ecb467eadfd5036dfb3783f
I20260923 19:50:12.498709 6313 tablet_service.cc:1558] Processing DeleteTablet for tablet 47c261638f0d48bb82c78c9a04d487b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:12.499622 6313 tablet_service.cc:1558] Processing DeleteTablet for tablet a4c5fdd14ecb467eadfd5036dfb3783f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:12.502830 7249 tablet.cc:1751] T 556b32b8ccd54c439f86b0069e2a5ce0 P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:12.503722 6031 tablet_service.cc:1511] Processing CreateTablet for tablet a57c91e5d3ab432dbc7e10eb11a020b8 (DEFAULT_TABLE table=default.Table_bfda8ee8ad2148e7b534d1e778b74427 [id=731af5872f3549cb945961f95729c8d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.504184 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a57c91e5d3ab432dbc7e10eb11a020b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.511751 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet 47c261638f0d48bb82c78c9a04d487b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:12.512529 6031 tablet_service.cc:1511] Processing CreateTablet for tablet 355b2fc61d4f4efd918204079f1ebf35 (DEFAULT_TABLE table=default.Table_f1842456992c4765924d809a3a062c07 [id=361a67b795ad41bb829dffbf0cc7dcc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.512974 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 355b2fc61d4f4efd918204079f1ebf35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.490823 7241 tablet.cc:1751] T ec4284d6a0fa416ca95b4d675c8e3912 P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:12.528775 6456 tablet_bootstrap.cc:654] T e071b9dd1db44af0a9d1b9e904f875a5 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:12.529500 6022 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a2e1e77494343ddb72c496d521151f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:12.529937 6022 tablet_service.cc:1558] Processing DeleteTablet for tablet bfe87e992ca04ea293e354da508e4c67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:12.530306 6022 tablet_service.cc:1558] Processing DeleteTablet for tablet 688bb1055ba94c2996cdfea6dea76416 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:12.531503 6022 tablet_service.cc:1558] Processing DeleteTablet for tablet e4ad9baac560463fabc80828074b46c1 with delete_type TABLET_DATA_DELETED (replaced by tablet cffe24ab4df745e3a34f82e8ca7b39f5) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:12.491294 6454 tablet_bootstrap.cc:492] T 31b0bdf719554d37993a802831e324ee P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:12.531973 6454 ts_tablet_manager.cc:1403] T 31b0bdf719554d37993a802831e324ee P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.057s user 0.004s sys 0.000s
I20260923 19:50:12.532219 6022 tablet_service.cc:1511] Processing CreateTablet for tablet 45e7232e2b26488dbc33ea7865d710f3 (DEFAULT_TABLE table=default.Table_11804efbcd284ce0a6dc342000a70b98 [id=7cdb1f6c949f4f8a96e6f57c4b1b45e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.532660 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45e7232e2b26488dbc33ea7865d710f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.532789 6454 raft_consensus.cc:359] T 31b0bdf719554d37993a802831e324ee P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.532933 6454 raft_consensus.cc:385] T 31b0bdf719554d37993a802831e324ee P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:12.532979 6454 raft_consensus.cc:740] T 31b0bdf719554d37993a802831e324ee P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:12.533185 6454 consensus_queue.cc:260] T 31b0bdf719554d37993a802831e324ee P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.533664 6454 ts_tablet_manager.cc:1434] T 31b0bdf719554d37993a802831e324ee P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:12.533942 6454 tablet_bootstrap.cc:492] T 6fe14389e2a3487587dfcf7a8b4b242d P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:12.519999 6459 ts_tablet_manager.cc:1929] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260923 19:50:12.518111 6139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.195:32855, user_credentials={real_user=slave}} blocked reactor thread for 56123.3us
I20260923 19:50:12.536501 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48d4a8371fa4454b7c67291db3ab796" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:12.536738 6343 raft_consensus.cc:3060] T c48d4a8371fa4454b7c67291db3ab796 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:12.539265 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet d2dd611746d741e88b6911bf5d51f3e5
I20260923 19:50:12.540416 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_76a8ffc5b25147c9af7758b6fe27a55d" } new_table_name: "default.Table_a319c1b23b8e44d9ac3fcb5c7406d7a4" modify_external_catalogs: true
I20260923 19:50:12.540613 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_d5f4a6e399064f4d9ae87a8c18f146d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:12.541189 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d5f4a6e399064f4d9ae87a8c18f146d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:12.541693 6343 raft_consensus.cc:2468] T c48d4a8371fa4454b7c67291db3ab796 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:12.543748 5797 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_bb0cff9e9bcd4de98b915af1c7e3bca2" } modify_external_catalogs: true
I20260923 19:50:12.543955 5797 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_bb0cff9e9bcd4de98b915af1c7e3bca2" } modify_external_catalogs: true
I20260923 19:50:12.545435 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_48edbb6cc7c2481a962e00014cdd921b" } new_table_name: "default.Table_74f45a860df845a484035e5b23fd874e" modify_external_catalogs: true
I20260923 19:50:12.545676 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_3237cd4c60f34314a0570aacaf0b5349" } new_table_name: "default.Table_34dc1315ccaa4033a038097353edf435" modify_external_catalogs: true
I20260923 19:50:12.546705 5798 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d7d1452530dc40018f8d5568a97f273b" } modify_external_catalogs: true
I20260923 19:50:12.546854 5798 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d7d1452530dc40018f8d5568a97f273b" } modify_external_catalogs: true
I20260923 19:50:12.547416 5802 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_9cef595b51ff4654aa683f9f00aa6e24" } new_table_name: "default.Table_6a56e4926a7b43d29a2cc015f69e8684" modify_external_catalogs: true
I20260923 19:50:12.549443 6314 tablet_service.cc:1558] Processing DeleteTablet for tablet d2dd611746d741e88b6911bf5d51f3e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:12.549768 6022 tablet_service.cc:1511] Processing CreateTablet for tablet a4c5fdd14ecb467eadfd5036dfb3783f (DEFAULT_TABLE table=default.Table_f0a0c094a432441db9c448896dc1b403 [id=540995bffc6a4a6eaa49531aad0a3d25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.550282 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4c5fdd14ecb467eadfd5036dfb3783f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.550522 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 373506f1b96046a5bf7f2820921b0312 (DEFAULT_TABLE table=default.Table_7ddfd6e3bbc7414e84d2785f412ed18f [id=74a90f141acd49b9a0f8b3ec87520b7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.553016 6021 tablet_service.cc:1511] Processing CreateTablet for tablet 441ec1cea9a74dd3ac4dc139d2b0baa2 (DEFAULT_TABLE table=default.Table_61a67edc9b154897b37cedf4df6485f7 [id=606b76fabc8c42dc9d2c7b0061eee58f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.553376 6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 441ec1cea9a74dd3ac4dc139d2b0baa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.555362 6456 tablet_bootstrap.cc:492] T e071b9dd1db44af0a9d1b9e904f875a5 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:12.562708 6021 tablet_service.cc:1511] Processing CreateTablet for tablet 3dead6c00e2c4516aa01547496a207fe (DEFAULT_TABLE table=default.Table_17d1d2de473849f79d13c8d52085d52b [id=efff804e3f994ba484af2a8bd93d9850]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.563290 6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dead6c00e2c4516aa01547496a207fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.560959 6456 ts_tablet_manager.cc:1403] T e071b9dd1db44af0a9d1b9e904f875a5 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.197s user 0.003s sys 0.002s
I20260923 19:50:12.535708 6459 log.cc:1199] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/e9cbfaa34c924a678f23cbcbf1a6fb0a
I20260923 19:50:12.564438 6456 raft_consensus.cc:359] T e071b9dd1db44af0a9d1b9e904f875a5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.564721 6456 raft_consensus.cc:385] T e071b9dd1db44af0a9d1b9e904f875a5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:12.564787 6459 ts_tablet_manager.cc:1950] T e9cbfaa34c924a678f23cbcbf1a6fb0a P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:12.564798 6456 raft_consensus.cc:740] T e071b9dd1db44af0a9d1b9e904f875a5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:12.565088 6458 ts_tablet_manager.cc:1929] T 495292cacf3b42a5b633ad40e5e01972 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:12.565244 6458 log.cc:1199] T 495292cacf3b42a5b633ad40e5e01972 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/495292cacf3b42a5b633ad40e5e01972
I20260923 19:50:12.565596 6459 tablet_replica.cc:333] T daafbafae5004b8499e7ea93342c0517 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:12.565790 6459 raft_consensus.cc:2243] T daafbafae5004b8499e7ea93342c0517 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:12.565973 6459 raft_consensus.cc:2272] T daafbafae5004b8499e7ea93342c0517 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:12.566479 6459 ts_tablet_manager.cc:1916] T daafbafae5004b8499e7ea93342c0517 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:12.566414 7148 raft_consensus.cc:515] T 015c14b447fe4cd18d197b2d1ed5884e P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.567307 7148 leader_election.cc:290] T 015c14b447fe4cd18d197b2d1ed5884e P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:12.567951 6027 tablet_service.cc:1511] Processing CreateTablet for tablet 7418058b0f5a44d189888b0b1714eb2e (DEFAULT_TABLE table=default.Table_bf259d1800344a87933c314d8362033f [id=41bc1e16f1224881ab414bf6c4659e06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.568336 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7418058b0f5a44d189888b0b1714eb2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.568917 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 7f7ecbb8d9054dde96b2bb511697dd47 (DEFAULT_TABLE table=default.Table_10cc33ba2656438aad3a4aa066bfa74e [id=dbdab306b70b4530866bcf8c830b469a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.575201 6458 ts_tablet_manager.cc:1950] T 495292cacf3b42a5b633ad40e5e01972 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:12.576709 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet e9cbfaa34c924a678f23cbcbf1a6fb0a (table default.Table_7e1ef96ed9694a29966dfbace1a5f555 [id=94ef9897f5c44524ae14f2b721a586e1]) successfully deleted
W20260923 19:50:12.577035 5791 catalog_manager.cc:5030] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet f4e3e64fdf584743a3a88df5d6600b22 because the tablet was not found. No further retry: Not found: Tablet not found: f4e3e64fdf584743a3a88df5d6600b22
W20260923 19:50:12.577286 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 18a31ed6bea444e7888f374927f90a60 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18a31ed6bea444e7888f374927f90a60 already in progress: creating tablet
I20260923 19:50:12.577540 6027 tablet_service.cc:1511] Processing CreateTablet for tablet 5815d903076e43f79d370261a74ef990 (DEFAULT_TABLE table=default.Table_8d1b18b8cdb047b489016f3a439148ba [id=5ea1f18854994fc0b52938f49c463b72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.578223 6026 tablet_service.cc:1558] Processing DeleteTablet for tablet 47c261638f0d48bb82c78c9a04d487b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:12.578639 6026 tablet_service.cc:1558] Processing DeleteTablet for tablet a4c5fdd14ecb467eadfd5036dfb3783f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:12.578635 6456 consensus_queue.cc:260] T e071b9dd1db44af0a9d1b9e904f875a5 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.579048 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5815d903076e43f79d370261a74ef990. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.584450 6026 tablet_service.cc:1511] Processing CreateTablet for tablet b1670d13d05c4c63874223d479e3e192 (DEFAULT_TABLE table=default.Table_b6a984d11ea34876becc2d10cf242e3f [id=e37569484ee249e6a8224c3edf9e9e34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.542302 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet d2dd611746d741e88b6911bf5d51f3e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:12.584865 6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1670d13d05c4c63874223d479e3e192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.544401 6139 leader_election.cc:304] T c48d4a8371fa4454b7c67291db3ab796 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:12.586463 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "015c14b447fe4cd18d197b2d1ed5884e" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:12.586732 6343 raft_consensus.cc:3060] T 015c14b447fe4cd18d197b2d1ed5884e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:12.587886 7172 raft_consensus.cc:493] T 194494af2c424a55a772f3858af63c2c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:12.588040 7172 raft_consensus.cc:515] T 194494af2c424a55a772f3858af63c2c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.588932 7172 leader_election.cc:290] T 194494af2c424a55a772f3858af63c2c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:12.593319 6343 raft_consensus.cc:2468] T 015c14b447fe4cd18d197b2d1ed5884e P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:12.585237 7148 raft_consensus.cc:2804] T c48d4a8371fa4454b7c67291db3ab796 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:12.554360 6169 tablet_service.cc:1511] Processing CreateTablet for tablet 7f7ecbb8d9054dde96b2bb511697dd47 (DEFAULT_TABLE table=default.Table_10cc33ba2656438aad3a4aa066bfa74e [id=dbdab306b70b4530866bcf8c830b469a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.595125 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f7ecbb8d9054dde96b2bb511697dd47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.596194 6026 tablet_service.cc:1558] Processing DeleteTablet for tablet d2dd611746d741e88b6911bf5d51f3e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:12.597316 6026 tablet_service.cc:1511] Processing CreateTablet for tablet 373506f1b96046a5bf7f2820921b0312 (DEFAULT_TABLE table=default.Table_7ddfd6e3bbc7414e84d2785f412ed18f [id=74a90f141acd49b9a0f8b3ec87520b7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.597823 6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 373506f1b96046a5bf7f2820921b0312. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.489610 7239 raft_consensus.cc:515] T ffcf1a144f3c42719a5aa5deed537975 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.601030 7239 leader_election.cc:290] T ffcf1a144f3c42719a5aa5deed537975 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:12.542505 6168 tablet_service.cc:1558] Processing DeleteTablet for tablet a4c5fdd14ecb467eadfd5036dfb3783f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:12.559332 6181 tablet_service.cc:1511] Processing CreateTablet for tablet 373506f1b96046a5bf7f2820921b0312 (DEFAULT_TABLE table=default.Table_7ddfd6e3bbc7414e84d2785f412ed18f [id=74a90f141acd49b9a0f8b3ec87520b7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.606688 6031 tablet_service.cc:1511] Processing CreateTablet for tablet 55991fab89be47afba7fcd08673ef82f (DEFAULT_TABLE table=default.Table_ce3b70141f6a4c24aa6d4f53fe8c97f8 [id=fda97d4d322f453296d283fffa052c35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.607460 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 373506f1b96046a5bf7f2820921b0312. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.594024 6139 leader_election.cc:304] T 015c14b447fe4cd18d197b2d1ed5884e P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:12.608845 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcf1a144f3c42719a5aa5deed537975" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:12.609378 6343 raft_consensus.cc:2468] T ffcf1a144f3c42719a5aa5deed537975 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:12.610175 6139 leader_election.cc:304] T ffcf1a144f3c42719a5aa5deed537975 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:12.610980 7244 raft_consensus.cc:2804] T 015c14b447fe4cd18d197b2d1ed5884e P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:12.611325 7244 raft_consensus.cc:697] T 015c14b447fe4cd18d197b2d1ed5884e P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:12.611368 7123 raft_consensus.cc:2804] T ffcf1a144f3c42719a5aa5deed537975 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:12.611527 7123 raft_consensus.cc:493] T ffcf1a144f3c42719a5aa5deed537975 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:12.611589 7123 raft_consensus.cc:3060] T ffcf1a144f3c42719a5aa5deed537975 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:12.611764 7244 consensus_queue.cc:237] T 015c14b447fe4cd18d197b2d1ed5884e P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.535470 6454 tablet_bootstrap.cc:654] T 6fe14389e2a3487587dfcf7a8b4b242d P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:12.613024 6456 ts_tablet_manager.cc:1434] T e071b9dd1db44af0a9d1b9e904f875a5 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.050s user 0.001s sys 0.001s
I20260923 19:50:12.615232 7123 raft_consensus.cc:515] T ffcf1a144f3c42719a5aa5deed537975 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.615595 7148 raft_consensus.cc:697] T c48d4a8371fa4454b7c67291db3ab796 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:12.615996 7148 consensus_queue.cc:237] T c48d4a8371fa4454b7c67291db3ab796 P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.617758 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcf1a144f3c42719a5aa5deed537975" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:12.618854 6343 raft_consensus.cc:3060] T ffcf1a144f3c42719a5aa5deed537975 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:12.622459 6343 raft_consensus.cc:2468] T ffcf1a144f3c42719a5aa5deed537975 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:12.623478 6139 leader_election.cc:304] T ffcf1a144f3c42719a5aa5deed537975 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:12.623776 7239 raft_consensus.cc:2804] T ffcf1a144f3c42719a5aa5deed537975 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:12.624626 7239 raft_consensus.cc:697] T ffcf1a144f3c42719a5aa5deed537975 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:12.624918 7181 tablet.cc:1751] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260923 19:50:12.634274 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55991fab89be47afba7fcd08673ef82f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.638551 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcf1a144f3c42719a5aa5deed537975" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:12.638777 6059 raft_consensus.cc:2468] T ffcf1a144f3c42719a5aa5deed537975 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:12.639765 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet 870db252d8414be7bbe613ea467b5f3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:12.644493 6459 ts_tablet_manager.cc:1929] T daafbafae5004b8499e7ea93342c0517 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:12.644852 6459 log.cc:1199] T daafbafae5004b8499e7ea93342c0517 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/daafbafae5004b8499e7ea93342c0517
I20260923 19:50:12.645236 7242 raft_consensus.cc:493] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:12.645399 7242 raft_consensus.cc:515] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.647277 6454 tablet_bootstrap.cc:492] T 6fe14389e2a3487587dfcf7a8b4b242d P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:12.647454 6454 ts_tablet_manager.cc:1403] T 6fe14389e2a3487587dfcf7a8b4b242d P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.114s user 0.003s sys 0.003s
I20260923 19:50:12.648181 6454 raft_consensus.cc:359] T 6fe14389e2a3487587dfcf7a8b4b242d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.648411 6454 raft_consensus.cc:385] T 6fe14389e2a3487587dfcf7a8b4b242d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:12.648524 6454 raft_consensus.cc:740] T 6fe14389e2a3487587dfcf7a8b4b242d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:12.648835 6454 consensus_queue.cc:260] T 6fe14389e2a3487587dfcf7a8b4b242d P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.649243 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 498) took 1678 ms. Trace:
I20260923 19:50:12.649610 6454 ts_tablet_manager.cc:1434] T 6fe14389e2a3487587dfcf7a8b4b242d P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:12.649466 6458 rpcz_store.cc:276] 0923 19:50:10.970435 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:10.970501 (+ 66us) service_pool.cc:224] Handling call
0923 19:50:12.232092 (+1261591us) ts_tablet_manager.cc:1151] Deleting tablet 495292cacf3b42a5b633ad40e5e01972
0923 19:50:12.232100 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:12.366239 (+134139us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:12.561017 (+194778us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:12.649182 (+ 88165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51728,"tablet-delete.queue_time_us":1261381}
I20260923 19:50:12.650528 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 495292cacf3b42a5b633ad40e5e01972 (table default.Table_504b18d33ff6487da9b8f40467850853 [id=97f3cda15d6f4e258eece32745c45b50]) successfully deleted
W20260923 19:50:12.652070 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 18a31ed6bea444e7888f374927f90a60 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18a31ed6bea444e7888f374927f90a60 already in progress: creating tablet
I20260923 19:50:12.652079 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bab39d85f94f4283f0b18c1c9b48a2" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:12.651397 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 499) took 1680 ms. Trace:
I20260923 19:50:12.652086 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e123b69877e4b1fbcdb2b27960864e9" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:12.652711 6458 rpcz_store.cc:276] 0923 19:50:10.970577 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:10.972891 (+ 2314us) service_pool.cc:224] Handling call
0923 19:50:12.651115 (+1678224us) ts_tablet_manager.cc:1151] Deleting tablet 337f32eb47954689a6eb8f74408e01d9
0923 19:50:12.651129 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:12.651334 (+ 205us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1677964}
I20260923 19:50:12.653409 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f4abb573bd4be6961b55c27c684d06" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:12.654119 5792 catalog_manager.cc:5030] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 337f32eb47954689a6eb8f74408e01d9 because the tablet was not found. No further retry: Not found: Tablet not found: 337f32eb47954689a6eb8f74408e01d9
I20260923 19:50:12.655210 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 504) took 1608 ms. Trace:
I20260923 19:50:12.658044 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86388fa08c454da9ad2ca0124dcba10b" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:12.660372 6173 tablet_service.cc:1511] Processing CreateTablet for tablet 96577a68f4984c90b82cf4d32e701476 (DEFAULT_TABLE table=default.Table_f0ae26687ca54a6085e4b7cf494fc482 [id=f922a13efe7b4c36a8e27481ee09de0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.660982 7134 raft_consensus.cc:493] T 7e41501bf01e4765853c27e4cac21e2b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:12.661120 7134 raft_consensus.cc:515] T 7e41501bf01e4765853c27e4cac21e2b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.661737 7134 leader_election.cc:290] T 7e41501bf01e4765853c27e4cac21e2b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:12.661126 5995 leader_election.cc:343] T 601a0ff319cc4c9a898d52bbcb19184b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:12.664219 5995 leader_election.cc:304] T 601a0ff319cc4c9a898d52bbcb19184b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
W20260923 19:50:12.664670 5995 raft_consensus.cc:2686] T 601a0ff319cc4c9a898d52bbcb19184b P e546f660e7e541d1aa9ae38e5ee5b9c0: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260923 19:50:12.665315 5995 leader_election.cc:343] T 18bab39d85f94f4283f0b18c1c9b48a2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:12.666100 5995 leader_election.cc:304] T 18bab39d85f94f4283f0b18c1c9b48a2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:12.666770 7211 raft_consensus.cc:2749] T 18bab39d85f94f4283f0b18c1c9b48a2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:12.667048 7252 tablet.cc:1751] T ec4cc8a742114e5fb07c5c9157ce09e8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260923 19:50:12.667676 5995 leader_election.cc:343] T 0e123b69877e4b1fbcdb2b27960864e9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:12.668783 5995 leader_election.cc:304] T 0e123b69877e4b1fbcdb2b27960864e9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:12.669055 7211 raft_consensus.cc:2749] T 0e123b69877e4b1fbcdb2b27960864e9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:12.669593 5995 leader_election.cc:343] T 12f4abb573bd4be6961b55c27c684d06 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:12.669719 5995 leader_election.cc:304] T 12f4abb573bd4be6961b55c27c684d06 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:12.617532 7123 leader_election.cc:290] T ffcf1a144f3c42719a5aa5deed537975 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:12.669968 7211 raft_consensus.cc:2749] T 12f4abb573bd4be6961b55c27c684d06 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:12.670719 5995 leader_election.cc:343] T 86388fa08c454da9ad2ca0124dcba10b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:12.670862 5995 leader_election.cc:304] T 86388fa08c454da9ad2ca0124dcba10b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:12.671087 7211 raft_consensus.cc:2749] T 86388fa08c454da9ad2ca0124dcba10b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:12.671645 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcf1a144f3c42719a5aa5deed537975" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:12.671864 6060 raft_consensus.cc:2468] T ffcf1a144f3c42719a5aa5deed537975 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
W20260923 19:50:12.672318 6137 leader_election.cc:343] T c48d4a8371fa4454b7c67291db3ab796 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: c48d4a8371fa4454b7c67291db3ab796
W20260923 19:50:12.672870 6137 leader_election.cc:343] T 015c14b447fe4cd18d197b2d1ed5884e P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 015c14b447fe4cd18d197b2d1ed5884e
I20260923 19:50:12.672875 6032 tablet_service.cc:1511] Processing CreateTablet for tablet 96577a68f4984c90b82cf4d32e701476 (DEFAULT_TABLE table=default.Table_f0ae26687ca54a6085e4b7cf494fc482 [id=f922a13efe7b4c36a8e27481ee09de0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.673363 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96577a68f4984c90b82cf4d32e701476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.678442 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3919b15a00eb4fb08008f065f556c760" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:12.679318 6056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcf1a144f3c42719a5aa5deed537975" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:12.679481 6056 raft_consensus.cc:3060] T ffcf1a144f3c42719a5aa5deed537975 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:12.674650 7239 consensus_queue.cc:237] T ffcf1a144f3c42719a5aa5deed537975 P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.682323 6056 raft_consensus.cc:2468] T ffcf1a144f3c42719a5aa5deed537975 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
W20260923 19:50:12.658188 6279 leader_election.cc:343] T f108ebdaecab42e7b57057c7ecfbe690 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: f108ebdaecab42e7b57057c7ecfbe690
I20260923 19:50:12.685518 6026 tablet_service.cc:1511] Processing CreateTablet for tablet ca73c91b58954537af373face5ad2f67 (DEFAULT_TABLE table=default.Table_2a3f607a23af430ba52036fcf8b35948 [id=6f9ac3e4264245358d37624ba8d8fa73]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:12.685700 6279 leader_election.cc:343] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: daafbafae5004b8499e7ea93342c0517
I20260923 19:50:12.686359 6279 leader_election.cc:304] T ffcf1a144f3c42719a5aa5deed537975 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:12.686751 6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca73c91b58954537af373face5ad2f67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.687460 7172 raft_consensus.cc:2764] T ffcf1a144f3c42719a5aa5deed537975 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260923 19:50:12.662578 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e41501bf01e4765853c27e4cac21e2b" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:12.689299 5996 leader_election.cc:343] T 7e41501bf01e4765853c27e4cac21e2b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:12.658521 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 96577a68f4984c90b82cf4d32e701476 (DEFAULT_TABLE table=default.Table_f0ae26687ca54a6085e4b7cf494fc482 [id=f922a13efe7b4c36a8e27481ee09de0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.667733 6456 tablet_bootstrap.cc:492] T 15c0dc02ba964af38ca9f76161722588 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:12.697845 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "194494af2c424a55a772f3858af63c2c" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:12.700886 6280 leader_election.cc:343] T 3919b15a00eb4fb08008f065f556c760 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:12.701154 6280 leader_election.cc:343] T 194494af2c424a55a772f3858af63c2c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:12.710937 7241 tablet.cc:1751] T 85d35ebef3c24a2e89233dd900b63513 P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260923 19:50:12.655558 6458 rpcz_store.cc:276] 0923 19:50:11.047187 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:11.047373 (+ 186us) service_pool.cc:224] Handling call
0923 19:50:12.654711 (+1607338us) ts_tablet_manager.cc:1151] Deleting tablet 1b1d9413e1e24547b491a160d851377b
0923 19:50:12.654775 (+ 64us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:12.655140 (+ 365us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1607026}
I20260923 19:50:12.714581 6030 tablet_service.cc:1511] Processing CreateTablet for tablet 7f7ecbb8d9054dde96b2bb511697dd47 (DEFAULT_TABLE table=default.Table_10cc33ba2656438aad3a4aa066bfa74e [id=dbdab306b70b4530866bcf8c830b469a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:12.718267 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 1b1d9413e1e24547b491a160d851377b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b1d9413e1e24547b491a160d851377b already in progress: creating tablet
I20260923 19:50:12.717391 7211 raft_consensus.cc:493] T 7b455812687f42848df5290d0cdbc312 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:12.719653 7211 raft_consensus.cc:515] T 7b455812687f42848df5290d0cdbc312 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.720361 7211 leader_election.cc:290] T 7b455812687f42848df5290d0cdbc312 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:12.721515 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b455812687f42848df5290d0cdbc312" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:12.722324 5996 leader_election.cc:343] T 7b455812687f42848df5290d0cdbc312 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:12.722569 6459 ts_tablet_manager.cc:1950] T daafbafae5004b8499e7ea93342c0517 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:12.722652 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f7ecbb8d9054dde96b2bb511697dd47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.723587 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet daafbafae5004b8499e7ea93342c0517 (table default.Table_4611fd8972c94dfdbbaf669673dbd540 [id=08d65b643de645c7b760d27d28eccafe]) successfully deleted
I20260923 19:50:12.725857 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e41501bf01e4765853c27e4cac21e2b" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:12.729328 5995 leader_election.cc:343] T 7e41501bf01e4765853c27e4cac21e2b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:12.729453 5995 leader_election.cc:304] T 7e41501bf01e4765853c27e4cac21e2b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:12.729684 7211 raft_consensus.cc:2749] T 7e41501bf01e4765853c27e4cac21e2b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:12.730499 6459 tablet_replica.cc:333] T 015c14b447fe4cd18d197b2d1ed5884e P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:12.735630 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b455812687f42848df5290d0cdbc312" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:12.735925 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e781ccf4aa343fc924138c3cc2b04e6" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:12.736181 6343 raft_consensus.cc:2468] T 6e781ccf4aa343fc924138c3cc2b04e6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
W20260923 19:50:12.736308 5995 leader_election.cc:343] T 7b455812687f42848df5290d0cdbc312 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:12.736542 5995 leader_election.cc:304] T 7b455812687f42848df5290d0cdbc312 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:12.736931 7211 raft_consensus.cc:2749] T 7b455812687f42848df5290d0cdbc312 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:12.737303 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96577a68f4984c90b82cf4d32e701476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.742944 6454 tablet_bootstrap.cc:492] T b529b0e82c5b48edac54cc281ac4b4a6 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:12.745293 7211 raft_consensus.cc:493] T 870db252d8414be7bbe613ea467b5f3a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:12.745440 7211 raft_consensus.cc:515] T 870db252d8414be7bbe613ea467b5f3a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.746060 7211 leader_election.cc:290] T 870db252d8414be7bbe613ea467b5f3a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:12.746712 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870db252d8414be7bbe613ea467b5f3a" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:12.747236 5996 leader_election.cc:343] T 870db252d8414be7bbe613ea467b5f3a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:12.749330 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96577a68f4984c90b82cf4d32e701476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.751777 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 373506f1b96046a5bf7f2820921b0312. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.752264 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f7ecbb8d9054dde96b2bb511697dd47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.752281 6457 tablet_bootstrap.cc:492] T 6a2564a99c274e07a7e43da739a2458b P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:12.752408 6457 ts_tablet_manager.cc:1403] T 6a2564a99c274e07a7e43da739a2458b P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.497s user 0.187s sys 0.220s
I20260923 19:50:12.753700 6457 raft_consensus.cc:359] T 6a2564a99c274e07a7e43da739a2458b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.753921 6457 raft_consensus.cc:385] T 6a2564a99c274e07a7e43da739a2458b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:12.753988 6457 raft_consensus.cc:740] T 6a2564a99c274e07a7e43da739a2458b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:12.754343 6456 tablet_bootstrap.cc:654] T 15c0dc02ba964af38ca9f76161722588 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:12.754253 6457 consensus_queue.cc:260] T 6a2564a99c274e07a7e43da739a2458b P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.755133 6457 ts_tablet_manager.cc:1434] T 6a2564a99c274e07a7e43da739a2458b P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:50:12.755422 6457 tablet_bootstrap.cc:492] T 22e37d5afa8047989928596b4092c4b9 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:12.738049 6458 tablet_replica.cc:333] T 6fe14389e2a3487587dfcf7a8b4b242d P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:12.756961 6457 tablet_bootstrap.cc:654] T 22e37d5afa8047989928596b4092c4b9 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:12.757145 6181 tablet_service.cc:1511] Processing CreateTablet for tablet ca73c91b58954537af373face5ad2f67 (DEFAULT_TABLE table=default.Table_2a3f607a23af430ba52036fcf8b35948 [id=6f9ac3e4264245358d37624ba8d8fa73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.758018 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca73c91b58954537af373face5ad2f67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.763223 6026 tablet_service.cc:1511] Processing CreateTablet for tablet 1f6df2c7b8c34ff2a358acdc58543991 (DEFAULT_TABLE table=default.Table_22eef68f3e1e499db53058abaf7b3fab [id=918936f42dad4927bd643541a36f9e5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.766794 6458 raft_consensus.cc:2243] T 6fe14389e2a3487587dfcf7a8b4b242d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:12.767040 6458 raft_consensus.cc:2272] T 6fe14389e2a3487587dfcf7a8b4b242d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:12.767759 6458 ts_tablet_manager.cc:1916] T 6fe14389e2a3487587dfcf7a8b4b242d P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:12.755946 6279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.143.193:39887, user_credentials={real_user=slave}} blocked reactor thread for 69146.6us
I20260923 19:50:12.757417 6314 tablet_service.cc:1511] Processing CreateTablet for tablet ca73c91b58954537af373face5ad2f67 (DEFAULT_TABLE table=default.Table_2a3f607a23af430ba52036fcf8b35948 [id=6f9ac3e4264245358d37624ba8d8fa73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.760744 6317 tablet_service.cc:1511] Processing CreateTablet for tablet d1258abcb244430ca8456ad146aa0e67 (DEFAULT_TABLE table=default.Table_572d17eb83634c98b68bbcfedc88603e [id=7e1215217a574debb42c752695194f6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.768705 6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f6df2c7b8c34ff2a358acdc58543991. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:12.768831 6279 leader_election.cc:343] T fe5d081a41a3417b855656ca6e24f235 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: fe5d081a41a3417b855656ca6e24f235
I20260923 19:50:12.768988 6279 leader_election.cc:304] T fe5d081a41a3417b855656ca6e24f235 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:12.769284 7172 raft_consensus.cc:2749] T fe5d081a41a3417b855656ca6e24f235 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:12.770104 7172 consensus_queue.cc:1048] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260923 19:50:12.771608 6279 leader_election.cc:343] T 3919b15a00eb4fb08008f065f556c760 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 3919b15a00eb4fb08008f065f556c760
I20260923 19:50:12.771858 6279 leader_election.cc:304] T 3919b15a00eb4fb08008f065f556c760 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:12.772176 7172 raft_consensus.cc:2749] T 3919b15a00eb4fb08008f065f556c760 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:12.772713 6279 leader_election.cc:343] T 194494af2c424a55a772f3858af63c2c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 194494af2c424a55a772f3858af63c2c
I20260923 19:50:12.772920 6279 leader_election.cc:304] T 194494af2c424a55a772f3858af63c2c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:12.773217 7172 raft_consensus.cc:2749] T 194494af2c424a55a772f3858af63c2c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:12.773819 7172 consensus_queue.cc:1048] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:12.776710 6169 tablet_service.cc:1511] Processing CreateTablet for tablet d1258abcb244430ca8456ad146aa0e67 (DEFAULT_TABLE table=default.Table_572d17eb83634c98b68bbcfedc88603e [id=7e1215217a574debb42c752695194f6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.741808 7242 leader_election.cc:290] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:12.777393 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1258abcb244430ca8456ad146aa0e67. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:12.788808 6137 leader_election.cc:343] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 6e781ccf4aa343fc924138c3cc2b04e6
W20260923 19:50:12.789068 6137 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.193:39887, user_credentials={real_user=slave}} blocked reactor thread for 58591.9us
I20260923 19:50:12.789237 6139 leader_election.cc:304] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:12.789716 6139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.195:32855, user_credentials={real_user=slave}} blocked reactor thread for 52888.2us
I20260923 19:50:12.791687 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870db252d8414be7bbe613ea467b5f3a" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:12.793524 5995 leader_election.cc:343] T 870db252d8414be7bbe613ea467b5f3a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:12.793685 7242 raft_consensus.cc:2804] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:12.793664 5995 leader_election.cc:304] T 870db252d8414be7bbe613ea467b5f3a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:12.793757 7242 raft_consensus.cc:493] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:12.793815 7242 raft_consensus.cc:3060] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:12.793954 7211 raft_consensus.cc:2749] T 870db252d8414be7bbe613ea467b5f3a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:12.806432 6032 tablet_service.cc:1511] Processing CreateTablet for tablet d1258abcb244430ca8456ad146aa0e67 (DEFAULT_TABLE table=default.Table_572d17eb83634c98b68bbcfedc88603e [id=7e1215217a574debb42c752695194f6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.810982 6456 tablet_bootstrap.cc:492] T 15c0dc02ba964af38ca9f76161722588 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:12.811273 6456 ts_tablet_manager.cc:1403] T 15c0dc02ba964af38ca9f76161722588 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.198s user 0.001s sys 0.005s
I20260923 19:50:12.812748 6456 raft_consensus.cc:359] T 15c0dc02ba964af38ca9f76161722588 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.813211 6456 raft_consensus.cc:385] T 15c0dc02ba964af38ca9f76161722588 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:12.813413 6456 raft_consensus.cc:740] T 15c0dc02ba964af38ca9f76161722588 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:12.814011 6456 consensus_queue.cc:260] T 15c0dc02ba964af38ca9f76161722588 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.814622 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1258abcb244430ca8456ad146aa0e67. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:12.826854 6279 consensus_peers.cc:597] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: daafbafae5004b8499e7ea93342c0517. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:12.827273 5796 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_7d19012d024e4648bce4b76d92e1a388 [id=498c667413e24c7c800fe5eae263cf22] alter complete (version 4)
W20260923 19:50:12.827507 5800 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f0915e6df24f42b3b8b1a558b7ebc7ff consensus state has no leader
W20260923 19:50:12.829511 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8fd7e98016ca4e168979d7f7411e525a consensus state has no leader
I20260923 19:50:12.829851 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 5adadf8caf5e4a9ab1107d0fb6a91735
I20260923 19:50:12.830890 6321 tablet_service.cc:1558] Processing DeleteTablet for tablet 5adadf8caf5e4a9ab1107d0fb6a91735 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:12.831394 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 559f3e3016aa470f9732a727b4528586
W20260923 19:50:12.832356 5803 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b8d209f958cc452c8b864e010c9da6a0 consensus state has no leader
I20260923 19:50:12.836033 6321 tablet_service.cc:1558] Processing DeleteTablet for tablet 559f3e3016aa470f9732a727b4528586 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:12.834422 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 559f3e3016aa470f9732a727b4528586 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:12.837579 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_bed0586ee50548bab95ee1bd85b005f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:12.838140 5802 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1c43641327d14a888a2815e49a2762c8 consensus state has no leader
W20260923 19:50:12.838383 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bed0586ee50548bab95ee1bd85b005f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:12.838531 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_74b3ada03dc14044b09a369b0e3782c7" } modify_external_catalogs: true
I20260923 19:50:12.839198 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_74b3ada03dc14044b09a369b0e3782c7" } modify_external_catalogs: true
I20260923 19:50:12.839974 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_6920203af31740688a974a5ff7755490"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:12.840575 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6920203af31740688a974a5ff7755490 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:12.840839 5804 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_349043a7dfa34b3fa1ca4a2eb51ac77c" } new_table_name: "default.Table_2117af45b89a4af2a58df762cb072590" modify_external_catalogs: true
I20260923 19:50:12.841045 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_40ca5e04bf0043999afbd49a6fe09bb2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:12.841492 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_40ca5e04bf0043999afbd49a6fe09bb2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:12.842083 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_d874e0de26244d32ad58f316738b6553"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:12.842507 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d874e0de26244d32ad58f316738b6553 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:12.844002 5799 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 8d87f05f29bd476386ff6516676ce31a (table default.Table_9fa8f8bfc6124f398a4acdf5e1e0b33a [id=02d2ab56def342c482c86ce96110342f]). Expected version 1 got 0
I20260923 19:50:12.844753 5805 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 85d35ebef3c24a2e89233dd900b63513 (table default.Table_ea5c2db0da154c51a706c771a367ab98 [id=da91b06e11c64bb0aaec37a0188b5586]). Expected version 3 got 0
I20260923 19:50:12.844998 5805 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet ec4284d6a0fa416ca95b4d675c8e3912 (table default.Table_00f5789c01e94f8e8c65077f98b164c2 [id=29a38060f3bf43f3900ad0ee42fbde9a]). Expected version 1 got 0
I20260923 19:50:12.845636 5799 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_412c7972d6ad4c9c9e44ad5763e7a6c7" } modify_external_catalogs: true
I20260923 19:50:12.846104 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_4bf3649d9e3d46ad9cf692caa1e51b8c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:12.846524 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4bf3649d9e3d46ad9cf692caa1e51b8c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:12.840840 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_610e289c686b4647bf9ff414ce55b007"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:12.848521 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_610e289c686b4647bf9ff414ce55b007 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:12.848469 5805 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_18c12428fbbe40a394cbf271fbcd69f0" } modify_external_catalogs: true
I20260923 19:50:12.851066 5805 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_18c12428fbbe40a394cbf271fbcd69f0" } modify_external_catalogs: true
I20260923 19:50:12.845813 5799 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_412c7972d6ad4c9c9e44ad5763e7a6c7" } modify_external_catalogs: true
I20260923 19:50:12.854166 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e123b69877e4b1fbcdb2b27960864e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:12.854809 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet b92aaac328934d95a89e0fc08a80b0b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:12.859031 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet 559f3e3016aa470f9732a727b4528586 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:12.859247 6168 tablet_service.cc:1558] Processing DeleteTablet for tablet 5adadf8caf5e4a9ab1107d0fb6a91735 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:12.859697 6168 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e781ccf4aa343fc924138c3cc2b04e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:12.859951 7252 tablet.cc:1751] T 115048f771764e41a3816e17a6c6cf94 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
W20260923 19:50:12.866081 6280 consensus_peers.cc:597] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: daafbafae5004b8499e7ea93342c0517. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:12.873612 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca73c91b58954537af373face5ad2f67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.874547 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1258abcb244430ca8456ad146aa0e67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.880945 7181 tablet.cc:1746] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd: Skipping requested alter to schema version 3, tablet already version 3
I20260923 19:50:12.881860 7241 tablet.cc:1746] T 85d35ebef3c24a2e89233dd900b63513 P 61022dd7f2f14dc19aebe3af5f08f430: Skipping requested alter to schema version 3, tablet already version 3
I20260923 19:50:12.885516 6458 ts_tablet_manager.cc:1929] T 6fe14389e2a3487587dfcf7a8b4b242d P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:12.885648 6458 log.cc:1199] T 6fe14389e2a3487587dfcf7a8b4b242d P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/6fe14389e2a3487587dfcf7a8b4b242d
I20260923 19:50:12.889405 7242 raft_consensus.cc:515] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:12.891727 6137 leader_election.cc:343] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 6e781ccf4aa343fc924138c3cc2b04e6
I20260923 19:50:12.892293 6458 ts_tablet_manager.cc:1950] T 6fe14389e2a3487587dfcf7a8b4b242d P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:12.893342 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 513) took 1669 ms. Trace:
I20260923 19:50:12.893565 6458 rpcz_store.cc:276] 0923 19:50:11.223862 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:11.223904 (+ 42us) service_pool.cc:224] Handling call
0923 19:50:12.726592 (+1502688us) ts_tablet_manager.cc:1151] Deleting tablet 6fe14389e2a3487587dfcf7a8b4b242d
0923 19:50:12.727107 (+ 515us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:12.882622 (+155515us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:12.885465 (+ 2843us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:12.893314 (+ 7849us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1499015}
I20260923 19:50:12.893992 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e781ccf4aa343fc924138c3cc2b04e6" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:12.894208 6343 raft_consensus.cc:3060] T 6e781ccf4aa343fc924138c3cc2b04e6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:12.898096 6458 tablet_replica.cc:333] T 015c14b447fe4cd18d197b2d1ed5884e P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:12.898521 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 6fe14389e2a3487587dfcf7a8b4b242d (table default.Table_654e78935bde491c95268be69d832a46 [id=db37d58a601f44c4a08efd4fcc3f115b]) successfully deleted
I20260923 19:50:12.899194 6458 raft_consensus.cc:2243] T 015c14b447fe4cd18d197b2d1ed5884e P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:12.899479 6343 raft_consensus.cc:2468] T 6e781ccf4aa343fc924138c3cc2b04e6 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:12.899674 6458 raft_consensus.cc:2272] T 015c14b447fe4cd18d197b2d1ed5884e P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:12.900002 6139 leader_election.cc:304] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:12.900242 6458 ts_tablet_manager.cc:1916] T 015c14b447fe4cd18d197b2d1ed5884e P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:12.900293 7148 raft_consensus.cc:2804] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:12.900393 7148 raft_consensus.cc:697] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:12.900614 7148 consensus_queue.cc:237] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.893771 7242 leader_election.cc:290] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:12.907079 6456 ts_tablet_manager.cc:1434] T 15c0dc02ba964af38ca9f76161722588 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.096s user 0.002s sys 0.000s
I20260923 19:50:12.914124 6173 tablet_service.cc:1511] Processing CreateTablet for tablet 1f6df2c7b8c34ff2a358acdc58543991 (DEFAULT_TABLE table=default.Table_22eef68f3e1e499db53058abaf7b3fab [id=918936f42dad4927bd643541a36f9e5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.914502 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f6df2c7b8c34ff2a358acdc58543991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.916483 6181 tablet_service.cc:1511] Processing CreateTablet for tablet 8fd7e98016ca4e168979d7f7411e525a (DEFAULT_TABLE table=default.Table_74f45a860df845a484035e5b23fd874e [id=31a784a213474423bd58ccc26e459b31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.917021 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fd7e98016ca4e168979d7f7411e525a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:12.910336 6279 consensus_peers.cc:597] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 359b08ef348d4be68b14f9e871a5e519. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:12.913734 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 1f6df2c7b8c34ff2a358acdc58543991 (DEFAULT_TABLE table=default.Table_22eef68f3e1e499db53058abaf7b3fab [id=918936f42dad4927bd643541a36f9e5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.918435 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f6df2c7b8c34ff2a358acdc58543991. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:12.917470 6280 consensus_peers.cc:597] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260923 19:50:12.930446 6280 consensus_peers.cc:597] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 359b08ef348d4be68b14f9e871a5e519. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:12.914187 6456 tablet_bootstrap.cc:492] T 2db82e6f314f412385b41720c7efdef5 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:12.934278 6456 tablet_bootstrap.cc:654] T 2db82e6f314f412385b41720c7efdef5 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:12.934885 6461 log.cc:1199] T 601a0ff319cc4c9a898d52bbcb19184b P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/601a0ff319cc4c9a898d52bbcb19184b
I20260923 19:50:12.937500 6454 tablet_bootstrap.cc:654] T b529b0e82c5b48edac54cc281ac4b4a6 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:12.940124 7134 raft_consensus.cc:493] T c19298691d5d4209b2d1147a1aad2f6f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:12.940274 7134 raft_consensus.cc:515] T c19298691d5d4209b2d1147a1aad2f6f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.940948 7134 leader_election.cc:290] T c19298691d5d4209b2d1147a1aad2f6f P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:12.941697 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19298691d5d4209b2d1147a1aad2f6f" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:12.941704 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19298691d5d4209b2d1147a1aad2f6f" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:12.942232 5996 leader_election.cc:343] T c19298691d5d4209b2d1147a1aad2f6f P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:12.942446 5995 leader_election.cc:343] T c19298691d5d4209b2d1147a1aad2f6f P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:12.942523 5995 leader_election.cc:304] T c19298691d5d4209b2d1147a1aad2f6f P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:12.943207 7211 raft_consensus.cc:2749] T c19298691d5d4209b2d1147a1aad2f6f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:12.947824 6461 ts_tablet_manager.cc:1950] T 601a0ff319cc4c9a898d52bbcb19184b P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:12.948583 6317 tablet_service.cc:1511] Processing CreateTablet for tablet 8fd7e98016ca4e168979d7f7411e525a (DEFAULT_TABLE table=default.Table_74f45a860df845a484035e5b23fd874e [id=31a784a213474423bd58ccc26e459b31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.953127 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 8fd7e98016ca4e168979d7f7411e525a (DEFAULT_TABLE table=default.Table_74f45a860df845a484035e5b23fd874e [id=31a784a213474423bd58ccc26e459b31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.953505 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fd7e98016ca4e168979d7f7411e525a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.953940 6314 tablet_service.cc:1511] Processing CreateTablet for tablet 2072d5cda2d046898df6ccddb872c92e (DEFAULT_TABLE table=default.Table_8d9c168e75b24278869d2281218a0ad5 [id=dc33438851de48ad85395ec65fe98ddd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.955430 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 2072d5cda2d046898df6ccddb872c92e (DEFAULT_TABLE table=default.Table_8d9c168e75b24278869d2281218a0ad5 [id=dc33438851de48ad85395ec65fe98ddd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:12.958256 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2072d5cda2d046898df6ccddb872c92e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.959167 6456 tablet_bootstrap.cc:492] T 2db82e6f314f412385b41720c7efdef5 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:12.959311 6456 ts_tablet_manager.cc:1403] T 2db82e6f314f412385b41720c7efdef5 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.045s user 0.003s sys 0.000s
W20260923 19:50:12.959656 7050 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 19:50:12.960071 7050 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
I20260923 19:50:12.959976 6456 raft_consensus.cc:359] T 2db82e6f314f412385b41720c7efdef5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.960131 6456 raft_consensus.cc:385] T 2db82e6f314f412385b41720c7efdef5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:12.960180 6456 raft_consensus.cc:740] T 2db82e6f314f412385b41720c7efdef5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
W20260923 19:50:12.960213 7050 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260923 19:50:12.961494 7211 raft_consensus.cc:493] T b92aaac328934d95a89e0fc08a80b0b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:12.961972 6456 consensus_queue.cc:260] T 2db82e6f314f412385b41720c7efdef5 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.963930 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fd7e98016ca4e168979d7f7411e525a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.964108 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2072d5cda2d046898df6ccddb872c92e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:12.969975 6459 raft_consensus.cc:2243] T 015c14b447fe4cd18d197b2d1ed5884e P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:12.970513 6459 pending_rounds.cc:70] T 015c14b447fe4cd18d197b2d1ed5884e P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:12.970577 6459 pending_rounds.cc:77] T 015c14b447fe4cd18d197b2d1ed5884e P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630579679993856 op_type: NO_OP noop_request { }
I20260923 19:50:12.970674 6459 raft_consensus.cc:2889] T 015c14b447fe4cd18d197b2d1ed5884e P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:12.970754 6459 raft_consensus.cc:2272] T 015c14b447fe4cd18d197b2d1ed5884e P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:12.971207 6456 ts_tablet_manager.cc:1434] T 2db82e6f314f412385b41720c7efdef5 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260923 19:50:12.974577 6459 ts_tablet_manager.cc:1916] T 015c14b447fe4cd18d197b2d1ed5884e P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:12.975610 6456 tablet_bootstrap.cc:492] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:12.961621 7211 raft_consensus.cc:515] T b92aaac328934d95a89e0fc08a80b0b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.978612 7211 leader_election.cc:290] T b92aaac328934d95a89e0fc08a80b0b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:12.979190 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92aaac328934d95a89e0fc08a80b0b1" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:12.979701 5996 leader_election.cc:343] T b92aaac328934d95a89e0fc08a80b0b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:12.979977 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92aaac328934d95a89e0fc08a80b0b1" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:12.980460 7172 raft_consensus.cc:493] T e071b9dd1db44af0a9d1b9e904f875a5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260923 19:50:12.980587 5995 leader_election.cc:343] T b92aaac328934d95a89e0fc08a80b0b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:12.980639 7172 raft_consensus.cc:515] T e071b9dd1db44af0a9d1b9e904f875a5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.980701 5995 leader_election.cc:304] T b92aaac328934d95a89e0fc08a80b0b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:12.981195 7211 raft_consensus.cc:2749] T b92aaac328934d95a89e0fc08a80b0b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:12.981323 7172 leader_election.cc:290] T e071b9dd1db44af0a9d1b9e904f875a5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:12.981858 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e071b9dd1db44af0a9d1b9e904f875a5" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:12.982340 6280 leader_election.cc:343] T e071b9dd1db44af0a9d1b9e904f875a5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:12.965449 7134 raft_consensus.cc:493] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:12.982932 7134 raft_consensus.cc:515] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:12.983502 7134 leader_election.cc:290] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:12.984066 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f46a1be80c4194b592c5d00fe1f342" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:12.984330 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f46a1be80c4194b592c5d00fe1f342" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:12.984786 5996 leader_election.cc:343] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:12.985183 6456 tablet_bootstrap.cc:654] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:12.985189 5995 leader_election.cc:343] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:12.985285 5995 leader_election.cc:304] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:12.985730 7134 raft_consensus.cc:2749] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:12.992411 7252 tablet.cc:1751] T 85d35ebef3c24a2e89233dd900b63513 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260923 19:50:12.992717 5792 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet b8d209f958cc452c8b864e010c9da6a0 (table default.Table_34dc1315ccaa4033a038097353edf435 [id=26a627e9c7944f90b61000e0406dca73], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet b8d209f958cc452c8b864e010c9da6a0 consensus state has no leader
W20260923 19:50:12.992811 7050 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 19:50:12.992914 7050 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260923 19:50:12.992998 7050 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 19:50:12.993032 6279 leader_election.cc:343] T e071b9dd1db44af0a9d1b9e904f875a5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: e071b9dd1db44af0a9d1b9e904f875a5
I20260923 19:50:12.993166 6279 leader_election.cc:304] T e071b9dd1db44af0a9d1b9e904f875a5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:12.993535 7050 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260923 19:50:12.994208 7189 raft_consensus.cc:2749] T e071b9dd1db44af0a9d1b9e904f875a5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:12.994233 6459 ts_tablet_manager.cc:1929] T 015c14b447fe4cd18d197b2d1ed5884e P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:12.994342 6459 log.cc:1199] T 015c14b447fe4cd18d197b2d1ed5884e P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/015c14b447fe4cd18d197b2d1ed5884e
I20260923 19:50:12.994737 6459 ts_tablet_manager.cc:1950] T 015c14b447fe4cd18d197b2d1ed5884e P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:12.995852 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 015c14b447fe4cd18d197b2d1ed5884e (table default.Table_e06d0ff4af234fa090feddba5bef4853 [id=5f2c892d7f794a6dbc1499fada9faf02]) successfully deleted
I20260923 19:50:13.003296 6459 tablet_replica.cc:333] T c48d4a8371fa4454b7c67291db3ab796 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:13.003494 6459 raft_consensus.cc:2243] T c48d4a8371fa4454b7c67291db3ab796 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:13.003724 6459 pending_rounds.cc:70] T c48d4a8371fa4454b7c67291db3ab796 P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:13.003775 6459 pending_rounds.cc:77] T c48d4a8371fa4454b7c67291db3ab796 P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630579678420992 op_type: NO_OP noop_request { }
I20260923 19:50:13.003870 6459 raft_consensus.cc:2889] T c48d4a8371fa4454b7c67291db3ab796 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:13.003955 6459 raft_consensus.cc:2272] T c48d4a8371fa4454b7c67291db3ab796 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:13.004784 6458 ts_tablet_manager.cc:1929] T 015c14b447fe4cd18d197b2d1ed5884e P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:13.005009 6458 log.cc:1199] T 015c14b447fe4cd18d197b2d1ed5884e P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/015c14b447fe4cd18d197b2d1ed5884e
I20260923 19:50:13.005615 6458 ts_tablet_manager.cc:1950] T 015c14b447fe4cd18d197b2d1ed5884e P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:13.005916 6456 tablet_bootstrap.cc:492] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:13.009702 6456 ts_tablet_manager.cc:1403] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.034s user 0.005s sys 0.000s
I20260923 19:50:13.010692 6456 raft_consensus.cc:359] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.011758 6456 raft_consensus.cc:385] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.011978 6456 raft_consensus.cc:740] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.012497 6456 consensus_queue.cc:260] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.013518 6456 ts_tablet_manager.cc:1434] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260923 19:50:13.015596 6456 tablet_bootstrap.cc:492] T a08446fcf1794dab9d3181904507456f P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:13.019773 6030 tablet_service.cc:1558] Processing DeleteTablet for tablet 5adadf8caf5e4a9ab1107d0fb6a91735 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:13.020536 6454 tablet_bootstrap.cc:492] T b529b0e82c5b48edac54cc281ac4b4a6 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:13.020660 6454 ts_tablet_manager.cc:1403] T b529b0e82c5b48edac54cc281ac4b4a6 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.308s user 0.003s sys 0.002s
I20260923 19:50:13.023718 6169 tablet_service.cc:1511] Processing CreateTablet for tablet 2072d5cda2d046898df6ccddb872c92e (DEFAULT_TABLE table=default.Table_8d9c168e75b24278869d2281218a0ad5 [id=dc33438851de48ad85395ec65fe98ddd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.024107 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2072d5cda2d046898df6ccddb872c92e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.027669 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 516) took 1802 ms. Trace:
I20260923 19:50:13.028292 6458 rpcz_store.cc:276] 0923 19:50:11.224643 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:11.224794 (+ 151us) service_pool.cc:224] Handling call
0923 19:50:12.893957 (+1669163us) ts_tablet_manager.cc:1151] Deleting tablet 015c14b447fe4cd18d197b2d1ed5884e
0923 19:50:12.898038 (+ 4081us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:12.907754 (+ 9716us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:13.004660 (+ 96906us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:13.027498 (+ 22838us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1668922}
I20260923 19:50:13.030249 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 015c14b447fe4cd18d197b2d1ed5884e (table default.Table_e06d0ff4af234fa090feddba5bef4853 [id=5f2c892d7f794a6dbc1499fada9faf02]) successfully deleted
I20260923 19:50:13.038138 6461 tablet_replica.cc:333] T 18bab39d85f94f4283f0b18c1c9b48a2 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:13.038374 6461 raft_consensus.cc:2243] T 18bab39d85f94f4283f0b18c1c9b48a2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:13.038520 6461 raft_consensus.cc:2272] T 18bab39d85f94f4283f0b18c1c9b48a2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:13.039045 6461 ts_tablet_manager.cc:1916] T 18bab39d85f94f4283f0b18c1c9b48a2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:13.039409 6457 tablet_bootstrap.cc:492] T 22e37d5afa8047989928596b4092c4b9 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:13.039549 6457 ts_tablet_manager.cc:1403] T 22e37d5afa8047989928596b4092c4b9 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.284s user 0.019s sys 0.076s
I20260923 19:50:13.040473 6457 raft_consensus.cc:359] T 22e37d5afa8047989928596b4092c4b9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.040685 6457 raft_consensus.cc:385] T 22e37d5afa8047989928596b4092c4b9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.040746 6457 raft_consensus.cc:740] T 22e37d5afa8047989928596b4092c4b9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.040973 6457 consensus_queue.cc:260] T 22e37d5afa8047989928596b4092c4b9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.041736 6457 ts_tablet_manager.cc:1434] T 22e37d5afa8047989928596b4092c4b9 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:13.042062 6457 tablet_bootstrap.cc:492] T 474e34e902064764864ba06ef41b1d94 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:13.045492 6456 tablet_bootstrap.cc:654] T a08446fcf1794dab9d3181904507456f P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.047830 6457 tablet_bootstrap.cc:654] T 474e34e902064764864ba06ef41b1d94 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.048841 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 601a0ff319cc4c9a898d52bbcb19184b (table default.Table_5812b40db6ab4814a5c5b3c869967f58 [id=df481a17409f4078a57a0aef11bef720]) successfully deleted
I20260923 19:50:13.045197 6458 tablet_replica.cc:333] T 2f627b7b9ff74750bd8dd59840bf77db P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:13.032560 6454 raft_consensus.cc:359] T b529b0e82c5b48edac54cc281ac4b4a6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.053108 6454 raft_consensus.cc:385] T b529b0e82c5b48edac54cc281ac4b4a6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.053231 6454 raft_consensus.cc:740] T b529b0e82c5b48edac54cc281ac4b4a6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.053699 6454 consensus_queue.cc:260] T b529b0e82c5b48edac54cc281ac4b4a6 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.057546 6458 raft_consensus.cc:2243] T 2f627b7b9ff74750bd8dd59840bf77db P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:13.060521 5800 master_service.cc:960] ReplaceTablet: received request to replace tablet 896bd068e6b343e48eb2a01679b49326 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:13.059899 6458 raft_consensus.cc:2272] T 2f627b7b9ff74750bd8dd59840bf77db P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:13.061030 5804 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 900726a4f2f84dde90e8bb3ab26b71c9 consensus state has no leader
I20260923 19:50:13.061301 5804 master_service.cc:960] ReplaceTablet: received request to replace tablet 7539bd538c6343eda16bedfdf8545316 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:13.062489 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet d6d3601a392f4723b4ca00f6e12b950c
I20260923 19:50:13.063198 5802 master_service.cc:960] ReplaceTablet: received request to replace tablet 908596339b2e4f7f8ddb7f9cd5bdcc3e from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:13.063935 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet d6d3601a392f4723b4ca00f6e12b950c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:13.063339 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet d6d3601a392f4723b4ca00f6e12b950c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:13.065515 6459 ts_tablet_manager.cc:1916] T c48d4a8371fa4454b7c67291db3ab796 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:13.065676 5798 master_service.cc:960] ReplaceTablet: received request to replace tablet 556b32b8ccd54c439f86b0069e2a5ce0 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:13.065912 7263 tablet.cc:1746] T 85d35ebef3c24a2e89233dd900b63513 P e546f660e7e541d1aa9ae38e5ee5b9c0: Skipping requested alter to schema version 3, tablet already version 3
I20260923 19:50:13.052378 6461 ts_tablet_manager.cc:1929] T 18bab39d85f94f4283f0b18c1c9b48a2 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:13.066268 6461 log.cc:1199] T 18bab39d85f94f4283f0b18c1c9b48a2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/18bab39d85f94f4283f0b18c1c9b48a2
I20260923 19:50:13.066710 5799 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet fc151f4d78344efeada6d6e57af6eb9f
I20260923 19:50:13.067193 6461 ts_tablet_manager.cc:1950] T 18bab39d85f94f4283f0b18c1c9b48a2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:13.067986 7050 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.143.212:38183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.5.143.254:37151,127.5.143.253:45285,127.5.143.252:45543
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.143.254:37151
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.143.254
--webserver_port=39441
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision faa920b8364ca43fd9d419253dab85c46533dc98
build type FASTDEBUG
built by None at 23 Sep 2026 19:43:25 UTC on bdcb31816ec0
build id 13965
ASAN enabled
I20260923 19:50:13.069561 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet e996910398694686bd68ef31239ed15f
I20260923 19:50:13.070127 6461 tablet_replica.cc:333] T 7e41501bf01e4765853c27e4cac21e2b P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:13.070166 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_d4465060b0834069ae08a025e1b6f146"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:13.070312 6461 raft_consensus.cc:2243] T 7e41501bf01e4765853c27e4cac21e2b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:13.070461 6461 raft_consensus.cc:2272] T 7e41501bf01e4765853c27e4cac21e2b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:13.070399 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a3fdc430d3554365b41daaa0baa5ebb8" } new_table_name: "default.Table_232922d4519b432994b66a52cd54123c" modify_external_catalogs: true
W20260923 19:50:13.070843 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4465060b0834069ae08a025e1b6f146 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:13.071457 6314 tablet_service.cc:1558] Processing DeleteTablet for tablet e996910398694686bd68ef31239ed15f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:13.074064 6458 ts_tablet_manager.cc:1916] T 2f627b7b9ff74750bd8dd59840bf77db P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:13.075248 6461 ts_tablet_manager.cc:1916] T 7e41501bf01e4765853c27e4cac21e2b P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:13.076186 5796 catalog_manager.cc:5838] T ffcf1a144f3c42719a5aa5deed537975 P 61022dd7f2f14dc19aebe3af5f08f430 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194). New cstate: current_term: 1 leader_uuid: "61022dd7f2f14dc19aebe3af5f08f430" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: UNKNOWN } } }
I20260923 19:50:13.077309 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_8590246f18b44aa9833d9152591b144b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:13.077914 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8590246f18b44aa9833d9152591b144b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:13.079375 5802 master_service.cc:960] ReplaceTablet: received request to replace tablet ccbb8cd687924f0892464c6cb80d175c from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:13.073726 7050 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 19:50:13.080785 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_8cd7b83d22794bc290a8d894a419250e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:13.081282 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8cd7b83d22794bc290a8d894a419250e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:13.082265 7134 raft_consensus.cc:493] T 66739afdf147413787acb0363aa37df6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:13.082415 7134 raft_consensus.cc:515] T 66739afdf147413787acb0363aa37df6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.083063 7134 leader_election.cc:290] T 66739afdf147413787acb0363aa37df6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:13.083247 6169 tablet_service.cc:1558] Processing DeleteTablet for tablet e996910398694686bd68ef31239ed15f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:13.083439 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet fc151f4d78344efeada6d6e57af6eb9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:13.083694 6454 ts_tablet_manager.cc:1434] T b529b0e82c5b48edac54cc281ac4b4a6 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.045s user 0.001s sys 0.002s
I20260923 19:50:13.083979 6454 tablet_bootstrap.cc:492] T 3919b15a00eb4fb08008f065f556c760 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:13.084105 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66739afdf147413787acb0363aa37df6" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:13.084738 5995 leader_election.cc:343] T 66739afdf147413787acb0363aa37df6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:13.085371 7050 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260923 19:50:13.085562 6454 tablet_bootstrap.cc:654] T 3919b15a00eb4fb08008f065f556c760 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.086061 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66739afdf147413787acb0363aa37df6" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:13.086740 5996 leader_election.cc:343] T 66739afdf147413787acb0363aa37df6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:13.086848 5996 leader_election.cc:304] T 66739afdf147413787acb0363aa37df6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:13.087284 7134 raft_consensus.cc:2749] T 66739afdf147413787acb0363aa37df6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:13.087702 6457 tablet_bootstrap.cc:492] T 474e34e902064764864ba06ef41b1d94 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:13.087908 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet fc151f4d78344efeada6d6e57af6eb9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:13.088133 6457 ts_tablet_manager.cc:1403] T 474e34e902064764864ba06ef41b1d94 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.046s user 0.001s sys 0.005s
I20260923 19:50:13.089037 6457 raft_consensus.cc:359] T 474e34e902064764864ba06ef41b1d94 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.089262 6457 raft_consensus.cc:385] T 474e34e902064764864ba06ef41b1d94 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.089361 6457 raft_consensus.cc:740] T 474e34e902064764864ba06ef41b1d94 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.089632 6457 consensus_queue.cc:260] T 474e34e902064764864ba06ef41b1d94 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.090318 6457 ts_tablet_manager.cc:1434] T 474e34e902064764864ba06ef41b1d94 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:13.090651 6457 tablet_bootstrap.cc:492] T 2ce6378a6bd844a485aebb96081307e3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:13.090756 6461 ts_tablet_manager.cc:1929] T 7e41501bf01e4765853c27e4cac21e2b P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:13.090852 6461 log.cc:1199] T 7e41501bf01e4765853c27e4cac21e2b P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/7e41501bf01e4765853c27e4cac21e2b
I20260923 19:50:13.091125 6461 ts_tablet_manager.cc:1950] T 7e41501bf01e4765853c27e4cac21e2b P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:13.092692 6457 tablet_bootstrap.cc:654] T 2ce6378a6bd844a485aebb96081307e3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.094650 6461 tablet_replica.cc:333] T 7b1601590508479c8f401cd09d9f4c3b P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:13.094892 6461 raft_consensus.cc:2243] T 7b1601590508479c8f401cd09d9f4c3b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:13.095057 6461 raft_consensus.cc:2272] T 7b1601590508479c8f401cd09d9f4c3b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:13.095557 6461 ts_tablet_manager.cc:1916] T 7b1601590508479c8f401cd09d9f4c3b P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:13.101356 6457 tablet_bootstrap.cc:492] T 2ce6378a6bd844a485aebb96081307e3 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:13.101984 6457 ts_tablet_manager.cc:1403] T 2ce6378a6bd844a485aebb96081307e3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.000s
I20260923 19:50:13.103585 6457 raft_consensus.cc:359] T 2ce6378a6bd844a485aebb96081307e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.105334 6457 raft_consensus.cc:385] T 2ce6378a6bd844a485aebb96081307e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.105556 6457 raft_consensus.cc:740] T 2ce6378a6bd844a485aebb96081307e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.105898 6457 consensus_queue.cc:260] T 2ce6378a6bd844a485aebb96081307e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.106097 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet fc151f4d78344efeada6d6e57af6eb9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:13.107007 6457 ts_tablet_manager.cc:1434] T 2ce6378a6bd844a485aebb96081307e3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260923 19:50:13.108961 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 7539bd538c6343eda16bedfdf8545316
I20260923 19:50:13.109575 5804 catalog_manager.cc:6934] ReplaceTablet: tablet 7539bd538c6343eda16bedfdf8545316 deleted and replaced by tablet e5fce24b9dc244c88ccbc16b633924fe
W20260923 19:50:13.110247 5805 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cf0caa6afcf546678c233a9333b77a2a consensus state has no leader
I20260923 19:50:13.111356 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet e996910398694686bd68ef31239ed15f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:13.111522 6461 ts_tablet_manager.cc:1929] T 7b1601590508479c8f401cd09d9f4c3b P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:13.111613 6461 log.cc:1199] T 7b1601590508479c8f401cd09d9f4c3b P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/7b1601590508479c8f401cd09d9f4c3b
I20260923 19:50:13.111907 6461 ts_tablet_manager.cc:1950] T 7b1601590508479c8f401cd09d9f4c3b P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:13.113867 6454 tablet_bootstrap.cc:492] T 3919b15a00eb4fb08008f065f556c760 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:13.114233 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet ccbb8cd687924f0892464c6cb80d175c
I20260923 19:50:13.114436 6454 ts_tablet_manager.cc:1403] T 3919b15a00eb4fb08008f065f556c760 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.001s
I20260923 19:50:13.114748 5802 catalog_manager.cc:6934] ReplaceTablet: tablet ccbb8cd687924f0892464c6cb80d175c deleted and replaced by tablet 3f1f46ea8b894c8693ecf2d752e2507e
I20260923 19:50:13.115098 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_8d806c3e0bb046baa472f015d9a750a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:13.115221 6454 raft_consensus.cc:359] T 3919b15a00eb4fb08008f065f556c760 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.115357 6454 raft_consensus.cc:385] T 3919b15a00eb4fb08008f065f556c760 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.115403 6454 raft_consensus.cc:740] T 3919b15a00eb4fb08008f065f556c760 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
W20260923 19:50:13.115629 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d806c3e0bb046baa472f015d9a750a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:13.115648 6454 consensus_queue.cc:260] T 3919b15a00eb4fb08008f065f556c760 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.116186 6454 ts_tablet_manager.cc:1434] T 3919b15a00eb4fb08008f065f556c760 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:13.117452 6461 tablet_replica.cc:333] T 465371cfbe544ba98e6eea05033ecf05 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:13.117345 5799 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_aad0a22c213c44f9b67c092d40fd8455" } new_table_name: "default.Table_a1c157c570224093ae6a50f1b10aa01b" modify_external_catalogs: true
I20260923 19:50:13.118328 6461 raft_consensus.cc:2243] T 465371cfbe544ba98e6eea05033ecf05 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:13.118479 6461 raft_consensus.cc:2272] T 465371cfbe544ba98e6eea05033ecf05 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:13.118957 6461 ts_tablet_manager.cc:1916] T 465371cfbe544ba98e6eea05033ecf05 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:13.119958 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet 7539bd538c6343eda16bedfdf8545316 with delete_type TABLET_DATA_DELETED (replaced by tablet e5fce24b9dc244c88ccbc16b633924fe) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:13.120239 6314 tablet_service.cc:1558] Processing DeleteTablet for tablet ccbb8cd687924f0892464c6cb80d175c with delete_type TABLET_DATA_DELETED (replaced by tablet 3f1f46ea8b894c8693ecf2d752e2507e) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:13.120759 5803 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d8377901984e4886984600fc0b7e24a4" } modify_external_catalogs: true
I20260923 19:50:13.121193 6454 tablet_bootstrap.cc:492] T 194494af2c424a55a772f3858af63c2c P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:13.121171 5803 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d8377901984e4886984600fc0b7e24a4" } modify_external_catalogs: true
I20260923 19:50:13.122570 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7974afca44e444c8b6d147fe6539ee20" } new_table_name: "default.Table_5c873b003c7b4b09ba69db7f039b2f98" modify_external_catalogs: true
I20260923 19:50:13.122741 6454 tablet_bootstrap.cc:654] T 194494af2c424a55a772f3858af63c2c P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.124272 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet ccbb8cd687924f0892464c6cb80d175c with delete_type TABLET_DATA_DELETED (replaced by tablet 3f1f46ea8b894c8693ecf2d752e2507e) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:13.124574 5804 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ca513ce9b8f64f38a09c5a1d6b534a97" } new_table_name: "default.Table_0b6e487ce80a40a992825c27bab24cb2" modify_external_catalogs: true
I20260923 19:50:13.125236 6173 tablet_service.cc:1558] Processing DeleteTablet for tablet 7539bd538c6343eda16bedfdf8545316 with delete_type TABLET_DATA_DELETED (replaced by tablet e5fce24b9dc244c88ccbc16b633924fe) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:13.128882 5805 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_fa5d77accb2d4cb2a336e0394074518a" } modify_external_catalogs: true
I20260923 19:50:13.129045 5805 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_fa5d77accb2d4cb2a336e0394074518a" } modify_external_catalogs: true
I20260923 19:50:13.129918 6456 tablet_bootstrap.cc:492] T a08446fcf1794dab9d3181904507456f P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:13.130119 6456 ts_tablet_manager.cc:1403] T a08446fcf1794dab9d3181904507456f P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.115s user 0.010s sys 0.003s
I20260923 19:50:13.130479 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet d6d3601a392f4723b4ca00f6e12b950c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:13.130932 6456 raft_consensus.cc:359] T a08446fcf1794dab9d3181904507456f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.131100 6456 raft_consensus.cc:385] T a08446fcf1794dab9d3181904507456f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.131163 6456 raft_consensus.cc:740] T a08446fcf1794dab9d3181904507456f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.131402 6456 consensus_queue.cc:260] T a08446fcf1794dab9d3181904507456f P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.131883 6456 ts_tablet_manager.cc:1434] T a08446fcf1794dab9d3181904507456f P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:13.133972 6456 tablet_bootstrap.cc:492] T cd02244c52ad4d2ab3915108a92a6f97 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:13.135141 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 18bab39d85f94f4283f0b18c1c9b48a2 (table default.Table_a0bee41bcb2d439fb8619a6c19152813 [id=8a710c10b5ca42548116d743cb0812c3]) successfully deleted
I20260923 19:50:13.135994 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 7e41501bf01e4765853c27e4cac21e2b (table default.Table_5c35e08897f74660ad23df9a2c751741 [id=9b387d21c8824514b7f3fae8c26b489d]) successfully deleted
I20260923 19:50:13.136348 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 7b1601590508479c8f401cd09d9f4c3b (table default.Table_d824a438d0804f58b8b89f6f0f0f964e [id=83a0bf386540479b9e915b9c66a31376]) successfully deleted
I20260923 19:50:13.134711 6457 tablet_bootstrap.cc:492] T a11ecef9a24f4e4a812ec220b6a92cc4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
W20260923 19:50:13.136795 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 772ece5283a949408d849f6e56f5f17b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 772ece5283a949408d849f6e56f5f17b already in progress: creating tablet
W20260923 19:50:13.137054 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet ecd91bf5bd9447c0bb20ba43573ff08d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ecd91bf5bd9447c0bb20ba43573ff08d already in progress: creating tablet
I20260923 19:50:13.137374 7244 raft_consensus.cc:493] T 6fe14389e2a3487587dfcf7a8b4b242d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:13.137513 7244 raft_consensus.cc:515] T 6fe14389e2a3487587dfcf7a8b4b242d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.137773 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet 7539bd538c6343eda16bedfdf8545316 with delete_type TABLET_DATA_DELETED (replaced by tablet e5fce24b9dc244c88ccbc16b633924fe) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:13.138379 7244 leader_election.cc:290] T 6fe14389e2a3487587dfcf7a8b4b242d P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:13.139230 6137 leader_election.cc:343] T 6fe14389e2a3487587dfcf7a8b4b242d P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 6fe14389e2a3487587dfcf7a8b4b242d
W20260923 19:50:13.139349 6139 leader_election.cc:343] T 6fe14389e2a3487587dfcf7a8b4b242d P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 6fe14389e2a3487587dfcf7a8b4b242d
I20260923 19:50:13.139629 6457 tablet_bootstrap.cc:654] T a11ecef9a24f4e4a812ec220b6a92cc4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.140471 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet ccbb8cd687924f0892464c6cb80d175c with delete_type TABLET_DATA_DELETED (replaced by tablet 3f1f46ea8b894c8693ecf2d752e2507e) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:13.139487 6139 leader_election.cc:304] T 6fe14389e2a3487587dfcf7a8b4b242d P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:13.142405 7244 raft_consensus.cc:2749] T 6fe14389e2a3487587dfcf7a8b4b242d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:13.133246 6461 ts_tablet_manager.cc:1929] T 465371cfbe544ba98e6eea05033ecf05 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:13.143179 6461 log.cc:1199] T 465371cfbe544ba98e6eea05033ecf05 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/465371cfbe544ba98e6eea05033ecf05
I20260923 19:50:13.143790 7134 raft_consensus.cc:493] T edb52bd88b424129bbdc45de89b56efb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:13.143952 7134 raft_consensus.cc:515] T edb52bd88b424129bbdc45de89b56efb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.144670 7134 leader_election.cc:290] T edb52bd88b424129bbdc45de89b56efb P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:13.145082 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb52bd88b424129bbdc45de89b56efb" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:13.143777 6461 ts_tablet_manager.cc:1950] T 465371cfbe544ba98e6eea05033ecf05 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:13.145506 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb52bd88b424129bbdc45de89b56efb" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:13.145992 6456 tablet_bootstrap.cc:654] T cd02244c52ad4d2ab3915108a92a6f97 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:13.147971 5996 leader_election.cc:343] T edb52bd88b424129bbdc45de89b56efb P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:13.148324 6454 tablet_bootstrap.cc:492] T 194494af2c424a55a772f3858af63c2c P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
W20260923 19:50:13.148409 5995 leader_election.cc:343] T edb52bd88b424129bbdc45de89b56efb P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:13.148501 5995 leader_election.cc:304] T edb52bd88b424129bbdc45de89b56efb P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:13.148530 6454 ts_tablet_manager.cc:1403] T 194494af2c424a55a772f3858af63c2c P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.027s user 0.006s sys 0.000s
I20260923 19:50:13.148850 7134 raft_consensus.cc:2749] T edb52bd88b424129bbdc45de89b56efb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:13.149057 6461 tablet_replica.cc:333] T c0ff8838ab17433ab733d3b293d4964f P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:13.149266 6458 ts_tablet_manager.cc:1929] T 2f627b7b9ff74750bd8dd59840bf77db P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:13.149369 6458 log.cc:1199] T 2f627b7b9ff74750bd8dd59840bf77db P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/2f627b7b9ff74750bd8dd59840bf77db
I20260923 19:50:13.149318 6454 raft_consensus.cc:359] T 194494af2c424a55a772f3858af63c2c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.149528 6454 raft_consensus.cc:385] T 194494af2c424a55a772f3858af63c2c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.149598 6454 raft_consensus.cc:740] T 194494af2c424a55a772f3858af63c2c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.149708 6458 ts_tablet_manager.cc:1950] T 2f627b7b9ff74750bd8dd59840bf77db P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:13.150084 6454 consensus_queue.cc:260] T 194494af2c424a55a772f3858af63c2c P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.149247 6461 raft_consensus.cc:2243] T c0ff8838ab17433ab733d3b293d4964f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:13.150319 6461 raft_consensus.cc:2272] T c0ff8838ab17433ab733d3b293d4964f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:13.150879 6454 ts_tablet_manager.cc:1434] T 194494af2c424a55a772f3858af63c2c P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:13.153743 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 465371cfbe544ba98e6eea05033ecf05 (table default.Table_59faad35003f4e6f95781fbb1895f6aa [id=b28193cd587649a4b2c450473da92564]) successfully deleted
I20260923 19:50:13.154554 6461 ts_tablet_manager.cc:1916] T c0ff8838ab17433ab733d3b293d4964f P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:13.159389 6459 ts_tablet_manager.cc:1929] T c48d4a8371fa4454b7c67291db3ab796 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:13.159508 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 515) took 1935 ms. Trace:
I20260923 19:50:13.159613 6458 rpcz_store.cc:276] 0923 19:50:11.224496 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:11.224557 (+ 61us) service_pool.cc:224] Handling call
0923 19:50:13.043806 (+1819249us) ts_tablet_manager.cc:1151] Deleting tablet 2f627b7b9ff74750bd8dd59840bf77db
0923 19:50:13.044070 (+ 264us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.077511 (+ 33441us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:13.149208 (+ 71697us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:13.159487 (+ 10279us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1805452}
I20260923 19:50:13.159957 6458 tablet_replica.cc:333] T c48d4a8371fa4454b7c67291db3ab796 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:13.160176 6458 raft_consensus.cc:2243] T c48d4a8371fa4454b7c67291db3ab796 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:13.160152 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 2f627b7b9ff74750bd8dd59840bf77db (table default.Table_e6225c62c99144cdb7c222d165e1d7b5 [id=e54ebfe94bd640f59f7006d4d146a9da]) successfully deleted
I20260923 19:50:13.160326 6458 raft_consensus.cc:2272] T c48d4a8371fa4454b7c67291db3ab796 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:13.160811 6458 ts_tablet_manager.cc:1916] T c48d4a8371fa4454b7c67291db3ab796 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:13.160122 6454 tablet_bootstrap.cc:492] T 15c0dc02ba964af38ca9f76161722588 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:13.166453 6459 log.cc:1199] T c48d4a8371fa4454b7c67291db3ab796 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/c48d4a8371fa4454b7c67291db3ab796
I20260923 19:50:13.168941 6459 ts_tablet_manager.cc:1950] T c48d4a8371fa4454b7c67291db3ab796 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:13.170442 6456 tablet_bootstrap.cc:492] T cd02244c52ad4d2ab3915108a92a6f97 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:13.170691 6456 ts_tablet_manager.cc:1403] T cd02244c52ad4d2ab3915108a92a6f97 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.037s user 0.004s sys 0.001s
I20260923 19:50:13.172367 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 556b32b8ccd54c439f86b0069e2a5ce0
W20260923 19:50:13.172497 5799 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cf538da9dc8c47a8a391efe4e17bb3a5 consensus state has no leader
I20260923 19:50:13.172889 5798 catalog_manager.cc:6934] ReplaceTablet: tablet 556b32b8ccd54c439f86b0069e2a5ce0 deleted and replaced by tablet cc6027b598c3416e842ac057591c1200
W20260923 19:50:13.173036 5800 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f1f1df47dc32413d9cc9456f4198dca5 consensus state has no leader
I20260923 19:50:13.173298 6456 raft_consensus.cc:359] T cd02244c52ad4d2ab3915108a92a6f97 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.173465 6314 tablet_service.cc:1558] Processing DeleteTablet for tablet 556b32b8ccd54c439f86b0069e2a5ce0 with delete_type TABLET_DATA_DELETED (replaced by tablet cc6027b598c3416e842ac057591c1200) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:13.168455 6454 tablet_bootstrap.cc:654] T 15c0dc02ba964af38ca9f76161722588 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.175203 5801 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet b529b0e82c5b48edac54cc281ac4b4a6 (table default.Table_504bdbe9702948d58b4f958360a2040b [id=ca73f0867b5d49cfb0bb7cd2315c47f2]). Expected version 5 got 0
W20260923 19:50:13.176617 5804 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 42ca4ffede1a472d8917a592fac7f746 has no consensus state
I20260923 19:50:13.173473 6456 raft_consensus.cc:385] T cd02244c52ad4d2ab3915108a92a6f97 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.177160 6456 raft_consensus.cc:740] T cd02244c52ad4d2ab3915108a92a6f97 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.177383 6456 consensus_queue.cc:260] T cd02244c52ad4d2ab3915108a92a6f97 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.177726 6461 ts_tablet_manager.cc:1929] T c0ff8838ab17433ab733d3b293d4964f P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:13.177834 6461 log.cc:1199] T c0ff8838ab17433ab733d3b293d4964f P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/c0ff8838ab17433ab733d3b293d4964f
I20260923 19:50:13.177956 6173 tablet_service.cc:1558] Processing DeleteTablet for tablet 556b32b8ccd54c439f86b0069e2a5ce0 with delete_type TABLET_DATA_DELETED (replaced by tablet cc6027b598c3416e842ac057591c1200) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:13.179198 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet 556b32b8ccd54c439f86b0069e2a5ce0 with delete_type TABLET_DATA_DELETED (replaced by tablet cc6027b598c3416e842ac057591c1200) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:13.179539 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 574) took 1137 ms. Trace:
W20260923 19:50:13.179522 7285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:50:13.179677 6459 rpcz_store.cc:276] 0923 19:50:12.042217 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:12.042741 (+ 524us) service_pool.cc:224] Handling call
0923 19:50:13.003242 (+960501us) ts_tablet_manager.cc:1151] Deleting tablet c48d4a8371fa4454b7c67291db3ab796
0923 19:50:13.003254 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.120258 (+117004us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:13.159328 (+ 39070us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:13.179517 (+ 20189us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":881619}
I20260923 19:50:13.180289 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet c48d4a8371fa4454b7c67291db3ab796 (table default.Table_42fbb36fdc75430881f49e0b2bb82fc3 [id=8a2bd1f24f824735a82439a9b4ce1f0a]) successfully deleted
I20260923 19:50:13.180595 6459 tablet_replica.cc:333] T 337f32eb47954689a6eb8f74408e01d9 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:13.180822 6459 raft_consensus.cc:2243] T 337f32eb47954689a6eb8f74408e01d9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:13.181011 6459 raft_consensus.cc:2272] T 337f32eb47954689a6eb8f74408e01d9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:13.181773 6457 tablet_bootstrap.cc:492] T a11ecef9a24f4e4a812ec220b6a92cc4 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:13.181821 6456 ts_tablet_manager.cc:1434] T cd02244c52ad4d2ab3915108a92a6f97 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260923 19:50:13.182456 6459 ts_tablet_manager.cc:1916] T 337f32eb47954689a6eb8f74408e01d9 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:13.183689 6456 tablet_bootstrap.cc:492] T 2ccfe6531fc44f86a0edc8bda1547442 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
W20260923 19:50:13.183736 7288 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:50:13.183940 6457 ts_tablet_manager.cc:1403] T a11ecef9a24f4e4a812ec220b6a92cc4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.077s user 0.006s sys 0.004s
I20260923 19:50:13.184995 6457 raft_consensus.cc:359] T a11ecef9a24f4e4a812ec220b6a92cc4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.185189 6457 raft_consensus.cc:385] T a11ecef9a24f4e4a812ec220b6a92cc4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.185246 6457 raft_consensus.cc:740] T a11ecef9a24f4e4a812ec220b6a92cc4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.185127 6461 ts_tablet_manager.cc:1950] T c0ff8838ab17433ab733d3b293d4964f P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:13.186414 6456 tablet_bootstrap.cc:654] T 2ccfe6531fc44f86a0edc8bda1547442 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.187686 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet c0ff8838ab17433ab733d3b293d4964f (table default.Table_c67ffb2902d446cba5c75e4a3d46d559 [id=b703874c0f19412b96d6776a2cda5caa]) successfully deleted
W20260923 19:50:13.189649 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 5a2e1e77494343ddb72c496d521151f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a2e1e77494343ddb72c496d521151f1 already in progress: creating tablet
W20260923 19:50:13.191543 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet bfe87e992ca04ea293e354da508e4c67 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bfe87e992ca04ea293e354da508e4c67 already in progress: creating tablet
I20260923 19:50:13.192221 6458 ts_tablet_manager.cc:1929] T c48d4a8371fa4454b7c67291db3ab796 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:13.192332 6458 log.cc:1199] T c48d4a8371fa4454b7c67291db3ab796 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/c48d4a8371fa4454b7c67291db3ab796
I20260923 19:50:13.192644 6458 ts_tablet_manager.cc:1950] T c48d4a8371fa4454b7c67291db3ab796 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:13.193109 6457 consensus_queue.cc:260] T a11ecef9a24f4e4a812ec220b6a92cc4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:13.193316 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 688bb1055ba94c2996cdfea6dea76416 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 688bb1055ba94c2996cdfea6dea76416 already in progress: creating tablet
I20260923 19:50:13.193359 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 514) took 1969 ms. Trace:
I20260923 19:50:13.193445 6458 rpcz_store.cc:276] 0923 19:50:11.224360 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:11.224820 (+ 460us) service_pool.cc:224] Handling call
0923 19:50:13.159913 (+1935093us) ts_tablet_manager.cc:1151] Deleting tablet c48d4a8371fa4454b7c67291db3ab796
0923 19:50:13.159923 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.189144 (+ 29221us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:13.192167 (+ 3023us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:13.193341 (+ 1174us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1934668}
I20260923 19:50:13.193785 6458 tablet_replica.cc:333] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:13.193979 6454 tablet_bootstrap.cc:492] T 15c0dc02ba964af38ca9f76161722588 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:13.193967 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet c48d4a8371fa4454b7c67291db3ab796 (table default.Table_42fbb36fdc75430881f49e0b2bb82fc3 [id=8a2bd1f24f824735a82439a9b4ce1f0a]) successfully deleted
I20260923 19:50:13.193989 6458 raft_consensus.cc:2243] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:13.194199 6454 ts_tablet_manager.cc:1403] T 15c0dc02ba964af38ca9f76161722588 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.002s
I20260923 19:50:13.194275 6458 pending_rounds.cc:70] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd: Trying to abort 1 pending ops.
I20260923 19:50:13.194342 6458 pending_rounds.cc:77] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630576023490560 op_type: NO_OP noop_request { }
W20260923 19:50:13.194432 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet e4ad9baac560463fabc80828074b46c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4ad9baac560463fabc80828074b46c1 already in progress: creating tablet
I20260923 19:50:13.194451 6458 raft_consensus.cc:2889] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:13.194540 6458 raft_consensus.cc:2272] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:13.195179 6458 ts_tablet_manager.cc:1916] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:13.195119 6454 raft_consensus.cc:359] T 15c0dc02ba964af38ca9f76161722588 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.195291 6454 raft_consensus.cc:385] T 15c0dc02ba964af38ca9f76161722588 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.195356 6454 raft_consensus.cc:740] T 15c0dc02ba964af38ca9f76161722588 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.195456 7050 server_base.cc:1061] running on GCE node
I20260923 19:50:13.195636 6454 consensus_queue.cc:260] T 15c0dc02ba964af38ca9f76161722588 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.196205 6454 ts_tablet_manager.cc:1434] T 15c0dc02ba964af38ca9f76161722588 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:13.197249 6454 tablet_bootstrap.cc:492] T 2db82e6f314f412385b41720c7efdef5 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
W20260923 19:50:13.199353 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 47c261638f0d48bb82c78c9a04d487b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47c261638f0d48bb82c78c9a04d487b2 already in progress: creating tablet
W20260923 19:50:13.200201 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet a4c5fdd14ecb467eadfd5036dfb3783f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4c5fdd14ecb467eadfd5036dfb3783f already in progress: creating tablet
I20260923 19:50:13.202855 6457 ts_tablet_manager.cc:1434] T a11ecef9a24f4e4a812ec220b6a92cc4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.019s user 0.001s sys 0.001s
I20260923 19:50:13.203178 6457 tablet_bootstrap.cc:492] T d09faa67bdc54d31a7f7a1b012de9ba1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
W20260923 19:50:13.203154 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet d2dd611746d741e88b6911bf5d51f3e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2dd611746d741e88b6911bf5d51f3e5 already in progress: creating tablet
W20260923 19:50:13.203620 7290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 19:50:13.203845 6461 tablet_replica.cc:333] T 870db252d8414be7bbe613ea467b5f3a P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:13.205197 6454 tablet_bootstrap.cc:654] T 2db82e6f314f412385b41720c7efdef5 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.205960 7050 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 19:50:13.207947 6461 raft_consensus.cc:2243] T 870db252d8414be7bbe613ea467b5f3a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:13.208199 6461 raft_consensus.cc:2272] T 870db252d8414be7bbe613ea467b5f3a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:13.208762 6461 ts_tablet_manager.cc:1916] T 870db252d8414be7bbe613ea467b5f3a P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:13.211449 7134 raft_consensus.cc:493] T 8d87f05f29bd476386ff6516676ce31a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:13.211580 7134 raft_consensus.cc:515] T 8d87f05f29bd476386ff6516676ce31a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.212229 7134 leader_election.cc:290] T 8d87f05f29bd476386ff6516676ce31a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:13.214862 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d87f05f29bd476386ff6516676ce31a" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:13.215022 5797 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 85d35ebef3c24a2e89233dd900b63513 (table default.Table_ea5c2db0da154c51a706c771a367ab98 [id=da91b06e11c64bb0aaec37a0188b5586]). Expected version 3 got 0
I20260923 19:50:13.215221 5797 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet b529b0e82c5b48edac54cc281ac4b4a6 (table default.Table_504bdbe9702948d58b4f958360a2040b [id=ca73f0867b5d49cfb0bb7cd2315c47f2]). Expected version 5 got 0
I20260923 19:50:13.215453 5797 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 35f46a1be80c4194b592c5d00fe1f342 (table default.Table_f6755f452e8d41c4b9d64c3ee2735188 [id=d6a2d0fc236a4056b224d01249f045b0]). Expected version 1 got 0
I20260923 19:50:13.216028 6314 tablet_service.cc:1511] Processing CreateTablet for tablet c0046526af374c999f8247bf9c6dc915 (DEFAULT_TABLE table=default.Table_d5f4a6e399064f4d9ae87a8c18f146d0 [id=66a4e9cfd7eb4e94a7a2cc9dc0252044]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.216431 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0046526af374c999f8247bf9c6dc915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.206909 6457 tablet_bootstrap.cc:654] T d09faa67bdc54d31a7f7a1b012de9ba1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.217581 5796 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_ea5c2db0da154c51a706c771a367ab98 [id=da91b06e11c64bb0aaec37a0188b5586] alter complete (version 3)
I20260923 19:50:13.218818 6317 tablet_service.cc:1511] Processing CreateTablet for tablet 104f137941e84b83bb9a726752c865c1 (DEFAULT_TABLE table=default.Table_dfda35b7191d4d5cb77451b06e244c47 [id=4a7c758ad97a42d4aa38e8db9868e983]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.219183 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 104f137941e84b83bb9a726752c865c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.219550 6032 tablet_service.cc:1511] Processing CreateTablet for tablet c0046526af374c999f8247bf9c6dc915 (DEFAULT_TABLE table=default.Table_d5f4a6e399064f4d9ae87a8c18f146d0 [id=66a4e9cfd7eb4e94a7a2cc9dc0252044]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.219898 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0046526af374c999f8247bf9c6dc915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.220439 6311 tablet_service.cc:1511] Processing CreateTablet for tablet cffe24ab4df745e3a34f82e8ca7b39f5 (DEFAULT_TABLE table=default.Table_973f7a2560ab48ad8d84aeb2f4fc235b [id=72c42d0bf8264d809c5ec888d05db821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.220758 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cffe24ab4df745e3a34f82e8ca7b39f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.222093 6318 tablet_service.cc:1511] Processing CreateTablet for tablet f1157d983bdc42a4a98326154d5f4eb4 (DEFAULT_TABLE table=default.Table_0f07ebb3890d464f8787e3406572d342 [id=89731585826f4c4fb22e0ac4e13ccf46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.222163 6029 tablet_service.cc:1511] Processing CreateTablet for tablet cffe24ab4df745e3a34f82e8ca7b39f5 (DEFAULT_TABLE table=default.Table_973f7a2560ab48ad8d84aeb2f4fc235b [id=72c42d0bf8264d809c5ec888d05db821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.222414 6318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1157d983bdc42a4a98326154d5f4eb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.222543 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cffe24ab4df745e3a34f82e8ca7b39f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.226401 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 104f137941e84b83bb9a726752c865c1 (DEFAULT_TABLE table=default.Table_dfda35b7191d4d5cb77451b06e244c47 [id=4a7c758ad97a42d4aa38e8db9868e983]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.226773 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 104f137941e84b83bb9a726752c865c1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:13.226799 5996 leader_election.cc:343] T 8d87f05f29bd476386ff6516676ce31a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:13.227650 6173 tablet_service.cc:1511] Processing CreateTablet for tablet c0046526af374c999f8247bf9c6dc915 (DEFAULT_TABLE table=default.Table_d5f4a6e399064f4d9ae87a8c18f146d0 [id=66a4e9cfd7eb4e94a7a2cc9dc0252044]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.228009 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0046526af374c999f8247bf9c6dc915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.227944 7172 consensus_queue.cc:1048] T f108ebdaecab42e7b57057c7ecfbe690 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:13.230155 6181 tablet_service.cc:1511] Processing CreateTablet for tablet cffe24ab4df745e3a34f82e8ca7b39f5 (DEFAULT_TABLE table=default.Table_973f7a2560ab48ad8d84aeb2f4fc235b [id=72c42d0bf8264d809c5ec888d05db821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.230494 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cffe24ab4df745e3a34f82e8ca7b39f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.233992 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d87f05f29bd476386ff6516676ce31a" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:13.234138 6169 tablet_service.cc:1511] Processing CreateTablet for tablet 104f137941e84b83bb9a726752c865c1 (DEFAULT_TABLE table=default.Table_dfda35b7191d4d5cb77451b06e244c47 [id=4a7c758ad97a42d4aa38e8db9868e983]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.234474 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 104f137941e84b83bb9a726752c865c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.238108 6168 tablet_service.cc:1511] Processing CreateTablet for tablet f1157d983bdc42a4a98326154d5f4eb4 (DEFAULT_TABLE table=default.Table_0f07ebb3890d464f8787e3406572d342 [id=89731585826f4c4fb22e0ac4e13ccf46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.238456 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1157d983bdc42a4a98326154d5f4eb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.240521 6456 tablet_bootstrap.cc:492] T 2ccfe6531fc44f86a0edc8bda1547442 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:13.240636 6456 ts_tablet_manager.cc:1403] T 2ccfe6531fc44f86a0edc8bda1547442 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.057s user 0.005s sys 0.000s
I20260923 19:50:13.241982 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet c48d4a8371fa4454b7c67291db3ab796 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:13.242219 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet 015c14b447fe4cd18d197b2d1ed5884e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:13.242420 6178 tablet_service.cc:1558] Processing DeleteTablet for tablet 31b0bdf719554d37993a802831e324ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:13.242610 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet 6fe14389e2a3487587dfcf7a8b4b242d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:01 UTC) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:13.243006 5995 leader_election.cc:343] T 8d87f05f29bd476386ff6516676ce31a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:13.243139 5995 leader_election.cc:304] T 8d87f05f29bd476386ff6516676ce31a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
W20260923 19:50:13.244096 6279 consensus_peers.cc:597] T f108ebdaecab42e7b57057c7ecfbe690 P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f108ebdaecab42e7b57057c7ecfbe690. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:13.244562 6318 tablet_service.cc:1558] Processing DeleteTablet for tablet 194494af2c424a55a772f3858af63c2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:13.244820 6317 tablet_service.cc:1558] Processing DeleteTablet for tablet e071b9dd1db44af0a9d1b9e904f875a5 with delete_type TABLET_DATA_DELETED (replaced by tablet b18548ba557f448880c5e617fc03cbe0) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:13.245007 6314 tablet_service.cc:1558] Processing DeleteTablet for tablet 15c0dc02ba964af38ca9f76161722588 with delete_type TABLET_DATA_DELETED (replaced by tablet 85b7dcf131c54187a6e61f8503c797f8) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:13.245184 7134 raft_consensus.cc:2749] T 8d87f05f29bd476386ff6516676ce31a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:13.247026 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_289a14904b5c40c589dd9edaefd30fb2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:13.247546 6456 raft_consensus.cc:359] T 2ccfe6531fc44f86a0edc8bda1547442 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.247706 6456 raft_consensus.cc:385] T 2ccfe6531fc44f86a0edc8bda1547442 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260923 19:50:13.247691 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_289a14904b5c40c589dd9edaefd30fb2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:13.247754 6456 raft_consensus.cc:740] T 2ccfe6531fc44f86a0edc8bda1547442 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.248315 5801 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet b529b0e82c5b48edac54cc281ac4b4a6 (table default.Table_504bdbe9702948d58b4f958360a2040b [id=ca73f0867b5d49cfb0bb7cd2315c47f2]). Expected version 5 got 0
I20260923 19:50:13.248390 6456 consensus_queue.cc:260] T 2ccfe6531fc44f86a0edc8bda1547442 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.249517 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_69a0d472f9674736bf0d2560edc30b20"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:13.250006 6456 ts_tablet_manager.cc:1434] T 2ccfe6531fc44f86a0edc8bda1547442 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260923 19:50:13.250075 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_96b3c6a5fc44408b9118efcd60ce8adb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:13.250545 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_96b3c6a5fc44408b9118efcd60ce8adb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:13.251556 6456 tablet_bootstrap.cc:492] T f1a4bccf6dd2411f83b86d782ecf5f40 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
W20260923 19:50:13.251721 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_69a0d472f9674736bf0d2560edc30b20 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:13.253672 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet 3919b15a00eb4fb08008f065f556c760 with delete_type TABLET_DATA_DELETED (replaced by tablet f74e7cb3e5f54dfdb2280c795ce2ce53) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:13.253774 5798 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet b529b0e82c5b48edac54cc281ac4b4a6 (table default.Table_504bdbe9702948d58b4f958360a2040b [id=ca73f0867b5d49cfb0bb7cd2315c47f2]). Expected version 5 got 0
I20260923 19:50:13.254472 5798 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 0d70deeda179486291195476e47a9ae6 (table default.Table_d130b4b675a14c5a86ff587918d83d7c [id=d1e262e6e34742538b2b26c5fae80a99]). Expected version 1 got 0
I20260923 19:50:13.254671 5798 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 2db82e6f314f412385b41720c7efdef5 (table default.Table_fa1d82a491c04ba89f5cf3162578d550 [id=6d79e588fb9e4936aedf8cd500f68d60]). Expected version 3 got 0
I20260923 19:50:13.256873 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet b8211238627b44468c8461bdc340b1bb
I20260923 19:50:13.257704 6314 tablet_service.cc:1558] Processing DeleteTablet for tablet b8211238627b44468c8461bdc340b1bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:13.257244 6456 tablet_bootstrap.cc:654] T f1a4bccf6dd2411f83b86d782ecf5f40 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.261755 6317 tablet_service.cc:1558] Processing DeleteTablet for tablet cd02244c52ad4d2ab3915108a92a6f97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:13.262055 6314 tablet_service.cc:1558] Processing DeleteTablet for tablet a08446fcf1794dab9d3181904507456f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:13.262326 6178 tablet_service.cc:1558] Processing DeleteTablet for tablet 15c0dc02ba964af38ca9f76161722588 with delete_type TABLET_DATA_DELETED (replaced by tablet 85b7dcf131c54187a6e61f8503c797f8) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:13.262535 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet 194494af2c424a55a772f3858af63c2c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:13.262771 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet b8211238627b44468c8461bdc340b1bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:13.263396 7050 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 19:50:13.265100 7050 hybrid_clock.cc:648] HybridClock initialized: now 1790193013265051 us; error 159 us; skew 500 ppm
I20260923 19:50:13.265563 7050 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260923 19:50:13.268728 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_6b1bf474d973437eabe2b92b3bc9e948"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:13.269464 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b1bf474d973437eabe2b92b3bc9e948 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:13.272113 6461 ts_tablet_manager.cc:1929] T 870db252d8414be7bbe613ea467b5f3a P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:13.273655 6026 tablet_service.cc:1511] Processing CreateTablet for tablet f1157d983bdc42a4a98326154d5f4eb4 (DEFAULT_TABLE table=default.Table_0f07ebb3890d464f8787e3406572d342 [id=89731585826f4c4fb22e0ac4e13ccf46]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.275071 6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1157d983bdc42a4a98326154d5f4eb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.275182 6314 tablet_service.cc:1511] Processing CreateTablet for tablet 42ca4ffede1a472d8917a592fac7f746 (DEFAULT_TABLE table=default.Table_0b6e487ce80a40a992825c27bab24cb2 [id=7fd109d95d1c4d88b0ae69cdbc550eb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.275552 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42ca4ffede1a472d8917a592fac7f746. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.276655 6031 tablet_service.cc:1558] Processing DeleteTablet for tablet c19298691d5d4209b2d1147a1aad2f6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:07 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:13.276830 6022 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a2564a99c274e07a7e43da739a2458b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:13.273851 6030 tablet_service.cc:1558] Processing DeleteTablet for tablet efc63a151f6444dfb03c3f15f6f54473 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:07 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:13.274292 6021 tablet_service.cc:1558] Processing DeleteTablet for tablet edb52bd88b424129bbdc45de89b56efb with delete_type TABLET_DATA_DELETED (replaced by tablet 1f6df2c7b8c34ff2a358acdc58543991) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:13.274562 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet 66739afdf147413787acb0363aa37df6 with delete_type TABLET_DATA_DELETED (replaced by tablet e4ad9baac560463fabc80828074b46c1) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:13.279019 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 42ca4ffede1a472d8917a592fac7f746 (DEFAULT_TABLE table=default.Table_0b6e487ce80a40a992825c27bab24cb2 [id=7fd109d95d1c4d88b0ae69cdbc550eb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.279247 6318 tablet_service.cc:1511] Processing CreateTablet for tablet ab3ebc7b91334209aff6147bfcffcf04 (DEFAULT_TABLE table=default.Table_015ff0f9bdf44e38890887c344423b1f [id=c25ed6cdc4034959b36bd3e69897689d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.279392 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42ca4ffede1a472d8917a592fac7f746. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.279573 6318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab3ebc7b91334209aff6147bfcffcf04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.281734 6317 tablet_service.cc:1511] Processing CreateTablet for tablet e33c94c99b4d442ab639b46179552a68 (DEFAULT_TABLE table=default.Table_665360e7a88a494cb401803f629f9cf3 [id=3a4cb96970234607ac80507cf4fc4ac6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.282186 6021 tablet_service.cc:1511] Processing CreateTablet for tablet e33c94c99b4d442ab639b46179552a68 (DEFAULT_TABLE table=default.Table_665360e7a88a494cb401803f629f9cf3 [id=3a4cb96970234607ac80507cf4fc4ac6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.282267 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e33c94c99b4d442ab639b46179552a68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.282510 6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e33c94c99b4d442ab639b46179552a68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.287856 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet ba4e9fee05994c0d8e7d1f21788280d3
I20260923 19:50:13.288749 7256 raft_consensus.cc:493] T 15c0dc02ba964af38ca9f76161722588 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:13.288889 7256 raft_consensus.cc:515] T 15c0dc02ba964af38ca9f76161722588 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.289417 6030 tablet_service.cc:1558] Processing DeleteTablet for tablet ba4e9fee05994c0d8e7d1f21788280d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:13.289515 7256 leader_election.cc:290] T 15c0dc02ba964af38ca9f76161722588 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:13.290319 6317 tablet_service.cc:1558] Processing DeleteTablet for tablet ba4e9fee05994c0d8e7d1f21788280d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:13.290643 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet ba4e9fee05994c0d8e7d1f21788280d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:13.291067 6279 leader_election.cc:343] T 15c0dc02ba964af38ca9f76161722588 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 15c0dc02ba964af38ca9f76161722588
I20260923 19:50:13.291222 6181 tablet_service.cc:1511] Processing CreateTablet for tablet e33c94c99b4d442ab639b46179552a68 (DEFAULT_TABLE table=default.Table_665360e7a88a494cb401803f629f9cf3 [id=3a4cb96970234607ac80507cf4fc4ac6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.291416 6461 log.cc:1199] T 870db252d8414be7bbe613ea467b5f3a P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/870db252d8414be7bbe613ea467b5f3a
I20260923 19:50:13.291999 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e33c94c99b4d442ab639b46179552a68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.294042 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c0dc02ba964af38ca9f76161722588" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:13.294267 6200 raft_consensus.cc:2468] T 15c0dc02ba964af38ca9f76161722588 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:13.294651 6280 leader_election.cc:304] T 15c0dc02ba964af38ca9f76161722588 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:13.295064 7256 raft_consensus.cc:2804] T 15c0dc02ba964af38ca9f76161722588 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:13.295150 7256 raft_consensus.cc:493] T 15c0dc02ba964af38ca9f76161722588 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:13.295229 7256 raft_consensus.cc:3060] T 15c0dc02ba964af38ca9f76161722588 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:13.295262 6173 tablet_service.cc:1511] Processing CreateTablet for tablet ab3ebc7b91334209aff6147bfcffcf04 (DEFAULT_TABLE table=default.Table_015ff0f9bdf44e38890887c344423b1f [id=c25ed6cdc4034959b36bd3e69897689d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.295912 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab3ebc7b91334209aff6147bfcffcf04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.297477 6461 ts_tablet_manager.cc:1950] T 870db252d8414be7bbe613ea467b5f3a P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:13.297466 5797 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 2ce6378a6bd844a485aebb96081307e3 (table default.Table_4d1a0d71d11f4c0a8c80b3ba7ea0c358 [id=ef9a6c259ceb4c189c8902a776fb3bfa]). Expected version 1 got 0
I20260923 19:50:13.298018 5797 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet b529b0e82c5b48edac54cc281ac4b4a6 (table default.Table_504bdbe9702948d58b4f958360a2040b [id=ca73f0867b5d49cfb0bb7cd2315c47f2]). Expected version 5 got 0
I20260923 19:50:13.297957 7256 raft_consensus.cc:515] T 15c0dc02ba964af38ca9f76161722588 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.298218 5797 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 22e37d5afa8047989928596b4092c4b9 (table default.Table_1141571b3d744e3b922ca1d9745fbadf [id=c0f9d6a40e364dd0ad7ce95fa73b5930]). Expected version 1 got 0
I20260923 19:50:13.299713 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 870db252d8414be7bbe613ea467b5f3a (table default.Table_24178fa82e3c4d878ed35fe32867eb98 [id=450e80ee217e4c6f91172b176cdda58c]) successfully deleted
I20260923 19:50:13.299662 6168 tablet_service.cc:1511] Processing CreateTablet for tablet 42ca4ffede1a472d8917a592fac7f746 (DEFAULT_TABLE table=default.Table_0b6e487ce80a40a992825c27bab24cb2 [id=7fd109d95d1c4d88b0ae69cdbc550eb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.300086 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42ca4ffede1a472d8917a592fac7f746. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.300469 7256 leader_election.cc:290] T 15c0dc02ba964af38ca9f76161722588 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:13.300959 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c0dc02ba964af38ca9f76161722588" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:13.301173 6200 raft_consensus.cc:3060] T 15c0dc02ba964af38ca9f76161722588 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:13.301558 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet b8211238627b44468c8461bdc340b1bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:13.304142 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet a11ecef9a24f4e4a812ec220b6a92cc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:13.304164 6279 leader_election.cc:343] T 15c0dc02ba964af38ca9f76161722588 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 15c0dc02ba964af38ca9f76161722588
I20260923 19:50:13.304346 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 474e34e902064764864ba06ef41b1d94 with delete_type TABLET_DATA_DELETED (replaced by tablet 12bda2ae961446bea2f34e792f4f1706) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:13.304813 6200 raft_consensus.cc:2468] T 15c0dc02ba964af38ca9f76161722588 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:13.305332 6280 leader_election.cc:304] T 15c0dc02ba964af38ca9f76161722588 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:13.305796 7256 raft_consensus.cc:2804] T 15c0dc02ba964af38ca9f76161722588 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:13.306509 7256 raft_consensus.cc:697] T 15c0dc02ba964af38ca9f76161722588 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:13.306831 7256 consensus_queue.cc:237] T 15c0dc02ba964af38ca9f76161722588 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.307303 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_ac3f28e750304261b9514b2f92b3f12a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:13.307906 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac3f28e750304261b9514b2f92b3f12a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:13.308326 7189 raft_consensus.cc:493] T 2db82e6f314f412385b41720c7efdef5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:13.308435 7189 raft_consensus.cc:515] T 2db82e6f314f412385b41720c7efdef5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.308961 7189 leader_election.cc:290] T 2db82e6f314f412385b41720c7efdef5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:13.309667 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db82e6f314f412385b41720c7efdef5" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:13.310218 6280 leader_election.cc:343] T 2db82e6f314f412385b41720c7efdef5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:13.311393 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db82e6f314f412385b41720c7efdef5" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:13.311502 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5fadfa5910764258a5909469ed37ebb7" } modify_external_catalogs: true
I20260923 19:50:13.311594 6060 raft_consensus.cc:2468] T 2db82e6f314f412385b41720c7efdef5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:13.311666 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5fadfa5910764258a5909469ed37ebb7" } modify_external_catalogs: true
I20260923 19:50:13.313174 6279 leader_election.cc:304] T 2db82e6f314f412385b41720c7efdef5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:13.313426 7189 raft_consensus.cc:2804] T 2db82e6f314f412385b41720c7efdef5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:13.313521 7189 raft_consensus.cc:493] T 2db82e6f314f412385b41720c7efdef5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:13.313601 7189 raft_consensus.cc:3060] T 2db82e6f314f412385b41720c7efdef5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:13.314288 5804 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a1862929985946f7b4a445dab5afbab5" } new_table_name: "default.Table_f2eaab6869a44801898602e856f9ef0d" modify_external_catalogs: true
I20260923 19:50:13.314229 5797 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_4cb745719e44465b8bdd1ed8a1e04b8e" } modify_external_catalogs: true
I20260923 19:50:13.315202 5797 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_4cb745719e44465b8bdd1ed8a1e04b8e" } modify_external_catalogs: true
I20260923 19:50:13.316694 7189 raft_consensus.cc:515] T 2db82e6f314f412385b41720c7efdef5 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.317265 7189 leader_election.cc:290] T 2db82e6f314f412385b41720c7efdef5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:13.318248 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db82e6f314f412385b41720c7efdef5" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:13.318436 6060 raft_consensus.cc:3060] T 2db82e6f314f412385b41720c7efdef5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:13.319331 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_56a69b63c77e409183883ea97ef06328"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:13.319929 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56a69b63c77e409183883ea97ef06328 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:13.321121 5801 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a4db4b4f4a6b45eabe9a2ae50186a32c" } modify_external_catalogs: true
I20260923 19:50:13.321214 6060 raft_consensus.cc:2468] T 2db82e6f314f412385b41720c7efdef5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:13.321271 5801 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a4db4b4f4a6b45eabe9a2ae50186a32c" } modify_external_catalogs: true
I20260923 19:50:13.322857 6279 leader_election.cc:304] T 2db82e6f314f412385b41720c7efdef5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:13.323170 7189 raft_consensus.cc:2804] T 2db82e6f314f412385b41720c7efdef5 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:13.323640 7189 raft_consensus.cc:697] T 2db82e6f314f412385b41720c7efdef5 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:13.323859 6459 ts_tablet_manager.cc:1929] T 337f32eb47954689a6eb8f74408e01d9 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:13.323990 7189 consensus_queue.cc:237] T 2db82e6f314f412385b41720c7efdef5 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.329978 6459 log.cc:1199] T 337f32eb47954689a6eb8f74408e01d9 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/337f32eb47954689a6eb8f74408e01d9
I20260923 19:50:13.330838 6459 ts_tablet_manager.cc:1950] T 337f32eb47954689a6eb8f74408e01d9 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:13.331245 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ccfe6531fc44f86a0edc8bda1547442 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:13.325268 6454 tablet_bootstrap.cc:492] T 2db82e6f314f412385b41720c7efdef5 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:13.334470 6454 ts_tablet_manager.cc:1403] T 2db82e6f314f412385b41720c7efdef5 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.138s user 0.004s sys 0.000s
I20260923 19:50:13.335902 6454 raft_consensus.cc:359] T 2db82e6f314f412385b41720c7efdef5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.336351 6454 raft_consensus.cc:385] T 2db82e6f314f412385b41720c7efdef5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.336464 6454 raft_consensus.cc:740] T 2db82e6f314f412385b41720c7efdef5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.336969 7134 raft_consensus.cc:493] T efc63a151f6444dfb03c3f15f6f54473 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:13.337141 7134 raft_consensus.cc:515] T efc63a151f6444dfb03c3f15f6f54473 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.338021 7134 leader_election.cc:290] T efc63a151f6444dfb03c3f15f6f54473 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:13.341132 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc63a151f6444dfb03c3f15f6f54473" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:13.341975 5996 leader_election.cc:343] T efc63a151f6444dfb03c3f15f6f54473 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:13.342581 6461 tablet_replica.cc:333] T 0e123b69877e4b1fbcdb2b27960864e9 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:13.342604 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc63a151f6444dfb03c3f15f6f54473" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:13.342792 6461 raft_consensus.cc:2243] T 0e123b69877e4b1fbcdb2b27960864e9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:13.342949 6461 raft_consensus.cc:2272] T 0e123b69877e4b1fbcdb2b27960864e9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:13.343323 5995 leader_election.cc:343] T efc63a151f6444dfb03c3f15f6f54473 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:13.343422 5995 leader_election.cc:304] T efc63a151f6444dfb03c3f15f6f54473 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:13.343470 6461 ts_tablet_manager.cc:1916] T 0e123b69877e4b1fbcdb2b27960864e9 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:13.343763 7134 raft_consensus.cc:2749] T efc63a151f6444dfb03c3f15f6f54473 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:13.351078 7244 raft_consensus.cc:493] T 31b0bdf719554d37993a802831e324ee P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:13.351289 7244 raft_consensus.cc:515] T 31b0bdf719554d37993a802831e324ee P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.352177 7244 leader_election.cc:290] T 31b0bdf719554d37993a802831e324ee P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:13.353502 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b0bdf719554d37993a802831e324ee" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:13.353699 6343 raft_consensus.cc:2468] T 31b0bdf719554d37993a802831e324ee P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:13.354257 6461 ts_tablet_manager.cc:1929] T 0e123b69877e4b1fbcdb2b27960864e9 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:13.354338 6139 leader_election.cc:304] T 31b0bdf719554d37993a802831e324ee P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
W20260923 19:50:13.355237 6137 leader_election.cc:343] T 31b0bdf719554d37993a802831e324ee P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 31b0bdf719554d37993a802831e324ee
I20260923 19:50:13.355736 7244 raft_consensus.cc:2804] T 31b0bdf719554d37993a802831e324ee P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:13.355830 7244 raft_consensus.cc:493] T 31b0bdf719554d37993a802831e324ee P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:13.355911 7244 raft_consensus.cc:3060] T 31b0bdf719554d37993a802831e324ee P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:13.356336 6461 log.cc:1199] T 0e123b69877e4b1fbcdb2b27960864e9 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/0e123b69877e4b1fbcdb2b27960864e9
I20260923 19:50:13.356642 6461 ts_tablet_manager.cc:1950] T 0e123b69877e4b1fbcdb2b27960864e9 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:13.357491 6461 tablet_replica.cc:333] T b92aaac328934d95a89e0fc08a80b0b1 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:13.359338 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet c212b069c3f740ecac403c99d93de7d9
I20260923 19:50:13.361119 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet c212b069c3f740ecac403c99d93de7d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:13.362382 7189 raft_consensus.cc:493] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:13.362600 7189 raft_consensus.cc:515] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.364104 7244 raft_consensus.cc:515] T 31b0bdf719554d37993a802831e324ee P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.364737 7189 leader_election.cc:290] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:13.364820 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d70deeda179486291195476e47a9ae6" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:13.362771 6461 raft_consensus.cc:2243] T b92aaac328934d95a89e0fc08a80b0b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260923 19:50:13.365510 6280 leader_election.cc:343] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:13.367274 5804 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2d6762b369d3496083947a4a47a51868 consensus state has no leader
I20260923 19:50:13.367695 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_7f31586785874f0995ea2cb31c2796e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:13.368530 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 559f3e3016aa470f9732a727b4528586 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 559f3e3016aa470f9732a727b4528586 already in progress: creating tablet
I20260923 19:50:13.370325 6458 ts_tablet_manager.cc:1929] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:13.370417 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 11e0f1c645184da19ce11927e1d562c3 (DEFAULT_TABLE table=default.Table_08afceb3d6d0424281def7649bc0a3e4 [id=624a7fc755ec49199ea40cd2cea7a4f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.371095 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11e0f1c645184da19ce11927e1d562c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.371935 6173 tablet_service.cc:1558] Processing DeleteTablet for tablet c212b069c3f740ecac403c99d93de7d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:13.370440 6458 log.cc:1199] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/359b08ef348d4be68b14f9e871a5e519
I20260923 19:50:13.372486 6458 ts_tablet_manager.cc:1950] T 359b08ef348d4be68b14f9e871a5e519 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:13.373248 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 512) took 2149 ms. Trace:
I20260923 19:50:13.373328 6458 rpcz_store.cc:276] 0923 19:50:11.223722 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:11.223775 (+ 53us) service_pool.cc:224] Handling call
0923 19:50:13.193737 (+1969962us) ts_tablet_manager.cc:1151] Deleting tablet 359b08ef348d4be68b14f9e871a5e519
0923 19:50:13.193748 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.341894 (+148146us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:13.370258 (+ 28364us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:13.373228 (+ 2970us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1968351}
I20260923 19:50:13.373680 6458 tablet_replica.cc:333] T 6e781ccf4aa343fc924138c3cc2b04e6 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:13.373864 6458 raft_consensus.cc:2243] T 6e781ccf4aa343fc924138c3cc2b04e6 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:13.374074 6458 raft_consensus.cc:2272] T 6e781ccf4aa343fc924138c3cc2b04e6 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:13.374768 6458 ts_tablet_manager.cc:1916] T 6e781ccf4aa343fc924138c3cc2b04e6 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:13.375445 6137 leader_election.cc:343] T 31b0bdf719554d37993a802831e324ee P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 31b0bdf719554d37993a802831e324ee
I20260923 19:50:13.376775 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b0bdf719554d37993a802831e324ee" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:13.376938 6343 raft_consensus.cc:3060] T 31b0bdf719554d37993a802831e324ee P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
W20260923 19:50:13.378578 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f31586785874f0995ea2cb31c2796e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:13.380160 6343 raft_consensus.cc:2468] T 31b0bdf719554d37993a802831e324ee P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:13.380772 6139 leader_election.cc:304] T 31b0bdf719554d37993a802831e324ee P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:13.381098 7148 raft_consensus.cc:2804] T 31b0bdf719554d37993a802831e324ee P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:13.381206 7148 raft_consensus.cc:697] T 31b0bdf719554d37993a802831e324ee P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:13.381448 7148 consensus_queue.cc:237] T 31b0bdf719554d37993a802831e324ee P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.385424 6461 raft_consensus.cc:2272] T b92aaac328934d95a89e0fc08a80b0b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:13.386124 6461 ts_tablet_manager.cc:1916] T b92aaac328934d95a89e0fc08a80b0b1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:13.318113 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db82e6f314f412385b41720c7efdef5" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:13.369519 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet c212b069c3f740ecac403c99d93de7d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:13.365787 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d70deeda179486291195476e47a9ae6" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:13.389951 6060 raft_consensus.cc:2468] T 0d70deeda179486291195476e47a9ae6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:13.390758 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 0e123b69877e4b1fbcdb2b27960864e9 (table default.Table_0562db93b14243108d8731231ae538c1 [id=74e85060f50e45069c378e7fd4cc7dba]) successfully deleted
I20260923 19:50:13.391098 5801 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet ba0453ef529344dfbab1130daa985fef
I20260923 19:50:13.393132 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 359b08ef348d4be68b14f9e871a5e519 (table default.Table_91a9675177604eb39c32e86718c59d31 [id=bf85ae2ea4884de58391fc9e7b140b7f]) successfully deleted
I20260923 19:50:13.393253 6168 tablet_service.cc:1511] Processing CreateTablet for tablet 11e0f1c645184da19ce11927e1d562c3 (DEFAULT_TABLE table=default.Table_08afceb3d6d0424281def7649bc0a3e4 [id=624a7fc755ec49199ea40cd2cea7a4f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.396730 6279 leader_election.cc:304] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:13.397185 7256 raft_consensus.cc:2804] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:13.397290 7256 raft_consensus.cc:493] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:13.397382 7256 raft_consensus.cc:3060] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:13.399142 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11e0f1c645184da19ce11927e1d562c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.400403 7256 raft_consensus.cc:515] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.402323 7256 leader_election.cc:290] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:13.402629 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d70deeda179486291195476e47a9ae6" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
W20260923 19:50:13.403242 6280 leader_election.cc:343] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:13.403563 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d70deeda179486291195476e47a9ae6" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:13.403779 6060 raft_consensus.cc:3060] T 0d70deeda179486291195476e47a9ae6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:13.403822 6314 tablet_service.cc:1511] Processing CreateTablet for tablet 7e8facf019054ac79fea193f44fc6742 (DEFAULT_TABLE table=default.Table_a9b0868c631e4f55a22ad70293408696 [id=9e4ea82969a54607b4ca2f0a2a2b038e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.403995 6318 tablet_service.cc:1511] Processing CreateTablet for tablet 3ad17f4d65784842a4dd2f5a5d06393a (DEFAULT_TABLE table=default.Table_2e5272f3f9b443fbbbb342873d0065b6 [id=95e573be50c34d55b24728bedbafe4a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.404217 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e8facf019054ac79fea193f44fc6742. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.405180 6318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ad17f4d65784842a4dd2f5a5d06393a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.409529 6317 tablet_service.cc:1511] Processing CreateTablet for tablet bec98cea4c254d5c9186acbbc7212159 (DEFAULT_TABLE table=default.Table_07770b1d25f549b5bda7cb16b2dde82c [id=882f11a7d8af488498feee5304dbc6ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.409770 6060 raft_consensus.cc:2468] T 0d70deeda179486291195476e47a9ae6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:13.409950 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bec98cea4c254d5c9186acbbc7212159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.410669 6169 tablet_service.cc:1511] Processing CreateTablet for tablet 3ad17f4d65784842a4dd2f5a5d06393a (DEFAULT_TABLE table=default.Table_2e5272f3f9b443fbbbb342873d0065b6 [id=95e573be50c34d55b24728bedbafe4a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.410838 6279 leader_election.cc:304] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:13.411018 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ad17f4d65784842a4dd2f5a5d06393a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.411461 7256 raft_consensus.cc:2804] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:13.411674 7256 raft_consensus.cc:697] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:13.412034 7256 consensus_queue.cc:237] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.415438 7244 leader_election.cc:290] T 31b0bdf719554d37993a802831e324ee P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:13.417002 6454 consensus_queue.cc:260] T 2db82e6f314f412385b41720c7efdef5 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.417276 6200 raft_consensus.cc:3060] T 2db82e6f314f412385b41720c7efdef5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:13.418182 6310 tablet_service.cc:1511] Processing CreateTablet for tablet dadb3ab2082b4f749182b0616cf6e8f5 (DEFAULT_TABLE table=default.Table_ef9d322446c04ecca302603e02b14fe8 [id=ba165772135449db85295eae1c83ec5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.418601 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dadb3ab2082b4f749182b0616cf6e8f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.419389 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet ba0453ef529344dfbab1130daa985fef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:13.402534 6456 tablet_bootstrap.cc:492] T f1a4bccf6dd2411f83b86d782ecf5f40 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:13.420357 6200 raft_consensus.cc:2468] T 2db82e6f314f412385b41720c7efdef5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:13.420559 6456 ts_tablet_manager.cc:1403] T f1a4bccf6dd2411f83b86d782ecf5f40 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.169s user 0.009s sys 0.013s
I20260923 19:50:13.421384 6456 raft_consensus.cc:359] T f1a4bccf6dd2411f83b86d782ecf5f40 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.421654 6456 raft_consensus.cc:385] T f1a4bccf6dd2411f83b86d782ecf5f40 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.421775 6456 raft_consensus.cc:740] T f1a4bccf6dd2411f83b86d782ecf5f40 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.422083 6456 consensus_queue.cc:260] T f1a4bccf6dd2411f83b86d782ecf5f40 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.422452 6454 ts_tablet_manager.cc:1434] T 2db82e6f314f412385b41720c7efdef5 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.088s user 0.002s sys 0.000s
I20260923 19:50:13.422986 6456 ts_tablet_manager.cc:1434] T f1a4bccf6dd2411f83b86d782ecf5f40 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:13.423326 6456 tablet_bootstrap.cc:492] T 623052a8c9c2436a828655da6cf6d379 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:13.424196 7244 raft_consensus.cc:493] T b529b0e82c5b48edac54cc281ac4b4a6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:13.424324 7244 raft_consensus.cc:515] T b529b0e82c5b48edac54cc281ac4b4a6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.425796 6457 tablet_bootstrap.cc:492] T d09faa67bdc54d31a7f7a1b012de9ba1 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:13.425982 6457 ts_tablet_manager.cc:1403] T d09faa67bdc54d31a7f7a1b012de9ba1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.223s user 0.001s sys 0.007s
I20260923 19:50:13.425952 6173 tablet_service.cc:1511] Processing CreateTablet for tablet 7e8facf019054ac79fea193f44fc6742 (DEFAULT_TABLE table=default.Table_a9b0868c631e4f55a22ad70293408696 [id=9e4ea82969a54607b4ca2f0a2a2b038e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.426327 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e8facf019054ac79fea193f44fc6742. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.426731 6457 raft_consensus.cc:359] T d09faa67bdc54d31a7f7a1b012de9ba1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.426911 6457 raft_consensus.cc:385] T d09faa67bdc54d31a7f7a1b012de9ba1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.426965 6457 raft_consensus.cc:740] T d09faa67bdc54d31a7f7a1b012de9ba1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.427171 6457 consensus_queue.cc:260] T d09faa67bdc54d31a7f7a1b012de9ba1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.427611 6457 ts_tablet_manager.cc:1434] T d09faa67bdc54d31a7f7a1b012de9ba1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:13.427897 6457 tablet_bootstrap.cc:492] T 035abecfbee7474d9dd048f35e28e867 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:13.429162 6456 tablet_bootstrap.cc:654] T 623052a8c9c2436a828655da6cf6d379 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.429602 6457 tablet_bootstrap.cc:654] T 035abecfbee7474d9dd048f35e28e867 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.443765 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b529b0e82c5b48edac54cc281ac4b4a6" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:13.444190 6457 tablet_bootstrap.cc:492] T 035abecfbee7474d9dd048f35e28e867 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:13.444499 6457 ts_tablet_manager.cc:1403] T 035abecfbee7474d9dd048f35e28e867 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.007s
I20260923 19:50:13.444856 6454 tablet_bootstrap.cc:492] T 0d70deeda179486291195476e47a9ae6 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:13.445438 6457 raft_consensus.cc:359] T 035abecfbee7474d9dd048f35e28e867 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.445680 6457 raft_consensus.cc:385] T 035abecfbee7474d9dd048f35e28e867 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.445787 6457 raft_consensus.cc:740] T 035abecfbee7474d9dd048f35e28e867 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.445938 6028 tablet_service.cc:1511] Processing CreateTablet for tablet ab3ebc7b91334209aff6147bfcffcf04 (DEFAULT_TABLE table=default.Table_015ff0f9bdf44e38890887c344423b1f [id=c25ed6cdc4034959b36bd3e69897689d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.446132 6457 consensus_queue.cc:260] T 035abecfbee7474d9dd048f35e28e867 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.446511 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab3ebc7b91334209aff6147bfcffcf04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.446619 6026 tablet_service.cc:1511] Processing CreateTablet for tablet 7e8facf019054ac79fea193f44fc6742 (DEFAULT_TABLE table=default.Table_a9b0868c631e4f55a22ad70293408696 [id=9e4ea82969a54607b4ca2f0a2a2b038e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.446873 6457 ts_tablet_manager.cc:1434] T 035abecfbee7474d9dd048f35e28e867 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260923 19:50:13.446930 6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e8facf019054ac79fea193f44fc6742. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.448577 6457 tablet_bootstrap.cc:492] T 9be4c46ee8eb4dbaad01d492b701a9e0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:13.448457 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b529b0e82c5b48edac54cc281ac4b4a6" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:13.449527 6139 leader_election.cc:304] T b529b0e82c5b48edac54cc281ac4b4a6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:13.449905 7239 raft_consensus.cc:2749] T b529b0e82c5b48edac54cc281ac4b4a6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:13.450138 6021 tablet_service.cc:1511] Processing CreateTablet for tablet bec98cea4c254d5c9186acbbc7212159 (DEFAULT_TABLE table=default.Table_07770b1d25f549b5bda7cb16b2dde82c [id=882f11a7d8af488498feee5304dbc6ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.450367 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 11e0f1c645184da19ce11927e1d562c3 (DEFAULT_TABLE table=default.Table_08afceb3d6d0424281def7649bc0a3e4 [id=624a7fc755ec49199ea40cd2cea7a4f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.450541 6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bec98cea4c254d5c9186acbbc7212159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.450698 6457 tablet_bootstrap.cc:654] T 9be4c46ee8eb4dbaad01d492b701a9e0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.450763 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet ba0453ef529344dfbab1130daa985fef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:13.451143 6169 tablet_service.cc:1511] Processing CreateTablet for tablet dadb3ab2082b4f749182b0616cf6e8f5 (DEFAULT_TABLE table=default.Table_ef9d322446c04ecca302603e02b14fe8 [id=ba165772135449db85295eae1c83ec5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.451506 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dadb3ab2082b4f749182b0616cf6e8f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.451807 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11e0f1c645184da19ce11927e1d562c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.454173 6030 tablet_service.cc:1511] Processing CreateTablet for tablet dadb3ab2082b4f749182b0616cf6e8f5 (DEFAULT_TABLE table=default.Table_ef9d322446c04ecca302603e02b14fe8 [id=ba165772135449db85295eae1c83ec5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.454253 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 96a00813b52944d19075cee6cf0f708e (DEFAULT_TABLE table=default.Table_0ec899ce5bf64ab2b558e12b3c41133d [id=ac79b30c41274617bdd30d9c6c2e0ecd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.454519 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dadb3ab2082b4f749182b0616cf6e8f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.454572 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96a00813b52944d19075cee6cf0f708e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.457516 6456 tablet_bootstrap.cc:492] T 623052a8c9c2436a828655da6cf6d379 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:13.457667 6456 ts_tablet_manager.cc:1403] T 623052a8c9c2436a828655da6cf6d379 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.034s user 0.001s sys 0.004s
I20260923 19:50:13.443303 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_bf259d1800344a87933c314d8362033f" } new_table_name: "default.Table_15c935c5fb8f497aaea93e214d5a6843" modify_external_catalogs: true
I20260923 19:50:13.459928 6456 raft_consensus.cc:359] T 623052a8c9c2436a828655da6cf6d379 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.460139 6456 raft_consensus.cc:385] T 623052a8c9c2436a828655da6cf6d379 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.460208 6456 raft_consensus.cc:740] T 623052a8c9c2436a828655da6cf6d379 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.460448 6456 consensus_queue.cc:260] T 623052a8c9c2436a828655da6cf6d379 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.461222 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a479e36e3d0146cd99a8f7479236e5ea" } new_table_name: "default.Table_c249eef0ba2046fba3b52297ffb6d16c" modify_external_catalogs: true
I20260923 19:50:13.463155 6456 ts_tablet_manager.cc:1434] T 623052a8c9c2436a828655da6cf6d379 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260923 19:50:13.450138 6032 tablet_service.cc:1511] Processing CreateTablet for tablet 3ad17f4d65784842a4dd2f5a5d06393a (DEFAULT_TABLE table=default.Table_2e5272f3f9b443fbbbb342873d0065b6 [id=95e573be50c34d55b24728bedbafe4a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.465267 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ad17f4d65784842a4dd2f5a5d06393a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:13.466375 6137 consensus_peers.cc:597] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2f627b7b9ff74750bd8dd59840bf77db. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:13.466796 7244 leader_election.cc:290] T b529b0e82c5b48edac54cc281ac4b4a6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:13.467895 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet ba0453ef529344dfbab1130daa985fef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:13.468436 6458 ts_tablet_manager.cc:1929] T 6e781ccf4aa343fc924138c3cc2b04e6 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:13.468542 6458 log.cc:1199] T 6e781ccf4aa343fc924138c3cc2b04e6 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/6e781ccf4aa343fc924138c3cc2b04e6
I20260923 19:50:13.468972 6458 ts_tablet_manager.cc:1950] T 6e781ccf4aa343fc924138c3cc2b04e6 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:13.469727 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 525) took 2121 ms. Trace:
I20260923 19:50:13.469756 6454 tablet_bootstrap.cc:654] T 0d70deeda179486291195476e47a9ae6 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.470923 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 573) took 1428 ms. Trace:
I20260923 19:50:13.471011 6459 rpcz_store.cc:276] 0923 19:50:12.042118 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:12.042920 (+ 802us) service_pool.cc:224] Handling call
0923 19:50:13.180540 (+1137620us) ts_tablet_manager.cc:1151] Deleting tablet 337f32eb47954689a6eb8f74408e01d9
0923 19:50:13.180553 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.191532 (+ 10979us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:13.323796 (+132264us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:13.470903 (+147107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1057491}
I20260923 19:50:13.471449 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 575) took 1429 ms. Trace:
I20260923 19:50:13.471529 6459 rpcz_store.cc:276] 0923 19:50:12.042360 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:12.042787 (+ 427us) service_pool.cc:224] Handling call
0923 19:50:13.471312 (+1428525us) ts_tablet_manager.cc:1151] Deleting tablet 772ece5283a949408d849f6e56f5f17b
0923 19:50:13.471322 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.471431 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1344008}
I20260923 19:50:13.471846 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 576) took 1429 ms. Trace:
I20260923 19:50:13.471906 6459 rpcz_store.cc:276] 0923 19:50:12.042464 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:12.042814 (+ 350us) service_pool.cc:224] Handling call
0923 19:50:13.471742 (+1428928us) ts_tablet_manager.cc:1151] Deleting tablet ecd91bf5bd9447c0bb20ba43573ff08d
0923 19:50:13.471750 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.471832 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1344206}
I20260923 19:50:13.472136 6459 tablet_replica.cc:333] T f108ebdaecab42e7b57057c7ecfbe690 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:13.472303 6459 raft_consensus.cc:2243] T f108ebdaecab42e7b57057c7ecfbe690 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:13.472503 6459 raft_consensus.cc:2272] T f108ebdaecab42e7b57057c7ecfbe690 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:13.474391 6456 tablet_bootstrap.cc:492] T b985acc650334497832cf4505e1b0043 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:13.477514 6168 tablet_service.cc:1511] Processing CreateTablet for tablet bec98cea4c254d5c9186acbbc7212159 (DEFAULT_TABLE table=default.Table_07770b1d25f549b5bda7cb16b2dde82c [id=882f11a7d8af488498feee5304dbc6ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.477949 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bec98cea4c254d5c9186acbbc7212159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.469817 6458 rpcz_store.cc:276] 0923 19:50:11.348762 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:11.348990 (+ 228us) service_pool.cc:224] Handling call
0923 19:50:13.373636 (+2024646us) ts_tablet_manager.cc:1151] Deleting tablet 6e781ccf4aa343fc924138c3cc2b04e6
0923 19:50:13.373645 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.465383 (+ 91738us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:13.468384 (+ 3001us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:13.469708 (+ 1324us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2023901}
I20260923 19:50:13.482697 6458 tablet_replica.cc:333] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:13.482887 6458 raft_consensus.cc:2243] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:13.483152 6458 pending_rounds.cc:70] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd: Trying to abort 1 pending ops.
I20260923 19:50:13.483208 6458 pending_rounds.cc:77] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630577236729856 op_type: NO_OP noop_request { }
I20260923 19:50:13.483305 6458 raft_consensus.cc:2889] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:13.483388 6458 raft_consensus.cc:2272] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:13.483914 6458 ts_tablet_manager.cc:1916] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:13.484977 6456 tablet_bootstrap.cc:654] T b985acc650334497832cf4505e1b0043 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.486553 6457 tablet_bootstrap.cc:492] T 9be4c46ee8eb4dbaad01d492b701a9e0 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:13.486703 6457 ts_tablet_manager.cc:1403] T 9be4c46ee8eb4dbaad01d492b701a9e0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.038s user 0.004s sys 0.000s
I20260923 19:50:13.487469 6457 raft_consensus.cc:359] T 9be4c46ee8eb4dbaad01d492b701a9e0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.487665 6457 raft_consensus.cc:385] T 9be4c46ee8eb4dbaad01d492b701a9e0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.487761 6457 raft_consensus.cc:740] T 9be4c46ee8eb4dbaad01d492b701a9e0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.487994 6457 consensus_queue.cc:260] T 9be4c46ee8eb4dbaad01d492b701a9e0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.488852 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 337f32eb47954689a6eb8f74408e01d9 (table default.Table_c80b112b6ce9402f87b07ee8a6e1b78b [id=f509f74bbf6b4b6381509c265432cbd7]) successfully deleted
I20260923 19:50:13.489444 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ef9d322446c04ecca302603e02b14fe8" } new_table_name: "default.Table_118d48fa59bb4a43a18182adeab5ca66" modify_external_catalogs: true
I20260923 19:50:13.490818 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_7ce588248ce944fc878bbe47bbbbc8fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:13.492987 6457 ts_tablet_manager.cc:1434] T 9be4c46ee8eb4dbaad01d492b701a9e0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260923 19:50:13.493002 5804 master_service.cc:960] ReplaceTablet: received request to replace tablet 9be4c46ee8eb4dbaad01d492b701a9e0 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:13.489117 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 6e781ccf4aa343fc924138c3cc2b04e6 (table default.Table_973ceea94f2e4c6da7b1c722b99ac413 [id=c9f541017259420e858a2982f3e32141]) successfully deleted
I20260923 19:50:13.493721 6457 tablet_bootstrap.cc:492] T 5e711e48156b46b5a517b330d6d41309 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:13.493752 6458 ts_tablet_manager.cc:1929] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:13.493854 6458 log.cc:1199] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/daafbafae5004b8499e7ea93342c0517
I20260923 19:50:13.494271 6458 ts_tablet_manager.cc:1950] T daafbafae5004b8499e7ea93342c0517 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:13.495995 6457 tablet_bootstrap.cc:654] T 5e711e48156b46b5a517b330d6d41309 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.500133 6456 tablet_bootstrap.cc:492] T b985acc650334497832cf4505e1b0043 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:13.500283 6456 ts_tablet_manager.cc:1403] T b985acc650334497832cf4505e1b0043 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.026s user 0.000s sys 0.002s
I20260923 19:50:13.501101 6456 raft_consensus.cc:359] T b985acc650334497832cf4505e1b0043 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.501271 6456 raft_consensus.cc:385] T b985acc650334497832cf4505e1b0043 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.501328 6456 raft_consensus.cc:740] T b985acc650334497832cf4505e1b0043 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.504155 6456 consensus_queue.cc:260] T b985acc650334497832cf4505e1b0043 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.505447 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ac3f28e750304261b9514b2f92b3f12a" } modify_external_catalogs: true
I20260923 19:50:13.505513 6456 ts_tablet_manager.cc:1434] T b985acc650334497832cf4505e1b0043 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260923 19:50:13.506160 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 528) took 2148 ms. Trace:
I20260923 19:50:13.506714 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 96a00813b52944d19075cee6cf0f708e (DEFAULT_TABLE table=default.Table_0ec899ce5bf64ab2b558e12b3c41133d [id=ac79b30c41274617bdd30d9c6c2e0ecd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.506242 6458 rpcz_store.cc:276] 0923 19:50:11.357209 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:11.357801 (+ 592us) service_pool.cc:224] Handling call
0923 19:50:13.482640 (+2124839us) ts_tablet_manager.cc:1151] Deleting tablet daafbafae5004b8499e7ea93342c0517
0923 19:50:13.482653 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.490047 (+ 7394us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:13.493690 (+ 3643us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:13.506139 (+ 12449us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24192,"tablet-delete.queue_time_us":2124302}
I20260923 19:50:13.507891 6456 tablet_bootstrap.cc:492] T 1c26a2863fdd4912b6d357877af1eb42 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:13.507933 6458 tablet_replica.cc:333] T 31b0bdf719554d37993a802831e324ee P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:13.508090 6458 raft_consensus.cc:2243] T 31b0bdf719554d37993a802831e324ee P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:13.508164 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96a00813b52944d19075cee6cf0f708e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.508221 6458 raft_consensus.cc:2272] T 31b0bdf719554d37993a802831e324ee P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:13.508728 6458 ts_tablet_manager.cc:1916] T 31b0bdf719554d37993a802831e324ee P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:13.510033 6456 tablet_bootstrap.cc:654] T 1c26a2863fdd4912b6d357877af1eb42 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.511487 6457 tablet_bootstrap.cc:492] T 5e711e48156b46b5a517b330d6d41309 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:13.511646 6457 ts_tablet_manager.cc:1403] T 5e711e48156b46b5a517b330d6d41309 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20260923 19:50:13.512475 6457 raft_consensus.cc:359] T 5e711e48156b46b5a517b330d6d41309 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.512637 6457 raft_consensus.cc:385] T 5e711e48156b46b5a517b330d6d41309 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.512682 6457 raft_consensus.cc:740] T 5e711e48156b46b5a517b330d6d41309 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.512874 6457 consensus_queue.cc:260] T 5e711e48156b46b5a517b330d6d41309 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.521229 6457 ts_tablet_manager.cc:1434] T 5e711e48156b46b5a517b330d6d41309 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260923 19:50:13.521710 6457 tablet_bootstrap.cc:492] T 6238d16b1be74dd88fd2e089fbd85d33 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:13.522292 6458 ts_tablet_manager.cc:1929] T 31b0bdf719554d37993a802831e324ee P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:13.522401 6458 log.cc:1199] T 31b0bdf719554d37993a802831e324ee P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/31b0bdf719554d37993a802831e324ee
I20260923 19:50:13.522680 6458 ts_tablet_manager.cc:1950] T 31b0bdf719554d37993a802831e324ee P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:13.523694 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 527) took 2166 ms. Trace:
I20260923 19:50:13.523790 6458 rpcz_store.cc:276] 0923 19:50:11.357097 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:11.358373 (+ 1276us) service_pool.cc:224] Handling call
0923 19:50:13.507065 (+2148692us) ts_tablet_manager.cc:1151] Deleting tablet 31b0bdf719554d37993a802831e324ee
0923 19:50:13.507890 (+ 825us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.513503 (+ 5613us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:13.522235 (+ 8732us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:13.523676 (+ 1441us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2148453}
I20260923 19:50:13.524114 6458 tablet_replica.cc:333] T f108ebdaecab42e7b57057c7ecfbe690 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:13.524281 6458 raft_consensus.cc:2243] T f108ebdaecab42e7b57057c7ecfbe690 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:13.524699 6457 tablet_bootstrap.cc:654] T 6238d16b1be74dd88fd2e089fbd85d33 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.526013 6458 raft_consensus.cc:2272] T f108ebdaecab42e7b57057c7ecfbe690 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:13.527216 6458 ts_tablet_manager.cc:1916] T f108ebdaecab42e7b57057c7ecfbe690 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:13.534685 6456 tablet_bootstrap.cc:492] T 1c26a2863fdd4912b6d357877af1eb42 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:13.534832 6456 ts_tablet_manager.cc:1403] T 1c26a2863fdd4912b6d357877af1eb42 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.027s user 0.000s sys 0.002s
I20260923 19:50:13.535005 5799 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_96b3c6a5fc44408b9118efcd60ce8adb" } new_table_name: "default.Table_badfa4e207ea4a70a06abfaa9bbeda76" modify_external_catalogs: true
I20260923 19:50:13.535174 7211 raft_consensus.cc:493] T 6a2564a99c274e07a7e43da739a2458b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:13.535300 7211 raft_consensus.cc:515] T 6a2564a99c274e07a7e43da739a2458b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.535861 7211 leader_election.cc:290] T 6a2564a99c274e07a7e43da739a2458b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:13.536408 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_63c5836d0ca149f3b6b24a23873e0ecc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:13.536624 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2564a99c274e07a7e43da739a2458b" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:13.536966 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63c5836d0ca149f3b6b24a23873e0ecc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:13.537336 5995 leader_election.cc:343] T 6a2564a99c274e07a7e43da739a2458b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:13.538029 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 772ece5283a949408d849f6e56f5f17b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 772ece5283a949408d849f6e56f5f17b already in progress: creating tablet
I20260923 19:50:13.537986 6456 raft_consensus.cc:359] T 1c26a2863fdd4912b6d357877af1eb42 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.538131 6456 raft_consensus.cc:385] T 1c26a2863fdd4912b6d357877af1eb42 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.538178 6456 raft_consensus.cc:740] T 1c26a2863fdd4912b6d357877af1eb42 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
W20260923 19:50:13.538192 5791 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 49105.8us
W20260923 19:50:13.538427 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet ecd91bf5bd9447c0bb20ba43573ff08d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ecd91bf5bd9447c0bb20ba43573ff08d already in progress: creating tablet
I20260923 19:50:13.538415 6456 consensus_queue.cc:260] T 1c26a2863fdd4912b6d357877af1eb42 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.539347 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_be2d57dc97394f3a9f8b723a664793ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:13.539692 6169 tablet_service.cc:1511] Processing CreateTablet for tablet 391465b6abc24ba9b23f22fe212006eb (DEFAULT_TABLE table=default.Table_aace4bdffc84478db1c7cca8eb7be0be [id=e3257938a4544cbdb30b4cab70383e77]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:13.539850 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_be2d57dc97394f3a9f8b723a664793ff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:13.539942 6456 ts_tablet_manager.cc:1434] T 1c26a2863fdd4912b6d357877af1eb42 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260923 19:50:13.540120 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2564a99c274e07a7e43da739a2458b" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:13.540215 6456 tablet_bootstrap.cc:492] T 235b4b8081ad4a13937a7941344dbc33 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:13.540722 6181 tablet_service.cc:1511] Processing CreateTablet for tablet fc71e2911b9e4d1eb3fcebe7d1e4d96c (DEFAULT_TABLE table=default.Table_0275ce58991948e781ef59d63b7ce7e9 [id=d7ef1bb9da9d4941a6b031d074cdaaa0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:13.540917 5996 leader_election.cc:343] T 6a2564a99c274e07a7e43da739a2458b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:13.541023 5996 leader_election.cc:304] T 6a2564a99c274e07a7e43da739a2458b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:13.541123 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 391465b6abc24ba9b23f22fe212006eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.541249 7211 raft_consensus.cc:2749] T 6a2564a99c274e07a7e43da739a2458b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:13.543318 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7ce588248ce944fc878bbe47bbbbc8fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:13.543803 6456 tablet_bootstrap.cc:654] T 235b4b8081ad4a13937a7941344dbc33 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:13.545037 5790 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.143.254:37151: connect: Connection refused (error 111) [suppressed 9 similar messages]
I20260923 19:50:13.545342 7211 raft_consensus.cc:493] T a11ecef9a24f4e4a812ec220b6a92cc4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:13.545485 7211 raft_consensus.cc:515] T a11ecef9a24f4e4a812ec220b6a92cc4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.546234 7211 leader_election.cc:290] T a11ecef9a24f4e4a812ec220b6a92cc4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:13.547559 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11ecef9a24f4e4a812ec220b6a92cc4" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:13.548197 6457 tablet_bootstrap.cc:492] T 6238d16b1be74dd88fd2e089fbd85d33 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:13.548318 6457 ts_tablet_manager.cc:1403] T 6238d16b1be74dd88fd2e089fbd85d33 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.000s
I20260923 19:50:13.549017 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc71e2911b9e4d1eb3fcebe7d1e4d96c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.549085 6457 raft_consensus.cc:359] T 6238d16b1be74dd88fd2e089fbd85d33 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:13.549227 6457 raft_consensus.cc:385] T 6238d16b1be74dd88fd2e089fbd85d33 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.549273 6457 raft_consensus.cc:740] T 6238d16b1be74dd88fd2e089fbd85d33 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.549513 6457 consensus_queue.cc:260] T 6238d16b1be74dd88fd2e089fbd85d33 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
W20260923 19:50:13.549654 5996 leader_election.cc:343] T a11ecef9a24f4e4a812ec220b6a92cc4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:13.550122 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dadb3ab2082b4f749182b0616cf6e8f5 consensus state has no leader
W20260923 19:50:13.550761 5805 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5f1a3b9bd2754a868908973cc79262e2 consensus state has no leader
I20260923 19:50:13.552362 6457 ts_tablet_manager.cc:1434] T 6238d16b1be74dd88fd2e089fbd85d33 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260923 19:50:13.553246 7148 consensus_queue.cc:1048] T ffcf1a144f3c42719a5aa5deed537975 P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:13.554303 6457 tablet_bootstrap.cc:492] T 2398c59871d241f985bca1761e722180 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:13.554551 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11ecef9a24f4e4a812ec220b6a92cc4" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:13.555291 6034 tablet_service.cc:1511] Processing CreateTablet for tablet fc71e2911b9e4d1eb3fcebe7d1e4d96c (DEFAULT_TABLE table=default.Table_0275ce58991948e781ef59d63b7ce7e9 [id=d7ef1bb9da9d4941a6b031d074cdaaa0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.555476 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ac3f28e750304261b9514b2f92b3f12a" } modify_external_catalogs: true
I20260923 19:50:13.556061 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc71e2911b9e4d1eb3fcebe7d1e4d96c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.556407 6457 tablet_bootstrap.cc:654] T 2398c59871d241f985bca1761e722180 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.556708 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet daafbafae5004b8499e7ea93342c0517 (table default.Table_4611fd8972c94dfdbbaf669673dbd540 [id=08d65b643de645c7b760d27d28eccafe]) successfully deleted
W20260923 19:50:13.556859 5792 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.5.143.195:32855, user_credentials={real_user=slave}} blocked reactor thread for 49516.3us
I20260923 19:50:13.558024 6456 tablet_bootstrap.cc:492] T 235b4b8081ad4a13937a7941344dbc33 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:13.558131 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 31b0bdf719554d37993a802831e324ee (table default.Table_b28fac33a5bd4feea5ac2c04b2bcecc4 [id=bf8666274f50416b80fcd282e4d1e2a3]) successfully deleted
I20260923 19:50:13.558190 6456 ts_tablet_manager.cc:1403] T 235b4b8081ad4a13937a7941344dbc33 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.001s
I20260923 19:50:13.558221 6317 tablet_service.cc:1511] Processing CreateTablet for tablet fc71e2911b9e4d1eb3fcebe7d1e4d96c (DEFAULT_TABLE table=default.Table_0275ce58991948e781ef59d63b7ce7e9 [id=d7ef1bb9da9d4941a6b031d074cdaaa0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.558575 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc71e2911b9e4d1eb3fcebe7d1e4d96c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.558912 6456 raft_consensus.cc:359] T 235b4b8081ad4a13937a7941344dbc33 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.559056 6456 raft_consensus.cc:385] T 235b4b8081ad4a13937a7941344dbc33 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.559110 6456 raft_consensus.cc:740] T 235b4b8081ad4a13937a7941344dbc33 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.559330 6456 consensus_queue.cc:260] T 235b4b8081ad4a13937a7941344dbc33 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:13.559418 5790 consensus_peers.cc:597] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b -> Peer 6b3d628214a34b4fa3ca0c1abe422bae (127.5.143.254:37151): Couldn't send request to peer 6b3d628214a34b4fa3ca0c1abe422bae. Status: Network error: Client connection negotiation failed: client connection to 127.5.143.254:37151: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260923 19:50:13.560784 5995 leader_election.cc:343] T a11ecef9a24f4e4a812ec220b6a92cc4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:13.560891 5995 leader_election.cc:304] T a11ecef9a24f4e4a812ec220b6a92cc4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:13.561100 7211 raft_consensus.cc:2749] T a11ecef9a24f4e4a812ec220b6a92cc4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:13.561472 5804 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_cabd4e85a8824c7699003c51f4f0ead6" } modify_external_catalogs: true
I20260923 19:50:13.561651 5804 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_cabd4e85a8824c7699003c51f4f0ead6" } modify_external_catalogs: true
I20260923 19:50:13.562410 6456 ts_tablet_manager.cc:1434] T 235b4b8081ad4a13937a7941344dbc33 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260923 19:50:13.563328 6030 tablet_service.cc:1511] Processing CreateTablet for tablet 96a00813b52944d19075cee6cf0f708e (DEFAULT_TABLE table=default.Table_0ec899ce5bf64ab2b558e12b3c41133d [id=ac79b30c41274617bdd30d9c6c2e0ecd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.563709 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96a00813b52944d19075cee6cf0f708e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.564886 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet f7cf45d4c4d3480288698682c1c85869
I20260923 19:50:13.565634 6169 tablet_service.cc:1558] Processing DeleteTablet for tablet f7cf45d4c4d3480288698682c1c85869 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:13.566138 6021 tablet_service.cc:1558] Processing DeleteTablet for tablet d09faa67bdc54d31a7f7a1b012de9ba1 with delete_type TABLET_DATA_DELETED (replaced by tablet 146a402ff29a4e0b834a9f270d61e21c) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:13.566385 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 391465b6abc24ba9b23f22fe212006eb (DEFAULT_TABLE table=default.Table_aace4bdffc84478db1c7cca8eb7be0be [id=e3257938a4544cbdb30b4cab70383e77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.567111 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 391465b6abc24ba9b23f22fe212006eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.567117 6026 tablet_service.cc:1558] Processing DeleteTablet for tablet f7cf45d4c4d3480288698682c1c85869 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:13.567471 6458 ts_tablet_manager.cc:1929] T f108ebdaecab42e7b57057c7ecfbe690 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:13.567240 6456 tablet_bootstrap.cc:492] T d2298d814a104f5cb62196be3bf0dae6 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:13.567569 6458 log.cc:1199] T f108ebdaecab42e7b57057c7ecfbe690 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/f108ebdaecab42e7b57057c7ecfbe690
I20260923 19:50:13.567909 6458 ts_tablet_manager.cc:1950] T f108ebdaecab42e7b57057c7ecfbe690 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:13.568221 6317 tablet_service.cc:1558] Processing DeleteTablet for tablet f7cf45d4c4d3480288698682c1c85869 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:13.568717 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 526) took 2219 ms. Trace:
I20260923 19:50:13.568799 6458 rpcz_store.cc:276] 0923 19:50:11.348894 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:11.373979 (+ 25085us) service_pool.cc:224] Handling call
0923 19:50:13.524066 (+2150087us) ts_tablet_manager.cc:1151] Deleting tablet f108ebdaecab42e7b57057c7ecfbe690
0923 19:50:13.524078 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.536710 (+ 12632us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:13.567423 (+ 30713us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:13.568699 (+ 1276us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2149727}
I20260923 19:50:13.569137 6456 tablet_bootstrap.cc:654] T d2298d814a104f5cb62196be3bf0dae6 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.569216 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet f108ebdaecab42e7b57057c7ecfbe690 (table default.Table_f6c15bbc16984baa89deab54175d787a [id=ec60adadc27d45b19a9eec1b8709eecb]) successfully deleted
I20260923 19:50:13.579110 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 391465b6abc24ba9b23f22fe212006eb (DEFAULT_TABLE table=default.Table_aace4bdffc84478db1c7cca8eb7be0be [id=e3257938a4544cbdb30b4cab70383e77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.579972 6457 tablet_bootstrap.cc:492] T 2398c59871d241f985bca1761e722180 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:13.580226 6457 ts_tablet_manager.cc:1403] T 2398c59871d241f985bca1761e722180 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.001s
I20260923 19:50:13.581164 6457 raft_consensus.cc:359] T 2398c59871d241f985bca1761e722180 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.581490 6457 raft_consensus.cc:385] T 2398c59871d241f985bca1761e722180 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.581564 6457 raft_consensus.cc:740] T 2398c59871d241f985bca1761e722180 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.582007 6457 consensus_queue.cc:260] T 2398c59871d241f985bca1761e722180 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.583962 7148 consensus_queue.cc:1048] T ffcf1a144f3c42719a5aa5deed537975 P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:13.584074 6457 ts_tablet_manager.cc:1434] T 2398c59871d241f985bca1761e722180 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260923 19:50:13.584620 6457 tablet_bootstrap.cc:492] T 28f9d03be14a4072aab7fd03834c3f6b P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:13.579985 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 391465b6abc24ba9b23f22fe212006eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.592700 6457 tablet_bootstrap.cc:654] T 28f9d03be14a4072aab7fd03834c3f6b P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.594063 7256 raft_consensus.cc:493] T 2ccfe6531fc44f86a0edc8bda1547442 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:13.594296 7256 raft_consensus.cc:515] T 2ccfe6531fc44f86a0edc8bda1547442 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.595767 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ccfe6531fc44f86a0edc8bda1547442" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:13.596318 6280 leader_election.cc:343] T 2ccfe6531fc44f86a0edc8bda1547442 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:13.596837 7256 leader_election.cc:290] T 2ccfe6531fc44f86a0edc8bda1547442 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:13.597891 6279 leader_election.cc:343] T 2ccfe6531fc44f86a0edc8bda1547442 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 2ccfe6531fc44f86a0edc8bda1547442
I20260923 19:50:13.598035 6279 leader_election.cc:304] T 2ccfe6531fc44f86a0edc8bda1547442 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:13.598351 7256 raft_consensus.cc:2749] T 2ccfe6531fc44f86a0edc8bda1547442 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:13.599855 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 530) took 2207 ms. Trace:
I20260923 19:50:13.599943 6458 rpcz_store.cc:276] 0923 19:50:11.392849 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:11.393202 (+ 353us) service_pool.cc:224] Handling call
0923 19:50:13.599729 (+2206527us) ts_tablet_manager.cc:1151] Deleting tablet 39261cedbdb54d1f8ae0e07ae1cfeb3e
0923 19:50:13.599740 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.599837 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2206246}
W20260923 19:50:13.600488 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 39261cedbdb54d1f8ae0e07ae1cfeb3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39261cedbdb54d1f8ae0e07ae1cfeb3e already in progress: creating tablet
I20260923 19:50:13.608150 7050 webserver.cc:533] Webserver started at http://127.5.143.254:39441/ using document root <none> and password file <none>
I20260923 19:50:13.610700 6459 ts_tablet_manager.cc:1916] T f108ebdaecab42e7b57057c7ecfbe690 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:13.614766 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_b5eb8fb996c44e1ebac34b604ebad0bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:13.615046 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 531) took 2198 ms. Trace:
I20260923 19:50:13.615164 6458 rpcz_store.cc:276] 0923 19:50:11.416096 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:11.416319 (+ 223us) service_pool.cc:224] Handling call
0923 19:50:13.614857 (+2198538us) ts_tablet_manager.cc:1151] Deleting tablet edb52bd88b424129bbdc45de89b56efb
0923 19:50:13.614874 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.615016 (+ 142us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2198100}
W20260923 19:50:13.615450 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b5eb8fb996c44e1ebac34b604ebad0bc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:13.615826 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet edb52bd88b424129bbdc45de89b56efb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet edb52bd88b424129bbdc45de89b56efb already in progress: creating tablet
I20260923 19:50:13.617220 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_3a0f945ec700475d9fc1321e0fd38fa0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:13.617758 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 532) took 2184 ms. Trace:
W20260923 19:50:13.617838 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a0f945ec700475d9fc1321e0fd38fa0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:13.617847 6458 rpcz_store.cc:276] 0923 19:50:11.433705 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:11.434535 (+ 830us) service_pool.cc:224] Handling call
0923 19:50:13.617598 (+2183063us) ts_tablet_manager.cc:1151] Deleting tablet ba639d8c68cf49a49a5ec5729143cf6b
0923 19:50:13.617612 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.617735 (+ 123us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2182752}
W20260923 19:50:13.618455 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet ba639d8c68cf49a49a5ec5729143cf6b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba639d8c68cf49a49a5ec5729143cf6b already in progress: creating tablet
I20260923 19:50:13.621080 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 534) took 2094 ms. Trace:
I20260923 19:50:13.621198 6458 rpcz_store.cc:276] 0923 19:50:11.526507 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:11.526569 (+ 62us) service_pool.cc:224] Handling call
0923 19:50:13.620924 (+2094355us) ts_tablet_manager.cc:1151] Deleting tablet 2852e91ccd0c44b3b16f8189e57575d7
0923 19:50:13.620937 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.621057 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2094105}
W20260923 19:50:13.621762 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 2852e91ccd0c44b3b16f8189e57575d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2852e91ccd0c44b3b16f8189e57575d7 already in progress: creating tablet
I20260923 19:50:13.623023 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 533) took 2137 ms. Trace:
I20260923 19:50:13.626367 6458 rpcz_store.cc:276] 0923 19:50:11.485204 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:11.485566 (+ 362us) service_pool.cc:224] Handling call
0923 19:50:13.622888 (+2137322us) ts_tablet_manager.cc:1151] Deleting tablet 465371cfbe544ba98e6eea05033ecf05
0923 19:50:13.622900 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.623001 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2093212}
W20260923 19:50:13.628165 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 465371cfbe544ba98e6eea05033ecf05 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 465371cfbe544ba98e6eea05033ecf05 already in progress: creating tablet
I20260923 19:50:13.628720 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 535) took 2028 ms. Trace:
I20260923 19:50:13.629575 6458 rpcz_store.cc:276] 0923 19:50:11.599831 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:11.599906 (+ 75us) service_pool.cc:224] Handling call
0923 19:50:13.628578 (+2028672us) ts_tablet_manager.cc:1151] Deleting tablet 2526884ab0ef404aaf93051cc842c695
0923 19:50:13.628589 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.628702 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2027653}
W20260923 19:50:13.629841 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7418058b0f5a44d189888b0b1714eb2e consensus state has no leader
W20260923 19:50:13.631323 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 2526884ab0ef404aaf93051cc842c695 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2526884ab0ef404aaf93051cc842c695 already in progress: creating tablet
I20260923 19:50:13.631721 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 536) took 1848 ms. Trace:
I20260923 19:50:13.631793 6458 rpcz_store.cc:276] 0923 19:50:11.783175 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:11.783463 (+ 288us) service_pool.cc:224] Handling call
0923 19:50:13.631596 (+1848133us) ts_tablet_manager.cc:1151] Deleting tablet a0d817069e664199bff0d7591548e2d7
0923 19:50:13.631607 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.631705 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1795442}
W20260923 19:50:13.632210 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet a0d817069e664199bff0d7591548e2d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0d817069e664199bff0d7591548e2d7 already in progress: creating tablet
I20260923 19:50:13.632575 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 547) took 1689 ms. Trace:
I20260923 19:50:13.632648 6458 rpcz_store.cc:276] 0923 19:50:11.943391 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:11.943445 (+ 54us) service_pool.cc:224] Handling call
0923 19:50:13.632465 (+1689020us) ts_tablet_manager.cc:1151] Deleting tablet 18a31ed6bea444e7888f374927f90a60
0923 19:50:13.632481 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.632559 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1686921}
W20260923 19:50:13.633026 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 18a31ed6bea444e7888f374927f90a60 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18a31ed6bea444e7888f374927f90a60 already in progress: creating tablet
I20260923 19:50:13.633496 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 556) took 1608 ms. Trace:
I20260923 19:50:13.633560 6458 rpcz_store.cc:276] 0923 19:50:12.024930 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:12.025321 (+ 391us) service_pool.cc:224] Handling call
0923 19:50:13.633405 (+1608084us) ts_tablet_manager.cc:1151] Deleting tablet ecd91bf5bd9447c0bb20ba43573ff08d
0923 19:50:13.633414 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.633482 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1607869}
W20260923 19:50:13.633975 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet ecd91bf5bd9447c0bb20ba43573ff08d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ecd91bf5bd9447c0bb20ba43573ff08d already in progress: creating tablet
I20260923 19:50:13.634743 6457 tablet_bootstrap.cc:492] T 28f9d03be14a4072aab7fd03834c3f6b P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:13.634593 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_23bee5e3273a448bac30904cc004d63a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:13.634883 6457 ts_tablet_manager.cc:1403] T 28f9d03be14a4072aab7fd03834c3f6b P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.050s user 0.011s sys 0.003s
W20260923 19:50:13.635390 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_23bee5e3273a448bac30904cc004d63a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:13.635555 6457 raft_consensus.cc:359] T 28f9d03be14a4072aab7fd03834c3f6b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.635708 6457 raft_consensus.cc:385] T 28f9d03be14a4072aab7fd03834c3f6b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.635757 6457 raft_consensus.cc:740] T 28f9d03be14a4072aab7fd03834c3f6b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.636703 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 555) took 1611 ms. Trace:
I20260923 19:50:13.636819 6458 rpcz_store.cc:276] 0923 19:50:12.024762 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:12.031601 (+ 6839us) service_pool.cc:224] Handling call
0923 19:50:13.636485 (+1604884us) ts_tablet_manager.cc:1151] Deleting tablet 772ece5283a949408d849f6e56f5f17b
0923 19:50:13.636549 (+ 64us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.636679 (+ 130us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1600639}
I20260923 19:50:13.637223 7211 raft_consensus.cc:493] T 2398c59871d241f985bca1761e722180 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:13.637341 7211 raft_consensus.cc:515] T 2398c59871d241f985bca1761e722180 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:13.637408 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 772ece5283a949408d849f6e56f5f17b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 772ece5283a949408d849f6e56f5f17b already in progress: creating tablet
I20260923 19:50:13.637707 6457 consensus_queue.cc:260] T 28f9d03be14a4072aab7fd03834c3f6b P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.637836 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 566) took 1541 ms. Trace:
I20260923 19:50:13.637948 6458 rpcz_store.cc:276] 0923 19:50:12.096684 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:12.096747 (+ 63us) service_pool.cc:224] Handling call
0923 19:50:13.637734 (+1540987us) ts_tablet_manager.cc:1151] Deleting tablet bfe87e992ca04ea293e354da508e4c67
0923 19:50:13.637744 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.637819 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1534126}
I20260923 19:50:13.638110 7211 leader_election.cc:290] T 2398c59871d241f985bca1761e722180 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:13.638468 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet bfe87e992ca04ea293e354da508e4c67 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bfe87e992ca04ea293e354da508e4c67 already in progress: creating tablet
I20260923 19:50:13.639132 6457 ts_tablet_manager.cc:1434] T 28f9d03be14a4072aab7fd03834c3f6b P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260923 19:50:13.639423 6457 tablet_bootstrap.cc:492] T 15a9d1d4adaa402f90d774e77010c928 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:13.639436 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398c59871d241f985bca1761e722180" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:13.640245 5995 leader_election.cc:343] T 2398c59871d241f985bca1761e722180 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:13.640520 6026 tablet_service.cc:1558] Processing DeleteTablet for tablet 6238d16b1be74dd88fd2e089fbd85d33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:13.641029 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398c59871d241f985bca1761e722180" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:13.641119 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet 9be4c46ee8eb4dbaad01d492b701a9e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:13.641546 5996 leader_election.cc:343] T 2398c59871d241f985bca1761e722180 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:13.641666 5996 leader_election.cc:304] T 2398c59871d241f985bca1761e722180 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
W20260923 19:50:13.641721 6139 consensus_peers.cc:597] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Couldn't send request to peer 2bf41435f70447f19992d368ca6b46bd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2f627b7b9ff74750bd8dd59840bf77db. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:13.641909 7211 raft_consensus.cc:2749] T 2398c59871d241f985bca1761e722180 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:13.625023 6454 tablet_bootstrap.cc:492] T 0d70deeda179486291195476e47a9ae6 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:13.642668 6454 ts_tablet_manager.cc:1403] T 0d70deeda179486291195476e47a9ae6 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.198s user 0.005s sys 0.001s
I20260923 19:50:13.642899 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 567) took 1538 ms. Trace:
I20260923 19:50:13.642984 6458 rpcz_store.cc:276] 0923 19:50:12.104054 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:12.104115 (+ 61us) service_pool.cc:224] Handling call
0923 19:50:13.638899 (+1534784us) ts_tablet_manager.cc:1151] Deleting tablet 688bb1055ba94c2996cdfea6dea76416
0923 19:50:13.642765 (+ 3866us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.642879 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1529366}
W20260923 19:50:13.643427 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 688bb1055ba94c2996cdfea6dea76416 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 688bb1055ba94c2996cdfea6dea76416 already in progress: creating tablet
I20260923 19:50:13.643589 6454 raft_consensus.cc:359] T 0d70deeda179486291195476e47a9ae6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.643757 6454 raft_consensus.cc:385] T 0d70deeda179486291195476e47a9ae6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.643762 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 565) took 1550 ms. Trace:
I20260923 19:50:13.643811 6454 raft_consensus.cc:740] T 0d70deeda179486291195476e47a9ae6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.643842 6458 rpcz_store.cc:276] 0923 19:50:12.093762 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:12.097992 (+ 4230us) service_pool.cc:224] Handling call
0923 19:50:13.643631 (+1545639us) ts_tablet_manager.cc:1151] Deleting tablet 5a2e1e77494343ddb72c496d521151f1
0923 19:50:13.643646 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.643745 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1528881}
I20260923 19:50:13.644027 6454 consensus_queue.cc:260] T 0d70deeda179486291195476e47a9ae6 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:13.644346 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 5a2e1e77494343ddb72c496d521151f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a2e1e77494343ddb72c496d521151f1 already in progress: creating tablet
I20260923 19:50:13.644678 6454 ts_tablet_manager.cc:1434] T 0d70deeda179486291195476e47a9ae6 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:13.644737 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 569) took 1411 ms. Trace:
I20260923 19:50:13.644912 6457 tablet_bootstrap.cc:654] T 15a9d1d4adaa402f90d774e77010c928 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.644825 6458 rpcz_store.cc:276] 0923 19:50:12.233131 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:12.236553 (+ 3422us) service_pool.cc:224] Handling call
0923 19:50:13.644642 (+1408089us) ts_tablet_manager.cc:1151] Deleting tablet e4ad9baac560463fabc80828074b46c1
0923 19:50:13.644652 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.644722 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1394175}
W20260923 19:50:13.645207 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet e4ad9baac560463fabc80828074b46c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4ad9baac560463fabc80828074b46c1 already in progress: creating tablet
I20260923 19:50:13.645447 6458 tablet_replica.cc:333] T 3919b15a00eb4fb08008f065f556c760 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
W20260923 19:50:13.647921 5799 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 81cbeb3b21064abca617920301ec8cd9 has no consensus state
I20260923 19:50:13.647907 6458 raft_consensus.cc:2243] T 3919b15a00eb4fb08008f065f556c760 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:13.648079 6458 raft_consensus.cc:2272] T 3919b15a00eb4fb08008f065f556c760 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:13.651384 6458 ts_tablet_manager.cc:1916] T 3919b15a00eb4fb08008f065f556c760 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:13.653004 6457 tablet_bootstrap.cc:492] T 15a9d1d4adaa402f90d774e77010c928 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:13.653698 6457 ts_tablet_manager.cc:1403] T 15a9d1d4adaa402f90d774e77010c928 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.002s
I20260923 19:50:13.655611 6457 raft_consensus.cc:359] T 15a9d1d4adaa402f90d774e77010c928 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.660503 6457 raft_consensus.cc:385] T 15a9d1d4adaa402f90d774e77010c928 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.660769 6461 ts_tablet_manager.cc:1929] T b92aaac328934d95a89e0fc08a80b0b1 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:13.660903 6461 log.cc:1199] T b92aaac328934d95a89e0fc08a80b0b1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/b92aaac328934d95a89e0fc08a80b0b1
I20260923 19:50:13.660784 6457 raft_consensus.cc:740] T 15a9d1d4adaa402f90d774e77010c928 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.661222 6461 ts_tablet_manager.cc:1950] T b92aaac328934d95a89e0fc08a80b0b1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:13.661489 6457 consensus_queue.cc:260] T 15a9d1d4adaa402f90d774e77010c928 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.662057 6458 ts_tablet_manager.cc:1929] T 3919b15a00eb4fb08008f065f556c760 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:13.662174 6458 log.cc:1199] T 3919b15a00eb4fb08008f065f556c760 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/3919b15a00eb4fb08008f065f556c760
I20260923 19:50:13.662482 6458 ts_tablet_manager.cc:1950] T 3919b15a00eb4fb08008f065f556c760 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:13.662976 6456 tablet_bootstrap.cc:492] T d2298d814a104f5cb62196be3bf0dae6 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:13.663144 6456 ts_tablet_manager.cc:1403] T d2298d814a104f5cb62196be3bf0dae6 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.096s user 0.009s sys 0.016s
I20260923 19:50:13.663218 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 576) took 1371 ms. Trace:
I20260923 19:50:13.663231 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_4c640f2dba03495aa79c4ff2d3719da2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:13.663295 6458 rpcz_store.cc:276] 0923 19:50:12.291530 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:12.292745 (+ 1215us) service_pool.cc:224] Handling call
0923 19:50:13.645384 (+1352639us) ts_tablet_manager.cc:1151] Deleting tablet 3919b15a00eb4fb08008f065f556c760
0923 19:50:13.645398 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.658578 (+ 13180us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:13.662005 (+ 3427us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:13.663201 (+ 1196us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1351938}
I20260923 19:50:13.663635 6458 tablet_replica.cc:333] T fe5d081a41a3417b855656ca6e24f235 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:13.663789 6458 raft_consensus.cc:2243] T fe5d081a41a3417b855656ca6e24f235 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
W20260923 19:50:13.663880 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4c640f2dba03495aa79c4ff2d3719da2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:13.663900 6456 raft_consensus.cc:359] T d2298d814a104f5cb62196be3bf0dae6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.664044 6456 raft_consensus.cc:385] T d2298d814a104f5cb62196be3bf0dae6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.664084 6456 raft_consensus.cc:740] T d2298d814a104f5cb62196be3bf0dae6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.664258 6456 consensus_queue.cc:260] T d2298d814a104f5cb62196be3bf0dae6 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.663839 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 3919b15a00eb4fb08008f065f556c760 (table default.Table_64791d9d1cef4cfe9d420e405abe816e [id=8325a8f159124a2da260e2be3ce69500]) successfully deleted
I20260923 19:50:13.665145 6456 ts_tablet_manager.cc:1434] T d2298d814a104f5cb62196be3bf0dae6 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:13.665409 6456 tablet_bootstrap.cc:492] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:13.667213 6457 ts_tablet_manager.cc:1434] T 15a9d1d4adaa402f90d774e77010c928 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.013s user 0.000s sys 0.002s
I20260923 19:50:13.667946 6456 tablet_bootstrap.cc:654] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.668530 6457 tablet_bootstrap.cc:492] T c504ec668a33451fb1249f697bb5e2bb P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:13.671067 6457 tablet_bootstrap.cc:654] T c504ec668a33451fb1249f697bb5e2bb P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.670516 7050 fs_manager.cc:362] Metadata directory not provided
I20260923 19:50:13.674289 7050 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 19:50:13.682066 7256 raft_consensus.cc:493] T 1c26a2863fdd4912b6d357877af1eb42 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:13.682237 7256 raft_consensus.cc:515] T 1c26a2863fdd4912b6d357877af1eb42 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.682860 7256 leader_election.cc:290] T 1c26a2863fdd4912b6d357877af1eb42 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:13.683632 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c26a2863fdd4912b6d357877af1eb42" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:13.684216 6280 leader_election.cc:343] T 1c26a2863fdd4912b6d357877af1eb42 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:13.687458 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_4cbf006b85204fe99daebf0cb58089a5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:13.688081 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4cbf006b85204fe99daebf0cb58089a5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:13.689257 5802 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 3a345d177b3c4bd486814928ef666bdb
I20260923 19:50:13.689580 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_67f9d2537a904559b507c9fac72ece67" } modify_external_catalogs: true
I20260923 19:50:13.689723 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_67f9d2537a904559b507c9fac72ece67" } modify_external_catalogs: true
W20260923 19:50:13.690450 6279 leader_election.cc:343] T 1c26a2863fdd4912b6d357877af1eb42 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 1c26a2863fdd4912b6d357877af1eb42
I20260923 19:50:13.690567 6279 leader_election.cc:304] T 1c26a2863fdd4912b6d357877af1eb42 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:13.690919 7256 raft_consensus.cc:2749] T 1c26a2863fdd4912b6d357877af1eb42 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:13.695122 6456 tablet_bootstrap.cc:492] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:13.695258 6456 ts_tablet_manager.cc:1403] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.030s user 0.005s sys 0.000s
I20260923 19:50:13.696174 6454 tablet_bootstrap.cc:492] T b985acc650334497832cf4505e1b0043 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:13.696643 6456 raft_consensus.cc:359] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.696805 6456 raft_consensus.cc:385] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.696858 6456 raft_consensus.cc:740] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.697074 6456 consensus_queue.cc:260] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.697207 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 83dba06b0d0040889015fb052c642ec0
I20260923 19:50:13.697899 6456 ts_tablet_manager.cc:1434] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:50:13.698160 6456 tablet_bootstrap.cc:492] T ba4e9fee05994c0d8e7d1f21788280d3 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:13.698417 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet 83dba06b0d0040889015fb052c642ec0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:13.699301 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_e2fa24504c43499d8907f4215b0153c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:13.699973 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e2fa24504c43499d8907f4215b0153c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:13.700914 6310 tablet_service.cc:1558] Processing DeleteTablet for tablet 83dba06b0d0040889015fb052c642ec0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:13.702061 6456 tablet_bootstrap.cc:654] T ba4e9fee05994c0d8e7d1f21788280d3 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.704279 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet b92aaac328934d95a89e0fc08a80b0b1 (table default.Table_9bd23e83d2144f82a8487f44b70458fc [id=93b330743f8d47f2b3e06f43ec3658b2]) successfully deleted
I20260923 19:50:13.704668 6461 tablet_replica.cc:333] T 5adadf8caf5e4a9ab1107d0fb6a91735 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:13.704926 6461 raft_consensus.cc:2243] T 5adadf8caf5e4a9ab1107d0fb6a91735 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:13.705152 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet 83dba06b0d0040889015fb052c642ec0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:13.706516 6030 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e711e48156b46b5a517b330d6d41309 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:13.705160 6461 raft_consensus.cc:2272] T 5adadf8caf5e4a9ab1107d0fb6a91735 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:13.709139 6461 ts_tablet_manager.cc:1916] T 5adadf8caf5e4a9ab1107d0fb6a91735 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:13.709298 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet 035abecfbee7474d9dd048f35e28e867 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:07 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:13.663903 6458 raft_consensus.cc:2272] T fe5d081a41a3417b855656ca6e24f235 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:13.718812 6458 ts_tablet_manager.cc:1916] T fe5d081a41a3417b855656ca6e24f235 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:13.724548 6454 tablet_bootstrap.cc:654] T b985acc650334497832cf4505e1b0043 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.724462 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_492aa1a4a9644f948b5bf137f57fac3d" } new_table_name: "default.Table_db1b6a3aa2f44c2f9d346b09bf7f2a4b" modify_external_catalogs: true
I20260923 19:50:13.731999 6459 ts_tablet_manager.cc:1929] T f108ebdaecab42e7b57057c7ecfbe690 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:13.732249 6459 log.cc:1199] T f108ebdaecab42e7b57057c7ecfbe690 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/f108ebdaecab42e7b57057c7ecfbe690
I20260923 19:50:13.732323 5805 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5d0c2a71e15a41e9a3200d2f16a36e16" } modify_external_catalogs: true
I20260923 19:50:13.732560 5805 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5d0c2a71e15a41e9a3200d2f16a36e16" } modify_external_catalogs: true
I20260923 19:50:13.732775 6459 ts_tablet_manager.cc:1950] T f108ebdaecab42e7b57057c7ecfbe690 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:13.733096 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 572) took 1691 ms. Trace:
I20260923 19:50:13.733211 6459 rpcz_store.cc:276] 0923 19:50:12.041923 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:12.042900 (+ 977us) service_pool.cc:224] Handling call
0923 19:50:13.472099 (+1429199us) ts_tablet_manager.cc:1151] Deleting tablet f108ebdaecab42e7b57057c7ecfbe690
0923 19:50:13.472106 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.629113 (+157007us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:13.731939 (+102826us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:13.733080 (+ 1141us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1325922}
I20260923 19:50:13.733762 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet f108ebdaecab42e7b57057c7ecfbe690 (table default.Table_f6c15bbc16984baa89deab54175d787a [id=ec60adadc27d45b19a9eec1b8709eecb]) successfully deleted
I20260923 19:50:13.734231 6459 tablet_replica.cc:333] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:13.734783 6461 ts_tablet_manager.cc:1929] T 5adadf8caf5e4a9ab1107d0fb6a91735 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:50:13.740671 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_cc866643127a4bc8aebae6c828c10bac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:13.741243 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc866643127a4bc8aebae6c828c10bac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:13.747295 6454 tablet_bootstrap.cc:492] T b985acc650334497832cf4505e1b0043 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:13.747489 6454 ts_tablet_manager.cc:1403] T b985acc650334497832cf4505e1b0043 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.051s user 0.001s sys 0.002s
I20260923 19:50:13.748026 6456 tablet_bootstrap.cc:492] T ba4e9fee05994c0d8e7d1f21788280d3 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:13.748157 6456 ts_tablet_manager.cc:1403] T ba4e9fee05994c0d8e7d1f21788280d3 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.050s user 0.007s sys 0.006s
I20260923 19:50:13.748209 6454 raft_consensus.cc:359] T b985acc650334497832cf4505e1b0043 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.748370 6454 raft_consensus.cc:385] T b985acc650334497832cf4505e1b0043 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.748453 6454 raft_consensus.cc:740] T b985acc650334497832cf4505e1b0043 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.748713 6454 consensus_queue.cc:260] T b985acc650334497832cf4505e1b0043 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.748860 5796 master_service.cc:960] ReplaceTablet: received request to replace tablet b529b0e82c5b48edac54cc281ac4b4a6 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:13.748836 6456 raft_consensus.cc:359] T ba4e9fee05994c0d8e7d1f21788280d3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.748996 6456 raft_consensus.cc:385] T ba4e9fee05994c0d8e7d1f21788280d3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.749042 6456 raft_consensus.cc:740] T ba4e9fee05994c0d8e7d1f21788280d3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.749171 6454 ts_tablet_manager.cc:1434] T b985acc650334497832cf4505e1b0043 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:13.749214 6456 consensus_queue.cc:260] T ba4e9fee05994c0d8e7d1f21788280d3 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.749636 6456 ts_tablet_manager.cc:1434] T ba4e9fee05994c0d8e7d1f21788280d3 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260923 19:50:13.754149 6454 tablet_bootstrap.cc:492] T e071b9dd1db44af0a9d1b9e904f875a5 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:13.755795 6454 tablet_bootstrap.cc:654] T e071b9dd1db44af0a9d1b9e904f875a5 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.756759 6459 raft_consensus.cc:2243] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
W20260923 19:50:13.758038 6139 consensus_peers.cc:597] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Couldn't send request to peer 2bf41435f70447f19992d368ca6b46bd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6e781ccf4aa343fc924138c3cc2b04e6. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:13.760843 6459 pending_rounds.cc:70] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:13.761060 6459 pending_rounds.cc:77] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630579007074304 op_type: NO_OP noop_request { }
I20260923 19:50:13.761320 6459 raft_consensus.cc:2889] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:13.761479 6459 raft_consensus.cc:2272] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:13.765455 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_8e33c6465d2d4bc2bb7dc625ec2cfca3" } new_table_name: "default.Table_999f599f560c49e3a8da9037c4554baa" modify_external_catalogs: true
I20260923 19:50:13.766428 6459 ts_tablet_manager.cc:1916] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:13.767555 6456 tablet_bootstrap.cc:492] T 896bd068e6b343e48eb2a01679b49326 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:13.737417 6457 tablet_bootstrap.cc:492] T c504ec668a33451fb1249f697bb5e2bb P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:13.769308 6461 log.cc:1199] T 5adadf8caf5e4a9ab1107d0fb6a91735 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/5adadf8caf5e4a9ab1107d0fb6a91735
I20260923 19:50:13.769380 6457 ts_tablet_manager.cc:1403] T c504ec668a33451fb1249f697bb5e2bb P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.101s user 0.003s sys 0.013s
I20260923 19:50:13.769862 6461 ts_tablet_manager.cc:1950] T 5adadf8caf5e4a9ab1107d0fb6a91735 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:13.770357 6456 tablet_bootstrap.cc:654] T 896bd068e6b343e48eb2a01679b49326 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.770220 6457 raft_consensus.cc:359] T c504ec668a33451fb1249f697bb5e2bb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.770511 6457 raft_consensus.cc:385] T c504ec668a33451fb1249f697bb5e2bb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.770572 6457 raft_consensus.cc:740] T c504ec668a33451fb1249f697bb5e2bb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.770821 6457 consensus_queue.cc:260] T c504ec668a33451fb1249f697bb5e2bb P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.771550 6457 ts_tablet_manager.cc:1434] T c504ec668a33451fb1249f697bb5e2bb P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:13.772714 6457 tablet_bootstrap.cc:492] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:13.773042 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 5adadf8caf5e4a9ab1107d0fb6a91735 (table default.Table_bb0cff9e9bcd4de98b915af1c7e3bca2 [id=738ed1d070ef485e9299c1f3b1db008a]) successfully deleted
I20260923 19:50:13.773741 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet c4b7cd806c3d41dd9af0a365d84c1f12
I20260923 19:50:13.775220 6457 tablet_bootstrap.cc:654] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.776337 6310 tablet_service.cc:1558] Processing DeleteTablet for tablet c4b7cd806c3d41dd9af0a365d84c1f12 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:13.779752 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet c4b7cd806c3d41dd9af0a365d84c1f12 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:13.780102 6168 tablet_service.cc:1558] Processing DeleteTablet for tablet c4b7cd806c3d41dd9af0a365d84c1f12 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:13.786538 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet fc151f4d78344efeada6d6e57af6eb9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc151f4d78344efeada6d6e57af6eb9f already in progress: creating tablet
W20260923 19:50:13.787271 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet e996910398694686bd68ef31239ed15f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e996910398694686bd68ef31239ed15f already in progress: creating tablet
I20260923 19:50:13.787233 5802 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_3cc4e61c61094959a908681364326b54" } new_table_name: "default.Table_40208153d40d477c8a2d41c8efc1617c" modify_external_catalogs: true
W20260923 19:50:13.788304 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet d6d3601a392f4723b4ca00f6e12b950c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d6d3601a392f4723b4ca00f6e12b950c already in progress: creating tablet
W20260923 19:50:13.788935 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 7539bd538c6343eda16bedfdf8545316 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7539bd538c6343eda16bedfdf8545316 already in progress: creating tablet
W20260923 19:50:13.789544 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet ccbb8cd687924f0892464c6cb80d175c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ccbb8cd687924f0892464c6cb80d175c already in progress: creating tablet
I20260923 19:50:13.789830 6461 tablet_replica.cc:333] T 556b32b8ccd54c439f86b0069e2a5ce0 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:13.790184 6461 raft_consensus.cc:2243] T 556b32b8ccd54c439f86b0069e2a5ce0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:13.790477 6461 raft_consensus.cc:2272] T 556b32b8ccd54c439f86b0069e2a5ce0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:13.791208 6461 ts_tablet_manager.cc:1916] T 556b32b8ccd54c439f86b0069e2a5ce0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:13.792064 7256 raft_consensus.cc:493] T a08446fcf1794dab9d3181904507456f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:13.792207 7256 raft_consensus.cc:515] T a08446fcf1794dab9d3181904507456f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.792586 7211 raft_consensus.cc:493] T 2ce6378a6bd844a485aebb96081307e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:13.792692 7211 raft_consensus.cc:515] T 2ce6378a6bd844a485aebb96081307e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.792878 7256 leader_election.cc:290] T a08446fcf1794dab9d3181904507456f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:13.793303 7211 leader_election.cc:290] T 2ce6378a6bd844a485aebb96081307e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:13.793625 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08446fcf1794dab9d3181904507456f" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:13.794277 6280 leader_election.cc:343] T a08446fcf1794dab9d3181904507456f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:13.794689 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ce6378a6bd844a485aebb96081307e3" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:13.795184 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ce6378a6bd844a485aebb96081307e3" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:13.795749 5996 leader_election.cc:343] T 2ce6378a6bd844a485aebb96081307e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:13.795892 5995 leader_election.cc:343] T 2ce6378a6bd844a485aebb96081307e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:13.795995 5995 leader_election.cc:304] T 2ce6378a6bd844a485aebb96081307e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:13.796206 7211 raft_consensus.cc:2749] T 2ce6378a6bd844a485aebb96081307e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:13.796450 6279 leader_election.cc:343] T a08446fcf1794dab9d3181904507456f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: a08446fcf1794dab9d3181904507456f
I20260923 19:50:13.796561 6279 leader_election.cc:304] T a08446fcf1794dab9d3181904507456f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:13.796938 7256 raft_consensus.cc:2749] T a08446fcf1794dab9d3181904507456f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:13.799410 5804 master_service.cc:960] ReplaceTablet: received request to replace tablet 7dac9efee371479ab3547e06f0e580ad from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:13.800143 6459 ts_tablet_manager.cc:1929] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:13.803500 7211 raft_consensus.cc:493] T 22e37d5afa8047989928596b4092c4b9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:13.803678 7211 raft_consensus.cc:515] T 22e37d5afa8047989928596b4092c4b9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.804425 7211 leader_election.cc:290] T 22e37d5afa8047989928596b4092c4b9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:13.805965 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e37d5afa8047989928596b4092c4b9" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:13.806522 5996 leader_election.cc:343] T 22e37d5afa8047989928596b4092c4b9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:13.808303 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 940d876042844020833ccc2347d67c4c consensus state has no leader
I20260923 19:50:13.808781 5798 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_10cc33ba2656438aad3a4aa066bfa74e" } modify_external_catalogs: true
I20260923 19:50:13.809007 5798 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_10cc33ba2656438aad3a4aa066bfa74e" } modify_external_catalogs: true
I20260923 19:50:13.805295 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e37d5afa8047989928596b4092c4b9" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:13.811862 6459 log.cc:1199] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/2f627b7b9ff74750bd8dd59840bf77db
I20260923 19:50:13.812333 6459 ts_tablet_manager.cc:1950] T 2f627b7b9ff74750bd8dd59840bf77db P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
W20260923 19:50:13.812352 5995 leader_election.cc:343] T 22e37d5afa8047989928596b4092c4b9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:13.812489 5995 leader_election.cc:304] T 22e37d5afa8047989928596b4092c4b9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:13.812907 7211 raft_consensus.cc:2749] T 22e37d5afa8047989928596b4092c4b9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:13.813450 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 571) took 1778 ms. Trace:
I20260923 19:50:13.814054 6459 rpcz_store.cc:276] 0923 19:50:12.035436 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:12.043113 (+ 7677us) service_pool.cc:224] Handling call
0923 19:50:13.734180 (+1691067us) ts_tablet_manager.cc:1151] Deleting tablet 2f627b7b9ff74750bd8dd59840bf77db
0923 19:50:13.734190 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.792345 (+ 58155us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:13.800077 (+ 7732us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:13.813433 (+ 13356us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9231,"tablet-delete.queue_time_us":1584059}
I20260923 19:50:13.815076 6458 ts_tablet_manager.cc:1929] T fe5d081a41a3417b855656ca6e24f235 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:13.815239 6458 log.cc:1199] T fe5d081a41a3417b855656ca6e24f235 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/fe5d081a41a3417b855656ca6e24f235
I20260923 19:50:13.815589 6458 ts_tablet_manager.cc:1950] T fe5d081a41a3417b855656ca6e24f235 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:13.815690 7316 raft_consensus.cc:493] T 0d70deeda179486291195476e47a9ae6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:13.815819 7316 raft_consensus.cc:515] T 0d70deeda179486291195476e47a9ae6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.816474 7316 leader_election.cc:290] T 0d70deeda179486291195476e47a9ae6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:13.817023 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d70deeda179486291195476e47a9ae6" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:13.817178 6056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d70deeda179486291195476e47a9ae6" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:13.817389 6056 raft_consensus.cc:2393] T 0d70deeda179486291195476e47a9ae6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61022dd7f2f14dc19aebe3af5f08f430 in current term 1: Already voted for candidate 2bf41435f70447f19992d368ca6b46bd in this term.
I20260923 19:50:13.817896 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 578) took 1481 ms. Trace:
I20260923 19:50:13.817914 6137 leader_election.cc:304] T 0d70deeda179486291195476e47a9ae6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:13.817981 6458 rpcz_store.cc:276] 0923 19:50:12.336349 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:12.337924 (+ 1575us) service_pool.cc:224] Handling call
0923 19:50:13.663588 (+1325664us) ts_tablet_manager.cc:1151] Deleting tablet fe5d081a41a3417b855656ca6e24f235
0923 19:50:13.663597 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.727062 (+ 63465us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:13.814992 (+ 87930us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:13.817856 (+ 2864us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1325392}
I20260923 19:50:13.818411 7316 raft_consensus.cc:3060] T 0d70deeda179486291195476e47a9ae6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:13.818392 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet fe5d081a41a3417b855656ca6e24f235 (table default.Table_124323035bb7418597ae00063fdffdf2 [id=b4a404dd8b1b4bd1971ec4ae180bff02]) successfully deleted
I20260923 19:50:13.818740 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 581) took 1320 ms. Trace:
I20260923 19:50:13.818802 6458 rpcz_store.cc:276] 0923 19:50:12.498545 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:12.498617 (+ 72us) service_pool.cc:224] Handling call
0923 19:50:13.818635 (+1320018us) ts_tablet_manager.cc:1151] Deleting tablet 47c261638f0d48bb82c78c9a04d487b2
0923 19:50:13.818645 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.818726 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1319740}
W20260923 19:50:13.819291 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 47c261638f0d48bb82c78c9a04d487b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47c261638f0d48bb82c78c9a04d487b2 already in progress: creating tablet
I20260923 19:50:13.819655 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 582) took 1320 ms. Trace:
I20260923 19:50:13.819717 6458 rpcz_store.cc:276] 0923 19:50:12.499463 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:12.499519 (+ 56us) service_pool.cc:224] Handling call
0923 19:50:13.819565 (+1320046us) ts_tablet_manager.cc:1151] Deleting tablet a4c5fdd14ecb467eadfd5036dfb3783f
0923 19:50:13.819574 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.819642 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1319805}
W20260923 19:50:13.820068 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet a4c5fdd14ecb467eadfd5036dfb3783f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4c5fdd14ecb467eadfd5036dfb3783f already in progress: creating tablet
I20260923 19:50:13.820372 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 584) took 1271 ms. Trace:
I20260923 19:50:13.820432 6458 rpcz_store.cc:276] 0923 19:50:12.548628 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:12.549288 (+ 660us) service_pool.cc:224] Handling call
0923 19:50:13.820289 (+1271001us) ts_tablet_manager.cc:1151] Deleting tablet d2dd611746d741e88b6911bf5d51f3e5
0923 19:50:13.820297 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.820359 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1270595}
W20260923 19:50:13.820799 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet d2dd611746d741e88b6911bf5d51f3e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2dd611746d741e88b6911bf5d51f3e5 already in progress: creating tablet
I20260923 19:50:13.821026 6458 tablet_replica.cc:333] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:13.821208 6458 raft_consensus.cc:2243] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:13.821480 6458 raft_consensus.cc:2272] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:13.821635 7316 raft_consensus.cc:2749] T 0d70deeda179486291195476e47a9ae6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:13.822060 6458 ts_tablet_manager.cc:1916] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:13.822502 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 2f627b7b9ff74750bd8dd59840bf77db (table default.Table_e6225c62c99144cdb7c222d165e1d7b5 [id=e54ebfe94bd640f59f7006d4d146a9da]) successfully deleted
I20260923 19:50:13.823282 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 584) took 1745 ms. Trace:
I20260923 19:50:13.823437 6459 rpcz_store.cc:276] 0923 19:50:12.077301 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:12.079145 (+ 1844us) service_pool.cc:224] Handling call
0923 19:50:13.823155 (+1744010us) ts_tablet_manager.cc:1151] Deleting tablet 5a2e1e77494343ddb72c496d521151f1
0923 19:50:13.823167 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.823264 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1665191}
W20260923 19:50:13.824611 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 5a2e1e77494343ddb72c496d521151f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a2e1e77494343ddb72c496d521151f1 already in progress: creating tablet
I20260923 19:50:13.826221 7316 raft_consensus.cc:493] T 3919b15a00eb4fb08008f065f556c760 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:13.826396 7316 raft_consensus.cc:515] T 3919b15a00eb4fb08008f065f556c760 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.826799 6454 tablet_bootstrap.cc:492] T e071b9dd1db44af0a9d1b9e904f875a5 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:13.826956 6454 ts_tablet_manager.cc:1403] T e071b9dd1db44af0a9d1b9e904f875a5 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.073s user 0.002s sys 0.006s
I20260923 19:50:13.827788 5801 master_service.cc:960] ReplaceTablet: received request to replace tablet 66739afdf147413787acb0363aa37df6 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:13.827795 6454 raft_consensus.cc:359] T e071b9dd1db44af0a9d1b9e904f875a5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.827991 6454 raft_consensus.cc:385] T e071b9dd1db44af0a9d1b9e904f875a5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260923 19:50:13.828027 6137 leader_election.cc:343] T 3919b15a00eb4fb08008f065f556c760 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 3919b15a00eb4fb08008f065f556c760
I20260923 19:50:13.828060 6454 raft_consensus.cc:740] T e071b9dd1db44af0a9d1b9e904f875a5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.828336 6454 consensus_queue.cc:260] T e071b9dd1db44af0a9d1b9e904f875a5 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:13.830488 6139 leader_election.cc:343] T 3919b15a00eb4fb08008f065f556c760 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 3919b15a00eb4fb08008f065f556c760
I20260923 19:50:13.830610 6139 leader_election.cc:304] T 3919b15a00eb4fb08008f065f556c760 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:13.831424 7239 raft_consensus.cc:2749] T 3919b15a00eb4fb08008f065f556c760 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:13.831578 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_9775cad3e3fc483a925aead3e398478c" } new_table_name: "default.Table_9facb802b3094c0b9bf0aeb831c771f6" modify_external_catalogs: true
I20260923 19:50:13.831871 6454 ts_tablet_manager.cc:1434] T e071b9dd1db44af0a9d1b9e904f875a5 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260923 19:50:13.832207 6454 tablet_bootstrap.cc:492] T fe5d081a41a3417b855656ca6e24f235 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:13.833060 7316 leader_election.cc:290] T 3919b15a00eb4fb08008f065f556c760 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:13.834578 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 585) took 1757 ms. Trace:
I20260923 19:50:13.835898 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet b529b0e82c5b48edac54cc281ac4b4a6
I20260923 19:50:13.836402 5796 catalog_manager.cc:6934] ReplaceTablet: tablet b529b0e82c5b48edac54cc281ac4b4a6 deleted and replaced by tablet 355346dce1954e93874a5cd756be8064
I20260923 19:50:13.836601 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet b529b0e82c5b48edac54cc281ac4b4a6 with delete_type TABLET_DATA_DELETED (replaced by tablet 355346dce1954e93874a5cd756be8064) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:13.836804 5800 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2fa50f80b71b4946a1b394196217b774 consensus state has no leader
I20260923 19:50:13.838043 6310 tablet_service.cc:1558] Processing DeleteTablet for tablet b529b0e82c5b48edac54cc281ac4b4a6 with delete_type TABLET_DATA_DELETED (replaced by tablet 355346dce1954e93874a5cd756be8064) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:13.838090 6168 tablet_service.cc:1558] Processing DeleteTablet for tablet b529b0e82c5b48edac54cc281ac4b4a6 with delete_type TABLET_DATA_DELETED (replaced by tablet 355346dce1954e93874a5cd756be8064) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:13.835057 6459 rpcz_store.cc:276] 0923 19:50:12.077397 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:12.121655 (+ 44258us) service_pool.cc:224] Handling call
0923 19:50:13.834036 (+1712381us) ts_tablet_manager.cc:1151] Deleting tablet bfe87e992ca04ea293e354da508e4c67
0923 19:50:13.834048 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.834558 (+ 510us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1585676}
W20260923 19:50:13.844681 5700 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 45605.2us
I20260923 19:50:13.845295 6457 tablet_bootstrap.cc:492] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:13.845440 6457 ts_tablet_manager.cc:1403] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.073s user 0.006s sys 0.017s
I20260923 19:50:13.846154 6457 raft_consensus.cc:359] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.846328 6457 raft_consensus.cc:385] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.846385 6457 raft_consensus.cc:740] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.846650 6457 consensus_queue.cc:260] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.847477 6457 ts_tablet_manager.cc:1434] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:50:13.847709 7211 raft_consensus.cc:493] T c504ec668a33451fb1249f697bb5e2bb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:13.847812 7211 raft_consensus.cc:515] T c504ec668a33451fb1249f697bb5e2bb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.848325 7211 leader_election.cc:290] T c504ec668a33451fb1249f697bb5e2bb P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:13.848623 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet bfe87e992ca04ea293e354da508e4c67 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bfe87e992ca04ea293e354da508e4c67 already in progress: creating tablet
I20260923 19:50:13.848905 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504ec668a33451fb1249f697bb5e2bb" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:13.849072 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 587) took 1553 ms. Trace:
I20260923 19:50:13.849156 6459 rpcz_store.cc:276] 0923 19:50:12.295477 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:12.297948 (+ 2471us) service_pool.cc:224] Handling call
0923 19:50:13.848930 (+1550982us) ts_tablet_manager.cc:1151] Deleting tablet e4ad9baac560463fabc80828074b46c1
0923 19:50:13.848942 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.849052 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1550706}
I20260923 19:50:13.849663 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 586) took 1728 ms. Trace:
W20260923 19:50:13.849742 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet e4ad9baac560463fabc80828074b46c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4ad9baac560463fabc80828074b46c1 already in progress: creating tablet
I20260923 19:50:13.849732 6459 rpcz_store.cc:276] 0923 19:50:12.121641 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:12.123069 (+ 1428us) service_pool.cc:224] Handling call
0923 19:50:13.849556 (+1726487us) ts_tablet_manager.cc:1151] Deleting tablet 688bb1055ba94c2996cdfea6dea76416
0923 19:50:13.849563 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.849645 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1545005}
I20260923 19:50:13.849973 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504ec668a33451fb1249f697bb5e2bb" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:13.850781 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 688bb1055ba94c2996cdfea6dea76416 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 688bb1055ba94c2996cdfea6dea76416 already in progress: creating tablet
W20260923 19:50:13.850853 5996 leader_election.cc:343] T c504ec668a33451fb1249f697bb5e2bb P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:13.851158 5995 leader_election.cc:343] T c504ec668a33451fb1249f697bb5e2bb P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:13.851253 5995 leader_election.cc:304] T c504ec668a33451fb1249f697bb5e2bb P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:13.851756 7211 raft_consensus.cc:2749] T c504ec668a33451fb1249f697bb5e2bb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:13.852592 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 595) took 1351 ms. Trace:
I20260923 19:50:13.852696 6456 tablet_bootstrap.cc:492] T 896bd068e6b343e48eb2a01679b49326 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:13.852715 6459 rpcz_store.cc:276] 0923 19:50:12.500751 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:12.511687 (+ 10936us) service_pool.cc:224] Handling call
0923 19:50:13.852288 (+1340601us) ts_tablet_manager.cc:1151] Deleting tablet 47c261638f0d48bb82c78c9a04d487b2
0923 19:50:13.852297 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.852574 (+ 277us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1326616}
I20260923 19:50:13.853101 7211 raft_consensus.cc:493] T 15a9d1d4adaa402f90d774e77010c928 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:13.853200 7211 raft_consensus.cc:515] T 15a9d1d4adaa402f90d774e77010c928 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:13.853387 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 47c261638f0d48bb82c78c9a04d487b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47c261638f0d48bb82c78c9a04d487b2 already in progress: creating tablet
I20260923 19:50:13.853752 7211 leader_election.cc:290] T 15a9d1d4adaa402f90d774e77010c928 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:13.834936 6454 tablet_bootstrap.cc:654] T fe5d081a41a3417b855656ca6e24f235 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.855268 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a9d1d4adaa402f90d774e77010c928" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:13.855849 5995 leader_election.cc:343] T 15a9d1d4adaa402f90d774e77010c928 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:13.855930 6457 tablet_bootstrap.cc:492] T e4f00490b0364f0e9f1b9569b870808e P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:13.856083 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 598) took 1314 ms. Trace:
I20260923 19:50:13.856199 6459 rpcz_store.cc:276] 0923 19:50:12.542135 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:12.542201 (+ 66us) service_pool.cc:224] Handling call
0923 19:50:13.855984 (+1313783us) ts_tablet_manager.cc:1151] Deleting tablet d2dd611746d741e88b6911bf5d51f3e5
0923 19:50:13.855992 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.856067 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1271074}
W20260923 19:50:13.856702 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet d2dd611746d741e88b6911bf5d51f3e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2dd611746d741e88b6911bf5d51f3e5 already in progress: creating tablet
I20260923 19:50:13.857065 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 596) took 1356 ms. Trace:
I20260923 19:50:13.857172 6459 rpcz_store.cc:276] 0923 19:50:12.500883 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:12.542443 (+ 41560us) service_pool.cc:224] Handling call
0923 19:50:13.856973 (+1314530us) ts_tablet_manager.cc:1151] Deleting tablet a4c5fdd14ecb467eadfd5036dfb3783f
0923 19:50:13.856982 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.857050 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1250831}
I20260923 19:50:13.857456 7050 fs_manager.cc:714] Time spent opening directory manager: real 0.123s user 0.003s sys 0.001s
I20260923 19:50:13.857568 6457 tablet_bootstrap.cc:654] T e4f00490b0364f0e9f1b9569b870808e P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:13.857645 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet a4c5fdd14ecb467eadfd5036dfb3783f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4c5fdd14ecb467eadfd5036dfb3783f already in progress: creating tablet
I20260923 19:50:13.857960 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 604) took 1008 ms. Trace:
I20260923 19:50:13.858037 6459 rpcz_store.cc:276] 0923 19:50:12.849909 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:12.850014 (+ 105us) service_pool.cc:224] Handling call
0923 19:50:13.857847 (+1007833us) ts_tablet_manager.cc:1151] Deleting tablet 559f3e3016aa470f9732a727b4528586
0923 19:50:13.857856 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.857946 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":998655}
I20260923 19:50:13.858213 7211 raft_consensus.cc:493] T 6238d16b1be74dd88fd2e089fbd85d33 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:13.858330 7211 raft_consensus.cc:515] T 6238d16b1be74dd88fd2e089fbd85d33 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:13.858867 7211 leader_election.cc:290] T 6238d16b1be74dd88fd2e089fbd85d33 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:13.859916 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 559f3e3016aa470f9732a727b4528586 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 559f3e3016aa470f9732a727b4528586 already in progress: creating tablet
I20260923 19:50:13.860219 6459 tablet_replica.cc:333] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:13.860448 6459 raft_consensus.cc:2243] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:13.860582 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238d16b1be74dd88fd2e089fbd85d33" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:13.860695 6459 raft_consensus.cc:2272] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:13.861074 5995 leader_election.cc:343] T 6238d16b1be74dd88fd2e089fbd85d33 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:13.854489 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a9d1d4adaa402f90d774e77010c928" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:13.861256 6459 ts_tablet_manager.cc:1916] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:13.859419 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238d16b1be74dd88fd2e089fbd85d33" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:13.861835 5996 leader_election.cc:343] T 15a9d1d4adaa402f90d774e77010c928 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:13.861958 5996 leader_election.cc:304] T 15a9d1d4adaa402f90d774e77010c928 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
W20260923 19:50:13.862306 5996 leader_election.cc:343] T 6238d16b1be74dd88fd2e089fbd85d33 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:13.862380 5996 leader_election.cc:304] T 6238d16b1be74dd88fd2e089fbd85d33 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:13.862664 7134 raft_consensus.cc:2749] T 15a9d1d4adaa402f90d774e77010c928 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:13.862784 7134 raft_consensus.cc:2749] T 6238d16b1be74dd88fd2e089fbd85d33 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:13.863195 6456 ts_tablet_manager.cc:1403] T 896bd068e6b343e48eb2a01679b49326 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.096s user 0.009s sys 0.013s
I20260923 19:50:13.863932 6456 raft_consensus.cc:359] T 896bd068e6b343e48eb2a01679b49326 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.864127 6456 raft_consensus.cc:385] T 896bd068e6b343e48eb2a01679b49326 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.864217 6456 raft_consensus.cc:740] T 896bd068e6b343e48eb2a01679b49326 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.864475 6456 consensus_queue.cc:260] T 896bd068e6b343e48eb2a01679b49326 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.865341 7211 raft_consensus.cc:493] T d09faa67bdc54d31a7f7a1b012de9ba1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:13.865450 7211 raft_consensus.cc:515] T d09faa67bdc54d31a7f7a1b012de9ba1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.865957 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_8eba59cb9a3843738a7bd980139febb7" } new_table_name: "default.Table_20b3800c0a01465585ccd87c3057f834" modify_external_catalogs: true
I20260923 19:50:13.866042 7211 leader_election.cc:290] T d09faa67bdc54d31a7f7a1b012de9ba1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:13.866783 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09faa67bdc54d31a7f7a1b012de9ba1" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:13.867453 5996 leader_election.cc:343] T d09faa67bdc54d31a7f7a1b012de9ba1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:13.867551 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09faa67bdc54d31a7f7a1b012de9ba1" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:13.868125 5995 leader_election.cc:343] T d09faa67bdc54d31a7f7a1b012de9ba1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:13.868218 5995 leader_election.cc:304] T d09faa67bdc54d31a7f7a1b012de9ba1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:13.868610 7211 raft_consensus.cc:2749] T d09faa67bdc54d31a7f7a1b012de9ba1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:13.868821 6456 ts_tablet_manager.cc:1434] T 896bd068e6b343e48eb2a01679b49326 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
W20260923 19:50:13.869319 5802 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 670d9cb0e6e2414092f72ffd5e6b00ea consensus state has no leader
I20260923 19:50:13.869649 6456 tablet_bootstrap.cc:492] T f5cb8dd5dcf54df9989dd808fe148ce6 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:13.870393 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_3630641bfa6e48de9885dffe4112a74e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:13.870963 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3630641bfa6e48de9885dffe4112a74e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:13.872687 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 13b21aadd7464b1aa2afe7a1ebc9e77f consensus state has no leader
I20260923 19:50:13.876488 6456 tablet_bootstrap.cc:654] T f5cb8dd5dcf54df9989dd808fe148ce6 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.878957 6461 ts_tablet_manager.cc:1929] T 556b32b8ccd54c439f86b0069e2a5ce0 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:50:13.884539 6457 tablet_bootstrap.cc:492] T e4f00490b0364f0e9f1b9569b870808e P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:13.886116 6457 ts_tablet_manager.cc:1403] T e4f00490b0364f0e9f1b9569b870808e P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.004s
I20260923 19:50:13.886287 6461 log.cc:1199] T 556b32b8ccd54c439f86b0069e2a5ce0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/556b32b8ccd54c439f86b0069e2a5ce0
I20260923 19:50:13.886754 5803 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 2db82e6f314f412385b41720c7efdef5 (table default.Table_fa1d82a491c04ba89f5cf3162578d550 [id=6d79e588fb9e4936aedf8cd500f68d60]). Expected version 3 got 0
I20260923 19:50:13.887049 6457 raft_consensus.cc:359] T e4f00490b0364f0e9f1b9569b870808e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.887221 6457 raft_consensus.cc:385] T e4f00490b0364f0e9f1b9569b870808e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.887279 6457 raft_consensus.cc:740] T e4f00490b0364f0e9f1b9569b870808e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.887526 6457 consensus_queue.cc:260] T e4f00490b0364f0e9f1b9569b870808e P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.887791 6461 ts_tablet_manager.cc:1950] T 556b32b8ccd54c439f86b0069e2a5ce0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:13.889366 6459 ts_tablet_manager.cc:1929] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:50:13.889470 6459 log.cc:1199] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/5adadf8caf5e4a9ab1107d0fb6a91735
I20260923 19:50:13.890110 6461 tablet_replica.cc:333] T c19298691d5d4209b2d1147a1aad2f6f P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:13.890350 6461 raft_consensus.cc:2243] T c19298691d5d4209b2d1147a1aad2f6f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:13.890833 6461 raft_consensus.cc:2272] T c19298691d5d4209b2d1147a1aad2f6f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:13.890686 5797 catalog_manager.cc:5838] T 2db82e6f314f412385b41720c7efdef5 P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:13.891108 5797 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 2db82e6f314f412385b41720c7efdef5 (table default.Table_fa1d82a491c04ba89f5cf3162578d550 [id=6d79e588fb9e4936aedf8cd500f68d60]). Expected version 3 got 0
I20260923 19:50:13.891420 6461 ts_tablet_manager.cc:1916] T c19298691d5d4209b2d1147a1aad2f6f P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:13.891336 5797 catalog_manager.cc:5838] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:13.891639 5797 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 0d70deeda179486291195476e47a9ae6 (table default.Table_d130b4b675a14c5a86ff587918d83d7c [id=d1e262e6e34742538b2b26c5fae80a99]). Expected version 1 got 0
I20260923 19:50:13.893116 6459 ts_tablet_manager.cc:1950] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:13.894047 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 556b32b8ccd54c439f86b0069e2a5ce0 (table default.Table_bae34ce3ce95493d81bcd45d6806c756 [id=f329852cd968475584a70fbb8b1b1c3c]) successfully deleted
I20260923 19:50:13.894317 6458 ts_tablet_manager.cc:1929] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:50:13.894419 6458 log.cc:1199] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/5adadf8caf5e4a9ab1107d0fb6a91735
I20260923 19:50:13.894793 6458 ts_tablet_manager.cc:1950] T 5adadf8caf5e4a9ab1107d0fb6a91735 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:13.895005 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 603) took 1045 ms. Trace:
I20260923 19:50:13.895088 6459 rpcz_store.cc:276] 0923 19:50:12.849759 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:12.849985 (+ 226us) service_pool.cc:224] Handling call
0923 19:50:13.860178 (+1010193us) ts_tablet_manager.cc:1151] Deleting tablet 5adadf8caf5e4a9ab1107d0fb6a91735
0923 19:50:13.860188 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.865238 (+ 5050us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:13.889311 (+ 24073us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:13.894981 (+ 5670us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1000812}
I20260923 19:50:13.895776 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_4761dd5028c84fd1beaa780170cbec4e" } modify_external_catalogs: true
I20260923 19:50:13.895943 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_4761dd5028c84fd1beaa780170cbec4e" } modify_external_catalogs: true
I20260923 19:50:13.890702 6457 ts_tablet_manager.cc:1434] T e4f00490b0364f0e9f1b9569b870808e P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260923 19:50:13.896574 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_9c0e162f59774279a9e240130af9e199"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:13.897186 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9c0e162f59774279a9e240130af9e199 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:13.898008 6457 tablet_bootstrap.cc:492] T a53f2eb08330411ebe417d4e1e414db6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:13.898693 6459 tablet_replica.cc:333] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:13.899108 6459 raft_consensus.cc:2243] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:13.900049 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_d9ebca389fa642cda383e62c5e7fae3a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:13.900214 6459 pending_rounds.cc:70] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:13.900259 6459 pending_rounds.cc:77] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630580843220992 op_type: NO_OP noop_request { }
I20260923 19:50:13.900336 6459 raft_consensus.cc:2889] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:13.900408 6459 raft_consensus.cc:2272] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:13.900555 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d9ebca389fa642cda383e62c5e7fae3a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:13.902137 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 5adadf8caf5e4a9ab1107d0fb6a91735 (table default.Table_bb0cff9e9bcd4de98b915af1c7e3bca2 [id=738ed1d070ef485e9299c1f3b1db008a]) successfully deleted
I20260923 19:50:13.902257 6457 tablet_bootstrap.cc:654] T a53f2eb08330411ebe417d4e1e414db6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.901865 6459 ts_tablet_manager.cc:1916] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:13.909988 6461 ts_tablet_manager.cc:1929] T c19298691d5d4209b2d1147a1aad2f6f P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:13.910475 6168 tablet_service.cc:1511] Processing CreateTablet for tablet e076b89526a24344bea591eccfdde1e9 (DEFAULT_TABLE table=default.Table_7f31586785874f0995ea2cb31c2796e2 [id=9a8d3decee6c4df49f5cf778e0a66777]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.911026 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e076b89526a24344bea591eccfdde1e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.913352 6456 tablet_bootstrap.cc:492] T f5cb8dd5dcf54df9989dd808fe148ce6 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:13.913491 6456 ts_tablet_manager.cc:1403] T f5cb8dd5dcf54df9989dd808fe148ce6 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.044s user 0.003s sys 0.002s
I20260923 19:50:13.913969 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 589) took 1083 ms. Trace:
I20260923 19:50:13.914054 6458 rpcz_store.cc:276] 0923 19:50:12.830735 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:12.830799 (+ 64us) service_pool.cc:224] Handling call
0923 19:50:13.820985 (+990186us) ts_tablet_manager.cc:1151] Deleting tablet 5adadf8caf5e4a9ab1107d0fb6a91735
0923 19:50:13.820993 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.874967 (+ 53974us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:13.894254 (+ 19287us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:13.913950 (+ 19696us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":989927}
I20260923 19:50:13.914295 6456 raft_consensus.cc:359] T f5cb8dd5dcf54df9989dd808fe148ce6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.914551 6456 raft_consensus.cc:385] T f5cb8dd5dcf54df9989dd808fe148ce6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.914572 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 5adadf8caf5e4a9ab1107d0fb6a91735 (table default.Table_bb0cff9e9bcd4de98b915af1c7e3bca2 [id=738ed1d070ef485e9299c1f3b1db008a]) successfully deleted
I20260923 19:50:13.914660 6456 raft_consensus.cc:740] T f5cb8dd5dcf54df9989dd808fe148ce6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.914866 6456 consensus_queue.cc:260] T f5cb8dd5dcf54df9989dd808fe148ce6 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.915061 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 590) took 1079 ms. Trace:
I20260923 19:50:13.915134 6458 rpcz_store.cc:276] 0923 19:50:12.835890 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:12.835959 (+ 69us) service_pool.cc:224] Handling call
0923 19:50:13.914934 (+1078975us) ts_tablet_manager.cc:1151] Deleting tablet 559f3e3016aa470f9732a727b4528586
0923 19:50:13.914944 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.915047 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1078738}
W20260923 19:50:13.915602 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 559f3e3016aa470f9732a727b4528586 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 559f3e3016aa470f9732a727b4528586 already in progress: creating tablet
I20260923 19:50:13.916354 6459 ts_tablet_manager.cc:1929] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:13.916450 6459 log.cc:1199] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/6e781ccf4aa343fc924138c3cc2b04e6
I20260923 19:50:13.916796 6459 ts_tablet_manager.cc:1950] T 6e781ccf4aa343fc924138c3cc2b04e6 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:13.917573 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 605) took 1058 ms. Trace:
I20260923 19:50:13.917821 6456 ts_tablet_manager.cc:1434] T f5cb8dd5dcf54df9989dd808fe148ce6 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260923 19:50:13.918298 6456 tablet_bootstrap.cc:492] T 58c24aa494bc4da28536dfa1df6123b7 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:13.919981 6456 tablet_bootstrap.cc:654] T 58c24aa494bc4da28536dfa1df6123b7 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:13.924732 5800 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2bc47336948746d694d5a896730c501c consensus state has no leader
I20260923 19:50:13.925179 6461 log.cc:1199] T c19298691d5d4209b2d1147a1aad2f6f P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/c19298691d5d4209b2d1147a1aad2f6f
I20260923 19:50:13.925971 6461 ts_tablet_manager.cc:1950] T c19298691d5d4209b2d1147a1aad2f6f P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
W20260923 19:50:13.925990 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet d6d3601a392f4723b4ca00f6e12b950c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d6d3601a392f4723b4ca00f6e12b950c already in progress: creating tablet
W20260923 19:50:13.926788 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet e996910398694686bd68ef31239ed15f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e996910398694686bd68ef31239ed15f already in progress: creating tablet
W20260923 19:50:13.927403 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet fc151f4d78344efeada6d6e57af6eb9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc151f4d78344efeada6d6e57af6eb9f already in progress: creating tablet
W20260923 19:50:13.928061 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 7539bd538c6343eda16bedfdf8545316 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7539bd538c6343eda16bedfdf8545316 already in progress: creating tablet
W20260923 19:50:13.928633 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet ccbb8cd687924f0892464c6cb80d175c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ccbb8cd687924f0892464c6cb80d175c already in progress: creating tablet
I20260923 19:50:13.931293 5800 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d115f4f641e04087a0ed990be1431c58" } modify_external_catalogs: true
I20260923 19:50:13.931476 6461 tablet_replica.cc:333] T 6a2564a99c274e07a7e43da739a2458b P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:13.931639 6458 tablet_replica.cc:333] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:13.931892 6458 raft_consensus.cc:2243] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:13.931919 5800 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d115f4f641e04087a0ed990be1431c58" } modify_external_catalogs: true
I20260923 19:50:13.932108 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet c19298691d5d4209b2d1147a1aad2f6f (table default.Table_22f84157ac664f81ae5266143e743737 [id=4bf839f09513412ea20c5e0afece9c37]) successfully deleted
I20260923 19:50:13.932261 6458 raft_consensus.cc:2272] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:13.932519 6459 rpcz_store.cc:276] 0923 19:50:12.859525 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:12.859651 (+ 126us) service_pool.cc:224] Handling call
0923 19:50:13.898637 (+1038986us) ts_tablet_manager.cc:1151] Deleting tablet 6e781ccf4aa343fc924138c3cc2b04e6
0923 19:50:13.898650 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:13.905830 (+ 7180us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:13.916306 (+ 10476us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:13.917551 (+ 1245us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1038823}
I20260923 19:50:13.931640 6030 tablet_service.cc:1558] Processing DeleteTablet for tablet c504ec668a33451fb1249f697bb5e2bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:13.931744 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet 58ea466d1b2b40e9b9b4cd5be51f79e0 with delete_type TABLET_DATA_DELETED (replaced by tablet 839bcf991b754f9e95a1dd6c4f826e71) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:13.931844 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 15a9d1d4adaa402f90d774e77010c928 with delete_type TABLET_DATA_DELETED (replaced by tablet 1cf016ff0bb8418d84358d17876338bf) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:13.933380 6461 raft_consensus.cc:2243] T 6a2564a99c274e07a7e43da739a2458b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:13.934121 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 6e781ccf4aa343fc924138c3cc2b04e6 (table default.Table_973ceea94f2e4c6da7b1c722b99ac413 [id=c9f541017259420e858a2982f3e32141]) successfully deleted
I20260923 19:50:13.934180 6461 raft_consensus.cc:2272] T 6a2564a99c274e07a7e43da739a2458b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:13.934263 6458 ts_tablet_manager.cc:1916] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:13.934680 6461 ts_tablet_manager.cc:1916] T 6a2564a99c274e07a7e43da739a2458b P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:13.936105 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet d6d3601a392f4723b4ca00f6e12b950c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d6d3601a392f4723b4ca00f6e12b950c already in progress: creating tablet
W20260923 19:50:13.936512 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet e996910398694686bd68ef31239ed15f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e996910398694686bd68ef31239ed15f already in progress: creating tablet
W20260923 19:50:13.937034 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet fc151f4d78344efeada6d6e57af6eb9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc151f4d78344efeada6d6e57af6eb9f already in progress: creating tablet
I20260923 19:50:13.937772 7256 raft_consensus.cc:493] T d2298d814a104f5cb62196be3bf0dae6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:13.937938 7256 raft_consensus.cc:515] T d2298d814a104f5cb62196be3bf0dae6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.938283 6028 tablet_service.cc:1511] Processing CreateTablet for tablet e076b89526a24344bea591eccfdde1e9 (DEFAULT_TABLE table=default.Table_7f31586785874f0995ea2cb31c2796e2 [id=9a8d3decee6c4df49f5cf778e0a66777]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.938472 6168 tablet_service.cc:1511] Processing CreateTablet for tablet 0323bfd60533432ebcf971ba050f2938 (DEFAULT_TABLE table=default.Table_56a69b63c77e409183883ea97ef06328 [id=75cd65eec1684478a3240fb57a7f131a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.938524 7256 leader_election.cc:290] T d2298d814a104f5cb62196be3bf0dae6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:13.938650 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e076b89526a24344bea591eccfdde1e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.938855 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0323bfd60533432ebcf971ba050f2938. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.938961 6310 tablet_service.cc:1511] Processing CreateTablet for tablet e076b89526a24344bea591eccfdde1e9 (DEFAULT_TABLE table=default.Table_7f31586785874f0995ea2cb31c2796e2 [id=9a8d3decee6c4df49f5cf778e0a66777]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.939280 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e076b89526a24344bea591eccfdde1e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:13.941821 7332 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 19:50:13.942147 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 0323bfd60533432ebcf971ba050f2938 (DEFAULT_TABLE table=default.Table_56a69b63c77e409183883ea97ef06328 [id=75cd65eec1684478a3240fb57a7f131a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.942474 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0323bfd60533432ebcf971ba050f2938. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:13.943699 6279 leader_election.cc:343] T d2298d814a104f5cb62196be3bf0dae6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: d2298d814a104f5cb62196be3bf0dae6
I20260923 19:50:13.944497 6317 tablet_service.cc:1511] Processing CreateTablet for tablet 0323bfd60533432ebcf971ba050f2938 (DEFAULT_TABLE table=default.Table_56a69b63c77e409183883ea97ef06328 [id=75cd65eec1684478a3240fb57a7f131a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:13.944839 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0323bfd60533432ebcf971ba050f2938. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:13.944795 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet ccbb8cd687924f0892464c6cb80d175c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ccbb8cd687924f0892464c6cb80d175c already in progress: creating tablet
W20260923 19:50:13.945492 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 7539bd538c6343eda16bedfdf8545316 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7539bd538c6343eda16bedfdf8545316 already in progress: creating tablet
I20260923 19:50:13.945811 6459 tablet_replica.cc:333] T 556b32b8ccd54c439f86b0069e2a5ce0 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:13.946062 6459 raft_consensus.cc:2243] T 556b32b8ccd54c439f86b0069e2a5ce0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:13.946038 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2298d814a104f5cb62196be3bf0dae6" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:13.946280 6459 raft_consensus.cc:2272] T 556b32b8ccd54c439f86b0069e2a5ce0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:13.946753 6280 leader_election.cc:343] T d2298d814a104f5cb62196be3bf0dae6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:13.946875 6280 leader_election.cc:304] T d2298d814a104f5cb62196be3bf0dae6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:13.946906 6459 ts_tablet_manager.cc:1916] T 556b32b8ccd54c439f86b0069e2a5ce0 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:13.947343 7256 raft_consensus.cc:2749] T d2298d814a104f5cb62196be3bf0dae6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:13.949666 6454 tablet_bootstrap.cc:492] T fe5d081a41a3417b855656ca6e24f235 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:13.949791 6454 ts_tablet_manager.cc:1403] T fe5d081a41a3417b855656ca6e24f235 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.118s user 0.012s sys 0.009s
I20260923 19:50:13.950652 6454 raft_consensus.cc:359] T fe5d081a41a3417b855656ca6e24f235 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.950887 6454 raft_consensus.cc:385] T fe5d081a41a3417b855656ca6e24f235 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.950994 6454 raft_consensus.cc:740] T fe5d081a41a3417b855656ca6e24f235 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.951623 6454 consensus_queue.cc:260] T fe5d081a41a3417b855656ca6e24f235 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.952715 6454 ts_tablet_manager.cc:1434] T fe5d081a41a3417b855656ca6e24f235 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260923 19:50:13.953028 6454 tablet_bootstrap.cc:492] T a08446fcf1794dab9d3181904507456f P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:13.955624 6454 tablet_bootstrap.cc:654] T a08446fcf1794dab9d3181904507456f P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.959126 6457 tablet_bootstrap.cc:492] T a53f2eb08330411ebe417d4e1e414db6 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:13.959321 6457 ts_tablet_manager.cc:1403] T a53f2eb08330411ebe417d4e1e414db6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.062s user 0.004s sys 0.004s
I20260923 19:50:13.960071 6457 raft_consensus.cc:359] T a53f2eb08330411ebe417d4e1e414db6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.960301 6457 raft_consensus.cc:385] T a53f2eb08330411ebe417d4e1e414db6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.960398 6457 raft_consensus.cc:740] T a53f2eb08330411ebe417d4e1e414db6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.962335 6457 consensus_queue.cc:260] T a53f2eb08330411ebe417d4e1e414db6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.964982 6459 ts_tablet_manager.cc:1929] T 556b32b8ccd54c439f86b0069e2a5ce0 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:50:13.965533 6457 ts_tablet_manager.cc:1434] T a53f2eb08330411ebe417d4e1e414db6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260923 19:50:13.967474 6456 tablet_bootstrap.cc:492] T 58c24aa494bc4da28536dfa1df6123b7 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:13.967684 6456 ts_tablet_manager.cc:1403] T 58c24aa494bc4da28536dfa1df6123b7 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.049s user 0.005s sys 0.003s
I20260923 19:50:13.968498 6456 raft_consensus.cc:359] T 58c24aa494bc4da28536dfa1df6123b7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.968904 5796 master_service.cc:960] ReplaceTablet: received request to replace tablet ec4cc8a742114e5fb07c5c9157ce09e8 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:13.970527 6456 raft_consensus.cc:385] T 58c24aa494bc4da28536dfa1df6123b7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:13.970611 6456 raft_consensus.cc:740] T 58c24aa494bc4da28536dfa1df6123b7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:13.972045 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_c5c45e9fda2041f4bbb52be7e6cbf9df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:13.972425 6459 log.cc:1199] T 556b32b8ccd54c439f86b0069e2a5ce0 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/556b32b8ccd54c439f86b0069e2a5ce0
W20260923 19:50:13.972749 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c5c45e9fda2041f4bbb52be7e6cbf9df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:13.972831 6459 ts_tablet_manager.cc:1950] T 556b32b8ccd54c439f86b0069e2a5ce0 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:13.974560 6458 ts_tablet_manager.cc:1929] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:50:13.974658 6458 log.cc:1199] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/556b32b8ccd54c439f86b0069e2a5ce0
I20260923 19:50:13.974640 5799 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 0d70deeda179486291195476e47a9ae6 (table default.Table_d130b4b675a14c5a86ff587918d83d7c [id=d1e262e6e34742538b2b26c5fae80a99]). Expected version 1 got 0
I20260923 19:50:13.975292 6456 consensus_queue.cc:260] T 58c24aa494bc4da28536dfa1df6123b7 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:13.975875 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_7b56764bac484738b24f3afc0b871751"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:13.976406 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b56764bac484738b24f3afc0b871751 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:13.977792 6456 ts_tablet_manager.cc:1434] T 58c24aa494bc4da28536dfa1df6123b7 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260923 19:50:13.978086 6456 tablet_bootstrap.cc:492] T 1fcd1c1bfd2c437a955c34569605a6d4 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:13.978308 6317 tablet_service.cc:1558] Processing DeleteTablet for tablet 623052a8c9c2436a828655da6cf6d379 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:13.978363 6459 tablet_replica.cc:333] T 31b0bdf719554d37993a802831e324ee P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:13.978552 6459 raft_consensus.cc:2243] T 31b0bdf719554d37993a802831e324ee P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:13.978608 6310 tablet_service.cc:1558] Processing DeleteTablet for tablet f1a4bccf6dd2411f83b86d782ecf5f40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:13.978796 6459 pending_rounds.cc:70] T 31b0bdf719554d37993a802831e324ee P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:13.981662 6456 tablet_bootstrap.cc:654] T 1fcd1c1bfd2c437a955c34569605a6d4 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:13.982273 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet e4f00490b0364f0e9f1b9569b870808e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:13.982615 6459 pending_rounds.cc:77] T 31b0bdf719554d37993a802831e324ee P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630582813257728 op_type: NO_OP noop_request { }
I20260923 19:50:13.982918 6459 raft_consensus.cc:2889] T 31b0bdf719554d37993a802831e324ee P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:13.984053 6459 raft_consensus.cc:2272] T 31b0bdf719554d37993a802831e324ee P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:13.985498 6461 ts_tablet_manager.cc:1929] T 6a2564a99c274e07a7e43da739a2458b P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:13.985669 6458 ts_tablet_manager.cc:1950] T 556b32b8ccd54c439f86b0069e2a5ce0 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:13.985680 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 556b32b8ccd54c439f86b0069e2a5ce0 (table default.Table_bae34ce3ce95493d81bcd45d6806c756 [id=f329852cd968475584a70fbb8b1b1c3c]) successfully deleted
I20260923 19:50:13.985723 6459 ts_tablet_manager.cc:1916] T 31b0bdf719554d37993a802831e324ee P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:13.985767 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet e071b9dd1db44af0a9d1b9e904f875a5 with delete_type TABLET_DATA_DELETED (replaced by tablet b18548ba557f448880c5e617fc03cbe0) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:13.985967 5791 catalog_manager.cc:5030] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet c48d4a8371fa4454b7c67291db3ab796 because the tablet was not found. No further retry: Not found: Tablet not found: c48d4a8371fa4454b7c67291db3ab796
W20260923 19:50:13.986184 5791 catalog_manager.cc:5030] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 015c14b447fe4cd18d197b2d1ed5884e because the tablet was not found. No further retry: Not found: Tablet not found: 015c14b447fe4cd18d197b2d1ed5884e
I20260923 19:50:13.986451 6168 tablet_service.cc:1558] Processing DeleteTablet for tablet b985acc650334497832cf4505e1b0043 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:13.988683 6461 log.cc:1199] T 6a2564a99c274e07a7e43da739a2458b P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/6a2564a99c274e07a7e43da739a2458b
I20260923 19:50:13.988713 6200 raft_consensus.cc:3060] T b529b0e82c5b48edac54cc281ac4b4a6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:13.989086 6461 ts_tablet_manager.cc:1950] T 6a2564a99c274e07a7e43da739a2458b P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:13.989682 7050 fs_manager.cc:730] Time spent opening block manager: real 0.130s user 0.004s sys 0.000s
I20260923 19:50:13.990063 6458 tablet_replica.cc:333] T 194494af2c424a55a772f3858af63c2c P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:13.990293 6458 raft_consensus.cc:2243] T 194494af2c424a55a772f3858af63c2c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:13.989945 7050 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-0/data,/tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-0/wal
uuid: "6b3d628214a34b4fa3ca0c1abe422bae"
format_stamp: "Formatted at 2026-09-23 19:49:54 on dist-test-slave-th4g"
I20260923 19:50:13.991081 6458 raft_consensus.cc:2272] T 194494af2c424a55a772f3858af63c2c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:13.990968 7050 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 19:50:13.991899 6458 ts_tablet_manager.cc:1916] T 194494af2c424a55a772f3858af63c2c P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:13.992539 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 556b32b8ccd54c439f86b0069e2a5ce0 (table default.Table_bae34ce3ce95493d81bcd45d6806c756 [id=f329852cd968475584a70fbb8b1b1c3c]) successfully deleted
I20260923 19:50:13.996162 6457 tablet_bootstrap.cc:492] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
W20260923 19:50:13.996832 5791 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 8fd7e98016ca4e168979d7f7411e525a (table default.Table_74f45a860df845a484035e5b23fd874e [id=31a784a213474423bd58ccc26e459b31], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8fd7e98016ca4e168979d7f7411e525a consensus state has no leader
I20260923 19:50:13.998266 6461 tablet_replica.cc:333] T efc63a151f6444dfb03c3f15f6f54473 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:13.998615 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 6a2564a99c274e07a7e43da739a2458b (table default.Table_504b18d33ff6487da9b8f40467850853 [id=97f3cda15d6f4e258eece32745c45b50]) successfully deleted
I20260923 19:50:13.998508 6461 raft_consensus.cc:2243] T efc63a151f6444dfb03c3f15f6f54473 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:13.998852 6461 raft_consensus.cc:2272] T efc63a151f6444dfb03c3f15f6f54473 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:14.000227 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 771ad1e82bd743e597aefe5edafe63ea (DEFAULT_TABLE table=default.Table_69a0d472f9674736bf0d2560edc30b20 [id=69c9224863e74397887508bd35bd0a5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.000350 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 771ad1e82bd743e597aefe5edafe63ea (DEFAULT_TABLE table=default.Table_69a0d472f9674736bf0d2560edc30b20 [id=69c9224863e74397887508bd35bd0a5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.000583 6168 tablet_service.cc:1511] Processing CreateTablet for tablet 771ad1e82bd743e597aefe5edafe63ea (DEFAULT_TABLE table=default.Table_69a0d472f9674736bf0d2560edc30b20 [id=69c9224863e74397887508bd35bd0a5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.000771 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 771ad1e82bd743e597aefe5edafe63ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.000873 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 771ad1e82bd743e597aefe5edafe63ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.001004 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 771ad1e82bd743e597aefe5edafe63ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.007022 6461 ts_tablet_manager.cc:1916] T efc63a151f6444dfb03c3f15f6f54473 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:14.009749 6459 ts_tablet_manager.cc:1929] T 31b0bdf719554d37993a802831e324ee P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:14.011566 6459 log.cc:1199] T 31b0bdf719554d37993a802831e324ee P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/31b0bdf719554d37993a802831e324ee
I20260923 19:50:14.012144 6459 ts_tablet_manager.cc:1950] T 31b0bdf719554d37993a802831e324ee P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:14.012279 6457 tablet_bootstrap.cc:654] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:14.016592 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 31b0bdf719554d37993a802831e324ee (table default.Table_b28fac33a5bd4feea5ac2c04b2bcecc4 [id=bf8666274f50416b80fcd282e4d1e2a3]) successfully deleted
I20260923 19:50:14.017194 6461 ts_tablet_manager.cc:1929] T efc63a151f6444dfb03c3f15f6f54473 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:14.017805 6459 tablet_replica.cc:333] T 6fe14389e2a3487587dfcf7a8b4b242d P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:14.018206 6459 raft_consensus.cc:2243] T 6fe14389e2a3487587dfcf7a8b4b242d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:14.018603 6459 raft_consensus.cc:2272] T 6fe14389e2a3487587dfcf7a8b4b242d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:14.020239 6459 ts_tablet_manager.cc:1916] T 6fe14389e2a3487587dfcf7a8b4b242d P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:14.023356 6458 ts_tablet_manager.cc:1929] T 194494af2c424a55a772f3858af63c2c P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:14.023471 6458 log.cc:1199] T 194494af2c424a55a772f3858af63c2c P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/194494af2c424a55a772f3858af63c2c
I20260923 19:50:14.023764 6458 ts_tablet_manager.cc:1950] T 194494af2c424a55a772f3858af63c2c P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:14.024595 6458 tablet_replica.cc:333] T e071b9dd1db44af0a9d1b9e904f875a5 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:14.024792 6458 raft_consensus.cc:2243] T e071b9dd1db44af0a9d1b9e904f875a5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:14.024791 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 194494af2c424a55a772f3858af63c2c (table default.Table_41c2e67e9c7e4fa192fc124e05c2d34f [id=b5209bbe29cb42e6b2473caddc119f44]) successfully deleted
I20260923 19:50:14.024940 6458 raft_consensus.cc:2272] T e071b9dd1db44af0a9d1b9e904f875a5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:14.025451 6458 ts_tablet_manager.cc:1916] T e071b9dd1db44af0a9d1b9e904f875a5 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:14.026686 6456 tablet_bootstrap.cc:492] T 1fcd1c1bfd2c437a955c34569605a6d4 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:14.026809 6456 ts_tablet_manager.cc:1403] T 1fcd1c1bfd2c437a955c34569605a6d4 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.049s user 0.005s sys 0.000s
I20260923 19:50:14.027463 6456 raft_consensus.cc:359] T 1fcd1c1bfd2c437a955c34569605a6d4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.027638 6456 raft_consensus.cc:385] T 1fcd1c1bfd2c437a955c34569605a6d4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:14.027688 6456 raft_consensus.cc:740] T 1fcd1c1bfd2c437a955c34569605a6d4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:14.027905 6456 consensus_queue.cc:260] T 1fcd1c1bfd2c437a955c34569605a6d4 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.030973 6456 ts_tablet_manager.cc:1434] T 1fcd1c1bfd2c437a955c34569605a6d4 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260923 19:50:14.031903 6456 tablet_bootstrap.cc:492] T 7b455812687f42848df5290d0cdbc312 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:14.036895 7316 raft_consensus.cc:493] T 194494af2c424a55a772f3858af63c2c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.037081 7316 raft_consensus.cc:515] T 194494af2c424a55a772f3858af63c2c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.037802 7316 leader_election.cc:290] T 194494af2c424a55a772f3858af63c2c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:14.038056 6456 tablet_bootstrap.cc:654] T 7b455812687f42848df5290d0cdbc312 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:14.038954 6139 leader_election.cc:343] T 194494af2c424a55a772f3858af63c2c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 194494af2c424a55a772f3858af63c2c
W20260923 19:50:14.040031 6137 leader_election.cc:343] T 194494af2c424a55a772f3858af63c2c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 194494af2c424a55a772f3858af63c2c
I20260923 19:50:14.040140 6137 leader_election.cc:304] T 194494af2c424a55a772f3858af63c2c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:14.040494 7316 raft_consensus.cc:2749] T 194494af2c424a55a772f3858af63c2c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:14.035034 6457 tablet_bootstrap.cc:492] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:14.044785 6457 ts_tablet_manager.cc:1403] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.049s user 0.002s sys 0.002s
I20260923 19:50:14.046207 6457 raft_consensus.cc:359] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.046733 6034 tablet_service.cc:1511] Processing CreateTablet for tablet fc068b844f6c440f9d13c9cff80cae2e (DEFAULT_TABLE table=default.Table_8d806c3e0bb046baa472f015d9a750a3 [id=0ad56666d300414882a85db166bc9411]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.047076 6317 tablet_service.cc:1511] Processing CreateTablet for tablet d974e61270dd409982af4491aeb8c37b (DEFAULT_TABLE table=default.Table_d4465060b0834069ae08a025e1b6f146 [id=fb9f3f4e429a476d90c95af76eb78859]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.047166 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc068b844f6c440f9d13c9cff80cae2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.047416 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d974e61270dd409982af4491aeb8c37b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.051054 6181 tablet_service.cc:1511] Processing CreateTablet for tablet d974e61270dd409982af4491aeb8c37b (DEFAULT_TABLE table=default.Table_d4465060b0834069ae08a025e1b6f146 [id=fb9f3f4e429a476d90c95af76eb78859]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.051432 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d974e61270dd409982af4491aeb8c37b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.053862 6457 raft_consensus.cc:385] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:14.053970 6457 raft_consensus.cc:740] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:14.054152 6457 consensus_queue.cc:260] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.054412 7211 raft_consensus.cc:493] T 474e34e902064764864ba06ef41b1d94 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.054509 7211 raft_consensus.cc:515] T 474e34e902064764864ba06ef41b1d94 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.055085 7211 leader_election.cc:290] T 474e34e902064764864ba06ef41b1d94 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:14.057647 6168 tablet_service.cc:1511] Processing CreateTablet for tablet fc068b844f6c440f9d13c9cff80cae2e (DEFAULT_TABLE table=default.Table_8d806c3e0bb046baa472f015d9a750a3 [id=0ad56666d300414882a85db166bc9411]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.057497 6457 ts_tablet_manager.cc:1434] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260923 19:50:14.058229 6457 tablet_bootstrap.cc:492] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:14.058377 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "474e34e902064764864ba06ef41b1d94" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:14.059929 5996 leader_election.cc:343] T 474e34e902064764864ba06ef41b1d94 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.060672 6457 tablet_bootstrap.cc:654] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:14.063217 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 2e1c19a751904a6295897376e9c5ee56
I20260923 19:50:14.064476 6314 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e1c19a751904a6295897376e9c5ee56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:14.065220 6310 tablet_service.cc:1511] Processing CreateTablet for tablet fc068b844f6c440f9d13c9cff80cae2e (DEFAULT_TABLE table=default.Table_8d806c3e0bb046baa472f015d9a750a3 [id=0ad56666d300414882a85db166bc9411]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.065303 6461 log.cc:1199] T efc63a151f6444dfb03c3f15f6f54473 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/efc63a151f6444dfb03c3f15f6f54473
I20260923 19:50:14.065630 6461 ts_tablet_manager.cc:1950] T efc63a151f6444dfb03c3f15f6f54473 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:14.066128 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e1c19a751904a6295897376e9c5ee56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:14.066532 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc068b844f6c440f9d13c9cff80cae2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.067392 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet efc63a151f6444dfb03c3f15f6f54473 (table default.Table_ee5fbb39c54a49c89eaaff48f72a9c3c [id=20b663f1b2504d4199c2a9a2e9667d5c]) successfully deleted
I20260923 19:50:14.067677 6461 tablet_replica.cc:333] T edb52bd88b424129bbdc45de89b56efb P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:14.067898 6461 raft_consensus.cc:2243] T edb52bd88b424129bbdc45de89b56efb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:14.068094 6461 raft_consensus.cc:2272] T edb52bd88b424129bbdc45de89b56efb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:14.068634 6461 ts_tablet_manager.cc:1916] T edb52bd88b424129bbdc45de89b56efb P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:14.072846 6457 tablet_bootstrap.cc:492] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:14.073029 6457 ts_tablet_manager.cc:1403] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.000s
I20260923 19:50:14.073769 6457 raft_consensus.cc:359] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.075153 6457 raft_consensus.cc:385] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:14.075263 6457 raft_consensus.cc:740] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:14.075538 6457 consensus_queue.cc:260] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.059548 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "474e34e902064764864ba06ef41b1d94" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:14.062685 6454 tablet_bootstrap.cc:492] T a08446fcf1794dab9d3181904507456f P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:14.078779 6454 ts_tablet_manager.cc:1403] T a08446fcf1794dab9d3181904507456f P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.126s user 0.009s sys 0.014s
W20260923 19:50:14.079610 5995 leader_election.cc:343] T 474e34e902064764864ba06ef41b1d94 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.079692 6457 ts_tablet_manager.cc:1434] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260923 19:50:14.079728 5995 leader_election.cc:304] T 474e34e902064764864ba06ef41b1d94 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:14.080009 7134 raft_consensus.cc:2749] T 474e34e902064764864ba06ef41b1d94 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:14.079995 6454 raft_consensus.cc:359] T a08446fcf1794dab9d3181904507456f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.080163 6454 raft_consensus.cc:385] T a08446fcf1794dab9d3181904507456f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:14.080211 6454 raft_consensus.cc:740] T a08446fcf1794dab9d3181904507456f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:14.080524 6454 consensus_queue.cc:260] T a08446fcf1794dab9d3181904507456f P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.081072 6457 tablet_bootstrap.cc:492] T a75c4436a67f453e973a7a7645de79b1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:14.082162 6454 ts_tablet_manager.cc:1434] T a08446fcf1794dab9d3181904507456f P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260923 19:50:14.082621 6454 tablet_bootstrap.cc:492] T 1c26a2863fdd4912b6d357877af1eb42 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:14.066515 6459 ts_tablet_manager.cc:1929] T 6fe14389e2a3487587dfcf7a8b4b242d P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:14.068442 6173 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e1c19a751904a6295897376e9c5ee56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:14.082944 6459 log.cc:1199] T 6fe14389e2a3487587dfcf7a8b4b242d P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/6fe14389e2a3487587dfcf7a8b4b242d
I20260923 19:50:14.083384 6459 ts_tablet_manager.cc:1950] T 6fe14389e2a3487587dfcf7a8b4b242d P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:14.083635 6034 tablet_service.cc:1511] Processing CreateTablet for tablet d974e61270dd409982af4491aeb8c37b (DEFAULT_TABLE table=default.Table_d4465060b0834069ae08a025e1b6f146 [id=fb9f3f4e429a476d90c95af76eb78859]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.083992 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d974e61270dd409982af4491aeb8c37b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.084326 6459 tablet_replica.cc:333] T 3919b15a00eb4fb08008f065f556c760 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:14.084336 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 6fe14389e2a3487587dfcf7a8b4b242d (table default.Table_654e78935bde491c95268be69d832a46 [id=db37d58a601f44c4a08efd4fcc3f115b]) successfully deleted
I20260923 19:50:14.084561 6459 raft_consensus.cc:2243] T 3919b15a00eb4fb08008f065f556c760 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:14.084820 6459 raft_consensus.cc:2272] T 3919b15a00eb4fb08008f065f556c760 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:14.085069 6173 tablet_service.cc:1511] Processing CreateTablet for tablet ff459c95d95746ccb2a931fdf6e28c57 (DEFAULT_TABLE table=default.Table_8cd7b83d22794bc290a8d894a419250e [id=bd8309b8d3674208b2744d8f6f31ff47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.085465 6459 ts_tablet_manager.cc:1916] T 3919b15a00eb4fb08008f065f556c760 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:14.085526 6028 tablet_service.cc:1511] Processing CreateTablet for tablet ff459c95d95746ccb2a931fdf6e28c57 (DEFAULT_TABLE table=default.Table_8cd7b83d22794bc290a8d894a419250e [id=bd8309b8d3674208b2744d8f6f31ff47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.085850 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff459c95d95746ccb2a931fdf6e28c57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.086274 6314 tablet_service.cc:1511] Processing CreateTablet for tablet ff459c95d95746ccb2a931fdf6e28c57 (DEFAULT_TABLE table=default.Table_8cd7b83d22794bc290a8d894a419250e [id=bd8309b8d3674208b2744d8f6f31ff47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.086604 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff459c95d95746ccb2a931fdf6e28c57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.096349 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet fe5d081a41a3417b855656ca6e24f235 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:14.097363 6456 tablet_bootstrap.cc:492] T 7b455812687f42848df5290d0cdbc312 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:14.097661 6456 ts_tablet_manager.cc:1403] T 7b455812687f42848df5290d0cdbc312 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.066s user 0.003s sys 0.003s
I20260923 19:50:14.098495 6314 tablet_service.cc:1558] Processing DeleteTablet for tablet 1c26a2863fdd4912b6d357877af1eb42 with delete_type TABLET_DATA_DELETED (replaced by tablet 7f9ec2a95bad40f7b229482b275110a3) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:14.098479 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_20a1677e214649a7892c8b6815106deb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:14.099216 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_20a1677e214649a7892c8b6815106deb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:14.100064 6457 tablet_bootstrap.cc:654] T a75c4436a67f453e973a7a7645de79b1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:14.098539 6456 raft_consensus.cc:359] T 7b455812687f42848df5290d0cdbc312 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.100414 6456 raft_consensus.cc:385] T 7b455812687f42848df5290d0cdbc312 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:14.100514 6456 raft_consensus.cc:740] T 7b455812687f42848df5290d0cdbc312 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:14.100769 6456 consensus_queue.cc:260] T 7b455812687f42848df5290d0cdbc312 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.102492 6456 ts_tablet_manager.cc:1434] T 7b455812687f42848df5290d0cdbc312 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20260923 19:50:14.103581 6456 tablet_bootstrap.cc:492] T 601a0ff319cc4c9a898d52bbcb19184b P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:14.101166 6314 tablet_service.cc:1558] Processing DeleteTablet for tablet 908596339b2e4f7f8ddb7f9cd5bdcc3e with delete_type TABLET_DATA_DELETED (replaced by tablet 688bb1055ba94c2996cdfea6dea76416) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:14.105293 6456 tablet_bootstrap.cc:654] T 601a0ff319cc4c9a898d52bbcb19184b P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:14.105259 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_3b64a099365449d4993169c3ea7499e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:14.105559 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet a08446fcf1794dab9d3181904507456f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:14.105938 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b64a099365449d4993169c3ea7499e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:14.109006 6314 tablet_service.cc:1558] Processing DeleteTablet for tablet 556b32b8ccd54c439f86b0069e2a5ce0 with delete_type TABLET_DATA_DELETED (replaced by tablet cc6027b598c3416e842ac057591c1200) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:14.112849 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet b985acc650334497832cf4505e1b0043 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:14.113118 6314 tablet_service.cc:1558] Processing DeleteTablet for tablet f5cb8dd5dcf54df9989dd808fe148ce6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:14.112890 6318 tablet_service.cc:1558] Processing DeleteTablet for tablet d2298d814a104f5cb62196be3bf0dae6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:14.112849 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 896bd068e6b343e48eb2a01679b49326 with delete_type TABLET_DATA_DELETED (replaced by tablet 0c537304c32c44adaa1e05de4496293f) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:14.112849 6317 tablet_service.cc:1558] Processing DeleteTablet for tablet 58c24aa494bc4da28536dfa1df6123b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:14.112497 6310 tablet_service.cc:1558] Processing DeleteTablet for tablet 235b4b8081ad4a13937a7941344dbc33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:04 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:14.114557 6461 ts_tablet_manager.cc:1929] T edb52bd88b424129bbdc45de89b56efb P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:14.114682 6461 log.cc:1199] T edb52bd88b424129bbdc45de89b56efb P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/edb52bd88b424129bbdc45de89b56efb
I20260923 19:50:14.114996 6461 ts_tablet_manager.cc:1950] T edb52bd88b424129bbdc45de89b56efb P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:14.115123 5803 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet ad29d22a82434023991ffcacf7f9bee5 (table default.Table_0eb28975495e4bedaf7c538454e525f6 [id=ea52a2330cd643e486e5b348dabbd295]). Expected version 1 got 0
I20260923 19:50:14.115355 5803 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 85b7dcf131c54187a6e61f8503c797f8 (table default.Table_23c500b65dba4b6790b4349e5a5b0a07 [id=647997210f5349a68aa98d24e12a33cd]). Expected version 2 got 0
I20260923 19:50:14.115875 6461 tablet_replica.cc:333] T 66739afdf147413787acb0363aa37df6 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:14.116050 6461 raft_consensus.cc:2243] T 66739afdf147413787acb0363aa37df6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:14.116118 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet edb52bd88b424129bbdc45de89b56efb (table default.Table_22eef68f3e1e499db53058abaf7b3fab [id=918936f42dad4927bd643541a36f9e5a]) successfully deleted
I20260923 19:50:14.116199 6461 raft_consensus.cc:2272] T 66739afdf147413787acb0363aa37df6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:14.116693 6461 ts_tablet_manager.cc:1916] T 66739afdf147413787acb0363aa37df6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:14.118017 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc068b844f6c440f9d13c9cff80cae2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.118268 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff459c95d95746ccb2a931fdf6e28c57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.119925 6454 tablet_bootstrap.cc:654] T 1c26a2863fdd4912b6d357877af1eb42 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:14.120239 6458 ts_tablet_manager.cc:1929] T e071b9dd1db44af0a9d1b9e904f875a5 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:14.120329 6458 log.cc:1199] T e071b9dd1db44af0a9d1b9e904f875a5 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/e071b9dd1db44af0a9d1b9e904f875a5
I20260923 19:50:14.120599 6458 ts_tablet_manager.cc:1950] T e071b9dd1db44af0a9d1b9e904f875a5 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:14.122254 7134 raft_consensus.cc:493] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.122368 7134 raft_consensus.cc:515] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.122956 7134 leader_election.cc:290] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:14.123865 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85b7dcf131c54187a6e61f8503c797f8" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:14.124271 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85b7dcf131c54187a6e61f8503c797f8" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:14.124620 7256 raft_consensus.cc:493] T cd02244c52ad4d2ab3915108a92a6f97 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.124756 7256 raft_consensus.cc:515] T cd02244c52ad4d2ab3915108a92a6f97 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:14.125113 5995 leader_election.cc:343] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.125331 7256 leader_election.cc:290] T cd02244c52ad4d2ab3915108a92a6f97 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:14.125839 5996 leader_election.cc:343] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.125977 5996 leader_election.cc:304] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:14.126416 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd02244c52ad4d2ab3915108a92a6f97" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:14.127102 6280 leader_election.cc:343] T cd02244c52ad4d2ab3915108a92a6f97 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.127323 7134 raft_consensus.cc:2749] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:14.127758 6279 leader_election.cc:343] T cd02244c52ad4d2ab3915108a92a6f97 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: cd02244c52ad4d2ab3915108a92a6f97
I20260923 19:50:14.127872 6279 leader_election.cc:304] T cd02244c52ad4d2ab3915108a92a6f97 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:14.129317 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 7dac9efee371479ab3547e06f0e580ad
I20260923 19:50:14.129763 5804 catalog_manager.cc:6934] ReplaceTablet: tablet 7dac9efee371479ab3547e06f0e580ad deleted and replaced by tablet bc64c9a47934420b9be3a6c8fe3ed91f
I20260923 19:50:14.130230 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_db49428dd8a94a17b044d011c905e20b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:14.130554 6458 tablet_replica.cc:333] T 15c0dc02ba964af38ca9f76161722588 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:14.130741 6458 raft_consensus.cc:2243] T 15c0dc02ba964af38ca9f76161722588 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Raft consensus shutting down.
W20260923 19:50:14.130738 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db49428dd8a94a17b044d011c905e20b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:14.130934 6458 pending_rounds.cc:70] T 15c0dc02ba964af38ca9f76161722588 P 2bf41435f70447f19992d368ca6b46bd: Trying to abort 1 pending ops.
I20260923 19:50:14.130975 6458 pending_rounds.cc:77] T 15c0dc02ba964af38ca9f76161722588 P 2bf41435f70447f19992d368ca6b46bd: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630582507913216 op_type: NO_OP noop_request { }
I20260923 19:50:14.131057 6458 raft_consensus.cc:2889] T 15c0dc02ba964af38ca9f76161722588 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:14.131143 6458 raft_consensus.cc:2272] T 15c0dc02ba964af38ca9f76161722588 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:14.132244 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet e071b9dd1db44af0a9d1b9e904f875a5 (table default.Table_b7610081818744a5b76680621ab7212d [id=8b14917d9dc6415dbb75917bccf09502]) successfully deleted
I20260923 19:50:14.132718 6456 tablet_bootstrap.cc:492] T 601a0ff319cc4c9a898d52bbcb19184b P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:14.132830 6456 ts_tablet_manager.cc:1403] T 601a0ff319cc4c9a898d52bbcb19184b P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.029s user 0.000s sys 0.005s
I20260923 19:50:14.133503 6456 raft_consensus.cc:359] T 601a0ff319cc4c9a898d52bbcb19184b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.133652 6456 raft_consensus.cc:385] T 601a0ff319cc4c9a898d52bbcb19184b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:14.133699 6456 raft_consensus.cc:740] T 601a0ff319cc4c9a898d52bbcb19184b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:14.133865 6456 consensus_queue.cc:260] T 601a0ff319cc4c9a898d52bbcb19184b P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.134585 7256 raft_consensus.cc:2749] T cd02244c52ad4d2ab3915108a92a6f97 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:14.134714 6458 ts_tablet_manager.cc:1916] T 15c0dc02ba964af38ca9f76161722588 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:14.134826 6459 ts_tablet_manager.cc:1929] T 3919b15a00eb4fb08008f065f556c760 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:14.135506 6317 tablet_service.cc:1511] Processing CreateTablet for tablet de871dbb0bb34e6fb3c38583a471a37f (DEFAULT_TABLE table=default.Table_610e289c686b4647bf9ff414ce55b007 [id=6ae9c27c156348e69894b12293bf487c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.135979 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de871dbb0bb34e6fb3c38583a471a37f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.138304 6457 tablet_bootstrap.cc:492] T a75c4436a67f453e973a7a7645de79b1 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:14.138497 6457 ts_tablet_manager.cc:1403] T a75c4436a67f453e973a7a7645de79b1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.058s user 0.004s sys 0.002s
I20260923 19:50:14.139142 7211 raft_consensus.cc:493] T 035abecfbee7474d9dd048f35e28e867 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.139254 7211 raft_consensus.cc:515] T 035abecfbee7474d9dd048f35e28e867 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.139755 7134 raft_consensus.cc:493] T a53f2eb08330411ebe417d4e1e414db6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.139856 7211 leader_election.cc:290] T 035abecfbee7474d9dd048f35e28e867 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:14.139933 6459 log.cc:1199] T 3919b15a00eb4fb08008f065f556c760 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/3919b15a00eb4fb08008f065f556c760
I20260923 19:50:14.140219 6459 ts_tablet_manager.cc:1950] T 3919b15a00eb4fb08008f065f556c760 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:14.139854 7134 raft_consensus.cc:515] T a53f2eb08330411ebe417d4e1e414db6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.143286 7134 leader_election.cc:290] T a53f2eb08330411ebe417d4e1e414db6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:14.144174 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet 7dac9efee371479ab3547e06f0e580ad with delete_type TABLET_DATA_DELETED (replaced by tablet bc64c9a47934420b9be3a6c8fe3ed91f) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:14.145151 6457 raft_consensus.cc:359] T a75c4436a67f453e973a7a7645de79b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.145360 6457 raft_consensus.cc:385] T a75c4436a67f453e973a7a7645de79b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:14.145452 6457 raft_consensus.cc:740] T a75c4436a67f453e973a7a7645de79b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:14.145768 6457 consensus_queue.cc:260] T a75c4436a67f453e973a7a7645de79b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.146379 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a53f2eb08330411ebe417d4e1e414db6" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:14.146379 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035abecfbee7474d9dd048f35e28e867" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:14.147163 5996 leader_election.cc:343] T a53f2eb08330411ebe417d4e1e414db6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:14.147353 5996 leader_election.cc:343] T 035abecfbee7474d9dd048f35e28e867 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.147750 6169 tablet_service.cc:1511] Processing CreateTablet for tablet de871dbb0bb34e6fb3c38583a471a37f (DEFAULT_TABLE table=default.Table_610e289c686b4647bf9ff414ce55b007 [id=6ae9c27c156348e69894b12293bf487c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.140882 6454 tablet_bootstrap.cc:492] T 1c26a2863fdd4912b6d357877af1eb42 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:14.142627 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035abecfbee7474d9dd048f35e28e867" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:14.143994 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a53f2eb08330411ebe417d4e1e414db6" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:14.148131 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de871dbb0bb34e6fb3c38583a471a37f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:14.148383 5995 leader_election.cc:343] T 035abecfbee7474d9dd048f35e28e867 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.148465 5995 leader_election.cc:304] T 035abecfbee7474d9dd048f35e28e867 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:14.148505 6454 ts_tablet_manager.cc:1403] T 1c26a2863fdd4912b6d357877af1eb42 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.066s user 0.007s sys 0.004s
W20260923 19:50:14.148856 5995 leader_election.cc:343] T a53f2eb08330411ebe417d4e1e414db6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.148936 5995 leader_election.cc:304] T a53f2eb08330411ebe417d4e1e414db6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:14.149369 7211 raft_consensus.cc:2749] T 035abecfbee7474d9dd048f35e28e867 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:14.149317 6454 raft_consensus.cc:359] T 1c26a2863fdd4912b6d357877af1eb42 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.149468 6454 raft_consensus.cc:385] T 1c26a2863fdd4912b6d357877af1eb42 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:14.149497 7211 raft_consensus.cc:2749] T a53f2eb08330411ebe417d4e1e414db6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:14.149524 6454 raft_consensus.cc:740] T 1c26a2863fdd4912b6d357877af1eb42 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:14.149791 6454 consensus_queue.cc:260] T 1c26a2863fdd4912b6d357877af1eb42 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.149814 6034 tablet_service.cc:1511] Processing CreateTablet for tablet de871dbb0bb34e6fb3c38583a471a37f (DEFAULT_TABLE table=default.Table_610e289c686b4647bf9ff414ce55b007 [id=6ae9c27c156348e69894b12293bf487c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.150162 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de871dbb0bb34e6fb3c38583a471a37f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.150235 6317 tablet_service.cc:1511] Processing CreateTablet for tablet 6f600d8f36674928a56aba6ec0cac047 (DEFAULT_TABLE table=default.Table_6920203af31740688a974a5ff7755490 [id=be32a4c7a1b94cb3b1eddb171cbeb618]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.150620 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f600d8f36674928a56aba6ec0cac047. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.153095 6454 ts_tablet_manager.cc:1434] T 1c26a2863fdd4912b6d357877af1eb42 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260923 19:50:14.153396 6459 tablet_replica.cc:333] T 15c0dc02ba964af38ca9f76161722588 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:14.153689 6459 raft_consensus.cc:2243] T 15c0dc02ba964af38ca9f76161722588 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:14.154022 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 6f600d8f36674928a56aba6ec0cac047 (DEFAULT_TABLE table=default.Table_6920203af31740688a974a5ff7755490 [id=be32a4c7a1b94cb3b1eddb171cbeb618]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.154058 5803 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 7b455812687f42848df5290d0cdbc312 (table default.Table_e9cc7064dc8e4c6bb9eadb9fc3f33e09 [id=e263e510102443df8fd2b5886fa01053]). Expected version 1 got 0
I20260923 19:50:14.154353 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f600d8f36674928a56aba6ec0cac047. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.153967 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet 7dac9efee371479ab3547e06f0e580ad with delete_type TABLET_DATA_DELETED (replaced by tablet bc64c9a47934420b9be3a6c8fe3ed91f) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:14.155071 6459 raft_consensus.cc:2272] T 15c0dc02ba964af38ca9f76161722588 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:14.155280 7256 raft_consensus.cc:493] T 235b4b8081ad4a13937a7941344dbc33 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.155390 7256 raft_consensus.cc:515] T 235b4b8081ad4a13937a7941344dbc33 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.155896 7256 leader_election.cc:290] T 235b4b8081ad4a13937a7941344dbc33 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:14.156499 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "235b4b8081ad4a13937a7941344dbc33" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:14.156817 6325 tablet_service.cc:1511] Processing CreateTablet for tablet e5fce24b9dc244c88ccbc16b633924fe (DEFAULT_TABLE table=default.Table_b065e06a599f4668a7ac9c2e0bd7d989 [id=5d5f431801bb41ee9b9b4373e04d0ed9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.154850 6454 tablet_bootstrap.cc:492] T f1a4bccf6dd2411f83b86d782ecf5f40 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:14.157150 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5fce24b9dc244c88ccbc16b633924fe. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:14.157233 6280 leader_election.cc:343] T 235b4b8081ad4a13937a7941344dbc33 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.158133 6030 tablet_service.cc:1511] Processing CreateTablet for tablet e5fce24b9dc244c88ccbc16b633924fe (DEFAULT_TABLE table=default.Table_b065e06a599f4668a7ac9c2e0bd7d989 [id=5d5f431801bb41ee9b9b4373e04d0ed9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.158425 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5fce24b9dc244c88ccbc16b633924fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.158531 6454 tablet_bootstrap.cc:654] T f1a4bccf6dd2411f83b86d782ecf5f40 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:14.159911 6459 ts_tablet_manager.cc:1916] T 15c0dc02ba964af38ca9f76161722588 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:14.164765 6279 leader_election.cc:343] T 235b4b8081ad4a13937a7941344dbc33 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 235b4b8081ad4a13937a7941344dbc33
I20260923 19:50:14.164892 6279 leader_election.cc:304] T 235b4b8081ad4a13937a7941344dbc33 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:14.165309 7256 raft_consensus.cc:2749] T 235b4b8081ad4a13937a7941344dbc33 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:14.166955 6310 tablet_service.cc:1558] Processing DeleteTablet for tablet 7dac9efee371479ab3547e06f0e580ad with delete_type TABLET_DATA_DELETED (replaced by tablet bc64c9a47934420b9be3a6c8fe3ed91f) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:14.169042 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 3919b15a00eb4fb08008f065f556c760 (table default.Table_64791d9d1cef4cfe9d420e405abe816e [id=8325a8f159124a2da260e2be3ce69500]) successfully deleted
I20260923 19:50:14.169134 6181 tablet_service.cc:1511] Processing CreateTablet for tablet e5fce24b9dc244c88ccbc16b633924fe (DEFAULT_TABLE table=default.Table_b065e06a599f4668a7ac9c2e0bd7d989 [id=5d5f431801bb41ee9b9b4373e04d0ed9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.169488 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5fce24b9dc244c88ccbc16b633924fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.171198 7256 consensus_queue.cc:1048] T 2db82e6f314f412385b41720c7efdef5 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:14.181145 6459 ts_tablet_manager.cc:1929] T 15c0dc02ba964af38ca9f76161722588 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:14.185799 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 7f7ecbb8d9054dde96b2bb511697dd47
I20260923 19:50:14.187325 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 9756a1f8e23a436bb7c19c8cba7bdc05
I20260923 19:50:14.188903 6456 ts_tablet_manager.cc:1434] T 601a0ff319cc4c9a898d52bbcb19184b P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.056s user 0.000s sys 0.004s
I20260923 19:50:14.189491 6456 tablet_bootstrap.cc:492] T 7b1601590508479c8f401cd09d9f4c3b P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:14.189709 6310 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f7ecbb8d9054dde96b2bb511697dd47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:14.190692 5800 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet ea2ef507c6e24d369427048171dfec06
I20260923 19:50:14.192214 6456 tablet_bootstrap.cc:654] T 7b1601590508479c8f401cd09d9f4c3b P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:14.193917 6310 tablet_service.cc:1558] Processing DeleteTablet for tablet ea2ef507c6e24d369427048171dfec06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:14.194626 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet ec4cc8a742114e5fb07c5c9157ce09e8
I20260923 19:50:14.195084 5796 catalog_manager.cc:6934] ReplaceTablet: tablet ec4cc8a742114e5fb07c5c9157ce09e8 deleted and replaced by tablet f5765057e685428da3caaaa65e6ed904
I20260923 19:50:14.196242 6457 ts_tablet_manager.cc:1434] T a75c4436a67f453e973a7a7645de79b1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.058s user 0.002s sys 0.000s
I20260923 19:50:14.196591 6457 tablet_bootstrap.cc:492] T 2948d729e1ec4dfca70789bcad513e52 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:14.197217 6310 tablet_service.cc:1558] Processing DeleteTablet for tablet ec4cc8a742114e5fb07c5c9157ce09e8 with delete_type TABLET_DATA_DELETED (replaced by tablet f5765057e685428da3caaaa65e6ed904) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:14.197482 6459 log.cc:1199] T 15c0dc02ba964af38ca9f76161722588 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/15c0dc02ba964af38ca9f76161722588
I20260923 19:50:14.197522 5797 master_service.cc:960] ReplaceTablet: received request to replace tablet 7f7ecbb8d9054dde96b2bb511697dd47 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:14.198720 6457 tablet_bootstrap.cc:654] T 2948d729e1ec4dfca70789bcad513e52 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:14.199179 6459 ts_tablet_manager.cc:1950] T 15c0dc02ba964af38ca9f76161722588 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:14.201351 6030 tablet_service.cc:1558] Processing DeleteTablet for tablet ea2ef507c6e24d369427048171dfec06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:14.201488 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet ec4cc8a742114e5fb07c5c9157ce09e8 with delete_type TABLET_DATA_DELETED (replaced by tablet f5765057e685428da3caaaa65e6ed904) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:14.202692 6459 tablet_replica.cc:333] T 194494af2c424a55a772f3858af63c2c P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:14.202848 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f7ecbb8d9054dde96b2bb511697dd47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:14.203171 6169 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f7ecbb8d9054dde96b2bb511697dd47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:14.203184 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet 9756a1f8e23a436bb7c19c8cba7bdc05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:14.203742 6169 tablet_service.cc:1558] Processing DeleteTablet for tablet ec4cc8a742114e5fb07c5c9157ce09e8 with delete_type TABLET_DATA_DELETED (replaced by tablet f5765057e685428da3caaaa65e6ed904) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:14.204071 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 15c0dc02ba964af38ca9f76161722588 (table default.Table_23c500b65dba4b6790b4349e5a5b0a07 [id=647997210f5349a68aa98d24e12a33cd]) successfully deleted
I20260923 19:50:14.204115 6459 raft_consensus.cc:2243] T 194494af2c424a55a772f3858af63c2c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:14.204677 6459 raft_consensus.cc:2272] T 194494af2c424a55a772f3858af63c2c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:14.204912 7352 raft_consensus.cc:493] T 896bd068e6b343e48eb2a01679b49326 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.205021 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet 9756a1f8e23a436bb7c19c8cba7bdc05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:14.205124 7352 raft_consensus.cc:515] T 896bd068e6b343e48eb2a01679b49326 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.205780 7352 leader_election.cc:290] T 896bd068e6b343e48eb2a01679b49326 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:14.206125 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896bd068e6b343e48eb2a01679b49326" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:14.206272 6459 ts_tablet_manager.cc:1916] T 194494af2c424a55a772f3858af63c2c P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:14.206784 6456 tablet_bootstrap.cc:492] T 7b1601590508479c8f401cd09d9f4c3b P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
W20260923 19:50:14.206858 6280 leader_election.cc:343] T 896bd068e6b343e48eb2a01679b49326 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.207012 6456 ts_tablet_manager.cc:1403] T 7b1601590508479c8f401cd09d9f4c3b P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.004s
W20260923 19:50:14.207527 6279 leader_election.cc:343] T 896bd068e6b343e48eb2a01679b49326 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 896bd068e6b343e48eb2a01679b49326
I20260923 19:50:14.207643 6279 leader_election.cc:304] T 896bd068e6b343e48eb2a01679b49326 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:14.207907 6456 raft_consensus.cc:359] T 7b1601590508479c8f401cd09d9f4c3b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.208235 6456 raft_consensus.cc:385] T 7b1601590508479c8f401cd09d9f4c3b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:14.208325 6456 raft_consensus.cc:740] T 7b1601590508479c8f401cd09d9f4c3b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:14.208159 7352 raft_consensus.cc:2749] T 896bd068e6b343e48eb2a01679b49326 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:14.208807 6456 consensus_queue.cc:260] T 7b1601590508479c8f401cd09d9f4c3b P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.209362 6173 tablet_service.cc:1558] Processing DeleteTablet for tablet ea2ef507c6e24d369427048171dfec06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:14.209725 6456 ts_tablet_manager.cc:1434] T 7b1601590508479c8f401cd09d9f4c3b P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260923 19:50:14.211081 7134 raft_consensus.cc:493] T 28f9d03be14a4072aab7fd03834c3f6b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.211221 7134 raft_consensus.cc:515] T 28f9d03be14a4072aab7fd03834c3f6b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.211423 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 9756a1f8e23a436bb7c19c8cba7bdc05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:14.211849 7134 leader_election.cc:290] T 28f9d03be14a4072aab7fd03834c3f6b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:14.212201 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f9d03be14a4072aab7fd03834c3f6b" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:14.212720 6456 tablet_bootstrap.cc:492] T 465371cfbe544ba98e6eea05033ecf05 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
W20260923 19:50:14.212806 5995 leader_election.cc:343] T 28f9d03be14a4072aab7fd03834c3f6b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.213231 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f9d03be14a4072aab7fd03834c3f6b" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:14.213454 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_da77a1d14aed4fba88200eb53fd16559" } modify_external_catalogs: true
W20260923 19:50:14.213717 5996 leader_election.cc:343] T 28f9d03be14a4072aab7fd03834c3f6b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.213764 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_da77a1d14aed4fba88200eb53fd16559" } modify_external_catalogs: true
I20260923 19:50:14.213819 5996 leader_election.cc:304] T 28f9d03be14a4072aab7fd03834c3f6b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:14.214267 7211 raft_consensus.cc:2749] T 28f9d03be14a4072aab7fd03834c3f6b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:14.214406 7211 raft_consensus.cc:493] T 9be4c46ee8eb4dbaad01d492b701a9e0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.214491 7211 raft_consensus.cc:515] T 9be4c46ee8eb4dbaad01d492b701a9e0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.215034 7211 leader_election.cc:290] T 9be4c46ee8eb4dbaad01d492b701a9e0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:14.216102 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be4c46ee8eb4dbaad01d492b701a9e0" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:14.216579 5995 leader_election.cc:343] T 9be4c46ee8eb4dbaad01d492b701a9e0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.216912 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be4c46ee8eb4dbaad01d492b701a9e0" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:14.217373 5996 leader_election.cc:343] T 9be4c46ee8eb4dbaad01d492b701a9e0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.217463 5996 leader_election.cc:304] T 9be4c46ee8eb4dbaad01d492b701a9e0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:14.217835 7134 raft_consensus.cc:2749] T 9be4c46ee8eb4dbaad01d492b701a9e0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:14.218137 6456 tablet_bootstrap.cc:654] T 465371cfbe544ba98e6eea05033ecf05 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:14.218552 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_56a69b63c77e409183883ea97ef06328" } new_table_name: "default.Table_139964b3440b4312afa1bd6c9b2ff2a9" modify_external_catalogs: true
I20260923 19:50:14.218972 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_b0ee37845cb4472db1adf576ec6ce4e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:14.219306 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_947cffda0c1f456ebfc9420e5b6e9865"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:14.219540 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b0ee37845cb4472db1adf576ec6ce4e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:14.219828 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_947cffda0c1f456ebfc9420e5b6e9865 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:14.220921 6459 ts_tablet_manager.cc:1929] T 194494af2c424a55a772f3858af63c2c P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:14.221051 6459 log.cc:1199] T 194494af2c424a55a772f3858af63c2c P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/194494af2c424a55a772f3858af63c2c
I20260923 19:50:14.221356 6459 ts_tablet_manager.cc:1950] T 194494af2c424a55a772f3858af63c2c P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:14.222424 5797 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_98e62ec3560b4093bdac39551e2c715f" } new_table_name: "default.Table_a9e7f8c6300f47c7ba79e2dbe36d7849" modify_external_catalogs: true
I20260923 19:50:14.225530 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_974e2fbea82147a1a2bb48f3bae1fde1" } new_table_name: "default.Table_ab816e7937ae4627a7a13c8e091caf19" modify_external_catalogs: true
I20260923 19:50:14.229390 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_20b3800c0a01465585ccd87c3057f834" } new_table_name: "default.Table_4aba50515e344158b08d4c2afc6cae77" modify_external_catalogs: true
I20260923 19:50:14.233855 6321 tablet_service.cc:1511] Processing CreateTablet for tablet 7bd0ccf56ee9498f9fa42c5a03a931b6 (DEFAULT_TABLE table=default.Table_6b1bf474d973437eabe2b92b3bc9e948 [id=759f0126c39f423b840c0f5bb4ad9675]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.234066 6318 tablet_service.cc:1511] Processing CreateTablet for tablet aafe3dac1953413cb2fbee82191f0633 (DEFAULT_TABLE table=default.Table_40ca5e04bf0043999afbd49a6fe09bb2 [id=e11514d753b74f3c8608f5e13a045fc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.234315 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bd0ccf56ee9498f9fa42c5a03a931b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.234455 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 77aa9699460440e7906957855b97448e (DEFAULT_TABLE table=default.Table_4bf3649d9e3d46ad9cf692caa1e51b8c [id=aa7a779ec35143daab3e7d0008eaf8b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.234757 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77aa9699460440e7906957855b97448e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.233855 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 30c8d87fa60d455ba1a8ce9296a02c30 (DEFAULT_TABLE table=default.Table_8590246f18b44aa9833d9152591b144b [id=a26556750f31404fa50d0e390e765aa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.238269 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c8d87fa60d455ba1a8ce9296a02c30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.240494 6313 tablet_service.cc:1511] Processing CreateTablet for tablet c6598be958f842328a81fd092c6fcf64 (DEFAULT_TABLE table=default.Table_d874e0de26244d32ad58f316738b6553 [id=0a87c6db7ee743888a33ec92fab6eb70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.240805 6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6598be958f842328a81fd092c6fcf64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.245991 6318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aafe3dac1953413cb2fbee82191f0633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.248010 6454 tablet_bootstrap.cc:492] T f1a4bccf6dd2411f83b86d782ecf5f40 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:14.248152 6454 ts_tablet_manager.cc:1403] T f1a4bccf6dd2411f83b86d782ecf5f40 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.093s user 0.007s sys 0.009s
I20260923 19:50:14.248498 6168 tablet_service.cc:1511] Processing CreateTablet for tablet 6f600d8f36674928a56aba6ec0cac047 (DEFAULT_TABLE table=default.Table_6920203af31740688a974a5ff7755490 [id=be32a4c7a1b94cb3b1eddb171cbeb618]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.248675 6456 tablet_bootstrap.cc:492] T 465371cfbe544ba98e6eea05033ecf05 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:14.248790 6456 ts_tablet_manager.cc:1403] T 465371cfbe544ba98e6eea05033ecf05 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.036s user 0.001s sys 0.006s
I20260923 19:50:14.248873 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f600d8f36674928a56aba6ec0cac047. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.249523 6456 raft_consensus.cc:359] T 465371cfbe544ba98e6eea05033ecf05 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.249677 6456 raft_consensus.cc:385] T 465371cfbe544ba98e6eea05033ecf05 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:14.249725 6456 raft_consensus.cc:740] T 465371cfbe544ba98e6eea05033ecf05 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:14.249928 6456 consensus_queue.cc:260] T 465371cfbe544ba98e6eea05033ecf05 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.251009 6310 tablet_service.cc:1511] Processing CreateTablet for tablet f36c34465066473f94da61da73f521ff (DEFAULT_TABLE table=default.Table_289a14904b5c40c589dd9edaefd30fb2 [id=214b5d032e304d2eb758252c5e82878d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.251380 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f36c34465066473f94da61da73f521ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.251972 6317 tablet_service.cc:1511] Processing CreateTablet for tablet cc6027b598c3416e842ac057591c1200 (DEFAULT_TABLE table=default.Table_bae34ce3ce95493d81bcd45d6806c756 [id=f329852cd968475584a70fbb8b1b1c3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.252137 6314 tablet_service.cc:1511] Processing CreateTablet for tablet 81cbeb3b21064abca617920301ec8cd9 (DEFAULT_TABLE table=default.Table_badfa4e207ea4a70a06abfaa9bbeda76 [id=3b166004f39f4f4e9c7cb4398c532d04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.252430 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc6027b598c3416e842ac057591c1200. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.252833 6458 ts_tablet_manager.cc:1929] T 15c0dc02ba964af38ca9f76161722588 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:14.256693 6032 tablet_service.cc:1511] Processing CreateTablet for tablet 81cbeb3b21064abca617920301ec8cd9 (DEFAULT_TABLE table=default.Table_badfa4e207ea4a70a06abfaa9bbeda76 [id=3b166004f39f4f4e9c7cb4398c532d04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.256851 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 30c8d87fa60d455ba1a8ce9296a02c30 (DEFAULT_TABLE table=default.Table_8590246f18b44aa9833d9152591b144b [id=a26556750f31404fa50d0e390e765aa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.257061 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81cbeb3b21064abca617920301ec8cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.257215 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c8d87fa60d455ba1a8ce9296a02c30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.262236 6030 tablet_service.cc:1511] Processing CreateTablet for tablet 77aa9699460440e7906957855b97448e (DEFAULT_TABLE table=default.Table_4bf3649d9e3d46ad9cf692caa1e51b8c [id=aa7a779ec35143daab3e7d0008eaf8b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.262310 6026 tablet_service.cc:1511] Processing CreateTablet for tablet 7bd0ccf56ee9498f9fa42c5a03a931b6 (DEFAULT_TABLE table=default.Table_6b1bf474d973437eabe2b92b3bc9e948 [id=759f0126c39f423b840c0f5bb4ad9675]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.262574 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77aa9699460440e7906957855b97448e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.262773 6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bd0ccf56ee9498f9fa42c5a03a931b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.256693 6028 tablet_service.cc:1511] Processing CreateTablet for tablet aafe3dac1953413cb2fbee82191f0633 (DEFAULT_TABLE table=default.Table_40ca5e04bf0043999afbd49a6fe09bb2 [id=e11514d753b74f3c8608f5e13a045fc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.269021 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aafe3dac1953413cb2fbee82191f0633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.270162 6461 ts_tablet_manager.cc:1929] T 66739afdf147413787acb0363aa37df6 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:14.270339 6458 log.cc:1199] T 15c0dc02ba964af38ca9f76161722588 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/15c0dc02ba964af38ca9f76161722588
I20260923 19:50:14.272292 6458 ts_tablet_manager.cc:1950] T 15c0dc02ba964af38ca9f76161722588 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:14.250717 6454 raft_consensus.cc:359] T f1a4bccf6dd2411f83b86d782ecf5f40 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.274675 6454 raft_consensus.cc:385] T f1a4bccf6dd2411f83b86d782ecf5f40 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:14.274785 6454 raft_consensus.cc:740] T f1a4bccf6dd2411f83b86d782ecf5f40 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:14.275089 6454 consensus_queue.cc:260] T f1a4bccf6dd2411f83b86d782ecf5f40 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.253993 6456 ts_tablet_manager.cc:1434] T 465371cfbe544ba98e6eea05033ecf05 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260923 19:50:14.269107 7352 raft_consensus.cc:493] T 58c24aa494bc4da28536dfa1df6123b7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.253005 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81cbeb3b21064abca617920301ec8cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.276345 7352 raft_consensus.cc:515] T 58c24aa494bc4da28536dfa1df6123b7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.276979 7352 leader_election.cc:290] T 58c24aa494bc4da28536dfa1df6123b7 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:14.277014 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 605) took 1033 ms. Trace:
I20260923 19:50:14.277099 6458 rpcz_store.cc:276] 0923 19:50:13.243583 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.244955 (+ 1372us) service_pool.cc:224] Handling call
0923 19:50:14.130509 (+885554us) ts_tablet_manager.cc:1151] Deleting tablet 15c0dc02ba964af38ca9f76161722588
0923 19:50:14.130518 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:14.230753 (+100235us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:14.252789 (+ 22036us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:14.276997 (+ 24208us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":885286}
I20260923 19:50:14.278479 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c24aa494bc4da28536dfa1df6123b7" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:14.279155 6456 tablet_bootstrap.cc:492] T c0ff8838ab17433ab733d3b293d4964f P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
W20260923 19:50:14.279258 6280 leader_election.cc:343] T 58c24aa494bc4da28536dfa1df6123b7 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.281014 6456 tablet_bootstrap.cc:654] T c0ff8838ab17433ab733d3b293d4964f P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:14.281570 6461 log.cc:1199] T 66739afdf147413787acb0363aa37df6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/66739afdf147413787acb0363aa37df6
I20260923 19:50:14.281975 6461 ts_tablet_manager.cc:1950] T 66739afdf147413787acb0363aa37df6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:14.282490 6317 tablet_service.cc:1511] Processing CreateTablet for tablet 3f1f46ea8b894c8693ecf2d752e2507e (DEFAULT_TABLE table=default.Table_a6baec3d4ff94a14a032737c8ae498ef [id=8b17b21567364cd5909b6ec1bc2344da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.282536 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 15c0dc02ba964af38ca9f76161722588 (table default.Table_23c500b65dba4b6790b4349e5a5b0a07 [id=647997210f5349a68aa98d24e12a33cd]) successfully deleted
I20260923 19:50:14.282868 6454 ts_tablet_manager.cc:1434] T f1a4bccf6dd2411f83b86d782ecf5f40 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.035s user 0.000s sys 0.002s
I20260923 19:50:14.284456 6321 tablet_service.cc:1511] Processing CreateTablet for tablet 40e6a09f1807425bbe030a25d694f58e (DEFAULT_TABLE table=default.Table_bed0586ee50548bab95ee1bd85b005f0 [id=b6c4c10f340246e796739f867a7414ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.287557 7256 raft_consensus.cc:493] T f1a4bccf6dd2411f83b86d782ecf5f40 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.288157 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40e6a09f1807425bbe030a25d694f58e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.288166 7256 raft_consensus.cc:515] T f1a4bccf6dd2411f83b86d782ecf5f40 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:14.288784 6279 leader_election.cc:343] T 58c24aa494bc4da28536dfa1df6123b7 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 58c24aa494bc4da28536dfa1df6123b7
I20260923 19:50:14.288914 6279 leader_election.cc:304] T 58c24aa494bc4da28536dfa1df6123b7 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:14.289007 6169 tablet_service.cc:1511] Processing CreateTablet for tablet aafe3dac1953413cb2fbee82191f0633 (DEFAULT_TABLE table=default.Table_40ca5e04bf0043999afbd49a6fe09bb2 [id=e11514d753b74f3c8608f5e13a045fc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.289336 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aafe3dac1953413cb2fbee82191f0633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.288923 7256 leader_election.cc:290] T f1a4bccf6dd2411f83b86d782ecf5f40 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:14.289402 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4bccf6dd2411f83b86d782ecf5f40" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:14.289601 7256 raft_consensus.cc:2749] T 58c24aa494bc4da28536dfa1df6123b7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:14.289630 6201 raft_consensus.cc:2468] T f1a4bccf6dd2411f83b86d782ecf5f40 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:14.290167 6280 leader_election.cc:304] T f1a4bccf6dd2411f83b86d782ecf5f40 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:14.292872 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f1f46ea8b894c8693ecf2d752e2507e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.294519 6181 tablet_service.cc:1511] Processing CreateTablet for tablet 81cbeb3b21064abca617920301ec8cd9 (DEFAULT_TABLE table=default.Table_badfa4e207ea4a70a06abfaa9bbeda76 [id=3b166004f39f4f4e9c7cb4398c532d04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.294960 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81cbeb3b21064abca617920301ec8cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.295238 6166 tablet_service.cc:1511] Processing CreateTablet for tablet 7bd0ccf56ee9498f9fa42c5a03a931b6 (DEFAULT_TABLE table=default.Table_6b1bf474d973437eabe2b92b3bc9e948 [id=759f0126c39f423b840c0f5bb4ad9675]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.295684 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bd0ccf56ee9498f9fa42c5a03a931b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.296554 6167 tablet_service.cc:1511] Processing CreateTablet for tablet cc6027b598c3416e842ac057591c1200 (DEFAULT_TABLE table=default.Table_bae34ce3ce95493d81bcd45d6806c756 [id=f329852cd968475584a70fbb8b1b1c3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.294975 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 77aa9699460440e7906957855b97448e (DEFAULT_TABLE table=default.Table_4bf3649d9e3d46ad9cf692caa1e51b8c [id=aa7a779ec35143daab3e7d0008eaf8b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.297864 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 194494af2c424a55a772f3858af63c2c (table default.Table_41c2e67e9c7e4fa192fc124e05c2d34f [id=b5209bbe29cb42e6b2473caddc119f44]) successfully deleted
I20260923 19:50:14.297927 7316 raft_consensus.cc:493] T b985acc650334497832cf4505e1b0043 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.298056 7316 raft_consensus.cc:515] T b985acc650334497832cf4505e1b0043 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.298727 7316 leader_election.cc:290] T b985acc650334497832cf4505e1b0043 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:14.299692 6170 tablet_service.cc:1511] Processing CreateTablet for tablet f36c34465066473f94da61da73f521ff (DEFAULT_TABLE table=default.Table_289a14904b5c40c589dd9edaefd30fb2 [id=214b5d032e304d2eb758252c5e82878d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.300256 6179 tablet_service.cc:1511] Processing CreateTablet for tablet c6598be958f842328a81fd092c6fcf64 (DEFAULT_TABLE table=default.Table_d874e0de26244d32ad58f316738b6553 [id=0a87c6db7ee743888a33ec92fab6eb70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.300799 6171 tablet_service.cc:1511] Processing CreateTablet for tablet 40e6a09f1807425bbe030a25d694f58e (DEFAULT_TABLE table=default.Table_bed0586ee50548bab95ee1bd85b005f0 [id=b6c4c10f340246e796739f867a7414ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.301327 6175 tablet_service.cc:1511] Processing CreateTablet for tablet 3f1f46ea8b894c8693ecf2d752e2507e (DEFAULT_TABLE table=default.Table_a6baec3d4ff94a14a032737c8ae498ef [id=8b17b21567364cd5909b6ec1bc2344da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.301674 6178 tablet_service.cc:1558] Processing DeleteTablet for tablet 1c26a2863fdd4912b6d357877af1eb42 with delete_type TABLET_DATA_DELETED (replaced by tablet 7f9ec2a95bad40f7b229482b275110a3) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:14.302762 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc6027b598c3416e842ac057591c1200. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:14.303486 6137 leader_election.cc:343] T b985acc650334497832cf4505e1b0043 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: b985acc650334497832cf4505e1b0043
I20260923 19:50:14.304316 6454 tablet_bootstrap.cc:492] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:14.305931 6454 tablet_bootstrap.cc:654] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:14.306218 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6598be958f842328a81fd092c6fcf64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.306751 6173 tablet_service.cc:1511] Processing CreateTablet for tablet 30c8d87fa60d455ba1a8ce9296a02c30 (DEFAULT_TABLE table=default.Table_8590246f18b44aa9833d9152591b144b [id=a26556750f31404fa50d0e390e765aa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.302356 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b985acc650334497832cf4505e1b0043" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:14.306988 6343 raft_consensus.cc:2468] T b985acc650334497832cf4505e1b0043 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:14.307063 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c8d87fa60d455ba1a8ce9296a02c30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.307497 6139 leader_election.cc:304] T b985acc650334497832cf4505e1b0043 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:14.307889 7316 raft_consensus.cc:2804] T b985acc650334497832cf4505e1b0043 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:14.307955 7316 raft_consensus.cc:493] T b985acc650334497832cf4505e1b0043 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:14.308007 7316 raft_consensus.cc:3060] T b985acc650334497832cf4505e1b0043 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:14.310348 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 601a0ff319cc4c9a898d52bbcb19184b with delete_type TABLET_DATA_DELETED (replaced by tablet 02fa9052a7054659baf9b07b770bb538) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:14.310714 6171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40e6a09f1807425bbe030a25d694f58e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.311308 6170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f36c34465066473f94da61da73f521ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.311846 6175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f1f46ea8b894c8693ecf2d752e2507e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.312345 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77aa9699460440e7906957855b97448e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.312683 7316 raft_consensus.cc:515] T b985acc650334497832cf4505e1b0043 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:14.314174 6137 leader_election.cc:343] T b985acc650334497832cf4505e1b0043 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: b985acc650334497832cf4505e1b0043
I20260923 19:50:14.314321 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b985acc650334497832cf4505e1b0043" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:14.314524 6343 raft_consensus.cc:3060] T b985acc650334497832cf4505e1b0043 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:14.317276 6343 raft_consensus.cc:2468] T b985acc650334497832cf4505e1b0043 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:14.317821 6139 leader_election.cc:304] T b985acc650334497832cf4505e1b0043 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:14.318131 7239 raft_consensus.cc:2804] T b985acc650334497832cf4505e1b0043 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:14.319404 7316 leader_election.cc:290] T b985acc650334497832cf4505e1b0043 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:14.332001 7239 raft_consensus.cc:697] T b985acc650334497832cf4505e1b0043 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:14.332371 7239 consensus_queue.cc:237] T b985acc650334497832cf4505e1b0043 P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.351522 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 624) took 1089 ms. Trace:
I20260923 19:50:14.359576 6321 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b1601590508479c8f401cd09d9f4c3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:04 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:14.359488 6317 tablet_service.cc:1558] Processing DeleteTablet for tablet 465371cfbe544ba98e6eea05033ecf05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:14.362958 5804 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_609f0fa8001e4a40905d2d090fc739b1" } new_table_name: "default.Table_72032a8e8a254d2bad8358ebf75f1615" modify_external_catalogs: true
I20260923 19:50:14.363363 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_207e79266a3b44f28cad759aeb41bdce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:14.364328 7362 raft_consensus.cc:2804] T f1a4bccf6dd2411f83b86d782ecf5f40 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:14.364450 7362 raft_consensus.cc:493] T f1a4bccf6dd2411f83b86d782ecf5f40 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:14.364583 7362 raft_consensus.cc:3060] T f1a4bccf6dd2411f83b86d782ecf5f40 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:14.365904 5801 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 2db82e6f314f412385b41720c7efdef5 (table default.Table_fa1d82a491c04ba89f5cf3162578d550 [id=6d79e588fb9e4936aedf8cd500f68d60]). Expected version 3 got 0
W20260923 19:50:14.366285 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_207e79266a3b44f28cad759aeb41bdce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:14.367623 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 92f94b93d1364bb1a2562eb577707cf1
I20260923 19:50:14.367888 7358 raft_consensus.cc:493] T 601a0ff319cc4c9a898d52bbcb19184b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.368144 7358 raft_consensus.cc:515] T 601a0ff319cc4c9a898d52bbcb19184b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.368860 5796 master_service.cc:960] ReplaceTablet: received request to replace tablet 5e711e48156b46b5a517b330d6d41309 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:14.368948 7358 leader_election.cc:290] T 601a0ff319cc4c9a898d52bbcb19184b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:14.370110 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_91d4a2993b4b4ecea5fda676d43c5a18"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:14.371881 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_91d4a2993b4b4ecea5fda676d43c5a18 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:14.372202 5700 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 89386.6us
I20260923 19:50:14.374325 5801 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ab5bcf93ffdc4e0f99d62c9d56cb1447" } modify_external_catalogs: true
I20260923 19:50:14.374617 5801 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ab5bcf93ffdc4e0f99d62c9d56cb1447" } modify_external_catalogs: true
I20260923 19:50:14.283171 6030 tablet_service.cc:1558] Processing DeleteTablet for tablet a75c4436a67f453e973a7a7645de79b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:14.377945 6459 rpcz_store.cc:276] 0923 19:50:13.261968 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.262722 (+ 754us) service_pool.cc:224] Handling call
0923 19:50:14.351391 (+1088669us) ts_tablet_manager.cc:1151] Deleting tablet b8211238627b44468c8461bdc340b1bb
0923 19:50:14.351403 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:14.351501 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1088531}
I20260923 19:50:14.283432 6026 tablet_service.cc:1511] Processing CreateTablet for tablet c6598be958f842328a81fd092c6fcf64 (DEFAULT_TABLE table=default.Table_d874e0de26244d32ad58f316738b6553 [id=0a87c6db7ee743888a33ec92fab6eb70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.378357 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 630) took 1087 ms. Trace:
I20260923 19:50:14.378423 6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6598be958f842328a81fd092c6fcf64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.378419 6459 rpcz_store.cc:276] 0923 19:50:13.290491 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.290547 (+ 56us) service_pool.cc:224] Handling call
0923 19:50:14.378250 (+1087703us) ts_tablet_manager.cc:1151] Deleting tablet ba4e9fee05994c0d8e7d1f21788280d3
0923 19:50:14.378260 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:14.378343 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1087458}
I20260923 19:50:14.378669 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 631) took 1007 ms. Trace:
I20260923 19:50:14.378721 6459 rpcz_store.cc:276] 0923 19:50:13.371243 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.371847 (+ 604us) service_pool.cc:224] Handling call
0923 19:50:14.378584 (+1006737us) ts_tablet_manager.cc:1151] Deleting tablet c212b069c3f740ecac403c99d93de7d9
0923 19:50:14.378591 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:14.378659 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1006526}
I20260923 19:50:14.379308 6459 tablet_replica.cc:333] T b529b0e82c5b48edac54cc281ac4b4a6 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:14.379474 6459 raft_consensus.cc:2243] T b529b0e82c5b48edac54cc281ac4b4a6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:14.379616 6459 raft_consensus.cc:2272] T b529b0e82c5b48edac54cc281ac4b4a6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:14.283464 6021 tablet_service.cc:1511] Processing CreateTablet for tablet f36c34465066473f94da61da73f521ff (DEFAULT_TABLE table=default.Table_289a14904b5c40c589dd9edaefd30fb2 [id=214b5d032e304d2eb758252c5e82878d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.284127 6029 tablet_service.cc:1511] Processing CreateTablet for tablet cc6027b598c3416e842ac057591c1200 (DEFAULT_TABLE table=default.Table_bae34ce3ce95493d81bcd45d6806c756 [id=f329852cd968475584a70fbb8b1b1c3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.284432 6022 tablet_service.cc:1511] Processing CreateTablet for tablet 3f1f46ea8b894c8693ecf2d752e2507e (DEFAULT_TABLE table=default.Table_a6baec3d4ff94a14a032737c8ae498ef [id=8b17b21567364cd5909b6ec1bc2344da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.382416 6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f36c34465066473f94da61da73f521ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.382606 6454 tablet_bootstrap.cc:492] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:14.382710 6454 ts_tablet_manager.cc:1403] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.097s user 0.005s sys 0.006s
I20260923 19:50:14.383375 6454 raft_consensus.cc:359] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.383841 6454 raft_consensus.cc:385] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:14.383893 6454 raft_consensus.cc:740] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:14.384110 6454 consensus_queue.cc:260] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.385349 6454 ts_tablet_manager.cc:1434] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260923 19:50:14.385581 6454 tablet_bootstrap.cc:492] T 623052a8c9c2436a828655da6cf6d379 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:14.369777 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet 92f94b93d1364bb1a2562eb577707cf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:14.371162 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "601a0ff319cc4c9a898d52bbcb19184b" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:14.386286 7134 raft_consensus.cc:493] T 5e711e48156b46b5a517b330d6d41309 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.386458 7134 raft_consensus.cc:515] T 5e711e48156b46b5a517b330d6d41309 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.387095 7134 leader_election.cc:290] T 5e711e48156b46b5a517b330d6d41309 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:14.387176 6454 tablet_bootstrap.cc:654] T 623052a8c9c2436a828655da6cf6d379 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:14.387530 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e711e48156b46b5a517b330d6d41309" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:14.387840 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f1f46ea8b894c8693ecf2d752e2507e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:14.388087 5995 leader_election.cc:343] T 5e711e48156b46b5a517b330d6d41309 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.358901 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 40e6a09f1807425bbe030a25d694f58e (DEFAULT_TABLE table=default.Table_bed0586ee50548bab95ee1bd85b005f0 [id=b6c4c10f340246e796739f867a7414ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.389462 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40e6a09f1807425bbe030a25d694f58e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.390867 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc6027b598c3416e842ac057591c1200. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.363510 6457 tablet_bootstrap.cc:492] T 2948d729e1ec4dfca70789bcad513e52 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:14.394024 6457 ts_tablet_manager.cc:1403] T 2948d729e1ec4dfca70789bcad513e52 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.198s user 0.004s sys 0.000s
I20260923 19:50:14.375649 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 92f94b93d1364bb1a2562eb577707cf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:14.394853 6457 raft_consensus.cc:359] T 2948d729e1ec4dfca70789bcad513e52 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.395107 6457 raft_consensus.cc:385] T 2948d729e1ec4dfca70789bcad513e52 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:14.395198 6457 raft_consensus.cc:740] T 2948d729e1ec4dfca70789bcad513e52 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:14.395457 6457 consensus_queue.cc:260] T 2948d729e1ec4dfca70789bcad513e52 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.398298 6454 tablet_bootstrap.cc:492] T 623052a8c9c2436a828655da6cf6d379 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:14.398427 6454 ts_tablet_manager.cc:1403] T 623052a8c9c2436a828655da6cf6d379 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
I20260923 19:50:14.399287 6457 ts_tablet_manager.cc:1434] T 2948d729e1ec4dfca70789bcad513e52 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260923 19:50:14.399664 6457 tablet_bootstrap.cc:492] T b7ba284e81bc4388bbd6456a41d1f9f4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:14.399325 6454 raft_consensus.cc:359] T 623052a8c9c2436a828655da6cf6d379 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.399969 6454 raft_consensus.cc:385] T 623052a8c9c2436a828655da6cf6d379 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:14.400039 6454 raft_consensus.cc:740] T 623052a8c9c2436a828655da6cf6d379 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:14.400291 6454 consensus_queue.cc:260] T 623052a8c9c2436a828655da6cf6d379 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.400797 6454 ts_tablet_manager.cc:1434] T 623052a8c9c2436a828655da6cf6d379 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260923 19:50:14.401127 6454 tablet_bootstrap.cc:492] T 58c24aa494bc4da28536dfa1df6123b7 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:14.401365 6457 tablet_bootstrap.cc:654] T b7ba284e81bc4388bbd6456a41d1f9f4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:14.403062 6454 tablet_bootstrap.cc:654] T 58c24aa494bc4da28536dfa1df6123b7 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:14.403158 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet b8211238627b44468c8461bdc340b1bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8211238627b44468c8461bdc340b1bb already in progress: creating tablet
W20260923 19:50:14.405761 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet ba4e9fee05994c0d8e7d1f21788280d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba4e9fee05994c0d8e7d1f21788280d3 already in progress: creating tablet
W20260923 19:50:14.406147 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet c212b069c3f740ecac403c99d93de7d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c212b069c3f740ecac403c99d93de7d9 already in progress: creating tablet
W20260923 19:50:14.406420 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet ba0453ef529344dfbab1130daa985fef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba0453ef529344dfbab1130daa985fef already in progress: creating tablet
W20260923 19:50:14.406665 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet f7cf45d4c4d3480288698682c1c85869 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7cf45d4c4d3480288698682c1c85869 already in progress: creating tablet
W20260923 19:50:14.406904 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 83dba06b0d0040889015fb052c642ec0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 83dba06b0d0040889015fb052c642ec0 already in progress: creating tablet
W20260923 19:50:14.408219 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet c4b7cd806c3d41dd9af0a365d84c1f12 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4b7cd806c3d41dd9af0a365d84c1f12 already in progress: creating tablet
I20260923 19:50:14.372627 6317 tablet_service.cc:1558] Processing DeleteTablet for tablet 92f94b93d1364bb1a2562eb577707cf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:14.411098 6454 tablet_bootstrap.cc:492] T 58c24aa494bc4da28536dfa1df6123b7 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:14.411645 6454 ts_tablet_manager.cc:1403] T 58c24aa494bc4da28536dfa1df6123b7 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.005s
W20260923 19:50:14.374526 6279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.143.193:39887, user_credentials={real_user=slave}} blocked reactor thread for 85201.3us
W20260923 19:50:14.388512 6280 leader_election.cc:343] T 601a0ff319cc4c9a898d52bbcb19184b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.414568 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e711e48156b46b5a517b330d6d41309" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:14.413923 6454 raft_consensus.cc:359] T 58c24aa494bc4da28536dfa1df6123b7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.415146 6454 raft_consensus.cc:385] T 58c24aa494bc4da28536dfa1df6123b7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:14.415251 6454 raft_consensus.cc:740] T 58c24aa494bc4da28536dfa1df6123b7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:14.415524 6454 consensus_queue.cc:260] T 58c24aa494bc4da28536dfa1df6123b7 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.407896 7363 raft_consensus.cc:493] T 623052a8c9c2436a828655da6cf6d379 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.415887 7363 raft_consensus.cc:515] T 623052a8c9c2436a828655da6cf6d379 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.417317 6454 ts_tablet_manager.cc:1434] T 58c24aa494bc4da28536dfa1df6123b7 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260923 19:50:14.418237 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623052a8c9c2436a828655da6cf6d379" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:14.418409 6200 raft_consensus.cc:2468] T 623052a8c9c2436a828655da6cf6d379 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:14.418965 7256 raft_consensus.cc:493] T f5cb8dd5dcf54df9989dd808fe148ce6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.419093 7256 raft_consensus.cc:515] T f5cb8dd5dcf54df9989dd808fe148ce6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:14.415071 5996 leader_election.cc:343] T 5e711e48156b46b5a517b330d6d41309 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.419530 5996 leader_election.cc:304] T 5e711e48156b46b5a517b330d6d41309 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:14.419704 7256 leader_election.cc:290] T f5cb8dd5dcf54df9989dd808fe148ce6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:14.419744 7134 raft_consensus.cc:2749] T 5e711e48156b46b5a517b330d6d41309 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:14.420205 6280 leader_election.cc:304] T 623052a8c9c2436a828655da6cf6d379 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:14.420696 7316 raft_consensus.cc:493] T e071b9dd1db44af0a9d1b9e904f875a5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.420805 7316 raft_consensus.cc:515] T e071b9dd1db44af0a9d1b9e904f875a5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.417644 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 642) took 1143 ms. Trace:
I20260923 19:50:14.421077 6461 rpcz_store.cc:276] 0923 19:50:13.274459 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.274505 (+ 46us) service_pool.cc:224] Handling call
0923 19:50:14.115826 (+841321us) ts_tablet_manager.cc:1151] Deleting tablet 66739afdf147413787acb0363aa37df6
0923 19:50:14.115838 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:14.223698 (+107860us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:14.270079 (+ 46381us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:14.417604 (+147525us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":837770}
I20260923 19:50:14.421331 7316 leader_election.cc:290] T e071b9dd1db44af0a9d1b9e904f875a5 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:14.421772 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 66739afdf147413787acb0363aa37df6 (table default.Table_973f7a2560ab48ad8d84aeb2f4fc235b [id=72c42d0bf8264d809c5ec888d05db821]) successfully deleted
W20260923 19:50:14.422452 6139 leader_election.cc:343] T e071b9dd1db44af0a9d1b9e904f875a5 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: e071b9dd1db44af0a9d1b9e904f875a5
I20260923 19:50:14.422817 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cb8dd5dcf54df9989dd808fe148ce6" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:14.423252 7256 raft_consensus.cc:2804] T 623052a8c9c2436a828655da6cf6d379 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:14.423363 7256 raft_consensus.cc:493] T 623052a8c9c2436a828655da6cf6d379 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260923 19:50:14.423418 6280 leader_election.cc:343] T f5cb8dd5dcf54df9989dd808fe148ce6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.423446 7256 raft_consensus.cc:3060] T 623052a8c9c2436a828655da6cf6d379 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
W20260923 19:50:14.424264 6137 leader_election.cc:343] T e071b9dd1db44af0a9d1b9e904f875a5 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: e071b9dd1db44af0a9d1b9e904f875a5
I20260923 19:50:14.424360 6137 leader_election.cc:304] T e071b9dd1db44af0a9d1b9e904f875a5 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:14.424755 7316 raft_consensus.cc:2749] T e071b9dd1db44af0a9d1b9e904f875a5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:14.425184 6454 tablet_bootstrap.cc:492] T 896bd068e6b343e48eb2a01679b49326 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:14.426285 7363 leader_election.cc:290] T 623052a8c9c2436a828655da6cf6d379 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:14.426788 7134 raft_consensus.cc:493] T a75c4436a67f453e973a7a7645de79b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.426877 6461 tablet_replica.cc:333] T ba4e9fee05994c0d8e7d1f21788280d3 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:14.426911 7134 raft_consensus.cc:515] T a75c4436a67f453e973a7a7645de79b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.427057 6461 raft_consensus.cc:2243] T ba4e9fee05994c0d8e7d1f21788280d3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:14.427176 6461 raft_consensus.cc:2272] T ba4e9fee05994c0d8e7d1f21788280d3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:14.427778 6454 tablet_bootstrap.cc:654] T 896bd068e6b343e48eb2a01679b49326 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:14.427951 7134 leader_election.cc:290] T a75c4436a67f453e973a7a7645de79b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:14.428345 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75c4436a67f453e973a7a7645de79b1" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:14.428418 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75c4436a67f453e973a7a7645de79b1" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:14.428844 5995 leader_election.cc:343] T a75c4436a67f453e973a7a7645de79b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:14.429077 5996 leader_election.cc:343] T a75c4436a67f453e973a7a7645de79b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:14.416687 6279 leader_election.cc:343] T f1a4bccf6dd2411f83b86d782ecf5f40 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: f1a4bccf6dd2411f83b86d782ecf5f40
I20260923 19:50:14.429157 5996 leader_election.cc:304] T a75c4436a67f453e973a7a7645de79b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:14.429543 7134 raft_consensus.cc:2749] T a75c4436a67f453e973a7a7645de79b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:14.430018 6456 tablet_bootstrap.cc:492] T c0ff8838ab17433ab733d3b293d4964f P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
W20260923 19:50:14.430333 6279 leader_election.cc:343] T 601a0ff319cc4c9a898d52bbcb19184b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 601a0ff319cc4c9a898d52bbcb19184b
I20260923 19:50:14.430445 6279 leader_election.cc:304] T 601a0ff319cc4c9a898d52bbcb19184b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:14.430790 6279 leader_election.cc:343] T f5cb8dd5dcf54df9989dd808fe148ce6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: f5cb8dd5dcf54df9989dd808fe148ce6
I20260923 19:50:14.430364 6456 ts_tablet_manager.cc:1403] T c0ff8838ab17433ab733d3b293d4964f P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.151s user 0.020s sys 0.000s
I20260923 19:50:14.431025 7363 consensus_queue.cc:1048] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:14.431429 7363 raft_consensus.cc:2749] T 601a0ff319cc4c9a898d52bbcb19184b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:14.431778 6456 raft_consensus.cc:359] T c0ff8838ab17433ab733d3b293d4964f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.431985 6456 raft_consensus.cc:385] T c0ff8838ab17433ab733d3b293d4964f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:14.432070 6456 raft_consensus.cc:740] T c0ff8838ab17433ab733d3b293d4964f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:14.432291 6456 consensus_queue.cc:260] T c0ff8838ab17433ab733d3b293d4964f P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.432809 6456 ts_tablet_manager.cc:1434] T c0ff8838ab17433ab733d3b293d4964f P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:14.430912 6279 leader_election.cc:304] T f5cb8dd5dcf54df9989dd808fe148ce6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:14.433339 7363 raft_consensus.cc:2749] T f5cb8dd5dcf54df9989dd808fe148ce6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:14.433545 6279 leader_election.cc:343] T 623052a8c9c2436a828655da6cf6d379 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 623052a8c9c2436a828655da6cf6d379
I20260923 19:50:14.434350 6461 ts_tablet_manager.cc:1916] T ba4e9fee05994c0d8e7d1f21788280d3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:14.439229 6456 tablet_bootstrap.cc:492] T 870db252d8414be7bbe613ea467b5f3a P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:14.444542 7362 raft_consensus.cc:515] T f1a4bccf6dd2411f83b86d782ecf5f40 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.445165 7362 leader_election.cc:290] T f1a4bccf6dd2411f83b86d782ecf5f40 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:14.445719 7352 consensus_queue.cc:1048] T 2db82e6f314f412385b41720c7efdef5 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:14.446022 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4bccf6dd2411f83b86d782ecf5f40" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:14.446200 6200 raft_consensus.cc:3060] T f1a4bccf6dd2411f83b86d782ecf5f40 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
W20260923 19:50:14.447340 6279 leader_election.cc:343] T f1a4bccf6dd2411f83b86d782ecf5f40 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: f1a4bccf6dd2411f83b86d782ecf5f40
I20260923 19:50:14.449190 6456 tablet_bootstrap.cc:654] T 870db252d8414be7bbe613ea467b5f3a P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:14.449977 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 608) took 1192 ms. Trace:
I20260923 19:50:14.450053 6458 rpcz_store.cc:276] 0923 19:50:13.257585 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.257637 (+ 52us) service_pool.cc:224] Handling call
0923 19:50:14.277360 (+1019723us) ts_tablet_manager.cc:1151] Deleting tablet b8211238627b44468c8461bdc340b1bb
0923 19:50:14.277371 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:14.449959 (+172588us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1019317}
W20260923 19:50:14.450587 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet b8211238627b44468c8461bdc340b1bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8211238627b44468c8461bdc340b1bb already in progress: creating tablet
I20260923 19:50:14.451552 6200 raft_consensus.cc:2468] T f1a4bccf6dd2411f83b86d782ecf5f40 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:14.452096 6458 tablet_replica.cc:333] T cd02244c52ad4d2ab3915108a92a6f97 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:14.452283 6458 raft_consensus.cc:2243] T cd02244c52ad4d2ab3915108a92a6f97 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:14.452504 6458 raft_consensus.cc:2272] T cd02244c52ad4d2ab3915108a92a6f97 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:14.452826 6280 leader_election.cc:304] T f1a4bccf6dd2411f83b86d782ecf5f40 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:14.452991 6458 ts_tablet_manager.cc:1916] T cd02244c52ad4d2ab3915108a92a6f97 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:14.453298 7363 raft_consensus.cc:2804] T f1a4bccf6dd2411f83b86d782ecf5f40 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:14.453420 7363 raft_consensus.cc:697] T f1a4bccf6dd2411f83b86d782ecf5f40 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:14.453636 7363 consensus_queue.cc:237] T f1a4bccf6dd2411f83b86d782ecf5f40 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.456022 6459 ts_tablet_manager.cc:1916] T b529b0e82c5b48edac54cc281ac4b4a6 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:14.458909 6461 ts_tablet_manager.cc:1929] T ba4e9fee05994c0d8e7d1f21788280d3 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:14.462575 6456 tablet_bootstrap.cc:492] T 870db252d8414be7bbe613ea467b5f3a P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:14.462747 6456 ts_tablet_manager.cc:1403] T 870db252d8414be7bbe613ea467b5f3a P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.000s
I20260923 19:50:14.463487 6456 raft_consensus.cc:359] T 870db252d8414be7bbe613ea467b5f3a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.463698 6456 raft_consensus.cc:385] T 870db252d8414be7bbe613ea467b5f3a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:14.463783 6456 raft_consensus.cc:740] T 870db252d8414be7bbe613ea467b5f3a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:14.464083 6456 consensus_queue.cc:260] T 870db252d8414be7bbe613ea467b5f3a P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.464622 6456 ts_tablet_manager.cc:1434] T 870db252d8414be7bbe613ea467b5f3a P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:14.466933 6456 tablet_bootstrap.cc:492] T 86388fa08c454da9ad2ca0124dcba10b P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:14.469144 6456 tablet_bootstrap.cc:654] T 86388fa08c454da9ad2ca0124dcba10b P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:14.469300 6461 log.cc:1199] T ba4e9fee05994c0d8e7d1f21788280d3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/ba4e9fee05994c0d8e7d1f21788280d3
I20260923 19:50:14.469693 6461 ts_tablet_manager.cc:1950] T ba4e9fee05994c0d8e7d1f21788280d3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:14.470252 6457 tablet_bootstrap.cc:492] T b7ba284e81bc4388bbd6456a41d1f9f4 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:14.470374 6457 ts_tablet_manager.cc:1403] T b7ba284e81bc4388bbd6456a41d1f9f4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.071s user 0.003s sys 0.001s
I20260923 19:50:14.471014 6457 raft_consensus.cc:359] T b7ba284e81bc4388bbd6456a41d1f9f4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.471163 6457 raft_consensus.cc:385] T b7ba284e81bc4388bbd6456a41d1f9f4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:14.471215 6457 raft_consensus.cc:740] T b7ba284e81bc4388bbd6456a41d1f9f4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:14.471240 6454 tablet_bootstrap.cc:492] T 896bd068e6b343e48eb2a01679b49326 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:14.471410 6457 consensus_queue.cc:260] T b7ba284e81bc4388bbd6456a41d1f9f4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.471481 6454 ts_tablet_manager.cc:1403] T 896bd068e6b343e48eb2a01679b49326 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.046s user 0.006s sys 0.004s
I20260923 19:50:14.471879 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 645) took 1182 ms. Trace:
I20260923 19:50:14.472620 6454 raft_consensus.cc:359] T 896bd068e6b343e48eb2a01679b49326 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.472769 6454 raft_consensus.cc:385] T 896bd068e6b343e48eb2a01679b49326 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:14.472816 6454 raft_consensus.cc:740] T 896bd068e6b343e48eb2a01679b49326 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:14.472858 6461 rpcz_store.cc:276] 0923 19:50:13.289310 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.289363 (+ 53us) service_pool.cc:224] Handling call
0923 19:50:14.426832 (+1137469us) ts_tablet_manager.cc:1151] Deleting tablet ba4e9fee05994c0d8e7d1f21788280d3
0923 19:50:14.426842 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:14.442910 (+ 16068us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:14.458841 (+ 15931us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:14.471861 (+ 13020us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1137273}
I20260923 19:50:14.473022 6454 consensus_queue.cc:260] T 896bd068e6b343e48eb2a01679b49326 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.473495 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet ba4e9fee05994c0d8e7d1f21788280d3 (table default.Table_fa5d77accb2d4cb2a336e0394074518a [id=49bb9f954b544f41b75f6035b1ea68b1]) successfully deleted
I20260923 19:50:14.473608 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 636) took 1215 ms. Trace:
I20260923 19:50:14.473670 6461 rpcz_store.cc:276] 0923 19:50:13.258030 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.301084 (+ 43054us) service_pool.cc:224] Handling call
0923 19:50:14.473485 (+1172401us) ts_tablet_manager.cc:1151] Deleting tablet b8211238627b44468c8461bdc340b1bb
0923 19:50:14.473495 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:14.473592 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1171747}
I20260923 19:50:14.474282 6454 ts_tablet_manager.cc:1434] T 896bd068e6b343e48eb2a01679b49326 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
W20260923 19:50:14.474695 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet b8211238627b44468c8461bdc340b1bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8211238627b44468c8461bdc340b1bb already in progress: creating tablet
I20260923 19:50:14.475016 6461 tablet_replica.cc:333] T a11ecef9a24f4e4a812ec220b6a92cc4 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:14.475649 6454 tablet_bootstrap.cc:492] T cd02244c52ad4d2ab3915108a92a6f97 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:14.475978 6461 raft_consensus.cc:2243] T a11ecef9a24f4e4a812ec220b6a92cc4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:14.476976 6454 tablet_bootstrap.cc:654] T cd02244c52ad4d2ab3915108a92a6f97 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:14.479981 5800 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2bc47336948746d694d5a896730c501c consensus state has no leader
W20260923 19:50:14.480305 5797 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f8052b05169b4673b387ac8b716ffc4e consensus state has no leader
I20260923 19:50:14.481527 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_6590a2564d3e40bea9c0392c0bc56cb8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:14.482105 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6590a2564d3e40bea9c0392c0bc56cb8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:14.482230 5800 master_service.cc:960] ReplaceTablet: received request to replace tablet cd02244c52ad4d2ab3915108a92a6f97 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:14.482730 5800 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_3630641bfa6e48de9885dffe4112a74e" } modify_external_catalogs: true
I20260923 19:50:14.482805 5797 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_3a2441d714924cc1ae24db6dd739f56e" } modify_external_catalogs: true
I20260923 19:50:14.482923 5800 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_3630641bfa6e48de9885dffe4112a74e" } modify_external_catalogs: true
W20260923 19:50:14.483170 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a83726da349c4cd1852e956c8fa2cda5 consensus state has no leader
I20260923 19:50:14.483474 5798 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_2c882fb60c3a4a5685508054fe5fa20d" } modify_external_catalogs: true
I20260923 19:50:14.483606 5798 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_2c882fb60c3a4a5685508054fe5fa20d" } modify_external_catalogs: true
I20260923 19:50:14.485262 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet f1a4bccf6dd2411f83b86d782ecf5f40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:14.486148 7358 raft_consensus.cc:493] T ba4e9fee05994c0d8e7d1f21788280d3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.486274 7358 raft_consensus.cc:515] T ba4e9fee05994c0d8e7d1f21788280d3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.486884 7358 leader_election.cc:290] T ba4e9fee05994c0d8e7d1f21788280d3 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:14.487319 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_abf82e70b0864fc58a445ec65d5ffac1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:14.487843 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_abf82e70b0864fc58a445ec65d5ffac1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:14.489796 5805 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0323bfd60533432ebcf971ba050f2938 consensus state has no leader
I20260923 19:50:14.482926 5797 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_3a2441d714924cc1ae24db6dd739f56e" } modify_external_catalogs: true
I20260923 19:50:14.492043 5805 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 2db82e6f314f412385b41720c7efdef5 (table default.Table_fa1d82a491c04ba89f5cf3162578d550 [id=6d79e588fb9e4936aedf8cd500f68d60]). Expected version 3 got 0
I20260923 19:50:14.493497 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet d2298d814a104f5cb62196be3bf0dae6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:14.493983 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet 623052a8c9c2436a828655da6cf6d379 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:14.494426 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet 896bd068e6b343e48eb2a01679b49326 with delete_type TABLET_DATA_DELETED (replaced by tablet 0c537304c32c44adaa1e05de4496293f) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:14.494879 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet 58c24aa494bc4da28536dfa1df6123b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:14.496259 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4e9fee05994c0d8e7d1f21788280d3" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:14.496858 6280 leader_election.cc:343] T ba4e9fee05994c0d8e7d1f21788280d3 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.497798 5805 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 2db82e6f314f412385b41720c7efdef5 (table default.Table_fa1d82a491c04ba89f5cf3162578d550 [id=6d79e588fb9e4936aedf8cd500f68d60]). Expected version 3 got 0
W20260923 19:50:14.498104 6279 leader_election.cc:343] T ba4e9fee05994c0d8e7d1f21788280d3 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: ba4e9fee05994c0d8e7d1f21788280d3
I20260923 19:50:14.498214 6279 leader_election.cc:304] T ba4e9fee05994c0d8e7d1f21788280d3 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:14.498237 6026 tablet_service.cc:1558] Processing DeleteTablet for tablet 2948d729e1ec4dfca70789bcad513e52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:14.498620 7358 raft_consensus.cc:2749] T ba4e9fee05994c0d8e7d1f21788280d3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:14.499452 6317 tablet_service.cc:1558] Processing DeleteTablet for tablet c0ff8838ab17433ab733d3b293d4964f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:14.499913 6317 tablet_service.cc:1558] Processing DeleteTablet for tablet 870db252d8414be7bbe613ea467b5f3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:14.501380 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_29b8321a878b47ca9fef841557c0fad5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:14.502413 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_29b8321a878b47ca9fef841557c0fad5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:14.514719 7358 consensus_queue.cc:1048] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260923 19:50:14.517750 5804 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f5765057e685428da3caaaa65e6ed904 has no consensus state
I20260923 19:50:14.527287 5796 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 0d70deeda179486291195476e47a9ae6 (table default.Table_d130b4b675a14c5a86ff587918d83d7c [id=d1e262e6e34742538b2b26c5fae80a99]). Expected version 1 got 0
I20260923 19:50:14.530210 6317 tablet_service.cc:1511] Processing CreateTablet for tablet 459ddc0be3c04cd7929af77c0747d4e4 (DEFAULT_TABLE table=default.Table_7b56764bac484738b24f3afc0b871751 [id=92f2f9b1fb214d6d85ec22a3d2646001]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.530599 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 459ddc0be3c04cd7929af77c0747d4e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.532194 7363 raft_consensus.cc:493] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.532310 7363 raft_consensus.cc:515] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:14.533797 6279 leader_election.cc:343] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 908596339b2e4f7f8ddb7f9cd5bdcc3e
I20260923 19:50:14.534641 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "908596339b2e4f7f8ddb7f9cd5bdcc3e" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:14.534976 6169 tablet_service.cc:1511] Processing CreateTablet for tablet 459ddc0be3c04cd7929af77c0747d4e4 (DEFAULT_TABLE table=default.Table_7b56764bac484738b24f3afc0b871751 [id=92f2f9b1fb214d6d85ec22a3d2646001]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:14.535192 6280 leader_election.cc:343] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.535285 6280 leader_election.cc:304] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:14.535367 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 459ddc0be3c04cd7929af77c0747d4e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.535987 6026 tablet_service.cc:1511] Processing CreateTablet for tablet 459ddc0be3c04cd7929af77c0747d4e4 (DEFAULT_TABLE table=default.Table_7b56764bac484738b24f3afc0b871751 [id=92f2f9b1fb214d6d85ec22a3d2646001]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.536031 6028 tablet_service.cc:1511] Processing CreateTablet for tablet abb78eae17f34d5b8deedd6067b4207e (DEFAULT_TABLE table=default.Table_4c640f2dba03495aa79c4ff2d3719da2 [id=921dfab75d5d41b3895a2b91398da2a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.536339 6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 459ddc0be3c04cd7929af77c0747d4e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.536481 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abb78eae17f34d5b8deedd6067b4207e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.540673 7358 raft_consensus.cc:2749] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:14.541695 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 4f3d70c3fb2c463db1d13dcbc428d30c (DEFAULT_TABLE table=default.Table_c5c45e9fda2041f4bbb52be7e6cbf9df [id=bd4b750add614a06a7d97f8875d8170e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.542081 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f3d70c3fb2c463db1d13dcbc428d30c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.542136 6021 tablet_service.cc:1511] Processing CreateTablet for tablet 4f3d70c3fb2c463db1d13dcbc428d30c (DEFAULT_TABLE table=default.Table_c5c45e9fda2041f4bbb52be7e6cbf9df [id=bd4b750add614a06a7d97f8875d8170e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.542119 6314 tablet_service.cc:1511] Processing CreateTablet for tablet ed92b66cfdff410ca8421fd15352e148 (DEFAULT_TABLE table=default.Table_cc866643127a4bc8aebae6c828c10bac [id=3df7d6f6f6ff417e82fd6a10f3a518ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.542462 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed92b66cfdff410ca8421fd15352e148. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.542471 6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f3d70c3fb2c463db1d13dcbc428d30c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.542752 7363 leader_election.cc:290] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:14.545688 6325 tablet_service.cc:1511] Processing CreateTablet for tablet e4a7898b3f514bea8d756065104bc7b3 (DEFAULT_TABLE table=default.Table_4cbf006b85204fe99daebf0cb58089a5 [id=f3fddd1d175145eabb9c22f6683d5c43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.546080 6318 tablet_service.cc:1511] Processing CreateTablet for tablet abb78eae17f34d5b8deedd6067b4207e (DEFAULT_TABLE table=default.Table_4c640f2dba03495aa79c4ff2d3719da2 [id=921dfab75d5d41b3895a2b91398da2a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.546173 6029 tablet_service.cc:1511] Processing CreateTablet for tablet ed92b66cfdff410ca8421fd15352e148 (DEFAULT_TABLE table=default.Table_cc866643127a4bc8aebae6c828c10bac [id=3df7d6f6f6ff417e82fd6a10f3a518ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.546382 6313 tablet_service.cc:1511] Processing CreateTablet for tablet 5ccef781d8a84ff298051f5da709fe85 (DEFAULT_TABLE table=default.Table_23bee5e3273a448bac30904cc004d63a [id=9010037126534b3e8c350cfaae97b9e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.546481 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed92b66cfdff410ca8421fd15352e148. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.546663 6321 tablet_service.cc:1511] Processing CreateTablet for tablet 4f3d70c3fb2c463db1d13dcbc428d30c (DEFAULT_TABLE table=default.Table_c5c45e9fda2041f4bbb52be7e6cbf9df [id=bd4b750add614a06a7d97f8875d8170e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.548445 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4a7898b3f514bea8d756065104bc7b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.548882 6022 tablet_service.cc:1511] Processing CreateTablet for tablet e4a7898b3f514bea8d756065104bc7b3 (DEFAULT_TABLE table=default.Table_4cbf006b85204fe99daebf0cb58089a5 [id=f3fddd1d175145eabb9c22f6683d5c43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.549197 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4a7898b3f514bea8d756065104bc7b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.551494 6167 tablet_service.cc:1511] Processing CreateTablet for tablet ed92b66cfdff410ca8421fd15352e148 (DEFAULT_TABLE table=default.Table_cc866643127a4bc8aebae6c828c10bac [id=3df7d6f6f6ff417e82fd6a10f3a518ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.551823 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed92b66cfdff410ca8421fd15352e148. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.554198 6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ccef781d8a84ff298051f5da709fe85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.555707 6183 tablet_service.cc:1511] Processing CreateTablet for tablet abb78eae17f34d5b8deedd6067b4207e (DEFAULT_TABLE table=default.Table_4c640f2dba03495aa79c4ff2d3719da2 [id=921dfab75d5d41b3895a2b91398da2a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.556033 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abb78eae17f34d5b8deedd6067b4207e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.558111 6173 tablet_service.cc:1511] Processing CreateTablet for tablet e4a7898b3f514bea8d756065104bc7b3 (DEFAULT_TABLE table=default.Table_4cbf006b85204fe99daebf0cb58089a5 [id=f3fddd1d175145eabb9c22f6683d5c43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.558422 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4a7898b3f514bea8d756065104bc7b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.562963 6318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abb78eae17f34d5b8deedd6067b4207e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.563459 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 5ccef781d8a84ff298051f5da709fe85 (DEFAULT_TABLE table=default.Table_23bee5e3273a448bac30904cc004d63a [id=9010037126534b3e8c350cfaae97b9e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.563777 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ccef781d8a84ff298051f5da709fe85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.565035 7316 raft_consensus.cc:493] T 58c24aa494bc4da28536dfa1df6123b7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.565168 7316 raft_consensus.cc:515] T 58c24aa494bc4da28536dfa1df6123b7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.565752 7316 leader_election.cc:290] T 58c24aa494bc4da28536dfa1df6123b7 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:14.566790 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c24aa494bc4da28536dfa1df6123b7" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:14.566954 6343 raft_consensus.cc:2468] T 58c24aa494bc4da28536dfa1df6123b7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:14.567883 7316 raft_consensus.cc:493] T fe5d081a41a3417b855656ca6e24f235 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.567996 7316 raft_consensus.cc:515] T fe5d081a41a3417b855656ca6e24f235 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.568393 6166 tablet_service.cc:1511] Processing CreateTablet for tablet 4e15adda08684a56aa2533a4dcc2e08a (DEFAULT_TABLE table=default.Table_3a0f945ec700475d9fc1321e0fd38fa0 [id=be05e6d37db243de8a1b349a272fa967]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.568491 7316 leader_election.cc:290] T fe5d081a41a3417b855656ca6e24f235 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:14.568759 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e15adda08684a56aa2533a4dcc2e08a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:14.570313 6137 leader_election.cc:343] T 58c24aa494bc4da28536dfa1df6123b7 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 58c24aa494bc4da28536dfa1df6123b7
I20260923 19:50:14.570983 6139 leader_election.cc:304] T 58c24aa494bc4da28536dfa1df6123b7 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:14.571482 6137 leader_election.cc:343] T fe5d081a41a3417b855656ca6e24f235 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: fe5d081a41a3417b855656ca6e24f235
I20260923 19:50:14.571647 7316 raft_consensus.cc:2804] T 58c24aa494bc4da28536dfa1df6123b7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:14.571712 7316 raft_consensus.cc:493] T 58c24aa494bc4da28536dfa1df6123b7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:14.571776 7316 raft_consensus.cc:3060] T 58c24aa494bc4da28536dfa1df6123b7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:14.573091 5804 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5fddffc3232840a1897043b514d0e68b" } modify_external_catalogs: true
I20260923 19:50:14.573271 5804 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5fddffc3232840a1897043b514d0e68b" } modify_external_catalogs: true
I20260923 19:50:14.574790 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 4e15adda08684a56aa2533a4dcc2e08a (DEFAULT_TABLE table=default.Table_3a0f945ec700475d9fc1321e0fd38fa0 [id=be05e6d37db243de8a1b349a272fa967]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.575212 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 4661da9259c74a4fbe3a00df5048658d (DEFAULT_TABLE table=default.Table_b5eb8fb996c44e1ebac34b604ebad0bc [id=f1a8779b48884730a60707aa579162ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.575320 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_94ed1fa75fba4ca69e19a74840c564c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:14.575515 6139 leader_election.cc:343] T fe5d081a41a3417b855656ca6e24f235 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: fe5d081a41a3417b855656ca6e24f235
I20260923 19:50:14.575606 6139 leader_election.cc:304] T fe5d081a41a3417b855656ca6e24f235 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:14.575810 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_94ed1fa75fba4ca69e19a74840c564c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:14.575922 7361 raft_consensus.cc:2749] T fe5d081a41a3417b855656ca6e24f235 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:14.576612 7316 raft_consensus.cc:515] T 58c24aa494bc4da28536dfa1df6123b7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.577472 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_3a11a15c5e5b4bc38332d423f3d559e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:14.577914 6137 leader_election.cc:343] T 58c24aa494bc4da28536dfa1df6123b7 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 58c24aa494bc4da28536dfa1df6123b7
W20260923 19:50:14.577986 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a11a15c5e5b4bc38332d423f3d559e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:14.578236 7316 leader_election.cc:290] T 58c24aa494bc4da28536dfa1df6123b7 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:14.578594 6021 tablet_service.cc:1511] Processing CreateTablet for tablet 4661da9259c74a4fbe3a00df5048658d (DEFAULT_TABLE table=default.Table_b5eb8fb996c44e1ebac34b604ebad0bc [id=f1a8779b48884730a60707aa579162ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.578940 6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4661da9259c74a4fbe3a00df5048658d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.579036 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c24aa494bc4da28536dfa1df6123b7" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:14.579209 6343 raft_consensus.cc:3060] T 58c24aa494bc4da28536dfa1df6123b7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:14.579334 6022 tablet_service.cc:1511] Processing CreateTablet for tablet 4e15adda08684a56aa2533a4dcc2e08a (DEFAULT_TABLE table=default.Table_3a0f945ec700475d9fc1321e0fd38fa0 [id=be05e6d37db243de8a1b349a272fa967]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.581662 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e15adda08684a56aa2533a4dcc2e08a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.583027 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_6548667d6dce4e069f658ff50dab80ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:14.579466 6026 tablet_service.cc:1511] Processing CreateTablet for tablet 5ccef781d8a84ff298051f5da709fe85 (DEFAULT_TABLE table=default.Table_23bee5e3273a448bac30904cc004d63a [id=9010037126534b3e8c350cfaae97b9e7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:14.583498 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6548667d6dce4e069f658ff50dab80ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:14.583613 6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ccef781d8a84ff298051f5da709fe85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.584664 7363 raft_consensus.cc:493] T 870db252d8414be7bbe613ea467b5f3a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.584801 7363 raft_consensus.cc:515] T 870db252d8414be7bbe613ea467b5f3a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.585362 6166 tablet_service.cc:1511] Processing CreateTablet for tablet 4661da9259c74a4fbe3a00df5048658d (DEFAULT_TABLE table=default.Table_b5eb8fb996c44e1ebac34b604ebad0bc [id=f1a8779b48884730a60707aa579162ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.585439 7363 leader_election.cc:290] T 870db252d8414be7bbe613ea467b5f3a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:14.585729 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4661da9259c74a4fbe3a00df5048658d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.586593 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870db252d8414be7bbe613ea467b5f3a" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:14.586766 6279 leader_election.cc:343] T 870db252d8414be7bbe613ea467b5f3a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 870db252d8414be7bbe613ea467b5f3a
W20260923 19:50:14.587076 6280 leader_election.cc:343] T 870db252d8414be7bbe613ea467b5f3a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.587175 6280 leader_election.cc:304] T 870db252d8414be7bbe613ea467b5f3a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:14.587499 7363 raft_consensus.cc:2749] T 870db252d8414be7bbe613ea467b5f3a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:14.589218 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f3d70c3fb2c463db1d13dcbc428d30c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.589687 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4661da9259c74a4fbe3a00df5048658d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.590068 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e15adda08684a56aa2533a4dcc2e08a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.594403 6461 raft_consensus.cc:2272] T a11ecef9a24f4e4a812ec220b6a92cc4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:14.594972 6461 ts_tablet_manager.cc:1916] T a11ecef9a24f4e4a812ec220b6a92cc4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:14.595384 6170 tablet_service.cc:1511] Processing CreateTablet for tablet 717995ec489343118809ada2a6b58804 (DEFAULT_TABLE table=default.Table_7ce588248ce944fc878bbe47bbbbc8fe [id=46b5a5f448ab42a3aff6665c3a4e769d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.595728 6170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 717995ec489343118809ada2a6b58804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.597822 6343 raft_consensus.cc:2468] T 58c24aa494bc4da28536dfa1df6123b7 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:14.597967 7134 raft_consensus.cc:493] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.598081 7134 raft_consensus.cc:515] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.598773 7134 leader_election.cc:290] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:14.598884 6139 leader_election.cc:304] T 58c24aa494bc4da28536dfa1df6123b7 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:14.599495 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ea466d1b2b40e9b9b4cd5be51f79e0" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:14.600288 5995 leader_election.cc:343] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.601629 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ea466d1b2b40e9b9b4cd5be51f79e0" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:14.602064 5996 leader_election.cc:343] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.602164 5996 leader_election.cc:304] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:14.602514 7134 raft_consensus.cc:2749] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:14.603343 7050 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260923 19:50:14.603819 7134 raft_consensus.cc:493] T e4f00490b0364f0e9f1b9569b870808e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.603933 7134 raft_consensus.cc:515] T e4f00490b0364f0e9f1b9569b870808e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.604467 7134 leader_election.cc:290] T e4f00490b0364f0e9f1b9569b870808e P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:14.604672 6461 ts_tablet_manager.cc:1929] T a11ecef9a24f4e4a812ec220b6a92cc4 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:14.604774 6461 log.cc:1199] T a11ecef9a24f4e4a812ec220b6a92cc4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/a11ecef9a24f4e4a812ec220b6a92cc4
I20260923 19:50:14.605088 6461 ts_tablet_manager.cc:1950] T a11ecef9a24f4e4a812ec220b6a92cc4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:14.605142 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f00490b0364f0e9f1b9569b870808e" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:14.605640 5995 leader_election.cc:343] T e4f00490b0364f0e9f1b9569b870808e P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.605808 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 646) took 1302 ms. Trace:
I20260923 19:50:14.606163 7316 raft_consensus.cc:2804] T 58c24aa494bc4da28536dfa1df6123b7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:14.606235 7050 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 19:50:14.606505 7316 raft_consensus.cc:697] T 58c24aa494bc4da28536dfa1df6123b7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:14.606884 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f00490b0364f0e9f1b9569b870808e" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:14.607547 7050 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 19:50:14.607669 7316 consensus_queue.cc:237] T 58c24aa494bc4da28536dfa1df6123b7 P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.612241 6314 tablet_service.cc:1511] Processing CreateTablet for tablet 717995ec489343118809ada2a6b58804 (DEFAULT_TABLE table=default.Table_7ce588248ce944fc878bbe47bbbbc8fe [id=46b5a5f448ab42a3aff6665c3a4e769d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.612716 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 717995ec489343118809ada2a6b58804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.614192 5802 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 0d70deeda179486291195476e47a9ae6 (table default.Table_d130b4b675a14c5a86ff587918d83d7c [id=d1e262e6e34742538b2b26c5fae80a99]). Expected version 1 got 0
I20260923 19:50:14.614380 5802 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 2db82e6f314f412385b41720c7efdef5 (table default.Table_fa1d82a491c04ba89f5cf3162578d550 [id=6d79e588fb9e4936aedf8cd500f68d60]). Expected version 3 got 0
I20260923 19:50:14.616849 6461 rpcz_store.cc:276] 0923 19:50:13.303434 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.304099 (+ 665us) service_pool.cc:224] Handling call
0923 19:50:14.474974 (+1170875us) ts_tablet_manager.cc:1151] Deleting tablet a11ecef9a24f4e4a812ec220b6a92cc4
0923 19:50:14.474983 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:14.601695 (+126712us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:14.604629 (+ 2934us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:14.605793 (+ 1164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":118183,"tablet-delete.queue_time_us":1170693}
I20260923 19:50:14.617468 6461 tablet_replica.cc:333] T 474e34e902064764864ba06ef41b1d94 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:14.617698 6461 raft_consensus.cc:2243] T 474e34e902064764864ba06ef41b1d94 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:14.617928 6461 raft_consensus.cc:2272] T 474e34e902064764864ba06ef41b1d94 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:14.618497 6461 ts_tablet_manager.cc:1916] T 474e34e902064764864ba06ef41b1d94 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:14.622651 7361 raft_consensus.cc:493] T a08446fcf1794dab9d3181904507456f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.622785 7361 raft_consensus.cc:515] T a08446fcf1794dab9d3181904507456f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.623374 7361 leader_election.cc:290] T a08446fcf1794dab9d3181904507456f P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:14.623605 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet a11ecef9a24f4e4a812ec220b6a92cc4 (table default.Table_ba859ce2dc954a94ac103be8f6037961 [id=712c6403e1b74895b79a3f7484db7347]) successfully deleted
I20260923 19:50:14.624807 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08446fcf1794dab9d3181904507456f" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:14.625087 6343 raft_consensus.cc:2468] T a08446fcf1794dab9d3181904507456f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:14.625720 6139 leader_election.cc:304] T a08446fcf1794dab9d3181904507456f P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:14.625988 7361 raft_consensus.cc:2804] T a08446fcf1794dab9d3181904507456f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:14.626052 7361 raft_consensus.cc:493] T a08446fcf1794dab9d3181904507456f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:14.626104 7361 raft_consensus.cc:3060] T a08446fcf1794dab9d3181904507456f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:14.626551 6456 tablet_bootstrap.cc:492] T 86388fa08c454da9ad2ca0124dcba10b P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:14.626658 6456 ts_tablet_manager.cc:1403] T 86388fa08c454da9ad2ca0124dcba10b P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.160s user 0.003s sys 0.015s
I20260923 19:50:14.627300 6456 raft_consensus.cc:359] T 86388fa08c454da9ad2ca0124dcba10b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.627457 6456 raft_consensus.cc:385] T 86388fa08c454da9ad2ca0124dcba10b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:14.627512 6456 raft_consensus.cc:740] T 86388fa08c454da9ad2ca0124dcba10b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:14.627771 6456 consensus_queue.cc:260] T 86388fa08c454da9ad2ca0124dcba10b P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.606832 6457 ts_tablet_manager.cc:1434] T b7ba284e81bc4388bbd6456a41d1f9f4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.136s user 0.002s sys 0.000s
W20260923 19:50:14.607339 5996 leader_election.cc:343] T e4f00490b0364f0e9f1b9569b870808e P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.628748 7361 raft_consensus.cc:515] T a08446fcf1794dab9d3181904507456f P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.629303 7361 leader_election.cc:290] T a08446fcf1794dab9d3181904507456f P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:14.629325 6456 ts_tablet_manager.cc:1434] T 86388fa08c454da9ad2ca0124dcba10b P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260923 19:50:14.632529 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a08446fcf1794dab9d3181904507456f" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:14.632705 6343 raft_consensus.cc:3060] T a08446fcf1794dab9d3181904507456f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:14.632990 6457 tablet_bootstrap.cc:492] T 6d29923f139445cc86379c80ac15df5d P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:14.635385 6343 raft_consensus.cc:2468] T a08446fcf1794dab9d3181904507456f P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:14.635919 6139 leader_election.cc:304] T a08446fcf1794dab9d3181904507456f P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:14.636734 7361 raft_consensus.cc:2804] T a08446fcf1794dab9d3181904507456f P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:14.636893 7361 raft_consensus.cc:697] T a08446fcf1794dab9d3181904507456f P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:14.637179 7361 consensus_queue.cc:237] T a08446fcf1794dab9d3181904507456f P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.637516 6321 tablet_service.cc:1511] Processing CreateTablet for tablet f4780edf9b934c509bea9acd7290da6d (DEFAULT_TABLE table=default.Table_63c5836d0ca149f3b6b24a23873e0ecc [id=fa505fc929ea46ae815560d673843abe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.638042 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4780edf9b934c509bea9acd7290da6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.639130 6168 tablet_service.cc:1511] Processing CreateTablet for tablet f4780edf9b934c509bea9acd7290da6d (DEFAULT_TABLE table=default.Table_63c5836d0ca149f3b6b24a23873e0ecc [id=fa505fc929ea46ae815560d673843abe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.639511 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4780edf9b934c509bea9acd7290da6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.640091 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 717995ec489343118809ada2a6b58804 (DEFAULT_TABLE table=default.Table_7ce588248ce944fc878bbe47bbbbc8fe [id=46b5a5f448ab42a3aff6665c3a4e769d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.643405 6311 tablet_service.cc:1511] Processing CreateTablet for tablet a5cd258b6ff44e3db0d4cb66b51874b0 (DEFAULT_TABLE table=default.Table_9c0e162f59774279a9e240130af9e199 [id=dc26b55311fe4633aed41ac2d984b003]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.643813 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5cd258b6ff44e3db0d4cb66b51874b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.651095 6317 tablet_service.cc:1511] Processing CreateTablet for tablet 355346dce1954e93874a5cd756be8064 (DEFAULT_TABLE table=default.Table_504bdbe9702948d58b4f958360a2040b [id=ca73f0867b5d49cfb0bb7cd2315c47f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.651510 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 355346dce1954e93874a5cd756be8064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.654235 5802 master_service.cc:960] ReplaceTablet: received request to replace tablet c1347ea7774c40548975d10f6b3cba2a from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:14.663936 6459 ts_tablet_manager.cc:1929] T b529b0e82c5b48edac54cc281ac4b4a6 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:14.664158 6459 log.cc:1199] T b529b0e82c5b48edac54cc281ac4b4a6 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/b529b0e82c5b48edac54cc281ac4b4a6
I20260923 19:50:14.667456 6321 tablet_service.cc:1511] Processing CreateTablet for tablet f5765057e685428da3caaaa65e6ed904 (DEFAULT_TABLE table=default.Table_72032a8e8a254d2bad8358ebf75f1615 [id=89181985e6154c7fa946148e48bef2eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.667878 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5765057e685428da3caaaa65e6ed904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.670703 6314 tablet_service.cc:1511] Processing CreateTablet for tablet bc64c9a47934420b9be3a6c8fe3ed91f (DEFAULT_TABLE table=default.Table_333fad3a38bb4b2781e372f8991a0f34 [id=a27e465b43fb4b4f9164761377d239c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.670797 6325 tablet_service.cc:1511] Processing CreateTablet for tablet cc581dd78b6d4fb29fff701ae794a89d (DEFAULT_TABLE table=default.Table_3630641bfa6e48de9885dffe4112a74e [id=aab8b79c08264896a5fafabd8408855f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.671101 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc64c9a47934420b9be3a6c8fe3ed91f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.671409 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc581dd78b6d4fb29fff701ae794a89d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.672166 6173 tablet_service.cc:1511] Processing CreateTablet for tablet f5765057e685428da3caaaa65e6ed904 (DEFAULT_TABLE table=default.Table_72032a8e8a254d2bad8358ebf75f1615 [id=89181985e6154c7fa946148e48bef2eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.672555 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5765057e685428da3caaaa65e6ed904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.675225 6169 tablet_service.cc:1511] Processing CreateTablet for tablet a5cd258b6ff44e3db0d4cb66b51874b0 (DEFAULT_TABLE table=default.Table_9c0e162f59774279a9e240130af9e199 [id=dc26b55311fe4633aed41ac2d984b003]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.675590 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5cd258b6ff44e3db0d4cb66b51874b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.678859 6310 tablet_service.cc:1511] Processing CreateTablet for tablet b579d2c0653240c4bd7aa061fff0e1a1 (DEFAULT_TABLE table=default.Table_d9ebca389fa642cda383e62c5e7fae3a [id=14d44b4e26554d4daaba50db16e556b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.679265 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b579d2c0653240c4bd7aa061fff0e1a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.682626 6317 tablet_service.cc:1511] Processing CreateTablet for tablet 242a63d6282f435aa94fb4307c15ca8a (DEFAULT_TABLE table=default.Table_be2d57dc97394f3a9f8b723a664793ff [id=e0955b39c9fb40c9b14661b486140e58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.682686 5801 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 349c0447464d4c5380cf15cb4aeb54a4
I20260923 19:50:14.682974 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242a63d6282f435aa94fb4307c15ca8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.683703 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet c031d99a6f9844c29664236662e8d5f8
I20260923 19:50:14.684929 7363 raft_consensus.cc:493] T 465371cfbe544ba98e6eea05033ecf05 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.685045 7363 raft_consensus.cc:515] T 465371cfbe544ba98e6eea05033ecf05 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.685246 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet b6ef90ddd7a34dfdb8309d0e1c3688e7
I20260923 19:50:14.685660 7363 leader_election.cc:290] T 465371cfbe544ba98e6eea05033ecf05 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:14.686100 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 17a105f389d041dbb0bf8b828f990d27
I20260923 19:50:14.686698 5800 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet cc581dd78b6d4fb29fff701ae794a89d
I20260923 19:50:14.687713 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465371cfbe544ba98e6eea05033ecf05" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:14.688838 6308 tablet_service.cc:1511] Processing CreateTablet for tablet 8d70b50dc7fb413eb5c2f1a768089d2e (DEFAULT_TABLE table=default.Table_e2fa24504c43499d8907f4215b0153c4 [id=360aa3c30bd5402498add55c3a7672c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.689213 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d70b50dc7fb413eb5c2f1a768089d2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.694029 6309 tablet_service.cc:1558] Processing DeleteTablet for tablet b6ef90ddd7a34dfdb8309d0e1c3688e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:14.694314 6306 tablet_service.cc:1558] Processing DeleteTablet for tablet 17a105f389d041dbb0bf8b828f990d27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:14.694509 6316 tablet_service.cc:1558] Processing DeleteTablet for tablet cc581dd78b6d4fb29fff701ae794a89d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:14.698104 5797 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d130b4b675a14c5a86ff587918d83d7c" } new_table_name: "default.Table_e99b5d82a0814c538bfe455a29c4fa8e" modify_external_catalogs: true
I20260923 19:50:14.698400 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b6d74978fafc4efb936873a5b5be74db" } new_table_name: "default.Table_7f7907c8e1bc4ad1ae68faf5f072b318" modify_external_catalogs: true
I20260923 19:50:14.698881 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_e9566b6b8f85440db073d543e768b2ae" } new_table_name: "default.Table_cea4d04a92eb4480be6da3424c723326" modify_external_catalogs: true
I20260923 19:50:14.699550 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_546176a528e34e3488adcb2f3ee2b4e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:14.700358 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_546176a528e34e3488adcb2f3ee2b4e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:14.700917 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_9ebd650e625041a897b52b9d151b4ada"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:14.701526 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ebd650e625041a897b52b9d151b4ada in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:14.702980 5804 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_c37dd4b246c24d57953eb81163b7b5f0" } new_table_name: "default.Table_097795475d8a46e582c0d71ee25ea439" modify_external_catalogs: true
I20260923 19:50:14.703847 6313 tablet_service.cc:1558] Processing DeleteTablet for tablet 349c0447464d4c5380cf15cb4aeb54a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:14.704397 6318 tablet_service.cc:1558] Processing DeleteTablet for tablet c031d99a6f9844c29664236662e8d5f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:14.705160 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 717995ec489343118809ada2a6b58804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.708302 6031 tablet_service.cc:1511] Processing CreateTablet for tablet bc64c9a47934420b9be3a6c8fe3ed91f (DEFAULT_TABLE table=default.Table_333fad3a38bb4b2781e372f8991a0f34 [id=a27e465b43fb4b4f9164761377d239c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.708810 6029 tablet_service.cc:1511] Processing CreateTablet for tablet a5cd258b6ff44e3db0d4cb66b51874b0 (DEFAULT_TABLE table=default.Table_9c0e162f59774279a9e240130af9e199 [id=dc26b55311fe4633aed41ac2d984b003]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.709069 6032 tablet_service.cc:1511] Processing CreateTablet for tablet f5765057e685428da3caaaa65e6ed904 (DEFAULT_TABLE table=default.Table_72032a8e8a254d2bad8358ebf75f1615 [id=89181985e6154c7fa946148e48bef2eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.709213 6030 tablet_service.cc:1511] Processing CreateTablet for tablet 355346dce1954e93874a5cd756be8064 (DEFAULT_TABLE table=default.Table_504bdbe9702948d58b4f958360a2040b [id=ca73f0867b5d49cfb0bb7cd2315c47f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.709642 6037 tablet_service.cc:1511] Processing CreateTablet for tablet b579d2c0653240c4bd7aa061fff0e1a1 (DEFAULT_TABLE table=default.Table_d9ebca389fa642cda383e62c5e7fae3a [id=14d44b4e26554d4daaba50db16e556b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.709776 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc64c9a47934420b9be3a6c8fe3ed91f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:14.710683 6279 leader_election.cc:343] T 465371cfbe544ba98e6eea05033ecf05 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 465371cfbe544ba98e6eea05033ecf05
W20260923 19:50:14.711143 6137 leader_election.cc:343] T a08446fcf1794dab9d3181904507456f P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: a08446fcf1794dab9d3181904507456f
I20260923 19:50:14.628875 5996 leader_election.cc:304] T e4f00490b0364f0e9f1b9569b870808e P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
W20260923 19:50:14.711609 6137 leader_election.cc:343] T a08446fcf1794dab9d3181904507456f P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: a08446fcf1794dab9d3181904507456f
I20260923 19:50:14.711241 6461 ts_tablet_manager.cc:1929] T 474e34e902064764864ba06ef41b1d94 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:14.711867 6036 tablet_service.cc:1558] Processing DeleteTablet for tablet cc581dd78b6d4fb29fff701ae794a89d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:14.712001 6461 log.cc:1199] T 474e34e902064764864ba06ef41b1d94 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/474e34e902064764864ba06ef41b1d94
I20260923 19:50:14.712505 6027 tablet_service.cc:1511] Processing CreateTablet for tablet cc581dd78b6d4fb29fff701ae794a89d (DEFAULT_TABLE table=default.Table_3630641bfa6e48de9885dffe4112a74e [id=aab8b79c08264896a5fafabd8408855f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.712710 6461 ts_tablet_manager.cc:1950] T 474e34e902064764864ba06ef41b1d94 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:14.714188 7134 raft_consensus.cc:2749] T e4f00490b0364f0e9f1b9569b870808e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:14.714672 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 647) took 1411 ms. Trace:
I20260923 19:50:14.714874 6461 rpcz_store.cc:276] 0923 19:50:13.303520 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.304311 (+ 791us) service_pool.cc:224] Handling call
0923 19:50:14.617423 (+1313112us) ts_tablet_manager.cc:1151] Deleting tablet 474e34e902064764864ba06ef41b1d94
0923 19:50:14.617432 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:14.704775 (+ 87343us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:14.710672 (+ 5897us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:14.714616 (+ 3944us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1312924}
I20260923 19:50:14.715893 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 648) took 1351 ms. Trace:
I20260923 19:50:14.716099 6461 rpcz_store.cc:276] 0923 19:50:13.364551 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.369452 (+ 4901us) service_pool.cc:224] Handling call
0923 19:50:14.715621 (+1346169us) ts_tablet_manager.cc:1151] Deleting tablet c212b069c3f740ecac403c99d93de7d9
0923 19:50:14.715672 (+ 51us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:14.715836 (+ 164us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1325823}
I20260923 19:50:14.712167 6023 tablet_service.cc:1558] Processing DeleteTablet for tablet c031d99a6f9844c29664236662e8d5f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:14.716977 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 651) took 1271 ms. Trace:
W20260923 19:50:14.717015 5996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.195:32855, user_credentials={real_user=slave}} blocked reactor thread for 109678us
I20260923 19:50:14.717109 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b579d2c0653240c4bd7aa061fff0e1a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.718600 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 355346dce1954e93874a5cd756be8064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.719280 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5765057e685428da3caaaa65e6ed904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.720396 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5cd258b6ff44e3db0d4cb66b51874b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.722324 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc581dd78b6d4fb29fff701ae794a89d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.724856 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 474e34e902064764864ba06ef41b1d94 (table default.Table_89c60db74742422086b6dcf76932a865 [id=2d69a962a7234afeb8366c66555b91e1]) successfully deleted
W20260923 19:50:14.725801 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet c212b069c3f740ecac403c99d93de7d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c212b069c3f740ecac403c99d93de7d9 already in progress: creating tablet
I20260923 19:50:14.725353 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_8df2759da2014f54b7c9979eebb709a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:14.726557 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8df2759da2014f54b7c9979eebb709a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:14.728031 6025 tablet_service.cc:1511] Processing CreateTablet for tablet 242a63d6282f435aa94fb4307c15ca8a (DEFAULT_TABLE table=default.Table_be2d57dc97394f3a9f8b723a664793ff [id=e0955b39c9fb40c9b14661b486140e58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.728403 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242a63d6282f435aa94fb4307c15ca8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.728955 6026 tablet_service.cc:1511] Processing CreateTablet for tablet f4780edf9b934c509bea9acd7290da6d (DEFAULT_TABLE table=default.Table_63c5836d0ca149f3b6b24a23873e0ecc [id=fa505fc929ea46ae815560d673843abe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.729388 6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4780edf9b934c509bea9acd7290da6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.730830 6456 tablet_bootstrap.cc:492] T 18bab39d85f94f4283f0b18c1c9b48a2 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:14.717193 6461 rpcz_store.cc:276] 0923 19:50:13.445703 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.450636 (+ 4933us) service_pool.cc:224] Handling call
0923 19:50:14.716623 (+1265987us) ts_tablet_manager.cc:1151] Deleting tablet ba0453ef529344dfbab1130daa985fef
0923 19:50:14.716674 (+ 51us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:14.716921 (+ 247us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1265743}
I20260923 19:50:14.731405 6461 tablet_replica.cc:333] T d09faa67bdc54d31a7f7a1b012de9ba1 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:14.735498 6170 tablet_service.cc:1511] Processing CreateTablet for tablet 355346dce1954e93874a5cd756be8064 (DEFAULT_TABLE table=default.Table_504bdbe9702948d58b4f958360a2040b [id=ca73f0867b5d49cfb0bb7cd2315c47f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.735589 6033 tablet_service.cc:1558] Processing DeleteTablet for tablet b6ef90ddd7a34dfdb8309d0e1c3688e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:14.735904 6170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 355346dce1954e93874a5cd756be8064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.735904 6035 tablet_service.cc:1558] Processing DeleteTablet for tablet 17a105f389d041dbb0bf8b828f990d27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:14.736414 6175 tablet_service.cc:1511] Processing CreateTablet for tablet bc64c9a47934420b9be3a6c8fe3ed91f (DEFAULT_TABLE table=default.Table_333fad3a38bb4b2781e372f8991a0f34 [id=a27e465b43fb4b4f9164761377d239c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.736763 6171 tablet_service.cc:1511] Processing CreateTablet for tablet cc581dd78b6d4fb29fff701ae794a89d (DEFAULT_TABLE table=default.Table_3630641bfa6e48de9885dffe4112a74e [id=aab8b79c08264896a5fafabd8408855f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.737025 6171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc581dd78b6d4fb29fff701ae794a89d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.735459 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet c1347ea7774c40548975d10f6b3cba2a
W20260923 19:50:14.737474 6280 leader_election.cc:343] T 465371cfbe544ba98e6eea05033ecf05 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.737598 6280 leader_election.cc:304] T 465371cfbe544ba98e6eea05033ecf05 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:14.738006 7363 raft_consensus.cc:2749] T 465371cfbe544ba98e6eea05033ecf05 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:14.738080 5802 catalog_manager.cc:6934] ReplaceTablet: tablet c1347ea7774c40548975d10f6b3cba2a deleted and replaced by tablet cabd3b2034664a5893bd6b084ee064e9
I20260923 19:50:14.738520 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_027ffe21cd7e440fa1b288bcb1d393c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:14.739183 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_027ffe21cd7e440fa1b288bcb1d393c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:14.739964 6318 tablet_service.cc:1558] Processing DeleteTablet for tablet c1347ea7774c40548975d10f6b3cba2a with delete_type TABLET_DATA_DELETED (replaced by tablet cabd3b2034664a5893bd6b084ee064e9) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:14.740125 6461 raft_consensus.cc:2243] T d09faa67bdc54d31a7f7a1b012de9ba1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:14.740268 6461 raft_consensus.cc:2272] T d09faa67bdc54d31a7f7a1b012de9ba1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:14.740768 6461 ts_tablet_manager.cc:1916] T d09faa67bdc54d31a7f7a1b012de9ba1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:14.735541 6038 tablet_service.cc:1558] Processing DeleteTablet for tablet 349c0447464d4c5380cf15cb4aeb54a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:14.744920 6457 tablet_bootstrap.cc:654] T 6d29923f139445cc86379c80ac15df5d P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:14.745565 6040 tablet_service.cc:1511] Processing CreateTablet for tablet 8d70b50dc7fb413eb5c2f1a768089d2e (DEFAULT_TABLE table=default.Table_e2fa24504c43499d8907f4215b0153c4 [id=360aa3c30bd5402498add55c3a7672c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.745920 6040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d70b50dc7fb413eb5c2f1a768089d2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.747035 6459 ts_tablet_manager.cc:1950] T b529b0e82c5b48edac54cc281ac4b4a6 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:14.748469 7363 raft_consensus.cc:493] T 1fcd1c1bfd2c437a955c34569605a6d4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.748654 6456 tablet_bootstrap.cc:654] T 18bab39d85f94f4283f0b18c1c9b48a2 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:14.748637 7363 raft_consensus.cc:515] T 1fcd1c1bfd2c437a955c34569605a6d4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.749464 7363 leader_election.cc:290] T 1fcd1c1bfd2c437a955c34569605a6d4 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:14.750231 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd1c1bfd2c437a955c34569605a6d4" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:14.750865 6280 leader_election.cc:343] T 1fcd1c1bfd2c437a955c34569605a6d4 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.760501 6054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd1c1bfd2c437a955c34569605a6d4" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:14.760679 6054 raft_consensus.cc:2468] T 1fcd1c1bfd2c437a955c34569605a6d4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:14.759950 7256 raft_consensus.cc:515] T 623052a8c9c2436a828655da6cf6d379 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.763000 7256 leader_election.cc:290] T 623052a8c9c2436a828655da6cf6d379 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:14.763751 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623052a8c9c2436a828655da6cf6d379" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:14.763967 6200 raft_consensus.cc:3060] T 623052a8c9c2436a828655da6cf6d379 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:14.767275 7316 raft_consensus.cc:493] T 896bd068e6b343e48eb2a01679b49326 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.767398 7316 raft_consensus.cc:515] T 896bd068e6b343e48eb2a01679b49326 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.767917 7316 leader_election.cc:290] T 896bd068e6b343e48eb2a01679b49326 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:14.768492 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896bd068e6b343e48eb2a01679b49326" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:14.768644 6343 raft_consensus.cc:2468] T 896bd068e6b343e48eb2a01679b49326 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:14.769093 6139 leader_election.cc:304] T 896bd068e6b343e48eb2a01679b49326 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:14.769105 6279 leader_election.cc:304] T 1fcd1c1bfd2c437a955c34569605a6d4 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:14.769382 7316 raft_consensus.cc:2804] T 896bd068e6b343e48eb2a01679b49326 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:14.769451 7316 raft_consensus.cc:493] T 896bd068e6b343e48eb2a01679b49326 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:14.769508 7316 raft_consensus.cc:3060] T 896bd068e6b343e48eb2a01679b49326 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:14.769865 7363 raft_consensus.cc:2804] T 1fcd1c1bfd2c437a955c34569605a6d4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:14.769986 7363 raft_consensus.cc:493] T 1fcd1c1bfd2c437a955c34569605a6d4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:14.770049 7363 raft_consensus.cc:3060] T 1fcd1c1bfd2c437a955c34569605a6d4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
W20260923 19:50:14.770428 6137 leader_election.cc:343] T 896bd068e6b343e48eb2a01679b49326 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 896bd068e6b343e48eb2a01679b49326
I20260923 19:50:14.773466 7363 raft_consensus.cc:515] T 1fcd1c1bfd2c437a955c34569605a6d4 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:14.775179 6279 leader_election.cc:343] T 623052a8c9c2436a828655da6cf6d379 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 623052a8c9c2436a828655da6cf6d379
I20260923 19:50:14.735140 5796 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 0d70deeda179486291195476e47a9ae6 (table default.Table_d130b4b675a14c5a86ff587918d83d7c [id=d1e262e6e34742538b2b26c5fae80a99]). Expected version 1 got 0
I20260923 19:50:14.779713 7363 leader_election.cc:290] T 1fcd1c1bfd2c437a955c34569605a6d4 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:14.780349 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_74f45a860df845a484035e5b23fd874e" } new_table_name: "default.Table_96fc17089cd1494cae8638a3cb02d37f" modify_external_catalogs: true
W20260923 19:50:14.782523 5790 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.5.143.193:39887, user_credentials={real_user=slave}} blocked reactor thread for 53377.5us
W20260923 19:50:14.784247 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet ba0453ef529344dfbab1130daa985fef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba0453ef529344dfbab1130daa985fef already in progress: creating tablet
I20260923 19:50:14.796216 6054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd1c1bfd2c437a955c34569605a6d4" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:14.796411 6054 raft_consensus.cc:3060] T 1fcd1c1bfd2c437a955c34569605a6d4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:14.799178 6054 raft_consensus.cc:2468] T 1fcd1c1bfd2c437a955c34569605a6d4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:14.796190 6031 tablet_service.cc:1558] Processing DeleteTablet for tablet c1347ea7774c40548975d10f6b3cba2a with delete_type TABLET_DATA_DELETED (replaced by tablet cabd3b2034664a5893bd6b084ee064e9) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:14.799891 6279 leader_election.cc:304] T 1fcd1c1bfd2c437a955c34569605a6d4 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:14.800541 7363 raft_consensus.cc:2804] T 1fcd1c1bfd2c437a955c34569605a6d4 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:14.800885 7363 raft_consensus.cc:697] T 1fcd1c1bfd2c437a955c34569605a6d4 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:14.801385 7363 consensus_queue.cc:237] T 1fcd1c1bfd2c437a955c34569605a6d4 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.803416 7358 raft_consensus.cc:493] T 7b1601590508479c8f401cd09d9f4c3b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.803562 7358 raft_consensus.cc:515] T 7b1601590508479c8f401cd09d9f4c3b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.804299 7358 leader_election.cc:290] T 7b1601590508479c8f401cd09d9f4c3b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:14.804834 6456 tablet_bootstrap.cc:492] T 18bab39d85f94f4283f0b18c1c9b48a2 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:14.804955 6456 ts_tablet_manager.cc:1403] T 18bab39d85f94f4283f0b18c1c9b48a2 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.175s user 0.003s sys 0.000s
I20260923 19:50:14.805598 6456 raft_consensus.cc:359] T 18bab39d85f94f4283f0b18c1c9b48a2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.805744 6456 raft_consensus.cc:385] T 18bab39d85f94f4283f0b18c1c9b48a2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:14.805795 6456 raft_consensus.cc:740] T 18bab39d85f94f4283f0b18c1c9b48a2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:14.805974 6456 consensus_queue.cc:260] T 18bab39d85f94f4283f0b18c1c9b48a2 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.806556 6456 ts_tablet_manager.cc:1434] T 18bab39d85f94f4283f0b18c1c9b48a2 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:50:14.806655 6461 ts_tablet_manager.cc:1929] T d09faa67bdc54d31a7f7a1b012de9ba1 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:14.806761 6461 log.cc:1199] T d09faa67bdc54d31a7f7a1b012de9ba1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/d09faa67bdc54d31a7f7a1b012de9ba1
I20260923 19:50:14.806854 6456 tablet_bootstrap.cc:492] T 7e41501bf01e4765853c27e4cac21e2b P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
W20260923 19:50:14.807390 6279 leader_election.cc:343] T 7b1601590508479c8f401cd09d9f4c3b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 7b1601590508479c8f401cd09d9f4c3b
I20260923 19:50:14.807531 6461 ts_tablet_manager.cc:1950] T d09faa67bdc54d31a7f7a1b012de9ba1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:14.808244 6456 tablet_bootstrap.cc:654] T 7e41501bf01e4765853c27e4cac21e2b P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:14.808720 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 656) took 1254 ms. Trace:
I20260923 19:50:14.808809 6461 rpcz_store.cc:276] 0923 19:50:13.553794 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.566049 (+ 12255us) service_pool.cc:224] Handling call
0923 19:50:14.731359 (+1165310us) ts_tablet_manager.cc:1151] Deleting tablet d09faa67bdc54d31a7f7a1b012de9ba1
0923 19:50:14.731368 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:14.802777 (+ 71409us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:14.806230 (+ 3453us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:14.808704 (+ 2474us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1163992}
I20260923 19:50:14.809454 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet d09faa67bdc54d31a7f7a1b012de9ba1 (table default.Table_8e43f2a7e2aa40e8afe8272232c65a8e [id=834c18797d8e48a79c45628c5180b80b]) successfully deleted
I20260923 19:50:14.810732 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 660) took 1243 ms. Trace:
I20260923 19:50:14.810833 6461 rpcz_store.cc:276] 0923 19:50:13.567012 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.567065 (+ 53us) service_pool.cc:224] Handling call
0923 19:50:14.810593 (+1243528us) ts_tablet_manager.cc:1151] Deleting tablet f7cf45d4c4d3480288698682c1c85869
0923 19:50:14.810606 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:14.810712 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1243160}
W20260923 19:50:14.811508 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet f7cf45d4c4d3480288698682c1c85869 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7cf45d4c4d3480288698682c1c85869 already in progress: creating tablet
I20260923 19:50:14.813675 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_8ff522cbded24ea9a5c6976986574fcb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:14.813756 6461 tablet_replica.cc:333] T 6238d16b1be74dd88fd2e089fbd85d33 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:14.814177 6461 raft_consensus.cc:2243] T 6238d16b1be74dd88fd2e089fbd85d33 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260923 19:50:14.814249 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8ff522cbded24ea9a5c6976986574fcb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:14.814321 6461 raft_consensus.cc:2272] T 6238d16b1be74dd88fd2e089fbd85d33 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:14.814673 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_bc31ee87b22a4ca3abd012dcddaa9ff8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:14.815348 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bc31ee87b22a4ca3abd012dcddaa9ff8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:14.816725 5796 master_service.cc:960] ReplaceTablet: received request to replace tablet 2ed8d49f1b3d4bee80b1822df2a7f495 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:14.820442 6461 ts_tablet_manager.cc:1916] T 6238d16b1be74dd88fd2e089fbd85d33 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:14.831454 6461 ts_tablet_manager.cc:1929] T 6238d16b1be74dd88fd2e089fbd85d33 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:14.831519 6456 tablet_bootstrap.cc:492] T 7e41501bf01e4765853c27e4cac21e2b P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:14.831588 6461 log.cc:1199] T 6238d16b1be74dd88fd2e089fbd85d33 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/6238d16b1be74dd88fd2e089fbd85d33
I20260923 19:50:14.831729 6456 ts_tablet_manager.cc:1403] T 7e41501bf01e4765853c27e4cac21e2b P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.002s
I20260923 19:50:14.831868 6461 ts_tablet_manager.cc:1950] T 6238d16b1be74dd88fd2e089fbd85d33 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:14.779544 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd1c1bfd2c437a955c34569605a6d4" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:14.832899 6175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc64c9a47934420b9be3a6c8fe3ed91f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.833053 6027 tablet_service.cc:1558] Processing DeleteTablet for tablet b7ba284e81bc4388bbd6456a41d1f9f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:14.837738 6459 tablet_replica.cc:333] T e071b9dd1db44af0a9d1b9e904f875a5 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:14.837965 6459 raft_consensus.cc:2243] T e071b9dd1db44af0a9d1b9e904f875a5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:14.838099 6459 raft_consensus.cc:2272] T e071b9dd1db44af0a9d1b9e904f875a5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:14.838193 6183 tablet_service.cc:1511] Processing CreateTablet for tablet b579d2c0653240c4bd7aa061fff0e1a1 (DEFAULT_TABLE table=default.Table_d9ebca389fa642cda383e62c5e7fae3a [id=14d44b4e26554d4daaba50db16e556b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.838515 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b579d2c0653240c4bd7aa061fff0e1a1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:14.839512 6280 leader_election.cc:343] T 1fcd1c1bfd2c437a955c34569605a6d4 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.839833 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_20d2e475e3e744f99e0ab5cd2f094310"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:14.840370 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_20d2e475e3e744f99e0ab5cd2f094310 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:14.840502 7361 raft_consensus.cc:493] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.840626 7361 raft_consensus.cc:515] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.841408 7361 leader_election.cc:290] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:14.841857 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2298d814a104f5cb62196be3bf0dae6" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:14.842119 6343 raft_consensus.cc:2468] T d2298d814a104f5cb62196be3bf0dae6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
W20260923 19:50:14.842639 5803 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f1c1d4f73488499a9e5add81e9d5e2d6 consensus state has no leader
W20260923 19:50:14.843097 5800 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 195d4fe5f92e4e2c9330dce34c303723 consensus state has no leader
W20260923 19:50:14.843614 5804 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1985088eb56b40c1aeecc1ec7409bcdf consensus state has no leader
W20260923 19:50:14.844290 6137 leader_election.cc:343] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: d2298d814a104f5cb62196be3bf0dae6
I20260923 19:50:14.845032 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 664) took 1210 ms. Trace:
I20260923 19:50:14.845727 6173 tablet_service.cc:1558] Processing DeleteTablet for tablet 17a105f389d041dbb0bf8b828f990d27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:14.845768 6172 tablet_service.cc:1558] Processing DeleteTablet for tablet cc581dd78b6d4fb29fff701ae794a89d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:14.845114 6461 rpcz_store.cc:276] 0923 19:50:13.634447 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.640460 (+ 6013us) service_pool.cc:224] Handling call
0923 19:50:14.813714 (+1173254us) ts_tablet_manager.cc:1151] Deleting tablet 6238d16b1be74dd88fd2e089fbd85d33
0923 19:50:14.813723 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:14.823558 (+ 9835us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:14.831403 (+ 7845us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:14.845001 (+ 13598us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1173019}
I20260923 19:50:14.846333 6459 ts_tablet_manager.cc:1916] T e071b9dd1db44af0a9d1b9e904f875a5 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:14.846481 6461 tablet_replica.cc:333] T 9be4c46ee8eb4dbaad01d492b701a9e0 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
W20260923 19:50:14.846555 5805 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8fd7e98016ca4e168979d7f7411e525a consensus state has no leader
I20260923 19:50:14.846652 6461 raft_consensus.cc:2243] T 9be4c46ee8eb4dbaad01d492b701a9e0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:14.846779 6461 raft_consensus.cc:2272] T 9be4c46ee8eb4dbaad01d492b701a9e0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:14.846871 6179 tablet_service.cc:1511] Processing CreateTablet for tablet 242a63d6282f435aa94fb4307c15ca8a (DEFAULT_TABLE table=default.Table_be2d57dc97394f3a9f8b723a664793ff [id=e0955b39c9fb40c9b14661b486140e58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.847193 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242a63d6282f435aa94fb4307c15ca8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:14.847231 6461 ts_tablet_manager.cc:1916] T 9be4c46ee8eb4dbaad01d492b701a9e0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:14.847936 6139 leader_election.cc:304] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:14.849082 6168 tablet_service.cc:1558] Processing DeleteTablet for tablet b6ef90ddd7a34dfdb8309d0e1c3688e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:14.849534 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 6238d16b1be74dd88fd2e089fbd85d33 (table default.Table_ba9e77809f194febb243d6dc37df3ee0 [id=6cacf523bb724ea58690207d93819846]) successfully deleted
I20260923 19:50:14.850436 7361 raft_consensus.cc:2804] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:14.850694 7361 raft_consensus.cc:493] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:14.850891 7361 raft_consensus.cc:3060] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:14.851738 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b1601590508479c8f401cd09d9f4c3b" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:14.852016 6178 tablet_service.cc:1558] Processing DeleteTablet for tablet c031d99a6f9844c29664236662e8d5f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:14.852289 6176 tablet_service.cc:1511] Processing CreateTablet for tablet 8d70b50dc7fb413eb5c2f1a768089d2e (DEFAULT_TABLE table=default.Table_e2fa24504c43499d8907f4215b0153c4 [id=360aa3c30bd5402498add55c3a7672c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:14.852670 6176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d70b50dc7fb413eb5c2f1a768089d2e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:14.853008 6280 leader_election.cc:343] T 7b1601590508479c8f401cd09d9f4c3b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.853119 6280 leader_election.cc:304] T 7b1601590508479c8f401cd09d9f4c3b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:14.852041 6177 tablet_service.cc:1558] Processing DeleteTablet for tablet c1347ea7774c40548975d10f6b3cba2a with delete_type TABLET_DATA_DELETED (replaced by tablet cabd3b2034664a5893bd6b084ee064e9) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:14.853782 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet b529b0e82c5b48edac54cc281ac4b4a6 (table default.Table_504bdbe9702948d58b4f958360a2040b [id=ca73f0867b5d49cfb0bb7cd2315c47f2]) successfully deleted
I20260923 19:50:14.856132 7362 raft_consensus.cc:2749] T 7b1601590508479c8f401cd09d9f4c3b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:14.855223 7316 raft_consensus.cc:515] T 896bd068e6b343e48eb2a01679b49326 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:14.857658 6137 leader_election.cc:343] T 896bd068e6b343e48eb2a01679b49326 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 896bd068e6b343e48eb2a01679b49326
I20260923 19:50:14.858354 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896bd068e6b343e48eb2a01679b49326" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:14.858560 6343 raft_consensus.cc:3060] T 896bd068e6b343e48eb2a01679b49326 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:14.862166 6343 raft_consensus.cc:2468] T 896bd068e6b343e48eb2a01679b49326 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:14.863750 7399 tablet.cc:1751] T 0d70deeda179486291195476e47a9ae6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:14.863957 7398 tablet.cc:1751] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:14.864792 6458 ts_tablet_manager.cc:1929] T cd02244c52ad4d2ab3915108a92a6f97 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:14.864894 6458 log.cc:1199] T cd02244c52ad4d2ab3915108a92a6f97 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/cd02244c52ad4d2ab3915108a92a6f97
I20260923 19:50:14.865175 6458 ts_tablet_manager.cc:1950] T cd02244c52ad4d2ab3915108a92a6f97 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:14.865923 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 610) took 1604 ms. Trace:
I20260923 19:50:14.866006 6458 rpcz_store.cc:276] 0923 19:50:13.261202 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.261709 (+ 507us) service_pool.cc:224] Handling call
0923 19:50:14.452050 (+1190341us) ts_tablet_manager.cc:1151] Deleting tablet cd02244c52ad4d2ab3915108a92a6f97
0923 19:50:14.452060 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:14.651200 (+199140us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:14.864749 (+213549us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:14.865907 (+ 1158us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1190164}
I20260923 19:50:14.866465 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet cd02244c52ad4d2ab3915108a92a6f97 (table default.Table_bc20a658edaf42818fb401723f10f95f [id=a36a23e5497a47e19f09ec8627152b1f]) successfully deleted
I20260923 19:50:14.868125 6458 tablet_replica.cc:333] T a08446fcf1794dab9d3181904507456f P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:14.868125 6200 raft_consensus.cc:2468] T 623052a8c9c2436a828655da6cf6d379 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:14.868353 6458 raft_consensus.cc:2243] T a08446fcf1794dab9d3181904507456f P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:14.868516 6458 raft_consensus.cc:2272] T a08446fcf1794dab9d3181904507456f P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:14.868544 6280 leader_election.cc:304] T 623052a8c9c2436a828655da6cf6d379 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:14.869082 6458 ts_tablet_manager.cc:1916] T a08446fcf1794dab9d3181904507456f P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:14.869232 7316 leader_election.cc:290] T 896bd068e6b343e48eb2a01679b49326 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:14.871199 7362 raft_consensus.cc:2804] T 623052a8c9c2436a828655da6cf6d379 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:14.871320 7362 raft_consensus.cc:697] T 623052a8c9c2436a828655da6cf6d379 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:14.871351 7352 raft_consensus.cc:493] T 7b455812687f42848df5290d0cdbc312 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.871433 7352 raft_consensus.cc:515] T 7b455812687f42848df5290d0cdbc312 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.871557 7362 consensus_queue.cc:237] T 623052a8c9c2436a828655da6cf6d379 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.872001 7352 leader_election.cc:290] T 7b455812687f42848df5290d0cdbc312 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:14.872282 7361 raft_consensus.cc:515] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.874246 6054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b455812687f42848df5290d0cdbc312" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:14.874483 6054 raft_consensus.cc:2468] T 7b455812687f42848df5290d0cdbc312 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:14.874900 6279 leader_election.cc:304] T 7b455812687f42848df5290d0cdbc312 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:14.875167 7352 raft_consensus.cc:2804] T 7b455812687f42848df5290d0cdbc312 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:14.875233 7352 raft_consensus.cc:493] T 7b455812687f42848df5290d0cdbc312 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:14.875298 7352 raft_consensus.cc:3060] T 7b455812687f42848df5290d0cdbc312 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:14.878023 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet 349c0447464d4c5380cf15cb4aeb54a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:14.862669 6139 leader_election.cc:304] T 896bd068e6b343e48eb2a01679b49326 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:14.878048 7352 raft_consensus.cc:515] T 7b455812687f42848df5290d0cdbc312 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.878822 7352 leader_election.cc:290] T 7b455812687f42848df5290d0cdbc312 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:14.878916 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b455812687f42848df5290d0cdbc312" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:14.879218 7316 raft_consensus.cc:2804] T 896bd068e6b343e48eb2a01679b49326 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:14.879338 7316 raft_consensus.cc:697] T 896bd068e6b343e48eb2a01679b49326 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
W20260923 19:50:14.879380 6280 leader_election.cc:343] T 7b455812687f42848df5290d0cdbc312 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.879675 6054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b455812687f42848df5290d0cdbc312" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:14.879848 6054 raft_consensus.cc:3060] T 7b455812687f42848df5290d0cdbc312 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:14.881645 6459 ts_tablet_manager.cc:1929] T e071b9dd1db44af0a9d1b9e904f875a5 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:14.883292 6459 log.cc:1199] T e071b9dd1db44af0a9d1b9e904f875a5 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/e071b9dd1db44af0a9d1b9e904f875a5
I20260923 19:50:14.883736 6459 ts_tablet_manager.cc:1950] T e071b9dd1db44af0a9d1b9e904f875a5 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:14.832608 6456 raft_consensus.cc:359] T 7e41501bf01e4765853c27e4cac21e2b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.884899 6456 raft_consensus.cc:385] T 7e41501bf01e4765853c27e4cac21e2b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:14.885159 6456 raft_consensus.cc:740] T 7e41501bf01e4765853c27e4cac21e2b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:14.885229 6054 raft_consensus.cc:2468] T 7b455812687f42848df5290d0cdbc312 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:14.884763 7358 raft_consensus.cc:493] T 18bab39d85f94f4283f0b18c1c9b48a2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.885542 7358 raft_consensus.cc:515] T 18bab39d85f94f4283f0b18c1c9b48a2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.885763 6279 leader_election.cc:304] T 7b455812687f42848df5290d0cdbc312 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:14.886144 7358 leader_election.cc:290] T 18bab39d85f94f4283f0b18c1c9b48a2 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:14.886399 6456 consensus_queue.cc:260] T 7e41501bf01e4765853c27e4cac21e2b P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.886699 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bab39d85f94f4283f0b18c1c9b48a2" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:14.886782 6279 leader_election.cc:343] T 18bab39d85f94f4283f0b18c1c9b48a2 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 18bab39d85f94f4283f0b18c1c9b48a2
I20260923 19:50:14.886889 6456 ts_tablet_manager.cc:1434] T 7e41501bf01e4765853c27e4cac21e2b P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.055s user 0.001s sys 0.001s
W20260923 19:50:14.887667 6280 leader_election.cc:343] T 18bab39d85f94f4283f0b18c1c9b48a2 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.887686 7358 raft_consensus.cc:493] T 86388fa08c454da9ad2ca0124dcba10b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.888325 6280 leader_election.cc:304] T 18bab39d85f94f4283f0b18c1c9b48a2 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:14.888365 7358 raft_consensus.cc:515] T 86388fa08c454da9ad2ca0124dcba10b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.888543 5798 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_bf20f5ba63594cce94f323629947c04c" } modify_external_catalogs: true
I20260923 19:50:14.888762 7352 raft_consensus.cc:2749] T 18bab39d85f94f4283f0b18c1c9b48a2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:14.888752 5798 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_bf20f5ba63594cce94f323629947c04c" } modify_external_catalogs: true
I20260923 19:50:14.889235 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86388fa08c454da9ad2ca0124dcba10b" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:14.889439 6456 tablet_bootstrap.cc:492] T b92aaac328934d95a89e0fc08a80b0b1 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
W20260923 19:50:14.889684 6280 leader_election.cc:343] T 86388fa08c454da9ad2ca0124dcba10b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.890048 7358 leader_election.cc:290] T 86388fa08c454da9ad2ca0124dcba10b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:14.890921 6456 tablet_bootstrap.cc:654] T b92aaac328934d95a89e0fc08a80b0b1 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:14.892084 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86388fa08c454da9ad2ca0124dcba10b" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:14.892258 6060 raft_consensus.cc:2468] T 86388fa08c454da9ad2ca0124dcba10b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:14.892771 6279 leader_election.cc:304] T 86388fa08c454da9ad2ca0124dcba10b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:14.893198 7358 raft_consensus.cc:2804] T 86388fa08c454da9ad2ca0124dcba10b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:14.893313 7358 raft_consensus.cc:493] T 86388fa08c454da9ad2ca0124dcba10b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:14.893430 7358 raft_consensus.cc:3060] T 86388fa08c454da9ad2ca0124dcba10b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:14.896188 7358 raft_consensus.cc:515] T 86388fa08c454da9ad2ca0124dcba10b P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.896785 7358 leader_election.cc:290] T 86388fa08c454da9ad2ca0124dcba10b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:14.897130 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86388fa08c454da9ad2ca0124dcba10b" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:14.897307 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86388fa08c454da9ad2ca0124dcba10b" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:14.897442 6060 raft_consensus.cc:3060] T 86388fa08c454da9ad2ca0124dcba10b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
W20260923 19:50:14.897619 6280 leader_election.cc:343] T 86388fa08c454da9ad2ca0124dcba10b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.898466 5799 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_333fad3a38bb4b2781e372f8991a0f34" } modify_external_catalogs: true
I20260923 19:50:14.898708 5799 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_333fad3a38bb4b2781e372f8991a0f34" } modify_external_catalogs: true
I20260923 19:50:14.900024 7256 raft_consensus.cc:2804] T 7b455812687f42848df5290d0cdbc312 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:14.900210 7352 raft_consensus.cc:493] T 7e41501bf01e4765853c27e4cac21e2b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:14.900244 6060 raft_consensus.cc:2468] T 86388fa08c454da9ad2ca0124dcba10b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:14.900348 7352 raft_consensus.cc:515] T 7e41501bf01e4765853c27e4cac21e2b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.900743 6279 leader_election.cc:304] T 86388fa08c454da9ad2ca0124dcba10b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:14.901051 7352 leader_election.cc:290] T 7e41501bf01e4765853c27e4cac21e2b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:14.901300 7352 raft_consensus.cc:2804] T 86388fa08c454da9ad2ca0124dcba10b P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:14.901399 7352 raft_consensus.cc:697] T 86388fa08c454da9ad2ca0124dcba10b P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:14.901681 7352 consensus_queue.cc:237] T 86388fa08c454da9ad2ca0124dcba10b P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:14.902568 6279 leader_election.cc:343] T 7e41501bf01e4765853c27e4cac21e2b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 7e41501bf01e4765853c27e4cac21e2b
I20260923 19:50:14.908427 6461 ts_tablet_manager.cc:1929] T 9be4c46ee8eb4dbaad01d492b701a9e0 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:14.908545 6461 log.cc:1199] T 9be4c46ee8eb4dbaad01d492b701a9e0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/9be4c46ee8eb4dbaad01d492b701a9e0
I20260923 19:50:14.908802 6461 ts_tablet_manager.cc:1950] T 9be4c46ee8eb4dbaad01d492b701a9e0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:14.916126 6457 tablet_bootstrap.cc:492] T 6d29923f139445cc86379c80ac15df5d P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:14.916424 6457 ts_tablet_manager.cc:1403] T 6d29923f139445cc86379c80ac15df5d P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.284s user 0.023s sys 0.004s
I20260923 19:50:14.917379 6457 raft_consensus.cc:359] T 6d29923f139445cc86379c80ac15df5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.923020 7256 raft_consensus.cc:697] T 7b455812687f42848df5290d0cdbc312 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:14.923578 7256 consensus_queue.cc:237] T 7b455812687f42848df5290d0cdbc312 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.924054 6457 raft_consensus.cc:385] T 6d29923f139445cc86379c80ac15df5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:14.924692 6457 raft_consensus.cc:740] T 6d29923f139445cc86379c80ac15df5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:14.921113 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 663) took 1286 ms. Trace:
I20260923 19:50:14.931578 6461 rpcz_store.cc:276] 0923 19:50:13.634334 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.641048 (+ 6714us) service_pool.cc:224] Handling call
0923 19:50:14.846437 (+1205389us) ts_tablet_manager.cc:1151] Deleting tablet 9be4c46ee8eb4dbaad01d492b701a9e0
0923 19:50:14.846447 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:14.869601 (+ 23154us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:14.908373 (+ 38772us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:14.921091 (+ 12718us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1204280}
I20260923 19:50:14.932205 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 665) took 1233 ms. Trace:
I20260923 19:50:14.932292 6461 rpcz_store.cc:276] 0923 19:50:13.699078 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.705087 (+ 6009us) service_pool.cc:224] Handling call
0923 19:50:14.932072 (+1226985us) ts_tablet_manager.cc:1151] Deleting tablet 83dba06b0d0040889015fb052c642ec0
0923 19:50:14.932084 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:14.932191 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1226688}
I20260923 19:50:14.932672 6461 tablet_replica.cc:333] T 5e711e48156b46b5a517b330d6d41309 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:14.932865 6461 raft_consensus.cc:2243] T 5e711e48156b46b5a517b330d6d41309 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:14.933007 6461 raft_consensus.cc:2272] T 5e711e48156b46b5a517b330d6d41309 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:14.933559 6461 ts_tablet_manager.cc:1916] T 5e711e48156b46b5a517b330d6d41309 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:14.938273 5801 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_dfda35b7191d4d5cb77451b06e244c47" } modify_external_catalogs: true
I20260923 19:50:14.938491 5801 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_dfda35b7191d4d5cb77451b06e244c47" } modify_external_catalogs: true
I20260923 19:50:14.939857 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_507609d3544d468ebf6218237ccce644"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:14.940595 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_507609d3544d468ebf6218237ccce644 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:14.932034 6457 consensus_queue.cc:260] T 6d29923f139445cc86379c80ac15df5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.944388 6457 ts_tablet_manager.cc:1434] T 6d29923f139445cc86379c80ac15df5d P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.028s user 0.001s sys 0.001s
I20260923 19:50:14.945622 5804 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_0b6e487ce80a40a992825c27bab24cb2" } modify_external_catalogs: true
I20260923 19:50:14.945947 5804 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_0b6e487ce80a40a992825c27bab24cb2" } modify_external_catalogs: true
I20260923 19:50:14.947168 5800 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d874e0de26244d32ad58f316738b6553" } modify_external_catalogs: true
I20260923 19:50:14.947314 5800 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d874e0de26244d32ad58f316738b6553" } modify_external_catalogs: true
I20260923 19:50:14.948005 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_af2e4e3ea01540f180d3c3b5213da913"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:14.948547 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af2e4e3ea01540f180d3c3b5213da913 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:14.948875 6461 ts_tablet_manager.cc:1929] T 5e711e48156b46b5a517b330d6d41309 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:14.948971 6461 log.cc:1199] T 5e711e48156b46b5a517b330d6d41309 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/5e711e48156b46b5a517b330d6d41309
I20260923 19:50:14.950295 6461 ts_tablet_manager.cc:1950] T 5e711e48156b46b5a517b330d6d41309 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:14.952926 6457 tablet_bootstrap.cc:492] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:14.953579 7361 leader_election.cc:290] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:14.955062 6457 tablet_bootstrap.cc:654] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:14.957166 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2298d814a104f5cb62196be3bf0dae6" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
W20260923 19:50:14.957235 6137 leader_election.cc:343] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: d2298d814a104f5cb62196be3bf0dae6
I20260923 19:50:14.957333 6343 raft_consensus.cc:3060] T d2298d814a104f5cb62196be3bf0dae6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:14.957893 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 662) took 1323 ms. Trace:
I20260923 19:50:14.957965 6461 rpcz_store.cc:276] 0923 19:50:13.634240 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.706467 (+ 72227us) service_pool.cc:224] Handling call
0923 19:50:14.932629 (+1226162us) ts_tablet_manager.cc:1151] Deleting tablet 5e711e48156b46b5a517b330d6d41309
0923 19:50:14.932637 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:14.936754 (+ 4117us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:14.948816 (+ 12062us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:14.957851 (+ 9035us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1225919}
I20260923 19:50:14.959759 6461 tablet_replica.cc:333] T 035abecfbee7474d9dd048f35e28e867 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:14.959945 6461 raft_consensus.cc:2243] T 035abecfbee7474d9dd048f35e28e867 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:14.960095 6461 raft_consensus.cc:2272] T 035abecfbee7474d9dd048f35e28e867 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:14.960119 6343 raft_consensus.cc:2468] T d2298d814a104f5cb62196be3bf0dae6 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:14.960142 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 9be4c46ee8eb4dbaad01d492b701a9e0 (table default.Table_bb91666519bc41aaaf1fc7f8e8b26691 [id=1b974d4dff8c4868947a4d7765208c97]) successfully deleted
I20260923 19:50:14.960585 6461 ts_tablet_manager.cc:1916] T 035abecfbee7474d9dd048f35e28e867 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:14.960402 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 83dba06b0d0040889015fb052c642ec0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 83dba06b0d0040889015fb052c642ec0 already in progress: creating tablet
I20260923 19:50:14.960891 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 5e711e48156b46b5a517b330d6d41309 (table default.Table_f68f50c8c0a74d59826e623c007a41a8 [id=24509437bc6049aab27952daeb610184]) successfully deleted
I20260923 19:50:14.961966 6458 ts_tablet_manager.cc:1929] T a08446fcf1794dab9d3181904507456f P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:14.879608 7316 consensus_queue.cc:237] T 896bd068e6b343e48eb2a01679b49326 P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.962071 6458 log.cc:1199] T a08446fcf1794dab9d3181904507456f P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/a08446fcf1794dab9d3181904507456f
I20260923 19:50:14.962858 6456 tablet_bootstrap.cc:492] T b92aaac328934d95a89e0fc08a80b0b1 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:14.962978 6456 ts_tablet_manager.cc:1403] T b92aaac328934d95a89e0fc08a80b0b1 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.074s user 0.005s sys 0.012s
I20260923 19:50:14.963656 6459 tablet_replica.cc:333] T b985acc650334497832cf4505e1b0043 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:14.963655 6456 raft_consensus.cc:359] T b92aaac328934d95a89e0fc08a80b0b1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.963795 6456 raft_consensus.cc:385] T b92aaac328934d95a89e0fc08a80b0b1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:14.963830 6459 raft_consensus.cc:2243] T b985acc650334497832cf4505e1b0043 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:14.963842 6456 raft_consensus.cc:740] T b92aaac328934d95a89e0fc08a80b0b1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:14.964021 6459 pending_rounds.cc:70] T b985acc650334497832cf4505e1b0043 P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:14.964066 6459 pending_rounds.cc:77] T b985acc650334497832cf4505e1b0043 P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630586710712320 op_type: NO_OP noop_request { }
I20260923 19:50:14.964039 6456 consensus_queue.cc:260] T b92aaac328934d95a89e0fc08a80b0b1 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.964133 6459 raft_consensus.cc:2889] T b985acc650334497832cf4505e1b0043 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:14.964205 6459 raft_consensus.cc:2272] T b985acc650334497832cf4505e1b0043 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:14.964212 5802 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_e99b5d82a0814c538bfe455a29c4fa8e [id=d1e262e6e34742538b2b26c5fae80a99] alter complete (version 2)
I20260923 19:50:14.964519 6456 ts_tablet_manager.cc:1434] T b92aaac328934d95a89e0fc08a80b0b1 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260923 19:50:14.964619 5802 master_service.cc:960] ReplaceTablet: received request to replace tablet cf0caa6afcf546678c233a9333b77a2a from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:14.964947 6456 tablet_bootstrap.cc:492] T 8d87f05f29bd476386ff6516676ce31a P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:14.964896 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e41501bf01e4765853c27e4cac21e2b" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:14.965390 6139 leader_election.cc:304] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:14.965864 6280 leader_election.cc:343] T 7e41501bf01e4765853c27e4cac21e2b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.965997 6280 leader_election.cc:304] T 7e41501bf01e4765853c27e4cac21e2b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:14.966394 6458 ts_tablet_manager.cc:1950] T a08446fcf1794dab9d3181904507456f P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:14.967671 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 609) took 1706 ms. Trace:
I20260923 19:50:14.968300 6458 rpcz_store.cc:276] 0923 19:50:13.261059 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.262007 (+ 948us) service_pool.cc:224] Handling call
0923 19:50:14.868076 (+1606069us) ts_tablet_manager.cc:1151] Deleting tablet a08446fcf1794dab9d3181904507456f
0923 19:50:14.868085 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:14.952250 (+ 84165us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:14.961906 (+ 9656us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:14.967653 (+ 5747us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1605895}
I20260923 19:50:14.969195 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet a08446fcf1794dab9d3181904507456f (table default.Table_e1b933d20310499aab93b720704ea8d0 [id=c348e030b47641e7a407e9c2903215d6]) successfully deleted
I20260923 19:50:14.969614 6458 tablet_replica.cc:333] T ba4e9fee05994c0d8e7d1f21788280d3 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:14.969762 7352 raft_consensus.cc:2749] T 7e41501bf01e4765853c27e4cac21e2b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:14.970511 6456 tablet_bootstrap.cc:654] T 8d87f05f29bd476386ff6516676ce31a P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:14.970836 6458 raft_consensus.cc:2243] T ba4e9fee05994c0d8e7d1f21788280d3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:14.970986 6458 raft_consensus.cc:2272] T ba4e9fee05994c0d8e7d1f21788280d3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:14.971467 6458 ts_tablet_manager.cc:1916] T ba4e9fee05994c0d8e7d1f21788280d3 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:14.973330 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet e071b9dd1db44af0a9d1b9e904f875a5 (table default.Table_b7610081818744a5b76680621ab7212d [id=8b14917d9dc6415dbb75917bccf09502]) successfully deleted
I20260923 19:50:14.974656 7361 raft_consensus.cc:2804] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:14.974772 7361 raft_consensus.cc:697] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:14.974856 6459 ts_tablet_manager.cc:1916] T b985acc650334497832cf4505e1b0043 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:14.976833 6461 ts_tablet_manager.cc:1929] T 035abecfbee7474d9dd048f35e28e867 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:14.976938 6461 log.cc:1199] T 035abecfbee7474d9dd048f35e28e867 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/035abecfbee7474d9dd048f35e28e867
I20260923 19:50:14.977221 6461 ts_tablet_manager.cc:1950] T 035abecfbee7474d9dd048f35e28e867 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:14.978082 5805 catalog_manager.cc:5838] T 1fcd1c1bfd2c437a955c34569605a6d4 P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:14.960583 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b455812687f42848df5290d0cdbc312" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:14.974975 7361 consensus_queue.cc:237] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.985746 6456 tablet_bootstrap.cc:492] T 8d87f05f29bd476386ff6516676ce31a P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:14.986027 6456 ts_tablet_manager.cc:1403] T 8d87f05f29bd476386ff6516676ce31a P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.000s
I20260923 19:50:14.986670 6456 raft_consensus.cc:359] T 8d87f05f29bd476386ff6516676ce31a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:14.986763 6280 leader_election.cc:343] T 7b455812687f42848df5290d0cdbc312 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:14.987149 6456 raft_consensus.cc:385] T 8d87f05f29bd476386ff6516676ce31a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:14.987257 6456 raft_consensus.cc:740] T 8d87f05f29bd476386ff6516676ce31a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:14.987535 6456 consensus_queue.cc:260] T 8d87f05f29bd476386ff6516676ce31a P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:14.988471 6456 ts_tablet_manager.cc:1434] T 8d87f05f29bd476386ff6516676ce31a P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:14.989573 6456 tablet_bootstrap.cc:492] T 12f4abb573bd4be6961b55c27c684d06 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:14.989588 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 2ed8d49f1b3d4bee80b1822df2a7f495
I20260923 19:50:14.990052 5801 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 104f137941e84b83bb9a726752c865c1
I20260923 19:50:14.990101 5796 catalog_manager.cc:6934] ReplaceTablet: tablet 2ed8d49f1b3d4bee80b1822df2a7f495 deleted and replaced by tablet ebc9dca1c228493a9dbaca4dd777d983
I20260923 19:50:14.992108 6456 tablet_bootstrap.cc:654] T 12f4abb573bd4be6961b55c27c684d06 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:14.994743 5797 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 6d29923f139445cc86379c80ac15df5d (table default.Table_0bf993fb53a243408934c3ce7812f300 [id=1dc5c4b9cfe242b099053cbb53aac5ce]). Expected version 1 got 0
I20260923 19:50:14.995322 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 661) took 1361 ms. Trace:
I20260923 19:50:14.995827 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ed8d49f1b3d4bee80b1822df2a7f495 with delete_type TABLET_DATA_DELETED (replaced by tablet ebc9dca1c228493a9dbaca4dd777d983) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:14.996508 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet 104f137941e84b83bb9a726752c865c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:14.996836 6461 rpcz_store.cc:276] 0923 19:50:13.634130 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.709250 (+ 75120us) service_pool.cc:224] Handling call
0923 19:50:14.959711 (+1250461us) ts_tablet_manager.cc:1151] Deleting tablet 035abecfbee7474d9dd048f35e28e867
0923 19:50:14.959721 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:14.973808 (+ 14087us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:14.976785 (+ 2977us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:14.995300 (+ 18515us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1241606}
I20260923 19:50:14.997391 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 666) took 1221 ms. Trace:
I20260923 19:50:14.997465 6461 rpcz_store.cc:276] 0923 19:50:13.775626 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.779689 (+ 4063us) service_pool.cc:224] Handling call
0923 19:50:14.997277 (+1217588us) ts_tablet_manager.cc:1151] Deleting tablet c4b7cd806c3d41dd9af0a365d84c1f12
0923 19:50:14.997288 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:14.997377 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1217380}
I20260923 19:50:14.999802 6461 tablet_replica.cc:333] T b529b0e82c5b48edac54cc281ac4b4a6 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:14.999985 6461 raft_consensus.cc:2243] T b529b0e82c5b48edac54cc281ac4b4a6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:15.000156 6461 raft_consensus.cc:2272] T b529b0e82c5b48edac54cc281ac4b4a6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:15.000746 6027 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ed8d49f1b3d4bee80b1822df2a7f495 with delete_type TABLET_DATA_DELETED (replaced by tablet ebc9dca1c228493a9dbaca4dd777d983) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:15.002390 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 035abecfbee7474d9dd048f35e28e867 (table default.Table_5a1ffa59de984ef3adb370cdf1142f24 [id=d2e859af377f491dbc81f6f3d4111640]) successfully deleted
W20260923 19:50:15.002699 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet c4b7cd806c3d41dd9af0a365d84c1f12 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4b7cd806c3d41dd9af0a365d84c1f12 already in progress: creating tablet
I20260923 19:50:15.003276 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_0e1d50c965e94124b683e41abf852dfa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:15.003908 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0e1d50c965e94124b683e41abf852dfa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:15.004187 6461 ts_tablet_manager.cc:1916] T b529b0e82c5b48edac54cc281ac4b4a6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:15.005208 6027 tablet_service.cc:1558] Processing DeleteTablet for tablet 104f137941e84b83bb9a726752c865c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:15.005688 6310 tablet_service.cc:1511] Processing CreateTablet for tablet b9c084a319c449328b639d604c00946a (DEFAULT_TABLE table=default.Table_94ed1fa75fba4ca69e19a74840c564c5 [id=a4114764c2894deb8e2e36cc3196d641]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.006186 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9c084a319c449328b639d604c00946a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.009207 6308 tablet_service.cc:1511] Processing CreateTablet for tablet a820bf5854324639b98c984ac583a4d7 (DEFAULT_TABLE table=default.Table_29b8321a878b47ca9fef841557c0fad5 [id=edb86fc08e434c22b507f0053cecb45c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.009548 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a820bf5854324639b98c984ac583a4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.011961 6458 ts_tablet_manager.cc:1929] T ba4e9fee05994c0d8e7d1f21788280d3 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:15.012315 6458 log.cc:1199] T ba4e9fee05994c0d8e7d1f21788280d3 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/ba4e9fee05994c0d8e7d1f21788280d3
I20260923 19:50:15.015678 6458 ts_tablet_manager.cc:1950] T ba4e9fee05994c0d8e7d1f21788280d3 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:15.016319 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet 104f137941e84b83bb9a726752c865c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:15.018412 5792 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 940d876042844020833ccc2347d67c4c (table default.Table_db1b6a3aa2f44c2f9d346b09bf7f2a4b [id=eec9dccd37884607a7b5e616340c5b9b], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 940d876042844020833ccc2347d67c4c consensus state has no leader
I20260923 19:50:15.019727 6457 tablet_bootstrap.cc:492] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:15.019820 6461 ts_tablet_manager.cc:1929] T b529b0e82c5b48edac54cc281ac4b4a6 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:15.019855 6457 ts_tablet_manager.cc:1403] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.067s user 0.002s sys 0.000s
I20260923 19:50:15.019925 6461 log.cc:1199] T b529b0e82c5b48edac54cc281ac4b4a6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/b529b0e82c5b48edac54cc281ac4b4a6
I20260923 19:50:15.020269 6461 ts_tablet_manager.cc:1950] T b529b0e82c5b48edac54cc281ac4b4a6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:15.020675 6457 raft_consensus.cc:359] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.020850 6457 raft_consensus.cc:385] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:15.020910 6457 raft_consensus.cc:740] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:15.020958 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 667) took 1184 ms. Trace:
I20260923 19:50:15.021057 6461 rpcz_store.cc:276] 0923 19:50:13.836464 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.836540 (+ 76us) service_pool.cc:224] Handling call
0923 19:50:14.999749 (+1163209us) ts_tablet_manager.cc:1151] Deleting tablet b529b0e82c5b48edac54cc281ac4b4a6
0923 19:50:14.999761 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.007305 (+ 7544us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.019766 (+ 12461us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.020938 (+ 1172us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1163017}
I20260923 19:50:15.021186 6457 consensus_queue.cc:260] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.023386 6457 ts_tablet_manager.cc:1434] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:50:15.023643 6457 tablet_bootstrap.cc:492] T f74e7cb3e5f54dfdb2280c795ce2ce53 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:15.024968 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 614) took 1736 ms. Trace:
I20260923 19:50:15.024997 6459 ts_tablet_manager.cc:1929] T b985acc650334497832cf4505e1b0043 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:15.025095 6459 log.cc:1199] T b985acc650334497832cf4505e1b0043 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/b985acc650334497832cf4505e1b0043
I20260923 19:50:15.025300 6457 tablet_bootstrap.cc:654] T f74e7cb3e5f54dfdb2280c795ce2ce53 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:15.025316 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ed8d49f1b3d4bee80b1822df2a7f495 with delete_type TABLET_DATA_DELETED (replaced by tablet ebc9dca1c228493a9dbaca4dd777d983) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:15.026050 6280 consensus_peers.cc:597] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b529b0e82c5b48edac54cc281ac4b4a6. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:15.026794 6458 rpcz_store.cc:276] 0923 19:50:13.288871 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.290271 (+ 1400us) service_pool.cc:224] Handling call
0923 19:50:14.969557 (+1679286us) ts_tablet_manager.cc:1151] Deleting tablet ba4e9fee05994c0d8e7d1f21788280d3
0923 19:50:14.969567 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:14.986004 (+ 16437us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:14.995189 (+ 9185us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.024949 (+ 29760us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1679064}
I20260923 19:50:15.027850 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet ba4e9fee05994c0d8e7d1f21788280d3 (table default.Table_fa5d77accb2d4cb2a336e0394074518a [id=49bb9f954b544f41b75f6035b1ea68b1]) successfully deleted
I20260923 19:50:15.028573 6458 tablet_replica.cc:333] T 2ccfe6531fc44f86a0edc8bda1547442 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:15.029325 6458 raft_consensus.cc:2243] T 2ccfe6531fc44f86a0edc8bda1547442 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:15.029793 6458 raft_consensus.cc:2272] T 2ccfe6531fc44f86a0edc8bda1547442 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:15.030670 6458 ts_tablet_manager.cc:1916] T 2ccfe6531fc44f86a0edc8bda1547442 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:15.031250 6027 tablet_service.cc:1511] Processing CreateTablet for tablet b9c084a319c449328b639d604c00946a (DEFAULT_TABLE table=default.Table_94ed1fa75fba4ca69e19a74840c564c5 [id=a4114764c2894deb8e2e36cc3196d641]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.031723 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9c084a319c449328b639d604c00946a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.035949 6459 ts_tablet_manager.cc:1950] T b985acc650334497832cf4505e1b0043 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:15.036523 6179 tablet_service.cc:1511] Processing CreateTablet for tablet b9c084a319c449328b639d604c00946a (DEFAULT_TABLE table=default.Table_94ed1fa75fba4ca69e19a74840c564c5 [id=a4114764c2894deb8e2e36cc3196d641]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.038226 6461 tablet_replica.cc:333] T c504ec668a33451fb1249f697bb5e2bb P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:15.038429 6461 raft_consensus.cc:2243] T c504ec668a33451fb1249f697bb5e2bb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:15.038590 6461 raft_consensus.cc:2272] T c504ec668a33451fb1249f697bb5e2bb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:15.039134 6461 ts_tablet_manager.cc:1916] T c504ec668a33451fb1249f697bb5e2bb P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:15.039582 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 279501c00ab14deeb3b06305836cea9b (DEFAULT_TABLE table=default.Table_abf82e70b0864fc58a445ec65d5ffac1 [id=acb5b4a9b4e141fab8e9ae9a57b2c9d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.040354 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 279501c00ab14deeb3b06305836cea9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.041253 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 554655516bb547ad9c2aa1ee66dc8deb
I20260923 19:50:15.041503 6317 tablet_service.cc:1511] Processing CreateTablet for tablet 6393303f6d664fe3bbc9c9052cd0b717 (DEFAULT_TABLE table=default.Table_207e79266a3b44f28cad759aeb41bdce [id=b1214f534ecd4a27aa6d26cd65e45ce8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.041831 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6393303f6d664fe3bbc9c9052cd0b717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.042717 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 42ca4ffede1a472d8917a592fac7f746
I20260923 19:50:15.047863 7134 raft_consensus.cc:493] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:15.048004 7134 raft_consensus.cc:515] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.048579 7134 leader_election.cc:290] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:15.050087 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad29d22a82434023991ffcacf7f9bee5" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:15.050416 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad29d22a82434023991ffcacf7f9bee5" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:15.050585 5996 leader_election.cc:343] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:15.050873 5995 leader_election.cc:343] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:15.050964 5995 leader_election.cc:304] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:15.051312 7134 raft_consensus.cc:2749] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:15.051569 6318 tablet_service.cc:1558] Processing DeleteTablet for tablet 554655516bb547ad9c2aa1ee66dc8deb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:15.051558 5805 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 8d87f05f29bd476386ff6516676ce31a (table default.Table_9fa8f8bfc6124f398a4acdf5e1e0b33a [id=02d2ab56def342c482c86ce96110342f]). Expected version 1 got 0
I20260923 19:50:15.051790 6313 tablet_service.cc:1558] Processing DeleteTablet for tablet 42ca4ffede1a472d8917a592fac7f746 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:15.051860 5805 catalog_manager.cc:5838] T 86388fa08c454da9ad2ca0124dcba10b P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:15.052057 6175 tablet_service.cc:1511] Processing CreateTablet for tablet a820bf5854324639b98c984ac583a4d7 (DEFAULT_TABLE table=default.Table_29b8321a878b47ca9fef841557c0fad5 [id=edb86fc08e434c22b507f0053cecb45c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.052366 5805 catalog_manager.cc:5838] T 7b455812687f42848df5290d0cdbc312 P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:15.052713 6175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a820bf5854324639b98c984ac583a4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.052742 5805 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 7b455812687f42848df5290d0cdbc312 (table default.Table_e9cc7064dc8e4c6bb9eadb9fc3f33e09 [id=e263e510102443df8fd2b5886fa01053]). Expected version 1 got 0
I20260923 19:50:15.053067 6171 tablet_service.cc:1511] Processing CreateTablet for tablet 279501c00ab14deeb3b06305836cea9b (DEFAULT_TABLE table=default.Table_abf82e70b0864fc58a445ec65d5ffac1 [id=acb5b4a9b4e141fab8e9ae9a57b2c9d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.053409 6171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 279501c00ab14deeb3b06305836cea9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.054666 7134 raft_consensus.cc:493] T 2948d729e1ec4dfca70789bcad513e52 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:15.054771 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9c084a319c449328b639d604c00946a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.054795 7134 raft_consensus.cc:515] T 2948d729e1ec4dfca70789bcad513e52 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.055356 7134 leader_election.cc:290] T 2948d729e1ec4dfca70789bcad513e52 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:15.055920 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2948d729e1ec4dfca70789bcad513e52" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:15.056334 5995 leader_election.cc:343] T 2948d729e1ec4dfca70789bcad513e52 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:15.057063 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet b529b0e82c5b48edac54cc281ac4b4a6 (table default.Table_504bdbe9702948d58b4f958360a2040b [id=ca73f0867b5d49cfb0bb7cd2315c47f2]) successfully deleted
I20260923 19:50:15.057775 5804 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_9f1adbf7034440cd8ec248d18c62ba63" } new_table_name: "default.Table_8aad9ce166cb40659479e35cbcbf1d88" modify_external_catalogs: true
I20260923 19:50:15.057945 7239 raft_consensus.cc:493] T 1c26a2863fdd4912b6d357877af1eb42 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:15.058066 7239 raft_consensus.cc:515] T 1c26a2863fdd4912b6d357877af1eb42 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.059319 7239 leader_election.cc:290] T 1c26a2863fdd4912b6d357877af1eb42 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:15.059540 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_e73bff7f81754cd69de0a927b79aa09a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:15.060046 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e73bff7f81754cd69de0a927b79aa09a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:15.060277 6137 leader_election.cc:343] T 1c26a2863fdd4912b6d357877af1eb42 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 1c26a2863fdd4912b6d357877af1eb42
I20260923 19:50:15.061429 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 77948f5e51524673966955468de45252 (DEFAULT_TABLE table=default.Table_6590a2564d3e40bea9c0392c0bc56cb8 [id=91f3dc1769fc4f2babf00c14359f423f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.061754 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77948f5e51524673966955468de45252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.061890 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_649d6f0a403747c38f6b0f9b6ed91fdf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:15.062404 6181 tablet_service.cc:1511] Processing CreateTablet for tablet 6393303f6d664fe3bbc9c9052cd0b717 (DEFAULT_TABLE table=default.Table_207e79266a3b44f28cad759aeb41bdce [id=b1214f534ecd4a27aa6d26cd65e45ce8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:15.062479 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_649d6f0a403747c38f6b0f9b6ed91fdf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:15.062695 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6393303f6d664fe3bbc9c9052cd0b717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.063383 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet 554655516bb547ad9c2aa1ee66dc8deb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:15.063941 6167 tablet_service.cc:1511] Processing CreateTablet for tablet df10596a5ce94240bd84af2504de105b (DEFAULT_TABLE table=default.Table_947cffda0c1f456ebfc9420e5b6e9865 [id=c5bbd6d8789d4a41b55cb7dcaaf3e1e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.064214 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df10596a5ce94240bd84af2504de105b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.067224 6461 ts_tablet_manager.cc:1929] T c504ec668a33451fb1249f697bb5e2bb P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:15.067338 6461 log.cc:1199] T c504ec668a33451fb1249f697bb5e2bb P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/c504ec668a33451fb1249f697bb5e2bb
I20260923 19:50:15.067616 6461 ts_tablet_manager.cc:1950] T c504ec668a33451fb1249f697bb5e2bb P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:15.069721 6027 tablet_service.cc:1511] Processing CreateTablet for tablet a820bf5854324639b98c984ac583a4d7 (DEFAULT_TABLE table=default.Table_29b8321a878b47ca9fef841557c0fad5 [id=edb86fc08e434c22b507f0053cecb45c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.070155 5800 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet c6598be958f842328a81fd092c6fcf64
I20260923 19:50:15.070544 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 279501c00ab14deeb3b06305836cea9b (DEFAULT_TABLE table=default.Table_abf82e70b0864fc58a445ec65d5ffac1 [id=acb5b4a9b4e141fab8e9ae9a57b2c9d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.070636 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a820bf5854324639b98c984ac583a4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.070839 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 279501c00ab14deeb3b06305836cea9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.070921 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_207e79266a3b44f28cad759aeb41bdce" } new_table_name: "default.Table_1ad06306ba71468dbaa1a583e056a06d" modify_external_catalogs: true
I20260923 19:50:15.072098 5799 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet bc64c9a47934420b9be3a6c8fe3ed91f
I20260923 19:50:15.072755 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_dd06a0c334dc4439af02958dd0b12a29"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:15.073197 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dd06a0c334dc4439af02958dd0b12a29 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:15.073732 6031 tablet_service.cc:1511] Processing CreateTablet for tablet 77948f5e51524673966955468de45252 (DEFAULT_TABLE table=default.Table_6590a2564d3e40bea9c0392c0bc56cb8 [id=91f3dc1769fc4f2babf00c14359f423f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.074054 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 6393303f6d664fe3bbc9c9052cd0b717 (DEFAULT_TABLE table=default.Table_207e79266a3b44f28cad759aeb41bdce [id=b1214f534ecd4a27aa6d26cd65e45ce8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.074257 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet c012b2a92dc14f2ab5d9f4fe8a6a7779 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:15.074076 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77948f5e51524673966955468de45252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.074584 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet cf0caa6afcf546678c233a9333b77a2a
I20260923 19:50:15.075039 5802 catalog_manager.cc:6934] ReplaceTablet: tablet cf0caa6afcf546678c233a9333b77a2a deleted and replaced by tablet e1178b26b95b41babd12b9b8b5bdbd6e
I20260923 19:50:15.075779 5802 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_e14fb17a6d3146409662b5f989ee9f15" } new_table_name: "default.Table_d6b7dd3e3841487bb83baf44aa4b24eb" modify_external_catalogs: true
I20260923 19:50:15.077236 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_4bf3649d9e3d46ad9cf692caa1e51b8c" } new_table_name: "default.Table_fe9e363eed7f4a9d8c22168528b69faa" modify_external_catalogs: true
I20260923 19:50:15.078361 5796 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_8d9c168e75b24278869d2281218a0ad5" } new_table_name: "default.Table_2f6075b4791c4a4cb8bda36d17569bcb" modify_external_catalogs: true
I20260923 19:50:15.078543 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6393303f6d664fe3bbc9c9052cd0b717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.080690 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 670) took 1149 ms. Trace:
I20260923 19:50:15.080785 6461 rpcz_store.cc:276] 0923 19:50:13.931537 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.931587 (+ 50us) service_pool.cc:224] Handling call
0923 19:50:15.038172 (+1106585us) ts_tablet_manager.cc:1151] Deleting tablet c504ec668a33451fb1249f697bb5e2bb
0923 19:50:15.038184 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.044358 (+ 6174us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.067172 (+ 22814us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.080673 (+ 13501us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1105191}
I20260923 19:50:15.081087 6461 tablet_replica.cc:333] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:15.081271 6461 raft_consensus.cc:2243] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:15.081405 6461 raft_consensus.cc:2272] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:15.083359 6461 ts_tablet_manager.cc:1916] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:15.084524 6170 tablet_service.cc:1558] Processing DeleteTablet for tablet 42ca4ffede1a472d8917a592fac7f746 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:15.084802 6177 tablet_service.cc:1558] Processing DeleteTablet for tablet c6598be958f842328a81fd092c6fcf64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:15.084827 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 647) took 1099 ms. Trace:
I20260923 19:50:15.085039 6459 rpcz_store.cc:276] 0923 19:50:13.985218 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.986412 (+ 1194us) service_pool.cc:224] Handling call
0923 19:50:14.963609 (+977197us) ts_tablet_manager.cc:1151] Deleting tablet b985acc650334497832cf4505e1b0043
0923 19:50:14.963618 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:14.977735 (+ 14117us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.024938 (+ 47203us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.084812 (+ 59874us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":977054}
I20260923 19:50:15.085836 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 652) took 1017 ms. Trace:
I20260923 19:50:15.086002 6459 rpcz_store.cc:276] 0923 19:50:14.068329 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.068392 (+ 63us) service_pool.cc:224] Handling call
0923 19:50:15.085699 (+1017307us) ts_tablet_manager.cc:1151] Deleting tablet 2e1c19a751904a6295897376e9c5ee56
0923 19:50:15.085709 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.085822 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1002693}
I20260923 19:50:15.088236 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet b985acc650334497832cf4505e1b0043 (table default.Table_0291d1f518d445cda50f5b95a4aee646 [id=4dd6a10e3a9f465f816cc39c3a122468]) successfully deleted
W20260923 19:50:15.089267 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 2e1c19a751904a6295897376e9c5ee56 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e1c19a751904a6295897376e9c5ee56 already in progress: creating tablet
I20260923 19:50:15.090796 7134 raft_consensus.cc:493] T b7ba284e81bc4388bbd6456a41d1f9f4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:15.090931 7134 raft_consensus.cc:515] T b7ba284e81bc4388bbd6456a41d1f9f4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.091562 7134 leader_election.cc:290] T b7ba284e81bc4388bbd6456a41d1f9f4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:15.091492 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 77948f5e51524673966955468de45252 (DEFAULT_TABLE table=default.Table_6590a2564d3e40bea9c0392c0bc56cb8 [id=91f3dc1769fc4f2babf00c14359f423f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.091905 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77948f5e51524673966955468de45252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.093612 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_7ef4fde492124fa28e7089765bab36d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:15.094528 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7ef4fde492124fa28e7089765bab36d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:15.095932 6454 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.548s user 0.001s sys 0.010s
W20260923 19:50:15.096064 6454 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.590s user 0.002s sys 0.010s
I20260923 19:50:15.096261 6170 tablet_service.cc:1558] Processing DeleteTablet for tablet cf0caa6afcf546678c233a9333b77a2a with delete_type TABLET_DATA_DELETED (replaced by tablet e1178b26b95b41babd12b9b8b5bdbd6e) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:15.096624 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 42387bc29fc54b4cbb3d669e821e759d (DEFAULT_TABLE table=default.Table_db49428dd8a94a17b044d011c905e20b [id=33f1b24c7d6b4d149c56b880de4439c4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:15.086561 6201 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s user 0.006s sys 0.011s
W20260923 19:50:15.097002 6201 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s user 0.006s sys 0.011s
I20260923 19:50:15.096943 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2948d729e1ec4dfca70789bcad513e52" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:15.097645 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c26a2863fdd4912b6d357877af1eb42" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:15.097838 6344 raft_consensus.cc:2468] T 1c26a2863fdd4912b6d357877af1eb42 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:15.098428 6031 tablet_service.cc:1558] Processing DeleteTablet for tablet 554655516bb547ad9c2aa1ee66dc8deb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:15.098709 5996 leader_election.cc:343] T 2948d729e1ec4dfca70789bcad513e52 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:15.098825 5996 leader_election.cc:304] T 2948d729e1ec4dfca70789bcad513e52 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:15.098917 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ba284e81bc4388bbd6456a41d1f9f4" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:15.099208 7134 raft_consensus.cc:2749] T 2948d729e1ec4dfca70789bcad513e52 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:15.099571 5996 leader_election.cc:343] T b7ba284e81bc4388bbd6456a41d1f9f4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:15.099632 6031 tablet_service.cc:1558] Processing DeleteTablet for tablet 42ca4ffede1a472d8917a592fac7f746 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:15.100227 6317 tablet_service.cc:1558] Processing DeleteTablet for tablet cf0caa6afcf546678c233a9333b77a2a with delete_type TABLET_DATA_DELETED (replaced by tablet e1178b26b95b41babd12b9b8b5bdbd6e) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:15.100590 6313 tablet_service.cc:1511] Processing CreateTablet for tablet df10596a5ce94240bd84af2504de105b (DEFAULT_TABLE table=default.Table_947cffda0c1f456ebfc9420e5b6e9865 [id=c5bbd6d8789d4a41b55cb7dcaaf3e1e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.102954 6031 tablet_service.cc:1558] Processing DeleteTablet for tablet c6598be958f842328a81fd092c6fcf64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:15.104097 6458 ts_tablet_manager.cc:1929] T 2ccfe6531fc44f86a0edc8bda1547442 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:15.104152 6461 ts_tablet_manager.cc:1929] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:15.104240 6461 log.cc:1199] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/58ea466d1b2b40e9b9b4cd5be51f79e0
I20260923 19:50:15.104362 6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df10596a5ce94240bd84af2504de105b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.104517 6461 ts_tablet_manager.cc:1950] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:15.106285 6031 tablet_service.cc:1558] Processing DeleteTablet for tablet bc64c9a47934420b9be3a6c8fe3ed91f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:15.110150 6318 tablet_service.cc:1511] Processing CreateTablet for tablet 42387bc29fc54b4cbb3d669e821e759d (DEFAULT_TABLE table=default.Table_db49428dd8a94a17b044d011c905e20b [id=33f1b24c7d6b4d149c56b880de4439c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.110496 6318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42387bc29fc54b4cbb3d669e821e759d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.110749 6031 tablet_service.cc:1558] Processing DeleteTablet for tablet cf0caa6afcf546678c233a9333b77a2a with delete_type TABLET_DATA_DELETED (replaced by tablet e1178b26b95b41babd12b9b8b5bdbd6e) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:15.111801 6031 tablet_service.cc:1511] Processing CreateTablet for tablet df10596a5ce94240bd84af2504de105b (DEFAULT_TABLE table=default.Table_947cffda0c1f456ebfc9420e5b6e9865 [id=c5bbd6d8789d4a41b55cb7dcaaf3e1e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.112226 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df10596a5ce94240bd84af2504de105b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.114492 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 668) took 1183 ms. Trace:
I20260923 19:50:15.114580 6461 rpcz_store.cc:276] 0923 19:50:13.931302 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.931710 (+ 408us) service_pool.cc:224] Handling call
0923 19:50:15.081045 (+1149335us) ts_tablet_manager.cc:1151] Deleting tablet 58ea466d1b2b40e9b9b4cd5be51f79e0
0923 19:50:15.081053 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.094496 (+ 13443us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.104111 (+ 9615us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.114473 (+ 10362us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1147979}
I20260923 19:50:15.115909 6461 tablet_replica.cc:333] T 15a9d1d4adaa402f90d774e77010c928 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:15.116110 6461 raft_consensus.cc:2243] T 15a9d1d4adaa402f90d774e77010c928 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:15.116125 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet c6598be958f842328a81fd092c6fcf64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:15.116261 6461 raft_consensus.cc:2272] T 15a9d1d4adaa402f90d774e77010c928 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:15.117467 6461 ts_tablet_manager.cc:1916] T 15a9d1d4adaa402f90d774e77010c928 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:15.118991 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet c504ec668a33451fb1249f697bb5e2bb (table default.Table_870cfa1b62c4442d866d3b9b1aec4bc7 [id=b8b525ace3444e3fb6548fb9f2064765]) successfully deleted
I20260923 19:50:15.122823 6177 tablet_service.cc:1558] Processing DeleteTablet for tablet bc64c9a47934420b9be3a6c8fe3ed91f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:15.123736 6139 leader_election.cc:304] T 1c26a2863fdd4912b6d357877af1eb42 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:15.123875 6458 log.cc:1199] T 2ccfe6531fc44f86a0edc8bda1547442 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/2ccfe6531fc44f86a0edc8bda1547442
I20260923 19:50:15.124439 6459 tablet_replica.cc:333] T fe5d081a41a3417b855656ca6e24f235 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:15.124636 6459 raft_consensus.cc:2243] T fe5d081a41a3417b855656ca6e24f235 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:15.124647 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 58ea466d1b2b40e9b9b4cd5be51f79e0 (table default.Table_c61ffa0e84514cddb714dc30da0a21f6 [id=3ee0e52e785f4cb39add98261628d513]) successfully deleted
I20260923 19:50:15.124778 6459 raft_consensus.cc:2272] T fe5d081a41a3417b855656ca6e24f235 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:15.124770 6458 ts_tablet_manager.cc:1950] T 2ccfe6531fc44f86a0edc8bda1547442 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:15.125274 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ba284e81bc4388bbd6456a41d1f9f4" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:15.125612 7239 raft_consensus.cc:2804] T 1c26a2863fdd4912b6d357877af1eb42 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:15.125649 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 615) took 1807 ms. Trace:
I20260923 19:50:15.125677 7239 raft_consensus.cc:493] T 1c26a2863fdd4912b6d357877af1eb42 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:15.125736 7239 raft_consensus.cc:3060] T 1c26a2863fdd4912b6d357877af1eb42 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:15.125809 6457 tablet_bootstrap.cc:492] T f74e7cb3e5f54dfdb2280c795ce2ce53 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:15.125730 6458 rpcz_store.cc:276] 0923 19:50:13.318520 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.331138 (+ 12618us) service_pool.cc:224] Handling call
0923 19:50:15.028532 (+1697394us) ts_tablet_manager.cc:1151] Deleting tablet 2ccfe6531fc44f86a0edc8bda1547442
0923 19:50:15.028541 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.061539 (+ 32998us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.104045 (+ 42506us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.125599 (+ 21554us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":198,"tablet-delete.queue_time_us":1697092}
I20260923 19:50:15.125944 6457 ts_tablet_manager.cc:1403] T f74e7cb3e5f54dfdb2280c795ce2ce53 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.102s user 0.002s sys 0.001s
I20260923 19:50:15.126104 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42387bc29fc54b4cbb3d669e821e759d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.126187 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 2ccfe6531fc44f86a0edc8bda1547442 (table default.Table_bbfd70af85d34f29bc8bbd6dbf85023d [id=d21707fbdafa4fb4a14990578cc7ab56]) successfully deleted
I20260923 19:50:15.126706 6457 raft_consensus.cc:359] T f74e7cb3e5f54dfdb2280c795ce2ce53 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.126849 6457 raft_consensus.cc:385] T f74e7cb3e5f54dfdb2280c795ce2ce53 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:15.126893 6457 raft_consensus.cc:740] T f74e7cb3e5f54dfdb2280c795ce2ce53 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:15.127077 6457 consensus_queue.cc:260] T f74e7cb3e5f54dfdb2280c795ce2ce53 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.127563 6457 ts_tablet_manager.cc:1434] T f74e7cb3e5f54dfdb2280c795ce2ce53 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:50:15.128003 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 616) took 1767 ms. Trace:
I20260923 19:50:15.128141 6458 rpcz_store.cc:276] 0923 19:50:13.360978 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.361049 (+ 71us) service_pool.cc:224] Handling call
0923 19:50:15.127837 (+1766788us) ts_tablet_manager.cc:1151] Deleting tablet c212b069c3f740ecac403c99d93de7d9
0923 19:50:15.127846 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.127954 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1766550}
W20260923 19:50:15.127979 5995 leader_election.cc:343] T b7ba284e81bc4388bbd6456a41d1f9f4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:15.132520 5995 leader_election.cc:304] T b7ba284e81bc4388bbd6456a41d1f9f4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:15.132746 7134 raft_consensus.cc:2749] T b7ba284e81bc4388bbd6456a41d1f9f4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:15.133949 6457 tablet_bootstrap.cc:492] T f7cf45d4c4d3480288698682c1c85869 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:15.134176 6459 ts_tablet_manager.cc:1916] T fe5d081a41a3417b855656ca6e24f235 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:15.138406 6457 tablet_bootstrap.cc:654] T f7cf45d4c4d3480288698682c1c85869 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:15.139446 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet c212b069c3f740ecac403c99d93de7d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c212b069c3f740ecac403c99d93de7d9 already in progress: creating tablet
I20260923 19:50:15.140182 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 618) took 1747 ms. Trace:
I20260923 19:50:15.140616 6458 rpcz_store.cc:276] 0923 19:50:13.392766 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.419339 (+ 26573us) service_pool.cc:224] Handling call
0923 19:50:15.140020 (+1720681us) ts_tablet_manager.cc:1151] Deleting tablet ba0453ef529344dfbab1130daa985fef
0923 19:50:15.140031 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.140132 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1720513}
I20260923 19:50:15.138762 6461 ts_tablet_manager.cc:1929] T 15a9d1d4adaa402f90d774e77010c928 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:15.140846 6461 log.cc:1199] T 15a9d1d4adaa402f90d774e77010c928 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/15a9d1d4adaa402f90d774e77010c928
I20260923 19:50:15.141148 6461 ts_tablet_manager.cc:1950] T 15a9d1d4adaa402f90d774e77010c928 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
W20260923 19:50:15.141628 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet ba0453ef529344dfbab1130daa985fef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba0453ef529344dfbab1130daa985fef already in progress: creating tablet
I20260923 19:50:15.141808 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 669) took 1210 ms. Trace:
I20260923 19:50:15.141916 6461 rpcz_store.cc:276] 0923 19:50:13.931419 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.931819 (+ 400us) service_pool.cc:224] Handling call
0923 19:50:15.115863 (+1184044us) ts_tablet_manager.cc:1151] Deleting tablet 15a9d1d4adaa402f90d774e77010c928
0923 19:50:15.115872 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.120519 (+ 4647us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.138718 (+ 18199us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.141791 (+ 3073us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1182743}
I20260923 19:50:15.142310 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 15a9d1d4adaa402f90d774e77010c928 (table default.Table_527c2568db7446559d0c719602184b02 [id=9e398f48d86e4c5898cac7336d3c24bf]) successfully deleted
I20260923 19:50:15.144784 6461 tablet_replica.cc:333] T e4f00490b0364f0e9f1b9569b870808e P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:15.144986 6461 raft_consensus.cc:2243] T e4f00490b0364f0e9f1b9569b870808e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:15.145149 6461 raft_consensus.cc:2272] T e4f00490b0364f0e9f1b9569b870808e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:15.145763 6461 ts_tablet_manager.cc:1916] T e4f00490b0364f0e9f1b9569b870808e P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:15.149981 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 626) took 1582 ms. Trace:
I20260923 19:50:15.150772 6458 rpcz_store.cc:276] 0923 19:50:13.567965 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.568165 (+ 200us) service_pool.cc:224] Handling call
0923 19:50:15.142015 (+1573850us) ts_tablet_manager.cc:1151] Deleting tablet f7cf45d4c4d3480288698682c1c85869
0923 19:50:15.142024 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.149924 (+ 7900us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1573628}
W20260923 19:50:15.151505 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet f7cf45d4c4d3480288698682c1c85869 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7cf45d4c4d3480288698682c1c85869 already in progress: creating tablet
I20260923 19:50:15.151971 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 627) took 1453 ms. Trace:
I20260923 19:50:15.152874 6458 rpcz_store.cc:276] 0923 19:50:13.698839 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.700852 (+ 2013us) service_pool.cc:224] Handling call
0923 19:50:15.151838 (+1450986us) ts_tablet_manager.cc:1151] Deleting tablet 83dba06b0d0040889015fb052c642ec0
0923 19:50:15.151847 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.151925 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1450804}
W20260923 19:50:15.153553 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 83dba06b0d0040889015fb052c642ec0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 83dba06b0d0040889015fb052c642ec0 already in progress: creating tablet
I20260923 19:50:15.154021 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 628) took 1379 ms. Trace:
I20260923 19:50:15.154481 6458 rpcz_store.cc:276] 0923 19:50:13.774975 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.776246 (+ 1271us) service_pool.cc:224] Handling call
0923 19:50:15.153866 (+1377620us) ts_tablet_manager.cc:1151] Deleting tablet c4b7cd806c3d41dd9af0a365d84c1f12
0923 19:50:15.153896 (+ 30us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.153976 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1377350}
W20260923 19:50:15.155180 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet c4b7cd806c3d41dd9af0a365d84c1f12 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4b7cd806c3d41dd9af0a365d84c1f12 already in progress: creating tablet
I20260923 19:50:15.155665 6458 tablet_replica.cc:333] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:15.156330 6458 raft_consensus.cc:2243] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:15.157297 6458 raft_consensus.cc:2272] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:15.157507 6461 ts_tablet_manager.cc:1929] T e4f00490b0364f0e9f1b9569b870808e P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:15.157619 6461 log.cc:1199] T e4f00490b0364f0e9f1b9569b870808e P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/e4f00490b0364f0e9f1b9569b870808e
I20260923 19:50:15.156774 6308 tablet_service.cc:1558] Processing DeleteTablet for tablet bc64c9a47934420b9be3a6c8fe3ed91f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:15.161550 6461 ts_tablet_manager.cc:1950] T e4f00490b0364f0e9f1b9569b870808e P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:15.163228 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 673) took 1181 ms. Trace:
I20260923 19:50:15.163311 6461 rpcz_store.cc:276] 0923 19:50:13.982152 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.982215 (+ 63us) service_pool.cc:224] Handling call
0923 19:50:15.144728 (+1162513us) ts_tablet_manager.cc:1151] Deleting tablet e4f00490b0364f0e9f1b9569b870808e
0923 19:50:15.144740 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.149109 (+ 4369us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.157460 (+ 8351us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.163208 (+ 5748us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1162320}
I20260923 19:50:15.163686 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 676) took 1097 ms. Trace:
I20260923 19:50:15.163751 6461 rpcz_store.cc:276] 0923 19:50:14.066022 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.066075 (+ 53us) service_pool.cc:224] Handling call
0923 19:50:15.163562 (+1097487us) ts_tablet_manager.cc:1151] Deleting tablet 2e1c19a751904a6295897376e9c5ee56
0923 19:50:15.163574 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.163670 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1097304}
I20260923 19:50:15.164095 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 679) took 1024 ms. Trace:
I20260923 19:50:15.164103 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet e4f00490b0364f0e9f1b9569b870808e (table default.Table_701c81d7fd4844f09fc1ccc28f0eda9c [id=67292e21e6b546298c5d629c6ebcb718]) successfully deleted
I20260923 19:50:15.164157 6461 rpcz_store.cc:276] 0923 19:50:14.139349 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.144124 (+ 4775us) service_pool.cc:224] Handling call
0923 19:50:15.163963 (+1019839us) ts_tablet_manager.cc:1151] Deleting tablet 7dac9efee371479ab3547e06f0e580ad
0923 19:50:15.163971 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.164082 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1019674}
W20260923 19:50:15.164325 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 2e1c19a751904a6295897376e9c5ee56 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e1c19a751904a6295897376e9c5ee56 already in progress: creating tablet
I20260923 19:50:15.164610 6461 tablet_replica.cc:333] T ec4cc8a742114e5fb07c5c9157ce09e8 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:15.164774 6461 raft_consensus.cc:2243] T ec4cc8a742114e5fb07c5c9157ce09e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:15.164928 6461 raft_consensus.cc:2272] T ec4cc8a742114e5fb07c5c9157ce09e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:15.164968 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet ea2ef507c6e24d369427048171dfec06 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea2ef507c6e24d369427048171dfec06 already in progress: creating tablet
I20260923 19:50:15.165403 6461 ts_tablet_manager.cc:1916] T ec4cc8a742114e5fb07c5c9157ce09e8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:15.166076 6454 tablet_bootstrap.cc:492] T cd02244c52ad4d2ab3915108a92a6f97 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:15.168112 6458 ts_tablet_manager.cc:1916] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:15.176545 6031 tablet_service.cc:1511] Processing CreateTablet for tablet 42387bc29fc54b4cbb3d669e821e759d (DEFAULT_TABLE table=default.Table_db49428dd8a94a17b044d011c905e20b [id=33f1b24c7d6b4d149c56b880de4439c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.173599 7239 raft_consensus.cc:515] T 1c26a2863fdd4912b6d357877af1eb42 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.176918 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42387bc29fc54b4cbb3d669e821e759d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.177667 7239 leader_election.cc:290] T 1c26a2863fdd4912b6d357877af1eb42 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:15.177977 6137 leader_election.cc:343] T 1c26a2863fdd4912b6d357877af1eb42 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 1c26a2863fdd4912b6d357877af1eb42
I20260923 19:50:15.178222 6456 tablet_bootstrap.cc:492] T 12f4abb573bd4be6961b55c27c684d06 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:15.178363 6456 ts_tablet_manager.cc:1403] T 12f4abb573bd4be6961b55c27c684d06 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.189s user 0.018s sys 0.032s
I20260923 19:50:15.179075 6456 raft_consensus.cc:359] T 12f4abb573bd4be6961b55c27c684d06 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.179239 6456 raft_consensus.cc:385] T 12f4abb573bd4be6961b55c27c684d06 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:15.179322 6456 raft_consensus.cc:740] T 12f4abb573bd4be6961b55c27c684d06 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:15.179705 6456 consensus_queue.cc:260] T 12f4abb573bd4be6961b55c27c684d06 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.180294 6456 ts_tablet_manager.cc:1434] T 12f4abb573bd4be6961b55c27c684d06 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:15.180804 6456 tablet_bootstrap.cc:492] T 66739afdf147413787acb0363aa37df6 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:15.178139 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c26a2863fdd4912b6d357877af1eb42" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:15.181308 6344 raft_consensus.cc:3060] T 1c26a2863fdd4912b6d357877af1eb42 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:15.184469 6456 tablet_bootstrap.cc:654] T 66739afdf147413787acb0363aa37df6 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:15.186327 6454 ts_tablet_manager.cc:1403] T cd02244c52ad4d2ab3915108a92a6f97 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.711s user 0.003s sys 0.011s
I20260923 19:50:15.186486 6344 raft_consensus.cc:2468] T 1c26a2863fdd4912b6d357877af1eb42 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:15.186946 6139 leader_election.cc:304] T 1c26a2863fdd4912b6d357877af1eb42 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:15.187464 7239 raft_consensus.cc:2804] T 1c26a2863fdd4912b6d357877af1eb42 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:15.187587 7239 raft_consensus.cc:697] T 1c26a2863fdd4912b6d357877af1eb42 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:15.187806 7239 consensus_queue.cc:237] T 1c26a2863fdd4912b6d357877af1eb42 P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.190088 6461 ts_tablet_manager.cc:1929] T ec4cc8a742114e5fb07c5c9157ce09e8 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260923 19:50:15.190194 6461 log.cc:1199] T ec4cc8a742114e5fb07c5c9157ce09e8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/ec4cc8a742114e5fb07c5c9157ce09e8
I20260923 19:50:15.190569 6461 ts_tablet_manager.cc:1950] T ec4cc8a742114e5fb07c5c9157ce09e8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:15.191545 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet ec4cc8a742114e5fb07c5c9157ce09e8 (table default.Table_72032a8e8a254d2bad8358ebf75f1615 [id=89181985e6154c7fa946148e48bef2eb]) successfully deleted
I20260923 19:50:15.193351 6308 tablet_service.cc:1511] Processing CreateTablet for tablet 401d909c37ec4daaa210e4fc32d838aa (DEFAULT_TABLE table=default.Table_b0ee37845cb4472db1adf576ec6ce4e2 [id=2c5b70db7dc04c728e149bfa34c1703a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.193953 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 401d909c37ec4daaa210e4fc32d838aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.194000 6459 ts_tablet_manager.cc:1929] T fe5d081a41a3417b855656ca6e24f235 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:15.194106 6459 log.cc:1199] T fe5d081a41a3417b855656ca6e24f235 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/fe5d081a41a3417b855656ca6e24f235
W20260923 19:50:15.194167 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 7f7ecbb8d9054dde96b2bb511697dd47 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f7ecbb8d9054dde96b2bb511697dd47 already in progress: creating tablet
I20260923 19:50:15.194461 6459 ts_tablet_manager.cc:1950] T fe5d081a41a3417b855656ca6e24f235 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:15.194782 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 654) took 1099 ms. Trace:
I20260923 19:50:15.194870 6459 rpcz_store.cc:276] 0923 19:50:14.095342 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.095817 (+ 475us) service_pool.cc:224] Handling call
0923 19:50:15.086624 (+990807us) ts_tablet_manager.cc:1151] Deleting tablet fe5d081a41a3417b855656ca6e24f235
0923 19:50:15.086632 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.177700 (+ 91068us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.193950 (+ 16250us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.194766 (+ 816us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":989924}
W20260923 19:50:15.195343 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 9756a1f8e23a436bb7c19c8cba7bdc05 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9756a1f8e23a436bb7c19c8cba7bdc05 already in progress: creating tablet
I20260923 19:50:15.195713 6459 tablet_replica.cc:333] T a08446fcf1794dab9d3181904507456f P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:15.195905 6459 raft_consensus.cc:2243] T a08446fcf1794dab9d3181904507456f P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:15.196050 6461 tablet_replica.cc:333] T a75c4436a67f453e973a7a7645de79b1 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:15.196130 6459 pending_rounds.cc:70] T a08446fcf1794dab9d3181904507456f P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:15.196187 6459 pending_rounds.cc:77] T a08446fcf1794dab9d3181904507456f P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630587956342784 op_type: NO_OP noop_request { }
I20260923 19:50:15.196228 6461 raft_consensus.cc:2243] T a75c4436a67f453e973a7a7645de79b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:15.196280 6459 raft_consensus.cc:2889] T a08446fcf1794dab9d3181904507456f P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:15.196360 6459 raft_consensus.cc:2272] T a08446fcf1794dab9d3181904507456f P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:15.196360 6461 raft_consensus.cc:2272] T a75c4436a67f453e973a7a7645de79b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:15.196870 6461 ts_tablet_manager.cc:1916] T a75c4436a67f453e973a7a7645de79b1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:15.197167 6459 ts_tablet_manager.cc:1916] T a08446fcf1794dab9d3181904507456f P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:15.213176 6461 ts_tablet_manager.cc:1929] T a75c4436a67f453e973a7a7645de79b1 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:15.213315 6461 log.cc:1199] T a75c4436a67f453e973a7a7645de79b1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/a75c4436a67f453e973a7a7645de79b1
I20260923 19:50:15.213629 6461 ts_tablet_manager.cc:1950] T a75c4436a67f453e973a7a7645de79b1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:15.216759 6461 tablet_replica.cc:333] T 2948d729e1ec4dfca70789bcad513e52 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:15.216843 6171 tablet_service.cc:1511] Processing CreateTablet for tablet 401d909c37ec4daaa210e4fc32d838aa (DEFAULT_TABLE table=default.Table_b0ee37845cb4472db1adf576ec6ce4e2 [id=2c5b70db7dc04c728e149bfa34c1703a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.216953 6461 raft_consensus.cc:2243] T 2948d729e1ec4dfca70789bcad513e52 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:15.217099 6461 raft_consensus.cc:2272] T 2948d729e1ec4dfca70789bcad513e52 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:15.217545 6461 ts_tablet_manager.cc:1916] T 2948d729e1ec4dfca70789bcad513e52 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:15.219518 7418 tablet.cc:1751] T 0d70deeda179486291195476e47a9ae6 P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:15.223033 6459 ts_tablet_manager.cc:1929] T a08446fcf1794dab9d3181904507456f P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:15.223141 6459 log.cc:1199] T a08446fcf1794dab9d3181904507456f P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/a08446fcf1794dab9d3181904507456f
I20260923 19:50:15.223444 6459 ts_tablet_manager.cc:1950] T a08446fcf1794dab9d3181904507456f P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:15.223989 6461 ts_tablet_manager.cc:1929] T 2948d729e1ec4dfca70789bcad513e52 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:15.224076 6461 log.cc:1199] T 2948d729e1ec4dfca70789bcad513e52 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/2948d729e1ec4dfca70789bcad513e52
I20260923 19:50:15.224324 6461 ts_tablet_manager.cc:1950] T 2948d729e1ec4dfca70789bcad513e52 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:15.225566 6458 ts_tablet_manager.cc:1929] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:15.228449 6458 log.cc:1199] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/b529b0e82c5b48edac54cc281ac4b4a6
I20260923 19:50:15.228921 6458 ts_tablet_manager.cc:1950] T b529b0e82c5b48edac54cc281ac4b4a6 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:15.230298 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet a75c4436a67f453e973a7a7645de79b1 (table default.Table_30ce30e86cff4c8f9995423040b349c9 [id=e579cc40ccb84a7aa8c508342e6e19be]) successfully deleted
W20260923 19:50:15.230621 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 92f94b93d1364bb1a2562eb577707cf1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 92f94b93d1364bb1a2562eb577707cf1 already in progress: creating tablet
I20260923 19:50:15.230896 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 2948d729e1ec4dfca70789bcad513e52 (table default.Table_0fabac277720489788ff4ee29635ba66 [id=ff040ccffd9c4e24be8e0eaafa134785]) successfully deleted
I20260923 19:50:15.231603 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet fe5d081a41a3417b855656ca6e24f235 (table default.Table_124323035bb7418597ae00063fdffdf2 [id=b4a404dd8b1b4bd1971ec4ae180bff02]) successfully deleted
I20260923 19:50:15.232494 6457 tablet_bootstrap.cc:492] T f7cf45d4c4d3480288698682c1c85869 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:15.232621 6457 ts_tablet_manager.cc:1403] T f7cf45d4c4d3480288698682c1c85869 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.099s user 0.004s sys 0.000s
I20260923 19:50:15.233294 6457 raft_consensus.cc:359] T f7cf45d4c4d3480288698682c1c85869 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.233443 6457 raft_consensus.cc:385] T f7cf45d4c4d3480288698682c1c85869 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:15.233381 6454 raft_consensus.cc:359] T cd02244c52ad4d2ab3915108a92a6f97 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.233489 6457 raft_consensus.cc:740] T f7cf45d4c4d3480288698682c1c85869 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:15.233670 6457 consensus_queue.cc:260] T f7cf45d4c4d3480288698682c1c85869 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.234089 6457 ts_tablet_manager.cc:1434] T f7cf45d4c4d3480288698682c1c85869 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 19:50:15.234341 6457 tablet_bootstrap.cc:492] T a926ff092e6e495e981be156421e8d72 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:15.235912 6457 tablet_bootstrap.cc:654] T a926ff092e6e495e981be156421e8d72 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:15.237607 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_611375feff304538a80e8b1eca51b3cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:15.238473 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_1acd164e2b1143a0abc77f70a0178d34"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:15.239128 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1acd164e2b1143a0abc77f70a0178d34 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:15.240947 5800 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6393303f6d664fe3bbc9c9052cd0b717 consensus state has no leader
I20260923 19:50:15.241413 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_ffe6f0b7197a452aafba7eebbabcbcfe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:15.244810 5804 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0f90406b20f54787bd27255d5ae81d1c consensus state has no leader
I20260923 19:50:15.245199 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_927e705db46045d0ab15c515a2eed8d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:15.245627 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_927e705db46045d0ab15c515a2eed8d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:15.249927 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ffe6f0b7197a452aafba7eebbabcbcfe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:15.250952 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_611375feff304538a80e8b1eca51b3cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:15.251987 6457 tablet_bootstrap.cc:492] T a926ff092e6e495e981be156421e8d72 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:15.252110 6457 ts_tablet_manager.cc:1403] T a926ff092e6e495e981be156421e8d72 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.001s
I20260923 19:50:15.252942 6457 raft_consensus.cc:359] T a926ff092e6e495e981be156421e8d72 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.253159 6457 raft_consensus.cc:385] T a926ff092e6e495e981be156421e8d72 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:15.253252 6457 raft_consensus.cc:740] T a926ff092e6e495e981be156421e8d72 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:15.253522 6457 consensus_queue.cc:260] T a926ff092e6e495e981be156421e8d72 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.254215 6457 ts_tablet_manager.cc:1434] T a926ff092e6e495e981be156421e8d72 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:15.254508 6457 tablet_bootstrap.cc:492] T a01a86b6fd4b44d3808c2040525d7b61 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:15.256594 6457 tablet_bootstrap.cc:654] T a01a86b6fd4b44d3808c2040525d7b61 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:15.257717 5801 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet f74e7cb3e5f54dfdb2280c795ce2ce53 (table default.Table_64791d9d1cef4cfe9d420e405abe816e [id=8325a8f159124a2da260e2be3ce69500]). Expected version 2 got 0
I20260923 19:50:15.260496 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_b86593b9d27b4c5180563a796c645133"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:15.261178 6031 tablet_service.cc:1511] Processing CreateTablet for tablet 401d909c37ec4daaa210e4fc32d838aa (DEFAULT_TABLE table=default.Table_b0ee37845cb4472db1adf576ec6ce4e2 [id=2c5b70db7dc04c728e149bfa34c1703a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:15.262006 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b86593b9d27b4c5180563a796c645133 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:15.266487 6027 tablet_service.cc:1511] Processing CreateTablet for tablet 62c0cf7f070e467dafaed442b6b8c15d (DEFAULT_TABLE table=default.Table_91d4a2993b4b4ecea5fda676d43c5a18 [id=94d4db1161a24be58685df6b568b498f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.266614 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 401d909c37ec4daaa210e4fc32d838aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.266829 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62c0cf7f070e467dafaed442b6b8c15d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.271049 6037 tablet_service.cc:1511] Processing CreateTablet for tablet e8b0d0a8e4e54ec195893127f7a76bed (DEFAULT_TABLE table=default.Table_3a11a15c5e5b4bc38332d423f3d559e7 [id=08c2ffe9af244decbbd14e0f5efc7c4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.272480 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8b0d0a8e4e54ec195893127f7a76bed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.274981 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 0e817b7284e4496caf519b06a47b8e90 (DEFAULT_TABLE table=default.Table_3b64a099365449d4993169c3ea7499e2 [id=938a0a8b6a254454a8644bf40ae52d0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.275303 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e817b7284e4496caf519b06a47b8e90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.276644 6175 tablet_service.cc:1511] Processing CreateTablet for tablet e8b0d0a8e4e54ec195893127f7a76bed (DEFAULT_TABLE table=default.Table_3a11a15c5e5b4bc38332d423f3d559e7 [id=08c2ffe9af244decbbd14e0f5efc7c4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.276729 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 94e111312f134034993bbd968366dea7 (DEFAULT_TABLE table=default.Table_20a1677e214649a7892c8b6815106deb [id=e4b9c8726cb746c297c80e1eeb424711]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.277164 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94e111312f134034993bbd968366dea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.277721 6181 tablet_service.cc:1511] Processing CreateTablet for tablet 0e817b7284e4496caf519b06a47b8e90 (DEFAULT_TABLE table=default.Table_3b64a099365449d4993169c3ea7499e2 [id=938a0a8b6a254454a8644bf40ae52d0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.278398 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 94e111312f134034993bbd968366dea7 (DEFAULT_TABLE table=default.Table_20a1677e214649a7892c8b6815106deb [id=e4b9c8726cb746c297c80e1eeb424711]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.291678 7134 raft_consensus.cc:493] T 6d29923f139445cc86379c80ac15df5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:15.291831 7134 raft_consensus.cc:515] T 6d29923f139445cc86379c80ac15df5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.292397 7134 leader_election.cc:290] T 6d29923f139445cc86379c80ac15df5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:15.293053 5799 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f2eaab6869a44801898602e856f9ef0d" } modify_external_catalogs: true
I20260923 19:50:15.293256 5799 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f2eaab6869a44801898602e856f9ef0d" } modify_external_catalogs: true
W20260923 19:50:15.294149 5802 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c013c07fd27a46f29a464d73fe752e10 consensus state has no leader
W20260923 19:50:15.294596 5803 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 77aa9699460440e7906957855b97448e consensus state has no leader
W20260923 19:50:15.294989 5796 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2072d5cda2d046898df6ccddb872c92e consensus state has no leader
I20260923 19:50:15.299260 5797 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 0d70deeda179486291195476e47a9ae6 (table default.Table_e99b5d82a0814c538bfe455a29c4fa8e [id=d1e262e6e34742538b2b26c5fae80a99]). Expected version 2 got 0
I20260923 19:50:15.299866 6461 tablet_replica.cc:333] T b7ba284e81bc4388bbd6456a41d1f9f4 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:15.300037 6461 raft_consensus.cc:2243] T b7ba284e81bc4388bbd6456a41d1f9f4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:15.300172 6461 raft_consensus.cc:2272] T b7ba284e81bc4388bbd6456a41d1f9f4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:15.300666 6461 ts_tablet_manager.cc:1916] T b7ba284e81bc4388bbd6456a41d1f9f4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:15.303440 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_4b2190aa0f324c3987e02081e95555e4" } modify_external_catalogs: true
I20260923 19:50:15.303624 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_4b2190aa0f324c3987e02081e95555e4" } modify_external_catalogs: true
I20260923 19:50:15.304802 5797 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_20a1677e214649a7892c8b6815106deb" } modify_external_catalogs: true
I20260923 19:50:15.304942 5797 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_20a1677e214649a7892c8b6815106deb" } modify_external_catalogs: true
I20260923 19:50:15.306205 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d29923f139445cc86379c80ac15df5d" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:15.307130 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet cc581dd78b6d4fb29fff701ae794a89d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc581dd78b6d4fb29fff701ae794a89d already in progress: creating tablet
W20260923 19:50:15.307363 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet c031d99a6f9844c29664236662e8d5f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c031d99a6f9844c29664236662e8d5f8 already in progress: creating tablet
W20260923 19:50:15.307557 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet b6ef90ddd7a34dfdb8309d0e1c3688e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b6ef90ddd7a34dfdb8309d0e1c3688e7 already in progress: creating tablet
W20260923 19:50:15.308100 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 17a105f389d041dbb0bf8b828f990d27 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17a105f389d041dbb0bf8b828f990d27 already in progress: creating tablet
I20260923 19:50:15.307850 5803 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_1141571b3d744e3b922ca1d9745fbadf" } modify_external_catalogs: true
I20260923 19:50:15.308274 5803 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_1141571b3d744e3b922ca1d9745fbadf" } modify_external_catalogs: true
W20260923 19:50:15.309422 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 349c0447464d4c5380cf15cb4aeb54a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 349c0447464d4c5380cf15cb4aeb54a4 already in progress: creating tablet
W20260923 19:50:15.309707 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet c1347ea7774c40548975d10f6b3cba2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c1347ea7774c40548975d10f6b3cba2a already in progress: creating tablet
W20260923 19:50:15.310021 5995 leader_election.cc:343] T 6d29923f139445cc86379c80ac15df5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:15.312337 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_e99b5d82a0814c538bfe455a29c4fa8e" } modify_external_catalogs: true
I20260923 19:50:15.312528 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_e99b5d82a0814c538bfe455a29c4fa8e" } modify_external_catalogs: true
I20260923 19:50:15.323498 6171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 401d909c37ec4daaa210e4fc32d838aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.326522 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 655) took 1221 ms. Trace:
I20260923 19:50:15.326613 6459 rpcz_store.cc:276] 0923 19:50:14.105305 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.105456 (+ 151us) service_pool.cc:224] Handling call
0923 19:50:15.195291 (+1089835us) ts_tablet_manager.cc:1151] Deleting tablet a08446fcf1794dab9d3181904507456f
0923 19:50:15.195300 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.219363 (+ 24063us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.222991 (+ 3628us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.326503 (+103512us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1089523}
I20260923 19:50:15.326969 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 656) took 1179 ms. Trace:
I20260923 19:50:15.327054 6459 rpcz_store.cc:276] 0923 19:50:14.147154 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.153925 (+ 6771us) service_pool.cc:224] Handling call
0923 19:50:15.326861 (+1172936us) ts_tablet_manager.cc:1151] Deleting tablet 7dac9efee371479ab3547e06f0e580ad
0923 19:50:15.326870 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.326954 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1171893}
I20260923 19:50:15.327229 6461 ts_tablet_manager.cc:1929] T b7ba284e81bc4388bbd6456a41d1f9f4 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:15.327325 6461 log.cc:1199] T b7ba284e81bc4388bbd6456a41d1f9f4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/b7ba284e81bc4388bbd6456a41d1f9f4
I20260923 19:50:15.327363 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 661) took 1124 ms. Trace:
I20260923 19:50:15.327427 6459 rpcz_store.cc:276] 0923 19:50:14.203094 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.203143 (+ 49us) service_pool.cc:224] Handling call
0923 19:50:15.327266 (+1124123us) ts_tablet_manager.cc:1151] Deleting tablet 9756a1f8e23a436bb7c19c8cba7bdc05
0923 19:50:15.327274 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.327348 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1123716}
I20260923 19:50:15.327644 6461 ts_tablet_manager.cc:1950] T b7ba284e81bc4388bbd6456a41d1f9f4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:15.327732 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 660) took 1125 ms. Trace:
I20260923 19:50:15.327795 6459 rpcz_store.cc:276] 0923 19:50:14.202758 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.203115 (+ 357us) service_pool.cc:224] Handling call
0923 19:50:15.327639 (+1124524us) ts_tablet_manager.cc:1151] Deleting tablet 7f7ecbb8d9054dde96b2bb511697dd47
0923 19:50:15.327647 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.327718 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1124024}
I20260923 19:50:15.328226 6459 tablet_replica.cc:333] T ec4cc8a742114e5fb07c5c9157ce09e8 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:15.328460 6459 raft_consensus.cc:2243] T ec4cc8a742114e5fb07c5c9157ce09e8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:15.328626 6459 raft_consensus.cc:2272] T ec4cc8a742114e5fb07c5c9157ce09e8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:15.329263 6459 ts_tablet_manager.cc:1916] T ec4cc8a742114e5fb07c5c9157ce09e8 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:15.330102 6175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8b0d0a8e4e54ec195893127f7a76bed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.334115 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e817b7284e4496caf519b06a47b8e90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.334074 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 62c0cf7f070e467dafaed442b6b8c15d (DEFAULT_TABLE table=default.Table_91d4a2993b4b4ecea5fda676d43c5a18 [id=94d4db1161a24be58685df6b568b498f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.334435 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62c0cf7f070e467dafaed442b6b8c15d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.334592 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94e111312f134034993bbd968366dea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.337455 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet b7ba284e81bc4388bbd6456a41d1f9f4 (table default.Table_91a9675177604eb39c32e86718c59d31 [id=bf85ae2ea4884de58391fc9e7b140b7f]) successfully deleted
W20260923 19:50:15.339952 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 2ed8d49f1b3d4bee80b1822df2a7f495 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ed8d49f1b3d4bee80b1822df2a7f495 already in progress: creating tablet
W20260923 19:50:15.341027 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 104f137941e84b83bb9a726752c865c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 104f137941e84b83bb9a726752c865c1 already in progress: creating tablet
I20260923 19:50:15.342113 6461 tablet_replica.cc:333] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:15.342283 6461 raft_consensus.cc:2243] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:15.342419 6461 raft_consensus.cc:2272] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:15.345690 6461 ts_tablet_manager.cc:1916] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:15.356777 6461 ts_tablet_manager.cc:1929] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:15.356922 6461 log.cc:1199] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/c012b2a92dc14f2ab5d9f4fe8a6a7779
I20260923 19:50:15.357227 6461 ts_tablet_manager.cc:1950] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:15.358500 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet a08446fcf1794dab9d3181904507456f (table default.Table_e1b933d20310499aab93b720704ea8d0 [id=c348e030b47641e7a407e9c2903215d6]) successfully deleted
W20260923 19:50:15.358922 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 9756a1f8e23a436bb7c19c8cba7bdc05 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9756a1f8e23a436bb7c19c8cba7bdc05 already in progress: creating tablet
W20260923 19:50:15.359229 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 7f7ecbb8d9054dde96b2bb511697dd47 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f7ecbb8d9054dde96b2bb511697dd47 already in progress: creating tablet
I20260923 19:50:15.364265 7134 raft_consensus.cc:493] T a926ff092e6e495e981be156421e8d72 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:15.364409 7134 raft_consensus.cc:515] T a926ff092e6e495e981be156421e8d72 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.365069 7134 leader_election.cc:290] T a926ff092e6e495e981be156421e8d72 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:15.366251 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a926ff092e6e495e981be156421e8d72" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:15.366719 5995 leader_election.cc:343] T a926ff092e6e495e981be156421e8d72 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:15.243124 6313 tablet_service.cc:1558] Processing DeleteTablet for tablet 18bab39d85f94f4283f0b18c1c9b48a2 with delete_type TABLET_DATA_DELETED (replaced by tablet ebc288d8d453481592df11cd1bfed3ac) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:15.243304 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet b92aaac328934d95a89e0fc08a80b0b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:15.264437 6318 tablet_service.cc:1511] Processing CreateTablet for tablet 62c0cf7f070e467dafaed442b6b8c15d (DEFAULT_TABLE table=default.Table_91d4a2993b4b4ecea5fda676d43c5a18 [id=94d4db1161a24be58685df6b568b498f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.369782 6318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62c0cf7f070e467dafaed442b6b8c15d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.268659 6325 tablet_service.cc:1511] Processing CreateTablet for tablet e8b0d0a8e4e54ec195893127f7a76bed (DEFAULT_TABLE table=default.Table_3a11a15c5e5b4bc38332d423f3d559e7 [id=08c2ffe9af244decbbd14e0f5efc7c4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.374195 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8b0d0a8e4e54ec195893127f7a76bed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.378854 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_fa3fcc5532af4101a61de0798a50be97"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:15.379428 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa3fcc5532af4101a61de0798a50be97 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:15.379663 6459 ts_tablet_manager.cc:1929] T ec4cc8a742114e5fb07c5c9157ce09e8 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260923 19:50:15.379765 6459 log.cc:1199] T ec4cc8a742114e5fb07c5c9157ce09e8 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/ec4cc8a742114e5fb07c5c9157ce09e8
I20260923 19:50:15.380224 6459 ts_tablet_manager.cc:1950] T ec4cc8a742114e5fb07c5c9157ce09e8 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:15.381021 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 663) took 1177 ms. Trace:
I20260923 19:50:15.381101 6459 rpcz_store.cc:276] 0923 19:50:14.203676 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.203709 (+ 33us) service_pool.cc:224] Handling call
0923 19:50:15.328158 (+1124449us) ts_tablet_manager.cc:1151] Deleting tablet ec4cc8a742114e5fb07c5c9157ce09e8
0923 19:50:15.328174 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.362621 (+ 34447us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.379592 (+ 16971us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.380999 (+ 1407us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1124149}
I20260923 19:50:15.274056 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 0e817b7284e4496caf519b06a47b8e90 (DEFAULT_TABLE table=default.Table_3b64a099365449d4993169c3ea7499e2 [id=938a0a8b6a254454a8644bf40ae52d0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.382027 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet a926ff092e6e495e981be156421e8d72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:15.382282 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e817b7284e4496caf519b06a47b8e90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.382702 5804 master_service.cc:960] ReplaceTablet: received request to replace tablet 22c89609da884c47b1dbc1470b37efbe from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:15.383622 5798 master_service.cc:960] ReplaceTablet: received request to replace tablet 870db252d8414be7bbe613ea467b5f3a from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:15.387885 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet ec4cc8a742114e5fb07c5c9157ce09e8 (table default.Table_72032a8e8a254d2bad8358ebf75f1615 [id=89181985e6154c7fa946148e48bef2eb]) successfully deleted
I20260923 19:50:15.275864 6317 tablet_service.cc:1511] Processing CreateTablet for tablet 94e111312f134034993bbd968366dea7 (DEFAULT_TABLE table=default.Table_20a1677e214649a7892c8b6815106deb [id=e4b9c8726cb746c297c80e1eeb424711]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.287973 7256 raft_consensus.cc:493] T c0ff8838ab17433ab733d3b293d4964f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:15.389379 7256 raft_consensus.cc:515] T c0ff8838ab17433ab733d3b293d4964f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.389551 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94e111312f134034993bbd968366dea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.390076 7256 leader_election.cc:290] T c0ff8838ab17433ab733d3b293d4964f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:15.390766 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0ff8838ab17433ab733d3b293d4964f" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:15.391644 6280 leader_election.cc:343] T c0ff8838ab17433ab733d3b293d4964f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:15.295626 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d29923f139445cc86379c80ac15df5d" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:15.300067 7352 consensus_queue.cc:1048] T f1a4bccf6dd2411f83b86d782ecf5f40 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260923 19:50:15.392421 5996 leader_election.cc:343] T 6d29923f139445cc86379c80ac15df5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:15.392570 5996 leader_election.cc:304] T 6d29923f139445cc86379c80ac15df5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:15.392899 7134 raft_consensus.cc:2749] T 6d29923f139445cc86379c80ac15df5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:15.363971 6456 tablet_bootstrap.cc:492] T 66739afdf147413787acb0363aa37df6 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:15.393915 6456 ts_tablet_manager.cc:1403] T 66739afdf147413787acb0363aa37df6 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.213s user 0.001s sys 0.009s
I20260923 19:50:15.394551 6456 raft_consensus.cc:359] T 66739afdf147413787acb0363aa37df6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.394711 6456 raft_consensus.cc:385] T 66739afdf147413787acb0363aa37df6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:15.394764 6456 raft_consensus.cc:740] T 66739afdf147413787acb0363aa37df6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:15.394959 6456 consensus_queue.cc:260] T 66739afdf147413787acb0363aa37df6 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.395370 6456 ts_tablet_manager.cc:1434] T 66739afdf147413787acb0363aa37df6 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260923 19:50:15.395654 6456 tablet_bootstrap.cc:492] T 35f46a1be80c4194b592c5d00fe1f342 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:15.397141 6456 tablet_bootstrap.cc:654] T 35f46a1be80c4194b592c5d00fe1f342 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:15.365803 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a926ff092e6e495e981be156421e8d72" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:15.399641 6457 tablet_bootstrap.cc:492] T a01a86b6fd4b44d3808c2040525d7b61 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:15.399772 6457 ts_tablet_manager.cc:1403] T a01a86b6fd4b44d3808c2040525d7b61 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.145s user 0.000s sys 0.016s
I20260923 19:50:15.400580 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 662) took 1197 ms. Trace:
I20260923 19:50:15.400662 6459 rpcz_store.cc:276] 0923 19:50:14.203398 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.209314 (+ 5916us) service_pool.cc:224] Handling call
0923 19:50:15.400465 (+1191151us) ts_tablet_manager.cc:1151] Deleting tablet ea2ef507c6e24d369427048171dfec06
0923 19:50:15.400475 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.400560 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1190984}
I20260923 19:50:15.400848 6461 tablet_replica.cc:333] T a926ff092e6e495e981be156421e8d72 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
W20260923 19:50:15.401084 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet ea2ef507c6e24d369427048171dfec06 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea2ef507c6e24d369427048171dfec06 already in progress: creating tablet
I20260923 19:50:15.402141 6461 raft_consensus.cc:2243] T a926ff092e6e495e981be156421e8d72 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:15.402570 6459 tablet_replica.cc:333] T 1c26a2863fdd4912b6d357877af1eb42 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:15.402882 6461 raft_consensus.cc:2272] T a926ff092e6e495e981be156421e8d72 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:15.402842 6459 raft_consensus.cc:2243] T 1c26a2863fdd4912b6d357877af1eb42 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:15.403283 6459 pending_rounds.cc:70] T 1c26a2863fdd4912b6d357877af1eb42 P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:15.404256 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet c012b2a92dc14f2ab5d9f4fe8a6a7779 (table default.Table_036d9052e0264e978bf3e3698ca8c08b [id=b2fef7fe862a41e493f5e1646b41bd5f]) successfully deleted
W20260923 19:50:15.404505 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 554655516bb547ad9c2aa1ee66dc8deb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 554655516bb547ad9c2aa1ee66dc8deb already in progress: creating tablet
I20260923 19:50:15.404502 6457 raft_consensus.cc:359] T a01a86b6fd4b44d3808c2040525d7b61 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.404654 6457 raft_consensus.cc:385] T a01a86b6fd4b44d3808c2040525d7b61 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:15.404706 6457 raft_consensus.cc:740] T a01a86b6fd4b44d3808c2040525d7b61 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:15.404717 5799 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 2d6762b369d3496083947a4a47a51868
I20260923 19:50:15.404914 6457 consensus_queue.cc:260] T a01a86b6fd4b44d3808c2040525d7b61 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:15.405122 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 42ca4ffede1a472d8917a592fac7f746 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 42ca4ffede1a472d8917a592fac7f746 already in progress: creating tablet
W20260923 19:50:15.405339 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet c6598be958f842328a81fd092c6fcf64 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c6598be958f842328a81fd092c6fcf64 already in progress: creating tablet
W20260923 19:50:15.405552 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet bc64c9a47934420b9be3a6c8fe3ed91f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc64c9a47934420b9be3a6c8fe3ed91f already in progress: creating tablet
I20260923 19:50:15.405720 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d6762b369d3496083947a4a47a51868 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:15.405766 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet cf0caa6afcf546678c233a9333b77a2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf0caa6afcf546678c233a9333b77a2a already in progress: creating tablet
I20260923 19:50:15.405916 6459 pending_rounds.cc:77] T 1c26a2863fdd4912b6d357877af1eb42 P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630590212100096 op_type: NO_OP noop_request { }
I20260923 19:50:15.406028 6459 raft_consensus.cc:2889] T 1c26a2863fdd4912b6d357877af1eb42 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:15.406107 6459 raft_consensus.cc:2272] T 1c26a2863fdd4912b6d357877af1eb42 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:15.407745 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 22e37d5afa8047989928596b4092c4b9
I20260923 19:50:15.408454 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 223edddace234a16b2d360504a99c28b
I20260923 19:50:15.409056 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 22e37d5afa8047989928596b4092c4b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:15.409926 6279 leader_election.cc:343] T c0ff8838ab17433ab733d3b293d4964f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: c0ff8838ab17433ab733d3b293d4964f
I20260923 19:50:15.410022 6279 leader_election.cc:304] T c0ff8838ab17433ab733d3b293d4964f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:15.410329 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 0d70deeda179486291195476e47a9ae6
I20260923 19:50:15.410562 7352 raft_consensus.cc:2749] T c0ff8838ab17433ab733d3b293d4964f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:15.414896 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 94e111312f134034993bbd968366dea7
I20260923 19:50:15.416157 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet 94e111312f134034993bbd968366dea7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:15.421322 6175 tablet_service.cc:1558] Processing DeleteTablet for tablet 22e37d5afa8047989928596b4092c4b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:15.421584 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet 223edddace234a16b2d360504a99c28b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:15.421763 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d70deeda179486291195476e47a9ae6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:15.421962 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet 94e111312f134034993bbd968366dea7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:15.422134 6178 tablet_service.cc:1558] Processing DeleteTablet for tablet a08446fcf1794dab9d3181904507456f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:15.422444 6171 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d6762b369d3496083947a4a47a51868 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:15.416157 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d70deeda179486291195476e47a9ae6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:15.423146 6318 tablet_service.cc:1558] Processing DeleteTablet for tablet 223edddace234a16b2d360504a99c28b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:15.423908 6310 tablet_service.cc:1558] Processing DeleteTablet for tablet 66739afdf147413787acb0363aa37df6 with delete_type TABLET_DATA_DELETED (replaced by tablet e4ad9baac560463fabc80828074b46c1) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:15.369294 6308 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e41501bf01e4765853c27e4cac21e2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:15.426695 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 629) took 1589 ms. Trace:
I20260923 19:50:15.426780 6458 rpcz_store.cc:276] 0923 19:50:13.837619 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.837954 (+ 335us) service_pool.cc:224] Handling call
0923 19:50:15.155558 (+1317604us) ts_tablet_manager.cc:1151] Deleting tablet b529b0e82c5b48edac54cc281ac4b4a6
0923 19:50:15.155570 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.209589 (+ 54019us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.225476 (+ 15887us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.426660 (+201184us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1317384}
I20260923 19:50:15.427189 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet b529b0e82c5b48edac54cc281ac4b4a6 (table default.Table_504bdbe9702948d58b4f958360a2040b [id=ca73f0867b5d49cfb0bb7cd2315c47f2]) successfully deleted
I20260923 19:50:15.427505 6458 tablet_replica.cc:333] T 623052a8c9c2436a828655da6cf6d379 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:15.412467 7134 raft_consensus.cc:493] T f7cf45d4c4d3480288698682c1c85869 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:15.427701 6458 raft_consensus.cc:2243] T 623052a8c9c2436a828655da6cf6d379 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:15.427904 6458 pending_rounds.cc:70] T 623052a8c9c2436a828655da6cf6d379 P 2bf41435f70447f19992d368ca6b46bd: Trying to abort 1 pending ops.
I20260923 19:50:15.427948 6458 pending_rounds.cc:77] T 623052a8c9c2436a828655da6cf6d379 P 2bf41435f70447f19992d368ca6b46bd: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630588916203520 op_type: NO_OP noop_request { }
I20260923 19:50:15.427829 7134 raft_consensus.cc:515] T f7cf45d4c4d3480288698682c1c85869 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.428027 6458 raft_consensus.cc:2889] T 623052a8c9c2436a828655da6cf6d379 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:15.428097 6458 raft_consensus.cc:2272] T 623052a8c9c2436a828655da6cf6d379 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:15.428171 6027 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d6762b369d3496083947a4a47a51868 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:15.428519 7134 leader_election.cc:290] T f7cf45d4c4d3480288698682c1c85869 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:15.417744 6026 tablet_service.cc:1558] Processing DeleteTablet for tablet 94e111312f134034993bbd968366dea7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:15.429059 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7cf45d4c4d3480288698682c1c85869" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:15.417972 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet 22e37d5afa8047989928596b4092c4b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:15.418020 6031 tablet_service.cc:1558] Processing DeleteTablet for tablet 223edddace234a16b2d360504a99c28b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:15.418058 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d70deeda179486291195476e47a9ae6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:15.430029 5996 leader_election.cc:343] T f7cf45d4c4d3480288698682c1c85869 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:15.430209 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet a01a86b6fd4b44d3808c2040525d7b61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:07 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:15.432017 6137 consensus_peers.cc:597] T 58c24aa494bc4da28536dfa1df6123b7 P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 58c24aa494bc4da28536dfa1df6123b7. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:15.432615 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7cf45d4c4d3480288698682c1c85869" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:15.424132 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet f7cf45d4c4d3480288698682c1c85869 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:15.405386 6457 ts_tablet_manager.cc:1434] T a01a86b6fd4b44d3808c2040525d7b61 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260923 19:50:15.434674 6457 tablet_bootstrap.cc:492] T c7369a5fc87f4b70bcfbe052ef021771 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:15.435981 6461 ts_tablet_manager.cc:1916] T a926ff092e6e495e981be156421e8d72 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:15.438969 6457 tablet_bootstrap.cc:654] T c7369a5fc87f4b70bcfbe052ef021771 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:15.439137 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_182f7505d6c041628fa56dc3288968f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:15.439313 5995 leader_election.cc:343] T f7cf45d4c4d3480288698682c1c85869 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:15.439417 5995 leader_election.cc:304] T f7cf45d4c4d3480288698682c1c85869 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
W20260923 19:50:15.439740 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_182f7505d6c041628fa56dc3288968f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:15.439864 7134 raft_consensus.cc:2749] T f7cf45d4c4d3480288698682c1c85869 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:15.440148 6279 consensus_peers.cc:597] T f1a4bccf6dd2411f83b86d782ecf5f40 P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f1a4bccf6dd2411f83b86d782ecf5f40. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:15.442181 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_a86b468f8e19450da6a1123193689d75"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:15.442734 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a86b468f8e19450da6a1123193689d75 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:15.443943 5796 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_6548667d6dce4e069f658ff50dab80ec" } new_table_name: "default.Table_1aa0de1bec54443186e5e99d279be98e" modify_external_catalogs: true
I20260923 19:50:15.446491 7352 raft_consensus.cc:493] T 8d87f05f29bd476386ff6516676ce31a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:15.446630 7352 raft_consensus.cc:515] T 8d87f05f29bd476386ff6516676ce31a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.447299 7352 leader_election.cc:290] T 8d87f05f29bd476386ff6516676ce31a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:15.447966 6054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d87f05f29bd476386ff6516676ce31a" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:15.448170 6054 raft_consensus.cc:2468] T 8d87f05f29bd476386ff6516676ce31a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:15.448700 6279 leader_election.cc:304] T 8d87f05f29bd476386ff6516676ce31a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:15.448961 7352 raft_consensus.cc:2804] T 8d87f05f29bd476386ff6516676ce31a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:15.449029 7352 raft_consensus.cc:493] T 8d87f05f29bd476386ff6516676ce31a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:15.449096 7352 raft_consensus.cc:3060] T 8d87f05f29bd476386ff6516676ce31a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:15.449313 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ce3b70141f6a4c24aa6d4f53fe8c97f8" } new_table_name: "default.Table_cd491412a6264b6aba16b6648a128b0f" modify_external_catalogs: true
I20260923 19:50:15.452517 7352 raft_consensus.cc:515] T 8d87f05f29bd476386ff6516676ce31a P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.455817 6454 raft_consensus.cc:385] T cd02244c52ad4d2ab3915108a92a6f97 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:15.456218 6454 raft_consensus.cc:740] T cd02244c52ad4d2ab3915108a92a6f97 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:15.456732 6454 consensus_queue.cc:260] T cd02244c52ad4d2ab3915108a92a6f97 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.459141 7352 leader_election.cc:290] T 8d87f05f29bd476386ff6516676ce31a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:15.459545 6054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d87f05f29bd476386ff6516676ce31a" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:15.459693 6054 raft_consensus.cc:3060] T 8d87f05f29bd476386ff6516676ce31a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:15.464097 6054 raft_consensus.cc:2468] T 8d87f05f29bd476386ff6516676ce31a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:15.464221 6461 ts_tablet_manager.cc:1929] T a926ff092e6e495e981be156421e8d72 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:15.464332 6461 log.cc:1199] T a926ff092e6e495e981be156421e8d72 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/a926ff092e6e495e981be156421e8d72
I20260923 19:50:15.464627 6461 ts_tablet_manager.cc:1950] T a926ff092e6e495e981be156421e8d72 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:15.466609 6279 leader_election.cc:304] T 8d87f05f29bd476386ff6516676ce31a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:15.469028 7352 raft_consensus.cc:2804] T 8d87f05f29bd476386ff6516676ce31a P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:15.472064 7352 raft_consensus.cc:697] T 8d87f05f29bd476386ff6516676ce31a P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:15.474020 5801 master_service.cc:960] ReplaceTablet: received request to replace tablet 717995ec489343118809ada2a6b58804 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:15.484686 7352 consensus_queue.cc:237] T 8d87f05f29bd476386ff6516676ce31a P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.485256 6457 tablet_bootstrap.cc:492] T c7369a5fc87f4b70bcfbe052ef021771 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:15.485445 6457 ts_tablet_manager.cc:1403] T c7369a5fc87f4b70bcfbe052ef021771 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.052s user 0.002s sys 0.002s
I20260923 19:50:15.486769 6457 raft_consensus.cc:359] T c7369a5fc87f4b70bcfbe052ef021771 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.488497 6456 tablet_bootstrap.cc:492] T 35f46a1be80c4194b592c5d00fe1f342 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:15.488673 6456 ts_tablet_manager.cc:1403] T 35f46a1be80c4194b592c5d00fe1f342 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.093s user 0.001s sys 0.003s
I20260923 19:50:15.489473 6456 raft_consensus.cc:359] T 35f46a1be80c4194b592c5d00fe1f342 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.489704 6456 raft_consensus.cc:385] T 35f46a1be80c4194b592c5d00fe1f342 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:15.489809 6456 raft_consensus.cc:740] T 35f46a1be80c4194b592c5d00fe1f342 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:15.490108 6456 consensus_queue.cc:260] T 35f46a1be80c4194b592c5d00fe1f342 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:15.490574 5796 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ed943ce02a6a468399e37693c3980780 has no consensus state
I20260923 19:50:15.490772 6456 ts_tablet_manager.cc:1434] T 35f46a1be80c4194b592c5d00fe1f342 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:15.491022 6456 tablet_bootstrap.cc:492] T c19298691d5d4209b2d1147a1aad2f6f P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
W20260923 19:50:15.491076 5803 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 55991fab89be47afba7fcd08673ef82f consensus state has no leader
I20260923 19:50:15.492689 6456 tablet_bootstrap.cc:654] T c19298691d5d4209b2d1147a1aad2f6f P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:15.493136 6458 ts_tablet_manager.cc:1916] T 623052a8c9c2436a828655da6cf6d379 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:15.495174 6457 raft_consensus.cc:385] T c7369a5fc87f4b70bcfbe052ef021771 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:15.495265 6457 raft_consensus.cc:740] T c7369a5fc87f4b70bcfbe052ef021771 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:15.498075 6457 consensus_queue.cc:260] T c7369a5fc87f4b70bcfbe052ef021771 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.499086 5801 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 717995ec489343118809ada2a6b58804
I20260923 19:50:15.499526 6457 ts_tablet_manager.cc:1434] T c7369a5fc87f4b70bcfbe052ef021771 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260923 19:50:15.499632 5801 catalog_manager.cc:6934] ReplaceTablet: tablet 717995ec489343118809ada2a6b58804 deleted and replaced by tablet cf3ab578ef1442f19d629b61dc73a970
I20260923 19:50:15.472843 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d87f05f29bd476386ff6516676ce31a" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:15.472931 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d87f05f29bd476386ff6516676ce31a" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:15.500295 6454 ts_tablet_manager.cc:1434] T cd02244c52ad4d2ab3915108a92a6f97 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.314s user 0.023s sys 0.000s
I20260923 19:50:15.501070 6308 tablet_service.cc:1558] Processing DeleteTablet for tablet 717995ec489343118809ada2a6b58804 with delete_type TABLET_DATA_DELETED (replaced by tablet cf3ab578ef1442f19d629b61dc73a970) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:15.501444 6280 leader_election.cc:343] T 8d87f05f29bd476386ff6516676ce31a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:15.501854 6280 leader_election.cc:343] T 8d87f05f29bd476386ff6516676ce31a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:15.502763 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet 717995ec489343118809ada2a6b58804 with delete_type TABLET_DATA_DELETED (replaced by tablet cf3ab578ef1442f19d629b61dc73a970) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:15.503376 6454 tablet_bootstrap.cc:492] T 235b4b8081ad4a13937a7941344dbc33 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:15.504391 6456 tablet_bootstrap.cc:492] T c19298691d5d4209b2d1147a1aad2f6f P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:15.504612 6456 ts_tablet_manager.cc:1403] T c19298691d5d4209b2d1147a1aad2f6f P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.002s
I20260923 19:50:15.510926 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet 717995ec489343118809ada2a6b58804 with delete_type TABLET_DATA_DELETED (replaced by tablet cf3ab578ef1442f19d629b61dc73a970) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:15.512701 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_dcef0afaedf948748a0f1f6b845e48c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:15.512805 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_677e330a53e147958b3aa8480e707869"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:15.513414 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_677e330a53e147958b3aa8480e707869 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:15.514062 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_db1b6a3aa2f44c2f9d346b09bf7f2a4b" } new_table_name: "default.Table_442d2690dd6a4cb681ac7f7146304efa" modify_external_catalogs: true
I20260923 19:50:15.514892 6461 tablet_replica.cc:333] T 22e37d5afa8047989928596b4092c4b9 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:15.515084 6461 raft_consensus.cc:2243] T 22e37d5afa8047989928596b4092c4b9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:15.515259 6461 raft_consensus.cc:2272] T 22e37d5afa8047989928596b4092c4b9 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:15.506964 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet cd02244c52ad4d2ab3915108a92a6f97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:15.487521 6459 ts_tablet_manager.cc:1916] T 1c26a2863fdd4912b6d357877af1eb42 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:15.515775 6461 ts_tablet_manager.cc:1916] T 22e37d5afa8047989928596b4092c4b9 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:15.516819 5796 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_eab0a85599f44d58b84847483e41ba6f" } new_table_name: "default.Table_cdf00b2482e94015ae5471906fbf2085" modify_external_catalogs: true
I20260923 19:50:15.518463 5802 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_610e289c686b4647bf9ff414ce55b007" } new_table_name: "default.Table_87bca22b5e614f978d7d3802b2557b53" modify_external_catalogs: true
W20260923 19:50:15.521253 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dcef0afaedf948748a0f1f6b845e48c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:15.522380 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet a926ff092e6e495e981be156421e8d72 (table default.Table_413519bded0c44f3b92a3710f13f69bb [id=8a617888464a4c8c85dbe8f93d6ef9fb]) successfully deleted
W20260923 19:50:15.522639 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 2d6762b369d3496083947a4a47a51868 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d6762b369d3496083947a4a47a51868 already in progress: creating tablet
W20260923 19:50:15.522907 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 94e111312f134034993bbd968366dea7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 94e111312f134034993bbd968366dea7 already in progress: creating tablet
I20260923 19:50:15.523970 6456 raft_consensus.cc:359] T c19298691d5d4209b2d1147a1aad2f6f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.524132 6456 raft_consensus.cc:385] T c19298691d5d4209b2d1147a1aad2f6f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:15.524185 6456 raft_consensus.cc:740] T c19298691d5d4209b2d1147a1aad2f6f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:15.524475 6456 consensus_queue.cc:260] T c19298691d5d4209b2d1147a1aad2f6f P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.525153 6456 ts_tablet_manager.cc:1434] T c19298691d5d4209b2d1147a1aad2f6f P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:15.525425 6456 tablet_bootstrap.cc:492] T 6a2564a99c274e07a7e43da739a2458b P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:15.526015 7316 raft_consensus.cc:493] T cd02244c52ad4d2ab3915108a92a6f97 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:15.526160 7316 raft_consensus.cc:515] T cd02244c52ad4d2ab3915108a92a6f97 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.526952 6456 tablet_bootstrap.cc:654] T 6a2564a99c274e07a7e43da739a2458b P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:15.527275 7316 leader_election.cc:290] T cd02244c52ad4d2ab3915108a92a6f97 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:15.527999 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet c7369a5fc87f4b70bcfbe052ef021771 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:15.528484 6457 tablet_bootstrap.cc:492] T b9c187ee1fa8438397c83bc2c2b16925 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
W20260923 19:50:15.528698 6139 leader_election.cc:343] T cd02244c52ad4d2ab3915108a92a6f97 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: cd02244c52ad4d2ab3915108a92a6f97
W20260923 19:50:15.530067 6137 leader_election.cc:343] T cd02244c52ad4d2ab3915108a92a6f97 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: cd02244c52ad4d2ab3915108a92a6f97
I20260923 19:50:15.530180 6457 tablet_bootstrap.cc:654] T b9c187ee1fa8438397c83bc2c2b16925 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:15.530166 6137 leader_election.cc:304] T cd02244c52ad4d2ab3915108a92a6f97 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:15.530733 7316 raft_consensus.cc:2749] T cd02244c52ad4d2ab3915108a92a6f97 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:15.540971 5796 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a53f2eb08330411ebe417d4e1e414db6 consensus state has no leader
W20260923 19:50:15.541497 5802 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet de871dbb0bb34e6fb3c38583a471a37f consensus state has no leader
I20260923 19:50:15.541545 6454 tablet_bootstrap.cc:654] T 235b4b8081ad4a13937a7941344dbc33 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:15.542299 5803 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 940d876042844020833ccc2347d67c4c consensus state has no leader
I20260923 19:50:15.544126 5802 catalog_manager.cc:5838] T 8d87f05f29bd476386ff6516676ce31a P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:15.544785 5802 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 8d87f05f29bd476386ff6516676ce31a (table default.Table_9fa8f8bfc6124f398a4acdf5e1e0b33a [id=02d2ab56def342c482c86ce96110342f]). Expected version 1 got 0
I20260923 19:50:15.554653 6458 ts_tablet_manager.cc:1929] T 623052a8c9c2436a828655da6cf6d379 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:15.579341 6457 tablet_bootstrap.cc:492] T b9c187ee1fa8438397c83bc2c2b16925 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:15.579530 6457 ts_tablet_manager.cc:1403] T b9c187ee1fa8438397c83bc2c2b16925 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.070s user 0.003s sys 0.000s
I20260923 19:50:15.580574 6457 raft_consensus.cc:359] T b9c187ee1fa8438397c83bc2c2b16925 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.580778 6457 raft_consensus.cc:385] T b9c187ee1fa8438397c83bc2c2b16925 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:15.580852 6457 raft_consensus.cc:740] T b9c187ee1fa8438397c83bc2c2b16925 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:15.581163 6457 consensus_queue.cc:260] T b9c187ee1fa8438397c83bc2c2b16925 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.583524 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_7fd5aef2a3c648f8bb0354e14380c716"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:15.583693 6457 ts_tablet_manager.cc:1434] T b9c187ee1fa8438397c83bc2c2b16925 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260923 19:50:15.583932 6457 tablet_bootstrap.cc:492] T ed9fb0cab0bd43b7a05d7376125b187e P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
W20260923 19:50:15.584128 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7fd5aef2a3c648f8bb0354e14380c716 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:15.586505 6461 ts_tablet_manager.cc:1929] T 22e37d5afa8047989928596b4092c4b9 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:15.586609 6461 log.cc:1199] T 22e37d5afa8047989928596b4092c4b9 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/22e37d5afa8047989928596b4092c4b9
I20260923 19:50:15.586897 6461 ts_tablet_manager.cc:1950] T 22e37d5afa8047989928596b4092c4b9 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:15.588248 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 22e37d5afa8047989928596b4092c4b9 (table default.Table_1141571b3d744e3b922ca1d9745fbadf [id=c0f9d6a40e364dd0ad7ce95fa73b5930]) successfully deleted
I20260923 19:50:15.588550 6461 tablet_replica.cc:333] T 223edddace234a16b2d360504a99c28b P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:15.588481 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_5fdf1ec98959467c8800e108f541e3d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:15.588721 6461 raft_consensus.cc:2243] T 223edddace234a16b2d360504a99c28b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:15.588868 6461 raft_consensus.cc:2272] T 223edddace234a16b2d360504a99c28b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:15.589025 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5fdf1ec98959467c8800e108f541e3d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:15.590085 6454 tablet_bootstrap.cc:492] T 235b4b8081ad4a13937a7941344dbc33 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:15.590212 6454 ts_tablet_manager.cc:1403] T 235b4b8081ad4a13937a7941344dbc33 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.088s user 0.004s sys 0.000s
I20260923 19:50:15.590718 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_b0b796ec295042f8a2b294c7dd1d6136"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:15.590883 6454 raft_consensus.cc:359] T 235b4b8081ad4a13937a7941344dbc33 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.591048 6454 raft_consensus.cc:385] T 235b4b8081ad4a13937a7941344dbc33 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:15.591104 6454 raft_consensus.cc:740] T 235b4b8081ad4a13937a7941344dbc33 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
W20260923 19:50:15.591217 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b0b796ec295042f8a2b294c7dd1d6136 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:15.591300 6454 consensus_queue.cc:260] T 235b4b8081ad4a13937a7941344dbc33 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.592157 6454 ts_tablet_manager.cc:1434] T 235b4b8081ad4a13937a7941344dbc33 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:50:15.592286 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_b7b81a79b9a24504adbefb5a52b17e4f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:15.592636 6454 tablet_bootstrap.cc:492] T ba4e9fee05994c0d8e7d1f21788280d3 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
W20260923 19:50:15.592742 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b7b81a79b9a24504adbefb5a52b17e4f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:15.593986 6458 log.cc:1199] T 623052a8c9c2436a828655da6cf6d379 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/623052a8c9c2436a828655da6cf6d379
I20260923 19:50:15.594390 6458 ts_tablet_manager.cc:1950] T 623052a8c9c2436a828655da6cf6d379 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:15.594698 6454 tablet_bootstrap.cc:654] T ba4e9fee05994c0d8e7d1f21788280d3 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:15.595203 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 632) took 1617 ms. Trace:
I20260923 19:50:15.595290 6458 rpcz_store.cc:276] 0923 19:50:13.978105 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.978261 (+ 156us) service_pool.cc:224] Handling call
0923 19:50:15.427465 (+1449204us) ts_tablet_manager.cc:1151] Deleting tablet 623052a8c9c2436a828655da6cf6d379
0923 19:50:15.427474 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.551196 (+123722us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.554594 (+ 3398us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.595181 (+ 40587us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1449048}
I20260923 19:50:15.595634 6458 tablet_replica.cc:333] T f1a4bccf6dd2411f83b86d782ecf5f40 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:15.595806 6458 raft_consensus.cc:2243] T f1a4bccf6dd2411f83b86d782ecf5f40 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:15.595872 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 623052a8c9c2436a828655da6cf6d379 (table default.Table_5365e890b976423aa339a9b5e8c8db7e [id=c815692bfbde445ea9c331e95615a751]) successfully deleted
I20260923 19:50:15.596139 6458 raft_consensus.cc:2272] T f1a4bccf6dd2411f83b86d782ecf5f40 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:15.604056 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_88f358158870457f92f99862bdc15f8b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:15.604897 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_88f358158870457f92f99862bdc15f8b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:15.608826 6461 ts_tablet_manager.cc:1916] T 223edddace234a16b2d360504a99c28b P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:15.612082 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet b9c187ee1fa8438397c83bc2c2b16925 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:15.614100 6457 tablet_bootstrap.cc:654] T ed9fb0cab0bd43b7a05d7376125b187e P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:15.614348 5805 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_2117af45b89a4af2a58df762cb072590" } modify_external_catalogs: true
I20260923 19:50:15.614545 5805 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_2117af45b89a4af2a58df762cb072590" } modify_external_catalogs: true
I20260923 19:50:15.614975 5797 master_service.cc:960] ReplaceTablet: received request to replace tablet 7dac9efee371479ab3547e06f0e580ad from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:15.615697 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet 235b4b8081ad4a13937a7941344dbc33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:04 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:15.617122 5797 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_1704ffca6cc6482f88bac19f06b8052c" } modify_external_catalogs: true
I20260923 19:50:15.617259 5797 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_1704ffca6cc6482f88bac19f06b8052c" } modify_external_catalogs: true
I20260923 19:50:15.620883 5798 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_85afd8d42b6445daa79f5fe22456ba77" } modify_external_catalogs: true
I20260923 19:50:15.621091 5798 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_85afd8d42b6445daa79f5fe22456ba77" } modify_external_catalogs: true
I20260923 19:50:15.622530 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_af3299e40526459183a95451e2320ae0" } modify_external_catalogs: true
I20260923 19:50:15.622702 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_af3299e40526459183a95451e2320ae0" } modify_external_catalogs: true
I20260923 19:50:15.624123 6458 ts_tablet_manager.cc:1916] T f1a4bccf6dd2411f83b86d782ecf5f40 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:15.630688 7134 raft_consensus.cc:493] T f74e7cb3e5f54dfdb2280c795ce2ce53 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:15.630841 7134 raft_consensus.cc:515] T f74e7cb3e5f54dfdb2280c795ce2ce53 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.631310 5801 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_14071e1a8af443939d9841cd4f672964" } modify_external_catalogs: true
I20260923 19:50:15.631505 7134 leader_election.cc:290] T f74e7cb3e5f54dfdb2280c795ce2ce53 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:15.632073 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e7cb3e5f54dfdb2280c795ce2ce53" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:15.632524 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e7cb3e5f54dfdb2280c795ce2ce53" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:15.632997 5995 leader_election.cc:343] T f74e7cb3e5f54dfdb2280c795ce2ce53 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:15.633119 5996 leader_election.cc:343] T f74e7cb3e5f54dfdb2280c795ce2ce53 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:15.633204 5996 leader_election.cc:304] T f74e7cb3e5f54dfdb2280c795ce2ce53 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:15.633543 7134 raft_consensus.cc:2749] T f74e7cb3e5f54dfdb2280c795ce2ce53 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:15.633848 5801 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_14071e1a8af443939d9841cd4f672964" } modify_external_catalogs: true
I20260923 19:50:15.637912 6454 tablet_bootstrap.cc:492] T ba4e9fee05994c0d8e7d1f21788280d3 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:15.638121 6454 ts_tablet_manager.cc:1403] T ba4e9fee05994c0d8e7d1f21788280d3 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.046s user 0.001s sys 0.004s
I20260923 19:50:15.639453 6454 raft_consensus.cc:359] T ba4e9fee05994c0d8e7d1f21788280d3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.641795 6454 raft_consensus.cc:385] T ba4e9fee05994c0d8e7d1f21788280d3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:15.642007 6454 raft_consensus.cc:740] T ba4e9fee05994c0d8e7d1f21788280d3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:15.642396 6454 consensus_queue.cc:260] T ba4e9fee05994c0d8e7d1f21788280d3 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.643117 6454 ts_tablet_manager.cc:1434] T ba4e9fee05994c0d8e7d1f21788280d3 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
W20260923 19:50:15.645712 6280 consensus_peers.cc:597] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ec4cc8a742114e5fb07c5c9157ce09e8. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:15.646287 6454 tablet_bootstrap.cc:492] T 2ccfe6531fc44f86a0edc8bda1547442 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
W20260923 19:50:15.646797 6280 consensus_peers.cc:597] T 1fcd1c1bfd2c437a955c34569605a6d4 P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:15.649631 6454 tablet_bootstrap.cc:654] T 2ccfe6531fc44f86a0edc8bda1547442 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:15.650584 5996 leader_election.cc:343] T a926ff092e6e495e981be156421e8d72 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:15.650712 5996 leader_election.cc:304] T a926ff092e6e495e981be156421e8d72 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
W20260923 19:50:15.650871 5996 raft_consensus.cc:2686] T a926ff092e6e495e981be156421e8d72 P e546f660e7e541d1aa9ae38e5ee5b9c0: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260923 19:50:15.651497 5802 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 35f46a1be80c4194b592c5d00fe1f342 (table default.Table_f6755f452e8d41c4b9d64c3ee2735188 [id=d6a2d0fc236a4056b224d01249f045b0]). Expected version 1 got 0
I20260923 19:50:15.653160 6461 ts_tablet_manager.cc:1929] T 223edddace234a16b2d360504a99c28b P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260923 19:50:15.653257 6461 log.cc:1199] T 223edddace234a16b2d360504a99c28b P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/223edddace234a16b2d360504a99c28b
I20260923 19:50:15.653644 6461 ts_tablet_manager.cc:1950] T 223edddace234a16b2d360504a99c28b P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:15.654541 6461 tablet_replica.cc:333] T 0d70deeda179486291195476e47a9ae6 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:15.654708 6461 raft_consensus.cc:2243] T 0d70deeda179486291195476e47a9ae6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:15.654886 6461 raft_consensus.cc:2272] T 0d70deeda179486291195476e47a9ae6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:15.657964 6308 tablet_service.cc:1558] Processing DeleteTablet for tablet c19298691d5d4209b2d1147a1aad2f6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:07 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:15.658306 6310 tablet_service.cc:1511] Processing CreateTablet for tablet f6a489aba98940fd888b9cc79a3a0b68 (DEFAULT_TABLE table=default.Table_7ef4fde492124fa28e7089765bab36d9 [id=2b1494b2d6884994bd4f6e885202e3f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.659307 6317 tablet_service.cc:1511] Processing CreateTablet for tablet d6834a3e535e4b56bea863106425df37 (DEFAULT_TABLE table=default.Table_dd06a0c334dc4439af02958dd0b12a29 [id=4d7c388b036641d0a7907fdab45c6b35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.660301 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6a489aba98940fd888b9cc79a3a0b68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.662655 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6834a3e535e4b56bea863106425df37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.665427 6461 ts_tablet_manager.cc:1916] T 0d70deeda179486291195476e47a9ae6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:15.665637 5802 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 2db82e6f314f412385b41720c7efdef5 (table default.Table_fa1d82a491c04ba89f5cf3162578d550 [id=6d79e588fb9e4936aedf8cd500f68d60]). Expected version 3 got 0
I20260923 19:50:15.666729 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 223edddace234a16b2d360504a99c28b (table default.Table_4b2190aa0f324c3987e02081e95555e4 [id=ed438085f7054d9993a39852df4cc790]) successfully deleted
I20260923 19:50:15.667443 6034 tablet_service.cc:1511] Processing CreateTablet for tablet f6a489aba98940fd888b9cc79a3a0b68 (DEFAULT_TABLE table=default.Table_7ef4fde492124fa28e7089765bab36d9 [id=2b1494b2d6884994bd4f6e885202e3f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.667907 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6a489aba98940fd888b9cc79a3a0b68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.670210 6028 tablet_service.cc:1511] Processing CreateTablet for tablet d6834a3e535e4b56bea863106425df37 (DEFAULT_TABLE table=default.Table_dd06a0c334dc4439af02958dd0b12a29 [id=4d7c388b036641d0a7907fdab45c6b35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.670621 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6834a3e535e4b56bea863106425df37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.674127 5801 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 5494818771f04f92b37a6991b73e40a6
I20260923 19:50:15.674651 6456 tablet_bootstrap.cc:492] T 6a2564a99c274e07a7e43da739a2458b P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:15.674777 6456 ts_tablet_manager.cc:1403] T 6a2564a99c274e07a7e43da739a2458b P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.149s user 0.003s sys 0.000s
I20260923 19:50:15.674952 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 22c89609da884c47b1dbc1470b37efbe
I20260923 19:50:15.674981 6308 tablet_service.cc:1558] Processing DeleteTablet for tablet 5494818771f04f92b37a6991b73e40a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:15.675386 5804 catalog_manager.cc:6934] ReplaceTablet: tablet 22c89609da884c47b1dbc1470b37efbe deleted and replaced by tablet 295502f94faf4d4880e9516aa8d9cb79
I20260923 19:50:15.675587 6456 raft_consensus.cc:359] T 6a2564a99c274e07a7e43da739a2458b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.675742 6456 raft_consensus.cc:385] T 6a2564a99c274e07a7e43da739a2458b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:15.675789 6456 raft_consensus.cc:740] T 6a2564a99c274e07a7e43da739a2458b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:15.676011 6456 consensus_queue.cc:260] T 6a2564a99c274e07a7e43da739a2458b P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.676646 6456 ts_tablet_manager.cc:1434] T 6a2564a99c274e07a7e43da739a2458b P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:50:15.658042 6183 tablet_service.cc:1511] Processing CreateTablet for tablet f6a489aba98940fd888b9cc79a3a0b68 (DEFAULT_TABLE table=default.Table_7ef4fde492124fa28e7089765bab36d9 [id=2b1494b2d6884994bd4f6e885202e3f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.658341 6171 tablet_service.cc:1511] Processing CreateTablet for tablet d6834a3e535e4b56bea863106425df37 (DEFAULT_TABLE table=default.Table_dd06a0c334dc4439af02958dd0b12a29 [id=4d7c388b036641d0a7907fdab45c6b35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.658607 6178 tablet_service.cc:1511] Processing CreateTablet for tablet b0ddcbe6166a4a2cb89cb60b3d8458fb (DEFAULT_TABLE table=default.Table_e73bff7f81754cd69de0a927b79aa09a [id=3d69b12598b2419fa6b5bfdcde469d88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.663657 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet ba4e9fee05994c0d8e7d1f21788280d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:15.667299 6459 ts_tablet_manager.cc:1929] T 1c26a2863fdd4912b6d357877af1eb42 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:15.678287 6459 log.cc:1199] T 1c26a2863fdd4912b6d357877af1eb42 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/1c26a2863fdd4912b6d357877af1eb42
I20260923 19:50:15.678406 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6a489aba98940fd888b9cc79a3a0b68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.678679 6459 ts_tablet_manager.cc:1950] T 1c26a2863fdd4912b6d357877af1eb42 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:15.678800 7134 raft_consensus.cc:493] T a01a86b6fd4b44d3808c2040525d7b61 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:15.678918 7134 raft_consensus.cc:515] T a01a86b6fd4b44d3808c2040525d7b61 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.679013 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 669) took 1383 ms. Trace:
I20260923 19:50:15.679080 6459 rpcz_store.cc:276] 0923 19:50:14.295234 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.297363 (+ 2129us) service_pool.cc:224] Handling call
0923 19:50:15.402524 (+1105161us) ts_tablet_manager.cc:1151] Deleting tablet 1c26a2863fdd4912b6d357877af1eb42
0923 19:50:15.402534 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.568681 (+166147us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.667238 (+ 98557us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.678997 (+ 11759us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1100708}
I20260923 19:50:15.679471 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 675) took 1309 ms. Trace:
I20260923 19:50:15.679502 7134 leader_election.cc:290] T a01a86b6fd4b44d3808c2040525d7b61 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:15.679543 6459 rpcz_store.cc:276] 0923 19:50:14.369640 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.369699 (+ 59us) service_pool.cc:224] Handling call
0923 19:50:15.679359 (+1309660us) ts_tablet_manager.cc:1151] Deleting tablet 92f94b93d1364bb1a2562eb577707cf1
0923 19:50:15.679369 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.679456 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1293062}
I20260923 19:50:15.679790 6459 tablet_replica.cc:333] T f1a4bccf6dd2411f83b86d782ecf5f40 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:15.679970 6459 raft_consensus.cc:2243] T f1a4bccf6dd2411f83b86d782ecf5f40 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:15.680135 6459 raft_consensus.cc:2272] T f1a4bccf6dd2411f83b86d782ecf5f40 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:15.681384 6308 tablet_service.cc:1558] Processing DeleteTablet for tablet 22c89609da884c47b1dbc1470b37efbe with delete_type TABLET_DATA_DELETED (replaced by tablet 295502f94faf4d4880e9516aa8d9cb79) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:15.682853 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0ddcbe6166a4a2cb89cb60b3d8458fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.682890 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01a86b6fd4b44d3808c2040525d7b61" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:15.682992 6456 tablet_bootstrap.cc:492] T d09faa67bdc54d31a7f7a1b012de9ba1 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:15.683183 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01a86b6fd4b44d3808c2040525d7b61" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:15.684211 5996 leader_election.cc:343] T a01a86b6fd4b44d3808c2040525d7b61 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:15.684376 6171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6834a3e535e4b56bea863106425df37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.684628 6456 tablet_bootstrap.cc:654] T d09faa67bdc54d31a7f7a1b012de9ba1 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:15.685904 6459 ts_tablet_manager.cc:1916] T f1a4bccf6dd2411f83b86d782ecf5f40 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:15.687456 6308 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a2564a99c274e07a7e43da739a2458b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:15.688112 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 1c26a2863fdd4912b6d357877af1eb42 (table default.Table_53ff161409a94c28a2d7f0a67a6eb839 [id=b3a6838530c74581b0b5afbca24f80ad]) successfully deleted
W20260923 19:50:15.688335 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 92f94b93d1364bb1a2562eb577707cf1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 92f94b93d1364bb1a2562eb577707cf1 already in progress: creating tablet
W20260923 19:50:15.688673 5995 leader_election.cc:343] T a01a86b6fd4b44d3808c2040525d7b61 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:15.688786 5995 leader_election.cc:304] T a01a86b6fd4b44d3808c2040525d7b61 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:15.689203 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet 5494818771f04f92b37a6991b73e40a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:15.689441 7134 raft_consensus.cc:2749] T a01a86b6fd4b44d3808c2040525d7b61 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:15.689958 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet 22c89609da884c47b1dbc1470b37efbe with delete_type TABLET_DATA_DELETED (replaced by tablet 295502f94faf4d4880e9516aa8d9cb79) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:15.691203 7352 raft_consensus.cc:493] T 66739afdf147413787acb0363aa37df6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:15.691329 7352 raft_consensus.cc:515] T 66739afdf147413787acb0363aa37df6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.691874 7352 leader_election.cc:290] T 66739afdf147413787acb0363aa37df6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:15.692524 6308 tablet_service.cc:1511] Processing CreateTablet for tablet b0ddcbe6166a4a2cb89cb60b3d8458fb (DEFAULT_TABLE table=default.Table_e73bff7f81754cd69de0a927b79aa09a [id=3d69b12598b2419fa6b5bfdcde469d88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.692878 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0ddcbe6166a4a2cb89cb60b3d8458fb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:15.698366 6279 leader_election.cc:343] T 66739afdf147413787acb0363aa37df6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 66739afdf147413787acb0363aa37df6
I20260923 19:50:15.699739 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66739afdf147413787acb0363aa37df6" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:15.700275 6280 leader_election.cc:343] T 66739afdf147413787acb0363aa37df6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:15.700371 6280 leader_election.cc:304] T 66739afdf147413787acb0363aa37df6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:15.700682 7352 raft_consensus.cc:2749] T 66739afdf147413787acb0363aa37df6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:15.707721 6458 ts_tablet_manager.cc:1929] T f1a4bccf6dd2411f83b86d782ecf5f40 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:15.707839 6458 log.cc:1199] T f1a4bccf6dd2411f83b86d782ecf5f40 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/f1a4bccf6dd2411f83b86d782ecf5f40
I20260923 19:50:15.708180 6458 ts_tablet_manager.cc:1950] T f1a4bccf6dd2411f83b86d782ecf5f40 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:15.710758 6454 tablet_bootstrap.cc:492] T 2ccfe6531fc44f86a0edc8bda1547442 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:15.710947 6454 ts_tablet_manager.cc:1403] T 2ccfe6531fc44f86a0edc8bda1547442 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.066s user 0.003s sys 0.004s
I20260923 19:50:15.710986 6178 tablet_service.cc:1511] Processing CreateTablet for tablet db943a36b2fe4ca9813e08ddb38ce7f6 (DEFAULT_TABLE table=default.Table_649d6f0a403747c38f6b0f9b6ed91fdf [id=e4b5c3517d5f489688184ef9f66153c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.711355 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db943a36b2fe4ca9813e08ddb38ce7f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.711856 6454 raft_consensus.cc:359] T 2ccfe6531fc44f86a0edc8bda1547442 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.712083 6454 raft_consensus.cc:385] T 2ccfe6531fc44f86a0edc8bda1547442 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:15.712180 6454 raft_consensus.cc:740] T 2ccfe6531fc44f86a0edc8bda1547442 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:15.712507 7316 raft_consensus.cc:493] T ba4e9fee05994c0d8e7d1f21788280d3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:15.712611 7316 raft_consensus.cc:515] T ba4e9fee05994c0d8e7d1f21788280d3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.713187 7316 leader_election.cc:290] T ba4e9fee05994c0d8e7d1f21788280d3 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:15.716043 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 8788f1917cb0449f84f92df2c81feff6
I20260923 19:50:15.716759 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 8b4c2a0ae64841c6971a0840c1d5b739
I20260923 19:50:15.717832 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 900726a4f2f84dde90e8bb3ab26b71c9
I20260923 19:50:15.718432 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 633) took 1740 ms. Trace:
I20260923 19:50:15.718480 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 950428e098994f2a9b5b17eeb36915cd
I20260923 19:50:15.718521 6458 rpcz_store.cc:276] 0923 19:50:13.978212 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:13.978439 (+ 227us) service_pool.cc:224] Handling call
0923 19:50:15.595578 (+1617139us) ts_tablet_manager.cc:1151] Deleting tablet f1a4bccf6dd2411f83b86d782ecf5f40
0923 19:50:15.595588 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.704807 (+109219us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.707673 (+ 2866us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.718408 (+ 10735us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1616873}
I20260923 19:50:15.718940 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 637) took 1654 ms. Trace:
I20260923 19:50:15.719007 6458 rpcz_store.cc:276] 0923 19:50:14.064277 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.064364 (+ 87us) service_pool.cc:224] Handling call
0923 19:50:15.718801 (+1654437us) ts_tablet_manager.cc:1151] Deleting tablet 2e1c19a751904a6295897376e9c5ee56
0923 19:50:15.718811 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.718922 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1654119}
W20260923 19:50:15.719903 6137 leader_election.cc:343] T ba4e9fee05994c0d8e7d1f21788280d3 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: ba4e9fee05994c0d8e7d1f21788280d3
I20260923 19:50:15.720484 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet f1a4bccf6dd2411f83b86d782ecf5f40 (table default.Table_fcbdddfc239041ae96611a78df2b3303 [id=24fd12b0465443c58bca97fcfea1f1d3]) successfully deleted
W20260923 19:50:15.722232 6139 leader_election.cc:343] T ba4e9fee05994c0d8e7d1f21788280d3 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: ba4e9fee05994c0d8e7d1f21788280d3
I20260923 19:50:15.722332 6139 leader_election.cc:304] T ba4e9fee05994c0d8e7d1f21788280d3 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:15.722764 7316 raft_consensus.cc:2749] T ba4e9fee05994c0d8e7d1f21788280d3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:15.724046 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet 900726a4f2f84dde90e8bb3ab26b71c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:15.724092 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet 8788f1917cb0449f84f92df2c81feff6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:15.724251 6171 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b4c2a0ae64841c6971a0840c1d5b739 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:15.724611 6179 tablet_service.cc:1511] Processing CreateTablet for tablet 5611eb05cb674c8ba7ae0066b9187c8d (DEFAULT_TABLE table=default.Table_0e1d50c965e94124b683e41abf852dfa [id=89c2332df8f24a49818750f30e86d772]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.725160 6171 tablet_service.cc:1558] Processing DeleteTablet for tablet 950428e098994f2a9b5b17eeb36915cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:15.725721 6171 tablet_service.cc:1511] Processing CreateTablet for tablet 5ce73f31a1f64a24835a272fea8d65c4 (DEFAULT_TABLE table=default.Table_af2e4e3ea01540f180d3c3b5213da913 [id=7a1c03080dcc484ebe1b2743a8e1c6ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.726768 6454 consensus_queue.cc:260] T 2ccfe6531fc44f86a0edc8bda1547442 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.727033 6167 tablet_service.cc:1511] Processing CreateTablet for tablet af261be0221647adb3a14c558ea3f003 (DEFAULT_TABLE table=default.Table_9ebd650e625041a897b52b9d151b4ada [id=4f37702e7c2d40c998bf80c7597db839]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.727900 6457 tablet_bootstrap.cc:492] T ed9fb0cab0bd43b7a05d7376125b187e P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:15.728226 6457 ts_tablet_manager.cc:1403] T ed9fb0cab0bd43b7a05d7376125b187e P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.144s user 0.005s sys 0.005s
I20260923 19:50:15.729197 6454 ts_tablet_manager.cc:1434] T 2ccfe6531fc44f86a0edc8bda1547442 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
I20260923 19:50:15.729859 6454 tablet_bootstrap.cc:492] T f5cb8dd5dcf54df9989dd808fe148ce6 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:15.730881 6457 raft_consensus.cc:359] T ed9fb0cab0bd43b7a05d7376125b187e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.731287 6457 raft_consensus.cc:385] T ed9fb0cab0bd43b7a05d7376125b187e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:15.731423 6457 raft_consensus.cc:740] T ed9fb0cab0bd43b7a05d7376125b187e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:15.731913 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ccfe6531fc44f86a0edc8bda1547442 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:02 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:15.734395 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet 22c89609da884c47b1dbc1470b37efbe with delete_type TABLET_DATA_DELETED (replaced by tablet 295502f94faf4d4880e9516aa8d9cb79) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:15.734743 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 5494818771f04f92b37a6991b73e40a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:15.721064 6310 tablet_service.cc:1558] Processing DeleteTablet for tablet 8788f1917cb0449f84f92df2c81feff6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:15.721192 6317 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b4c2a0ae64841c6971a0840c1d5b739 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:15.721201 6308 tablet_service.cc:1558] Processing DeleteTablet for tablet 900726a4f2f84dde90e8bb3ab26b71c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:15.721365 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 950428e098994f2a9b5b17eeb36915cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:15.721748 6318 tablet_service.cc:1511] Processing CreateTablet for tablet db943a36b2fe4ca9813e08ddb38ce7f6 (DEFAULT_TABLE table=default.Table_649d6f0a403747c38f6b0f9b6ed91fdf [id=e4b5c3517d5f489688184ef9f66153c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.735862 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet 8788f1917cb0449f84f92df2c81feff6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:15.735976 6318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db943a36b2fe4ca9813e08ddb38ce7f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.736629 6325 tablet_service.cc:1511] Processing CreateTablet for tablet af261be0221647adb3a14c558ea3f003 (DEFAULT_TABLE table=default.Table_9ebd650e625041a897b52b9d151b4ada [id=4f37702e7c2d40c998bf80c7597db839]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.736547 6028 tablet_service.cc:1511] Processing CreateTablet for tablet b0ddcbe6166a4a2cb89cb60b3d8458fb (DEFAULT_TABLE table=default.Table_e73bff7f81754cd69de0a927b79aa09a [id=3d69b12598b2419fa6b5bfdcde469d88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.736946 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af261be0221647adb3a14c558ea3f003. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.737282 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0ddcbe6166a4a2cb89cb60b3d8458fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.738580 6454 tablet_bootstrap.cc:654] T f5cb8dd5dcf54df9989dd808fe148ce6 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:15.721710 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 5611eb05cb674c8ba7ae0066b9187c8d (DEFAULT_TABLE table=default.Table_0e1d50c965e94124b683e41abf852dfa [id=89c2332df8f24a49818750f30e86d772]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.740823 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5611eb05cb674c8ba7ae0066b9187c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.744118 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 9603acbedc27465eab5a8146fed41587 (DEFAULT_TABLE table=default.Table_8ff522cbded24ea9a5c6976986574fcb [id=e50a0e9d0de54b87814a81ff8435fd61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.744771 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 656973919c49460b9eb4b3e4cbd34c5b (DEFAULT_TABLE table=default.Table_bc31ee87b22a4ca3abd012dcddaa9ff8 [id=214d63d8f1674d30af105fc24e9b0408]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.721710 6313 tablet_service.cc:1511] Processing CreateTablet for tablet 5ce73f31a1f64a24835a272fea8d65c4 (DEFAULT_TABLE table=default.Table_af2e4e3ea01540f180d3c3b5213da913 [id=7a1c03080dcc484ebe1b2743a8e1c6ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.722030 6321 tablet_service.cc:1511] Processing CreateTablet for tablet 656973919c49460b9eb4b3e4cbd34c5b (DEFAULT_TABLE table=default.Table_bc31ee87b22a4ca3abd012dcddaa9ff8 [id=214d63d8f1674d30af105fc24e9b0408]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.746309 6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce73f31a1f64a24835a272fea8d65c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.746572 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 656973919c49460b9eb4b3e4cbd34c5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.746891 6459 ts_tablet_manager.cc:1929] T f1a4bccf6dd2411f83b86d782ecf5f40 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:15.747375 6459 log.cc:1199] T f1a4bccf6dd2411f83b86d782ecf5f40 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/f1a4bccf6dd2411f83b86d782ecf5f40
I20260923 19:50:15.750597 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 9603acbedc27465eab5a8146fed41587 (DEFAULT_TABLE table=default.Table_8ff522cbded24ea9a5c6976986574fcb [id=e50a0e9d0de54b87814a81ff8435fd61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.727182 6456 tablet_bootstrap.cc:492] T d09faa67bdc54d31a7f7a1b012de9ba1 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:15.751562 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9603acbedc27465eab5a8146fed41587. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.752220 6456 ts_tablet_manager.cc:1403] T d09faa67bdc54d31a7f7a1b012de9ba1 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.069s user 0.001s sys 0.002s
I20260923 19:50:15.752656 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b4c2a0ae64841c6971a0840c1d5b739 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:15.754474 6034 tablet_service.cc:1511] Processing CreateTablet for tablet db943a36b2fe4ca9813e08ddb38ce7f6 (DEFAULT_TABLE table=default.Table_649d6f0a403747c38f6b0f9b6ed91fdf [id=e4b5c3517d5f489688184ef9f66153c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.755275 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db943a36b2fe4ca9813e08ddb38ce7f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.756201 6456 raft_consensus.cc:359] T d09faa67bdc54d31a7f7a1b012de9ba1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.756875 6456 raft_consensus.cc:385] T d09faa67bdc54d31a7f7a1b012de9ba1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:15.757140 6456 raft_consensus.cc:740] T d09faa67bdc54d31a7f7a1b012de9ba1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:15.758010 6456 consensus_queue.cc:260] T d09faa67bdc54d31a7f7a1b012de9ba1 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.760337 6456 ts_tablet_manager.cc:1434] T d09faa67bdc54d31a7f7a1b012de9ba1 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260923 19:50:15.760578 6459 ts_tablet_manager.cc:1950] T f1a4bccf6dd2411f83b86d782ecf5f40 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:15.760977 6456 tablet_bootstrap.cc:492] T 2ce6378a6bd844a485aebb96081307e3 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:15.763656 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5611eb05cb674c8ba7ae0066b9187c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.764081 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af261be0221647adb3a14c558ea3f003. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.765301 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9603acbedc27465eab5a8146fed41587. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.770881 6171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce73f31a1f64a24835a272fea8d65c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.771112 6458 tablet_replica.cc:333] T 1c26a2863fdd4912b6d357877af1eb42 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
W20260923 19:50:15.771095 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 2e1c19a751904a6295897376e9c5ee56 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e1c19a751904a6295897376e9c5ee56 already in progress: creating tablet
I20260923 19:50:15.771296 6458 raft_consensus.cc:2243] T 1c26a2863fdd4912b6d357877af1eb42 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:15.771430 6458 raft_consensus.cc:2272] T 1c26a2863fdd4912b6d357877af1eb42 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:15.771912 6458 ts_tablet_manager.cc:1916] T 1c26a2863fdd4912b6d357877af1eb42 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:15.774204 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 656973919c49460b9eb4b3e4cbd34c5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.775048 6031 tablet_service.cc:1558] Processing DeleteTablet for tablet 900726a4f2f84dde90e8bb3ab26b71c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:15.775864 6031 tablet_service.cc:1558] Processing DeleteTablet for tablet 950428e098994f2a9b5b17eeb36915cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:15.776077 7316 consensus_queue.cc:1048] T 58c24aa494bc4da28536dfa1df6123b7 P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:15.776571 7352 raft_consensus.cc:493] T c19298691d5d4209b2d1147a1aad2f6f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:15.776543 6031 tablet_service.cc:1511] Processing CreateTablet for tablet 5611eb05cb674c8ba7ae0066b9187c8d (DEFAULT_TABLE table=default.Table_0e1d50c965e94124b683e41abf852dfa [id=89c2332df8f24a49818750f30e86d772]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.776683 7352 raft_consensus.cc:515] T c19298691d5d4209b2d1147a1aad2f6f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.776886 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5611eb05cb674c8ba7ae0066b9187c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.777266 7352 leader_election.cc:290] T c19298691d5d4209b2d1147a1aad2f6f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:15.777837 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19298691d5d4209b2d1147a1aad2f6f" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:15.778175 6279 leader_election.cc:343] T c19298691d5d4209b2d1147a1aad2f6f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: c19298691d5d4209b2d1147a1aad2f6f
W20260923 19:50:15.778335 6280 leader_election.cc:343] T c19298691d5d4209b2d1147a1aad2f6f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:15.778430 6280 leader_election.cc:304] T c19298691d5d4209b2d1147a1aad2f6f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:15.778762 7352 raft_consensus.cc:2749] T c19298691d5d4209b2d1147a1aad2f6f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:15.779793 6313 tablet_service.cc:1511] Processing CreateTablet for tablet 91bb82d520b44ae9ad596e41322982f1 (DEFAULT_TABLE table=default.Table_027ffe21cd7e440fa1b288bcb1d393c9 [id=df7503d1f0d0450cb37e687c47d756c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.781208 6321 tablet_service.cc:1558] Processing DeleteTablet for tablet d09faa67bdc54d31a7f7a1b012de9ba1 with delete_type TABLET_DATA_DELETED (replaced by tablet 146a402ff29a4e0b834a9f270d61e21c) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:15.781929 6456 tablet_bootstrap.cc:654] T 2ce6378a6bd844a485aebb96081307e3 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:15.782825 6179 tablet_service.cc:1511] Processing CreateTablet for tablet 91bb82d520b44ae9ad596e41322982f1 (DEFAULT_TABLE table=default.Table_027ffe21cd7e440fa1b288bcb1d393c9 [id=df7503d1f0d0450cb37e687c47d756c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.783310 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91bb82d520b44ae9ad596e41322982f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.783818 6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91bb82d520b44ae9ad596e41322982f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.784413 6031 tablet_service.cc:1511] Processing CreateTablet for tablet 5ce73f31a1f64a24835a272fea8d65c4 (DEFAULT_TABLE table=default.Table_af2e4e3ea01540f180d3c3b5213da913 [id=7a1c03080dcc484ebe1b2743a8e1c6ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.784778 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce73f31a1f64a24835a272fea8d65c4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:15.791033 6137 consensus_peers.cc:597] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d2298d814a104f5cb62196be3bf0dae6. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:15.791625 6456 tablet_bootstrap.cc:492] T 2ce6378a6bd844a485aebb96081307e3 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:15.791747 6456 ts_tablet_manager.cc:1403] T 2ce6378a6bd844a485aebb96081307e3 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.002s
I20260923 19:50:15.792421 6456 raft_consensus.cc:359] T 2ce6378a6bd844a485aebb96081307e3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.792626 6456 raft_consensus.cc:385] T 2ce6378a6bd844a485aebb96081307e3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:15.792689 6456 raft_consensus.cc:740] T 2ce6378a6bd844a485aebb96081307e3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:15.792896 6456 consensus_queue.cc:260] T 2ce6378a6bd844a485aebb96081307e3 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.795701 6454 tablet_bootstrap.cc:492] T f5cb8dd5dcf54df9989dd808fe148ce6 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:15.795833 6454 ts_tablet_manager.cc:1403] T f5cb8dd5dcf54df9989dd808fe148ce6 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.066s user 0.003s sys 0.007s
I20260923 19:50:15.796506 6454 raft_consensus.cc:359] T f5cb8dd5dcf54df9989dd808fe148ce6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.796663 6454 raft_consensus.cc:385] T f5cb8dd5dcf54df9989dd808fe148ce6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:15.796717 6454 raft_consensus.cc:740] T f5cb8dd5dcf54df9989dd808fe148ce6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:15.796912 6454 consensus_queue.cc:260] T f5cb8dd5dcf54df9989dd808fe148ce6 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.798090 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 676) took 1312 ms. Trace:
I20260923 19:50:15.798229 6459 rpcz_store.cc:276] 0923 19:50:14.485166 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.485212 (+ 46us) service_pool.cc:224] Handling call
0923 19:50:15.679750 (+1194538us) ts_tablet_manager.cc:1151] Deleting tablet f1a4bccf6dd2411f83b86d782ecf5f40
0923 19:50:15.679758 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.688795 (+ 9037us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.746623 (+ 57828us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.783486 (+ 36863us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1194371}
I20260923 19:50:15.798656 6459 tablet_replica.cc:333] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:15.798794 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet f1a4bccf6dd2411f83b86d782ecf5f40 (table default.Table_fcbdddfc239041ae96611a78df2b3303 [id=24fd12b0465443c58bca97fcfea1f1d3]) successfully deleted
I20260923 19:50:15.798894 6459 raft_consensus.cc:2243] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:15.799142 6459 pending_rounds.cc:70] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:15.799975 6459 pending_rounds.cc:77] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630589354643456 op_type: NO_OP noop_request { }
I20260923 19:50:15.800529 6459 raft_consensus.cc:2889] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:15.801842 6321 tablet_service.cc:1511] Processing CreateTablet for tablet c500791905944480840c25929bc7bbe1 (DEFAULT_TABLE table=default.Table_546176a528e34e3488adcb2f3ee2b4e2 [id=709a057f75f6438bbc231ff7f446e022]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.802263 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c500791905944480840c25929bc7bbe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.804414 6456 ts_tablet_manager.cc:1434] T 2ce6378a6bd844a485aebb96081307e3 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.013s user 0.000s sys 0.002s
I20260923 19:50:15.804687 6456 tablet_bootstrap.cc:492] T a11ecef9a24f4e4a812ec220b6a92cc4 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
W20260923 19:50:15.805287 6280 consensus_peers.cc:597] T 86388fa08c454da9ad2ca0124dcba10b P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:15.806857 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 656973919c49460b9eb4b3e4cbd34c5b (DEFAULT_TABLE table=default.Table_bc31ee87b22a4ca3abd012dcddaa9ff8 [id=214d63d8f1674d30af105fc24e9b0408]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.806985 6458 ts_tablet_manager.cc:1929] T 1c26a2863fdd4912b6d357877af1eb42 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:15.807240 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 656973919c49460b9eb4b3e4cbd34c5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.807276 6456 tablet_bootstrap.cc:654] T a11ecef9a24f4e4a812ec220b6a92cc4 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:15.808450 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_3cfe796a43654c54be5f70f57774c2fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:15.809019 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3cfe796a43654c54be5f70f57774c2fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:15.803030 6171 tablet_service.cc:1558] Processing DeleteTablet for tablet f5cb8dd5dcf54df9989dd808fe148ce6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:15.810145 6459 raft_consensus.cc:2272] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:15.803882 6454 ts_tablet_manager.cc:1434] T f5cb8dd5dcf54df9989dd808fe148ce6 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
W20260923 19:50:15.815552 6137 consensus_peers.cc:597] T 896bd068e6b343e48eb2a01679b49326 P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 896bd068e6b343e48eb2a01679b49326. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:15.815976 6458 log.cc:1199] T 1c26a2863fdd4912b6d357877af1eb42 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/1c26a2863fdd4912b6d357877af1eb42
I20260923 19:50:15.816651 6458 ts_tablet_manager.cc:1950] T 1c26a2863fdd4912b6d357877af1eb42 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:15.817085 6459 ts_tablet_manager.cc:1916] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:15.820221 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 639) took 1721 ms. Trace:
I20260923 19:50:15.823257 6454 tablet_bootstrap.cc:492] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:15.824270 6458 rpcz_store.cc:276] 0923 19:50:14.098326 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.098421 (+ 95us) service_pool.cc:224] Handling call
0923 19:50:15.770741 (+1672320us) ts_tablet_manager.cc:1151] Deleting tablet 1c26a2863fdd4912b6d357877af1eb42
0923 19:50:15.770752 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.787554 (+ 16802us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.806938 (+ 19384us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.820201 (+ 13263us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1671653}
I20260923 19:50:15.825798 5797 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 2ce6378a6bd844a485aebb96081307e3 (table default.Table_4d1a0d71d11f4c0a8c80b3ba7ea0c358 [id=ef9a6c259ceb4c189c8902a776fb3bfa]). Expected version 1 got 0
I20260923 19:50:15.826323 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 1c26a2863fdd4912b6d357877af1eb42 (table default.Table_53ff161409a94c28a2d7f0a67a6eb839 [id=b3a6838530c74581b0b5afbca24f80ad]) successfully deleted
I20260923 19:50:15.826542 7134 raft_consensus.cc:493] T c7369a5fc87f4b70bcfbe052ef021771 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:15.826735 6458 tablet_replica.cc:333] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:15.826689 7134 raft_consensus.cc:515] T c7369a5fc87f4b70bcfbe052ef021771 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.826918 6458 raft_consensus.cc:2243] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:15.827348 7134 leader_election.cc:290] T c7369a5fc87f4b70bcfbe052ef021771 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:15.827059 6458 raft_consensus.cc:2272] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:15.827912 6458 ts_tablet_manager.cc:1916] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:15.827940 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7369a5fc87f4b70bcfbe052ef021771" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:15.828526 5995 leader_election.cc:343] T c7369a5fc87f4b70bcfbe052ef021771 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:15.828749 6454 tablet_bootstrap.cc:654] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:15.827960 6171 tablet_service.cc:1511] Processing CreateTablet for tablet 8c171a08e5104dd8b87bf759238d5655 (DEFAULT_TABLE table=default.Table_8df2759da2014f54b7c9979eebb709a3 [id=359a2f35c9ee4e68a991334b4cd66ca9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.805380 6179 tablet_service.cc:1511] Processing CreateTablet for tablet c500791905944480840c25929bc7bbe1 (DEFAULT_TABLE table=default.Table_546176a528e34e3488adcb2f3ee2b4e2 [id=709a057f75f6438bbc231ff7f446e022]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.829293 6171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c171a08e5104dd8b87bf759238d5655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.829849 6311 tablet_service.cc:1511] Processing CreateTablet for tablet e1178b26b95b41babd12b9b8b5bdbd6e (DEFAULT_TABLE table=default.Table_232922d4519b432994b66a52cd54123c [id=f465f2caf6544a0ab7eda8fe4a377572]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.830214 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1178b26b95b41babd12b9b8b5bdbd6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.830371 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c500791905944480840c25929bc7bbe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.830430 6321 tablet_service.cc:1511] Processing CreateTablet for tablet 8c171a08e5104dd8b87bf759238d5655 (DEFAULT_TABLE table=default.Table_8df2759da2014f54b7c9979eebb709a3 [id=359a2f35c9ee4e68a991334b4cd66ca9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.830721 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c171a08e5104dd8b87bf759238d5655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.834182 6167 tablet_service.cc:1511] Processing CreateTablet for tablet e1178b26b95b41babd12b9b8b5bdbd6e (DEFAULT_TABLE table=default.Table_232922d4519b432994b66a52cd54123c [id=f465f2caf6544a0ab7eda8fe4a377572]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.834532 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1178b26b95b41babd12b9b8b5bdbd6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.839164 6325 tablet_service.cc:1511] Processing CreateTablet for tablet ed943ce02a6a468399e37693c3980780 (DEFAULT_TABLE table=default.Table_1aa0de1bec54443186e5e99d279be98e [id=f01065abde4f4cfe8fa4088574f08588]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.839484 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed943ce02a6a468399e37693c3980780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.839479 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7369a5fc87f4b70bcfbe052ef021771" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:15.840346 5996 leader_election.cc:343] T c7369a5fc87f4b70bcfbe052ef021771 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:15.840494 5996 leader_election.cc:304] T c7369a5fc87f4b70bcfbe052ef021771 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:15.840948 7134 raft_consensus.cc:2749] T c7369a5fc87f4b70bcfbe052ef021771 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:15.843225 6171 tablet_service.cc:1511] Processing CreateTablet for tablet 16954e4999af443d8d91b234d8891df2 (DEFAULT_TABLE table=default.Table_20d2e475e3e744f99e0ab5cd2f094310 [id=bfb7a2df6de64945896d7d7da1cee369]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.843578 6171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16954e4999af443d8d91b234d8891df2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.846665 6456 tablet_bootstrap.cc:492] T a11ecef9a24f4e4a812ec220b6a92cc4 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:15.846872 6456 ts_tablet_manager.cc:1403] T a11ecef9a24f4e4a812ec220b6a92cc4 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.042s user 0.003s sys 0.003s
I20260923 19:50:15.847858 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 16954e4999af443d8d91b234d8891df2 (DEFAULT_TABLE table=default.Table_20d2e475e3e744f99e0ab5cd2f094310 [id=bfb7a2df6de64945896d7d7da1cee369]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.848243 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16954e4999af443d8d91b234d8891df2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.731854 6457 consensus_queue.cc:260] T ed9fb0cab0bd43b7a05d7376125b187e P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.855453 6313 tablet_service.cc:1511] Processing CreateTablet for tablet ebc9dca1c228493a9dbaca4dd777d983 (DEFAULT_TABLE table=default.Table_b0aaf57c3ec9414f89529017165bc65b [id=84b65375453448aebd9bce135f58bd90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.856585 6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebc9dca1c228493a9dbaca4dd777d983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.856773 6183 tablet_service.cc:1511] Processing CreateTablet for tablet cabd3b2034664a5893bd6b084ee064e9 (DEFAULT_TABLE table=default.Table_96ab135786f74ab697bb37601c264ece [id=dc6240941b87434aa6037a3f08689920]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.856895 6457 ts_tablet_manager.cc:1434] T ed9fb0cab0bd43b7a05d7376125b187e P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.128s user 0.003s sys 0.000s
I20260923 19:50:15.857092 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cabd3b2034664a5893bd6b084ee064e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.859383 6457 tablet_bootstrap.cc:492] T b18548ba557f448880c5e617fc03cbe0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:15.859575 6454 tablet_bootstrap.cc:492] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:15.859687 6454 ts_tablet_manager.cc:1403] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.003s
I20260923 19:50:15.860383 6454 raft_consensus.cc:359] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.860553 6454 raft_consensus.cc:385] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:15.860607 6454 raft_consensus.cc:740] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:15.860823 6454 consensus_queue.cc:260] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.861194 6457 tablet_bootstrap.cc:654] T b18548ba557f448880c5e617fc03cbe0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:15.861554 6454 ts_tablet_manager.cc:1434] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:15.862764 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_270206b5f7c84a6c96de1d66a4c6ce54"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:15.863302 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_270206b5f7c84a6c96de1d66a4c6ce54 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:15.864861 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_c1c26750ec3d49c3b1144b79fa4089cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:15.865279 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c1c26750ec3d49c3b1144b79fa4089cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:15.865635 7362 raft_consensus.cc:493] T b92aaac328934d95a89e0fc08a80b0b1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:15.865634 7316 consensus_queue.cc:1048] T 896bd068e6b343e48eb2a01679b49326 P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:15.865761 7362 raft_consensus.cc:515] T b92aaac328934d95a89e0fc08a80b0b1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.866344 7362 leader_election.cc:290] T b92aaac328934d95a89e0fc08a80b0b1 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:15.867697 6456 raft_consensus.cc:359] T a11ecef9a24f4e4a812ec220b6a92cc4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:15.869480 6279 leader_election.cc:343] T b92aaac328934d95a89e0fc08a80b0b1 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: b92aaac328934d95a89e0fc08a80b0b1
I20260923 19:50:15.870260 6456 raft_consensus.cc:385] T a11ecef9a24f4e4a812ec220b6a92cc4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:15.870324 6456 raft_consensus.cc:740] T a11ecef9a24f4e4a812ec220b6a92cc4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:15.870697 6456 consensus_queue.cc:260] T a11ecef9a24f4e4a812ec220b6a92cc4 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.871582 6456 ts_tablet_manager.cc:1434] T a11ecef9a24f4e4a812ec220b6a92cc4 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.025s user 0.001s sys 0.001s
I20260923 19:50:15.872624 6178 tablet_service.cc:1511] Processing CreateTablet for tablet ed943ce02a6a468399e37693c3980780 (DEFAULT_TABLE table=default.Table_1aa0de1bec54443186e5e99d279be98e [id=f01065abde4f4cfe8fa4088574f08588]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.876087 6456 tablet_bootstrap.cc:492] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:15.877803 6454 tablet_bootstrap.cc:492] T 7e41501bf01e4765853c27e4cac21e2b P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:15.878810 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92aaac328934d95a89e0fc08a80b0b1" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:15.879813 6313 tablet_service.cc:1511] Processing CreateTablet for tablet cabd3b2034664a5893bd6b084ee064e9 (DEFAULT_TABLE table=default.Table_96ab135786f74ab697bb37601c264ece [id=dc6240941b87434aa6037a3f08689920]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.880375 6181 tablet_service.cc:1511] Processing CreateTablet for tablet 7270540a7d724159ae7a2c2cb3473580 (DEFAULT_TABLE table=default.Table_507609d3544d468ebf6218237ccce644 [id=6b50c65d4d0a4dc59cf22187b21303d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.880774 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 7270540a7d724159ae7a2c2cb3473580 (DEFAULT_TABLE table=default.Table_507609d3544d468ebf6218237ccce644 [id=6b50c65d4d0a4dc59cf22187b21303d0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:15.880877 6280 leader_election.cc:343] T b92aaac328934d95a89e0fc08a80b0b1 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:15.881011 6280 leader_election.cc:304] T b92aaac328934d95a89e0fc08a80b0b1 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:15.881297 6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cabd3b2034664a5893bd6b084ee064e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.881381 6456 tablet_bootstrap.cc:654] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:15.881358 7362 raft_consensus.cc:2749] T b92aaac328934d95a89e0fc08a80b0b1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:15.882053 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7270540a7d724159ae7a2c2cb3473580. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.884053 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7270540a7d724159ae7a2c2cb3473580. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.884624 6175 tablet_service.cc:1558] Processing DeleteTablet for tablet 908596339b2e4f7f8ddb7f9cd5bdcc3e with delete_type TABLET_DATA_DELETED (replaced by tablet 688bb1055ba94c2996cdfea6dea76416) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:15.885524 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f276fef2266243f0add02a76de24e3c6" } new_table_name: "default.Table_fd23b34609244c098737c8f88587ce5f" modify_external_catalogs: true
I20260923 19:50:15.888638 5797 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7ddfd6e3bbc7414e84d2785f412ed18f" } new_table_name: "default.Table_8d86008813f549ba8c339eb52051c506" modify_external_catalogs: true
I20260923 19:50:15.889186 5798 master_service.cc:960] ReplaceTablet: received request to replace tablet f9687b3f4b904e438d83533fb67cc92f from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:15.891492 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7af64af6dab645518765ddc326d8b537" } new_table_name: "default.Table_105f26b7d508479ab5114c279aca4dfb" modify_external_catalogs: true
I20260923 19:50:15.891825 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_7c503dc2bcda44d0b99f66019026968d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:15.892210 5804 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_8ab9cdc2d4a14b679b8c38c86766c132" } new_table_name: "default.Table_1f1e14e95be64e1cbd372b6b4a741546" modify_external_catalogs: true
W20260923 19:50:15.892370 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c503dc2bcda44d0b99f66019026968d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:15.893978 5796 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_504bdbe9702948d58b4f958360a2040b" } new_table_name: "default.Table_20e578ee9e57408c9a54cc2ac08af6e2" modify_external_catalogs: true
I20260923 19:50:15.894277 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_98bbea51f78c4eb6872b30a01002be31"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:15.894774 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_98bbea51f78c4eb6872b30a01002be31 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:15.895179 7362 raft_consensus.cc:493] T 6a2564a99c274e07a7e43da739a2458b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:15.895301 7362 raft_consensus.cc:515] T 6a2564a99c274e07a7e43da739a2458b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.895898 7362 leader_election.cc:290] T 6a2564a99c274e07a7e43da739a2458b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:15.895852 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_9eb8348988b14a1e8b36839078e0f2d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:15.896293 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9eb8348988b14a1e8b36839078e0f2d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:15.896425 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2564a99c274e07a7e43da739a2458b" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:15.897119 6280 leader_election.cc:343] T 6a2564a99c274e07a7e43da739a2458b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:15.897450 6279 leader_election.cc:343] T 6a2564a99c274e07a7e43da739a2458b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 6a2564a99c274e07a7e43da739a2458b
I20260923 19:50:15.897538 6279 leader_election.cc:304] T 6a2564a99c274e07a7e43da739a2458b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:15.897624 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_23216d517be14547b1a57de90be93f03"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:15.897856 7362 raft_consensus.cc:2749] T 6a2564a99c274e07a7e43da739a2458b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:15.898208 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_23216d517be14547b1a57de90be93f03 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:15.898281 6461 ts_tablet_manager.cc:1929] T 0d70deeda179486291195476e47a9ae6 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:50:15.898415 6461 log.cc:1199] T 0d70deeda179486291195476e47a9ae6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/0d70deeda179486291195476e47a9ae6
I20260923 19:50:15.903026 6461 ts_tablet_manager.cc:1950] T 0d70deeda179486291195476e47a9ae6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:15.904716 6031 tablet_service.cc:1511] Processing CreateTablet for tablet 91bb82d520b44ae9ad596e41322982f1 (DEFAULT_TABLE table=default.Table_027ffe21cd7e440fa1b288bcb1d393c9 [id=df7503d1f0d0450cb37e687c47d756c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.905202 6037 tablet_service.cc:1511] Processing CreateTablet for tablet c500791905944480840c25929bc7bbe1 (DEFAULT_TABLE table=default.Table_546176a528e34e3488adcb2f3ee2b4e2 [id=709a057f75f6438bbc231ff7f446e022]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.905529 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c500791905944480840c25929bc7bbe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.906210 6027 tablet_service.cc:1511] Processing CreateTablet for tablet e1178b26b95b41babd12b9b8b5bdbd6e (DEFAULT_TABLE table=default.Table_232922d4519b432994b66a52cd54123c [id=f465f2caf6544a0ab7eda8fe4a377572]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.906493 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1178b26b95b41babd12b9b8b5bdbd6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.909641 6026 tablet_service.cc:1511] Processing CreateTablet for tablet 8c171a08e5104dd8b87bf759238d5655 (DEFAULT_TABLE table=default.Table_8df2759da2014f54b7c9979eebb709a3 [id=359a2f35c9ee4e68a991334b4cd66ca9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.909978 6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c171a08e5104dd8b87bf759238d5655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.910372 6458 ts_tablet_manager.cc:1929] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:15.910477 6458 log.cc:1199] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/908596339b2e4f7f8ddb7f9cd5bdcc3e
I20260923 19:50:15.910772 6458 ts_tablet_manager.cc:1950] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:15.911893 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 640) took 1810 ms. Trace:
I20260923 19:50:15.911973 6458 rpcz_store.cc:276] 0923 19:50:14.100981 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.101051 (+ 70us) service_pool.cc:224] Handling call
0923 19:50:15.826681 (+1725630us) ts_tablet_manager.cc:1151] Deleting tablet 908596339b2e4f7f8ddb7f9cd5bdcc3e
0923 19:50:15.826691 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.844419 (+ 17728us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.910315 (+ 65896us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.911874 (+ 1559us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1722303}
I20260923 19:50:15.912345 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 641) took 1803 ms. Trace:
I20260923 19:50:15.912415 6458 rpcz_store.cc:276] 0923 19:50:14.108817 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.108923 (+ 106us) service_pool.cc:224] Handling call
0923 19:50:15.912249 (+1803326us) ts_tablet_manager.cc:1151] Deleting tablet 556b32b8ccd54c439f86b0069e2a5ce0
0923 19:50:15.912260 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.912330 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1802954}
I20260923 19:50:15.912703 6458 tablet_replica.cc:333] T b985acc650334497832cf4505e1b0043 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:15.912885 6458 raft_consensus.cc:2243] T b985acc650334497832cf4505e1b0043 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:15.913017 6458 raft_consensus.cc:2272] T b985acc650334497832cf4505e1b0043 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:15.913460 6458 ts_tablet_manager.cc:1916] T b985acc650334497832cf4505e1b0043 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:15.914065 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 908596339b2e4f7f8ddb7f9cd5bdcc3e (table default.Table_f92387e003d44b0eb22010e7ca6598af [id=1e323f5b380a4af4acc3865649648e12]) successfully deleted
W20260923 19:50:15.914337 5792 catalog_manager.cc:5030] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 556b32b8ccd54c439f86b0069e2a5ce0 because the tablet was not found. No further retry: Not found: Tablet not found: 556b32b8ccd54c439f86b0069e2a5ce0
I20260923 19:50:15.914538 6456 tablet_bootstrap.cc:492] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:15.914671 6456 ts_tablet_manager.cc:1403] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.001s
W20260923 19:50:15.914893 5805 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1497ebe16d1a4eb6afbc1988dddf8951 consensus state has no leader
I20260923 19:50:15.915280 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_7dbacc6620d24105a6e2a2b21c26af26"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:15.915498 6456 raft_consensus.cc:359] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.915656 6456 raft_consensus.cc:385] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:15.915712 6456 raft_consensus.cc:740] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
W20260923 19:50:15.915812 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7dbacc6620d24105a6e2a2b21c26af26 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:15.915898 6456 consensus_queue.cc:260] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.916355 6456 ts_tablet_manager.cc:1434] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:15.916950 6456 tablet_bootstrap.cc:492] T 035abecfbee7474d9dd048f35e28e867 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:15.917433 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_9f11e4333c1242e1bfd461bd7c79a6d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:15.918143 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91bb82d520b44ae9ad596e41322982f1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:15.918133 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f8007918eca14c81947e5999fe13a705 consensus state has no leader
I20260923 19:50:15.918479 6456 tablet_bootstrap.cc:654] T 035abecfbee7474d9dd048f35e28e867 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:15.919204 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f11e4333c1242e1bfd461bd7c79a6d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:15.920218 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_e13bfd92341c4edea1d722b5eba5e696"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:15.920711 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e13bfd92341c4edea1d722b5eba5e696 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:15.922115 5797 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 373506f1b96046a5bf7f2820921b0312 consensus state has no leader
W20260923 19:50:15.922302 5804 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0bf1a426b7dc489ea4d73b117a87e49b consensus state has no leader
I20260923 19:50:15.902197 6028 tablet_service.cc:1511] Processing CreateTablet for tablet af261be0221647adb3a14c558ea3f003 (DEFAULT_TABLE table=default.Table_9ebd650e625041a897b52b9d151b4ada [id=4f37702e7c2d40c998bf80c7597db839]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:15.922528 5796 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 355346dce1954e93874a5cd756be8064 consensus state has no leader
I20260923 19:50:15.922881 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af261be0221647adb3a14c558ea3f003. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.925073 7362 consensus_queue.cc:1048] T 7b455812687f42848df5290d0cdbc312 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:15.926671 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet f9687b3f4b904e438d83533fb67cc92f
I20260923 19:50:15.927309 5798 catalog_manager.cc:6934] ReplaceTablet: tablet f9687b3f4b904e438d83533fb67cc92f deleted and replaced by tablet 115b8a9e79c64e84bc0ee9cdab636b94
I20260923 19:50:15.927592 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet f9687b3f4b904e438d83533fb67cc92f with delete_type TABLET_DATA_DELETED (replaced by tablet 115b8a9e79c64e84bc0ee9cdab636b94) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:15.930140 6313 tablet_service.cc:1558] Processing DeleteTablet for tablet f9687b3f4b904e438d83533fb67cc92f with delete_type TABLET_DATA_DELETED (replaced by tablet 115b8a9e79c64e84bc0ee9cdab636b94) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:15.931674 6459 ts_tablet_manager.cc:1929] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:15.931856 6459 log.cc:1199] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/d2298d814a104f5cb62196be3bf0dae6
I20260923 19:50:15.932276 6459 ts_tablet_manager.cc:1950] T d2298d814a104f5cb62196be3bf0dae6 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:15.935865 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 9603acbedc27465eab5a8146fed41587 (DEFAULT_TABLE table=default.Table_8ff522cbded24ea9a5c6976986574fcb [id=e50a0e9d0de54b87814a81ff8435fd61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.936369 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9603acbedc27465eab5a8146fed41587. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.944144 6454 tablet_bootstrap.cc:654] T 7e41501bf01e4765853c27e4cac21e2b P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:15.932590 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed943ce02a6a468399e37693c3980780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.946388 6027 tablet_service.cc:1511] Processing CreateTablet for tablet ed943ce02a6a468399e37693c3980780 (DEFAULT_TABLE table=default.Table_1aa0de1bec54443186e5e99d279be98e [id=f01065abde4f4cfe8fa4088574f08588]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.947146 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed943ce02a6a468399e37693c3980780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.948920 5805 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 7b455812687f42848df5290d0cdbc312 (table default.Table_e9cc7064dc8e4c6bb9eadb9fc3f33e09 [id=e263e510102443df8fd2b5886fa01053]). Expected version 1 got 0
I20260923 19:50:15.934715 6179 tablet_service.cc:1511] Processing CreateTablet for tablet ebc9dca1c228493a9dbaca4dd777d983 (DEFAULT_TABLE table=default.Table_b0aaf57c3ec9414f89529017165bc65b [id=84b65375453448aebd9bce135f58bd90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:15.949751 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebc9dca1c228493a9dbaca4dd777d983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:15.952596 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 677) took 1459 ms. Trace:
I20260923 19:50:15.952682 6459 rpcz_store.cc:276] 0923 19:50:14.493380 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.493429 (+ 49us) service_pool.cc:224] Handling call
0923 19:50:15.798598 (+1305169us) ts_tablet_manager.cc:1151] Deleting tablet d2298d814a104f5cb62196be3bf0dae6
0923 19:50:15.798610 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.820475 (+ 21865us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.881458 (+ 60983us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.952578 (+ 71120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1304977}
I20260923 19:50:15.953398 6459 tablet_replica.cc:333] T 623052a8c9c2436a828655da6cf6d379 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:15.953583 6459 raft_consensus.cc:2243] T 623052a8c9c2436a828655da6cf6d379 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:15.953747 6459 raft_consensus.cc:2272] T 623052a8c9c2436a828655da6cf6d379 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:15.953632 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet d2298d814a104f5cb62196be3bf0dae6 (table default.Table_69bbed3a902143c0a4fc91ee4cf3fec4 [id=ba1f8e14938e4925b3fc8a8b72002231]) successfully deleted
I20260923 19:50:15.954006 6458 ts_tablet_manager.cc:1929] T b985acc650334497832cf4505e1b0043 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:15.954303 6459 ts_tablet_manager.cc:1916] T 623052a8c9c2436a828655da6cf6d379 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:15.963536 6458 log.cc:1199] T b985acc650334497832cf4505e1b0043 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/b985acc650334497832cf4505e1b0043
W20260923 19:50:15.963630 6279 consensus_peers.cc:597] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0d70deeda179486291195476e47a9ae6. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:15.961679 6313 tablet_service.cc:1558] Processing DeleteTablet for tablet a11ecef9a24f4e4a812ec220b6a92cc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:15.966996 6458 ts_tablet_manager.cc:1950] T b985acc650334497832cf4505e1b0043 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:15.967870 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 645) took 1855 ms. Trace:
I20260923 19:50:15.971037 6456 tablet_bootstrap.cc:492] T 035abecfbee7474d9dd048f35e28e867 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:15.971202 6456 ts_tablet_manager.cc:1403] T 035abecfbee7474d9dd048f35e28e867 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.054s user 0.006s sys 0.002s
I20260923 19:50:15.972067 6456 raft_consensus.cc:359] T 035abecfbee7474d9dd048f35e28e867 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.972255 6456 raft_consensus.cc:385] T 035abecfbee7474d9dd048f35e28e867 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:15.972332 6456 raft_consensus.cc:740] T 035abecfbee7474d9dd048f35e28e867 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:15.972625 6456 consensus_queue.cc:260] T 035abecfbee7474d9dd048f35e28e867 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.973322 6456 ts_tablet_manager.cc:1434] T 035abecfbee7474d9dd048f35e28e867 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:15.973443 6458 rpcz_store.cc:276] 0923 19:50:14.112600 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.112815 (+ 215us) service_pool.cc:224] Handling call
0923 19:50:15.912659 (+1799844us) ts_tablet_manager.cc:1151] Deleting tablet b985acc650334497832cf4505e1b0043
0923 19:50:15.912667 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.936466 (+ 23799us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.953951 (+ 17485us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.967853 (+ 13902us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1799620}
I20260923 19:50:15.974514 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet b985acc650334497832cf4505e1b0043 (table default.Table_0291d1f518d445cda50f5b95a4aee646 [id=4dd6a10e3a9f465f816cc39c3a122468]) successfully deleted
I20260923 19:50:15.973945 6313 tablet_service.cc:1558] Processing DeleteTablet for tablet 58ea466d1b2b40e9b9b4cd5be51f79e0 with delete_type TABLET_DATA_DELETED (replaced by tablet 839bcf991b754f9e95a1dd6c4f826e71) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:15.974120 6456 tablet_bootstrap.cc:492] T efc63a151f6444dfb03c3f15f6f54473 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:15.977986 6456 tablet_bootstrap.cc:654] T efc63a151f6444dfb03c3f15f6f54473 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:15.978956 6458 tablet_replica.cc:333] T f5cb8dd5dcf54df9989dd808fe148ce6 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:15.979849 6458 raft_consensus.cc:2243] T f5cb8dd5dcf54df9989dd808fe148ce6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:15.980067 6458 raft_consensus.cc:2272] T f5cb8dd5dcf54df9989dd808fe148ce6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:15.980643 6458 ts_tablet_manager.cc:1916] T f5cb8dd5dcf54df9989dd808fe148ce6 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:15.981407 5799 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 7b455812687f42848df5290d0cdbc312 (table default.Table_e9cc7064dc8e4c6bb9eadb9fc3f33e09 [id=e263e510102443df8fd2b5886fa01053]). Expected version 1 got 0
I20260923 19:50:15.983407 6313 tablet_service.cc:1558] Processing DeleteTablet for tablet 035abecfbee7474d9dd048f35e28e867 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:07 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:15.985911 6461 tablet_replica.cc:333] T a01a86b6fd4b44d3808c2040525d7b61 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:15.986119 6461 raft_consensus.cc:2243] T a01a86b6fd4b44d3808c2040525d7b61 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:15.986299 6461 raft_consensus.cc:2272] T a01a86b6fd4b44d3808c2040525d7b61 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:15.987852 7362 consensus_queue.cc:1048] T 1fcd1c1bfd2c437a955c34569605a6d4 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:15.988943 6457 tablet_bootstrap.cc:492] T b18548ba557f448880c5e617fc03cbe0 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:15.989758 6457 ts_tablet_manager.cc:1403] T b18548ba557f448880c5e617fc03cbe0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.131s user 0.003s sys 0.003s
I20260923 19:50:15.990549 6457 raft_consensus.cc:359] T b18548ba557f448880c5e617fc03cbe0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.990927 6459 ts_tablet_manager.cc:1929] T 623052a8c9c2436a828655da6cf6d379 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:15.991458 6457 raft_consensus.cc:385] T b18548ba557f448880c5e617fc03cbe0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:15.991617 6459 log.cc:1199] T 623052a8c9c2436a828655da6cf6d379 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/623052a8c9c2436a828655da6cf6d379
I20260923 19:50:15.991961 6459 ts_tablet_manager.cc:1950] T 623052a8c9c2436a828655da6cf6d379 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:15.992058 6457 raft_consensus.cc:740] T b18548ba557f448880c5e617fc03cbe0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:15.992448 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 678) took 1498 ms. Trace:
I20260923 19:50:15.992722 6457 consensus_queue.cc:260] T b18548ba557f448880c5e617fc03cbe0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:15.992938 6459 rpcz_store.cc:276] 0923 19:50:14.493856 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.493942 (+ 86us) service_pool.cc:224] Handling call
0923 19:50:15.953357 (+1459415us) ts_tablet_manager.cc:1151] Deleting tablet 623052a8c9c2436a828655da6cf6d379
0923 19:50:15.953366 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.971660 (+ 18294us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.990870 (+ 19210us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.992409 (+ 1539us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1459271}
I20260923 19:50:15.993546 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 623052a8c9c2436a828655da6cf6d379 (table default.Table_5365e890b976423aa339a9b5e8c8db7e [id=c815692bfbde445ea9c331e95615a751]) successfully deleted
I20260923 19:50:15.993917 6459 tablet_replica.cc:333] T 896bd068e6b343e48eb2a01679b49326 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:15.998718 6458 ts_tablet_manager.cc:1929] T f5cb8dd5dcf54df9989dd808fe148ce6 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:15.999255 6458 log.cc:1199] T f5cb8dd5dcf54df9989dd808fe148ce6 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/f5cb8dd5dcf54df9989dd808fe148ce6
I20260923 19:50:15.999617 6458 ts_tablet_manager.cc:1950] T f5cb8dd5dcf54df9989dd808fe148ce6 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:16.000362 6456 tablet_bootstrap.cc:492] T efc63a151f6444dfb03c3f15f6f54473 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:16.000488 6456 ts_tablet_manager.cc:1403] T efc63a151f6444dfb03c3f15f6f54473 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.002s
I20260923 19:50:16.000823 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 643) took 1888 ms. Trace:
I20260923 19:50:16.000938 6458 rpcz_store.cc:276] 0923 19:50:14.112412 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.113089 (+ 677us) service_pool.cc:224] Handling call
0923 19:50:15.978917 (+1865828us) ts_tablet_manager.cc:1151] Deleting tablet f5cb8dd5dcf54df9989dd808fe148ce6
0923 19:50:15.978925 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:15.994123 (+ 15198us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:15.998666 (+ 4543us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:16.000806 (+ 2140us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1865663}
I20260923 19:50:16.001262 6456 raft_consensus.cc:359] T efc63a151f6444dfb03c3f15f6f54473 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.001421 6456 raft_consensus.cc:385] T efc63a151f6444dfb03c3f15f6f54473 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:16.001432 6457 ts_tablet_manager.cc:1434] T b18548ba557f448880c5e617fc03cbe0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.011s user 0.000s sys 0.002s
I20260923 19:50:16.001482 6456 raft_consensus.cc:740] T efc63a151f6444dfb03c3f15f6f54473 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:16.001708 6456 consensus_queue.cc:260] T efc63a151f6444dfb03c3f15f6f54473 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.001902 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet f5cb8dd5dcf54df9989dd808fe148ce6 (table default.Table_c49fa1ccdba34f098164e9732f9a750a [id=1b9a067155ad446db4ead7a1ece15427]) successfully deleted
I20260923 19:50:16.002182 6456 ts_tablet_manager.cc:1434] T efc63a151f6444dfb03c3f15f6f54473 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:50:16.001703 6457 tablet_bootstrap.cc:492] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:16.004456 6457 tablet_bootstrap.cc:654] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:16.006702 6026 tablet_service.cc:1511] Processing CreateTablet for tablet ebc9dca1c228493a9dbaca4dd777d983 (DEFAULT_TABLE table=default.Table_b0aaf57c3ec9414f89529017165bc65b [id=84b65375453448aebd9bce135f58bd90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.007061 6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebc9dca1c228493a9dbaca4dd777d983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.010614 7134 raft_consensus.cc:493] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:16.010733 7134 raft_consensus.cc:515] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.011278 7134 leader_election.cc:290] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:16.011977 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f46a1be80c4194b592c5d00fe1f342" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:16.012146 6344 raft_consensus.cc:2468] T 35f46a1be80c4194b592c5d00fe1f342 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 0.
I20260923 19:50:16.012523 5996 leader_election.cc:304] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:16.012702 6456 tablet_bootstrap.cc:492] T 474e34e902064764864ba06ef41b1d94 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:16.013171 6037 tablet_service.cc:1511] Processing CreateTablet for tablet cabd3b2034664a5893bd6b084ee064e9 (DEFAULT_TABLE table=default.Table_96ab135786f74ab697bb37601c264ece [id=dc6240941b87434aa6037a3f08689920]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.013507 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cabd3b2034664a5893bd6b084ee064e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.015007 6456 tablet_bootstrap.cc:654] T 474e34e902064764864ba06ef41b1d94 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:16.016820 7134 raft_consensus.cc:2804] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:16.016896 7134 raft_consensus.cc:493] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:16.016949 7134 raft_consensus.cc:3060] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:16.020164 7134 raft_consensus.cc:515] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.021581 6461 ts_tablet_manager.cc:1916] T a01a86b6fd4b44d3808c2040525d7b61 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:16.021807 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f46a1be80c4194b592c5d00fe1f342" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
W20260923 19:50:16.022663 5995 leader_election.cc:343] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:16.022898 7134 leader_election.cc:290] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:16.023337 6458 tablet_replica.cc:333] T d2298d814a104f5cb62196be3bf0dae6 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:16.021440 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f46a1be80c4194b592c5d00fe1f342" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:16.023689 6458 raft_consensus.cc:2243] T d2298d814a104f5cb62196be3bf0dae6 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:16.023866 6458 raft_consensus.cc:2272] T d2298d814a104f5cb62196be3bf0dae6 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:16.026584 5791 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 355346dce1954e93874a5cd756be8064 (table default.Table_20e578ee9e57408c9a54cc2ac08af6e2 [id=ca73f0867b5d49cfb0bb7cd2315c47f2], current schema version=6) failed: Not found: failed to reset TS proxy: No leader found: Tablet 355346dce1954e93874a5cd756be8064 consensus state has no leader
I20260923 19:50:16.027527 6313 tablet_service.cc:1511] Processing CreateTablet for tablet c1406ea0967342878cba36a557a28780 (DEFAULT_TABLE table=default.Table_270206b5f7c84a6c96de1d66a4c6ce54 [id=940e99bb5e574ec49fd9ef7334cc20f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.028254 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 0c30bd7ab8fa42dea5de04c8d36f2e54 (DEFAULT_TABLE table=default.Table_c1c26750ec3d49c3b1144b79fa4089cb [id=eeba1521989c4c7ea8ac68fd69ae4baa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.029127 6311 tablet_service.cc:1511] Processing CreateTablet for tablet b6937278da5740e18cd1b1abd588b4e5 (DEFAULT_TABLE table=default.Table_88f358158870457f92f99862bdc15f8b [id=aeff5e19aca840899a789f39c0e98c4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.030107 6321 tablet_service.cc:1511] Processing CreateTablet for tablet dde2782e5a054e7793ac0789eb4e9ba1 (DEFAULT_TABLE table=default.Table_5fdf1ec98959467c8800e108f541e3d7 [id=33873eae0f7f43b2b812dfaf43f3f893]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.031093 6318 tablet_service.cc:1511] Processing CreateTablet for tablet f0acd9e73ecf4b79bb06a38312c4d2f8 (DEFAULT_TABLE table=default.Table_dcef0afaedf948748a0f1f6b845e48c4 [id=41c79314759d4a5aa3ff53bbafd5f1fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.031808 6308 tablet_service.cc:1511] Processing CreateTablet for tablet c1944da20fe44860accdd4970031e99d (DEFAULT_TABLE table=default.Table_677e330a53e147958b3aa8480e707869 [id=45d071bd91344f97acd114d456fc346c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.032676 6317 tablet_service.cc:1511] Processing CreateTablet for tablet abe0d022ab39455091d631f859b3fc09 (DEFAULT_TABLE table=default.Table_182f7505d6c041628fa56dc3288968f6 [id=41ee888bf23c4187b92d4e4b92afa1bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.035005 6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1406ea0967342878cba36a557a28780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.036541 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 0d70deeda179486291195476e47a9ae6 (table default.Table_e99b5d82a0814c538bfe455a29c4fa8e [id=d1e262e6e34742538b2b26c5fae80a99]) successfully deleted
I20260923 19:50:16.038230 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c30bd7ab8fa42dea5de04c8d36f2e54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.040868 6027 tablet_service.cc:1511] Processing CreateTablet for tablet 7270540a7d724159ae7a2c2cb3473580 (DEFAULT_TABLE table=default.Table_507609d3544d468ebf6218237ccce644 [id=6b50c65d4d0a4dc59cf22187b21303d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.041610 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6937278da5740e18cd1b1abd588b4e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.043284 6457 tablet_bootstrap.cc:492] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:16.043421 6457 ts_tablet_manager.cc:1403] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.042s user 0.001s sys 0.002s
I20260923 19:50:16.044195 6457 raft_consensus.cc:359] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.044348 6457 raft_consensus.cc:385] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:16.044404 6457 raft_consensus.cc:740] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:16.044656 6457 consensus_queue.cc:260] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.045070 6458 ts_tablet_manager.cc:1916] T d2298d814a104f5cb62196be3bf0dae6 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:16.045312 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dde2782e5a054e7793ac0789eb4e9ba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.045971 6457 ts_tablet_manager.cc:1434] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:16.046146 6318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0acd9e73ecf4b79bb06a38312c4d2f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.046218 6457 tablet_bootstrap.cc:492] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:16.048148 6457 tablet_bootstrap.cc:654] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:16.050318 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1944da20fe44860accdd4970031e99d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.054054 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abe0d022ab39455091d631f859b3fc09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.020201 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f46a1be80c4194b592c5d00fe1f342" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:16.058713 6031 tablet_service.cc:1511] Processing CreateTablet for tablet 16954e4999af443d8d91b234d8891df2 (DEFAULT_TABLE table=default.Table_20d2e475e3e744f99e0ab5cd2f094310 [id=bfb7a2df6de64945896d7d7da1cee369]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.058820 6179 tablet_service.cc:1511] Processing CreateTablet for tablet c1406ea0967342878cba36a557a28780 (DEFAULT_TABLE table=default.Table_270206b5f7c84a6c96de1d66a4c6ce54 [id=940e99bb5e574ec49fd9ef7334cc20f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.059543 6181 tablet_service.cc:1511] Processing CreateTablet for tablet f0acd9e73ecf4b79bb06a38312c4d2f8 (DEFAULT_TABLE table=default.Table_dcef0afaedf948748a0f1f6b845e48c4 [id=41c79314759d4a5aa3ff53bbafd5f1fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.059860 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0acd9e73ecf4b79bb06a38312c4d2f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.062140 6171 tablet_service.cc:1511] Processing CreateTablet for tablet c1944da20fe44860accdd4970031e99d (DEFAULT_TABLE table=default.Table_677e330a53e147958b3aa8480e707869 [id=45d071bd91344f97acd114d456fc346c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.062450 6171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1944da20fe44860accdd4970031e99d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.063225 6454 tablet_bootstrap.cc:492] T 7e41501bf01e4765853c27e4cac21e2b P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:16.063345 6454 ts_tablet_manager.cc:1403] T 7e41501bf01e4765853c27e4cac21e2b P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.186s user 0.003s sys 0.000s
I20260923 19:50:16.064695 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7270540a7d724159ae7a2c2cb3473580. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.065171 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16954e4999af443d8d91b234d8891df2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.065564 6175 tablet_service.cc:1511] Processing CreateTablet for tablet abe0d022ab39455091d631f859b3fc09 (DEFAULT_TABLE table=default.Table_182f7505d6c041628fa56dc3288968f6 [id=41ee888bf23c4187b92d4e4b92afa1bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.065852 6175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abe0d022ab39455091d631f859b3fc09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.066406 6183 tablet_service.cc:1511] Processing CreateTablet for tablet dde2782e5a054e7793ac0789eb4e9ba1 (DEFAULT_TABLE table=default.Table_5fdf1ec98959467c8800e108f541e3d7 [id=33873eae0f7f43b2b812dfaf43f3f893]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.066704 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dde2782e5a054e7793ac0789eb4e9ba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.066951 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 0c30bd7ab8fa42dea5de04c8d36f2e54 (DEFAULT_TABLE table=default.Table_c1c26750ec3d49c3b1144b79fa4089cb [id=eeba1521989c4c7ea8ac68fd69ae4baa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.067209 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c30bd7ab8fa42dea5de04c8d36f2e54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.067322 6458 ts_tablet_manager.cc:1929] T d2298d814a104f5cb62196be3bf0dae6 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:16.067412 6458 log.cc:1199] T d2298d814a104f5cb62196be3bf0dae6 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/d2298d814a104f5cb62196be3bf0dae6
I20260923 19:50:16.067694 6458 ts_tablet_manager.cc:1950] T d2298d814a104f5cb62196be3bf0dae6 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:16.068369 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 646) took 1955 ms. Trace:
I20260923 19:50:16.068442 6458 rpcz_store.cc:276] 0923 19:50:14.112672 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.112871 (+ 199us) service_pool.cc:224] Handling call
0923 19:50:16.003990 (+1891119us) ts_tablet_manager.cc:1151] Deleting tablet d2298d814a104f5cb62196be3bf0dae6
0923 19:50:16.023276 (+ 19286us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:16.048287 (+ 25011us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:16.067274 (+ 18987us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:16.068351 (+ 1077us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9373,"tablet-delete.queue_time_us":1890669}
I20260923 19:50:16.069192 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1406ea0967342878cba36a557a28780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.068779 6458 tablet_replica.cc:333] T 896bd068e6b343e48eb2a01679b49326 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:16.070675 6458 raft_consensus.cc:2243] T 896bd068e6b343e48eb2a01679b49326 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:16.071059 6458 raft_consensus.cc:2272] T 896bd068e6b343e48eb2a01679b49326 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:16.072079 6458 ts_tablet_manager.cc:1916] T 896bd068e6b343e48eb2a01679b49326 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:16.074527 6454 raft_consensus.cc:359] T 7e41501bf01e4765853c27e4cac21e2b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.074718 6454 raft_consensus.cc:385] T 7e41501bf01e4765853c27e4cac21e2b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:16.074784 6454 raft_consensus.cc:740] T 7e41501bf01e4765853c27e4cac21e2b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:16.074985 6454 consensus_queue.cc:260] T 7e41501bf01e4765853c27e4cac21e2b P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.077116 6454 ts_tablet_manager.cc:1434] T 7e41501bf01e4765853c27e4cac21e2b P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.014s user 0.002s sys 0.001s
I20260923 19:50:16.077759 6454 tablet_bootstrap.cc:492] T 7b1601590508479c8f401cd09d9f4c3b P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:16.077245 6456 tablet_bootstrap.cc:492] T 474e34e902064764864ba06ef41b1d94 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:16.081054 6456 ts_tablet_manager.cc:1403] T 474e34e902064764864ba06ef41b1d94 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.068s user 0.004s sys 0.004s
I20260923 19:50:16.081907 6456 raft_consensus.cc:359] T 474e34e902064764864ba06ef41b1d94 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.082132 6456 raft_consensus.cc:385] T 474e34e902064764864ba06ef41b1d94 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:16.082217 6456 raft_consensus.cc:740] T 474e34e902064764864ba06ef41b1d94 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:16.082430 6456 consensus_queue.cc:260] T 474e34e902064764864ba06ef41b1d94 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.082940 6456 ts_tablet_manager.cc:1434] T 474e34e902064764864ba06ef41b1d94 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:16.083559 6456 tablet_bootstrap.cc:492] T 0e123b69877e4b1fbcdb2b27960864e9 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:16.086195 6456 tablet_bootstrap.cc:654] T 0e123b69877e4b1fbcdb2b27960864e9 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:16.086355 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet d2298d814a104f5cb62196be3bf0dae6 (table default.Table_69bbed3a902143c0a4fc91ee4cf3fec4 [id=ba1f8e14938e4925b3fc8a8b72002231]) successfully deleted
I20260923 19:50:16.090175 6312 tablet_service.cc:1511] Processing CreateTablet for tablet 95630644f0a242d8b8449f12bd6a3de5 (DEFAULT_TABLE table=default.Table_b86593b9d27b4c5180563a796c645133 [id=78e58889d09f40199e60ffff052d1fde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.090595 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95630644f0a242d8b8449f12bd6a3de5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.091679 6322 tablet_service.cc:1511] Processing CreateTablet for tablet d39bfd7ec454447cbcc6ed965973355c (DEFAULT_TABLE table=default.Table_3cfe796a43654c54be5f70f57774c2fd [id=b817eacce9dd42f994bf36ca9a377347]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.091953 6320 tablet_service.cc:1511] Processing CreateTablet for tablet 1e835fa95fa84b43be4c27b7e3e26af3 (DEFAULT_TABLE table=default.Table_b7b81a79b9a24504adbefb5a52b17e4f [id=1e986e2630b843bcbb585d5d228d42c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.092202 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 5ad33cd4913941c6aa2fea717608ef7c (DEFAULT_TABLE table=default.Table_611375feff304538a80e8b1eca51b3cd [id=320d0532910f4d60aacd0426a3aec2b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.093287 7495 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.5.143.254:37151 every 8 connection(s)
I20260923 19:50:16.093632 7050 rpc_server.cc:307] RPC server started. Bound to: 127.5.143.254:37151
I20260923 19:50:16.099207 7050 server_base.cc:1193] Dumped server information to /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/master-0/data/info.pb
I20260923 19:50:16.099715 5695 external_mini_cluster.cc:1434] Started /tmp/dist-test-task5JtCX2/build/asan/bin/kudu as pid 7050
I20260923 19:50:16.103518 6166 tablet_service.cc:1511] Processing CreateTablet for tablet cf3ab578ef1442f19d629b61dc73a970 (DEFAULT_TABLE table=default.Table_7ce588248ce944fc878bbe47bbbbc8fe [id=46b5a5f448ab42a3aff6665c3a4e769d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.103816 6177 tablet_service.cc:1511] Processing CreateTablet for tablet d4bb6958a8a0410fbac59e0ff39539ad (DEFAULT_TABLE table=default.Table_1acd164e2b1143a0abc77f70a0178d34 [id=1667c2dec35f4b4fae0e86e6414680f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.103967 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf3ab578ef1442f19d629b61dc73a970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.107950 6456 tablet_bootstrap.cc:492] T 0e123b69877e4b1fbcdb2b27960864e9 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:16.108143 6307 tablet_service.cc:1511] Processing CreateTablet for tablet 295502f94faf4d4880e9516aa8d9cb79 (DEFAULT_TABLE table=default.Table_5bf3acc342a34bba8f50e005425b4c5d [id=a34c7ad2f3004c6e908b87fb99389632]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.108521 6316 tablet_service.cc:1511] Processing CreateTablet for tablet d4bb6958a8a0410fbac59e0ff39539ad (DEFAULT_TABLE table=default.Table_1acd164e2b1143a0abc77f70a0178d34 [id=1667c2dec35f4b4fae0e86e6414680f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.108534 6456 ts_tablet_manager.cc:1403] T 0e123b69877e4b1fbcdb2b27960864e9 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.000s
I20260923 19:50:16.111173 6176 tablet_service.cc:1511] Processing CreateTablet for tablet 382daee3555642b7a767a35c2f49b98a (DEFAULT_TABLE table=default.Table_fa3fcc5532af4101a61de0798a50be97 [id=ba15210503de4471992e91c6ade38ac3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.112106 6177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4bb6958a8a0410fbac59e0ff39539ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.112363 6176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 382daee3555642b7a767a35c2f49b98a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.112273 6456 raft_consensus.cc:359] T 0e123b69877e4b1fbcdb2b27960864e9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.112998 6456 raft_consensus.cc:385] T 0e123b69877e4b1fbcdb2b27960864e9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:16.113258 6456 raft_consensus.cc:740] T 0e123b69877e4b1fbcdb2b27960864e9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:16.114078 6315 tablet_service.cc:1511] Processing CreateTablet for tablet 18b4ed7ef6dc468096b92a1ffa64c7d9 (DEFAULT_TABLE table=default.Table_7fd5aef2a3c648f8bb0354e14380c716 [id=6892d0c8f40b4015b756de3d181cacb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.114404 6323 tablet_service.cc:1511] Processing CreateTablet for tablet a55b2ff045d648339d7e207f13e2fa27 (DEFAULT_TABLE table=default.Table_b0b796ec295042f8a2b294c7dd1d6136 [id=c472d4f734384207af159c3738b88a49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.114598 7362 raft_consensus.cc:493] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:16.114691 6319 tablet_service.cc:1511] Processing CreateTablet for tablet 872e939a37e642d7b10fa2b98395ed6d (DEFAULT_TABLE table=default.Table_ffe6f0b7197a452aafba7eebbabcbcfe [id=b3726f123e174878aede71dbffef9ae7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.114737 7362 raft_consensus.cc:515] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.114948 6309 tablet_service.cc:1511] Processing CreateTablet for tablet cf3ab578ef1442f19d629b61dc73a970 (DEFAULT_TABLE table=default.Table_7ce588248ce944fc878bbe47bbbbc8fe [id=46b5a5f448ab42a3aff6665c3a4e769d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.115170 6324 tablet_service.cc:1511] Processing CreateTablet for tablet 34932207ec4145cf9f6ec59d1282d03b (DEFAULT_TABLE table=default.Table_927e705db46045d0ab15c515a2eed8d7 [id=06e3f91bd8c343378acfec194470ba00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.115520 7362 leader_election.cc:290] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:16.107942 6314 tablet_service.cc:1511] Processing CreateTablet for tablet 382daee3555642b7a767a35c2f49b98a (DEFAULT_TABLE table=default.Table_fa3fcc5532af4101a61de0798a50be97 [id=ba15210503de4471992e91c6ade38ac3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.115849 7490 raft_consensus.cc:493] T 035abecfbee7474d9dd048f35e28e867 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:16.115942 7490 raft_consensus.cc:515] T 035abecfbee7474d9dd048f35e28e867 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.116412 7490 leader_election.cc:290] T 035abecfbee7474d9dd048f35e28e867 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:16.115689 6322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d39bfd7ec454447cbcc6ed965973355c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.117093 6320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e835fa95fa84b43be4c27b7e3e26af3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.115746 6306 tablet_service.cc:1511] Processing CreateTablet for tablet 525875ed1ba1484680f83c1f514df0c5 (DEFAULT_TABLE table=default.Table_a86b468f8e19450da6a1123193689d75 [id=6b4fea99f3c54a3a8ef893ad5f8f0abd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.117347 6306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 525875ed1ba1484680f83c1f514df0c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.118008 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 382daee3555642b7a767a35c2f49b98a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.118185 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34932207ec4145cf9f6ec59d1282d03b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.121992 6309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf3ab578ef1442f19d629b61dc73a970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.126031 6319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 872e939a37e642d7b10fa2b98395ed6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.127727 7134 raft_consensus.cc:493] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:16.127853 7134 raft_consensus.cc:515] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.128458 7134 leader_election.cc:290] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:16.130038 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a55b2ff045d648339d7e207f13e2fa27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.132997 6456 consensus_queue.cc:260] T 0e123b69877e4b1fbcdb2b27960864e9 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.134334 6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18b4ed7ef6dc468096b92a1ffa64c7d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.134976 6456 ts_tablet_manager.cc:1434] T 0e123b69877e4b1fbcdb2b27960864e9 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.026s user 0.003s sys 0.000s
I20260923 19:50:16.135241 6456 tablet_bootstrap.cc:492] T 5e711e48156b46b5a517b330d6d41309 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:16.135213 6461 ts_tablet_manager.cc:1929] T a01a86b6fd4b44d3808c2040525d7b61 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:16.135308 6461 log.cc:1199] T a01a86b6fd4b44d3808c2040525d7b61 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/a01a86b6fd4b44d3808c2040525d7b61
I20260923 19:50:16.135574 6461 ts_tablet_manager.cc:1950] T a01a86b6fd4b44d3808c2040525d7b61 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:16.136515 6461 tablet_replica.cc:333] T f7cf45d4c4d3480288698682c1c85869 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:16.136749 6461 raft_consensus.cc:2243] T f7cf45d4c4d3480288698682c1c85869 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:16.136906 6461 raft_consensus.cc:2272] T f7cf45d4c4d3480288698682c1c85869 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:16.137387 6461 ts_tablet_manager.cc:1916] T f7cf45d4c4d3480288698682c1c85869 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:16.137992 6458 ts_tablet_manager.cc:1929] T 896bd068e6b343e48eb2a01679b49326 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:16.138083 6307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295502f94faf4d4880e9516aa8d9cb79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.138091 6458 log.cc:1199] T 896bd068e6b343e48eb2a01679b49326 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/896bd068e6b343e48eb2a01679b49326
I20260923 19:50:16.138872 6458 ts_tablet_manager.cc:1950] T 896bd068e6b343e48eb2a01679b49326 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:16.139520 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 647) took 2026 ms. Trace:
I20260923 19:50:16.139595 6458 rpcz_store.cc:276] 0923 19:50:14.112765 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.112807 (+ 42us) service_pool.cc:224] Handling call
0923 19:50:16.068740 (+1955933us) ts_tablet_manager.cc:1151] Deleting tablet 896bd068e6b343e48eb2a01679b49326
0923 19:50:16.068750 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:16.075159 (+ 6409us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:16.137951 (+ 62792us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:16.139499 (+ 1548us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1955234}
I20260923 19:50:16.140050 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 896bd068e6b343e48eb2a01679b49326 (table default.Table_5febe26a78884634a01aa0ec62f36604 [id=e2a29fc060074c45918b97001dd03207]) successfully deleted
I20260923 19:50:16.140846 6456 tablet_bootstrap.cc:654] T 5e711e48156b46b5a517b330d6d41309 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:16.142772 6458 tablet_replica.cc:333] T 58c24aa494bc4da28536dfa1df6123b7 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:16.143800 6458 raft_consensus.cc:2243] T 58c24aa494bc4da28536dfa1df6123b7 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:16.144555 6458 raft_consensus.cc:2272] T 58c24aa494bc4da28536dfa1df6123b7 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:16.107733 6167 tablet_service.cc:1511] Processing CreateTablet for tablet b6937278da5740e18cd1b1abd588b4e5 (DEFAULT_TABLE table=default.Table_88f358158870457f92f99862bdc15f8b [id=aeff5e19aca840899a789f39c0e98c4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.146041 6458 ts_tablet_manager.cc:1916] T 58c24aa494bc4da28536dfa1df6123b7 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:16.150130 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6937278da5740e18cd1b1abd588b4e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.150362 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ad33cd4913941c6aa2fea717608ef7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.157295 6457 tablet_bootstrap.cc:492] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
W20260923 19:50:16.157940 6280 consensus_peers.cc:597] T 7b455812687f42848df5290d0cdbc312 P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:16.158010 6457 ts_tablet_manager.cc:1403] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.112s user 0.005s sys 0.002s
W20260923 19:50:16.158155 6280 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 54301.8us
I20260923 19:50:16.158864 6457 raft_consensus.cc:359] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.159035 6457 raft_consensus.cc:385] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:16.159085 6457 raft_consensus.cc:740] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:16.159199 7490 raft_consensus.cc:493] T 12f4abb573bd4be6961b55c27c684d06 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:16.159260 6457 consensus_queue.cc:260] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.159581 7490 raft_consensus.cc:515] T 12f4abb573bd4be6961b55c27c684d06 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.160118 7490 leader_election.cc:290] T 12f4abb573bd4be6961b55c27c684d06 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:16.160611 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c8bfa9b7424b9f80f76e0bb05cbc0c" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:16.161550 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ea466d1b2b40e9b9b4cd5be51f79e0" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:16.161761 5996 leader_election.cc:343] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:16.163038 6457 ts_tablet_manager.cc:1434] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260923 19:50:16.163432 6457 tablet_bootstrap.cc:492] T 83dba06b0d0040889015fb052c642ec0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:16.103518 6175 tablet_service.cc:1511] Processing CreateTablet for tablet 5ad33cd4913941c6aa2fea717608ef7c (DEFAULT_TABLE table=default.Table_611375feff304538a80e8b1eca51b3cd [id=320d0532910f4d60aacd0426a3aec2b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.167104 6175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ad33cd4913941c6aa2fea717608ef7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.167508 6458 ts_tablet_manager.cc:1929] T 58c24aa494bc4da28536dfa1df6123b7 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:16.167618 6458 log.cc:1199] T 58c24aa494bc4da28536dfa1df6123b7 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/58c24aa494bc4da28536dfa1df6123b7
I20260923 19:50:16.167976 6458 ts_tablet_manager.cc:1950] T 58c24aa494bc4da28536dfa1df6123b7 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:16.168711 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 644) took 2056 ms. Trace:
I20260923 19:50:16.169556 6457 tablet_bootstrap.cc:654] T 83dba06b0d0040889015fb052c642ec0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:16.168812 6458 rpcz_store.cc:276] 0923 19:50:14.112518 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.112780 (+ 262us) service_pool.cc:224] Handling call
0923 19:50:16.142725 (+2029945us) ts_tablet_manager.cc:1151] Deleting tablet 58c24aa494bc4da28536dfa1df6123b7
0923 19:50:16.142734 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:16.149476 (+ 6742us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:16.167459 (+ 17983us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:16.168692 (+ 1233us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2028984}
I20260923 19:50:16.177489 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 58c24aa494bc4da28536dfa1df6123b7 (table default.Table_82887fe31841462bafc075decf6acdbd [id=8bf9f0ca8abf4fa1a05458b12288cd12]) successfully deleted
I20260923 19:50:16.177999 6458 tablet_replica.cc:333] T 235b4b8081ad4a13937a7941344dbc33 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:16.178658 6458 raft_consensus.cc:2243] T 235b4b8081ad4a13937a7941344dbc33 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:16.179298 6458 raft_consensus.cc:2272] T 235b4b8081ad4a13937a7941344dbc33 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:16.179548 7490 raft_consensus.cc:493] T a11ecef9a24f4e4a812ec220b6a92cc4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:16.179967 7499 sys_catalog.cc:263] Verifying existing consensus state
I20260923 19:50:16.179921 7490 raft_consensus.cc:515] T a11ecef9a24f4e4a812ec220b6a92cc4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.180542 7490 leader_election.cc:290] T a11ecef9a24f4e4a812ec220b6a92cc4 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:16.182154 6458 ts_tablet_manager.cc:1916] T 235b4b8081ad4a13937a7941344dbc33 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:16.183434 6320 tablet_service.cc:1511] Processing CreateTablet for tablet 3ca71d8573d1498a91aaf6cb4b9f0845 (DEFAULT_TABLE table=default.Table_e13bfd92341c4edea1d722b5eba5e696 [id=7ccfde56715d421e845a633a94cc5695]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.184343 6320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ca71d8573d1498a91aaf6cb4b9f0845. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.184538 6457 tablet_bootstrap.cc:492] T 83dba06b0d0040889015fb052c642ec0 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:16.184675 6457 ts_tablet_manager.cc:1403] T 83dba06b0d0040889015fb052c642ec0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.000s
I20260923 19:50:16.186194 6457 raft_consensus.cc:359] T 83dba06b0d0040889015fb052c642ec0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.186348 6457 raft_consensus.cc:385] T 83dba06b0d0040889015fb052c642ec0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:16.186390 6457 raft_consensus.cc:740] T 83dba06b0d0040889015fb052c642ec0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:16.186589 6457 consensus_queue.cc:260] T 83dba06b0d0040889015fb052c642ec0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.187942 6461 ts_tablet_manager.cc:1929] T f7cf45d4c4d3480288698682c1c85869 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:16.188025 6461 log.cc:1199] T f7cf45d4c4d3480288698682c1c85869 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/f7cf45d4c4d3480288698682c1c85869
I20260923 19:50:16.188277 6461 ts_tablet_manager.cc:1950] T f7cf45d4c4d3480288698682c1c85869 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:16.189925 6457 ts_tablet_manager.cc:1434] T 83dba06b0d0040889015fb052c642ec0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260923 19:50:16.191287 6314 tablet_service.cc:1511] Processing CreateTablet for tablet 4ac35ccdcf254b7e8b59926fcc9bd1cf (DEFAULT_TABLE table=default.Table_98bbea51f78c4eb6872b30a01002be31 [id=ae2e7200b0df46649df2de751fd6c209]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.191653 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ac35ccdcf254b7e8b59926fcc9bd1cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.191705 6457 tablet_bootstrap.cc:492] T b87872fb6cc0400c86eddffb29c898e8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:16.191171 6461 tablet_replica.cc:333] T c7369a5fc87f4b70bcfbe052ef021771 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:16.193550 6461 raft_consensus.cc:2243] T c7369a5fc87f4b70bcfbe052ef021771 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:16.193728 6461 raft_consensus.cc:2272] T c7369a5fc87f4b70bcfbe052ef021771 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:16.194325 6461 ts_tablet_manager.cc:1916] T c7369a5fc87f4b70bcfbe052ef021771 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:16.194789 6312 tablet_service.cc:1511] Processing CreateTablet for tablet 115b8a9e79c64e84bc0ee9cdab636b94 (DEFAULT_TABLE table=default.Table_b1d68ffe395448d195d5a18f8dae7539 [id=27331fb9c47646388b3102f8480dbaaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.195122 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 115b8a9e79c64e84bc0ee9cdab636b94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.198139 6315 tablet_service.cc:1511] Processing CreateTablet for tablet 2c6b2e4dac9749e58d01a838c2472bbc (DEFAULT_TABLE table=default.Table_9f11e4333c1242e1bfd461bd7c79a6d7 [id=ccd2727d297147f88427167e65caf2cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.198458 6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c6b2e4dac9749e58d01a838c2472bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.200950 6320 tablet_service.cc:1511] Processing CreateTablet for tablet fcc32bda7c684e849161f9d4a3df79d3 (DEFAULT_TABLE table=default.Table_23216d517be14547b1a57de90be93f03 [id=a925e4a6dd1d4a95896253ffb1a0d970]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.201550 6320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcc32bda7c684e849161f9d4a3df79d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.202272 6458 ts_tablet_manager.cc:1929] T 235b4b8081ad4a13937a7941344dbc33 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:16.205839 6458 log.cc:1199] T 235b4b8081ad4a13937a7941344dbc33 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/235b4b8081ad4a13937a7941344dbc33
I20260923 19:50:16.206566 6458 ts_tablet_manager.cc:1950] T 235b4b8081ad4a13937a7941344dbc33 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:16.208264 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 642) took 2095 ms. Trace:
I20260923 19:50:16.210428 6458 rpcz_store.cc:276] 0923 19:50:14.112322 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.112403 (+ 81us) service_pool.cc:224] Handling call
0923 19:50:16.177948 (+2065545us) ts_tablet_manager.cc:1151] Deleting tablet 235b4b8081ad4a13937a7941344dbc33
0923 19:50:16.177958 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:16.187344 (+ 9386us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:16.202220 (+ 14876us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:16.208236 (+ 6016us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2063904}
I20260923 19:50:16.211675 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 235b4b8081ad4a13937a7941344dbc33 (table default.Table_1a5602208673400faf5f272297ff82b9 [id=a7241c5e33894e8c97e723b3b90b8cc7]) successfully deleted
W20260923 19:50:16.212857 5995 leader_election.cc:343] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:16.213984 6031 tablet_service.cc:1558] Processing DeleteTablet for tablet f9687b3f4b904e438d83533fb67cc92f with delete_type TABLET_DATA_DELETED (replaced by tablet 115b8a9e79c64e84bc0ee9cdab636b94) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:16.214098 6025 tablet_service.cc:1511] Processing CreateTablet for tablet c1944da20fe44860accdd4970031e99d (DEFAULT_TABLE table=default.Table_677e330a53e147958b3aa8480e707869 [id=45d071bd91344f97acd114d456fc346c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.214365 6027 tablet_service.cc:1511] Processing CreateTablet for tablet c1406ea0967342878cba36a557a28780 (DEFAULT_TABLE table=default.Table_270206b5f7c84a6c96de1d66a4c6ce54 [id=940e99bb5e574ec49fd9ef7334cc20f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.214783 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 0c30bd7ab8fa42dea5de04c8d36f2e54 (DEFAULT_TABLE table=default.Table_c1c26750ec3d49c3b1144b79fa4089cb [id=eeba1521989c4c7ea8ac68fd69ae4baa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.215121 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 648) took 2082 ms. Trace:
I20260923 19:50:16.215149 6028 tablet_service.cc:1511] Processing CreateTablet for tablet b6937278da5740e18cd1b1abd588b4e5 (DEFAULT_TABLE table=default.Table_88f358158870457f92f99862bdc15f8b [id=aeff5e19aca840899a789f39c0e98c4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.215507 6037 tablet_service.cc:1511] Processing CreateTablet for tablet dde2782e5a054e7793ac0789eb4e9ba1 (DEFAULT_TABLE table=default.Table_5fdf1ec98959467c8800e108f541e3d7 [id=33873eae0f7f43b2b812dfaf43f3f893]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.215456 6458 rpcz_store.cc:276] 0923 19:50:14.132622 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.166901 (+ 34279us) service_pool.cc:224] Handling call
0923 19:50:16.214429 (+2047528us) ts_tablet_manager.cc:1151] Deleting tablet 7dac9efee371479ab3547e06f0e580ad
0923 19:50:16.214439 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:16.214872 (+ 433us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2047293}
I20260923 19:50:16.215919 6026 tablet_service.cc:1511] Processing CreateTablet for tablet f0acd9e73ecf4b79bb06a38312c4d2f8 (DEFAULT_TABLE table=default.Table_dcef0afaedf948748a0f1f6b845e48c4 [id=41c79314759d4a5aa3ff53bbafd5f1fe]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:16.216863 6279 consensus_peers.cc:597] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ec4cc8a742114e5fb07c5c9157ce09e8. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:16.217013 6031 tablet_service.cc:1511] Processing CreateTablet for tablet abe0d022ab39455091d631f859b3fc09 (DEFAULT_TABLE table=default.Table_182f7505d6c041628fa56dc3288968f6 [id=41ee888bf23c4187b92d4e4b92afa1bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.215934 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f4abb573bd4be6961b55c27c684d06" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:16.217361 6060 raft_consensus.cc:2468] T 12f4abb573bd4be6961b55c27c684d06 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
W20260923 19:50:16.217566 6279 leader_election.cc:343] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 58ea466d1b2b40e9b9b4cd5be51f79e0
I20260923 19:50:16.217615 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 652) took 2028 ms. Trace:
I20260923 19:50:16.218113 6458 rpcz_store.cc:276] 0923 19:50:14.189601 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.189661 (+ 60us) service_pool.cc:224] Handling call
0923 19:50:16.217510 (+2027849us) ts_tablet_manager.cc:1151] Deleting tablet 7f7ecbb8d9054dde96b2bb511697dd47
0923 19:50:16.217521 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:16.217600 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2027476}
I20260923 19:50:16.218918 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1944da20fe44860accdd4970031e99d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:16.219058 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 7f7ecbb8d9054dde96b2bb511697dd47 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f7ecbb8d9054dde96b2bb511697dd47 already in progress: creating tablet
I20260923 19:50:16.219554 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 654) took 2025 ms. Trace:
I20260923 19:50:16.220167 6458 rpcz_store.cc:276] 0923 19:50:14.193787 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.193843 (+ 56us) service_pool.cc:224] Handling call
0923 19:50:16.219459 (+2025616us) ts_tablet_manager.cc:1151] Deleting tablet ea2ef507c6e24d369427048171dfec06
0923 19:50:16.219468 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:16.219539 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2025418}
W20260923 19:50:16.220933 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet ea2ef507c6e24d369427048171dfec06 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea2ef507c6e24d369427048171dfec06 already in progress: creating tablet
I20260923 19:50:16.221338 6458 tablet_replica.cc:333] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:16.221840 6458 raft_consensus.cc:2243] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:16.222114 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1406ea0967342878cba36a557a28780. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:16.222285 6279 leader_election.cc:343] T 035abecfbee7474d9dd048f35e28e867 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 035abecfbee7474d9dd048f35e28e867
W20260923 19:50:16.222823 6279 leader_election.cc:343] T a11ecef9a24f4e4a812ec220b6a92cc4 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: a11ecef9a24f4e4a812ec220b6a92cc4
I20260923 19:50:16.223017 6279 leader_election.cc:304] T 12f4abb573bd4be6961b55c27c684d06 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:16.223302 7362 consensus_queue.cc:1048] T 86388fa08c454da9ad2ca0124dcba10b P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:16.223891 7362 raft_consensus.cc:2804] T 12f4abb573bd4be6961b55c27c684d06 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:16.224004 7362 raft_consensus.cc:493] T 12f4abb573bd4be6961b55c27c684d06 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:16.224107 7362 raft_consensus.cc:3060] T 12f4abb573bd4be6961b55c27c684d06 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:16.226800 5799 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 6ac04be575704a69994f98e00411a254 (table default.Table_346160aa15ec4313947a6b9f256cea06 [id=cefd3af14e2148c19281df9e59f07421]). Expected version 1 got 0
I20260923 19:50:16.227115 7362 raft_consensus.cc:515] T 12f4abb573bd4be6961b55c27c684d06 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.228034 7362 leader_election.cc:290] T 12f4abb573bd4be6961b55c27c684d06 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:16.229210 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c30bd7ab8fa42dea5de04c8d36f2e54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.230124 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6937278da5740e18cd1b1abd588b4e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.231098 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f4abb573bd4be6961b55c27c684d06" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:16.231263 6059 raft_consensus.cc:3060] T 12f4abb573bd4be6961b55c27c684d06 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:16.231406 6458 raft_consensus.cc:2272] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:16.231949 6458 ts_tablet_manager.cc:1916] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:16.234259 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dde2782e5a054e7793ac0789eb4e9ba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.236507 6059 raft_consensus.cc:2468] T 12f4abb573bd4be6961b55c27c684d06 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:16.238355 6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0acd9e73ecf4b79bb06a38312c4d2f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.238345 6279 leader_election.cc:304] T 12f4abb573bd4be6961b55c27c684d06 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:16.238636 7362 raft_consensus.cc:2804] T 12f4abb573bd4be6961b55c27c684d06 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:16.239099 7362 raft_consensus.cc:697] T 12f4abb573bd4be6961b55c27c684d06 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:16.239349 7362 consensus_queue.cc:237] T 12f4abb573bd4be6961b55c27c684d06 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.243028 7134 raft_consensus.cc:493] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:16.243153 7134 raft_consensus.cc:515] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.243724 7134 leader_election.cc:290] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:16.244328 6344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac04be575704a69994f98e00411a254" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:16.244784 5996 leader_election.cc:343] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:16.246567 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abe0d022ab39455091d631f859b3fc09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.247212 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 1b7d35282dd148e7bfcf1277d34002bf (DEFAULT_TABLE table=default.Table_9eb8348988b14a1e8b36839078e0f2d2 [id=748d7b66dd7a47c59f86817972b0dccc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.247571 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b7d35282dd148e7bfcf1277d34002bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.255059 6308 tablet_service.cc:1511] Processing CreateTablet for tablet adafe0a6b58c4de5a97d17053f7c6bf1 (DEFAULT_TABLE table=default.Table_7dbacc6620d24105a6e2a2b21c26af26 [id=bcfcc79a0a284247b9be768e462b8acd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.260618 6172 tablet_service.cc:1511] Processing CreateTablet for tablet 295502f94faf4d4880e9516aa8d9cb79 (DEFAULT_TABLE table=default.Table_5bf3acc342a34bba8f50e005425b4c5d [id=a34c7ad2f3004c6e908b87fb99389632]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.261036 6172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295502f94faf4d4880e9516aa8d9cb79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.262049 7482 raft_consensus.cc:493] T 235b4b8081ad4a13937a7941344dbc33 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:16.262158 7482 raft_consensus.cc:515] T 235b4b8081ad4a13937a7941344dbc33 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.262691 7482 leader_election.cc:290] T 235b4b8081ad4a13937a7941344dbc33 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:16.262790 7482 raft_consensus.cc:493] T 7e41501bf01e4765853c27e4cac21e2b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:16.262863 7482 raft_consensus.cc:515] T 7e41501bf01e4765853c27e4cac21e2b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.263236 7482 leader_election.cc:290] T 7e41501bf01e4765853c27e4cac21e2b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:16.263691 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 872e939a37e642d7b10fa2b98395ed6d (DEFAULT_TABLE table=default.Table_ffe6f0b7197a452aafba7eebbabcbcfe [id=b3726f123e174878aede71dbffef9ae7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.264014 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 872e939a37e642d7b10fa2b98395ed6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.266162 6170 tablet_service.cc:1511] Processing CreateTablet for tablet 525875ed1ba1484680f83c1f514df0c5 (DEFAULT_TABLE table=default.Table_a86b468f8e19450da6a1123193689d75 [id=6b4fea99f3c54a3a8ef893ad5f8f0abd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.266400 6459 raft_consensus.cc:2243] T 896bd068e6b343e48eb2a01679b49326 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:16.266500 6170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 525875ed1ba1484680f83c1f514df0c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.266520 6173 tablet_service.cc:1511] Processing CreateTablet for tablet 18b4ed7ef6dc468096b92a1ffa64c7d9 (DEFAULT_TABLE table=default.Table_7fd5aef2a3c648f8bb0354e14380c716 [id=6892d0c8f40b4015b756de3d181cacb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.266844 6168 tablet_service.cc:1511] Processing CreateTablet for tablet a55b2ff045d648339d7e207f13e2fa27 (DEFAULT_TABLE table=default.Table_b0b796ec295042f8a2b294c7dd1d6136 [id=c472d4f734384207af159c3738b88a49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.266952 6459 raft_consensus.cc:2272] T 896bd068e6b343e48eb2a01679b49326 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:16.267174 6169 tablet_service.cc:1511] Processing CreateTablet for tablet 1e835fa95fa84b43be4c27b7e3e26af3 (DEFAULT_TABLE table=default.Table_b7b81a79b9a24504adbefb5a52b17e4f [id=1e986e2630b843bcbb585d5d228d42c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.267690 6459 ts_tablet_manager.cc:1916] T 896bd068e6b343e48eb2a01679b49326 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:16.267786 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a55b2ff045d648339d7e207f13e2fa27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.270192 6164 tablet_service.cc:1511] Processing CreateTablet for tablet adafe0a6b58c4de5a97d17053f7c6bf1 (DEFAULT_TABLE table=default.Table_7dbacc6620d24105a6e2a2b21c26af26 [id=bcfcc79a0a284247b9be768e462b8acd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.273452 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 3ca71d8573d1498a91aaf6cb4b9f0845 (DEFAULT_TABLE table=default.Table_e13bfd92341c4edea1d722b5eba5e696 [id=7ccfde56715d421e845a633a94cc5695]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.278836 6458 ts_tablet_manager.cc:1929] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260923 19:50:16.279341 6458 log.cc:1199] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/ec4cc8a742114e5fb07c5c9157ce09e8
I20260923 19:50:16.278807 6179 tablet_service.cc:1511] Processing CreateTablet for tablet 34932207ec4145cf9f6ec59d1282d03b (DEFAULT_TABLE table=default.Table_927e705db46045d0ab15c515a2eed8d7 [id=06e3f91bd8c343378acfec194470ba00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.279273 6321 tablet_service.cc:1511] Processing CreateTablet for tablet 14a41affa49e4bf499cde0789a36d8d8 (DEFAULT_TABLE table=default.Table_7c503dc2bcda44d0b99f66019026968d [id=ce9e3c54a9b14c8c99132837c080e4ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.281376 6458 ts_tablet_manager.cc:1950] T ec4cc8a742114e5fb07c5c9157ce09e8 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:16.282472 7352 raft_consensus.cc:493] T 2ce6378a6bd844a485aebb96081307e3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:16.282701 7352 raft_consensus.cc:515] T 2ce6378a6bd844a485aebb96081307e3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.281997 6181 tablet_service.cc:1511] Processing CreateTablet for tablet 95630644f0a242d8b8449f12bd6a3de5 (DEFAULT_TABLE table=default.Table_b86593b9d27b4c5180563a796c645133 [id=78e58889d09f40199e60ffff052d1fde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.288251 7352 leader_election.cc:290] T 2ce6378a6bd844a485aebb96081307e3 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:16.288721 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "035abecfbee7474d9dd048f35e28e867" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:16.289263 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11ecef9a24f4e4a812ec220b6a92cc4" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:16.294293 6054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ce6378a6bd844a485aebb96081307e3" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:16.294512 6054 raft_consensus.cc:2468] T 2ce6378a6bd844a485aebb96081307e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:16.295070 6279 leader_election.cc:304] T 2ce6378a6bd844a485aebb96081307e3 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:16.023699 6343 raft_consensus.cc:3060] T 35f46a1be80c4194b592c5d00fe1f342 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:16.299283 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f4abb573bd4be6961b55c27c684d06" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:16.300104 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12f4abb573bd4be6961b55c27c684d06" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:16.301990 7362 raft_consensus.cc:2804] T 2ce6378a6bd844a485aebb96081307e3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:16.302073 7362 raft_consensus.cc:493] T 2ce6378a6bd844a485aebb96081307e3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:16.302129 7362 raft_consensus.cc:3060] T 2ce6378a6bd844a485aebb96081307e3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:16.305646 7362 raft_consensus.cc:515] T 2ce6378a6bd844a485aebb96081307e3 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.307257 7490 consensus_queue.cc:1048] T 8d87f05f29bd476386ff6516676ce31a P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:16.310245 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ce6378a6bd844a485aebb96081307e3" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:16.310683 7362 leader_election.cc:290] T 2ce6378a6bd844a485aebb96081307e3 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:16.310850 6059 raft_consensus.cc:3060] T 2ce6378a6bd844a485aebb96081307e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:16.311841 7134 raft_consensus.cc:493] T ed9fb0cab0bd43b7a05d7376125b187e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:16.311985 7134 raft_consensus.cc:515] T ed9fb0cab0bd43b7a05d7376125b187e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.312661 7134 leader_election.cc:290] T ed9fb0cab0bd43b7a05d7376125b187e P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:16.327005 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fb0cab0bd43b7a05d7376125b187e" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:16.327581 5996 leader_election.cc:343] T ed9fb0cab0bd43b7a05d7376125b187e P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:16.328126 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14a41affa49e4bf499cde0789a36d8d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.332091 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adafe0a6b58c4de5a97d17053f7c6bf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.338021 7362 raft_consensus.cc:493] T 474e34e902064764864ba06ef41b1d94 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:16.338245 7362 raft_consensus.cc:515] T 474e34e902064764864ba06ef41b1d94 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.339252 7362 leader_election.cc:290] T 474e34e902064764864ba06ef41b1d94 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:16.339329 6180 tablet_service.cc:1511] Processing CreateTablet for tablet 14a41affa49e4bf499cde0789a36d8d8 (DEFAULT_TABLE table=default.Table_7c503dc2bcda44d0b99f66019026968d [id=ce9e3c54a9b14c8c99132837c080e4ad]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:16.340618 5790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.143.254:37151, user_credentials={real_user=slave}} blocked reactor thread for 298703us
I20260923 19:50:16.341786 5804 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_973f7a2560ab48ad8d84aeb2f4fc235b" } modify_external_catalogs: true
I20260923 19:50:16.342038 5804 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_973f7a2560ab48ad8d84aeb2f4fc235b" } modify_external_catalogs: true
I20260923 19:50:16.342193 5798 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_91d4a2993b4b4ecea5fda676d43c5a18" } modify_external_catalogs: true
I20260923 19:50:16.342708 6165 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e41501bf01e4765853c27e4cac21e2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:16.342795 5798 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_91d4a2993b4b4ecea5fda676d43c5a18" } modify_external_catalogs: true
I20260923 19:50:16.343035 6182 tablet_service.cc:1511] Processing CreateTablet for tablet 1b7d35282dd148e7bfcf1277d34002bf (DEFAULT_TABLE table=default.Table_9eb8348988b14a1e8b36839078e0f2d2 [id=748d7b66dd7a47c59f86817972b0dccc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.343701 5801 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_fa3fcc5532af4101a61de0798a50be97" } modify_external_catalogs: true
I20260923 19:50:16.343869 5801 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_fa3fcc5532af4101a61de0798a50be97" } modify_external_catalogs: true
I20260923 19:50:16.343895 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_76b550f8599f4650b443c16ae2483ba8" } modify_external_catalogs: true
I20260923 19:50:16.344041 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_76b550f8599f4650b443c16ae2483ba8" } modify_external_catalogs: true
I20260923 19:50:16.345660 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_769b0dad8d264f458b46793b701ef2bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:16.346205 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_769b0dad8d264f458b46793b701ef2bc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:16.349402 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_14291874bbe14b46940404de2dc7b51e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:16.349431 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_9f22e0d8c3e240478c41d7eb8e843594"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:16.350401 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f22e0d8c3e240478c41d7eb8e843594 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:16.350684 6279 leader_election.cc:343] T 474e34e902064764864ba06ef41b1d94 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 474e34e902064764864ba06ef41b1d94
I20260923 19:50:16.350807 5799 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b0ee37845cb4472db1adf576ec6ce4e2" } modify_external_catalogs: true
I20260923 19:50:16.351294 5799 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b0ee37845cb4472db1adf576ec6ce4e2" } modify_external_catalogs: true
I20260923 19:50:16.337265 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 655) took 2140 ms. Trace:
W20260923 19:50:16.351522 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_14291874bbe14b46940404de2dc7b51e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:16.351643 6458 rpcz_store.cc:276] 0923 19:50:14.196565 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.197163 (+ 598us) service_pool.cc:224] Handling call
0923 19:50:16.221298 (+2024135us) ts_tablet_manager.cc:1151] Deleting tablet ec4cc8a742114e5fb07c5c9157ce09e8
0923 19:50:16.221307 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:16.268317 (+ 47010us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:16.278682 (+ 10365us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:16.337239 (+ 58557us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2023947}
I20260923 19:50:16.352878 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet ec4cc8a742114e5fb07c5c9157ce09e8 (table default.Table_72032a8e8a254d2bad8358ebf75f1615 [id=89181985e6154c7fa946148e48bef2eb]) successfully deleted
I20260923 19:50:16.354687 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 653) took 2164 ms. Trace:
I20260923 19:50:16.357810 5802 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 8d87f05f29bd476386ff6516676ce31a (table default.Table_9fa8f8bfc6124f398a4acdf5e1e0b33a [id=02d2ab56def342c482c86ce96110342f]). Expected version 1 got 0
I20260923 19:50:16.358106 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 62c0cf7f070e467dafaed442b6b8c15d
I20260923 19:50:16.196067 6457 tablet_bootstrap.cc:654] T b87872fb6cc0400c86eddffb29c898e8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:16.362321 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 62c0cf7f070e467dafaed442b6b8c15d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:16.362918 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet efc63a151f6444dfb03c3f15f6f54473 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:07 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:16.355057 6458 rpcz_store.cc:276] 0923 19:50:14.189752 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.211340 (+ 21588us) service_pool.cc:224] Handling call
0923 19:50:16.353624 (+2142284us) ts_tablet_manager.cc:1151] Deleting tablet 9756a1f8e23a436bb7c19c8cba7bdc05
0923 19:50:16.353637 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:16.354574 (+ 937us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2141959}
I20260923 19:50:16.363814 6176 tablet_service.cc:1511] Processing CreateTablet for tablet fcc32bda7c684e849161f9d4a3df79d3 (DEFAULT_TABLE table=default.Table_23216d517be14547b1a57de90be93f03 [id=a925e4a6dd1d4a95896253ffb1a0d970]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.365396 6170 tablet_service.cc:1511] Processing CreateTablet for tablet 115b8a9e79c64e84bc0ee9cdab636b94 (DEFAULT_TABLE table=default.Table_b1d68ffe395448d195d5a18f8dae7539 [id=27331fb9c47646388b3102f8480dbaaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.370893 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_8590246f18b44aa9833d9152591b144b" } new_table_name: "default.Table_d25d7e79926a44b787f91190666493a9" modify_external_catalogs: true
I20260923 19:50:16.371062 5802 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_8a3be67d9a6c40bd90d313bff635b25a" } new_table_name: "default.Table_454977731aee4768be1b7437bb41c1ba" modify_external_catalogs: true
I20260923 19:50:16.372553 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 5ad33cd4913941c6aa2fea717608ef7c (DEFAULT_TABLE table=default.Table_611375feff304538a80e8b1eca51b3cd [id=320d0532910f4d60aacd0426a3aec2b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.373018 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ad33cd4913941c6aa2fea717608ef7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.373601 6343 raft_consensus.cc:2468] T 35f46a1be80c4194b592c5d00fe1f342 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 1.
I20260923 19:50:16.376343 5996 leader_election.cc:304] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:16.376789 7134 raft_consensus.cc:2804] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:16.378178 6391 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
I20260923 19:50:16.382735 6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4bb6958a8a0410fbac59e0ff39539ad. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:16.383044 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 9756a1f8e23a436bb7c19c8cba7bdc05 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9756a1f8e23a436bb7c19c8cba7bdc05 already in progress: creating tablet
I20260923 19:50:16.394315 7499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae: Bootstrap starting.
I20260923 19:50:16.394587 6458 tablet_replica.cc:333] T 601a0ff319cc4c9a898d52bbcb19184b P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:16.395541 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 382daee3555642b7a767a35c2f49b98a (DEFAULT_TABLE table=default.Table_fa3fcc5532af4101a61de0798a50be97 [id=ba15210503de4471992e91c6ade38ac3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.396019 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 382daee3555642b7a767a35c2f49b98a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.396834 6458 raft_consensus.cc:2243] T 601a0ff319cc4c9a898d52bbcb19184b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:16.397667 6458 raft_consensus.cc:2272] T 601a0ff319cc4c9a898d52bbcb19184b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:16.398478 6456 tablet_bootstrap.cc:492] T 5e711e48156b46b5a517b330d6d41309 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:16.399281 6456 ts_tablet_manager.cc:1403] T 5e711e48156b46b5a517b330d6d41309 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.264s user 0.023s sys 0.014s
I20260923 19:50:16.400614 6458 ts_tablet_manager.cc:1916] T 601a0ff319cc4c9a898d52bbcb19184b P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:16.403599 6165 tablet_service.cc:1511] Processing CreateTablet for tablet 4ac35ccdcf254b7e8b59926fcc9bd1cf (DEFAULT_TABLE table=default.Table_98bbea51f78c4eb6872b30a01002be31 [id=ae2e7200b0df46649df2de751fd6c209]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.342907 6174 tablet_service.cc:1511] Processing CreateTablet for tablet d39bfd7ec454447cbcc6ed965973355c (DEFAULT_TABLE table=default.Table_3cfe796a43654c54be5f70f57774c2fd [id=b817eacce9dd42f994bf36ca9a377347]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.403090 6456 raft_consensus.cc:359] T 5e711e48156b46b5a517b330d6d41309 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.404184 6456 raft_consensus.cc:385] T 5e711e48156b46b5a517b330d6d41309 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:16.404558 6456 raft_consensus.cc:740] T 5e711e48156b46b5a517b330d6d41309 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:16.404960 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ce6378a6bd844a485aebb96081307e3" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:16.405361 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ce6378a6bd844a485aebb96081307e3" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:16.406203 6166 tablet_service.cc:1511] Processing CreateTablet for tablet 2c6b2e4dac9749e58d01a838c2472bbc (DEFAULT_TABLE table=default.Table_9f11e4333c1242e1bfd461bd7c79a6d7 [id=ccd2727d297147f88427167e65caf2cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.407657 6029 tablet_service.cc:1511] Processing CreateTablet for tablet a55b2ff045d648339d7e207f13e2fa27 (DEFAULT_TABLE table=default.Table_b0b796ec295042f8a2b294c7dd1d6136 [id=c472d4f734384207af159c3738b88a49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.407914 6040 tablet_service.cc:1511] Processing CreateTablet for tablet d39bfd7ec454447cbcc6ed965973355c (DEFAULT_TABLE table=default.Table_3cfe796a43654c54be5f70f57774c2fd [id=b817eacce9dd42f994bf36ca9a377347]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.408007 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a55b2ff045d648339d7e207f13e2fa27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.408231 6030 tablet_service.cc:1511] Processing CreateTablet for tablet 295502f94faf4d4880e9516aa8d9cb79 (DEFAULT_TABLE table=default.Table_5bf3acc342a34bba8f50e005425b4c5d [id=a34c7ad2f3004c6e908b87fb99389632]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.408550 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295502f94faf4d4880e9516aa8d9cb79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.406121 6456 consensus_queue.cc:260] T 5e711e48156b46b5a517b330d6d41309 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.414026 6040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d39bfd7ec454447cbcc6ed965973355c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.414173 6032 tablet_service.cc:1511] Processing CreateTablet for tablet 18b4ed7ef6dc468096b92a1ffa64c7d9 (DEFAULT_TABLE table=default.Table_7fd5aef2a3c648f8bb0354e14380c716 [id=6892d0c8f40b4015b756de3d181cacb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.414517 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18b4ed7ef6dc468096b92a1ffa64c7d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.418308 6038 tablet_service.cc:1511] Processing CreateTablet for tablet adafe0a6b58c4de5a97d17053f7c6bf1 (DEFAULT_TABLE table=default.Table_7dbacc6620d24105a6e2a2b21c26af26 [id=bcfcc79a0a284247b9be768e462b8acd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.418648 6038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adafe0a6b58c4de5a97d17053f7c6bf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.419045 6457 tablet_bootstrap.cc:492] T b87872fb6cc0400c86eddffb29c898e8 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:16.419262 6456 ts_tablet_manager.cc:1434] T 5e711e48156b46b5a517b330d6d41309 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.020s user 0.002s sys 0.000s
I20260923 19:50:16.422583 6035 tablet_service.cc:1511] Processing CreateTablet for tablet 14a41affa49e4bf499cde0789a36d8d8 (DEFAULT_TABLE table=default.Table_7c503dc2bcda44d0b99f66019026968d [id=ce9e3c54a9b14c8c99132837c080e4ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.422657 6021 tablet_service.cc:1511] Processing CreateTablet for tablet 3ca71d8573d1498a91aaf6cb4b9f0845 (DEFAULT_TABLE table=default.Table_e13bfd92341c4edea1d722b5eba5e696 [id=7ccfde56715d421e845a633a94cc5695]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.422927 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14a41affa49e4bf499cde0789a36d8d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.422868 6023 tablet_service.cc:1511] Processing CreateTablet for tablet fcc32bda7c684e849161f9d4a3df79d3 (DEFAULT_TABLE table=default.Table_23216d517be14547b1a57de90be93f03 [id=a925e4a6dd1d4a95896253ffb1a0d970]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.422950 6022 tablet_service.cc:1511] Processing CreateTablet for tablet 4ac35ccdcf254b7e8b59926fcc9bd1cf (DEFAULT_TABLE table=default.Table_98bbea51f78c4eb6872b30a01002be31 [id=ae2e7200b0df46649df2de751fd6c209]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.423241 6036 tablet_service.cc:1511] Processing CreateTablet for tablet 115b8a9e79c64e84bc0ee9cdab636b94 (DEFAULT_TABLE table=default.Table_b1d68ffe395448d195d5a18f8dae7539 [id=27331fb9c47646388b3102f8480dbaaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.423446 6026 tablet_service.cc:1511] Processing CreateTablet for tablet 95630644f0a242d8b8449f12bd6a3de5 (DEFAULT_TABLE table=default.Table_b86593b9d27b4c5180563a796c645133 [id=78e58889d09f40199e60ffff052d1fde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.423306 6024 tablet_service.cc:1511] Processing CreateTablet for tablet 2c6b2e4dac9749e58d01a838c2472bbc (DEFAULT_TABLE table=default.Table_9f11e4333c1242e1bfd461bd7c79a6d7 [id=ccd2727d297147f88427167e65caf2cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.423764 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 872e939a37e642d7b10fa2b98395ed6d (DEFAULT_TABLE table=default.Table_ffe6f0b7197a452aafba7eebbabcbcfe [id=b3726f123e174878aede71dbffef9ae7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.423938 6039 tablet_service.cc:1558] Processing DeleteTablet for tablet d8c8bfa9b7424b9f80f76e0bb05cbc0c with delete_type TABLET_DATA_DELETED (replaced by tablet cf64073cdde748bc8ed3ce7580a71160) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:16.424129 6039 tablet_service.cc:1558] Processing DeleteTablet for tablet 83dba06b0d0040889015fb052c642ec0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:16.424093 6027 tablet_service.cc:1511] Processing CreateTablet for tablet cf3ab578ef1442f19d629b61dc73a970 (DEFAULT_TABLE table=default.Table_7ce588248ce944fc878bbe47bbbbc8fe [id=46b5a5f448ab42a3aff6665c3a4e769d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.424238 6039 tablet_service.cc:1558] Processing DeleteTablet for tablet b18548ba557f448880c5e617fc03cbe0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:16.424533 6023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcc32bda7c684e849161f9d4a3df79d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.426097 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ac35ccdcf254b7e8b59926fcc9bd1cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.426126 6033 tablet_service.cc:1511] Processing CreateTablet for tablet 1b7d35282dd148e7bfcf1277d34002bf (DEFAULT_TABLE table=default.Table_9eb8348988b14a1e8b36839078e0f2d2 [id=748d7b66dd7a47c59f86817972b0dccc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.426467 6033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b7d35282dd148e7bfcf1277d34002bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.426945 6025 tablet_service.cc:1511] Processing CreateTablet for tablet 34932207ec4145cf9f6ec59d1282d03b (DEFAULT_TABLE table=default.Table_927e705db46045d0ab15c515a2eed8d7 [id=06e3f91bd8c343378acfec194470ba00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.427232 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34932207ec4145cf9f6ec59d1282d03b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.430132 6036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 115b8a9e79c64e84bc0ee9cdab636b94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.432196 6031 tablet_service.cc:1511] Processing CreateTablet for tablet 1e835fa95fa84b43be4c27b7e3e26af3 (DEFAULT_TABLE table=default.Table_b7b81a79b9a24504adbefb5a52b17e4f [id=1e986e2630b843bcbb585d5d228d42c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.432518 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e835fa95fa84b43be4c27b7e3e26af3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.438691 6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95630644f0a242d8b8449f12bd6a3de5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.439014 6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ca71d8573d1498a91aaf6cb4b9f0845. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.441697 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 525875ed1ba1484680f83c1f514df0c5 (DEFAULT_TABLE table=default.Table_a86b468f8e19450da6a1123193689d75 [id=6b4fea99f3c54a3a8ef893ad5f8f0abd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.442041 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 525875ed1ba1484680f83c1f514df0c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.442442 6024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c6b2e4dac9749e58d01a838c2472bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.445948 7134 raft_consensus.cc:697] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Becoming Leader. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Running, Role: LEADER
I20260923 19:50:16.446220 7134 consensus_queue.cc:237] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.446839 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf3ab578ef1442f19d629b61dc73a970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.447518 6028 tablet_service.cc:1511] Processing CreateTablet for tablet d4bb6958a8a0410fbac59e0ff39539ad (DEFAULT_TABLE table=default.Table_1acd164e2b1143a0abc77f70a0178d34 [id=1667c2dec35f4b4fae0e86e6414680f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.447899 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4bb6958a8a0410fbac59e0ff39539ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.420121 6457 ts_tablet_manager.cc:1403] T b87872fb6cc0400c86eddffb29c898e8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.228s user 0.004s sys 0.000s
I20260923 19:50:16.452564 6456 tablet_bootstrap.cc:492] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:16.453357 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_cac7a266c93b4f28a3ceff8c08002256"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:16.454005 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 872e939a37e642d7b10fa2b98395ed6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.455874 6461 ts_tablet_manager.cc:1929] T c7369a5fc87f4b70bcfbe052ef021771 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:16.455977 6461 log.cc:1199] T c7369a5fc87f4b70bcfbe052ef021771 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/c7369a5fc87f4b70bcfbe052ef021771
I20260923 19:50:16.456286 6461 ts_tablet_manager.cc:1950] T c7369a5fc87f4b70bcfbe052ef021771 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:16.456830 6457 raft_consensus.cc:359] T b87872fb6cc0400c86eddffb29c898e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.459170 6457 raft_consensus.cc:385] T b87872fb6cc0400c86eddffb29c898e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:16.460119 6457 raft_consensus.cc:740] T b87872fb6cc0400c86eddffb29c898e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:16.460791 7513 raft_consensus.cc:493] T b9c187ee1fa8438397c83bc2c2b16925 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260923 19:50:16.464577 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cac7a266c93b4f28a3ceff8c08002256 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:16.464625 7513 raft_consensus.cc:515] T b9c187ee1fa8438397c83bc2c2b16925 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.465405 6457 consensus_queue.cc:260] T b87872fb6cc0400c86eddffb29c898e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.472000 6343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c187ee1fa8438397c83bc2c2b16925" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:16.472723 5996 leader_election.cc:343] T b9c187ee1fa8438397c83bc2c2b16925 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:16.473362 6456 tablet_bootstrap.cc:654] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:16.473798 6457 ts_tablet_manager.cc:1434] T b87872fb6cc0400c86eddffb29c898e8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
I20260923 19:50:16.474140 7513 leader_election.cc:290] T b9c187ee1fa8438397c83bc2c2b16925 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:16.475171 6457 tablet_bootstrap.cc:492] T dbe06eba8067413a903e4a07c2768484 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:16.479079 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet 62c0cf7f070e467dafaed442b6b8c15d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:16.475095 5801 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 382daee3555642b7a767a35c2f49b98a
I20260923 19:50:16.475528 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet f4313a4d8a9c411fad593b05ad655fc4
I20260923 19:50:16.482299 6308 tablet_service.cc:1558] Processing DeleteTablet for tablet f4313a4d8a9c411fad593b05ad655fc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:16.483840 6457 tablet_bootstrap.cc:654] T dbe06eba8067413a903e4a07c2768484 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:16.490360 6458 ts_tablet_manager.cc:1929] T 601a0ff319cc4c9a898d52bbcb19184b P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:16.491528 6458 log.cc:1199] T 601a0ff319cc4c9a898d52bbcb19184b P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/601a0ff319cc4c9a898d52bbcb19184b
I20260923 19:50:16.494431 6458 ts_tablet_manager.cc:1950] T 601a0ff319cc4c9a898d52bbcb19184b P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:16.495505 6457 tablet_bootstrap.cc:492] T dbe06eba8067413a903e4a07c2768484 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:16.497176 6456 tablet_bootstrap.cc:492] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:16.497418 6456 ts_tablet_manager.cc:1403] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.045s user 0.002s sys 0.004s
I20260923 19:50:16.498358 6456 raft_consensus.cc:359] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.498876 6456 raft_consensus.cc:385] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:16.499109 6456 raft_consensus.cc:740] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:16.478658 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet a01a86b6fd4b44d3808c2040525d7b61 (table default.Table_d2249132d73a45758b64da97b668320e [id=bf20ac3f66704af69ceb4531253cbd15]) successfully deleted
I20260923 19:50:16.499658 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet f7cf45d4c4d3480288698682c1c85869 (table default.Table_4cb745719e44465b8bdd1ed8a1e04b8e [id=e107798635ee473eb50362535f76985d]) successfully deleted
W20260923 19:50:16.499922 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 717995ec489343118809ada2a6b58804 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 717995ec489343118809ada2a6b58804 already in progress: creating tablet
I20260923 19:50:16.499645 6456 consensus_queue.cc:260] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.503922 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet c7369a5fc87f4b70bcfbe052ef021771 (table default.Table_295f07d1ca7345d5a18a80da04089ca2 [id=26fc3d5dd42441098cdd17a5d73d219d]) successfully deleted
I20260923 19:50:16.505053 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet 382daee3555642b7a767a35c2f49b98a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:16.506672 6456 ts_tablet_manager.cc:1434] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260923 19:50:16.506755 6461 tablet_replica.cc:333] T b9c187ee1fa8438397c83bc2c2b16925 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:16.506929 6461 raft_consensus.cc:2243] T b9c187ee1fa8438397c83bc2c2b16925 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:16.507216 6461 raft_consensus.cc:2272] T b9c187ee1fa8438397c83bc2c2b16925 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:16.507727 6461 ts_tablet_manager.cc:1916] T b9c187ee1fa8438397c83bc2c2b16925 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:16.510226 6316 tablet_service.cc:1558] Processing DeleteTablet for tablet 382daee3555642b7a767a35c2f49b98a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:16.496359 6457 ts_tablet_manager.cc:1403] T dbe06eba8067413a903e4a07c2768484 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.021s user 0.006s sys 0.000s
I20260923 19:50:16.511451 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet cffe24ab4df745e3a34f82e8ca7b39f5
I20260923 19:50:16.512108 6456 tablet_bootstrap.cc:492] T b7ba284e81bc4388bbd6456a41d1f9f4 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:16.512058 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 656) took 2279 ms. Trace:
I20260923 19:50:16.513113 6316 tablet_service.cc:1558] Processing DeleteTablet for tablet cffe24ab4df745e3a34f82e8ca7b39f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:16.513383 6458 rpcz_store.cc:276] 0923 19:50:14.233110 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.310255 (+ 77145us) service_pool.cc:224] Handling call
0923 19:50:16.393847 (+2083592us) ts_tablet_manager.cc:1151] Deleting tablet 601a0ff319cc4c9a898d52bbcb19184b
0923 19:50:16.394303 (+ 456us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:16.470116 (+ 75813us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:16.490035 (+ 19919us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:16.511545 (+ 21510us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2083256}
I20260923 19:50:16.515021 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 601a0ff319cc4c9a898d52bbcb19184b (table default.Table_5812b40db6ab4814a5c5b3c869967f58 [id=df481a17409f4078a57a0aef11bef720]) successfully deleted
I20260923 19:50:16.516830 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "474e34e902064764864ba06ef41b1d94" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:16.517885 5799 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 401d909c37ec4daaa210e4fc32d838aa
I20260923 19:50:16.519089 5804 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b615fa2da8c94949bed2f458156fc128" } new_table_name: "default.Table_92f3bea4e4164a738fb75f01e95cd776" modify_external_catalogs: true
I20260923 19:50:16.519721 5797 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_792882a419914f80a8e5bb625dbe633e" } new_table_name: "default.Table_3f7aea8c4b01456887ad705c059f1572" modify_external_catalogs: true
I20260923 19:50:16.520403 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_acafa9eab1a2413fb05d955b844452ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:16.520936 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_acafa9eab1a2413fb05d955b844452ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:16.521279 5796 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_036527853b5f467ab42e956cc35b2081" } new_table_name: "default.Table_ea8c4179d37e4165869f5bf030971467" modify_external_catalogs: true
I20260923 19:50:16.515704 6458 tablet_replica.cc:333] T 7b1601590508479c8f401cd09d9f4c3b P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:16.523629 6454 tablet_bootstrap.cc:654] T 7b1601590508479c8f401cd09d9f4c3b P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:16.527510 6280 leader_election.cc:343] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:16.527778 6280 leader_election.cc:304] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:16.528204 6280 leader_election.cc:343] T 035abecfbee7474d9dd048f35e28e867 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:16.528297 6280 leader_election.cc:304] T 035abecfbee7474d9dd048f35e28e867 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:16.528734 6280 leader_election.cc:343] T a11ecef9a24f4e4a812ec220b6a92cc4 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:16.528816 6280 leader_election.cc:304] T a11ecef9a24f4e4a812ec220b6a92cc4 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:16.529134 6280 leader_election.cc:343] T 12f4abb573bd4be6961b55c27c684d06 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:16.529378 6280 leader_election.cc:343] T 12f4abb573bd4be6961b55c27c684d06 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:16.529793 7362 raft_consensus.cc:2749] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:16.529984 7362 raft_consensus.cc:2749] T 035abecfbee7474d9dd048f35e28e867 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:16.530261 7362 raft_consensus.cc:2749] T a11ecef9a24f4e4a812ec220b6a92cc4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:16.531484 7316 raft_consensus.cc:493] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:16.531653 7316 raft_consensus.cc:515] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.532379 7316 leader_election.cc:290] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:16.534312 6316 tablet_service.cc:1558] Processing DeleteTablet for tablet 401d909c37ec4daaa210e4fc32d838aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:16.536536 7352 raft_consensus.cc:493] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:16.536667 7352 raft_consensus.cc:515] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.537284 7352 leader_election.cc:290] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:16.539819 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_fff6175767d74b3785fa69b365c1e4b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:16.540585 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fff6175767d74b3785fa69b365c1e4b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:16.541188 6054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e7cb3e5f54dfdb2280c795ce2ce53" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:16.541378 6054 raft_consensus.cc:2468] T f74e7cb3e5f54dfdb2280c795ce2ce53 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:16.541822 6279 leader_election.cc:304] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:16.542250 7352 raft_consensus.cc:2804] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:16.542325 7352 raft_consensus.cc:493] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:16.542384 7352 raft_consensus.cc:3060] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:16.546324 7352 raft_consensus.cc:515] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.547605 7352 leader_election.cc:290] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:16.549585 6054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e7cb3e5f54dfdb2280c795ce2ce53" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:16.549818 6054 raft_consensus.cc:3060] T f74e7cb3e5f54dfdb2280c795ce2ce53 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:16.558450 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet f4313a4d8a9c411fad593b05ad655fc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:16.559536 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet cffe24ab4df745e3a34f82e8ca7b39f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:16.562839 5791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.143.252:45543, user_credentials={real_user=slave}} blocked reactor thread for 89347.7us
I20260923 19:50:16.572496 6059 raft_consensus.cc:2468] T 2ce6378a6bd844a485aebb96081307e3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:16.573148 6279 leader_election.cc:304] T 2ce6378a6bd844a485aebb96081307e3 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:16.578801 6106 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
I20260923 19:50:16.580590 7362 raft_consensus.cc:2804] T 2ce6378a6bd844a485aebb96081307e3 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:16.580742 7362 raft_consensus.cc:697] T 2ce6378a6bd844a485aebb96081307e3 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:16.580739 6177 tablet_service.cc:1558] Processing DeleteTablet for tablet 62c0cf7f070e467dafaed442b6b8c15d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:16.580965 6172 tablet_service.cc:1558] Processing DeleteTablet for tablet 382daee3555642b7a767a35c2f49b98a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:16.580988 7362 consensus_queue.cc:237] T 2ce6378a6bd844a485aebb96081307e3 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:16.576565 6280 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 46957.7us
W20260923 19:50:16.586076 6280 leader_election.cc:343] T 2ce6378a6bd844a485aebb96081307e3 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:16.587201 6280 leader_election.cc:343] T 2ce6378a6bd844a485aebb96081307e3 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:16.587288 6054 raft_consensus.cc:2468] T f74e7cb3e5f54dfdb2280c795ce2ce53 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
W20260923 19:50:16.588855 6280 consensus_peers.cc:597] T 8d87f05f29bd476386ff6516676ce31a P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:16.589030 6172 tablet_service.cc:1558] Processing DeleteTablet for tablet f4313a4d8a9c411fad593b05ad655fc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:16.589155 7505 raft_consensus.cc:493] T 2ccfe6531fc44f86a0edc8bda1547442 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:16.589613 7505 raft_consensus.cc:515] T 2ccfe6531fc44f86a0edc8bda1547442 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.591483 6172 tablet_service.cc:1558] Processing DeleteTablet for tablet cffe24ab4df745e3a34f82e8ca7b39f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:16.593034 6172 tablet_service.cc:1558] Processing DeleteTablet for tablet 401d909c37ec4daaa210e4fc32d838aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:16.593497 6279 leader_election.cc:304] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:16.593977 7490 raft_consensus.cc:2804] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:16.594090 7490 raft_consensus.cc:697] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:16.594323 7490 consensus_queue.cc:237] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.595197 7505 leader_election.cc:290] T 2ccfe6531fc44f86a0edc8bda1547442 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:16.605284 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet 401d909c37ec4daaa210e4fc32d838aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:16.607064 6458 raft_consensus.cc:2243] T 7b1601590508479c8f401cd09d9f4c3b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:16.609285 6458 raft_consensus.cc:2272] T 7b1601590508479c8f401cd09d9f4c3b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:16.610358 6461 ts_tablet_manager.cc:1929] T b9c187ee1fa8438397c83bc2c2b16925 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:16.610474 6461 log.cc:1199] T b9c187ee1fa8438397c83bc2c2b16925 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/b9c187ee1fa8438397c83bc2c2b16925
I20260923 19:50:16.610780 6461 ts_tablet_manager.cc:1950] T b9c187ee1fa8438397c83bc2c2b16925 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:16.611968 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet b9c187ee1fa8438397c83bc2c2b16925 (table default.Table_76a4d42c4ee8417fa82124f036ec71de [id=220774101a2442309f08c3d6f8713956]) successfully deleted
W20260923 19:50:16.612365 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 22c89609da884c47b1dbc1470b37efbe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22c89609da884c47b1dbc1470b37efbe already in progress: creating tablet
W20260923 19:50:16.612694 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 5494818771f04f92b37a6991b73e40a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5494818771f04f92b37a6991b73e40a6 already in progress: creating tablet
W20260923 19:50:16.608145 6280 leader_election.cc:343] T 474e34e902064764864ba06ef41b1d94 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:16.613022 6280 leader_election.cc:304] T 474e34e902064764864ba06ef41b1d94 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:16.613344 7256 raft_consensus.cc:2749] T 474e34e902064764864ba06ef41b1d94 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:16.613969 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 8788f1917cb0449f84f92df2c81feff6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8788f1917cb0449f84f92df2c81feff6 already in progress: creating tablet
I20260923 19:50:16.615978 6456 tablet_bootstrap.cc:654] T b7ba284e81bc4388bbd6456a41d1f9f4 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:16.616993 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 8b4c2a0ae64841c6971a0840c1d5b739 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b4c2a0ae64841c6971a0840c1d5b739 already in progress: creating tablet
W20260923 19:50:16.617287 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 900726a4f2f84dde90e8bb3ab26b71c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 900726a4f2f84dde90e8bb3ab26b71c9 already in progress: creating tablet
I20260923 19:50:16.617564 6458 ts_tablet_manager.cc:1916] T 7b1601590508479c8f401cd09d9f4c3b P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:16.619230 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e7cb3e5f54dfdb2280c795ce2ce53" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:16.619824 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 950428e098994f2a9b5b17eeb36915cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 950428e098994f2a9b5b17eeb36915cd already in progress: creating tablet
W20260923 19:50:16.620078 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet f9687b3f4b904e438d83533fb67cc92f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f9687b3f4b904e438d83533fb67cc92f already in progress: creating tablet
I20260923 19:50:16.620225 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74e7cb3e5f54dfdb2280c795ce2ce53" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:16.620348 6461 tablet_replica.cc:333] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:16.620548 6461 raft_consensus.cc:2243] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:16.620714 6461 raft_consensus.cc:2272] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:16.621330 6461 ts_tablet_manager.cc:1916] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:16.579347 6457 raft_consensus.cc:359] T dbe06eba8067413a903e4a07c2768484 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.621567 6457 raft_consensus.cc:385] T dbe06eba8067413a903e4a07c2768484 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:16.621665 6457 raft_consensus.cc:740] T dbe06eba8067413a903e4a07c2768484 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:16.622102 6457 consensus_queue.cc:260] T dbe06eba8067413a903e4a07c2768484 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:16.630017 6137 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s user 0.010s sys 0.002s
W20260923 19:50:16.630141 6137 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.519s user 0.010s sys 0.002s
W20260923 19:50:16.643379 6280 leader_election.cc:343] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:16.643803 5802 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4e69656e9fc941e19eb7de5c87bc9050 consensus state has no leader
W20260923 19:50:16.647289 5796 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e6e04d16675443fc923a5f8216e292b6 consensus state has no leader
W20260923 19:50:16.647518 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 30c8d87fa60d455ba1a8ce9296a02c30 consensus state has no leader
W20260923 19:50:16.647718 5797 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9ee02922d2be45f5a1473a53a6f253c4 consensus state has no leader
I20260923 19:50:16.651695 6461 ts_tablet_manager.cc:1929] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260923 19:50:16.652377 6280 leader_election.cc:343] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:16.652441 5797 master_service.cc:960] ReplaceTablet: received request to replace tablet f8007918eca14c81947e5999fe13a705 from {username='slave'} at 127.0.0.1:59912
W20260923 19:50:16.652922 5804 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 397ec5e49673406cb26a2efab0ad8401 consensus state has no leader
I20260923 19:50:16.660549 6461 log.cc:1199] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/d8c8bfa9b7424b9f80f76e0bb05cbc0c
I20260923 19:50:16.661173 6461 ts_tablet_manager.cc:1950] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:16.662911 6456 tablet_bootstrap.cc:492] T b7ba284e81bc4388bbd6456a41d1f9f4 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:16.663147 6456 ts_tablet_manager.cc:1403] T b7ba284e81bc4388bbd6456a41d1f9f4 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.152s user 0.002s sys 0.002s
I20260923 19:50:16.663918 6456 raft_consensus.cc:359] T b7ba284e81bc4388bbd6456a41d1f9f4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:16.664450 6139 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s user 0.000s sys 0.010s
I20260923 19:50:16.666407 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c8bfa9b7424b9f80f76e0bb05cbc0c" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:16.667393 6461 tablet_replica.cc:333] T 83dba06b0d0040889015fb052c642ec0 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:16.667464 6454 tablet_bootstrap.cc:492] T 7b1601590508479c8f401cd09d9f4c3b P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:16.667626 6454 ts_tablet_manager.cc:1403] T 7b1601590508479c8f401cd09d9f4c3b P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.590s user 0.010s sys 0.003s
I20260923 19:50:16.667622 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac04be575704a69994f98e00411a254" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:16.667800 6461 raft_consensus.cc:2243] T 83dba06b0d0040889015fb052c642ec0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:16.668007 6461 raft_consensus.cc:2272] T 83dba06b0d0040889015fb052c642ec0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:16.668103 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fb0cab0bd43b7a05d7376125b187e" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:16.653692 6457 ts_tablet_manager.cc:1434] T dbe06eba8067413a903e4a07c2768484 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.142s user 0.003s sys 0.000s
I20260923 19:50:16.668609 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c187ee1fa8438397c83bc2c2b16925" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:16.669096 5995 leader_election.cc:343] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:16.669215 5995 leader_election.cc:304] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
W20260923 19:50:16.669378 5995 raft_consensus.cc:2686] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P e546f660e7e541d1aa9ae38e5ee5b9c0: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260923 19:50:16.670010 6461 ts_tablet_manager.cc:1916] T 83dba06b0d0040889015fb052c642ec0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:16.670686 5995 leader_election.cc:343] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:16.670178 6457 tablet_bootstrap.cc:492] T 34d62ab3d4aa457f8fea283cd9248a41 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:16.670789 5995 leader_election.cc:304] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:16.670992 7134 raft_consensus.cc:2749] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:16.671612 5995 leader_election.cc:343] T ed9fb0cab0bd43b7a05d7376125b187e P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:16.671710 5995 leader_election.cc:304] T ed9fb0cab0bd43b7a05d7376125b187e P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:16.671891 7134 raft_consensus.cc:2749] T ed9fb0cab0bd43b7a05d7376125b187e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:16.672403 5995 leader_election.cc:343] T b9c187ee1fa8438397c83bc2c2b16925 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:16.672518 5995 leader_election.cc:304] T b9c187ee1fa8438397c83bc2c2b16925 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
W20260923 19:50:16.672654 5995 raft_consensus.cc:2686] T b9c187ee1fa8438397c83bc2c2b16925 P e546f660e7e541d1aa9ae38e5ee5b9c0: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260923 19:50:16.673786 6139 leader_election.cc:343] T 235b4b8081ad4a13937a7941344dbc33 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 235b4b8081ad4a13937a7941344dbc33
W20260923 19:50:16.674263 6139 leader_election.cc:343] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 908596339b2e4f7f8ddb7f9cd5bdcc3e
I20260923 19:50:16.675298 7505 raft_consensus.cc:493] T f5cb8dd5dcf54df9989dd808fe148ce6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:16.675431 7505 raft_consensus.cc:515] T f5cb8dd5dcf54df9989dd808fe148ce6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.676067 7505 leader_election.cc:290] T f5cb8dd5dcf54df9989dd808fe148ce6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:16.675653 6139 leader_election.cc:343] T 2ccfe6531fc44f86a0edc8bda1547442 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 2ccfe6531fc44f86a0edc8bda1547442
I20260923 19:50:16.677263 6457 tablet_bootstrap.cc:654] T 34d62ab3d4aa457f8fea283cd9248a41 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:16.686302 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet d8c8bfa9b7424b9f80f76e0bb05cbc0c (table default.Table_f9942fca28234830913277dada229375 [id=662eb0a4f944445486929d42c5ebfd01]) successfully deleted
I20260923 19:50:16.688920 6454 raft_consensus.cc:359] T 7b1601590508479c8f401cd09d9f4c3b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.689289 6454 raft_consensus.cc:385] T 7b1601590508479c8f401cd09d9f4c3b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:16.665323 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e41501bf01e4765853c27e4cac21e2b" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:16.679327 7362 raft_consensus.cc:493] T d09faa67bdc54d31a7f7a1b012de9ba1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:16.694131 6341 raft_consensus.cc:2468] T 7e41501bf01e4765853c27e4cac21e2b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:16.694424 7362 raft_consensus.cc:515] T d09faa67bdc54d31a7f7a1b012de9ba1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:16.696218 6279 leader_election.cc:343] T d09faa67bdc54d31a7f7a1b012de9ba1 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: d09faa67bdc54d31a7f7a1b012de9ba1
I20260923 19:50:16.697216 7362 leader_election.cc:290] T d09faa67bdc54d31a7f7a1b012de9ba1 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:16.697531 6456 raft_consensus.cc:385] T b7ba284e81bc4388bbd6456a41d1f9f4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:16.697686 6456 raft_consensus.cc:740] T b7ba284e81bc4388bbd6456a41d1f9f4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:16.698210 6456 consensus_queue.cc:260] T b7ba284e81bc4388bbd6456a41d1f9f4 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.700070 6456 ts_tablet_manager.cc:1434] T b7ba284e81bc4388bbd6456a41d1f9f4 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.037s user 0.002s sys 0.000s
W20260923 19:50:16.703189 5791 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 78047.7us
I20260923 19:50:16.706841 5804 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_8e3f5612c14448349fdc0fddeaead3d0" } modify_external_catalogs: true
I20260923 19:50:16.707050 5804 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_8e3f5612c14448349fdc0fddeaead3d0" } modify_external_catalogs: true
I20260923 19:50:16.707635 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_d283141d43ef4b21bd1372ff52f6a711"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:16.707903 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_41da098c27d44ad3b986089b10f8b6ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:16.708222 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d283141d43ef4b21bd1372ff52f6a711 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:16.708421 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41da098c27d44ad3b986089b10f8b6ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:16.710000 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_9c1645ee01fb4c5eaa536d8115780393"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:16.710167 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_602f24694ce04fa887e6cb0112b325f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:16.689721 6454 raft_consensus.cc:740] T 7b1601590508479c8f401cd09d9f4c3b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
W20260923 19:50:16.710512 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9c1645ee01fb4c5eaa536d8115780393 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:16.710610 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_602f24694ce04fa887e6cb0112b325f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:16.710783 6454 consensus_queue.cc:260] T 7b1601590508479c8f401cd09d9f4c3b P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.711318 6454 ts_tablet_manager.cc:1434] T 7b1601590508479c8f401cd09d9f4c3b P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.043s user 0.001s sys 0.001s
I20260923 19:50:16.710912 5799 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 8d87f05f29bd476386ff6516676ce31a (table default.Table_9fa8f8bfc6124f398a4acdf5e1e0b33a [id=02d2ab56def342c482c86ce96110342f]). Expected version 1 got 0
I20260923 19:50:16.711633 6454 tablet_bootstrap.cc:492] T 7b455812687f42848df5290d0cdbc312 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:16.710302 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e835fa95fa84b43be4c27b7e3e26af3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.697214 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09faa67bdc54d31a7f7a1b012de9ba1" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:16.716663 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d39bfd7ec454447cbcc6ed965973355c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.718951 6461 ts_tablet_manager.cc:1929] T 83dba06b0d0040889015fb052c642ec0 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:16.721068 6461 log.cc:1199] T 83dba06b0d0040889015fb052c642ec0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/83dba06b0d0040889015fb052c642ec0
I20260923 19:50:16.721704 6461 ts_tablet_manager.cc:1950] T 83dba06b0d0040889015fb052c642ec0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
W20260923 19:50:16.722168 6280 leader_election.cc:343] T d09faa67bdc54d31a7f7a1b012de9ba1 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:16.722391 6280 leader_election.cc:304] T d09faa67bdc54d31a7f7a1b012de9ba1 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:16.722937 7362 raft_consensus.cc:2749] T d09faa67bdc54d31a7f7a1b012de9ba1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:16.727329 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 83dba06b0d0040889015fb052c642ec0 (table default.Table_cabd4e85a8824c7699003c51f4f0ead6 [id=33aab54b056646fe9324af773098823b]) successfully deleted
I20260923 19:50:16.727798 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adafe0a6b58c4de5a97d17053f7c6bf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.728116 6457 tablet_bootstrap.cc:492] T 34d62ab3d4aa457f8fea283cd9248a41 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:16.728286 6457 ts_tablet_manager.cc:1403] T 34d62ab3d4aa457f8fea283cd9248a41 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.060s user 0.005s sys 0.000s
I20260923 19:50:16.728987 6457 raft_consensus.cc:359] T 34d62ab3d4aa457f8fea283cd9248a41 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.729218 6457 raft_consensus.cc:385] T 34d62ab3d4aa457f8fea283cd9248a41 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:16.729319 6457 raft_consensus.cc:740] T 34d62ab3d4aa457f8fea283cd9248a41 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:16.729624 6457 consensus_queue.cc:260] T 34d62ab3d4aa457f8fea283cd9248a41 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.730273 6457 ts_tablet_manager.cc:1434] T 34d62ab3d4aa457f8fea283cd9248a41 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:16.730611 6457 tablet_bootstrap.cc:492] T d6d3601a392f4723b4ca00f6e12b950c P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:16.731746 6161 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:60136 (request call id 139) took 1005 ms. Trace:
I20260923 19:50:16.732164 6457 tablet_bootstrap.cc:654] T d6d3601a392f4723b4ca00f6e12b950c P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:16.732405 6461 tablet_replica.cc:333] T b18548ba557f448880c5e617fc03cbe0 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:16.733417 6461 raft_consensus.cc:2243] T b18548ba557f448880c5e617fc03cbe0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:16.733999 6461 raft_consensus.cc:2272] T b18548ba557f448880c5e617fc03cbe0 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:16.734547 6461 ts_tablet_manager.cc:1916] T b18548ba557f448880c5e617fc03cbe0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:16.740931 6458 ts_tablet_manager.cc:1929] T 7b1601590508479c8f401cd09d9f4c3b P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:16.742000 6182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b7d35282dd148e7bfcf1277d34002bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.741945 6161 rpcz_store.cc:276] 0923 19:50:15.726446 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.726506 (+ 60us) service_pool.cc:224] Handling call
0923 19:50:15.981015 (+254509us) spinlock_profiling.cc:243] Waited 92.9 ms on lock 0x616000212254. stack: 00007fc70c102366 00007fc70c102120 00007fc70b10c34d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007fc7181c5b50 00007fc71c0bd1ff 00007fc716484bd6 00007fc716484905 00007fc71324c63e 00007fc71324b51e 00007fc713251758 00007fc7132520bf 00007fc713251ee8 0000000000aaef9c
0923 19:50:16.731718 (+750703us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":213609856}
I20260923 19:50:16.737344 6454 tablet_bootstrap.cc:654] T 7b455812687f42848df5290d0cdbc312 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:16.746006 6176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcc32bda7c684e849161f9d4a3df79d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.749997 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14a41affa49e4bf499cde0789a36d8d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.739349 6459 ts_tablet_manager.cc:1929] T 896bd068e6b343e48eb2a01679b49326 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:16.754186 6459 log.cc:1199] T 896bd068e6b343e48eb2a01679b49326 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/896bd068e6b343e48eb2a01679b49326
I20260923 19:50:16.754925 6459 ts_tablet_manager.cc:1950] T 896bd068e6b343e48eb2a01679b49326 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:16.755295 6458 log.cc:1199] T 7b1601590508479c8f401cd09d9f4c3b P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/7b1601590508479c8f401cd09d9f4c3b
I20260923 19:50:16.756017 6458 ts_tablet_manager.cc:1950] T 7b1601590508479c8f401cd09d9f4c3b P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:16.761255 6165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ac35ccdcf254b7e8b59926fcc9bd1cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.762836 6454 tablet_bootstrap.cc:492] T 7b455812687f42848df5290d0cdbc312 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:16.763068 6454 ts_tablet_manager.cc:1403] T 7b455812687f42848df5290d0cdbc312 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.052s user 0.004s sys 0.000s
I20260923 19:50:16.764222 6454 raft_consensus.cc:359] T 7b455812687f42848df5290d0cdbc312 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.764597 6454 raft_consensus.cc:385] T 7b455812687f42848df5290d0cdbc312 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:16.764935 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18b4ed7ef6dc468096b92a1ffa64c7d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.764735 6454 raft_consensus.cc:740] T 7b455812687f42848df5290d0cdbc312 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:16.766382 6454 consensus_queue.cc:260] T 7b455812687f42848df5290d0cdbc312 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.767387 6454 ts_tablet_manager.cc:1434] T 7b455812687f42848df5290d0cdbc312 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260923 19:50:16.768349 6454 tablet_bootstrap.cc:492] T 465371cfbe544ba98e6eea05033ecf05 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:16.772059 5800 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_2b35ad69600645618a826140c33c4da8" } modify_external_catalogs: true
I20260923 19:50:16.772279 5800 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_2b35ad69600645618a826140c33c4da8" } modify_external_catalogs: true
I20260923 19:50:16.772879 5799 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_3cfe796a43654c54be5f70f57774c2fd" } modify_external_catalogs: true
I20260923 19:50:16.773052 5799 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_3cfe796a43654c54be5f70f57774c2fd" } modify_external_catalogs: true
I20260923 19:50:16.773638 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_d059170653dd4938887467bd38374ffc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:16.774210 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d059170653dd4938887467bd38374ffc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:16.775597 6454 tablet_bootstrap.cc:654] T 465371cfbe544ba98e6eea05033ecf05 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:16.775822 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95630644f0a242d8b8449f12bd6a3de5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.779915 6457 tablet_bootstrap.cc:492] T d6d3601a392f4723b4ca00f6e12b950c P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:16.780133 6457 ts_tablet_manager.cc:1403] T d6d3601a392f4723b4ca00f6e12b950c P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.050s user 0.003s sys 0.000s
I20260923 19:50:16.780200 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34932207ec4145cf9f6ec59d1282d03b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.780944 6457 raft_consensus.cc:359] T d6d3601a392f4723b4ca00f6e12b950c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.781194 6457 raft_consensus.cc:385] T d6d3601a392f4723b4ca00f6e12b950c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:16.781291 6457 raft_consensus.cc:740] T d6d3601a392f4723b4ca00f6e12b950c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:16.781594 6457 consensus_queue.cc:260] T d6d3601a392f4723b4ca00f6e12b950c P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.782294 6457 ts_tablet_manager.cc:1434] T d6d3601a392f4723b4ca00f6e12b950c P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:16.782836 6457 tablet_bootstrap.cc:492] T 98f61ace3a984938ace1fedbaa1dafa3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:16.784834 6457 tablet_bootstrap.cc:654] T 98f61ace3a984938ace1fedbaa1dafa3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:16.794009 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ca71d8573d1498a91aaf6cb4b9f0845. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.797075 6106 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
I20260923 19:50:16.797677 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c6b2e4dac9749e58d01a838c2472bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.800096 6170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 115b8a9e79c64e84bc0ee9cdab636b94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.801537 6454 tablet_bootstrap.cc:492] T 465371cfbe544ba98e6eea05033ecf05 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:16.801852 6454 ts_tablet_manager.cc:1403] T 465371cfbe544ba98e6eea05033ecf05 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.034s user 0.003s sys 0.004s
I20260923 19:50:16.802111 6461 ts_tablet_manager.cc:1929] T b18548ba557f448880c5e617fc03cbe0 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:16.802287 6461 log.cc:1199] T b18548ba557f448880c5e617fc03cbe0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/b18548ba557f448880c5e617fc03cbe0
I20260923 19:50:16.802670 6461 ts_tablet_manager.cc:1950] T b18548ba557f448880c5e617fc03cbe0 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:16.803197 6454 raft_consensus.cc:359] T 465371cfbe544ba98e6eea05033ecf05 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.803551 6454 raft_consensus.cc:385] T 465371cfbe544ba98e6eea05033ecf05 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:16.803694 6454 raft_consensus.cc:740] T 465371cfbe544ba98e6eea05033ecf05 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:16.804170 6454 consensus_queue.cc:260] T 465371cfbe544ba98e6eea05033ecf05 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.805558 6456 tablet_bootstrap.cc:492] T 22e37d5afa8047989928596b4092c4b9 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:16.805963 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet b18548ba557f448880c5e617fc03cbe0 (table default.Table_b7610081818744a5b76680621ab7212d [id=8b14917d9dc6415dbb75917bccf09502]) successfully deleted
I20260923 19:50:16.807371 6456 tablet_bootstrap.cc:654] T 22e37d5afa8047989928596b4092c4b9 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:16.807665 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 62c0cf7f070e467dafaed442b6b8c15d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 62c0cf7f070e467dafaed442b6b8c15d already in progress: creating tablet
I20260923 19:50:16.805162 6454 ts_tablet_manager.cc:1434] T 465371cfbe544ba98e6eea05033ecf05 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
W20260923 19:50:16.808269 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 382daee3555642b7a767a35c2f49b98a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 382daee3555642b7a767a35c2f49b98a already in progress: creating tablet
I20260923 19:50:16.808636 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 668) took 2449 ms. Trace:
I20260923 19:50:16.808712 6458 rpcz_store.cc:276] 0923 19:50:14.359479 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.359523 (+ 44us) service_pool.cc:224] Handling call
0923 19:50:16.515345 (+2155822us) ts_tablet_manager.cc:1151] Deleting tablet 7b1601590508479c8f401cd09d9f4c3b
0923 19:50:16.515512 (+ 167us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:16.707875 (+192363us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:16.740881 (+ 33006us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:16.808615 (+ 67734us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2155531}
W20260923 19:50:16.808907 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet f4313a4d8a9c411fad593b05ad655fc4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4313a4d8a9c411fad593b05ad655fc4 already in progress: creating tablet
I20260923 19:50:16.809024 6458 tablet_replica.cc:333] T 465371cfbe544ba98e6eea05033ecf05 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:16.809187 6458 raft_consensus.cc:2243] T 465371cfbe544ba98e6eea05033ecf05 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:16.809311 6454 tablet_bootstrap.cc:492] T 1fcd1c1bfd2c437a955c34569605a6d4 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:16.809316 6458 raft_consensus.cc:2272] T 465371cfbe544ba98e6eea05033ecf05 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:16.809623 6457 tablet_bootstrap.cc:492] T 98f61ace3a984938ace1fedbaa1dafa3 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:16.809741 6457 ts_tablet_manager.cc:1403] T 98f61ace3a984938ace1fedbaa1dafa3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.027s user 0.001s sys 0.001s
I20260923 19:50:16.809795 6458 ts_tablet_manager.cc:1916] T 465371cfbe544ba98e6eea05033ecf05 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:16.810658 6457 raft_consensus.cc:359] T 98f61ace3a984938ace1fedbaa1dafa3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.810823 6457 raft_consensus.cc:385] T 98f61ace3a984938ace1fedbaa1dafa3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:16.810873 6457 raft_consensus.cc:740] T 98f61ace3a984938ace1fedbaa1dafa3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:16.811053 6457 consensus_queue.cc:260] T 98f61ace3a984938ace1fedbaa1dafa3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.813446 6457 ts_tablet_manager.cc:1434] T 98f61ace3a984938ace1fedbaa1dafa3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260923 19:50:16.813730 6457 tablet_bootstrap.cc:492] T 1b1d9413e1e24547b491a160d851377b P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:16.815261 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 7b1601590508479c8f401cd09d9f4c3b (table default.Table_d824a438d0804f58b8b89f6f0f0f964e [id=83a0bf386540479b9e915b9c66a31376]) successfully deleted
I20260923 19:50:16.820425 6454 tablet_bootstrap.cc:654] T 1fcd1c1bfd2c437a955c34569605a6d4 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:16.822142 6458 ts_tablet_manager.cc:1929] T 465371cfbe544ba98e6eea05033ecf05 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:16.824199 6458 log.cc:1199] T 465371cfbe544ba98e6eea05033ecf05 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/465371cfbe544ba98e6eea05033ecf05
I20260923 19:50:16.824743 6458 ts_tablet_manager.cc:1950] T 465371cfbe544ba98e6eea05033ecf05 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:16.825934 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 667) took 2466 ms. Trace:
W20260923 19:50:16.826819 6137 leader_election.cc:343] T 7e41501bf01e4765853c27e4cac21e2b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 7e41501bf01e4765853c27e4cac21e2b
W20260923 19:50:16.828047 6137 leader_election.cc:343] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 908596339b2e4f7f8ddb7f9cd5bdcc3e
I20260923 19:50:16.828245 6458 rpcz_store.cc:276] 0923 19:50:14.359353 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.359400 (+ 47us) service_pool.cc:224] Handling call
0923 19:50:16.808983 (+2449583us) ts_tablet_manager.cc:1151] Deleting tablet 465371cfbe544ba98e6eea05033ecf05
0923 19:50:16.808992 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:16.813038 (+ 4046us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:16.822079 (+ 9041us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:16.825909 (+ 3830us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2448991}
I20260923 19:50:16.829164 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 465371cfbe544ba98e6eea05033ecf05 (table default.Table_59faad35003f4e6f95781fbb1895f6aa [id=b28193cd587649a4b2c450473da92564]) successfully deleted
I20260923 19:50:16.829850 6137 leader_election.cc:304] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:16.830070 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet cffe24ab4df745e3a34f82e8ca7b39f5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cffe24ab4df745e3a34f82e8ca7b39f5 already in progress: creating tablet
I20260923 19:50:16.830330 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 669) took 2457 ms. Trace:
I20260923 19:50:16.830956 6457 tablet_bootstrap.cc:654] T 1b1d9413e1e24547b491a160d851377b P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:16.830951 6137 leader_election.cc:343] T 235b4b8081ad4a13937a7941344dbc33 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 235b4b8081ad4a13937a7941344dbc33
I20260923 19:50:16.831393 6458 rpcz_store.cc:276] 0923 19:50:14.372391 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.372562 (+ 171us) service_pool.cc:224] Handling call
0923 19:50:16.830204 (+2457642us) ts_tablet_manager.cc:1151] Deleting tablet 92f94b93d1364bb1a2562eb577707cf1
0923 19:50:16.830217 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:16.830311 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2421028}
W20260923 19:50:16.831516 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 401d909c37ec4daaa210e4fc32d838aa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 401d909c37ec4daaa210e4fc32d838aa already in progress: creating tablet
W20260923 19:50:16.832165 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 92f94b93d1364bb1a2562eb577707cf1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 92f94b93d1364bb1a2562eb577707cf1 already in progress: creating tablet
I20260923 19:50:16.832581 6458 tablet_replica.cc:333] T c0ff8838ab17433ab733d3b293d4964f P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:16.832741 6137 leader_election.cc:304] T 235b4b8081ad4a13937a7941344dbc33 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:16.833197 7505 raft_consensus.cc:2749] T 235b4b8081ad4a13937a7941344dbc33 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:16.833380 6137 consensus_peers.cc:597] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 223edddace234a16b2d360504a99c28b. This is attempt 1: this message will repeat every 5th retry.
W20260923 19:50:16.833537 6137 leader_election.cc:343] T 2ccfe6531fc44f86a0edc8bda1547442 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 2ccfe6531fc44f86a0edc8bda1547442
I20260923 19:50:16.833647 6137 leader_election.cc:304] T 2ccfe6531fc44f86a0edc8bda1547442 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:16.831143 7506 raft_consensus.cc:2749] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:16.833923 7505 raft_consensus.cc:2749] T 2ccfe6531fc44f86a0edc8bda1547442 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:16.834260 6458 raft_consensus.cc:2243] T c0ff8838ab17433ab733d3b293d4964f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:16.834424 6458 raft_consensus.cc:2272] T c0ff8838ab17433ab733d3b293d4964f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:16.835606 6169 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b1601590508479c8f401cd09d9f4c3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:04 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:16.838002 6458 ts_tablet_manager.cc:1916] T c0ff8838ab17433ab733d3b293d4964f P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:16.844213 6139 leader_election.cc:304] T 7e41501bf01e4765853c27e4cac21e2b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:16.844616 7505 raft_consensus.cc:2804] T 7e41501bf01e4765853c27e4cac21e2b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:16.844699 7505 raft_consensus.cc:493] T 7e41501bf01e4765853c27e4cac21e2b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260923 19:50:16.844749 6139 leader_election.cc:343] T f5cb8dd5dcf54df9989dd808fe148ce6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: f5cb8dd5dcf54df9989dd808fe148ce6
I20260923 19:50:16.844758 7505 raft_consensus.cc:3060] T 7e41501bf01e4765853c27e4cac21e2b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
W20260923 19:50:16.845755 6139 consensus_peers.cc:597] T 58c24aa494bc4da28536dfa1df6123b7 P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Couldn't send request to peer 2bf41435f70447f19992d368ca6b46bd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 58c24aa494bc4da28536dfa1df6123b7. This is attempt 1: this message will repeat every 5th retry.
W20260923 19:50:16.849395 6137 leader_election.cc:343] T f5cb8dd5dcf54df9989dd808fe148ce6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: f5cb8dd5dcf54df9989dd808fe148ce6
I20260923 19:50:16.849509 6137 leader_election.cc:304] T f5cb8dd5dcf54df9989dd808fe148ce6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:16.849958 7507 raft_consensus.cc:2749] T f5cb8dd5dcf54df9989dd808fe148ce6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:16.851789 6456 tablet_bootstrap.cc:492] T 22e37d5afa8047989928596b4092c4b9 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:16.851986 6456 ts_tablet_manager.cc:1403] T 22e37d5afa8047989928596b4092c4b9 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.047s user 0.007s sys 0.002s
I20260923 19:50:16.852540 6457 tablet_bootstrap.cc:492] T 1b1d9413e1e24547b491a160d851377b P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:16.852703 6457 ts_tablet_manager.cc:1403] T 1b1d9413e1e24547b491a160d851377b P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.039s user 0.004s sys 0.001s
I20260923 19:50:16.852771 6456 raft_consensus.cc:359] T 22e37d5afa8047989928596b4092c4b9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.852921 6456 raft_consensus.cc:385] T 22e37d5afa8047989928596b4092c4b9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:16.852962 6456 raft_consensus.cc:740] T 22e37d5afa8047989928596b4092c4b9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:16.853152 6456 consensus_queue.cc:260] T 22e37d5afa8047989928596b4092c4b9 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.853473 6457 raft_consensus.cc:359] T 1b1d9413e1e24547b491a160d851377b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.853629 6457 raft_consensus.cc:385] T 1b1d9413e1e24547b491a160d851377b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:16.853678 6457 raft_consensus.cc:740] T 1b1d9413e1e24547b491a160d851377b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:16.853724 6456 ts_tablet_manager.cc:1434] T 22e37d5afa8047989928596b4092c4b9 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:16.853853 6457 consensus_queue.cc:260] T 1b1d9413e1e24547b491a160d851377b P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.854553 6456 tablet_bootstrap.cc:492] T a75c4436a67f453e973a7a7645de79b1 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:16.854557 6457 ts_tablet_manager.cc:1434] T 1b1d9413e1e24547b491a160d851377b P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:16.854839 6457 tablet_bootstrap.cc:492] T 7af330ae1aaa48209f2bd1880bcfebb1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:16.856153 6456 tablet_bootstrap.cc:654] T a75c4436a67f453e973a7a7645de79b1 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:16.856367 6457 tablet_bootstrap.cc:654] T 7af330ae1aaa48209f2bd1880bcfebb1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:16.862469 5801 catalog_manager.cc:5838] T 12f4abb573bd4be6961b55c27c684d06 P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:16.863029 5801 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 7b455812687f42848df5290d0cdbc312 (table default.Table_e9cc7064dc8e4c6bb9eadb9fc3f33e09 [id=e263e510102443df8fd2b5886fa01053]). Expected version 1 got 0
I20260923 19:50:16.863338 5801 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 8d87f05f29bd476386ff6516676ce31a (table default.Table_9fa8f8bfc6124f398a4acdf5e1e0b33a [id=02d2ab56def342c482c86ce96110342f]). Expected version 1 got 0
I20260923 19:50:16.868938 6316 tablet_service.cc:1511] Processing CreateTablet for tablet 8e95ec2f36be418fa2f042cd14b7a8bd (DEFAULT_TABLE table=default.Table_769b0dad8d264f458b46793b701ef2bc [id=6b3219959dad474a8575e0c429d4bcf3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.869386 6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e95ec2f36be418fa2f042cd14b7a8bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.869752 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 80386e27facd494bb11a46ddf83e7b23 (DEFAULT_TABLE table=default.Table_14291874bbe14b46940404de2dc7b51e [id=d418ecc2ab3c4f41b0fa5f6315c66d92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.870183 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80386e27facd494bb11a46ddf83e7b23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.874205 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 8e95ec2f36be418fa2f042cd14b7a8bd (DEFAULT_TABLE table=default.Table_769b0dad8d264f458b46793b701ef2bc [id=6b3219959dad474a8575e0c429d4bcf3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.874639 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e95ec2f36be418fa2f042cd14b7a8bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.881698 6454 tablet_bootstrap.cc:492] T 1fcd1c1bfd2c437a955c34569605a6d4 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:16.882524 6454 ts_tablet_manager.cc:1403] T 1fcd1c1bfd2c437a955c34569605a6d4 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.074s user 0.006s sys 0.008s
I20260923 19:50:16.884338 6454 raft_consensus.cc:359] T 1fcd1c1bfd2c437a955c34569605a6d4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.885969 6454 raft_consensus.cc:385] T 1fcd1c1bfd2c437a955c34569605a6d4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:16.886253 6454 raft_consensus.cc:740] T 1fcd1c1bfd2c437a955c34569605a6d4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:16.887691 6169 tablet_service.cc:1511] Processing CreateTablet for tablet 80386e27facd494bb11a46ddf83e7b23 (DEFAULT_TABLE table=default.Table_14291874bbe14b46940404de2dc7b51e [id=d418ecc2ab3c4f41b0fa5f6315c66d92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.887483 6454 consensus_queue.cc:260] T 1fcd1c1bfd2c437a955c34569605a6d4 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.888113 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80386e27facd494bb11a46ddf83e7b23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.888335 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 679) took 2394 ms. Trace:
I20260923 19:50:16.888410 6459 rpcz_store.cc:276] 0923 19:50:14.494330 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.494368 (+ 38us) service_pool.cc:224] Handling call
0923 19:50:15.993840 (+1499472us) ts_tablet_manager.cc:1151] Deleting tablet 896bd068e6b343e48eb2a01679b49326
0923 19:50:15.993850 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:16.266653 (+272803us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x6160001b1c54. stack: 00007fc70c102366 00007fc70c102120 00007fc70b10c34d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007fc7181f6a70 00007fc71957f583 00007fc71c14c8b7 00007fc71c17fa64 00007fc71c1603a0 00007fc71c16012d 0000000000aaef9c 00007fc70c14888f 00007fc70c14bb8b 00007fc70c14ba08
0923 19:50:16.720438 (+453785us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:16.739299 (+ 18861us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:16.888320 (+149021us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":626118528,"tablet-delete.queue_time_us":1499307}
I20260923 19:50:16.888779 6459 tablet_replica.cc:333] T 58c24aa494bc4da28536dfa1df6123b7 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:16.888926 6459 raft_consensus.cc:2243] T 58c24aa494bc4da28536dfa1df6123b7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:16.889230 6459 raft_consensus.cc:2272] T 58c24aa494bc4da28536dfa1df6123b7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:16.890210 6459 ts_tablet_manager.cc:1916] T 58c24aa494bc4da28536dfa1df6123b7 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:16.893913 6321 tablet_service.cc:1511] Processing CreateTablet for tablet 80386e27facd494bb11a46ddf83e7b23 (DEFAULT_TABLE table=default.Table_14291874bbe14b46940404de2dc7b51e [id=d418ecc2ab3c4f41b0fa5f6315c66d92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.894894 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80386e27facd494bb11a46ddf83e7b23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.895143 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 8e95ec2f36be418fa2f042cd14b7a8bd (DEFAULT_TABLE table=default.Table_769b0dad8d264f458b46793b701ef2bc [id=6b3219959dad474a8575e0c429d4bcf3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:16.895702 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e95ec2f36be418fa2f042cd14b7a8bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:16.900854 6454 ts_tablet_manager.cc:1434] T 1fcd1c1bfd2c437a955c34569605a6d4 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.018s user 0.003s sys 0.000s
I20260923 19:50:16.902331 6459 ts_tablet_manager.cc:1929] T 58c24aa494bc4da28536dfa1df6123b7 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:16.903096 6457 tablet_bootstrap.cc:492] T 7af330ae1aaa48209f2bd1880bcfebb1 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:16.903028 6454 tablet_bootstrap.cc:492] T 18bab39d85f94f4283f0b18c1c9b48a2 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:16.903281 6457 ts_tablet_manager.cc:1403] T 7af330ae1aaa48209f2bd1880bcfebb1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.049s user 0.005s sys 0.002s
I20260923 19:50:16.903122 6459 log.cc:1199] T 58c24aa494bc4da28536dfa1df6123b7 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/58c24aa494bc4da28536dfa1df6123b7
I20260923 19:50:16.904246 6457 raft_consensus.cc:359] T 7af330ae1aaa48209f2bd1880bcfebb1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.904490 6457 raft_consensus.cc:385] T 7af330ae1aaa48209f2bd1880bcfebb1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:16.904599 6457 raft_consensus.cc:740] T 7af330ae1aaa48209f2bd1880bcfebb1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:16.904999 6457 consensus_queue.cc:260] T 7af330ae1aaa48209f2bd1880bcfebb1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.905372 6459 ts_tablet_manager.cc:1950] T 58c24aa494bc4da28536dfa1df6123b7 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:16.907639 6199 raft_consensus.cc:3060] T 7b455812687f42848df5290d0cdbc312 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:16.912145 6457 ts_tablet_manager.cc:1434] T 7af330ae1aaa48209f2bd1880bcfebb1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260923 19:50:16.912480 6457 tablet_bootstrap.cc:492] T 3d74560614b744188e759b981ad89a7d P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:16.912771 6454 tablet_bootstrap.cc:654] T 18bab39d85f94f4283f0b18c1c9b48a2 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:16.917111 6457 tablet_bootstrap.cc:654] T 3d74560614b744188e759b981ad89a7d P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:16.918288 6249 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
I20260923 19:50:16.921970 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 896bd068e6b343e48eb2a01679b49326 (table default.Table_5febe26a78884634a01aa0ec62f36604 [id=e2a29fc060074c45918b97001dd03207]) successfully deleted
I20260923 19:50:16.930866 6454 tablet_bootstrap.cc:492] T 18bab39d85f94f4283f0b18c1c9b48a2 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:16.931245 6454 ts_tablet_manager.cc:1403] T 18bab39d85f94f4283f0b18c1c9b48a2 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.004s
I20260923 19:50:16.933504 6454 raft_consensus.cc:359] T 18bab39d85f94f4283f0b18c1c9b48a2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.933921 6454 raft_consensus.cc:385] T 18bab39d85f94f4283f0b18c1c9b48a2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:16.934031 6457 tablet_bootstrap.cc:492] T 3d74560614b744188e759b981ad89a7d P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:16.934087 6454 raft_consensus.cc:740] T 18bab39d85f94f4283f0b18c1c9b48a2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:16.934229 6457 ts_tablet_manager.cc:1403] T 3d74560614b744188e759b981ad89a7d P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.004s
I20260923 19:50:16.934624 6454 consensus_queue.cc:260] T 18bab39d85f94f4283f0b18c1c9b48a2 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.935998 6454 ts_tablet_manager.cc:1434] T 18bab39d85f94f4283f0b18c1c9b48a2 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260923 19:50:16.936998 6454 tablet_bootstrap.cc:492] T 601a0ff319cc4c9a898d52bbcb19184b P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:16.940047 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_c6300cbac0064c74bbc5bd955433f5d5" } modify_external_catalogs: true
I20260923 19:50:16.940742 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_c6300cbac0064c74bbc5bd955433f5d5" } modify_external_catalogs: true
I20260923 19:50:16.942273 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_64a90e659c564472a7b8ff265be1cea8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:16.942874 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_64a90e659c564472a7b8ff265be1cea8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:16.935174 6457 raft_consensus.cc:359] T 3d74560614b744188e759b981ad89a7d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.944036 5803 catalog_manager.cc:5838] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193). New cstate: current_term: 1 leader_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: UNKNOWN } } }
I20260923 19:50:16.944449 5803 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 35f46a1be80c4194b592c5d00fe1f342 (table default.Table_f6755f452e8d41c4b9d64c3ee2735188 [id=d6a2d0fc236a4056b224d01249f045b0]). Expected version 1 got 0
I20260923 19:50:16.944593 6457 raft_consensus.cc:385] T 3d74560614b744188e759b981ad89a7d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:16.944679 5803 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 98f61ace3a984938ace1fedbaa1dafa3 (table default.Table_c624a31c5179478cb6c54a36d7a36892 [id=26caa02bc37e471abdf29bbbb3acba69]). Expected version 3 got 0
I20260923 19:50:16.944898 5803 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 34d62ab3d4aa457f8fea283cd9248a41 (table default.Table_71d7f590efb94aae8c345f9d9a620fc1 [id=b4e8e3f2a48a4b5496f506080b415805]). Expected version 1 got 0
I20260923 19:50:16.944726 6457 raft_consensus.cc:740] T 3d74560614b744188e759b981ad89a7d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:16.945266 6457 consensus_queue.cc:260] T 3d74560614b744188e759b981ad89a7d P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.945617 7362 raft_consensus.cc:493] T efc63a151f6444dfb03c3f15f6f54473 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:16.945755 7362 raft_consensus.cc:515] T efc63a151f6444dfb03c3f15f6f54473 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.946370 7362 leader_election.cc:290] T efc63a151f6444dfb03c3f15f6f54473 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:16.947021 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc63a151f6444dfb03c3f15f6f54473" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:16.947963 6280 leader_election.cc:343] T efc63a151f6444dfb03c3f15f6f54473 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:16.948253 6279 leader_election.cc:343] T efc63a151f6444dfb03c3f15f6f54473 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: efc63a151f6444dfb03c3f15f6f54473
I20260923 19:50:16.948339 6279 leader_election.cc:304] T efc63a151f6444dfb03c3f15f6f54473 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:16.948616 6454 tablet_bootstrap.cc:654] T 601a0ff319cc4c9a898d52bbcb19184b P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:16.949230 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_03428c96fc774fd9921788967964ed5a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:16.949815 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_03428c96fc774fd9921788967964ed5a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:16.950927 7362 raft_consensus.cc:2749] T efc63a151f6444dfb03c3f15f6f54473 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:16.951333 6457 ts_tablet_manager.cc:1434] T 3d74560614b744188e759b981ad89a7d P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260923 19:50:16.951681 6457 tablet_bootstrap.cc:492] T fc151f4d78344efeada6d6e57af6eb9f P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:16.956550 6457 tablet_bootstrap.cc:654] T fc151f4d78344efeada6d6e57af6eb9f P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:16.966615 6456 tablet_bootstrap.cc:492] T a75c4436a67f453e973a7a7645de79b1 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:16.966902 6456 ts_tablet_manager.cc:1403] T a75c4436a67f453e973a7a7645de79b1 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.112s user 0.002s sys 0.002s
I20260923 19:50:16.967689 6456 raft_consensus.cc:359] T a75c4436a67f453e973a7a7645de79b1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.967924 6456 raft_consensus.cc:385] T a75c4436a67f453e973a7a7645de79b1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:16.968019 6456 raft_consensus.cc:740] T a75c4436a67f453e973a7a7645de79b1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:16.968269 6456 consensus_queue.cc:260] T a75c4436a67f453e973a7a7645de79b1 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.971202 6454 tablet_bootstrap.cc:492] T 601a0ff319cc4c9a898d52bbcb19184b P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:16.971506 6454 ts_tablet_manager.cc:1403] T 601a0ff319cc4c9a898d52bbcb19184b P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.035s user 0.008s sys 0.000s
I20260923 19:50:16.972966 6454 raft_consensus.cc:359] T 601a0ff319cc4c9a898d52bbcb19184b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.973327 6454 raft_consensus.cc:385] T 601a0ff319cc4c9a898d52bbcb19184b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:16.973477 6454 raft_consensus.cc:740] T 601a0ff319cc4c9a898d52bbcb19184b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:16.977437 7505 raft_consensus.cc:515] T 7e41501bf01e4765853c27e4cac21e2b P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.978896 7505 leader_election.cc:290] T 7e41501bf01e4765853c27e4cac21e2b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:16.979447 6454 consensus_queue.cc:260] T 601a0ff319cc4c9a898d52bbcb19184b P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.979848 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e41501bf01e4765853c27e4cac21e2b" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:16.980051 6341 raft_consensus.cc:3060] T 7e41501bf01e4765853c27e4cac21e2b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:16.982028 6454 ts_tablet_manager.cc:1434] T 601a0ff319cc4c9a898d52bbcb19184b P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260923 19:50:16.982234 5801 master_service.cc:960] ReplaceTablet: received request to replace tablet 3a4b9d48f02a4372adce6d9eb80935f6 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:16.982681 5802 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 7b455812687f42848df5290d0cdbc312 (table default.Table_e9cc7064dc8e4c6bb9eadb9fc3f33e09 [id=e263e510102443df8fd2b5886fa01053]). Expected version 1 got 0
I20260923 19:50:16.982826 6341 raft_consensus.cc:2468] T 7e41501bf01e4765853c27e4cac21e2b P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:16.983192 6454 tablet_bootstrap.cc:492] T c0ff8838ab17433ab733d3b293d4964f P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:16.984853 6321 tablet_service.cc:1558] Processing DeleteTablet for tablet 474e34e902064764864ba06ef41b1d94 with delete_type TABLET_DATA_DELETED (replaced by tablet 12bda2ae961446bea2f34e792f4f1706) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:16.985980 6457 tablet_bootstrap.cc:492] T fc151f4d78344efeada6d6e57af6eb9f P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:16.986192 6457 ts_tablet_manager.cc:1403] T fc151f4d78344efeada6d6e57af6eb9f P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.035s user 0.004s sys 0.007s
I20260923 19:50:16.987067 6457 raft_consensus.cc:359] T fc151f4d78344efeada6d6e57af6eb9f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.987316 6457 raft_consensus.cc:385] T fc151f4d78344efeada6d6e57af6eb9f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:16.987411 6457 raft_consensus.cc:740] T fc151f4d78344efeada6d6e57af6eb9f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:16.987663 6457 consensus_queue.cc:260] T fc151f4d78344efeada6d6e57af6eb9f P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:16.989986 6454 tablet_bootstrap.cc:654] T c0ff8838ab17433ab733d3b293d4964f P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:16.990566 6316 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e123b69877e4b1fbcdb2b27960864e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:16.991602 5800 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 28f9d03be14a4072aab7fd03834c3f6b
I20260923 19:50:16.992462 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 28f9d03be14a4072aab7fd03834c3f6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:16.992820 6461 tablet_replica.cc:333] T 28f9d03be14a4072aab7fd03834c3f6b P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:16.993027 6461 raft_consensus.cc:2243] T 28f9d03be14a4072aab7fd03834c3f6b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:16.993191 6461 raft_consensus.cc:2272] T 28f9d03be14a4072aab7fd03834c3f6b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:16.993811 6461 ts_tablet_manager.cc:1916] T 28f9d03be14a4072aab7fd03834c3f6b P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:16.994653 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_572d17eb83634c98b68bbcfedc88603e" } modify_external_catalogs: true
I20260923 19:50:16.994827 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_572d17eb83634c98b68bbcfedc88603e" } modify_external_catalogs: true
I20260923 19:50:16.997368 6316 tablet_service.cc:1558] Processing DeleteTablet for tablet 28f9d03be14a4072aab7fd03834c3f6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:16.997682 6137 leader_election.cc:343] T 7e41501bf01e4765853c27e4cac21e2b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 7e41501bf01e4765853c27e4cac21e2b
I20260923 19:50:16.998200 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 680) took 2503 ms. Trace:
I20260923 19:50:16.998277 6459 rpcz_store.cc:276] 0923 19:50:14.494808 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.494845 (+ 37us) service_pool.cc:224] Handling call
0923 19:50:16.888740 (+2393895us) ts_tablet_manager.cc:1151] Deleting tablet 58c24aa494bc4da28536dfa1df6123b7
0923 19:50:16.888749 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:16.895401 (+ 6652us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:16.902121 (+ 6720us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:16.998184 (+ 96063us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2393768}
I20260923 19:50:16.998685 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 702) took 2153 ms. Trace:
I20260923 19:50:16.999169 6459 rpcz_store.cc:276] 0923 19:50:14.845583 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.845679 (+ 96us) service_pool.cc:224] Handling call
0923 19:50:16.998551 (+2152872us) ts_tablet_manager.cc:1151] Deleting tablet 17a105f389d041dbb0bf8b828f990d27
0923 19:50:16.998564 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:16.998670 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2152705}
I20260923 19:50:16.999521 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 703) took 2153 ms. Trace:
I20260923 19:50:16.999586 6459 rpcz_store.cc:276] 0923 19:50:14.845687 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.845739 (+ 52us) service_pool.cc:224] Handling call
0923 19:50:16.999420 (+2153681us) ts_tablet_manager.cc:1151] Deleting tablet cc581dd78b6d4fb29fff701ae794a89d
0923 19:50:16.999429 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:16.999505 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42,"tablet-delete.queue_time_us":2153575}
I20260923 19:50:16.999891 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 701) took 2154 ms. Trace:
I20260923 19:50:16.999951 6459 rpcz_store.cc:276] 0923 19:50:14.845435 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.849038 (+ 3603us) service_pool.cc:224] Handling call
0923 19:50:16.999803 (+2150765us) ts_tablet_manager.cc:1151] Deleting tablet b6ef90ddd7a34dfdb8309d0e1c3688e7
0923 19:50:16.999812 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:16.999879 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2150600}
I20260923 19:50:17.000250 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 699) took 2166 ms. Trace:
I20260923 19:50:17.000308 6459 rpcz_store.cc:276] 0923 19:50:14.833979 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.838746 (+ 4767us) service_pool.cc:224] Handling call
0923 19:50:17.000165 (+2161419us) ts_tablet_manager.cc:1151] Deleting tablet c031d99a6f9844c29664236662e8d5f8
0923 19:50:17.000173 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.000239 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2148031}
I20260923 19:50:17.000592 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 704) took 2154 ms. Trace:
I20260923 19:50:17.000662 6459 rpcz_store.cc:276] 0923 19:50:14.845797 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.845855 (+ 58us) service_pool.cc:224] Handling call
0923 19:50:17.000504 (+2154649us) ts_tablet_manager.cc:1151] Deleting tablet c1347ea7774c40548975d10f6b3cba2a
0923 19:50:17.000512 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.000580 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2147044}
I20260923 19:50:17.000979 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 698) took 2167 ms. Trace:
I20260923 19:50:17.001039 6459 rpcz_store.cc:276] 0923 19:50:14.833861 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.838684 (+ 4823us) service_pool.cc:224] Handling call
0923 19:50:17.000892 (+2162208us) ts_tablet_manager.cc:1151] Deleting tablet 349c0447464d4c5380cf15cb4aeb54a4
0923 19:50:17.000899 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.000966 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2054213}
I20260923 19:50:17.001319 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 705) took 2005 ms. Trace:
I20260923 19:50:17.001461 6454 tablet_bootstrap.cc:492] T c0ff8838ab17433ab733d3b293d4964f P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:17.001605 6454 ts_tablet_manager.cc:1403] T c0ff8838ab17433ab733d3b293d4964f P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.001s
I20260923 19:50:17.002339 6454 raft_consensus.cc:359] T c0ff8838ab17433ab733d3b293d4964f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.002488 6454 raft_consensus.cc:385] T c0ff8838ab17433ab733d3b293d4964f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:17.002532 6454 raft_consensus.cc:740] T c0ff8838ab17433ab733d3b293d4964f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:17.002727 6454 consensus_queue.cc:260] T c0ff8838ab17433ab733d3b293d4964f P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.003288 6454 ts_tablet_manager.cc:1434] T c0ff8838ab17433ab733d3b293d4964f P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:50:17.003578 6454 tablet_bootstrap.cc:492] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:17.003970 6461 ts_tablet_manager.cc:1929] T 28f9d03be14a4072aab7fd03834c3f6b P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:17.004073 6461 log.cc:1199] T 28f9d03be14a4072aab7fd03834c3f6b P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/28f9d03be14a4072aab7fd03834c3f6b
I20260923 19:50:17.005393 6454 tablet_bootstrap.cc:654] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:17.005573 6461 ts_tablet_manager.cc:1950] T 28f9d03be14a4072aab7fd03834c3f6b P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:17.006779 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 28f9d03be14a4072aab7fd03834c3f6b (table default.Table_2b35ad69600645618a826140c33c4da8 [id=6a9d5cc3eb1a4dbdbf6a5acaafa07ec7]) successfully deleted
I20260923 19:50:17.007792 6457 ts_tablet_manager.cc:1434] T fc151f4d78344efeada6d6e57af6eb9f P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.021s user 0.001s sys 0.000s
I20260923 19:50:17.008211 6457 tablet_bootstrap.cc:492] T c031d99a6f9844c29664236662e8d5f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:17.001384 6459 rpcz_store.cc:276] 0923 19:50:14.995645 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.995779 (+ 134us) service_pool.cc:224] Handling call
0923 19:50:17.001238 (+2005459us) ts_tablet_manager.cc:1151] Deleting tablet 2ed8d49f1b3d4bee80b1822df2a7f495
0923 19:50:17.001244 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.001307 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2005278}
I20260923 19:50:17.009815 7505 raft_consensus.cc:493] T 1fcd1c1bfd2c437a955c34569605a6d4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:17.013304 7505 raft_consensus.cc:515] T 1fcd1c1bfd2c437a955c34569605a6d4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.013514 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 706) took 2017 ms. Trace:
I20260923 19:50:17.013604 6459 rpcz_store.cc:276] 0923 19:50:14.996423 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.996472 (+ 49us) service_pool.cc:224] Handling call
0923 19:50:17.013335 (+2016863us) ts_tablet_manager.cc:1151] Deleting tablet 104f137941e84b83bb9a726752c865c1
0923 19:50:17.013345 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.013501 (+ 156us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2016701}
I20260923 19:50:17.013957 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 712) took 1950 ms. Trace:
I20260923 19:50:17.014034 6459 rpcz_store.cc:276] 0923 19:50:15.063294 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.063343 (+ 49us) service_pool.cc:224] Handling call
0923 19:50:17.013831 (+1950488us) ts_tablet_manager.cc:1151] Deleting tablet 554655516bb547ad9c2aa1ee66dc8deb
0923 19:50:17.013839 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.013940 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1950329}
I20260923 19:50:17.014122 7505 leader_election.cc:290] T 1fcd1c1bfd2c437a955c34569605a6d4 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:17.014377 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 714) took 1947 ms. Trace:
I20260923 19:50:17.014453 6459 rpcz_store.cc:276] 0923 19:50:15.067413 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.067468 (+ 55us) service_pool.cc:224] Handling call
0923 19:50:17.014283 (+1946815us) ts_tablet_manager.cc:1151] Deleting tablet 42ca4ffede1a472d8917a592fac7f746
0923 19:50:17.014291 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.014361 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1929592}
I20260923 19:50:17.014770 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 715) took 1932 ms. Trace:
I20260923 19:50:17.014844 6459 rpcz_store.cc:276] 0923 19:50:15.082191 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.082265 (+ 74us) service_pool.cc:224] Handling call
0923 19:50:17.014675 (+1932410us) ts_tablet_manager.cc:1151] Deleting tablet c6598be958f842328a81fd092c6fcf64
0923 19:50:17.014686 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.014756 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1929773}
I20260923 19:50:17.015152 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 717) took 1927 ms. Trace:
I20260923 19:50:17.015226 6459 rpcz_store.cc:276] 0923 19:50:15.087582 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.087626 (+ 44us) service_pool.cc:224] Handling call
0923 19:50:17.015058 (+1927432us) ts_tablet_manager.cc:1151] Deleting tablet cf0caa6afcf546678c233a9333b77a2a
0923 19:50:17.015068 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.015138 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1918673}
I20260923 19:50:17.015524 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 716) took 1928 ms. Trace:
I20260923 19:50:17.010052 6139 leader_election.cc:304] T 7e41501bf01e4765853c27e4cac21e2b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:17.015607 6459 rpcz_store.cc:276] 0923 19:50:15.087283 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.087332 (+ 49us) service_pool.cc:224] Handling call
0923 19:50:17.015436 (+1928104us) ts_tablet_manager.cc:1151] Deleting tablet bc64c9a47934420b9be3a6c8fe3ed91f
0923 19:50:17.015445 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.015511 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1892477}
I20260923 19:50:17.015978 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 725) took 1595 ms. Trace:
I20260923 19:50:17.016002 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd1c1bfd2c437a955c34569605a6d4" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:17.016047 6459 rpcz_store.cc:276] 0923 19:50:15.420496 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.421235 (+ 739us) service_pool.cc:224] Handling call
0923 19:50:17.015891 (+1594656us) ts_tablet_manager.cc:1151] Deleting tablet 22e37d5afa8047989928596b4092c4b9
0923 19:50:17.015900 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.015966 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1594388}
I20260923 19:50:17.016172 7505 raft_consensus.cc:2804] T 7e41501bf01e4765853c27e4cac21e2b P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:17.016271 7505 raft_consensus.cc:697] T 7e41501bf01e4765853c27e4cac21e2b P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:17.016300 6459 tablet_replica.cc:333] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:17.016458 6459 raft_consensus.cc:2243] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:17.016495 7505 consensus_queue.cc:237] T 7e41501bf01e4765853c27e4cac21e2b P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.016742 6459 raft_consensus.cc:2272] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:17.017537 6459 ts_tablet_manager.cc:1916] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:17.022854 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcd1c1bfd2c437a955c34569605a6d4" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:17.025344 6459 ts_tablet_manager.cc:1929] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260923 19:50:17.025482 6459 log.cc:1199] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/223edddace234a16b2d360504a99c28b
I20260923 19:50:17.031594 6457 tablet_bootstrap.cc:654] T c031d99a6f9844c29664236662e8d5f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:17.025844 6459 ts_tablet_manager.cc:1950] T 223edddace234a16b2d360504a99c28b P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:17.040004 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 726) took 1619 ms. Trace:
I20260923 19:50:17.028951 7507 raft_consensus.cc:493] T 465371cfbe544ba98e6eea05033ecf05 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:17.041522 6459 rpcz_store.cc:276] 0923 19:50:15.420598 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.421547 (+ 949us) service_pool.cc:224] Handling call
0923 19:50:17.016260 (+1594713us) ts_tablet_manager.cc:1151] Deleting tablet 223edddace234a16b2d360504a99c28b
0923 19:50:17.016269 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.021760 (+ 5491us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:17.025281 (+ 3521us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:17.039983 (+ 14702us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1594566}
I20260923 19:50:17.041776 7507 raft_consensus.cc:515] T 465371cfbe544ba98e6eea05033ecf05 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.043532 6459 tablet_replica.cc:333] T 0d70deeda179486291195476e47a9ae6 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:17.044211 7507 leader_election.cc:290] T 465371cfbe544ba98e6eea05033ecf05 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:17.044638 6459 raft_consensus.cc:2243] T 0d70deeda179486291195476e47a9ae6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:17.045560 6459 raft_consensus.cc:2272] T 0d70deeda179486291195476e47a9ae6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:17.045831 6137 leader_election.cc:343] T 465371cfbe544ba98e6eea05033ecf05 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 465371cfbe544ba98e6eea05033ecf05
I20260923 19:50:17.026445 6139 leader_election.cc:304] T 1fcd1c1bfd2c437a955c34569605a6d4 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:17.046170 7507 raft_consensus.cc:2749] T 1fcd1c1bfd2c437a955c34569605a6d4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:17.046675 6459 ts_tablet_manager.cc:1916] T 0d70deeda179486291195476e47a9ae6 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:17.047907 7490 raft_consensus.cc:493] T 0e123b69877e4b1fbcdb2b27960864e9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:17.048085 7490 raft_consensus.cc:515] T 0e123b69877e4b1fbcdb2b27960864e9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.048666 7490 leader_election.cc:290] T 0e123b69877e4b1fbcdb2b27960864e9 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:17.049536 6279 leader_election.cc:343] T 0e123b69877e4b1fbcdb2b27960864e9 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 0e123b69877e4b1fbcdb2b27960864e9
I20260923 19:50:17.049562 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e123b69877e4b1fbcdb2b27960864e9" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:17.050063 6280 leader_election.cc:343] T 0e123b69877e4b1fbcdb2b27960864e9 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:17.050192 6280 leader_election.cc:304] T 0e123b69877e4b1fbcdb2b27960864e9 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:17.050760 7490 raft_consensus.cc:2749] T 0e123b69877e4b1fbcdb2b27960864e9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:17.051676 6139 leader_election.cc:343] T 465371cfbe544ba98e6eea05033ecf05 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 465371cfbe544ba98e6eea05033ecf05
I20260923 19:50:17.051841 6139 leader_election.cc:304] T 465371cfbe544ba98e6eea05033ecf05 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:17.052109 7507 raft_consensus.cc:2749] T 465371cfbe544ba98e6eea05033ecf05 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:17.053258 5791 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 4e69656e9fc941e19eb7de5c87bc9050 (table default.Table_454977731aee4768be1b7437bb41c1ba [id=1337273e913b43e797c0fb356ca5085b], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 4e69656e9fc941e19eb7de5c87bc9050 consensus state has no leader
I20260923 19:50:17.054462 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 58c24aa494bc4da28536dfa1df6123b7 (table default.Table_82887fe31841462bafc075decf6acdbd [id=8bf9f0ca8abf4fa1a05458b12288cd12]) successfully deleted
I20260923 19:50:17.074718 6459 ts_tablet_manager.cc:1929] T 0d70deeda179486291195476e47a9ae6 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:50:17.077322 6456 ts_tablet_manager.cc:1434] T a75c4436a67f453e973a7a7645de79b1 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.110s user 0.001s sys 0.001s
I20260923 19:50:17.079403 6459 log.cc:1199] T 0d70deeda179486291195476e47a9ae6 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/0d70deeda179486291195476e47a9ae6
W20260923 19:50:17.079890 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 17a105f389d041dbb0bf8b828f990d27 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17a105f389d041dbb0bf8b828f990d27 already in progress: creating tablet
W20260923 19:50:17.080264 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet cc581dd78b6d4fb29fff701ae794a89d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc581dd78b6d4fb29fff701ae794a89d already in progress: creating tablet
W20260923 19:50:17.080479 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet b6ef90ddd7a34dfdb8309d0e1c3688e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b6ef90ddd7a34dfdb8309d0e1c3688e7 already in progress: creating tablet
I20260923 19:50:17.080516 6459 ts_tablet_manager.cc:1950] T 0d70deeda179486291195476e47a9ae6 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
W20260923 19:50:17.080720 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet c031d99a6f9844c29664236662e8d5f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c031d99a6f9844c29664236662e8d5f8 already in progress: creating tablet
W20260923 19:50:17.080931 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet c1347ea7774c40548975d10f6b3cba2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c1347ea7774c40548975d10f6b3cba2a already in progress: creating tablet
I20260923 19:50:17.081324 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 727) took 1660 ms. Trace:
I20260923 19:50:17.081672 6459 rpcz_store.cc:276] 0923 19:50:15.420718 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.421730 (+ 1012us) service_pool.cc:224] Handling call
0923 19:50:17.043478 (+1621748us) ts_tablet_manager.cc:1151] Deleting tablet 0d70deeda179486291195476e47a9ae6
0923 19:50:17.043491 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.050887 (+ 7396us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:17.074654 (+ 23767us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:17.081309 (+ 6655us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1621616}
I20260923 19:50:17.083038 6456 tablet_bootstrap.cc:492] T ed9fb0cab0bd43b7a05d7376125b187e P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:17.086477 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 729) took 1665 ms. Trace:
I20260923 19:50:17.086971 6459 rpcz_store.cc:276] 0923 19:50:15.420951 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.421919 (+ 968us) service_pool.cc:224] Handling call
0923 19:50:17.086335 (+1664416us) ts_tablet_manager.cc:1151] Deleting tablet 94e111312f134034993bbd968366dea7
0923 19:50:17.086347 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.086458 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1664255}
I20260923 19:50:17.087182 6456 tablet_bootstrap.cc:654] T ed9fb0cab0bd43b7a05d7376125b187e P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:17.087996 6457 tablet_bootstrap.cc:492] T c031d99a6f9844c29664236662e8d5f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:17.088238 6457 ts_tablet_manager.cc:1403] T c031d99a6f9844c29664236662e8d5f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.080s user 0.002s sys 0.004s
I20260923 19:50:17.089316 6457 raft_consensus.cc:359] T c031d99a6f9844c29664236662e8d5f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.089943 6457 raft_consensus.cc:385] T c031d99a6f9844c29664236662e8d5f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:17.090061 6457 raft_consensus.cc:740] T c031d99a6f9844c29664236662e8d5f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:17.090390 6457 consensus_queue.cc:260] T c031d99a6f9844c29664236662e8d5f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.090554 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 728) took 1669 ms. Trace:
I20260923 19:50:17.090929 6459 rpcz_store.cc:276] 0923 19:50:15.420821 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.422102 (+ 1281us) service_pool.cc:224] Handling call
0923 19:50:17.090457 (+1668355us) ts_tablet_manager.cc:1151] Deleting tablet a08446fcf1794dab9d3181904507456f
0923 19:50:17.090468 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.090538 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1668229}
I20260923 19:50:17.091756 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 724) took 1671 ms. Trace:
I20260923 19:50:17.092033 6459 rpcz_store.cc:276] 0923 19:50:15.420377 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.422405 (+ 2028us) service_pool.cc:224] Handling call
0923 19:50:17.091551 (+1669146us) ts_tablet_manager.cc:1151] Deleting tablet 2d6762b369d3496083947a4a47a51868
0923 19:50:17.091647 (+ 96us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.091735 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1669015}
I20260923 19:50:17.092772 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 730) took 1590 ms. Trace:
I20260923 19:50:17.092983 6457 ts_tablet_manager.cc:1434] T c031d99a6f9844c29664236662e8d5f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260923 19:50:17.093185 6459 rpcz_store.cc:276] 0923 19:50:15.502125 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.502709 (+ 584us) service_pool.cc:224] Handling call
0923 19:50:17.092670 (+1589961us) ts_tablet_manager.cc:1151] Deleting tablet 717995ec489343118809ada2a6b58804
0923 19:50:17.092680 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.092756 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1589741}
I20260923 19:50:17.093281 6457 tablet_bootstrap.cc:492] T e6e04d16675443fc923a5f8216e292b6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:17.093853 6459 tablet_replica.cc:333] T cd02244c52ad4d2ab3915108a92a6f97 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:17.094274 6459 raft_consensus.cc:2243] T cd02244c52ad4d2ab3915108a92a6f97 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:17.094702 6459 raft_consensus.cc:2272] T cd02244c52ad4d2ab3915108a92a6f97 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:17.096040 6457 tablet_bootstrap.cc:654] T e6e04d16675443fc923a5f8216e292b6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:17.089857 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet 28f9d03be14a4072aab7fd03834c3f6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:17.098577 6459 ts_tablet_manager.cc:1916] T cd02244c52ad4d2ab3915108a92a6f97 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:17.098881 6106 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
W20260923 19:50:17.109313 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 349c0447464d4c5380cf15cb4aeb54a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 349c0447464d4c5380cf15cb4aeb54a4 already in progress: creating tablet
W20260923 19:50:17.109776 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 2ed8d49f1b3d4bee80b1822df2a7f495 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ed8d49f1b3d4bee80b1822df2a7f495 already in progress: creating tablet
W20260923 19:50:17.110119 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 104f137941e84b83bb9a726752c865c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 104f137941e84b83bb9a726752c865c1 already in progress: creating tablet
W20260923 19:50:17.110368 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 554655516bb547ad9c2aa1ee66dc8deb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 554655516bb547ad9c2aa1ee66dc8deb already in progress: creating tablet
W20260923 19:50:17.110620 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 42ca4ffede1a472d8917a592fac7f746 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 42ca4ffede1a472d8917a592fac7f746 already in progress: creating tablet
W20260923 19:50:17.110846 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet c6598be958f842328a81fd092c6fcf64 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c6598be958f842328a81fd092c6fcf64 already in progress: creating tablet
W20260923 19:50:17.111102 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet cf0caa6afcf546678c233a9333b77a2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf0caa6afcf546678c233a9333b77a2a already in progress: creating tablet
I20260923 19:50:17.118925 6454 tablet_bootstrap.cc:492] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:17.119307 6454 ts_tablet_manager.cc:1403] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.116s user 0.010s sys 0.014s
I20260923 19:50:17.120265 6454 raft_consensus.cc:359] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.120571 6454 raft_consensus.cc:385] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:17.120692 6454 raft_consensus.cc:740] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:17.121249 6454 consensus_queue.cc:260] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.123422 6454 ts_tablet_manager.cc:1434] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260923 19:50:17.123756 6454 tablet_bootstrap.cc:492] T 86388fa08c454da9ad2ca0124dcba10b P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:17.100510 6458 ts_tablet_manager.cc:1929] T c0ff8838ab17433ab733d3b293d4964f P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:17.113981 6391 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
I20260923 19:50:17.125221 6458 log.cc:1199] T c0ff8838ab17433ab733d3b293d4964f P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/c0ff8838ab17433ab733d3b293d4964f
I20260923 19:50:17.125816 6458 ts_tablet_manager.cc:1950] T c0ff8838ab17433ab733d3b293d4964f P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:17.126646 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 670) took 2627 ms. Trace:
I20260923 19:50:17.127252 7555 tablet.cc:1751] T 7b455812687f42848df5290d0cdbc312 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260923 19:50:17.111357 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet bc64c9a47934420b9be3a6c8fe3ed91f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc64c9a47934420b9be3a6c8fe3ed91f already in progress: creating tablet
W20260923 19:50:17.129129 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 22e37d5afa8047989928596b4092c4b9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22e37d5afa8047989928596b4092c4b9 already in progress: creating tablet
I20260923 19:50:17.129266 6458 rpcz_store.cc:276] 0923 19:50:14.499354 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.499406 (+ 52us) service_pool.cc:224] Handling call
0923 19:50:16.832527 (+2333121us) ts_tablet_manager.cc:1151] Deleting tablet c0ff8838ab17433ab733d3b293d4964f
0923 19:50:16.832539 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.063613 (+231074us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:17.100417 (+ 36804us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:17.126629 (+ 26212us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2332954}
I20260923 19:50:17.130049 6458 tablet_replica.cc:333] T 870db252d8414be7bbe613ea467b5f3a P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:17.130476 6458 raft_consensus.cc:2243] T 870db252d8414be7bbe613ea467b5f3a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:17.130689 6458 raft_consensus.cc:2272] T 870db252d8414be7bbe613ea467b5f3a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:17.131235 6458 ts_tablet_manager.cc:1916] T 870db252d8414be7bbe613ea467b5f3a P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:17.126554 6459 ts_tablet_manager.cc:1929] T cd02244c52ad4d2ab3915108a92a6f97 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:17.132980 6459 log.cc:1199] T cd02244c52ad4d2ab3915108a92a6f97 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/cd02244c52ad4d2ab3915108a92a6f97
I20260923 19:50:17.133316 6459 ts_tablet_manager.cc:1950] T cd02244c52ad4d2ab3915108a92a6f97 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:17.133654 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 731) took 1626 ms. Trace:
I20260923 19:50:17.134420 7362 raft_consensus.cc:493] T a75c4436a67f453e973a7a7645de79b1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:17.134407 6459 rpcz_store.cc:276] 0923 19:50:15.506833 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.506920 (+ 87us) service_pool.cc:224] Handling call
0923 19:50:17.093813 (+1586893us) ts_tablet_manager.cc:1151] Deleting tablet cd02244c52ad4d2ab3915108a92a6f97
0923 19:50:17.093822 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.108819 (+ 14997us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:17.126498 (+ 17679us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:17.133637 (+ 7139us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1578186}
I20260923 19:50:17.134881 6459 tablet_replica.cc:333] T 235b4b8081ad4a13937a7941344dbc33 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:17.128000 6456 tablet_bootstrap.cc:492] T ed9fb0cab0bd43b7a05d7376125b187e P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:17.135181 7362 raft_consensus.cc:515] T a75c4436a67f453e973a7a7645de79b1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.135419 6456 ts_tablet_manager.cc:1403] T ed9fb0cab0bd43b7a05d7376125b187e P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.052s user 0.003s sys 0.000s
I20260923 19:50:17.136165 7362 leader_election.cc:290] T a75c4436a67f453e973a7a7645de79b1 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:17.136654 6279 leader_election.cc:343] T a75c4436a67f453e973a7a7645de79b1 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: a75c4436a67f453e973a7a7645de79b1
I20260923 19:50:17.136392 7507 raft_consensus.cc:493] T 601a0ff319cc4c9a898d52bbcb19184b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:17.136931 7507 raft_consensus.cc:515] T 601a0ff319cc4c9a898d52bbcb19184b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.137110 6456 raft_consensus.cc:359] T ed9fb0cab0bd43b7a05d7376125b187e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.137241 6456 raft_consensus.cc:385] T ed9fb0cab0bd43b7a05d7376125b187e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:17.137288 6456 raft_consensus.cc:740] T ed9fb0cab0bd43b7a05d7376125b187e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:17.137532 7507 leader_election.cc:290] T 601a0ff319cc4c9a898d52bbcb19184b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:17.136559 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75c4436a67f453e973a7a7645de79b1" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:17.138195 6139 leader_election.cc:343] T 601a0ff319cc4c9a898d52bbcb19184b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 601a0ff319cc4c9a898d52bbcb19184b
W20260923 19:50:17.138267 6280 leader_election.cc:343] T a75c4436a67f453e973a7a7645de79b1 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:17.138269 6459 raft_consensus.cc:2243] T 235b4b8081ad4a13937a7941344dbc33 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:17.138374 6280 leader_election.cc:304] T a75c4436a67f453e973a7a7645de79b1 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:17.138465 6459 raft_consensus.cc:2272] T 235b4b8081ad4a13937a7941344dbc33 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:17.138780 7362 raft_consensus.cc:2749] T a75c4436a67f453e973a7a7645de79b1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:17.139052 6137 leader_election.cc:343] T 601a0ff319cc4c9a898d52bbcb19184b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 601a0ff319cc4c9a898d52bbcb19184b
I20260923 19:50:17.139256 6137 leader_election.cc:304] T 601a0ff319cc4c9a898d52bbcb19184b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:17.139675 7507 raft_consensus.cc:2749] T 601a0ff319cc4c9a898d52bbcb19184b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:17.139071 6459 ts_tablet_manager.cc:1916] T 235b4b8081ad4a13937a7941344dbc33 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:17.129830 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet c0ff8838ab17433ab733d3b293d4964f (table default.Table_c67ffb2902d446cba5c75e4a3d46d559 [id=b703874c0f19412b96d6776a2cda5caa]) successfully deleted
I20260923 19:50:17.142445 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 223edddace234a16b2d360504a99c28b (table default.Table_4b2190aa0f324c3987e02081e95555e4 [id=ed438085f7054d9993a39852df4cc790]) successfully deleted
I20260923 19:50:17.143275 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 0d70deeda179486291195476e47a9ae6 (table default.Table_e99b5d82a0814c538bfe455a29c4fa8e [id=d1e262e6e34742538b2b26c5fae80a99]) successfully deleted
W20260923 19:50:17.143625 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 94e111312f134034993bbd968366dea7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 94e111312f134034993bbd968366dea7 already in progress: creating tablet
W20260923 19:50:17.143955 5791 catalog_manager.cc:5030] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet a08446fcf1794dab9d3181904507456f because the tablet was not found. No further retry: Not found: Tablet not found: a08446fcf1794dab9d3181904507456f
W20260923 19:50:17.144263 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 2d6762b369d3496083947a4a47a51868 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d6762b369d3496083947a4a47a51868 already in progress: creating tablet
W20260923 19:50:17.144587 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 717995ec489343118809ada2a6b58804 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 717995ec489343118809ada2a6b58804 already in progress: creating tablet
I20260923 19:50:17.144852 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet cd02244c52ad4d2ab3915108a92a6f97 (table default.Table_bc20a658edaf42818fb401723f10f95f [id=a36a23e5497a47e19f09ec8627152b1f]) successfully deleted
I20260923 19:50:17.146620 5799 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet d39bfd7ec454447cbcc6ed965973355c
I20260923 19:50:17.148140 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet d3f7b33bbf3f453e8e841ee5d99c5b31
I20260923 19:50:17.148684 5804 master_service.cc:960] ReplaceTablet: received request to replace tablet ca73c91b58954537af373face5ad2f67 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:17.148873 7554 tablet.cc:1751] T 7b455812687f42848df5290d0cdbc312 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:17.152000 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet d39bfd7ec454447cbcc6ed965973355c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:17.152244 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet d3f7b33bbf3f453e8e841ee5d99c5b31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:17.153997 6321 tablet_service.cc:1558] Processing DeleteTablet for tablet d3f7b33bbf3f453e8e841ee5d99c5b31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:17.154264 6025 tablet_service.cc:1558] Processing DeleteTablet for tablet dbe06eba8067413a903e4a07c2768484 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:17.149859 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet f8007918eca14c81947e5999fe13a705
I20260923 19:50:17.154444 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet d6d3601a392f4723b4ca00f6e12b950c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:17.150122 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 3a4b9d48f02a4372adce6d9eb80935f6
I20260923 19:50:17.155218 5797 catalog_manager.cc:6934] ReplaceTablet: tablet f8007918eca14c81947e5999fe13a705 deleted and replaced by tablet 75958985ee414a5a9907ec0c7dece252
I20260923 19:50:17.155519 5797 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_64791d9d1cef4cfe9d420e405abe816e" } new_table_name: "default.Table_fb92f0dc809c49018d4300eaf32b6a8b" modify_external_catalogs: true
I20260923 19:50:17.155617 5796 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_af2e4e3ea01540f180d3c3b5213da913" } new_table_name: "default.Table_a97c70dd1454425e9e3abc310ebc442b" modify_external_catalogs: true
I20260923 19:50:17.156970 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet b87872fb6cc0400c86eddffb29c898e8 with delete_type TABLET_DATA_DELETED (replaced by tablet 37769256de33432697e9d4fb235f473f) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:17.157223 6461 tablet_replica.cc:333] T dbe06eba8067413a903e4a07c2768484 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:17.157418 6461 raft_consensus.cc:2243] T dbe06eba8067413a903e4a07c2768484 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:17.157433 6308 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a4b9d48f02a4372adce6d9eb80935f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:17.157567 6461 raft_consensus.cc:2272] T dbe06eba8067413a903e4a07c2768484 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:17.157616 6321 tablet_service.cc:1558] Processing DeleteTablet for tablet f8007918eca14c81947e5999fe13a705 with delete_type TABLET_DATA_DELETED (replaced by tablet 75958985ee414a5a9907ec0c7dece252) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:17.158149 6461 ts_tablet_manager.cc:1916] T dbe06eba8067413a903e4a07c2768484 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:17.151010 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_cc866643127a4bc8aebae6c828c10bac" } new_table_name: "default.Table_46ecbe8002024ce5ac1dfd7644c19ec9" modify_external_catalogs: true
I20260923 19:50:17.162623 6316 tablet_service.cc:1558] Processing DeleteTablet for tablet d39bfd7ec454447cbcc6ed965973355c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:17.151525 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_4182e2a68072409081f00598f5232c5a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:17.163707 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4182e2a68072409081f00598f5232c5a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:17.151968 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_9eb8348988b14a1e8b36839078e0f2d2" } new_table_name: "default.Table_b1d43c43c77240748d3bf2c2eaee1d65" modify_external_catalogs: true
I20260923 19:50:17.152398 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_94ed1fa75fba4ca69e19a74840c564c5" } new_table_name: "default.Table_9f1bedfe0be845e093fca27534320732" modify_external_catalogs: true
W20260923 19:50:17.153728 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet d39bfd7ec454447cbcc6ed965973355c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d39bfd7ec454447cbcc6ed965973355c already in progress: creating tablet
W20260923 19:50:17.167727 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet d3f7b33bbf3f453e8e841ee5d99c5b31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3f7b33bbf3f453e8e841ee5d99c5b31 already in progress: creating tablet
I20260923 19:50:17.169371 6454 tablet_bootstrap.cc:654] T 86388fa08c454da9ad2ca0124dcba10b P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:17.169545 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a4b9d48f02a4372adce6d9eb80935f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:17.169752 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet f8007918eca14c81947e5999fe13a705 with delete_type TABLET_DATA_DELETED (replaced by tablet 75958985ee414a5a9907ec0c7dece252) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:17.182039 6461 ts_tablet_manager.cc:1929] T dbe06eba8067413a903e4a07c2768484 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:17.182262 6461 log.cc:1199] T dbe06eba8067413a903e4a07c2768484 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/dbe06eba8067413a903e4a07c2768484
I20260923 19:50:17.182688 6461 ts_tablet_manager.cc:1950] T dbe06eba8067413a903e4a07c2768484 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:17.183362 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_0dc41b18f4d248faa5eb104b1f413442"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:17.184178 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet dbe06eba8067413a903e4a07c2768484 (table default.Table_85f67787052f46c2b29555acf4abc05c [id=98fdaeb42b5a426f8d96225de816958d]) successfully deleted
I20260923 19:50:17.184650 6461 tablet_replica.cc:333] T d6d3601a392f4723b4ca00f6e12b950c P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:17.184983 6461 raft_consensus.cc:2243] T d6d3601a392f4723b4ca00f6e12b950c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260923 19:50:17.185832 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0dc41b18f4d248faa5eb104b1f413442 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:17.188758 6461 raft_consensus.cc:2272] T d6d3601a392f4723b4ca00f6e12b950c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:17.189761 6461 ts_tablet_manager.cc:1916] T d6d3601a392f4723b4ca00f6e12b950c P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:17.192781 7507 raft_consensus.cc:493] T 18bab39d85f94f4283f0b18c1c9b48a2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:17.192950 7507 raft_consensus.cc:515] T 18bab39d85f94f4283f0b18c1c9b48a2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.193688 7507 leader_election.cc:290] T 18bab39d85f94f4283f0b18c1c9b48a2 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:17.194684 7256 raft_consensus.cc:493] T 5e711e48156b46b5a517b330d6d41309 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:17.194821 7256 raft_consensus.cc:515] T 5e711e48156b46b5a517b330d6d41309 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:17.195319 6137 leader_election.cc:343] T 18bab39d85f94f4283f0b18c1c9b48a2 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 18bab39d85f94f4283f0b18c1c9b48a2
I20260923 19:50:17.195465 7256 leader_election.cc:290] T 5e711e48156b46b5a517b330d6d41309 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:17.196127 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e711e48156b46b5a517b330d6d41309" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:17.196300 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bab39d85f94f4283f0b18c1c9b48a2" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:17.196465 6341 raft_consensus.cc:2468] T 18bab39d85f94f4283f0b18c1c9b48a2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
W20260923 19:50:17.196640 6280 leader_election.cc:343] T 5e711e48156b46b5a517b330d6d41309 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:17.197072 6139 leader_election.cc:304] T 18bab39d85f94f4283f0b18c1c9b48a2 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:17.197386 7507 raft_consensus.cc:2804] T 18bab39d85f94f4283f0b18c1c9b48a2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:17.197472 7507 raft_consensus.cc:493] T 18bab39d85f94f4283f0b18c1c9b48a2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:17.197539 7507 raft_consensus.cc:3060] T 18bab39d85f94f4283f0b18c1c9b48a2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:17.199826 6457 tablet_bootstrap.cc:492] T e6e04d16675443fc923a5f8216e292b6 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:17.200078 6457 ts_tablet_manager.cc:1403] T e6e04d16675443fc923a5f8216e292b6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.107s user 0.007s sys 0.004s
W20260923 19:50:17.200433 6279 leader_election.cc:343] T 5e711e48156b46b5a517b330d6d41309 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 5e711e48156b46b5a517b330d6d41309
I20260923 19:50:17.200541 6279 leader_election.cc:304] T 5e711e48156b46b5a517b330d6d41309 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:17.200834 7256 raft_consensus.cc:2749] T 5e711e48156b46b5a517b330d6d41309 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:17.201226 6457 raft_consensus.cc:359] T e6e04d16675443fc923a5f8216e292b6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.201493 6457 raft_consensus.cc:385] T e6e04d16675443fc923a5f8216e292b6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:17.201618 6457 raft_consensus.cc:740] T e6e04d16675443fc923a5f8216e292b6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:17.201984 6457 consensus_queue.cc:260] T e6e04d16675443fc923a5f8216e292b6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.201751 7507 raft_consensus.cc:515] T 18bab39d85f94f4283f0b18c1c9b48a2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.205302 7507 leader_election.cc:290] T 18bab39d85f94f4283f0b18c1c9b48a2 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:17.205727 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18bab39d85f94f4283f0b18c1c9b48a2" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:17.205940 6341 raft_consensus.cc:3060] T 18bab39d85f94f4283f0b18c1c9b48a2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:17.208667 6341 raft_consensus.cc:2468] T 18bab39d85f94f4283f0b18c1c9b48a2 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:17.209488 6139 leader_election.cc:304] T 18bab39d85f94f4283f0b18c1c9b48a2 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:17.209784 7507 raft_consensus.cc:2804] T 18bab39d85f94f4283f0b18c1c9b48a2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:17.210152 7507 raft_consensus.cc:697] T 18bab39d85f94f4283f0b18c1c9b48a2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:17.210522 7507 consensus_queue.cc:237] T 18bab39d85f94f4283f0b18c1c9b48a2 P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.210932 7557 tablet.cc:1751] T 7b455812687f42848df5290d0cdbc312 P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260923 19:50:17.212080 6137 leader_election.cc:343] T 18bab39d85f94f4283f0b18c1c9b48a2 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 18bab39d85f94f4283f0b18c1c9b48a2
I20260923 19:50:17.214165 6457 ts_tablet_manager.cc:1434] T e6e04d16675443fc923a5f8216e292b6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.014s user 0.000s sys 0.002s
I20260923 19:50:17.214116 6456 consensus_queue.cc:260] T ed9fb0cab0bd43b7a05d7376125b187e P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.214788 6456 ts_tablet_manager.cc:1434] T ed9fb0cab0bd43b7a05d7376125b187e P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.079s user 0.002s sys 0.000s
I20260923 19:50:17.219128 6456 tablet_bootstrap.cc:492] T d6d3601a392f4723b4ca00f6e12b950c P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:17.221050 6456 tablet_bootstrap.cc:654] T d6d3601a392f4723b4ca00f6e12b950c P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:17.230057 6457 tablet_bootstrap.cc:492] T 528fca12bfe04747830ad1d3bb323676 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
W20260923 19:50:17.233695 5791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.143.252:45543, user_credentials={real_user=slave}} blocked reactor thread for 88281.8us
I20260923 19:50:17.233776 6454 tablet_bootstrap.cc:492] T 86388fa08c454da9ad2ca0124dcba10b P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:17.233922 6454 ts_tablet_manager.cc:1403] T 86388fa08c454da9ad2ca0124dcba10b P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.110s user 0.010s sys 0.005s
I20260923 19:50:17.234349 6457 tablet_bootstrap.cc:654] T 528fca12bfe04747830ad1d3bb323676 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:17.234797 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet 465371cfbe544ba98e6eea05033ecf05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:17.234707 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet d3f7b33bbf3f453e8e841ee5d99c5b31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:17.235225 6454 raft_consensus.cc:359] T 86388fa08c454da9ad2ca0124dcba10b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.235392 6454 raft_consensus.cc:385] T 86388fa08c454da9ad2ca0124dcba10b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:17.234843 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet d39bfd7ec454447cbcc6ed965973355c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:17.235458 6454 raft_consensus.cc:740] T 86388fa08c454da9ad2ca0124dcba10b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:17.235852 6454 consensus_queue.cc:260] T 86388fa08c454da9ad2ca0124dcba10b P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.238940 6454 ts_tablet_manager.cc:1434] T 86388fa08c454da9ad2ca0124dcba10b P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260923 19:50:17.239343 6454 tablet_bootstrap.cc:492] T 870db252d8414be7bbe613ea467b5f3a P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:17.242731 7134 consensus_queue.cc:1048] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:17.243927 6160 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:60136 (request call id 140) took 1418 ms. Trace:
I20260923 19:50:17.244124 6160 rpcz_store.cc:276] 0923 19:50:15.825725 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.838913 (+ 13188us) service_pool.cc:224] Handling call
0923 19:50:17.091291 (+1252378us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x6160000e4d54. stack: 00007fc70c102366 00007fc70c102120 00007fc70b10c34d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007fc7181c5b50 00007fc71c0bd1ff 00007fc716484bd6 00007fc716484905 00007fc71324c63e 00007fc71324b51e 00007fc713251758 00007fc7132520bf 00007fc713251ee8 0000000000aaef9c
0923 19:50:17.243879 (+152588us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":257783168}
I20260923 19:50:17.246273 6459 ts_tablet_manager.cc:1929] T 235b4b8081ad4a13937a7941344dbc33 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:17.246392 6459 log.cc:1199] T 235b4b8081ad4a13937a7941344dbc33 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/235b4b8081ad4a13937a7941344dbc33
I20260923 19:50:17.246707 6459 ts_tablet_manager.cc:1950] T 235b4b8081ad4a13937a7941344dbc33 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:17.247001 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 732) took 1641 ms. Trace:
I20260923 19:50:17.248427 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet 601a0ff319cc4c9a898d52bbcb19184b with delete_type TABLET_DATA_DELETED (replaced by tablet 02fa9052a7054659baf9b07b770bb538) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:17.249076 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet f8007918eca14c81947e5999fe13a705 with delete_type TABLET_DATA_DELETED (replaced by tablet 75958985ee414a5a9907ec0c7dece252) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:17.251050 6454 tablet_bootstrap.cc:654] T 870db252d8414be7bbe613ea467b5f3a P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:17.255138 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a4b9d48f02a4372adce6d9eb80935f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:17.255349 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet 18bab39d85f94f4283f0b18c1c9b48a2 with delete_type TABLET_DATA_DELETED (replaced by tablet ebc288d8d453481592df11cd1bfed3ac) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:17.260187 6458 ts_tablet_manager.cc:1929] T 870db252d8414be7bbe613ea467b5f3a P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:17.260300 6458 log.cc:1199] T 870db252d8414be7bbe613ea467b5f3a P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/870db252d8414be7bbe613ea467b5f3a
I20260923 19:50:17.260572 6458 ts_tablet_manager.cc:1950] T 870db252d8414be7bbe613ea467b5f3a P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:17.266987 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 671) took 2767 ms. Trace:
I20260923 19:50:17.267107 6458 rpcz_store.cc:276] 0923 19:50:14.499836 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.499880 (+ 44us) service_pool.cc:224] Handling call
0923 19:50:17.130003 (+2630123us) ts_tablet_manager.cc:1151] Deleting tablet 870db252d8414be7bbe613ea467b5f3a
0923 19:50:17.130013 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.241400 (+111387us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:17.260128 (+ 18728us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:17.266957 (+ 6829us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2629985}
I20260923 19:50:17.268556 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 870db252d8414be7bbe613ea467b5f3a (table default.Table_24178fa82e3c4d878ed35fe32867eb98 [id=450e80ee217e4c6f91172b176cdda58c]) successfully deleted
I20260923 19:50:17.269194 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 692) took 2580 ms. Trace:
I20260923 19:50:17.269758 6458 rpcz_store.cc:276] 0923 19:50:14.688275 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.693928 (+ 5653us) service_pool.cc:224] Handling call
0923 19:50:17.269037 (+2575109us) ts_tablet_manager.cc:1151] Deleting tablet b6ef90ddd7a34dfdb8309d0e1c3688e7
0923 19:50:17.269053 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.269174 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2574841}
W20260923 19:50:17.270725 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet b6ef90ddd7a34dfdb8309d0e1c3688e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b6ef90ddd7a34dfdb8309d0e1c3688e7 already in progress: creating tablet
I20260923 19:50:17.271185 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 693) took 2582 ms. Trace:
I20260923 19:50:17.271571 6458 rpcz_store.cc:276] 0923 19:50:14.688375 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.694237 (+ 5862us) service_pool.cc:224] Handling call
0923 19:50:17.271090 (+2576853us) ts_tablet_manager.cc:1151] Deleting tablet 17a105f389d041dbb0bf8b828f990d27
0923 19:50:17.271099 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.271171 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2576673}
W20260923 19:50:17.272223 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 17a105f389d041dbb0bf8b828f990d27 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17a105f389d041dbb0bf8b828f990d27 already in progress: creating tablet
I20260923 19:50:17.272624 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 694) took 2584 ms. Trace:
I20260923 19:50:17.272969 6458 rpcz_store.cc:276] 0923 19:50:14.688505 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.694452 (+ 5947us) service_pool.cc:224] Handling call
0923 19:50:17.272522 (+2578070us) ts_tablet_manager.cc:1151] Deleting tablet cc581dd78b6d4fb29fff701ae794a89d
0923 19:50:17.272530 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.272610 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2577922}
W20260923 19:50:17.273574 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet cc581dd78b6d4fb29fff701ae794a89d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc581dd78b6d4fb29fff701ae794a89d already in progress: creating tablet
I20260923 19:50:17.274255 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 689) took 2587 ms. Trace:
I20260923 19:50:17.274444 6458 rpcz_store.cc:276] 0923 19:50:14.686538 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.703771 (+ 17233us) service_pool.cc:224] Handling call
0923 19:50:17.273861 (+2570090us) ts_tablet_manager.cc:1151] Deleting tablet 349c0447464d4c5380cf15cb4aeb54a4
0923 19:50:17.273869 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.274239 (+ 370us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2569746}
W20260923 19:50:17.275801 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 349c0447464d4c5380cf15cb4aeb54a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 349c0447464d4c5380cf15cb4aeb54a4 already in progress: creating tablet
I20260923 19:50:17.278080 6249 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
I20260923 19:50:17.288364 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 690) took 2601 ms. Trace:
I20260923 19:50:17.288893 6458 rpcz_store.cc:276] 0923 19:50:14.686692 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.704336 (+ 17644us) service_pool.cc:224] Handling call
0923 19:50:17.288219 (+2583883us) ts_tablet_manager.cc:1151] Deleting tablet c031d99a6f9844c29664236662e8d5f8
0923 19:50:17.288235 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.288340 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2583650}
W20260923 19:50:17.289738 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet c031d99a6f9844c29664236662e8d5f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c031d99a6f9844c29664236662e8d5f8 already in progress: creating tablet
I20260923 19:50:17.290599 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 695) took 2551 ms. Trace:
I20260923 19:50:17.290894 6458 rpcz_store.cc:276] 0923 19:50:14.739485 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:14.739908 (+ 423us) service_pool.cc:224] Handling call
0923 19:50:17.290183 (+2550275us) ts_tablet_manager.cc:1151] Deleting tablet c1347ea7774c40548975d10f6b3cba2a
0923 19:50:17.290196 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.290580 (+ 384us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2550110}
W20260923 19:50:17.291815 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet c1347ea7774c40548975d10f6b3cba2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c1347ea7774c40548975d10f6b3cba2a already in progress: creating tablet
I20260923 19:50:17.292280 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 698) took 2301 ms. Trace:
I20260923 19:50:17.292665 6458 rpcz_store.cc:276] 0923 19:50:14.990846 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.016193 (+ 25347us) service_pool.cc:224] Handling call
0923 19:50:17.292168 (+2275975us) ts_tablet_manager.cc:1151] Deleting tablet 104f137941e84b83bb9a726752c865c1
0923 19:50:17.292180 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.292263 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2275684}
W20260923 19:50:17.293395 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 104f137941e84b83bb9a726752c865c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 104f137941e84b83bb9a726752c865c1 already in progress: creating tablet
I20260923 19:50:17.294028 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 697) took 2303 ms. Trace:
I20260923 19:50:17.294541 6458 rpcz_store.cc:276] 0923 19:50:14.990729 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.025264 (+ 34535us) service_pool.cc:224] Handling call
0923 19:50:17.293906 (+2268642us) ts_tablet_manager.cc:1151] Deleting tablet 2ed8d49f1b3d4bee80b1822df2a7f495
0923 19:50:17.293918 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.294012 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2267158}
W20260923 19:50:17.295235 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 2ed8d49f1b3d4bee80b1822df2a7f495 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ed8d49f1b3d4bee80b1822df2a7f495 already in progress: creating tablet
I20260923 19:50:17.295699 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 704) took 2244 ms. Trace:
I20260923 19:50:17.296082 6458 rpcz_store.cc:276] 0923 19:50:15.051336 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.051501 (+ 165us) service_pool.cc:224] Handling call
0923 19:50:17.295589 (+2244088us) ts_tablet_manager.cc:1151] Deleting tablet 554655516bb547ad9c2aa1ee66dc8deb
0923 19:50:17.295600 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.295681 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2243887}
W20260923 19:50:17.296881 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 554655516bb547ad9c2aa1ee66dc8deb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 554655516bb547ad9c2aa1ee66dc8deb already in progress: creating tablet
I20260923 19:50:17.297567 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 705) took 2246 ms. Trace:
W20260923 19:50:17.299247 5995 consensus_peers.cc:597] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0 -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:17.298012 6458 rpcz_store.cc:276] 0923 19:50:15.051453 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.051735 (+ 282us) service_pool.cc:224] Handling call
0923 19:50:17.297432 (+2245697us) ts_tablet_manager.cc:1151] Deleting tablet 42ca4ffede1a472d8917a592fac7f746
0923 19:50:17.297444 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.297548 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2245543}
W20260923 19:50:17.301812 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 42ca4ffede1a472d8917a592fac7f746 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 42ca4ffede1a472d8917a592fac7f746 already in progress: creating tablet
I20260923 19:50:17.302560 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 708) took 2202 ms. Trace:
I20260923 19:50:17.302826 6458 rpcz_store.cc:276] 0923 19:50:15.099795 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.100175 (+ 380us) service_pool.cc:224] Handling call
0923 19:50:17.302248 (+2202073us) ts_tablet_manager.cc:1151] Deleting tablet cf0caa6afcf546678c233a9333b77a2a
0923 19:50:17.302258 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.302544 (+ 286us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2201907}
W20260923 19:50:17.303442 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet cf0caa6afcf546678c233a9333b77a2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf0caa6afcf546678c233a9333b77a2a already in progress: creating tablet
I20260923 19:50:17.303818 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 706) took 2207 ms. Trace:
I20260923 19:50:17.304131 6458 rpcz_store.cc:276] 0923 19:50:15.096725 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.116037 (+ 19312us) service_pool.cc:224] Handling call
0923 19:50:17.303729 (+2187692us) ts_tablet_manager.cc:1151] Deleting tablet c6598be958f842328a81fd092c6fcf64
0923 19:50:17.303738 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.303804 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2187499}
W20260923 19:50:17.304788 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet c6598be958f842328a81fd092c6fcf64 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c6598be958f842328a81fd092c6fcf64 already in progress: creating tablet
I20260923 19:50:17.306192 6454 tablet_bootstrap.cc:492] T 870db252d8414be7bbe613ea467b5f3a P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:17.306344 6454 ts_tablet_manager.cc:1403] T 870db252d8414be7bbe613ea467b5f3a P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.067s user 0.005s sys 0.003s
I20260923 19:50:17.307159 6454 raft_consensus.cc:359] T 870db252d8414be7bbe613ea467b5f3a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.307337 6454 raft_consensus.cc:385] T 870db252d8414be7bbe613ea467b5f3a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:17.307394 6454 raft_consensus.cc:740] T 870db252d8414be7bbe613ea467b5f3a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:17.307626 6454 consensus_queue.cc:260] T 870db252d8414be7bbe613ea467b5f3a P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.308156 6454 ts_tablet_manager.cc:1434] T 870db252d8414be7bbe613ea467b5f3a P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:50:17.308441 6454 tablet_bootstrap.cc:492] T 8d87f05f29bd476386ff6516676ce31a P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:17.305217 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 707) took 2205 ms. Trace:
I20260923 19:50:17.308646 6458 rpcz_store.cc:276] 0923 19:50:15.099419 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.156659 (+ 57240us) service_pool.cc:224] Handling call
0923 19:50:17.305107 (+2148448us) ts_tablet_manager.cc:1151] Deleting tablet bc64c9a47934420b9be3a6c8fe3ed91f
0923 19:50:17.305118 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.305199 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2146111}
W20260923 19:50:17.309060 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet bc64c9a47934420b9be3a6c8fe3ed91f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc64c9a47934420b9be3a6c8fe3ed91f already in progress: creating tablet
I20260923 19:50:17.309489 6458 tablet_replica.cc:333] T 18bab39d85f94f4283f0b18c1c9b48a2 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:17.311460 6458 raft_consensus.cc:2243] T 18bab39d85f94f4283f0b18c1c9b48a2 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:17.311606 6458 raft_consensus.cc:2272] T 18bab39d85f94f4283f0b18c1c9b48a2 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:17.312242 6458 ts_tablet_manager.cc:1916] T 18bab39d85f94f4283f0b18c1c9b48a2 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:17.318070 6454 tablet_bootstrap.cc:654] T 8d87f05f29bd476386ff6516676ce31a P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:17.318785 6459 rpcz_store.cc:276] 0923 19:50:15.606038 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.615642 (+ 9604us) service_pool.cc:224] Handling call
0923 19:50:17.134837 (+1519195us) ts_tablet_manager.cc:1151] Deleting tablet 235b4b8081ad4a13937a7941344dbc33
0923 19:50:17.134846 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.225444 (+ 90598us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:17.246216 (+ 20772us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:17.246988 (+ 772us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1519017}
I20260923 19:50:17.320098 6459 tablet_replica.cc:333] T ba4e9fee05994c0d8e7d1f21788280d3 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:17.320051 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 235b4b8081ad4a13937a7941344dbc33 (table default.Table_1a5602208673400faf5f272297ff82b9 [id=a7241c5e33894e8c97e723b3b90b8cc7]) successfully deleted
I20260923 19:50:17.320308 6459 raft_consensus.cc:2243] T ba4e9fee05994c0d8e7d1f21788280d3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:17.320510 6459 raft_consensus.cc:2272] T ba4e9fee05994c0d8e7d1f21788280d3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:17.321029 6459 ts_tablet_manager.cc:1916] T ba4e9fee05994c0d8e7d1f21788280d3 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:17.321051 6456 tablet_bootstrap.cc:492] T d6d3601a392f4723b4ca00f6e12b950c P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:17.321826 6456 ts_tablet_manager.cc:1403] T d6d3601a392f4723b4ca00f6e12b950c P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.103s user 0.004s sys 0.010s
I20260923 19:50:17.322654 6456 raft_consensus.cc:359] T d6d3601a392f4723b4ca00f6e12b950c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.322878 6456 raft_consensus.cc:385] T d6d3601a392f4723b4ca00f6e12b950c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:17.322981 6456 raft_consensus.cc:740] T d6d3601a392f4723b4ca00f6e12b950c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:17.323248 6456 consensus_queue.cc:260] T d6d3601a392f4723b4ca00f6e12b950c P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.313434 7499 log.cc:826] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae: Log is configured to *not* fsync() on all Append() calls
I20260923 19:50:17.324892 6461 ts_tablet_manager.cc:1929] T d6d3601a392f4723b4ca00f6e12b950c P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:17.325060 6461 log.cc:1199] T d6d3601a392f4723b4ca00f6e12b950c P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/d6d3601a392f4723b4ca00f6e12b950c
I20260923 19:50:17.325659 6456 ts_tablet_manager.cc:1434] T d6d3601a392f4723b4ca00f6e12b950c P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260923 19:50:17.326006 6456 tablet_bootstrap.cc:492] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:17.329277 6456 tablet_bootstrap.cc:654] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:17.333369 6461 ts_tablet_manager.cc:1950] T d6d3601a392f4723b4ca00f6e12b950c P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:17.334591 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet d6d3601a392f4723b4ca00f6e12b950c (table default.Table_74b3ada03dc14044b09a369b0e3782c7 [id=6c09f84a1d19402b8b59bbc60ae92bcb]) successfully deleted
I20260923 19:50:17.336477 6461 tablet_replica.cc:333] T b87872fb6cc0400c86eddffb29c898e8 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:17.336702 6461 raft_consensus.cc:2243] T b87872fb6cc0400c86eddffb29c898e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:17.336874 6461 raft_consensus.cc:2272] T b87872fb6cc0400c86eddffb29c898e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:17.337428 6461 ts_tablet_manager.cc:1916] T b87872fb6cc0400c86eddffb29c898e8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:17.354305 7507 raft_consensus.cc:493] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:17.354465 7507 raft_consensus.cc:515] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.355182 7507 leader_election.cc:290] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:17.358296 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92aaac328934d95a89e0fc08a80b0b1" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:17.358520 6341 raft_consensus.cc:2468] T b92aaac328934d95a89e0fc08a80b0b1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:17.359050 6139 leader_election.cc:304] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:17.359313 7507 raft_consensus.cc:2804] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:17.359385 7507 raft_consensus.cc:493] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:17.359436 7507 raft_consensus.cc:3060] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:17.362826 7507 raft_consensus.cc:515] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.363523 7507 leader_election.cc:290] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:17.366189 6137 leader_election.cc:343] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: b92aaac328934d95a89e0fc08a80b0b1
I20260923 19:50:17.366494 6459 ts_tablet_manager.cc:1929] T ba4e9fee05994c0d8e7d1f21788280d3 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:17.366700 6459 log.cc:1199] T ba4e9fee05994c0d8e7d1f21788280d3 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/ba4e9fee05994c0d8e7d1f21788280d3
I20260923 19:50:17.367190 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92aaac328934d95a89e0fc08a80b0b1" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:17.367383 6341 raft_consensus.cc:3060] T b92aaac328934d95a89e0fc08a80b0b1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:17.367693 6459 ts_tablet_manager.cc:1950] T ba4e9fee05994c0d8e7d1f21788280d3 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:17.368178 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 736) took 1704 ms. Trace:
I20260923 19:50:17.368643 6459 rpcz_store.cc:276] 0923 19:50:15.663539 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.663590 (+ 51us) service_pool.cc:224] Handling call
0923 19:50:17.320048 (+1656458us) ts_tablet_manager.cc:1151] Deleting tablet ba4e9fee05994c0d8e7d1f21788280d3
0923 19:50:17.320059 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.329336 (+ 9277us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:17.344157 (+ 14821us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:17.368161 (+ 24004us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1641774}
I20260923 19:50:17.369360 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet ba4e9fee05994c0d8e7d1f21788280d3 (table default.Table_fa5d77accb2d4cb2a336e0394074518a [id=49bb9f954b544f41b75f6035b1ea68b1]) successfully deleted
I20260923 19:50:17.369724 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 737) took 1680 ms. Trace:
I20260923 19:50:17.369943 6459 rpcz_store.cc:276] 0923 19:50:15.689019 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.689127 (+ 108us) service_pool.cc:224] Handling call
0923 19:50:17.369398 (+1680271us) ts_tablet_manager.cc:1151] Deleting tablet 5494818771f04f92b37a6991b73e40a6
0923 19:50:17.369410 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.369706 (+ 296us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1680067}
I20260923 19:50:17.370311 6341 raft_consensus.cc:2468] T b92aaac328934d95a89e0fc08a80b0b1 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
W20260923 19:50:17.370553 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 5494818771f04f92b37a6991b73e40a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5494818771f04f92b37a6991b73e40a6 already in progress: creating tablet
I20260923 19:50:17.370887 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 738) took 1681 ms. Trace:
I20260923 19:50:17.371030 6139 leader_election.cc:304] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:17.371304 7507 raft_consensus.cc:2804] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:17.371403 7507 raft_consensus.cc:697] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:17.371646 7507 consensus_queue.cc:237] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.374748 7256 consensus_queue.cc:1048] T 2ce6378a6bd844a485aebb96081307e3 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260923 19:50:17.378412 6137 leader_election.cc:343] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: b92aaac328934d95a89e0fc08a80b0b1
I20260923 19:50:17.384720 6461 ts_tablet_manager.cc:1929] T b87872fb6cc0400c86eddffb29c898e8 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:17.385681 6461 log.cc:1199] T b87872fb6cc0400c86eddffb29c898e8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/b87872fb6cc0400c86eddffb29c898e8
I20260923 19:50:17.386708 6458 ts_tablet_manager.cc:1929] T 18bab39d85f94f4283f0b18c1c9b48a2 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:17.386373 7134 raft_consensus.cc:493] T 3d74560614b744188e759b981ad89a7d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:17.386507 6461 ts_tablet_manager.cc:1950] T b87872fb6cc0400c86eddffb29c898e8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:17.371155 6459 rpcz_store.cc:276] 0923 19:50:15.689145 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.689919 (+ 774us) service_pool.cc:224] Handling call
0923 19:50:17.370615 (+1680696us) ts_tablet_manager.cc:1151] Deleting tablet 22c89609da884c47b1dbc1470b37efbe
0923 19:50:17.370624 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.370870 (+ 246us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1680514}
I20260923 19:50:17.387648 7134 raft_consensus.cc:515] T 3d74560614b744188e759b981ad89a7d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.386680 7566 raft_consensus.cc:493] T a53f2eb08330411ebe417d4e1e414db6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:17.388622 7566 raft_consensus.cc:515] T a53f2eb08330411ebe417d4e1e414db6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.388536 7134 leader_election.cc:290] T 3d74560614b744188e759b981ad89a7d P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:17.391036 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 22c89609da884c47b1dbc1470b37efbe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22c89609da884c47b1dbc1470b37efbe already in progress: creating tablet
I20260923 19:50:17.391207 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 740) took 1667 ms. Trace:
I20260923 19:50:17.392052 6459 rpcz_store.cc:276] 0923 19:50:15.723788 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.724064 (+ 276us) service_pool.cc:224] Handling call
0923 19:50:17.391076 (+1667012us) ts_tablet_manager.cc:1151] Deleting tablet 8788f1917cb0449f84f92df2c81feff6
0923 19:50:17.391089 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.391188 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1666895}
W20260923 19:50:17.392549 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 8788f1917cb0449f84f92df2c81feff6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8788f1917cb0449f84f92df2c81feff6 already in progress: creating tablet
I20260923 19:50:17.392647 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 742) took 1668 ms. Trace:
I20260923 19:50:17.392709 6459 rpcz_store.cc:276] 0923 19:50:15.723941 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.723998 (+ 57us) service_pool.cc:224] Handling call
0923 19:50:17.392539 (+1668541us) ts_tablet_manager.cc:1151] Deleting tablet 900726a4f2f84dde90e8bb3ab26b71c9
0923 19:50:17.392549 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.392630 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68,"tablet-delete.queue_time_us":1668361}
W20260923 19:50:17.393131 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 900726a4f2f84dde90e8bb3ab26b71c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 900726a4f2f84dde90e8bb3ab26b71c9 already in progress: creating tablet
I20260923 19:50:17.395174 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 741) took 1671 ms. Trace:
I20260923 19:50:17.395226 7566 leader_election.cc:290] T a53f2eb08330411ebe417d4e1e414db6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:17.395303 6459 rpcz_store.cc:276] 0923 19:50:15.723873 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.724211 (+ 338us) service_pool.cc:224] Handling call
0923 19:50:17.395067 (+1670856us) ts_tablet_manager.cc:1151] Deleting tablet 8b4c2a0ae64841c6971a0840c1d5b739
0923 19:50:17.395077 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.395155 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1670726}
I20260923 19:50:17.395517 7566 raft_consensus.cc:493] T 1b1d9413e1e24547b491a160d851377b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260923 19:50:17.395732 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 8b4c2a0ae64841c6971a0840c1d5b739 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b4c2a0ae64841c6971a0840c1d5b739 already in progress: creating tablet
I20260923 19:50:17.395823 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 744) took 1670 ms. Trace:
I20260923 19:50:17.395913 6459 rpcz_store.cc:276] 0923 19:50:15.725059 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.725114 (+ 55us) service_pool.cc:224] Handling call
0923 19:50:17.395719 (+1670605us) ts_tablet_manager.cc:1151] Deleting tablet 950428e098994f2a9b5b17eeb36915cd
0923 19:50:17.395730 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.395805 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1670455}
I20260923 19:50:17.395794 7566 raft_consensus.cc:515] T 1b1d9413e1e24547b491a160d851377b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.396358 6459 tablet_replica.cc:333] T 2ccfe6531fc44f86a0edc8bda1547442 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
W20260923 19:50:17.396332 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 950428e098994f2a9b5b17eeb36915cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 950428e098994f2a9b5b17eeb36915cd already in progress: creating tablet
I20260923 19:50:17.396566 6459 raft_consensus.cc:2243] T 2ccfe6531fc44f86a0edc8bda1547442 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:17.396749 6459 raft_consensus.cc:2272] T 2ccfe6531fc44f86a0edc8bda1547442 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:17.397310 6459 ts_tablet_manager.cc:1916] T 2ccfe6531fc44f86a0edc8bda1547442 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:17.397403 7566 leader_election.cc:290] T 1b1d9413e1e24547b491a160d851377b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:17.387049 6456 tablet_bootstrap.cc:492] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:17.399631 6458 log.cc:1199] T 18bab39d85f94f4283f0b18c1c9b48a2 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/18bab39d85f94f4283f0b18c1c9b48a2
I20260923 19:50:17.399646 6456 ts_tablet_manager.cc:1403] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.074s user 0.004s sys 0.002s
I20260923 19:50:17.390396 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a53f2eb08330411ebe417d4e1e414db6" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:17.392264 6280 consensus_peers.cc:597] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0d70deeda179486291195476e47a9ae6. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:17.388718 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d74560614b744188e759b981ad89a7d" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:17.400096 6458 ts_tablet_manager.cc:1950] T 18bab39d85f94f4283f0b18c1c9b48a2 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:17.400660 6456 raft_consensus.cc:359] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.400817 6456 raft_consensus.cc:385] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:17.400902 6456 raft_consensus.cc:740] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
W20260923 19:50:17.401090 5996 leader_election.cc:343] T 3d74560614b744188e759b981ad89a7d P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:17.401276 5996 leader_election.cc:343] T a53f2eb08330411ebe417d4e1e414db6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:17.401173 6456 consensus_queue.cc:260] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:17.401510 6280 consensus_peers.cc:597] T 12f4abb573bd4be6961b55c27c684d06 P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:17.401839 6456 ts_tablet_manager.cc:1434] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:17.402837 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet b87872fb6cc0400c86eddffb29c898e8 (table default.Table_59a69335b281437498cea78a9cb3fadb [id=ac71e26491774bcd93d004a319b086c8]) successfully deleted
W20260923 19:50:17.403286 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 3a4b9d48f02a4372adce6d9eb80935f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3a4b9d48f02a4372adce6d9eb80935f6 already in progress: creating tablet
I20260923 19:50:17.402494 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d74560614b744188e759b981ad89a7d" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:17.403892 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a53f2eb08330411ebe417d4e1e414db6" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:17.404415 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1d9413e1e24547b491a160d851377b" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:17.404628 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet f8007918eca14c81947e5999fe13a705 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f8007918eca14c81947e5999fe13a705 already in progress: creating tablet
I20260923 19:50:17.402631 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1d9413e1e24547b491a160d851377b" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:17.405134 5996 leader_election.cc:343] T 1b1d9413e1e24547b491a160d851377b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:17.410513 6459 ts_tablet_manager.cc:1929] T 2ccfe6531fc44f86a0edc8bda1547442 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260923 19:50:17.415764 5995 leader_election.cc:343] T 3d74560614b744188e759b981ad89a7d P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:17.416584 5995 leader_election.cc:304] T 3d74560614b744188e759b981ad89a7d P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
W20260923 19:50:17.417143 5995 leader_election.cc:343] T a53f2eb08330411ebe417d4e1e414db6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:17.417661 5995 leader_election.cc:304] T a53f2eb08330411ebe417d4e1e414db6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:17.417299 7568 raft_consensus.cc:2749] T 3d74560614b744188e759b981ad89a7d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:17.418102 7568 raft_consensus.cc:2749] T a53f2eb08330411ebe417d4e1e414db6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:17.418517 5995 leader_election.cc:343] T 1b1d9413e1e24547b491a160d851377b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:17.418807 5995 leader_election.cc:304] T 1b1d9413e1e24547b491a160d851377b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:17.419492 7568 raft_consensus.cc:2749] T 1b1d9413e1e24547b491a160d851377b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:17.419456 7256 consensus_queue.cc:1048] T 12f4abb573bd4be6961b55c27c684d06 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:17.414634 6454 tablet_bootstrap.cc:492] T 8d87f05f29bd476386ff6516676ce31a P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:17.430033 6454 ts_tablet_manager.cc:1403] T 8d87f05f29bd476386ff6516676ce31a P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.122s user 0.003s sys 0.010s
I20260923 19:50:17.430701 6454 raft_consensus.cc:359] T 8d87f05f29bd476386ff6516676ce31a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.430847 6454 raft_consensus.cc:385] T 8d87f05f29bd476386ff6516676ce31a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:17.430896 6454 raft_consensus.cc:740] T 8d87f05f29bd476386ff6516676ce31a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:17.431133 6454 consensus_queue.cc:260] T 8d87f05f29bd476386ff6516676ce31a P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.431712 6454 ts_tablet_manager.cc:1434] T 8d87f05f29bd476386ff6516676ce31a P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:17.432006 6454 tablet_bootstrap.cc:492] T efc63a151f6444dfb03c3f15f6f54473 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:17.433952 6454 tablet_bootstrap.cc:654] T efc63a151f6444dfb03c3f15f6f54473 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:17.435537 6459 log.cc:1199] T 2ccfe6531fc44f86a0edc8bda1547442 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/2ccfe6531fc44f86a0edc8bda1547442
I20260923 19:50:17.436014 6459 ts_tablet_manager.cc:1950] T 2ccfe6531fc44f86a0edc8bda1547442 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:17.436866 6454 tablet_bootstrap.cc:492] T efc63a151f6444dfb03c3f15f6f54473 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:17.437031 6454 ts_tablet_manager.cc:1403] T efc63a151f6444dfb03c3f15f6f54473 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20260923 19:50:17.437631 6454 raft_consensus.cc:359] T efc63a151f6444dfb03c3f15f6f54473 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.437803 6454 raft_consensus.cc:385] T efc63a151f6444dfb03c3f15f6f54473 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:17.437891 6454 raft_consensus.cc:740] T efc63a151f6444dfb03c3f15f6f54473 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:17.438153 6454 consensus_queue.cc:260] T efc63a151f6444dfb03c3f15f6f54473 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.438724 6454 ts_tablet_manager.cc:1434] T efc63a151f6444dfb03c3f15f6f54473 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:17.439008 6454 tablet_bootstrap.cc:492] T edb52bd88b424129bbdc45de89b56efb P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:17.439234 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 748) took 1707 ms. Trace:
I20260923 19:50:17.439383 6459 rpcz_store.cc:276] 0923 19:50:15.731807 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.731857 (+ 50us) service_pool.cc:224] Handling call
0923 19:50:17.396310 (+1664453us) ts_tablet_manager.cc:1151] Deleting tablet 2ccfe6531fc44f86a0edc8bda1547442
0923 19:50:17.396321 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.407603 (+ 11282us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:17.410457 (+ 2854us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:17.439218 (+ 28761us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1664289}
I20260923 19:50:17.440032 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 2ccfe6531fc44f86a0edc8bda1547442 (table default.Table_bbfd70af85d34f29bc8bbd6dbf85023d [id=d21707fbdafa4fb4a14990578cc7ab56]) successfully deleted
I20260923 19:50:17.440101 6459 tablet_replica.cc:333] T f5cb8dd5dcf54df9989dd808fe148ce6 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:17.440361 6459 raft_consensus.cc:2243] T f5cb8dd5dcf54df9989dd808fe148ce6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:17.440594 6459 raft_consensus.cc:2272] T f5cb8dd5dcf54df9989dd808fe148ce6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:17.441228 6459 ts_tablet_manager.cc:1916] T f5cb8dd5dcf54df9989dd808fe148ce6 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:17.450784 5796 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5ce73f31a1f64a24835a272fea8d65c4 consensus state has no leader
W20260923 19:50:17.451646 5805 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ed92b66cfdff410ca8421fd15352e148 consensus state has no leader
I20260923 19:50:17.452286 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet d1258abcb244430ca8456ad146aa0e67
W20260923 19:50:17.452499 5803 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1b7d35282dd148e7bfcf1277d34002bf consensus state has no leader
I20260923 19:50:17.452710 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet ca73c91b58954537af373face5ad2f67
I20260923 19:50:17.452891 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_9873b1fe765149cd908dac5d4de14e46"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:17.453172 5804 catalog_manager.cc:6934] ReplaceTablet: tablet ca73c91b58954537af373face5ad2f67 deleted and replaced by tablet c3bac0c76df144e2b2ae4fbb809e2d84
W20260923 19:50:17.453555 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9873b1fe765149cd908dac5d4de14e46 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:17.453491 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_37285845f6354f36bb1f2c008dd28922"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:17.454396 6457 tablet_bootstrap.cc:492] T 528fca12bfe04747830ad1d3bb323676 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:17.454519 6457 ts_tablet_manager.cc:1403] T 528fca12bfe04747830ad1d3bb323676 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.225s user 0.007s sys 0.030s
W20260923 19:50:17.454524 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_37285845f6354f36bb1f2c008dd28922 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:17.454638 5805 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet e6e04d16675443fc923a5f8216e292b6 (table default.Table_ea8c4179d37e4165869f5bf030971467 [id=5c206f48fb1a4be587f17803f654ce5a]). Expected version 1 got 0
W20260923 19:50:17.455334 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b9c084a319c449328b639d604c00946a consensus state has no leader
I20260923 19:50:17.455412 6457 raft_consensus.cc:359] T 528fca12bfe04747830ad1d3bb323676 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.455561 6457 raft_consensus.cc:385] T 528fca12bfe04747830ad1d3bb323676 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:17.455616 6457 raft_consensus.cc:740] T 528fca12bfe04747830ad1d3bb323676 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:17.455725 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_da6325e1e8c2435883ac5b9710afe956"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:17.455823 6457 consensus_queue.cc:260] T 528fca12bfe04747830ad1d3bb323676 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.456064 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_33eccae60b564266970bd8671c80df0c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:17.456176 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_da6325e1e8c2435883ac5b9710afe956 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:17.456331 6457 ts_tablet_manager.cc:1434] T 528fca12bfe04747830ad1d3bb323676 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
W20260923 19:50:17.456554 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_33eccae60b564266970bd8671c80df0c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:17.456631 6457 tablet_bootstrap.cc:492] T 658253ff3d014361803e1aeda978e59a P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:17.456687 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_52506d2d13c545bea0757f1a2802d817"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:17.457180 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_52506d2d13c545bea0757f1a2802d817 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:17.457929 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_07aaf9a4da6443b482d23a3267f97a0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:17.458398 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_07aaf9a4da6443b482d23a3267f97a0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:17.458706 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet ca73c91b58954537af373face5ad2f67 with delete_type TABLET_DATA_DELETED (replaced by tablet c3bac0c76df144e2b2ae4fbb809e2d84) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:17.461304 6025 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d74560614b744188e759b981ad89a7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:17.461755 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet 7af330ae1aaa48209f2bd1880bcfebb1 with delete_type TABLET_DATA_DELETED (replaced by tablet 55991fab89be47afba7fcd08673ef82f) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:17.461549 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet c031d99a6f9844c29664236662e8d5f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:17.461843 6457 tablet_bootstrap.cc:654] T 658253ff3d014361803e1aeda978e59a P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:17.461982 6027 tablet_service.cc:1558] Processing DeleteTablet for tablet fc151f4d78344efeada6d6e57af6eb9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:17.462059 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b1d9413e1e24547b491a160d851377b with delete_type TABLET_DATA_DELETED (replaced by tablet 355b2fc61d4f4efd918204079f1ebf35) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:17.462232 6461 tablet_replica.cc:333] T 3d74560614b744188e759b981ad89a7d P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:17.462397 6461 raft_consensus.cc:2243] T 3d74560614b744188e759b981ad89a7d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:17.462595 6461 raft_consensus.cc:2272] T 3d74560614b744188e759b981ad89a7d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:17.462666 6316 tablet_service.cc:1558] Processing DeleteTablet for tablet ca73c91b58954537af373face5ad2f67 with delete_type TABLET_DATA_DELETED (replaced by tablet c3bac0c76df144e2b2ae4fbb809e2d84) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:17.463114 6461 ts_tablet_manager.cc:1916] T 3d74560614b744188e759b981ad89a7d P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:17.464669 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet ca73c91b58954537af373face5ad2f67 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca73c91b58954537af373face5ad2f67 already in progress: creating tablet
I20260923 19:50:17.467338 5796 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 7b455812687f42848df5290d0cdbc312 (table default.Table_e9cc7064dc8e4c6bb9eadb9fc3f33e09 [id=e263e510102443df8fd2b5886fa01053]). Expected version 1 got 0
I20260923 19:50:17.467909 6316 tablet_service.cc:1558] Processing DeleteTablet for tablet d1258abcb244430ca8456ad146aa0e67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:17.469091 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet ca73c91b58954537af373face5ad2f67 with delete_type TABLET_DATA_DELETED (replaced by tablet c3bac0c76df144e2b2ae4fbb809e2d84) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:17.469307 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet d1258abcb244430ca8456ad146aa0e67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:17.469465 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet b92aaac328934d95a89e0fc08a80b0b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:17.469628 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet c0ff8838ab17433ab733d3b293d4964f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:17.473055 5796 master_service.cc:960] ReplaceTablet: received request to replace tablet d5d3f96ebf1c4d05aceb06ef53737e4f from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:17.467366 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_3f0fe2b329f64cdf9617315270900e4f" } modify_external_catalogs: true
I20260923 19:50:17.474244 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_3f0fe2b329f64cdf9617315270900e4f" } modify_external_catalogs: true
I20260923 19:50:17.476465 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet d1258abcb244430ca8456ad146aa0e67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:17.480816 6461 ts_tablet_manager.cc:1929] T 3d74560614b744188e759b981ad89a7d P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:17.481639 6199 raft_consensus.cc:3060] T 8d87f05f29bd476386ff6516676ce31a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:17.481716 6461 log.cc:1199] T 3d74560614b744188e759b981ad89a7d P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/3d74560614b744188e759b981ad89a7d
I20260923 19:50:17.484728 5803 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 8d87f05f29bd476386ff6516676ce31a (table default.Table_9fa8f8bfc6124f398a4acdf5e1e0b33a [id=02d2ab56def342c482c86ce96110342f]). Expected version 1 got 0
W20260923 19:50:17.487141 6280 consensus_peers.cc:597] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:17.487876 5801 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_08e8b19223d8498983c3571f2e650e8c" } modify_external_catalogs: true
I20260923 19:50:17.488116 5801 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_08e8b19223d8498983c3571f2e650e8c" } modify_external_catalogs: true
I20260923 19:50:17.485865 5798 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_98f26974f07c4799981e0b2b01d7cd8d" } modify_external_catalogs: true
I20260923 19:50:17.488881 5798 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_98f26974f07c4799981e0b2b01d7cd8d" } modify_external_catalogs: true
I20260923 19:50:17.491629 6461 ts_tablet_manager.cc:1950] T 3d74560614b744188e759b981ad89a7d P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:17.493129 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 3d74560614b744188e759b981ad89a7d (table default.Table_ca447ba1a2d04e7ab8954432c4a42c97 [id=7a040306f6064b3d8d10bdb87ab32247]) successfully deleted
W20260923 19:50:17.495301 6280 consensus_peers.cc:597] T 2ce6378a6bd844a485aebb96081307e3 P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:17.496613 6461 tablet_replica.cc:333] T 7af330ae1aaa48209f2bd1880bcfebb1 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:17.496966 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_60d05328969249e989f5118d456e8e21"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:17.497605 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_60d05328969249e989f5118d456e8e21 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:17.497907 6461 raft_consensus.cc:2243] T 7af330ae1aaa48209f2bd1880bcfebb1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:17.498644 6461 raft_consensus.cc:2272] T 7af330ae1aaa48209f2bd1880bcfebb1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:17.502516 6456 tablet_bootstrap.cc:492] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:17.499562 6461 ts_tablet_manager.cc:1916] T 7af330ae1aaa48209f2bd1880bcfebb1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:17.504463 6456 tablet_bootstrap.cc:654] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:17.506112 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 713) took 2263 ms. Trace:
I20260923 19:50:17.506281 6458 rpcz_store.cc:276] 0923 19:50:15.242709 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.243047 (+ 338us) service_pool.cc:224] Handling call
0923 19:50:17.309448 (+2066401us) ts_tablet_manager.cc:1151] Deleting tablet 18bab39d85f94f4283f0b18c1c9b48a2
0923 19:50:17.309457 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.331451 (+ 21994us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:17.386637 (+ 55186us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:17.506088 (+119451us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1798,"tablet-delete.queue_time_us":1939995}
I20260923 19:50:17.506986 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 18bab39d85f94f4283f0b18c1c9b48a2 (table default.Table_a0bee41bcb2d439fb8619a6c19152813 [id=8a710c10b5ca42548116d743cb0812c3]) successfully deleted
I20260923 19:50:17.507407 6458 tablet_replica.cc:333] T b92aaac328934d95a89e0fc08a80b0b1 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:17.507685 6458 raft_consensus.cc:2243] T b92aaac328934d95a89e0fc08a80b0b1 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:17.507899 6458 raft_consensus.cc:2272] T b92aaac328934d95a89e0fc08a80b0b1 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:17.508737 6458 ts_tablet_manager.cc:1916] T b92aaac328934d95a89e0fc08a80b0b1 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:17.515166 6461 ts_tablet_manager.cc:1929] T 7af330ae1aaa48209f2bd1880bcfebb1 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:17.516062 6461 log.cc:1199] T 7af330ae1aaa48209f2bd1880bcfebb1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/7af330ae1aaa48209f2bd1880bcfebb1
I20260923 19:50:17.516601 6461 ts_tablet_manager.cc:1950] T 7af330ae1aaa48209f2bd1880bcfebb1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:17.521796 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 7af330ae1aaa48209f2bd1880bcfebb1 (table default.Table_cd491412a6264b6aba16b6648a128b0f [id=fda97d4d322f453296d283fffa052c35]) successfully deleted
I20260923 19:50:17.522243 6461 tablet_replica.cc:333] T c031d99a6f9844c29664236662e8d5f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:17.522670 6461 raft_consensus.cc:2243] T c031d99a6f9844c29664236662e8d5f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:17.524869 6461 raft_consensus.cc:2272] T c031d99a6f9844c29664236662e8d5f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:17.528360 6461 ts_tablet_manager.cc:1916] T c031d99a6f9844c29664236662e8d5f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:17.530507 5803 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_e9cc7064dc8e4c6bb9eadb9fc3f33e09 [id=e263e510102443df8fd2b5886fa01053] alter complete (version 1)
I20260923 19:50:17.531420 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_c40ca6fb16fc44fca87eec30e15b47d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:17.531994 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c40ca6fb16fc44fca87eec30e15b47d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:17.533638 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet 870db252d8414be7bbe613ea467b5f3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:17.533638 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet efc63a151f6444dfb03c3f15f6f54473 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:07 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:17.535712 5799 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_611375feff304538a80e8b1eca51b3cd" } modify_external_catalogs: true
I20260923 19:50:17.535887 5799 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_611375feff304538a80e8b1eca51b3cd" } modify_external_catalogs: true
I20260923 19:50:17.539619 7507 raft_consensus.cc:493] T 86388fa08c454da9ad2ca0124dcba10b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:17.539762 7507 raft_consensus.cc:515] T 86388fa08c454da9ad2ca0124dcba10b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.540381 7507 leader_election.cc:290] T 86388fa08c454da9ad2ca0124dcba10b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:17.540489 7566 raft_consensus.cc:493] T 2398c59871d241f985bca1761e722180 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:17.540609 7566 raft_consensus.cc:515] T 2398c59871d241f985bca1761e722180 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.541026 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86388fa08c454da9ad2ca0124dcba10b" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:17.541229 7566 leader_election.cc:290] T 2398c59871d241f985bca1761e722180 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:17.541635 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398c59871d241f985bca1761e722180" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:17.542045 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86388fa08c454da9ad2ca0124dcba10b" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
W20260923 19:50:17.542245 5995 leader_election.cc:343] T 2398c59871d241f985bca1761e722180 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:17.543254 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398c59871d241f985bca1761e722180" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:17.543653 6137 leader_election.cc:304] T 86388fa08c454da9ad2ca0124dcba10b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:17.543857 5996 leader_election.cc:343] T 2398c59871d241f985bca1761e722180 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:17.544008 5996 leader_election.cc:304] T 2398c59871d241f985bca1761e722180 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:17.544059 7507 raft_consensus.cc:2749] T 86388fa08c454da9ad2ca0124dcba10b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:17.544296 5805 master_service.cc:960] ReplaceTablet: received request to replace tablet a10d35bf564d45488524d3d21721f4e5 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:17.545039 7566 raft_consensus.cc:2749] T 2398c59871d241f985bca1761e722180 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:17.548513 5804 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 8d87f05f29bd476386ff6516676ce31a (table default.Table_9fa8f8bfc6124f398a4acdf5e1e0b33a [id=02d2ab56def342c482c86ce96110342f]). Expected version 1 got 0
I20260923 19:50:17.549854 6461 ts_tablet_manager.cc:1929] T c031d99a6f9844c29664236662e8d5f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:17.552139 6461 log.cc:1199] T c031d99a6f9844c29664236662e8d5f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/c031d99a6f9844c29664236662e8d5f8
I20260923 19:50:17.562230 6457 tablet_bootstrap.cc:492] T 658253ff3d014361803e1aeda978e59a P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:17.562664 6457 ts_tablet_manager.cc:1403] T 658253ff3d014361803e1aeda978e59a P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.106s user 0.002s sys 0.018s
I20260923 19:50:17.563436 6457 raft_consensus.cc:359] T 658253ff3d014361803e1aeda978e59a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.563689 6457 raft_consensus.cc:385] T 658253ff3d014361803e1aeda978e59a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:17.563784 6457 raft_consensus.cc:740] T 658253ff3d014361803e1aeda978e59a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:17.564036 6457 consensus_queue.cc:260] T 658253ff3d014361803e1aeda978e59a P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.564560 7507 raft_consensus.cc:493] T efc63a151f6444dfb03c3f15f6f54473 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:17.564733 7507 raft_consensus.cc:515] T efc63a151f6444dfb03c3f15f6f54473 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.565512 7507 leader_election.cc:290] T efc63a151f6444dfb03c3f15f6f54473 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:17.567183 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc63a151f6444dfb03c3f15f6f54473" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:17.567330 6454 tablet_bootstrap.cc:654] T edb52bd88b424129bbdc45de89b56efb P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:17.567390 6341 raft_consensus.cc:2468] T efc63a151f6444dfb03c3f15f6f54473 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:17.567859 6139 leader_election.cc:304] T efc63a151f6444dfb03c3f15f6f54473 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:17.568264 6457 ts_tablet_manager.cc:1434] T 658253ff3d014361803e1aeda978e59a P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260923 19:50:17.568576 6457 tablet_bootstrap.cc:492] T d35ff653bf8d41cfbcf83359402a8f6a P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:17.570452 7507 raft_consensus.cc:2804] T efc63a151f6444dfb03c3f15f6f54473 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:17.570542 7507 raft_consensus.cc:493] T efc63a151f6444dfb03c3f15f6f54473 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:17.570601 7507 raft_consensus.cc:3060] T efc63a151f6444dfb03c3f15f6f54473 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
W20260923 19:50:17.571484 6137 leader_election.cc:343] T efc63a151f6444dfb03c3f15f6f54473 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: efc63a151f6444dfb03c3f15f6f54473
I20260923 19:50:17.571934 6458 ts_tablet_manager.cc:1929] T b92aaac328934d95a89e0fc08a80b0b1 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:17.571593 6457 tablet_bootstrap.cc:654] T d35ff653bf8d41cfbcf83359402a8f6a P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:17.579866 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet d5d3f96ebf1c4d05aceb06ef53737e4f
I20260923 19:50:17.581233 5796 catalog_manager.cc:6934] ReplaceTablet: tablet d5d3f96ebf1c4d05aceb06ef53737e4f deleted and replaced by tablet 7595c09be8784a948027dd923c4b023e
I20260923 19:50:17.581249 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet d5d3f96ebf1c4d05aceb06ef53737e4f with delete_type TABLET_DATA_DELETED (replaced by tablet 7595c09be8784a948027dd923c4b023e) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:17.582290 7566 raft_consensus.cc:493] T 34d62ab3d4aa457f8fea283cd9248a41 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:17.582461 7566 raft_consensus.cc:515] T 34d62ab3d4aa457f8fea283cd9248a41 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.582481 5800 catalog_manager.cc:5838] T 2ce6378a6bd844a485aebb96081307e3 P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:17.582917 5800 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 2ce6378a6bd844a485aebb96081307e3 (table default.Table_4d1a0d71d11f4c0a8c80b3ba7ea0c358 [id=ef9a6c259ceb4c189c8902a776fb3bfa]). Expected version 1 got 0
I20260923 19:50:17.583113 7566 leader_election.cc:290] T 34d62ab3d4aa457f8fea283cd9248a41 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:17.583256 5800 catalog_manager.cc:5838] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:17.583602 5800 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet f74e7cb3e5f54dfdb2280c795ce2ce53 (table default.Table_64791d9d1cef4cfe9d420e405abe816e [id=8325a8f159124a2da260e2be3ce69500]). Expected version 2 got 0
I20260923 19:50:17.584044 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet e4375ff709a74bc6b8ef2073fb2c1d18
W20260923 19:50:17.584731 5797 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f74e7cb3e5f54dfdb2280c795ce2ce53 consensus state has no leader
I20260923 19:50:17.586217 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet e55ab069a0fa48398b39bbb9e7c65cd1
I20260923 19:50:17.586359 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet e4375ff709a74bc6b8ef2073fb2c1d18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:17 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:17.587006 6459 ts_tablet_manager.cc:1929] T f5cb8dd5dcf54df9989dd808fe148ce6 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:17.587134 6459 log.cc:1199] T f5cb8dd5dcf54df9989dd808fe148ce6 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/f5cb8dd5dcf54df9989dd808fe148ce6
I20260923 19:50:17.587440 6459 ts_tablet_manager.cc:1950] T f5cb8dd5dcf54df9989dd808fe148ce6 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:17.587422 5799 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 5ad33cd4913941c6aa2fea717608ef7c
I20260923 19:50:17.588794 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet d5d3f96ebf1c4d05aceb06ef53737e4f with delete_type TABLET_DATA_DELETED (replaced by tablet 7595c09be8784a948027dd923c4b023e) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:17.589524 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet e4375ff709a74bc6b8ef2073fb2c1d18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:17 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:17.590291 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet e55ab069a0fa48398b39bbb9e7c65cd1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:17 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:17.590832 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ad33cd4913941c6aa2fea717608ef7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:17 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:17.591279 5801 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet ec5793bdec5244aa8cf13b7fb3b84b8a
I20260923 19:50:17.592532 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet ec5793bdec5244aa8cf13b7fb3b84b8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:17 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:17.593039 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d62ab3d4aa457f8fea283cd9248a41" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:17.593708 5995 leader_election.cc:343] T 34d62ab3d4aa457f8fea283cd9248a41 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:17.594900 5803 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 35f46a1be80c4194b592c5d00fe1f342 (table default.Table_f6755f452e8d41c4b9d64c3ee2735188 [id=d6a2d0fc236a4056b224d01249f045b0]). Expected version 1 got 0
I20260923 19:50:17.595221 5803 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 2ce6378a6bd844a485aebb96081307e3 (table default.Table_4d1a0d71d11f4c0a8c80b3ba7ea0c358 [id=ef9a6c259ceb4c189c8902a776fb3bfa]). Expected version 1 got 0
I20260923 19:50:17.601477 7505 raft_consensus.cc:493] T 7b1601590508479c8f401cd09d9f4c3b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:17.601658 7505 raft_consensus.cc:515] T 7b1601590508479c8f401cd09d9f4c3b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.602360 7505 leader_election.cc:290] T 7b1601590508479c8f401cd09d9f4c3b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:17.603118 6137 leader_election.cc:343] T 7b1601590508479c8f401cd09d9f4c3b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 7b1601590508479c8f401cd09d9f4c3b
W20260923 19:50:17.604326 6139 leader_election.cc:343] T 7b1601590508479c8f401cd09d9f4c3b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 7b1601590508479c8f401cd09d9f4c3b
I20260923 19:50:17.604451 6139 leader_election.cc:304] T 7b1601590508479c8f401cd09d9f4c3b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:17.604756 7505 raft_consensus.cc:2749] T 7b1601590508479c8f401cd09d9f4c3b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:17.607897 6461 ts_tablet_manager.cc:1950] T c031d99a6f9844c29664236662e8d5f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:17.610968 6457 tablet_bootstrap.cc:492] T d35ff653bf8d41cfbcf83359402a8f6a P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:17.611121 5800 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 35f46a1be80c4194b592c5d00fe1f342 (table default.Table_f6755f452e8d41c4b9d64c3ee2735188 [id=d6a2d0fc236a4056b224d01249f045b0]). Expected version 1 got 0
I20260923 19:50:17.611205 6457 ts_tablet_manager.cc:1403] T d35ff653bf8d41cfbcf83359402a8f6a P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.043s user 0.003s sys 0.007s
I20260923 19:50:17.612076 6457 raft_consensus.cc:359] T d35ff653bf8d41cfbcf83359402a8f6a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.612319 6457 raft_consensus.cc:385] T d35ff653bf8d41cfbcf83359402a8f6a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:17.612447 6457 raft_consensus.cc:740] T d35ff653bf8d41cfbcf83359402a8f6a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:17.612715 6457 consensus_queue.cc:260] T d35ff653bf8d41cfbcf83359402a8f6a P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.614691 6457 ts_tablet_manager.cc:1434] T d35ff653bf8d41cfbcf83359402a8f6a P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:50:17.612883 6461 tablet_replica.cc:333] T fc151f4d78344efeada6d6e57af6eb9f P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:17.611485 5800 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 2ce6378a6bd844a485aebb96081307e3 (table default.Table_4d1a0d71d11f4c0a8c80b3ba7ea0c358 [id=ef9a6c259ceb4c189c8902a776fb3bfa]). Expected version 1 got 0
I20260923 19:50:17.619441 5803 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 2ce6378a6bd844a485aebb96081307e3 (table default.Table_4d1a0d71d11f4c0a8c80b3ba7ea0c358 [id=ef9a6c259ceb4c189c8902a776fb3bfa]). Expected version 1 got 0
I20260923 19:50:17.620914 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet c031d99a6f9844c29664236662e8d5f8 (table default.Table_2c882fb60c3a4a5685508054fe5fa20d [id=4f2f07c1e27c431299438af5105e9f2e]) successfully deleted
I20260923 19:50:17.621412 6027 tablet_service.cc:1558] Processing DeleteTablet for tablet 658253ff3d014361803e1aeda978e59a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:17.623234 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 528fca12bfe04747830ad1d3bb323676 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:17.630147 7566 raft_consensus.cc:493] T 98f61ace3a984938ace1fedbaa1dafa3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:17.630324 7566 raft_consensus.cc:515] T 98f61ace3a984938ace1fedbaa1dafa3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.631088 7566 leader_election.cc:290] T 98f61ace3a984938ace1fedbaa1dafa3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:17.632817 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f61ace3a984938ace1fedbaa1dafa3" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:17.633407 5995 leader_election.cc:343] T 98f61ace3a984938ace1fedbaa1dafa3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:17.634837 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 752) took 1831 ms. Trace:
I20260923 19:50:17.634929 6459 rpcz_store.cc:276] 0923 19:50:15.802927 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.802983 (+ 56us) service_pool.cc:224] Handling call
0923 19:50:17.440046 (+1637063us) ts_tablet_manager.cc:1151] Deleting tablet f5cb8dd5dcf54df9989dd808fe148ce6
0923 19:50:17.440058 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.562756 (+122698us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:17.586947 (+ 24191us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:17.634819 (+ 47872us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1630017}
I20260923 19:50:17.635231 6459 tablet_replica.cc:333] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:17.635403 6459 raft_consensus.cc:2243] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:17.635568 6459 raft_consensus.cc:2272] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:17.636171 6459 ts_tablet_manager.cc:1916] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:17.639971 6457 tablet_bootstrap.cc:492] T f1f1df47dc32413d9cc9456f4198dca5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:17.643335 6461 raft_consensus.cc:2243] T fc151f4d78344efeada6d6e57af6eb9f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:17.645059 6461 raft_consensus.cc:2272] T fc151f4d78344efeada6d6e57af6eb9f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:17.645792 6461 ts_tablet_manager.cc:1916] T fc151f4d78344efeada6d6e57af6eb9f P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:17.646818 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 7f5f02661ce34714a18045945f3fc25d (DEFAULT_TABLE table=default.Table_9c1645ee01fb4c5eaa536d8115780393 [id=0268697d0199470ebff8225a06903f69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:17.644845 6457 tablet_bootstrap.cc:654] T f1f1df47dc32413d9cc9456f4198dca5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:17.647208 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f5f02661ce34714a18045945f3fc25d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:17.647491 6027 tablet_service.cc:1511] Processing CreateTablet for tablet f4ef5a1c66d7416f8d0099b501a9ba96 (DEFAULT_TABLE table=default.Table_41da098c27d44ad3b986089b10f8b6ea [id=42fd29978b7c43fda262b779d8512ba9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:17.647801 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4ef5a1c66d7416f8d0099b501a9ba96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:17.650144 6034 tablet_service.cc:1511] Processing CreateTablet for tablet b18ddbbf3ce84927bc330b8affc37bb8 (DEFAULT_TABLE table=default.Table_acafa9eab1a2413fb05d955b844452ea [id=f04b384fbad343e5bee580b78bd717c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:17.651961 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b18ddbbf3ce84927bc330b8affc37bb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:17.652508 7507 raft_consensus.cc:515] T efc63a151f6444dfb03c3f15f6f54473 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.653532 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet e55ab069a0fa48398b39bbb9e7c65cd1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:17 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:17.653841 7507 leader_election.cc:290] T efc63a151f6444dfb03c3f15f6f54473 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:17.657701 6459 ts_tablet_manager.cc:1929] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:17.657807 6459 log.cc:1199] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/908596339b2e4f7f8ddb7f9cd5bdcc3e
I20260923 19:50:17.658128 6459 ts_tablet_manager.cc:1950] T 908596339b2e4f7f8ddb7f9cd5bdcc3e P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:17.658409 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 760) took 1773 ms. Trace:
I20260923 19:50:17.658483 6459 rpcz_store.cc:276] 0923 19:50:15.884529 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.884583 (+ 54us) service_pool.cc:224] Handling call
0923 19:50:17.635187 (+1750604us) ts_tablet_manager.cc:1151] Deleting tablet 908596339b2e4f7f8ddb7f9cd5bdcc3e
0923 19:50:17.635196 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.654617 (+ 19421us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:17.657646 (+ 3029us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:17.658395 (+ 749us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1750447}
I20260923 19:50:17.658901 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 761) took 1731 ms. Trace:
I20260923 19:50:17.658977 6459 rpcz_store.cc:276] 0923 19:50:15.927483 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.927538 (+ 55us) service_pool.cc:224] Handling call
0923 19:50:17.658778 (+1731240us) ts_tablet_manager.cc:1151] Deleting tablet f9687b3f4b904e438d83533fb67cc92f
0923 19:50:17.658788 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.658885 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1730971}
I20260923 19:50:17.659216 6459 tablet_replica.cc:333] T 7e41501bf01e4765853c27e4cac21e2b P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
W20260923 19:50:17.659515 6137 leader_election.cc:343] T efc63a151f6444dfb03c3f15f6f54473 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: efc63a151f6444dfb03c3f15f6f54473
I20260923 19:50:17.659699 6459 raft_consensus.cc:2243] T 7e41501bf01e4765853c27e4cac21e2b P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:17.647197 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 9b0a7c1feae24d65bb18609847449f4b (DEFAULT_TABLE table=default.Table_fff6175767d74b3785fa69b365c1e4b3 [id=c6be6f5e59194f288435a9ac1fe0afad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:17.660218 6459 pending_rounds.cc:70] T 7e41501bf01e4765853c27e4cac21e2b P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:17.660267 6459 pending_rounds.cc:77] T 7e41501bf01e4765853c27e4cac21e2b P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630597702000640 op_type: NO_OP noop_request { }
I20260923 19:50:17.660349 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b0a7c1feae24d65bb18609847449f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:17.660346 6459 raft_consensus.cc:2889] T 7e41501bf01e4765853c27e4cac21e2b P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:17.660419 6459 raft_consensus.cc:2272] T 7e41501bf01e4765853c27e4cac21e2b P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:17.662174 6458 log.cc:1199] T b92aaac328934d95a89e0fc08a80b0b1 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/b92aaac328934d95a89e0fc08a80b0b1
I20260923 19:50:17.662508 6458 ts_tablet_manager.cc:1950] T b92aaac328934d95a89e0fc08a80b0b1 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:17.585309 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d62ab3d4aa457f8fea283cd9248a41" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:17.585814 6321 tablet_service.cc:1558] Processing DeleteTablet for tablet e4375ff709a74bc6b8ef2073fb2c1d18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:17 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:17.585978 6316 tablet_service.cc:1558] Processing DeleteTablet for tablet d5d3f96ebf1c4d05aceb06ef53737e4f with delete_type TABLET_DATA_DELETED (replaced by tablet 7595c09be8784a948027dd923c4b023e) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:17.587098 6308 tablet_service.cc:1558] Processing DeleteTablet for tablet e55ab069a0fa48398b39bbb9e7c65cd1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:17 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:17.664633 5996 leader_election.cc:343] T 34d62ab3d4aa457f8fea283cd9248a41 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:17.664784 5996 leader_election.cc:304] T 34d62ab3d4aa457f8fea283cd9248a41 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:17.665293 7566 raft_consensus.cc:2749] T 34d62ab3d4aa457f8fea283cd9248a41 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:17.665705 6459 ts_tablet_manager.cc:1916] T 7e41501bf01e4765853c27e4cac21e2b P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:17.665673 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7fd5aef2a3c648f8bb0354e14380c716" } new_table_name: "default.Table_363237ea560c44c2937c3aa08e9799cb" modify_external_catalogs: true
I20260923 19:50:17.588384 6315 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ad33cd4913941c6aa2fea717608ef7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:17 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:17.592487 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet ec5793bdec5244aa8cf13b7fb3b84b8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:17 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:17.666148 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_f5155af0d4e041c282bb316389c2275f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:17.666750 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f5155af0d4e041c282bb316389c2275f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:17.667976 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_5933ddc6cf2343c2a39ead3bd433f063"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:17.668450 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5933ddc6cf2343c2a39ead3bd433f063 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:17.669515 5797 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_999f599f560c49e3a8da9037c4554baa" } new_table_name: "default.Table_e75f15fb5fbd4114ac504d553b66f20a" modify_external_catalogs: true
I20260923 19:50:17.603315 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet b7ba284e81bc4388bbd6456a41d1f9f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:17.670758 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_8e43f2a7e2aa40e8afe8272232c65a8e" } new_table_name: "default.Table_605d43f9448e4b4bb429f8bf52d6ac55" modify_external_catalogs: true
I20260923 19:50:17.603734 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet a75c4436a67f453e973a7a7645de79b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:17.604039 6322 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e711e48156b46b5a517b330d6d41309 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:17.612751 7490 consensus_queue.cc:1048] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:17.631810 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f61ace3a984938ace1fedbaa1dafa3" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:17.632086 6313 tablet_service.cc:1558] Processing DeleteTablet for tablet edb52bd88b424129bbdc45de89b56efb with delete_type TABLET_DATA_DELETED (replaced by tablet 1f6df2c7b8c34ff2a358acdc58543991) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:17.632542 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet d6d3601a392f4723b4ca00f6e12b950c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:17.675467 5996 leader_election.cc:343] T 98f61ace3a984938ace1fedbaa1dafa3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:17.675621 5996 leader_election.cc:304] T 98f61ace3a984938ace1fedbaa1dafa3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:17.675901 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 714) took 2433 ms. Trace:
I20260923 19:50:17.676059 7566 raft_consensus.cc:2749] T 98f61ace3a984938ace1fedbaa1dafa3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:17.675983 6458 rpcz_store.cc:276] 0923 19:50:15.242838 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.243233 (+ 395us) service_pool.cc:224] Handling call
0923 19:50:17.507348 (+2264115us) ts_tablet_manager.cc:1151] Deleting tablet b92aaac328934d95a89e0fc08a80b0b1
0923 19:50:17.507362 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.513376 (+ 6014us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:17.571870 (+ 58494us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:17.675878 (+104008us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":373,"tablet-delete.queue_time_us":2137837}
I20260923 19:50:17.676465 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet b92aaac328934d95a89e0fc08a80b0b1 (table default.Table_9bd23e83d2144f82a8487f44b70458fc [id=93b330743f8d47f2b3e06f43ec3658b2]) successfully deleted
I20260923 19:50:17.681123 5798 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_63a6947f3c8f4223b9f33e260bc77331" } modify_external_catalogs: true
I20260923 19:50:17.681341 5798 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_63a6947f3c8f4223b9f33e260bc77331" } modify_external_catalogs: true
I20260923 19:50:17.684243 6323 tablet_service.cc:1511] Processing CreateTablet for tablet b18ddbbf3ce84927bc330b8affc37bb8 (DEFAULT_TABLE table=default.Table_acafa9eab1a2413fb05d955b844452ea [id=f04b384fbad343e5bee580b78bd717c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:17.684677 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b18ddbbf3ce84927bc330b8affc37bb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:17.685370 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet f5cb8dd5dcf54df9989dd808fe148ce6 (table default.Table_c49fa1ccdba34f098164e9732f9a750a [id=1b9a067155ad446db4ead7a1ece15427]) successfully deleted
I20260923 19:50:17.685459 6459 ts_tablet_manager.cc:1929] T 7e41501bf01e4765853c27e4cac21e2b P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:17.685570 6459 log.cc:1199] T 7e41501bf01e4765853c27e4cac21e2b P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/7e41501bf01e4765853c27e4cac21e2b
I20260923 19:50:17.685662 7490 raft_consensus.cc:493] T b7ba284e81bc4388bbd6456a41d1f9f4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:17.685775 7490 raft_consensus.cc:515] T b7ba284e81bc4388bbd6456a41d1f9f4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.685935 6459 ts_tablet_manager.cc:1950] T 7e41501bf01e4765853c27e4cac21e2b P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:17.686265 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 782) took 1425 ms. Trace:
I20260923 19:50:17.686335 6459 rpcz_store.cc:276] 0923 19:50:16.260514 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:16.266349 (+ 5835us) service_pool.cc:224] Handling call
0923 19:50:17.659173 (+1392824us) ts_tablet_manager.cc:1151] Deleting tablet 7e41501bf01e4765853c27e4cac21e2b
0923 19:50:17.659183 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.678863 (+ 19680us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:17.685399 (+ 6536us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:17.686248 (+ 849us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1316320}
I20260923 19:50:17.686462 7490 leader_election.cc:290] T b7ba284e81bc4388bbd6456a41d1f9f4 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:17.686733 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 791) took 1106 ms. Trace:
I20260923 19:50:17.643386 6456 tablet_bootstrap.cc:492] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:17.686798 6459 rpcz_store.cc:276] 0923 19:50:16.580568 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:16.580661 (+ 93us) service_pool.cc:224] Handling call
0923 19:50:17.686614 (+1105953us) ts_tablet_manager.cc:1151] Deleting tablet 62c0cf7f070e467dafaed442b6b8c15d
0923 19:50:17.686624 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.686718 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1105668}
I20260923 19:50:17.686939 6456 ts_tablet_manager.cc:1403] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.185s user 0.004s sys 0.005s
I20260923 19:50:17.687124 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 792) took 1106 ms. Trace:
I20260923 19:50:17.687189 6459 rpcz_store.cc:276] 0923 19:50:16.580834 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:16.580904 (+ 70us) service_pool.cc:224] Handling call
0923 19:50:17.687014 (+1106110us) ts_tablet_manager.cc:1151] Deleting tablet 382daee3555642b7a767a35c2f49b98a
0923 19:50:17.687023 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.687109 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1105885}
I20260923 19:50:17.687474 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 793) took 1106 ms. Trace:
I20260923 19:50:17.687546 6459 rpcz_store.cc:276] 0923 19:50:16.588823 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:16.588910 (+ 87us) service_pool.cc:224] Handling call
0923 19:50:17.687381 (+1098471us) ts_tablet_manager.cc:1151] Deleting tablet f4313a4d8a9c411fad593b05ad655fc4
0923 19:50:17.687389 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.687459 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1097990}
I20260923 19:50:17.687872 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 794) took 1097 ms. Trace:
I20260923 19:50:17.687933 6459 rpcz_store.cc:276] 0923 19:50:16.591027 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:16.591373 (+ 346us) service_pool.cc:224] Handling call
0923 19:50:17.687776 (+1096403us) ts_tablet_manager.cc:1151] Deleting tablet cffe24ab4df745e3a34f82e8ca7b39f5
0923 19:50:17.687785 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.687858 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1096035}
I20260923 19:50:17.688222 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 795) took 1095 ms. Trace:
I20260923 19:50:17.688282 6459 rpcz_store.cc:276] 0923 19:50:16.592884 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:16.592959 (+ 75us) service_pool.cc:224] Handling call
0923 19:50:17.688133 (+1095174us) ts_tablet_manager.cc:1151] Deleting tablet 401d909c37ec4daaa210e4fc32d838aa
0923 19:50:17.688142 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.688209 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1094828}
I20260923 19:50:17.688535 6459 tablet_replica.cc:333] T 7b1601590508479c8f401cd09d9f4c3b P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:17.688715 6459 raft_consensus.cc:2243] T 7b1601590508479c8f401cd09d9f4c3b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:17.689116 7566 raft_consensus.cc:493] T d35ff653bf8d41cfbcf83359402a8f6a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:17.689255 7566 raft_consensus.cc:515] T d35ff653bf8d41cfbcf83359402a8f6a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.689939 7566 leader_election.cc:290] T d35ff653bf8d41cfbcf83359402a8f6a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:17.644270 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 7f5f02661ce34714a18045945f3fc25d (DEFAULT_TABLE table=default.Table_9c1645ee01fb4c5eaa536d8115780393 [id=0268697d0199470ebff8225a06903f69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:17.691331 6461 ts_tablet_manager.cc:1929] T fc151f4d78344efeada6d6e57af6eb9f P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:17.691426 6461 log.cc:1199] T fc151f4d78344efeada6d6e57af6eb9f P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/fc151f4d78344efeada6d6e57af6eb9f
I20260923 19:50:17.691591 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f5f02661ce34714a18045945f3fc25d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:17.691704 6461 ts_tablet_manager.cc:1950] T fc151f4d78344efeada6d6e57af6eb9f P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:17.644940 6306 tablet_service.cc:1511] Processing CreateTablet for tablet f4ef5a1c66d7416f8d0099b501a9ba96 (DEFAULT_TABLE table=default.Table_41da098c27d44ad3b986089b10f8b6ea [id=42fd29978b7c43fda262b779d8512ba9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:17.694164 6306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4ef5a1c66d7416f8d0099b501a9ba96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:17.695067 6461 tablet_replica.cc:333] T 1b1d9413e1e24547b491a160d851377b P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:17.695904 6461 raft_consensus.cc:2243] T 1b1d9413e1e24547b491a160d851377b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:17.696381 6461 raft_consensus.cc:2272] T 1b1d9413e1e24547b491a160d851377b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:17.697237 6461 ts_tablet_manager.cc:1916] T 1b1d9413e1e24547b491a160d851377b P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:17.697379 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 719) took 2291 ms. Trace:
I20260923 19:50:17.697521 6458 rpcz_store.cc:276] 0923 19:50:15.405583 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.405640 (+ 57us) service_pool.cc:224] Handling call
0923 19:50:17.697259 (+2291619us) ts_tablet_manager.cc:1151] Deleting tablet 2d6762b369d3496083947a4a47a51868
0923 19:50:17.697268 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.697360 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2291404}
I20260923 19:50:17.700842 6459 raft_consensus.cc:2272] T 7b1601590508479c8f401cd09d9f4c3b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:17.701498 5797 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2fa50f80b71b4946a1b394196217b774 consensus state has no leader
W20260923 19:50:17.702096 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 18b4ed7ef6dc468096b92a1ffa64c7d9 consensus state has no leader
I20260923 19:50:17.702216 6459 ts_tablet_manager.cc:1916] T 7b1601590508479c8f401cd09d9f4c3b P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:17.702334 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 4a034eb9b02d4532b4b68e74c8e5b3fa
I20260923 19:50:17.659888 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc63a151f6444dfb03c3f15f6f54473" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:17.645750 6307 tablet_service.cc:1511] Processing CreateTablet for tablet 9b0a7c1feae24d65bb18609847449f4b (DEFAULT_TABLE table=default.Table_fff6175767d74b3785fa69b365c1e4b3 [id=c6be6f5e59194f288435a9ac1fe0afad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:17.703711 6342 raft_consensus.cc:3060] T efc63a151f6444dfb03c3f15f6f54473 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:17.703989 6307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b0a7c1feae24d65bb18609847449f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:17.706771 6342 raft_consensus.cc:2468] T efc63a151f6444dfb03c3f15f6f54473 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:17.707273 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_095a7797fab845eeb9d72bad1309e2f4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:17.707654 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_1ddcefc310ff4feca41bc3475393eac1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:17.707906 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_095a7797fab845eeb9d72bad1309e2f4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:17.708034 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ddcefc310ff4feca41bc3475393eac1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:17.709448 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 2d6762b369d3496083947a4a47a51868 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d6762b369d3496083947a4a47a51868 already in progress: creating tablet
I20260923 19:50:17.709404 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_57f19c72a7cd4e4d8288370ebcb5c9db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:17.709959 6458 tablet_replica.cc:333] T 22e37d5afa8047989928596b4092c4b9 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
W20260923 19:50:17.709960 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_57f19c72a7cd4e4d8288370ebcb5c9db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:17.711126 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_495d1f81e9a94fa4b7a63f4df12aa190"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:17.711632 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_495d1f81e9a94fa4b7a63f4df12aa190 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:17.701314 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d35ff653bf8d41cfbcf83359402a8f6a" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:17.712843 6458 raft_consensus.cc:2243] T 22e37d5afa8047989928596b4092c4b9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:17.713554 6458 raft_consensus.cc:2272] T 22e37d5afa8047989928596b4092c4b9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:17.714709 6458 ts_tablet_manager.cc:1916] T 22e37d5afa8047989928596b4092c4b9 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:17.703516 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet 4a034eb9b02d4532b4b68e74c8e5b3fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:17 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:17.712468 6313 tablet_service.cc:1511] Processing CreateTablet for tablet 33a318872f6a4f838ed9f0c0260d4bfb (DEFAULT_TABLE table=default.Table_cac7a266c93b4f28a3ceff8c08002256 [id=0b1e78f742b84c4fb236e68337f94d87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:17.716248 6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33a318872f6a4f838ed9f0c0260d4bfb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:17.717427 5996 leader_election.cc:343] T d35ff653bf8d41cfbcf83359402a8f6a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:17.702649 7490 raft_consensus.cc:493] T ed9fb0cab0bd43b7a05d7376125b187e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:17.717994 7490 raft_consensus.cc:515] T ed9fb0cab0bd43b7a05d7376125b187e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.718571 7490 leader_election.cc:290] T ed9fb0cab0bd43b7a05d7376125b187e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:17.720305 6028 tablet_service.cc:1511] Processing CreateTablet for tablet d689f30677c04fb880778d6723b1f5ac (DEFAULT_TABLE table=default.Table_9f22e0d8c3e240478c41d7eb8e843594 [id=7e67134de07f49ac88dce0a606c6f2de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:17.720737 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d689f30677c04fb880778d6723b1f5ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:17.715763 6322 tablet_service.cc:1511] Processing CreateTablet for tablet d689f30677c04fb880778d6723b1f5ac (DEFAULT_TABLE table=default.Table_9f22e0d8c3e240478c41d7eb8e843594 [id=7e67134de07f49ac88dce0a606c6f2de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:17.722851 6322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d689f30677c04fb880778d6723b1f5ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:17.722746 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fb0cab0bd43b7a05d7376125b187e" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:17.723382 6059 raft_consensus.cc:2468] T ed9fb0cab0bd43b7a05d7376125b187e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:17.727777 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet fc151f4d78344efeada6d6e57af6eb9f (table default.Table_412c7972d6ad4c9c9e44ad5763e7a6c7 [id=22bf03cd65ab4346af756b244875c007]) successfully deleted
W20260923 19:50:17.728211 6279 leader_election.cc:343] T b7ba284e81bc4388bbd6456a41d1f9f4 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: b7ba284e81bc4388bbd6456a41d1f9f4
I20260923 19:50:17.728662 6279 leader_election.cc:304] T ed9fb0cab0bd43b7a05d7376125b187e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:17.728938 7490 raft_consensus.cc:2804] T ed9fb0cab0bd43b7a05d7376125b187e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:17.729012 7490 raft_consensus.cc:493] T ed9fb0cab0bd43b7a05d7376125b187e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:17.729084 7490 raft_consensus.cc:3060] T ed9fb0cab0bd43b7a05d7376125b187e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:17.732242 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d059170653dd4938887467bd38374ffc" } new_table_name: "default.Table_03b07fc0700f4beaa669406e95bdba50" modify_external_catalogs: true
I20260923 19:50:17.732313 6459 ts_tablet_manager.cc:1929] T 7b1601590508479c8f401cd09d9f4c3b P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:17.732465 6459 log.cc:1199] T 7b1601590508479c8f401cd09d9f4c3b P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/7b1601590508479c8f401cd09d9f4c3b
I20260923 19:50:17.733454 6461 ts_tablet_manager.cc:1929] T 1b1d9413e1e24547b491a160d851377b P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:17.734226 6461 log.cc:1199] T 1b1d9413e1e24547b491a160d851377b P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/1b1d9413e1e24547b491a160d851377b
I20260923 19:50:17.737311 6461 ts_tablet_manager.cc:1950] T 1b1d9413e1e24547b491a160d851377b P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:17.738914 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 1b1d9413e1e24547b491a160d851377b (table default.Table_f1842456992c4765924d809a3a062c07 [id=361a67b795ad41bb829dffbf0cc7dcc5]) successfully deleted
I20260923 19:50:17.740249 6459 ts_tablet_manager.cc:1950] T 7b1601590508479c8f401cd09d9f4c3b P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:17.741751 6461 tablet_replica.cc:333] T 658253ff3d014361803e1aeda978e59a P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:17.742588 5799 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet f74e7cb3e5f54dfdb2280c795ce2ce53 (table default.Table_fb92f0dc809c49018d4300eaf32b6a8b [id=8325a8f159124a2da260e2be3ce69500]). Expected version 3 got 0
I20260923 19:50:17.742825 6459 tablet_replica.cc:333] T 465371cfbe544ba98e6eea05033ecf05 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:17.743045 6459 raft_consensus.cc:2243] T 465371cfbe544ba98e6eea05033ecf05 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:17.743219 6459 raft_consensus.cc:2272] T 465371cfbe544ba98e6eea05033ecf05 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:17.700104 6456 raft_consensus.cc:359] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.744529 6456 raft_consensus.cc:385] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:17.744621 6456 raft_consensus.cc:740] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:17.744613 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_b57c902238674ae8bafb70e9cb0f65aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:17.744887 6456 consensus_queue.cc:260] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:17.745229 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b57c902238674ae8bafb70e9cb0f65aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:17.745623 6456 ts_tablet_manager.cc:1434] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.059s user 0.001s sys 0.001s
I20260923 19:50:17.745934 6461 raft_consensus.cc:2243] T 658253ff3d014361803e1aeda978e59a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:17.747395 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_a7ebf250a610449d84315e63c3d58522"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:17.747917 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a7ebf250a610449d84315e63c3d58522 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:17.749059 6456 tablet_bootstrap.cc:492] T ad29d22a82434023991ffcacf7f9bee5 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:17.750646 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_3974c6faa5a94a44a6c15aae07db7da2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:17.751526 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet d1258abcb244430ca8456ad146aa0e67 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1258abcb244430ca8456ad146aa0e67 already in progress: creating tablet
W20260923 19:50:17.751753 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3974c6faa5a94a44a6c15aae07db7da2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:17.751816 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet d5d3f96ebf1c4d05aceb06ef53737e4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d5d3f96ebf1c4d05aceb06ef53737e4f already in progress: creating tablet
W20260923 19:50:17.752012 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet e4375ff709a74bc6b8ef2073fb2c1d18 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4375ff709a74bc6b8ef2073fb2c1d18 already in progress: creating tablet
W20260923 19:50:17.752256 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet e55ab069a0fa48398b39bbb9e7c65cd1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e55ab069a0fa48398b39bbb9e7c65cd1 already in progress: creating tablet
W20260923 19:50:17.752488 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 5ad33cd4913941c6aa2fea717608ef7c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ad33cd4913941c6aa2fea717608ef7c already in progress: creating tablet
W20260923 19:50:17.752768 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet ec5793bdec5244aa8cf13b7fb3b84b8a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ec5793bdec5244aa8cf13b7fb3b84b8a already in progress: creating tablet
I20260923 19:50:17.755189 6323 tablet_service.cc:1511] Processing CreateTablet for tablet ce42c5de0cd3435b85fcfca92d69cdd5 (DEFAULT_TABLE table=default.Table_602f24694ce04fa887e6cb0112b325f3 [id=746aa0153e7f43ccbea58171d58e5e34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:17.755708 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce42c5de0cd3435b85fcfca92d69cdd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:17.760717 6028 tablet_service.cc:1511] Processing CreateTablet for tablet ce42c5de0cd3435b85fcfca92d69cdd5 (DEFAULT_TABLE table=default.Table_602f24694ce04fa887e6cb0112b325f3 [id=746aa0153e7f43ccbea58171d58e5e34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:17.767406 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce42c5de0cd3435b85fcfca92d69cdd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:17.767866 5798 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet f74e7cb3e5f54dfdb2280c795ce2ce53 (table default.Table_fb92f0dc809c49018d4300eaf32b6a8b [id=8325a8f159124a2da260e2be3ce69500]). Expected version 3 got 0
I20260923 19:50:17.770134 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_c9caa816995b4d02b2b42ef1f29e41e1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:17.770897 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c9caa816995b4d02b2b42ef1f29e41e1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:17.774928 5803 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9968ab539c9149e98aa5326c208ce140 consensus state has no leader
I20260923 19:50:17.775143 6313 tablet_service.cc:1558] Processing DeleteTablet for tablet c012b2a92dc14f2ab5d9f4fe8a6a7779 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:17.775841 6461 raft_consensus.cc:2272] T 658253ff3d014361803e1aeda978e59a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:17.775724 7490 raft_consensus.cc:515] T ed9fb0cab0bd43b7a05d7376125b187e P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:17.777776 5800 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 146a402ff29a4e0b834a9f270d61e21c consensus state has no leader
I20260923 19:50:17.776481 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet 4a034eb9b02d4532b4b68e74c8e5b3fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:17 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:17.776837 6027 tablet_service.cc:1511] Processing CreateTablet for tablet 33a318872f6a4f838ed9f0c0260d4bfb (DEFAULT_TABLE table=default.Table_cac7a266c93b4f28a3ceff8c08002256 [id=0b1e78f742b84c4fb236e68337f94d87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:17.779211 6459 ts_tablet_manager.cc:1916] T 465371cfbe544ba98e6eea05033ecf05 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:17.779599 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33a318872f6a4f838ed9f0c0260d4bfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:17.780308 6461 ts_tablet_manager.cc:1916] T 658253ff3d014361803e1aeda978e59a P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:17.777034 6106 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
I20260923 19:50:17.791783 5802 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ea5c2db0da154c51a706c771a367ab98" } new_table_name: "default.Table_7d891deab94f4132b4358c6e4dfd54af" modify_external_catalogs: true
I20260923 19:50:17.792610 7566 raft_consensus.cc:493] T e6e04d16675443fc923a5f8216e292b6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:17.792783 7566 raft_consensus.cc:515] T e6e04d16675443fc923a5f8216e292b6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.793517 7566 leader_election.cc:290] T e6e04d16675443fc923a5f8216e292b6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:17.793619 5797 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_59a69335b281437498cea78a9cb3fadb" } modify_external_catalogs: true
I20260923 19:50:17.794121 6313 tablet_service.cc:1511] Processing CreateTablet for tablet 9968ab539c9149e98aa5326c208ce140 (DEFAULT_TABLE table=default.Table_03b07fc0700f4beaa669406e95bdba50 [id=7be6ba11bd6f4349af355570506e3a89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:17.794521 6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9968ab539c9149e98aa5326c208ce140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:17.794628 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e04d16675443fc923a5f8216e292b6" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:17.797135 5996 leader_election.cc:343] T e6e04d16675443fc923a5f8216e292b6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:17.793798 5797 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_59a69335b281437498cea78a9cb3fadb" } modify_external_catalogs: true
I20260923 19:50:17.806313 7490 leader_election.cc:290] T ed9fb0cab0bd43b7a05d7376125b187e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:17.807142 5803 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_9f1bedfe0be845e093fca27534320732" } modify_external_catalogs: true
I20260923 19:50:17.807432 5803 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_9f1bedfe0be845e093fca27534320732" } modify_external_catalogs: true
I20260923 19:50:17.807441 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fb0cab0bd43b7a05d7376125b187e" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:17.807686 6059 raft_consensus.cc:3060] T ed9fb0cab0bd43b7a05d7376125b187e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:17.774075 5804 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet f74e7cb3e5f54dfdb2280c795ce2ce53 (table default.Table_fb92f0dc809c49018d4300eaf32b6a8b [id=8325a8f159124a2da260e2be3ce69500]). Expected version 3 got 0
I20260923 19:50:17.810457 7555 tablet.cc:1751] T f74e7cb3e5f54dfdb2280c795ce2ce53 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260923 19:50:17.810920 5804 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_74ffa772df8d47a4b028a5290d1c8846" } modify_external_catalogs: true
I20260923 19:50:17.811283 5804 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_74ffa772df8d47a4b028a5290d1c8846" } modify_external_catalogs: true
I20260923 19:50:17.812723 5798 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_dad9b3f98a4745baac9606ed19421df1" } modify_external_catalogs: true
I20260923 19:50:17.812956 5798 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_dad9b3f98a4745baac9606ed19421df1" } modify_external_catalogs: true
I20260923 19:50:17.813843 6059 raft_consensus.cc:2468] T ed9fb0cab0bd43b7a05d7376125b187e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:17.814653 6279 leader_election.cc:304] T ed9fb0cab0bd43b7a05d7376125b187e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:17.815109 7362 raft_consensus.cc:2804] T ed9fb0cab0bd43b7a05d7376125b187e P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:17.815208 7362 raft_consensus.cc:697] T ed9fb0cab0bd43b7a05d7376125b187e P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:17.815434 7362 consensus_queue.cc:237] T ed9fb0cab0bd43b7a05d7376125b187e P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.776839 6456 tablet_bootstrap.cc:654] T ad29d22a82434023991ffcacf7f9bee5 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:17.820502 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 577a1dcfe5bd4ef990053466bda6454c (DEFAULT_TABLE table=default.Table_d283141d43ef4b21bd1372ff52f6a711 [id=ce68cc57ec324a1aa784ddd5e6cc547a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:17.822225 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 577a1dcfe5bd4ef990053466bda6454c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:17.822892 6306 tablet_service.cc:1511] Processing CreateTablet for tablet 577a1dcfe5bd4ef990053466bda6454c (DEFAULT_TABLE table=default.Table_d283141d43ef4b21bd1372ff52f6a711 [id=ce68cc57ec324a1aa784ddd5e6cc547a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:17.829120 6200 raft_consensus.cc:3060] T 86388fa08c454da9ad2ca0124dcba10b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:17.830112 6169 tablet_service.cc:1511] Processing CreateTablet for tablet ce42c5de0cd3435b85fcfca92d69cdd5 (DEFAULT_TABLE table=default.Table_602f24694ce04fa887e6cb0112b325f3 [id=746aa0153e7f43ccbea58171d58e5e34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:17.830535 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce42c5de0cd3435b85fcfca92d69cdd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:17.830808 7507 raft_consensus.cc:493] T 870db252d8414be7bbe613ea467b5f3a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:17.830917 7507 raft_consensus.cc:515] T 870db252d8414be7bbe613ea467b5f3a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.831374 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ad33cd4913941c6aa2fea717608ef7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:17 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:17.831601 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet ec5793bdec5244aa8cf13b7fb3b84b8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:17 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:17.831892 6181 tablet_service.cc:1511] Processing CreateTablet for tablet 7f5f02661ce34714a18045945f3fc25d (DEFAULT_TABLE table=default.Table_9c1645ee01fb4c5eaa536d8115780393 [id=0268697d0199470ebff8225a06903f69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:17.832206 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f5f02661ce34714a18045945f3fc25d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:17.832942 6166 tablet_service.cc:1511] Processing CreateTablet for tablet f4ef5a1c66d7416f8d0099b501a9ba96 (DEFAULT_TABLE table=default.Table_41da098c27d44ad3b986089b10f8b6ea [id=42fd29978b7c43fda262b779d8512ba9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:17.833451 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 9b0a7c1feae24d65bb18609847449f4b (DEFAULT_TABLE table=default.Table_fff6175767d74b3785fa69b365c1e4b3 [id=c6be6f5e59194f288435a9ac1fe0afad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:17.833813 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b0a7c1feae24d65bb18609847449f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:17.834561 6306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 577a1dcfe5bd4ef990053466bda6454c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:17.837538 6173 tablet_service.cc:1558] Processing DeleteTablet for tablet 4a034eb9b02d4532b4b68e74c8e5b3fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:17 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:17.838246 6164 tablet_service.cc:1511] Processing CreateTablet for tablet 577a1dcfe5bd4ef990053466bda6454c (DEFAULT_TABLE table=default.Table_d283141d43ef4b21bd1372ff52f6a711 [id=ce68cc57ec324a1aa784ddd5e6cc547a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:17.838697 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 577a1dcfe5bd4ef990053466bda6454c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:17.838937 7505 raft_consensus.cc:493] T c0ff8838ab17433ab733d3b293d4964f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:17.839072 7505 raft_consensus.cc:515] T c0ff8838ab17433ab733d3b293d4964f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.839860 7505 leader_election.cc:290] T c0ff8838ab17433ab733d3b293d4964f P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:17.840050 6180 tablet_service.cc:1511] Processing CreateTablet for tablet 9968ab539c9149e98aa5326c208ce140 (DEFAULT_TABLE table=default.Table_03b07fc0700f4beaa669406e95bdba50 [id=7be6ba11bd6f4349af355570506e3a89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:17.840358 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9968ab539c9149e98aa5326c208ce140. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:17.840758 6137 leader_election.cc:343] T c0ff8838ab17433ab733d3b293d4964f P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: c0ff8838ab17433ab733d3b293d4964f
I20260923 19:50:17.841001 6174 tablet_service.cc:1511] Processing CreateTablet for tablet 33a318872f6a4f838ed9f0c0260d4bfb (DEFAULT_TABLE table=default.Table_cac7a266c93b4f28a3ceff8c08002256 [id=0b1e78f742b84c4fb236e68337f94d87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:17.841315 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33a318872f6a4f838ed9f0c0260d4bfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:17.707538 6139 leader_election.cc:304] T efc63a151f6444dfb03c3f15f6f54473 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:17.841660 6139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.195:32855, user_credentials={real_user=slave}} blocked reactor thread for 134160us
I20260923 19:50:17.842276 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d35ff653bf8d41cfbcf83359402a8f6a" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:17.842640 7507 leader_election.cc:290] T 870db252d8414be7bbe613ea467b5f3a P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:17.842680 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e04d16675443fc923a5f8216e292b6" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:17.842787 7507 raft_consensus.cc:2804] T efc63a151f6444dfb03c3f15f6f54473 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:17.842880 7507 raft_consensus.cc:697] T efc63a151f6444dfb03c3f15f6f54473 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:17.843117 7507 consensus_queue.cc:237] T efc63a151f6444dfb03c3f15f6f54473 P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:17.843437 6137 leader_election.cc:343] T 870db252d8414be7bbe613ea467b5f3a P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 870db252d8414be7bbe613ea467b5f3a
I20260923 19:50:17.844241 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4ef5a1c66d7416f8d0099b501a9ba96. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:17.844753 6139 leader_election.cc:343] T c0ff8838ab17433ab733d3b293d4964f P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: c0ff8838ab17433ab733d3b293d4964f
I20260923 19:50:17.844856 6139 leader_election.cc:304] T c0ff8838ab17433ab733d3b293d4964f P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:17.845227 5995 leader_election.cc:343] T d35ff653bf8d41cfbcf83359402a8f6a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:17.845381 5995 leader_election.cc:304] T d35ff653bf8d41cfbcf83359402a8f6a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
W20260923 19:50:17.845778 5995 leader_election.cc:343] T e6e04d16675443fc923a5f8216e292b6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:17.845865 5995 leader_election.cc:304] T e6e04d16675443fc923a5f8216e292b6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:17.846206 7571 raft_consensus.cc:2749] T e6e04d16675443fc923a5f8216e292b6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:17.845966 7566 raft_consensus.cc:2749] T d35ff653bf8d41cfbcf83359402a8f6a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:17.851523 7505 raft_consensus.cc:2749] T c0ff8838ab17433ab733d3b293d4964f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:17.855043 6203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ba284e81bc4388bbd6456a41d1f9f4" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:17.858680 6280 leader_election.cc:343] T b7ba284e81bc4388bbd6456a41d1f9f4 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:17.858816 6280 leader_election.cc:304] T b7ba284e81bc4388bbd6456a41d1f9f4 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:17.859062 7490 raft_consensus.cc:2749] T b7ba284e81bc4388bbd6456a41d1f9f4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:17.862267 6182 tablet_service.cc:1511] Processing CreateTablet for tablet d689f30677c04fb880778d6723b1f5ac (DEFAULT_TABLE table=default.Table_9f22e0d8c3e240478c41d7eb8e843594 [id=7e67134de07f49ac88dce0a606c6f2de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:17.862641 6165 tablet_service.cc:1511] Processing CreateTablet for tablet b18ddbbf3ce84927bc330b8affc37bb8 (DEFAULT_TABLE table=default.Table_acafa9eab1a2413fb05d955b844452ea [id=f04b384fbad343e5bee580b78bd717c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:17.864410 7566 raft_consensus.cc:493] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:17.864552 7566 raft_consensus.cc:515] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.865216 7566 leader_election.cc:290] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:17.866045 6027 tablet_service.cc:1511] Processing CreateTablet for tablet 9968ab539c9149e98aa5326c208ce140 (DEFAULT_TABLE table=default.Table_03b07fc0700f4beaa669406e95bdba50 [id=7be6ba11bd6f4349af355570506e3a89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:17.866427 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9968ab539c9149e98aa5326c208ce140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:17.868148 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85b7dcf131c54187a6e61f8503c797f8" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:17.868678 5996 leader_election.cc:343] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:17.873523 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fb0cab0bd43b7a05d7376125b187e" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:17.874276 6182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d689f30677c04fb880778d6723b1f5ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:17.873620 7587 tablet.cc:1751] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260923 19:50:17.878482 6280 leader_election.cc:343] T ed9fb0cab0bd43b7a05d7376125b187e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:17.878983 6457 tablet_bootstrap.cc:492] T f1f1df47dc32413d9cc9456f4198dca5 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:17.879417 6457 ts_tablet_manager.cc:1403] T f1f1df47dc32413d9cc9456f4198dca5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.240s user 0.009s sys 0.018s
I20260923 19:50:17.880235 6457 raft_consensus.cc:359] T f1f1df47dc32413d9cc9456f4198dca5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:17.880549 6457 raft_consensus.cc:385] T f1f1df47dc32413d9cc9456f4198dca5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:17.880661 6457 raft_consensus.cc:740] T f1f1df47dc32413d9cc9456f4198dca5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:17.879262 6198 raft_consensus.cc:3060] T 1fcd1c1bfd2c437a955c34569605a6d4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:17.879496 6165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b18ddbbf3ce84927bc330b8affc37bb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:17.880951 6457 consensus_queue.cc:260] T f1f1df47dc32413d9cc9456f4198dca5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:17.884693 6457 ts_tablet_manager.cc:1434] T f1f1df47dc32413d9cc9456f4198dca5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260923 19:50:17.885109 6457 tablet_bootstrap.cc:492] T 670d9cb0e6e2414092f72ffd5e6b00ea P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:17.865404 6458 ts_tablet_manager.cc:1929] T 22e37d5afa8047989928596b4092c4b9 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:17.890764 6458 log.cc:1199] T 22e37d5afa8047989928596b4092c4b9 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/22e37d5afa8047989928596b4092c4b9
I20260923 19:50:17.891621 6458 ts_tablet_manager.cc:1950] T 22e37d5afa8047989928596b4092c4b9 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:17.896163 6457 tablet_bootstrap.cc:654] T 670d9cb0e6e2414092f72ffd5e6b00ea P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:17.898473 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 720) took 2489 ms. Trace:
I20260923 19:50:17.896982 6461 ts_tablet_manager.cc:1929] T 658253ff3d014361803e1aeda978e59a P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:17.901294 6461 log.cc:1199] T 658253ff3d014361803e1aeda978e59a P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/658253ff3d014361803e1aeda978e59a
I20260923 19:50:17.902065 6459 ts_tablet_manager.cc:1929] T 465371cfbe544ba98e6eea05033ecf05 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:17.902370 6459 log.cc:1199] T 465371cfbe544ba98e6eea05033ecf05 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/465371cfbe544ba98e6eea05033ecf05
I20260923 19:50:17.903617 6459 ts_tablet_manager.cc:1950] T 465371cfbe544ba98e6eea05033ecf05 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:17.903983 6461 ts_tablet_manager.cc:1950] T 658253ff3d014361803e1aeda978e59a P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:17.900918 6456 tablet_bootstrap.cc:492] T ad29d22a82434023991ffcacf7f9bee5 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:17.911619 6456 ts_tablet_manager.cc:1403] T ad29d22a82434023991ffcacf7f9bee5 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.163s user 0.002s sys 0.002s
I20260923 19:50:17.912277 6457 tablet_bootstrap.cc:492] T 670d9cb0e6e2414092f72ffd5e6b00ea P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:17.912510 6457 ts_tablet_manager.cc:1403] T 670d9cb0e6e2414092f72ffd5e6b00ea P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.027s user 0.001s sys 0.008s
I20260923 19:50:17.912650 6456 raft_consensus.cc:359] T ad29d22a82434023991ffcacf7f9bee5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.912890 6456 raft_consensus.cc:385] T ad29d22a82434023991ffcacf7f9bee5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:17.912997 6456 raft_consensus.cc:740] T ad29d22a82434023991ffcacf7f9bee5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:17.913308 6456 consensus_queue.cc:260] T ad29d22a82434023991ffcacf7f9bee5 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.913380 6457 raft_consensus.cc:359] T 670d9cb0e6e2414092f72ffd5e6b00ea P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:17.913846 6456 ts_tablet_manager.cc:1434] T ad29d22a82434023991ffcacf7f9bee5 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:17.914340 6456 tablet_bootstrap.cc:492] T 2398c59871d241f985bca1761e722180 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:17.911615 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fb0cab0bd43b7a05d7376125b187e" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:17.916440 6280 leader_election.cc:343] T ed9fb0cab0bd43b7a05d7376125b187e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:17.916460 6458 rpcz_store.cc:276] 0923 19:50:15.408805 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.408963 (+ 158us) service_pool.cc:224] Handling call
0923 19:50:17.709898 (+2300935us) ts_tablet_manager.cc:1151] Deleting tablet 22e37d5afa8047989928596b4092c4b9
0923 19:50:17.709910 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.803485 (+ 93575us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:17.865335 (+ 61850us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:17.898445 (+ 33110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2300690}
I20260923 19:50:17.916092 6456 tablet_bootstrap.cc:654] T 2398c59871d241f985bca1761e722180 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:17.919098 6454 tablet_bootstrap.cc:492] T edb52bd88b424129bbdc45de89b56efb P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:17.919341 6454 ts_tablet_manager.cc:1403] T edb52bd88b424129bbdc45de89b56efb P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.480s user 0.012s sys 0.015s
I20260923 19:50:17.922341 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 908596339b2e4f7f8ddb7f9cd5bdcc3e (table default.Table_f92387e003d44b0eb22010e7ca6598af [id=1e323f5b380a4af4acc3865649648e12]) successfully deleted
W20260923 19:50:17.922520 5791 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 68299.9us
W20260923 19:50:17.922763 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet f9687b3f4b904e438d83533fb67cc92f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f9687b3f4b904e438d83533fb67cc92f already in progress: creating tablet
I20260923 19:50:17.922962 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 7e41501bf01e4765853c27e4cac21e2b (table default.Table_5c35e08897f74660ad23df9a2c751741 [id=9b387d21c8824514b7f3fae8c26b489d]) successfully deleted
W20260923 19:50:17.923152 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 62c0cf7f070e467dafaed442b6b8c15d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 62c0cf7f070e467dafaed442b6b8c15d already in progress: creating tablet
W20260923 19:50:17.923334 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 382daee3555642b7a767a35c2f49b98a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 382daee3555642b7a767a35c2f49b98a already in progress: creating tablet
W20260923 19:50:17.923491 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet f4313a4d8a9c411fad593b05ad655fc4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4313a4d8a9c411fad593b05ad655fc4 already in progress: creating tablet
W20260923 19:50:17.923655 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet cffe24ab4df745e3a34f82e8ca7b39f5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cffe24ab4df745e3a34f82e8ca7b39f5 already in progress: creating tablet
W20260923 19:50:17.923810 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 401d909c37ec4daaa210e4fc32d838aa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 401d909c37ec4daaa210e4fc32d838aa already in progress: creating tablet
I20260923 19:50:17.923974 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 7b1601590508479c8f401cd09d9f4c3b (table default.Table_d824a438d0804f58b8b89f6f0f0f964e [id=83a0bf386540479b9e915b9c66a31376]) successfully deleted
W20260923 19:50:17.924170 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 28f9d03be14a4072aab7fd03834c3f6b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 28f9d03be14a4072aab7fd03834c3f6b already in progress: creating tablet
I20260923 19:50:17.928817 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 465371cfbe544ba98e6eea05033ecf05 (table default.Table_59faad35003f4e6f95781fbb1895f6aa [id=b28193cd587649a4b2c450473da92564]) successfully deleted
I20260923 19:50:17.929104 6454 raft_consensus.cc:359] T edb52bd88b424129bbdc45de89b56efb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.929527 6454 raft_consensus.cc:385] T edb52bd88b424129bbdc45de89b56efb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:17.929725 6454 raft_consensus.cc:740] T edb52bd88b424129bbdc45de89b56efb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:17.930217 6454 consensus_queue.cc:260] T edb52bd88b424129bbdc45de89b56efb P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.931751 6454 ts_tablet_manager.cc:1434] T edb52bd88b424129bbdc45de89b56efb P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260923 19:50:17.932492 6454 tablet_bootstrap.cc:492] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
W20260923 19:50:17.932557 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet d3f7b33bbf3f453e8e841ee5d99c5b31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3f7b33bbf3f453e8e841ee5d99c5b31 already in progress: creating tablet
I20260923 19:50:17.936574 6457 raft_consensus.cc:385] T 670d9cb0e6e2414092f72ffd5e6b00ea P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260923 19:50:17.937417 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet d39bfd7ec454447cbcc6ed965973355c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d39bfd7ec454447cbcc6ed965973355c already in progress: creating tablet
I20260923 19:50:17.939049 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 724) took 2522 ms. Trace:
I20260923 19:50:17.939667 6458 rpcz_store.cc:276] 0923 19:50:15.416059 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.416109 (+ 50us) service_pool.cc:224] Handling call
0923 19:50:17.938241 (+2522132us) ts_tablet_manager.cc:1151] Deleting tablet 94e111312f134034993bbd968366dea7
0923 19:50:17.938265 (+ 24us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:17.938925 (+ 660us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2517841}
I20260923 19:50:17.941170 6461 tablet_replica.cc:333] T 528fca12bfe04747830ad1d3bb323676 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:17.941335 6457 raft_consensus.cc:740] T 670d9cb0e6e2414092f72ffd5e6b00ea P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:17.942680 6457 consensus_queue.cc:260] T 670d9cb0e6e2414092f72ffd5e6b00ea P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:17.942988 6458 tablet_replica.cc:333] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:17.921847 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 22e37d5afa8047989928596b4092c4b9 (table default.Table_1141571b3d744e3b922ca1d9745fbadf [id=c0f9d6a40e364dd0ad7ce95fa73b5930]) successfully deleted
W20260923 19:50:17.945356 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 94e111312f134034993bbd968366dea7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 94e111312f134034993bbd968366dea7 already in progress: creating tablet
I20260923 19:50:17.946631 6457 ts_tablet_manager.cc:1434] T 670d9cb0e6e2414092f72ffd5e6b00ea P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.034s user 0.002s sys 0.000s
I20260923 19:50:17.947028 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 658253ff3d014361803e1aeda978e59a (table default.Table_493eae9e089b423ca42a863b541f4ec4 [id=374e9291e4564d47a5a9bab50f013952]) successfully deleted
I20260923 19:50:17.947301 6457 tablet_bootstrap.cc:492] T d39a64531dd24eb4aa1f7e0c418b985b P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:17.947728 5799 master_service.cc:960] ReplaceTablet: received request to replace tablet 0c30bd7ab8fa42dea5de04c8d36f2e54 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:17.944980 6461 raft_consensus.cc:2243] T 528fca12bfe04747830ad1d3bb323676 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:17.944730 6458 raft_consensus.cc:2243] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:17.950963 6458 raft_consensus.cc:2272] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:17.949110 6457 tablet_bootstrap.cc:654] T d39a64531dd24eb4aa1f7e0c418b985b P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:17.955938 6459 tablet_replica.cc:333] T 601a0ff319cc4c9a898d52bbcb19184b P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:17.949998 6461 raft_consensus.cc:2272] T 528fca12bfe04747830ad1d3bb323676 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:17.956547 6461 ts_tablet_manager.cc:1916] T 528fca12bfe04747830ad1d3bb323676 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:17.956506 6459 raft_consensus.cc:2243] T 601a0ff319cc4c9a898d52bbcb19184b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:17.956871 6459 raft_consensus.cc:2272] T 601a0ff319cc4c9a898d52bbcb19184b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:17.957440 6459 ts_tablet_manager.cc:1916] T 601a0ff319cc4c9a898d52bbcb19184b P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:17.958997 6458 ts_tablet_manager.cc:1916] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:17.955876 6391 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
I20260923 19:50:17.961556 7362 raft_consensus.cc:493] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:17.961711 7362 raft_consensus.cc:515] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.962458 7362 leader_election.cc:290] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:17.964334 6279 leader_election.cc:343] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: edb52bd88b424129bbdc45de89b56efb
I20260923 19:50:17.966039 6457 tablet_bootstrap.cc:492] T d39a64531dd24eb4aa1f7e0c418b985b P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:17.966197 6457 ts_tablet_manager.cc:1403] T d39a64531dd24eb4aa1f7e0c418b985b P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.002s
I20260923 19:50:17.966493 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_15c935c5fb8f497aaea93e214d5a6843" } new_table_name: "default.Table_4bda7de33be746b08324030612e45987" modify_external_catalogs: true
I20260923 19:50:17.968508 6456 tablet_bootstrap.cc:492] T 2398c59871d241f985bca1761e722180 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:17.968664 6456 ts_tablet_manager.cc:1403] T 2398c59871d241f985bca1761e722180 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.054s user 0.004s sys 0.000s
I20260923 19:50:17.969393 6456 raft_consensus.cc:359] T 2398c59871d241f985bca1761e722180 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.969559 6456 raft_consensus.cc:385] T 2398c59871d241f985bca1761e722180 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:17.969625 6456 raft_consensus.cc:740] T 2398c59871d241f985bca1761e722180 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:17.967003 6457 raft_consensus.cc:359] T d39a64531dd24eb4aa1f7e0c418b985b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.972868 6457 raft_consensus.cc:385] T d39a64531dd24eb4aa1f7e0c418b985b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:17.973053 6457 raft_consensus.cc:740] T d39a64531dd24eb4aa1f7e0c418b985b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:17.973378 6457 consensus_queue.cc:260] T d39a64531dd24eb4aa1f7e0c418b985b P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.976083 6456 consensus_queue.cc:260] T 2398c59871d241f985bca1761e722180 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.976541 6457 ts_tablet_manager.cc:1434] T d39a64531dd24eb4aa1f7e0c418b985b P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260923 19:50:17.976886 6457 tablet_bootstrap.cc:492] T 1c43641327d14a888a2815e49a2762c8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:17.978427 6457 tablet_bootstrap.cc:654] T 1c43641327d14a888a2815e49a2762c8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:17.981017 5792 catalog_manager.cc:5136] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): alter failed for tablet b529b0e82c5b48edac54cc281ac4b4a6 (table default.Table_20e578ee9e57408c9a54cc2ac08af6e2 [id=ca73f0867b5d49cfb0bb7cd2315c47f2]),no further retry: Not found: Tablet not found: b529b0e82c5b48edac54cc281ac4b4a6
I20260923 19:50:17.981531 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_23216d517be14547b1a57de90be93f03" } new_table_name: "default.Table_9731ebe308dc4f34b1ad1b7bc1e8400b" modify_external_catalogs: true
I20260923 19:50:17.981838 6456 ts_tablet_manager.cc:1434] T 2398c59871d241f985bca1761e722180 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260923 19:50:17.983127 5800 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 2ce6378a6bd844a485aebb96081307e3 (table default.Table_4d1a0d71d11f4c0a8c80b3ba7ea0c358 [id=ef9a6c259ceb4c189c8902a776fb3bfa]). Expected version 1 got 0
I20260923 19:50:17.983539 5800 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet f74e7cb3e5f54dfdb2280c795ce2ce53 (table default.Table_fb92f0dc809c49018d4300eaf32b6a8b [id=8325a8f159124a2da260e2be3ce69500]). Expected version 3 got 0
I20260923 19:50:17.984522 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb52bd88b424129bbdc45de89b56efb" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:17.986109 5800 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 2db82e6f314f412385b41720c7efdef5 (table default.Table_fa1d82a491c04ba89f5cf3162578d550 [id=6d79e588fb9e4936aedf8cd500f68d60]). Expected version 3 got 0
I20260923 19:50:17.986236 6202 raft_consensus.cc:2468] T edb52bd88b424129bbdc45de89b56efb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:17.986436 5800 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 8d87f05f29bd476386ff6516676ce31a (table default.Table_9fa8f8bfc6124f398a4acdf5e1e0b33a [id=02d2ab56def342c482c86ce96110342f]). Expected version 1 got 0
I20260923 19:50:17.984814 7362 raft_consensus.cc:493] T d6d3601a392f4723b4ca00f6e12b950c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:17.991487 7362 raft_consensus.cc:515] T d6d3601a392f4723b4ca00f6e12b950c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:17.992218 7362 leader_election.cc:290] T d6d3601a392f4723b4ca00f6e12b950c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:17.986929 6280 leader_election.cc:304] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:17.993027 7256 raft_consensus.cc:2804] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:17.993108 7256 raft_consensus.cc:493] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:17.993182 7256 raft_consensus.cc:3060] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:17.993229 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3601a392f4723b4ca00f6e12b950c" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:17.993932 6280 leader_election.cc:343] T d6d3601a392f4723b4ca00f6e12b950c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:17.995568 6461 ts_tablet_manager.cc:1929] T 528fca12bfe04747830ad1d3bb323676 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:17.995683 6461 log.cc:1199] T 528fca12bfe04747830ad1d3bb323676 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/528fca12bfe04747830ad1d3bb323676
I20260923 19:50:17.995885 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 37769256de33432697e9d4fb235f473f
I20260923 19:50:17.996003 6461 ts_tablet_manager.cc:1950] T 528fca12bfe04747830ad1d3bb323676 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:17.995930 7256 raft_consensus.cc:515] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:17.998446 6279 leader_election.cc:343] T d6d3601a392f4723b4ca00f6e12b950c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: d6d3601a392f4723b4ca00f6e12b950c
I20260923 19:50:17.998652 6279 leader_election.cc:304] T d6d3601a392f4723b4ca00f6e12b950c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:17.999059 7490 raft_consensus.cc:2749] T d6d3601a392f4723b4ca00f6e12b950c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:17.999156 7256 leader_election.cc:290] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:17.999897 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb52bd88b424129bbdc45de89b56efb" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:17.999954 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_b8c82428065244aeb53ee2590094329c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:18.000653 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b8c82428065244aeb53ee2590094329c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:18.000994 6279 leader_election.cc:343] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: edb52bd88b424129bbdc45de89b56efb
I20260923 19:50:18.000610 6200 raft_consensus.cc:3060] T edb52bd88b424129bbdc45de89b56efb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:18.001585 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet 37769256de33432697e9d4fb235f473f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:17 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:18.002921 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 528fca12bfe04747830ad1d3bb323676 (table default.Table_141fc144025e434aa7d7a6e0ecb9c98d [id=f4622a8ebb6644cba5c5c4d18a9a22f1]) successfully deleted
W20260923 19:50:18.003263 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 4a034eb9b02d4532b4b68e74c8e5b3fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4a034eb9b02d4532b4b68e74c8e5b3fa already in progress: creating tablet
W20260923 19:50:18.003736 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 37769256de33432697e9d4fb235f473f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 37769256de33432697e9d4fb235f473f already in progress: creating tablet
I20260923 19:50:18.004513 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet b9c084a319c449328b639d604c00946a
I20260923 19:50:18.005537 5803 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_40208153d40d477c8a2d41c8efc1617c" } modify_external_catalogs: true
I20260923 19:50:18.005651 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet b9c084a319c449328b639d604c00946a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:17 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:18.006464 6313 tablet_service.cc:1558] Processing DeleteTablet for tablet b9c084a319c449328b639d604c00946a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:17 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:18.006732 6306 tablet_service.cc:1558] Processing DeleteTablet for tablet 37769256de33432697e9d4fb235f473f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:17 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:18.005787 5803 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_40208153d40d477c8a2d41c8efc1617c" } modify_external_catalogs: true
I20260923 19:50:18.007386 6454 tablet_bootstrap.cc:654] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:18.006443 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet b9c084a319c449328b639d604c00946a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9c084a319c449328b639d604c00946a already in progress: creating tablet
I20260923 19:50:18.010300 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_b115b41e555e48ee912c9be01ed1700c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:18.010994 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b115b41e555e48ee912c9be01ed1700c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:18.011971 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet 37769256de33432697e9d4fb235f473f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:17 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:18.012239 6182 tablet_service.cc:1558] Processing DeleteTablet for tablet b9c084a319c449328b639d604c00946a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:17 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:18.015949 6456 tablet_bootstrap.cc:492] T 28f9d03be14a4072aab7fd03834c3f6b P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:18.017828 6456 tablet_bootstrap.cc:654] T 28f9d03be14a4072aab7fd03834c3f6b P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:18.024592 6139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.195:32855, user_credentials={real_user=slave}} blocked reactor thread for 179828us
I20260923 19:50:18.025089 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85b7dcf131c54187a6e61f8503c797f8" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:18.036559 6139 leader_election.cc:343] T 870db252d8414be7bbe613ea467b5f3a P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 870db252d8414be7bbe613ea467b5f3a
I20260923 19:50:18.036715 6139 leader_election.cc:304] T 870db252d8414be7bbe613ea467b5f3a P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:18.037012 7507 raft_consensus.cc:2749] T 870db252d8414be7bbe613ea467b5f3a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:18.037441 5995 leader_election.cc:343] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:18.037571 5995 leader_election.cc:304] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:18.038265 7566 raft_consensus.cc:2749] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:18.038205 6200 raft_consensus.cc:2468] T edb52bd88b424129bbdc45de89b56efb P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:18.049664 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 88640e1a21154073ae0db18b171408b7
I20260923 19:50:18.053417 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_76e9093a6c7e44928a0ae7f1565e830a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:18.056496 6454 tablet_bootstrap.cc:492] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
W20260923 19:50:18.056972 5789 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 5ce73f31a1f64a24835a272fea8d65c4 (table default.Table_a97c70dd1454425e9e3abc310ebc442b [id=7a1c03080dcc484ebe1b2743a8e1c6ed], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 5ce73f31a1f64a24835a272fea8d65c4 consensus state has no leader
I20260923 19:50:18.057729 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 29e6ea6b3eda4df88a539627d4505885
I20260923 19:50:18.060046 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_78600d43ea2249ca9fbfd813317ee3d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:18.060731 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_78600d43ea2249ca9fbfd813317ee3d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:18.061213 6454 ts_tablet_manager.cc:1403] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.129s user 0.003s sys 0.002s
W20260923 19:50:18.065238 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_76e9093a6c7e44928a0ae7f1565e830a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:18.064427 6182 tablet_service.cc:1558] Processing DeleteTablet for tablet 88640e1a21154073ae0db18b171408b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:17 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:18.064589 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet edb52bd88b424129bbdc45de89b56efb with delete_type TABLET_DATA_DELETED (replaced by tablet 1f6df2c7b8c34ff2a358acdc58543991) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:18.064670 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet 29e6ea6b3eda4df88a539627d4505885 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:17 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:18.069114 6454 raft_consensus.cc:359] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.070829 6457 tablet_bootstrap.cc:492] T 1c43641327d14a888a2815e49a2762c8 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:18.071379 5796 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_fb92f0dc809c49018d4300eaf32b6a8b [id=8325a8f159124a2da260e2be3ce69500] alter complete (version 3)
I20260923 19:50:18.071976 6457 ts_tablet_manager.cc:1403] T 1c43641327d14a888a2815e49a2762c8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.095s user 0.008s sys 0.004s
I20260923 19:50:18.072039 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_7731869fe4bd4efd97e95739dbb3398d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:18.072584 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7731869fe4bd4efd97e95739dbb3398d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:18.076601 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_d28de154c0f1433db6ef27cc9a3a67b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:18.077507 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d28de154c0f1433db6ef27cc9a3a67b1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:18.078027 6454 raft_consensus.cc:385] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:18.078693 6454 raft_consensus.cc:740] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:18.079622 5799 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 0c30bd7ab8fa42dea5de04c8d36f2e54
I20260923 19:50:18.080238 5799 catalog_manager.cc:6934] ReplaceTablet: tablet 0c30bd7ab8fa42dea5de04c8d36f2e54 deleted and replaced by tablet 501921b0f23b4713b0c53e8844c9f423
I20260923 19:50:18.080583 5799 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_2450b2fff14d4d4ebd74a9ebf00fd118" } new_table_name: "default.Table_bd61cd1b68ec4ef69749319768dfe74c" modify_external_catalogs: true
I20260923 19:50:18.081843 7571 raft_consensus.cc:493] T f1f1df47dc32413d9cc9456f4198dca5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:18.082031 7571 raft_consensus.cc:515] T f1f1df47dc32413d9cc9456f4198dca5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:18.083266 7571 leader_election.cc:290] T f1f1df47dc32413d9cc9456f4198dca5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:18.084051 6454 consensus_queue.cc:260] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.038859 6280 leader_election.cc:304] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:18.062407 6313 tablet_service.cc:1558] Processing DeleteTablet for tablet 29e6ea6b3eda4df88a539627d4505885 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:17 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:18.063175 6306 tablet_service.cc:1558] Processing DeleteTablet for tablet 88640e1a21154073ae0db18b171408b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:17 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:18.081923 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c30bd7ab8fa42dea5de04c8d36f2e54 with delete_type TABLET_DATA_DELETED (replaced by tablet 501921b0f23b4713b0c53e8844c9f423) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:18.084733 6280 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 45904.2us
I20260923 19:50:18.085611 7362 raft_consensus.cc:2804] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:18.085726 7362 raft_consensus.cc:697] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:18.086014 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f1df47dc32413d9cc9456f4198dca5" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:18.086925 7362 consensus_queue.cc:237] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:18.096848 5995 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 58773us
I20260923 19:50:18.099256 6027 tablet_service.cc:1558] Processing DeleteTablet for tablet 29e6ea6b3eda4df88a539627d4505885 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:17 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:18.100449 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet 88640e1a21154073ae0db18b171408b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:17 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:18.100735 6027 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c30bd7ab8fa42dea5de04c8d36f2e54 with delete_type TABLET_DATA_DELETED (replaced by tablet 501921b0f23b4713b0c53e8844c9f423) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:18.102257 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 29e6ea6b3eda4df88a539627d4505885 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29e6ea6b3eda4df88a539627d4505885 already in progress: creating tablet
W20260923 19:50:18.104209 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 88640e1a21154073ae0db18b171408b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 88640e1a21154073ae0db18b171408b7 already in progress: creating tablet
W20260923 19:50:18.104823 5805 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7418058b0f5a44d189888b0b1714eb2e consensus state has no leader
W20260923 19:50:18.105924 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 0c30bd7ab8fa42dea5de04c8d36f2e54 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c30bd7ab8fa42dea5de04c8d36f2e54 already in progress: creating tablet
W20260923 19:50:18.112258 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fcc32bda7c684e849161f9d4a3df79d3 consensus state has no leader
I20260923 19:50:18.112740 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_e73bff7f81754cd69de0a927b79aa09a" } new_table_name: "default.Table_2e6167b1010f4df8be79e4234ebd5866" modify_external_catalogs: true
I20260923 19:50:18.116426 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_3de87a9c328940219e659fef1ebb0db8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:18.117038 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3de87a9c328940219e659fef1ebb0db8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:18.120879 5996 leader_election.cc:343] T f1f1df47dc32413d9cc9456f4198dca5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:18.089684 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c30bd7ab8fa42dea5de04c8d36f2e54 with delete_type TABLET_DATA_DELETED (replaced by tablet 501921b0f23b4713b0c53e8844c9f423) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:18.098101 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f1df47dc32413d9cc9456f4198dca5" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:18.130261 6454 ts_tablet_manager.cc:1434] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.062s user 0.001s sys 0.001s
I20260923 19:50:18.130609 6454 tablet_bootstrap.cc:492] T 35f46a1be80c4194b592c5d00fe1f342 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
W20260923 19:50:18.130568 5995 leader_election.cc:343] T f1f1df47dc32413d9cc9456f4198dca5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:18.131153 5995 leader_election.cc:304] T f1f1df47dc32413d9cc9456f4198dca5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
W20260923 19:50:18.131657 6139 consensus_peers.cc:597] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Couldn't send request to peer 2bf41435f70447f19992d368ca6b46bd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b92aaac328934d95a89e0fc08a80b0b1. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:18.131675 7566 raft_consensus.cc:2749] T f1f1df47dc32413d9cc9456f4198dca5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:18.132301 6454 tablet_bootstrap.cc:654] T 35f46a1be80c4194b592c5d00fe1f342 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:18.077725 6457 raft_consensus.cc:359] T 1c43641327d14a888a2815e49a2762c8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.133322 6457 raft_consensus.cc:385] T 1c43641327d14a888a2815e49a2762c8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:18.133424 6457 raft_consensus.cc:740] T 1c43641327d14a888a2815e49a2762c8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:18.133716 6457 consensus_queue.cc:260] T 1c43641327d14a888a2815e49a2762c8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.137769 7587 tablet.cc:1751] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260923 19:50:18.138751 7555 tablet.cc:1751] T 85d35ebef3c24a2e89233dd900b63513 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260923 19:50:18.139847 5804 master_service.cc:960] ReplaceTablet: received request to replace tablet e5fce24b9dc244c88ccbc16b633924fe from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:18.140436 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a2564a99c274e07a7e43da739a2458b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:18.141287 5805 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet f1f1df47dc32413d9cc9456f4198dca5 (table default.Table_5c873b003c7b4b09ba69db7f039b2f98 [id=6d285eda96a948b2b14fa1ef456ca5b2]). Expected version 2 got 0
I20260923 19:50:18.141520 5805 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet d39a64531dd24eb4aa1f7e0c418b985b (table default.Table_b1d1d63c07d44208b5d0b2542e9590af [id=a56799b0709846cf8308d7d7b727427c]). Expected version 1 got 0
I20260923 19:50:18.141942 6456 tablet_bootstrap.cc:492] T 28f9d03be14a4072aab7fd03834c3f6b P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:18.142064 6456 ts_tablet_manager.cc:1403] T 28f9d03be14a4072aab7fd03834c3f6b P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.126s user 0.004s sys 0.000s
I20260923 19:50:18.142721 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 670d9cb0e6e2414092f72ffd5e6b00ea
I20260923 19:50:18.143265 6457 ts_tablet_manager.cc:1434] T 1c43641327d14a888a2815e49a2762c8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.066s user 0.002s sys 0.000s
I20260923 19:50:18.143714 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet 670d9cb0e6e2414092f72ffd5e6b00ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:18.143975 6027 tablet_service.cc:1558] Processing DeleteTablet for tablet 670d9cb0e6e2414092f72ffd5e6b00ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:18.144726 6456 raft_consensus.cc:359] T 28f9d03be14a4072aab7fd03834c3f6b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.144920 6456 raft_consensus.cc:385] T 28f9d03be14a4072aab7fd03834c3f6b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:18.145188 6461 tablet_replica.cc:333] T 670d9cb0e6e2414092f72ffd5e6b00ea P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:18.145380 6461 raft_consensus.cc:2243] T 670d9cb0e6e2414092f72ffd5e6b00ea P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:18.145363 6456 raft_consensus.cc:740] T 28f9d03be14a4072aab7fd03834c3f6b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:18.145526 6461 raft_consensus.cc:2272] T 670d9cb0e6e2414092f72ffd5e6b00ea P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:18.145817 6456 consensus_queue.cc:260] T 28f9d03be14a4072aab7fd03834c3f6b P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.146540 6461 ts_tablet_manager.cc:1916] T 670d9cb0e6e2414092f72ffd5e6b00ea P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:18.147781 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet 670d9cb0e6e2414092f72ffd5e6b00ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:18.150225 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_1b26a697bf2a472995a21b28dc49a95f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:18.150815 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1b26a697bf2a472995a21b28dc49a95f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:18.157063 6461 ts_tablet_manager.cc:1929] T 670d9cb0e6e2414092f72ffd5e6b00ea P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:18.159026 6461 log.cc:1199] T 670d9cb0e6e2414092f72ffd5e6b00ea P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/670d9cb0e6e2414092f72ffd5e6b00ea
I20260923 19:50:18.159545 6461 ts_tablet_manager.cc:1950] T 670d9cb0e6e2414092f72ffd5e6b00ea P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:18.068022 6459 ts_tablet_manager.cc:1929] T 601a0ff319cc4c9a898d52bbcb19184b P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:18.163367 6459 log.cc:1199] T 601a0ff319cc4c9a898d52bbcb19184b P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/601a0ff319cc4c9a898d52bbcb19184b
I20260923 19:50:18.163789 6459 ts_tablet_manager.cc:1950] T 601a0ff319cc4c9a898d52bbcb19184b P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:18.164378 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 601a0ff319cc4c9a898d52bbcb19184b (table default.Table_5812b40db6ab4814a5c5b3c869967f58 [id=df481a17409f4078a57a0aef11bef720]) successfully deleted
W20260923 19:50:18.164776 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet f8007918eca14c81947e5999fe13a705 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f8007918eca14c81947e5999fe13a705 already in progress: creating tablet
W20260923 19:50:18.165009 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 3a4b9d48f02a4372adce6d9eb80935f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3a4b9d48f02a4372adce6d9eb80935f6 already in progress: creating tablet
I20260923 19:50:18.165076 6459 tablet_replica.cc:333] T 18bab39d85f94f4283f0b18c1c9b48a2 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:18.165259 6459 raft_consensus.cc:2243] T 18bab39d85f94f4283f0b18c1c9b48a2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:18.165531 6459 pending_rounds.cc:70] T 18bab39d85f94f4283f0b18c1c9b48a2 P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:18.165621 6459 pending_rounds.cc:77] T 18bab39d85f94f4283f0b18c1c9b48a2 P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630598498516992 op_type: NO_OP noop_request { }
I20260923 19:50:18.165768 6459 raft_consensus.cc:2889] T 18bab39d85f94f4283f0b18c1c9b48a2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:18.165926 6459 raft_consensus.cc:2272] T 18bab39d85f94f4283f0b18c1c9b48a2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:18.166949 6459 ts_tablet_manager.cc:1916] T 18bab39d85f94f4283f0b18c1c9b48a2 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:18.168068 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_d78d71ca18ac4335ad0c752f06e39dd8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:18.168663 6457 tablet_bootstrap.cc:492] T 0c537304c32c44adaa1e05de4496293f P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
W20260923 19:50:18.168805 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d78d71ca18ac4335ad0c752f06e39dd8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:18.171430 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 670d9cb0e6e2414092f72ffd5e6b00ea (table default.Table_40208153d40d477c8a2d41c8efc1617c [id=8065910e86444becaf5f982fbdeb2aed]) successfully deleted
I20260923 19:50:18.176673 6456 ts_tablet_manager.cc:1434] T 28f9d03be14a4072aab7fd03834c3f6b P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.034s user 0.002s sys 0.000s
W20260923 19:50:18.179585 5799 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4935c06f29cf4c729946f35829dfdf92 consensus state has no leader
I20260923 19:50:18.179977 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_8b491f6b8220479ba54f424bc16d9251"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:18.180614 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8b491f6b8220479ba54f424bc16d9251 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:18.181744 6456 tablet_bootstrap.cc:492] T 15a9d1d4adaa402f90d774e77010c928 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:18.183918 6456 tablet_bootstrap.cc:654] T 15a9d1d4adaa402f90d774e77010c928 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:18.190591 6457 tablet_bootstrap.cc:654] T 0c537304c32c44adaa1e05de4496293f P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:18.191370 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b0ddcbe6166a4a2cb89cb60b3d8458fb consensus state has no leader
I20260923 19:50:18.192627 6458 ts_tablet_manager.cc:1929] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:50:18.192812 6458 log.cc:1199] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/0d70deeda179486291195476e47a9ae6
I20260923 19:50:18.193306 6458 ts_tablet_manager.cc:1950] T 0d70deeda179486291195476e47a9ae6 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:18.193656 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 722) took 2780 ms. Trace:
I20260923 19:50:18.197258 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet e5fce24b9dc244c88ccbc16b633924fe
I20260923 19:50:18.197754 5804 catalog_manager.cc:6934] ReplaceTablet: tablet e5fce24b9dc244c88ccbc16b633924fe deleted and replaced by tablet 60fec1c062234257b08429e50c965ebc
I20260923 19:50:18.198515 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet e5fce24b9dc244c88ccbc16b633924fe with delete_type TABLET_DATA_DELETED (replaced by tablet 60fec1c062234257b08429e50c965ebc) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:18.168671 6249 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
I20260923 19:50:18.198235 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet e5fce24b9dc244c88ccbc16b633924fe with delete_type TABLET_DATA_DELETED (replaced by tablet 60fec1c062234257b08429e50c965ebc) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:18.201900 6027 tablet_service.cc:1558] Processing DeleteTablet for tablet e5fce24b9dc244c88ccbc16b633924fe with delete_type TABLET_DATA_DELETED (replaced by tablet 60fec1c062234257b08429e50c965ebc) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:18.202566 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet e5fce24b9dc244c88ccbc16b633924fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e5fce24b9dc244c88ccbc16b633924fe already in progress: creating tablet
I20260923 19:50:18.203544 5804 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5f13aeaf05304dadbdb2d0d720acd604" } modify_external_catalogs: true
I20260923 19:50:18.203752 5804 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5f13aeaf05304dadbdb2d0d720acd604" } modify_external_catalogs: true
I20260923 19:50:18.205142 7566 raft_consensus.cc:493] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:18.205305 7566 raft_consensus.cc:515] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.206040 7566 leader_election.cc:290] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:18.206755 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad29d22a82434023991ffcacf7f9bee5" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:18.206894 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad29d22a82434023991ffcacf7f9bee5" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:18.206965 6340 raft_consensus.cc:2468] T ad29d22a82434023991ffcacf7f9bee5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 0.
I20260923 19:50:18.207496 5996 leader_election.cc:304] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:18.207783 5797 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ea8c4179d37e4165869f5bf030971467" } modify_external_catalogs: true
W20260923 19:50:18.208220 5995 leader_election.cc:343] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:18.208627 7566 raft_consensus.cc:2804] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:18.208714 7566 raft_consensus.cc:493] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:18.208787 7566 raft_consensus.cc:3060] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:18.209093 5797 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ea8c4179d37e4165869f5bf030971467" } modify_external_catalogs: true
I20260923 19:50:18.213411 6456 tablet_bootstrap.cc:492] T 15a9d1d4adaa402f90d774e77010c928 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:18.213557 6456 ts_tablet_manager.cc:1403] T 15a9d1d4adaa402f90d774e77010c928 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.032s user 0.007s sys 0.000s
I20260923 19:50:18.213857 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_fff6175767d74b3785fa69b365c1e4b3" } new_table_name: "default.Table_55a8400c20e944fb8f7b5814feee727d" modify_external_catalogs: true
I20260923 19:50:18.214380 6456 raft_consensus.cc:359] T 15a9d1d4adaa402f90d774e77010c928 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.214547 6456 raft_consensus.cc:385] T 15a9d1d4adaa402f90d774e77010c928 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:18.214596 6456 raft_consensus.cc:740] T 15a9d1d4adaa402f90d774e77010c928 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:18.214831 6456 consensus_queue.cc:260] T 15a9d1d4adaa402f90d774e77010c928 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.217993 7591 raft_consensus.cc:493] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:18.218143 7591 raft_consensus.cc:515] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.218859 7591 leader_election.cc:290] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:18.219703 7566 raft_consensus.cc:515] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.219820 7362 raft_consensus.cc:493] T 28f9d03be14a4072aab7fd03834c3f6b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:18.219941 7362 raft_consensus.cc:515] T 28f9d03be14a4072aab7fd03834c3f6b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.220566 7362 leader_election.cc:290] T 28f9d03be14a4072aab7fd03834c3f6b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:18.220846 7566 leader_election.cc:290] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:18.221073 6137 leader_election.cc:343] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 6a2564a99c274e07a7e43da739a2458b
I20260923 19:50:18.221760 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad29d22a82434023991ffcacf7f9bee5" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:18.221968 6340 raft_consensus.cc:3060] T ad29d22a82434023991ffcacf7f9bee5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:18.222831 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f9d03be14a4072aab7fd03834c3f6b" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:18.223376 6280 leader_election.cc:343] T 28f9d03be14a4072aab7fd03834c3f6b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:18.224574 6137 consensus_peers.cc:597] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b92aaac328934d95a89e0fc08a80b0b1. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:18.224831 6340 raft_consensus.cc:2468] T ad29d22a82434023991ffcacf7f9bee5 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 1.
I20260923 19:50:18.227141 5996 leader_election.cc:304] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:18.227636 6456 ts_tablet_manager.cc:1434] T 15a9d1d4adaa402f90d774e77010c928 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260923 19:50:18.228219 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad29d22a82434023991ffcacf7f9bee5" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
W20260923 19:50:18.229386 5995 leader_election.cc:343] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:18.229453 6279 leader_election.cc:343] T 28f9d03be14a4072aab7fd03834c3f6b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 28f9d03be14a4072aab7fd03834c3f6b
I20260923 19:50:18.229557 6279 leader_election.cc:304] T 28f9d03be14a4072aab7fd03834c3f6b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:18.230007 7362 raft_consensus.cc:2749] T 28f9d03be14a4072aab7fd03834c3f6b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:18.230334 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2564a99c274e07a7e43da739a2458b" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:18.230494 6340 raft_consensus.cc:2468] T 6a2564a99c274e07a7e43da739a2458b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:18.230871 6139 leader_election.cc:304] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:18.231343 7591 raft_consensus.cc:2804] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:18.231436 7591 raft_consensus.cc:493] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:18.231519 7591 raft_consensus.cc:3060] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:18.234668 6456 tablet_bootstrap.cc:492] T c504ec668a33451fb1249f697bb5e2bb P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:18.235085 7591 raft_consensus.cc:515] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.235975 7591 leader_election.cc:290] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:18.236264 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9b0a7c1feae24d65bb18609847449f4b consensus state has no leader
I20260923 19:50:18.236435 7566 raft_consensus.cc:2804] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election won for term 1
W20260923 19:50:18.236562 6137 leader_election.cc:343] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 6a2564a99c274e07a7e43da739a2458b
I20260923 19:50:18.236624 7566 raft_consensus.cc:697] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Becoming Leader. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Running, Role: LEADER
I20260923 19:50:18.236891 7566 consensus_queue.cc:237] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.237524 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2564a99c274e07a7e43da739a2458b" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:18.237704 6340 raft_consensus.cc:3060] T 6a2564a99c274e07a7e43da739a2458b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:18.240331 6456 tablet_bootstrap.cc:654] T c504ec668a33451fb1249f697bb5e2bb P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:18.241176 6340 raft_consensus.cc:2468] T 6a2564a99c274e07a7e43da739a2458b P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:18.241598 6139 leader_election.cc:304] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:18.242087 7591 raft_consensus.cc:2804] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:18.242230 7591 raft_consensus.cc:697] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:18.242487 7591 consensus_queue.cc:237] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.199977 6454 tablet_bootstrap.cc:492] T 35f46a1be80c4194b592c5d00fe1f342 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:18.244120 6454 ts_tablet_manager.cc:1403] T 35f46a1be80c4194b592c5d00fe1f342 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.114s user 0.002s sys 0.002s
I20260923 19:50:18.244906 6454 raft_consensus.cc:359] T 35f46a1be80c4194b592c5d00fe1f342 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.245252 6454 raft_consensus.cc:385] T 35f46a1be80c4194b592c5d00fe1f342 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:18.245345 6454 raft_consensus.cc:740] T 35f46a1be80c4194b592c5d00fe1f342 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:18.245607 6454 consensus_queue.cc:260] T 35f46a1be80c4194b592c5d00fe1f342 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.246163 6454 ts_tablet_manager.cc:1434] T 35f46a1be80c4194b592c5d00fe1f342 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:18.246552 6454 tablet_bootstrap.cc:492] T 0e123b69877e4b1fbcdb2b27960864e9 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:18.193797 6458 rpcz_store.cc:276] 0923 19:50:15.412734 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.416111 (+ 3377us) service_pool.cc:224] Handling call
0923 19:50:17.942380 (+2526269us) ts_tablet_manager.cc:1151] Deleting tablet 0d70deeda179486291195476e47a9ae6
0923 19:50:17.942565 (+ 185us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:18.060171 (+117606us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:18.192568 (+132397us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:18.193640 (+ 1072us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2519458}
I20260923 19:50:18.247507 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 0d70deeda179486291195476e47a9ae6 (table default.Table_e99b5d82a0814c538bfe455a29c4fa8e [id=d1e262e6e34742538b2b26c5fae80a99]) successfully deleted
I20260923 19:50:18.248418 6454 tablet_bootstrap.cc:654] T 0e123b69877e4b1fbcdb2b27960864e9 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:18.249735 7362 raft_consensus.cc:493] T 2398c59871d241f985bca1761e722180 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:18.249899 7362 raft_consensus.cc:515] T 2398c59871d241f985bca1761e722180 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.250520 7362 leader_election.cc:290] T 2398c59871d241f985bca1761e722180 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:18.251123 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398c59871d241f985bca1761e722180" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:18.251658 6280 leader_election.cc:343] T 2398c59871d241f985bca1761e722180 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:18.252664 5796 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 1c43641327d14a888a2815e49a2762c8 (table default.Table_6a56e4926a7b43d29a2cc015f69e8684 [id=923a67e6f6534f4da28ce819cecd9171]). Expected version 2 got 0
I20260923 19:50:18.253973 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398c59871d241f985bca1761e722180" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:18.254168 6059 raft_consensus.cc:2468] T 2398c59871d241f985bca1761e722180 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:18.254649 6279 leader_election.cc:304] T 2398c59871d241f985bca1761e722180 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:18.256575 5796 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 35f46a1be80c4194b592c5d00fe1f342 (table default.Table_f6755f452e8d41c4b9d64c3ee2735188 [id=d6a2d0fc236a4056b224d01249f045b0]). Expected version 1 got 0
I20260923 19:50:18.257669 7362 raft_consensus.cc:2804] T 2398c59871d241f985bca1761e722180 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:18.257753 7362 raft_consensus.cc:493] T 2398c59871d241f985bca1761e722180 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:18.257814 7362 raft_consensus.cc:3060] T 2398c59871d241f985bca1761e722180 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:18.260131 5802 catalog_manager.cc:5838] T ed9fb0cab0bd43b7a05d7376125b187e P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:18.260689 5802 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet ad29d22a82434023991ffcacf7f9bee5 (table default.Table_0eb28975495e4bedaf7c538454e525f6 [id=ea52a2330cd643e486e5b348dabbd295]). Expected version 1 got 0
I20260923 19:50:18.260776 7362 raft_consensus.cc:515] T 2398c59871d241f985bca1761e722180 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.261912 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398c59871d241f985bca1761e722180" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
W20260923 19:50:18.262471 6280 leader_election.cc:343] T 2398c59871d241f985bca1761e722180 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:18.262925 7362 leader_election.cc:290] T 2398c59871d241f985bca1761e722180 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:18.263470 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398c59871d241f985bca1761e722180" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:18.263650 6059 raft_consensus.cc:3060] T 2398c59871d241f985bca1761e722180 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:18.265648 6456 tablet_bootstrap.cc:492] T c504ec668a33451fb1249f697bb5e2bb P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:18.265777 6456 ts_tablet_manager.cc:1403] T c504ec668a33451fb1249f697bb5e2bb P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.031s user 0.006s sys 0.000s
I20260923 19:50:18.266441 6164 tablet_service.cc:1511] Processing CreateTablet for tablet 07781a6543ae4c7f9e8c25b3de8171a2 (DEFAULT_TABLE table=default.Table_a7ebf250a610449d84315e63c3d58522 [id=b2da3f9ec376464cb6a87a647a8764d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.266649 6456 raft_consensus.cc:359] T c504ec668a33451fb1249f697bb5e2bb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.266813 6456 raft_consensus.cc:385] T c504ec668a33451fb1249f697bb5e2bb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:18.266860 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07781a6543ae4c7f9e8c25b3de8171a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.266867 6456 raft_consensus.cc:740] T c504ec668a33451fb1249f697bb5e2bb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:18.267441 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 717101b8668f4cadb5180bb8e17939e9
I20260923 19:50:18.267534 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet e6e04d16675443fc923a5f8216e292b6
I20260923 19:50:18.268636 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet 717101b8668f4cadb5180bb8e17939e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:18.268862 6306 tablet_service.cc:1558] Processing DeleteTablet for tablet e6e04d16675443fc923a5f8216e292b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:18.269339 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f1842456992c4765924d809a3a062c07" } modify_external_catalogs: true
I20260923 19:50:18.269501 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f1842456992c4765924d809a3a062c07" } modify_external_catalogs: true
I20260923 19:50:18.270426 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet 717101b8668f4cadb5180bb8e17939e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:18.270833 6182 tablet_service.cc:1558] Processing DeleteTablet for tablet e6e04d16675443fc923a5f8216e292b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:18.272004 5801 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b72aa27a80014ace84053df8c32cf34f" } modify_external_catalogs: true
I20260923 19:50:18.272303 5801 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b72aa27a80014ace84053df8c32cf34f" } modify_external_catalogs: true
I20260923 19:50:18.267125 6456 consensus_queue.cc:260] T c504ec668a33451fb1249f697bb5e2bb P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.274009 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet e6e04d16675443fc923a5f8216e292b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:18.274195 6027 tablet_service.cc:1511] Processing CreateTablet for tablet 07781a6543ae4c7f9e8c25b3de8171a2 (DEFAULT_TABLE table=default.Table_a7ebf250a610449d84315e63c3d58522 [id=b2da3f9ec376464cb6a87a647a8764d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.274760 6059 raft_consensus.cc:2468] T 2398c59871d241f985bca1761e722180 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:18.275892 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07781a6543ae4c7f9e8c25b3de8171a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.278307 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet 717101b8668f4cadb5180bb8e17939e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:18.278303 6279 leader_election.cc:304] T 2398c59871d241f985bca1761e722180 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:18.278734 7490 raft_consensus.cc:2804] T 2398c59871d241f985bca1761e722180 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:18.278853 7490 raft_consensus.cc:697] T 2398c59871d241f985bca1761e722180 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:18.279101 7490 consensus_queue.cc:237] T 2398c59871d241f985bca1761e722180 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.280503 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 355b2fc61d4f4efd918204079f1ebf35
I20260923 19:50:18.280649 6182 tablet_service.cc:1511] Processing CreateTablet for tablet a2a793179a6a48cc9e9c2f0da9231416 (DEFAULT_TABLE table=default.Table_b57c902238674ae8bafb70e9cb0f65aa [id=d36e5399f9ff44c699d7654d40873a2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.281034 6182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2a793179a6a48cc9e9c2f0da9231416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.282114 6306 tablet_service.cc:1511] Processing CreateTablet for tablet 07781a6543ae4c7f9e8c25b3de8171a2 (DEFAULT_TABLE table=default.Table_a7ebf250a610449d84315e63c3d58522 [id=b2da3f9ec376464cb6a87a647a8764d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.282495 6306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07781a6543ae4c7f9e8c25b3de8171a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.284142 6029 tablet_service.cc:1511] Processing CreateTablet for tablet a2a793179a6a48cc9e9c2f0da9231416 (DEFAULT_TABLE table=default.Table_b57c902238674ae8bafb70e9cb0f65aa [id=d36e5399f9ff44c699d7654d40873a2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.285084 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 2d42fd1960e0421b8f0a756bd084b946 (DEFAULT_TABLE table=default.Table_095a7797fab845eeb9d72bad1309e2f4 [id=ec95088f76704f7bb58aded18cf57c0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.285427 5801 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet c462a9a5bde64e8094d7a2ca09740fc9
I20260923 19:50:18.286109 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet 355b2fc61d4f4efd918204079f1ebf35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:18.286345 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet 355b2fc61d4f4efd918204079f1ebf35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:18.286556 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet c462a9a5bde64e8094d7a2ca09740fc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:18.287792 6457 tablet_bootstrap.cc:492] T 0c537304c32c44adaa1e05de4496293f P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:18.288357 6457 ts_tablet_manager.cc:1403] T 0c537304c32c44adaa1e05de4496293f P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.120s user 0.004s sys 0.000s
I20260923 19:50:18.288573 6313 tablet_service.cc:1558] Processing DeleteTablet for tablet c462a9a5bde64e8094d7a2ca09740fc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:18.288710 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 377f4454d8c846e08d6207ceacf4797a (DEFAULT_TABLE table=default.Table_f5155af0d4e041c282bb316389c2275f [id=367d42260c81430a8796e6abaa84fecc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.288887 6322 tablet_service.cc:1511] Processing CreateTablet for tablet 2d42fd1960e0421b8f0a756bd084b946 (DEFAULT_TABLE table=default.Table_095a7797fab845eeb9d72bad1309e2f4 [id=ec95088f76704f7bb58aded18cf57c0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.289098 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 377f4454d8c846e08d6207ceacf4797a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.289503 6323 tablet_service.cc:1511] Processing CreateTablet for tablet a2a793179a6a48cc9e9c2f0da9231416 (DEFAULT_TABLE table=default.Table_b57c902238674ae8bafb70e9cb0f65aa [id=d36e5399f9ff44c699d7654d40873a2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.290107 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2a793179a6a48cc9e9c2f0da9231416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.291075 6457 raft_consensus.cc:359] T 0c537304c32c44adaa1e05de4496293f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.291704 6457 raft_consensus.cc:385] T 0c537304c32c44adaa1e05de4496293f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:18.291852 6457 raft_consensus.cc:740] T 0c537304c32c44adaa1e05de4496293f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:18.292598 6457 consensus_queue.cc:260] T 0c537304c32c44adaa1e05de4496293f P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.293458 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet c462a9a5bde64e8094d7a2ca09740fc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:18.293756 6165 tablet_service.cc:1511] Processing CreateTablet for tablet 2d42fd1960e0421b8f0a756bd084b946 (DEFAULT_TABLE table=default.Table_095a7797fab845eeb9d72bad1309e2f4 [id=ec95088f76704f7bb58aded18cf57c0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.293982 6322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d42fd1960e0421b8f0a756bd084b946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.294126 6165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d42fd1960e0421b8f0a756bd084b946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.294561 6457 ts_tablet_manager.cc:1434] T 0c537304c32c44adaa1e05de4496293f P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
W20260923 19:50:18.295102 7613 log.cc:927] Time spent T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430: Append to log took a long time: real 0.051s user 0.000s sys 0.000s
I20260923 19:50:18.297824 6180 tablet_service.cc:1511] Processing CreateTablet for tablet 377f4454d8c846e08d6207ceacf4797a (DEFAULT_TABLE table=default.Table_f5155af0d4e041c282bb316389c2275f [id=367d42260c81430a8796e6abaa84fecc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.298189 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 377f4454d8c846e08d6207ceacf4797a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.301815 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet 355b2fc61d4f4efd918204079f1ebf35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:18.303088 6313 tablet_service.cc:1511] Processing CreateTablet for tablet 2d8a5ec91fc84026aa31a41f4cca5d07 (DEFAULT_TABLE table=default.Table_52506d2d13c545bea0757f1a2802d817 [id=b7a6ad17fb56431da4a5d0baa871329a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.303469 6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d8a5ec91fc84026aa31a41f4cca5d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.303756 6166 tablet_service.cc:1511] Processing CreateTablet for tablet 2d8a5ec91fc84026aa31a41f4cca5d07 (DEFAULT_TABLE table=default.Table_52506d2d13c545bea0757f1a2802d817 [id=b7a6ad17fb56431da4a5d0baa871329a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.303910 6174 tablet_service.cc:1511] Processing CreateTablet for tablet 691e09f898e54902b42755e5c02fcb94 (DEFAULT_TABLE table=default.Table_60d05328969249e989f5118d456e8e21 [id=b52273cedbc64dc197d1136af5ab1b82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.304101 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d8a5ec91fc84026aa31a41f4cca5d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.304320 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 691e09f898e54902b42755e5c02fcb94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.304623 6307 tablet_service.cc:1511] Processing CreateTablet for tablet 5be96b04d4c742bb900346b7707634b9 (DEFAULT_TABLE table=default.Table_33eccae60b564266970bd8671c80df0c [id=08e6d87ba290487dad85aa5f4c478904]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.304965 6307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5be96b04d4c742bb900346b7707634b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.310165 6181 tablet_service.cc:1511] Processing CreateTablet for tablet 5be96b04d4c742bb900346b7707634b9 (DEFAULT_TABLE table=default.Table_33eccae60b564266970bd8671c80df0c [id=08e6d87ba290487dad85aa5f4c478904]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.310552 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5be96b04d4c742bb900346b7707634b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.317662 6461 tablet_replica.cc:333] T e6e04d16675443fc923a5f8216e292b6 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:18.317991 6461 raft_consensus.cc:2243] T e6e04d16675443fc923a5f8216e292b6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:18.318197 6461 raft_consensus.cc:2272] T e6e04d16675443fc923a5f8216e292b6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:18.318228 5802 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_cdf00b2482e94015ae5471906fbf2085" } new_table_name: "default.Table_1d212a8856d940d8898230b16d0e0aa2" modify_external_catalogs: true
I20260923 19:50:18.318888 6461 ts_tablet_manager.cc:1916] T e6e04d16675443fc923a5f8216e292b6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:18.321918 5796 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7d7ca8e644fb4245b276ecea1534ff91" } new_table_name: "default.Table_4c7beeb130604565858c166a2b4c4c53" modify_external_catalogs: true
I20260923 19:50:18.323788 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2a793179a6a48cc9e9c2f0da9231416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.323980 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d42fd1960e0421b8f0a756bd084b946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.327023 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 691e09f898e54902b42755e5c02fcb94 (DEFAULT_TABLE table=default.Table_60d05328969249e989f5118d456e8e21 [id=b52273cedbc64dc197d1136af5ab1b82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.327390 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 691e09f898e54902b42755e5c02fcb94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.329936 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_e81b9a7863b44739aebfd551dc96b551"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:18.330567 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e81b9a7863b44739aebfd551dc96b551 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:18.333164 6457 tablet_bootstrap.cc:492] T e1de117713f34b51bbda0c712f0b837c P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:18.334836 6457 tablet_bootstrap.cc:654] T e1de117713f34b51bbda0c712f0b837c P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:18.338097 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 2d8a5ec91fc84026aa31a41f4cca5d07 (DEFAULT_TABLE table=default.Table_52506d2d13c545bea0757f1a2802d817 [id=b7a6ad17fb56431da4a5d0baa871329a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.338461 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d8a5ec91fc84026aa31a41f4cca5d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.339871 6025 tablet_service.cc:1511] Processing CreateTablet for tablet 5be96b04d4c742bb900346b7707634b9 (DEFAULT_TABLE table=default.Table_33eccae60b564266970bd8671c80df0c [id=08e6d87ba290487dad85aa5f4c478904]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.340231 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5be96b04d4c742bb900346b7707634b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.341202 5797 catalog_manager.cc:5838] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193). New cstate: current_term: 1 leader_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: UNKNOWN } } }
I20260923 19:50:18.341607 5797 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet ad29d22a82434023991ffcacf7f9bee5 (table default.Table_0eb28975495e4bedaf7c538454e525f6 [id=ea52a2330cd643e486e5b348dabbd295]). Expected version 1 got 0
I20260923 19:50:18.344395 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_7a874d08526d43f6a0a3e37b65be3167"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:18.344974 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a874d08526d43f6a0a3e37b65be3167 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:18.345808 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_c8b250416a5b4e08a25804b2aea8c0f8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:18.346619 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8b250416a5b4e08a25804b2aea8c0f8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:18.350965 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_37fae96810d94ad084dc55119b52f9d6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:18.351519 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_37fae96810d94ad084dc55119b52f9d6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:18.353040 5802 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a53f2eb08330411ebe417d4e1e414db6 consensus state has no leader
I20260923 19:50:18.353410 5804 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f022376095554ea9a858fae27248e742" } modify_external_catalogs: true
I20260923 19:50:18.354018 5804 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f022376095554ea9a858fae27248e742" } modify_external_catalogs: true
I20260923 19:50:18.354291 6458 tablet_replica.cc:333] T 223edddace234a16b2d360504a99c28b P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:18.354524 6458 raft_consensus.cc:2243] T 223edddace234a16b2d360504a99c28b P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:18.354743 6458 raft_consensus.cc:2272] T 223edddace234a16b2d360504a99c28b P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:18.355402 6458 ts_tablet_manager.cc:1916] T 223edddace234a16b2d360504a99c28b P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:18.356509 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_8ae3676f12e14ee5a82935897324e9d6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:18.357187 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8ae3676f12e14ee5a82935897324e9d6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:18.358848 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 377f4454d8c846e08d6207ceacf4797a (DEFAULT_TABLE table=default.Table_f5155af0d4e041c282bb316389c2275f [id=367d42260c81430a8796e6abaa84fecc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.359237 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 377f4454d8c846e08d6207ceacf4797a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:18.362733 5796 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f28da30d48454ffd9626df789a2f2063 consensus state has no leader
I20260923 19:50:18.363505 5801 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_7d891deab94f4132b4358c6e4dfd54af [id=da91b06e11c64bb0aaec37a0188b5586] alter complete (version 4)
I20260923 19:50:18.363919 6027 tablet_service.cc:1511] Processing CreateTablet for tablet 691e09f898e54902b42755e5c02fcb94 (DEFAULT_TABLE table=default.Table_60d05328969249e989f5118d456e8e21 [id=b52273cedbc64dc197d1136af5ab1b82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.364418 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 691e09f898e54902b42755e5c02fcb94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.366729 6322 tablet_service.cc:1558] Processing DeleteTablet for tablet 15a9d1d4adaa402f90d774e77010c928 with delete_type TABLET_DATA_DELETED (replaced by tablet 1cf016ff0bb8418d84358d17876338bf) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:18.366961 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet c504ec668a33451fb1249f697bb5e2bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:18.374788 6456 ts_tablet_manager.cc:1434] T c504ec668a33451fb1249f697bb5e2bb P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.109s user 0.002s sys 0.000s
I20260923 19:50:18.375128 6456 tablet_bootstrap.cc:492] T a53f2eb08330411ebe417d4e1e414db6 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:18.377151 6456 tablet_bootstrap.cc:654] T a53f2eb08330411ebe417d4e1e414db6 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:18.378203 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_10a60aec581f467fb0c09e6585a852d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:18.378780 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10a60aec581f467fb0c09e6585a852d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:18.382742 7608 tablet.cc:1751] T 85d35ebef3c24a2e89233dd900b63513 P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260923 19:50:18.392226 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 1d905af116d9446ab001555014b2a2d2
W20260923 19:50:18.394204 5792 catalog_manager.cc:5136] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): alter failed for tablet b529b0e82c5b48edac54cc281ac4b4a6 (table default.Table_20e578ee9e57408c9a54cc2ac08af6e2 [id=ca73f0867b5d49cfb0bb7cd2315c47f2]),no further retry: Not found: Tablet not found: b529b0e82c5b48edac54cc281ac4b4a6
I20260923 19:50:18.396800 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_00f5789c01e94f8e8c65077f98b164c2" } new_table_name: "default.Table_053f0e613bb44662b6348691d23eae65" modify_external_catalogs: true
I20260923 19:50:18.398878 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_e48ab580d16248b1b302453b13b24af7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:18.399385 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e48ab580d16248b1b302453b13b24af7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:18.401360 5797 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ebf069e144a848b88e93d7b5e2eebac9" } new_table_name: "default.Table_eca08dbb70af4e91a7e58a26ee330b14" modify_external_catalogs: true
I20260923 19:50:18.403012 6454 tablet_bootstrap.cc:492] T 0e123b69877e4b1fbcdb2b27960864e9 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:18.403211 6454 ts_tablet_manager.cc:1403] T 0e123b69877e4b1fbcdb2b27960864e9 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.157s user 0.005s sys 0.001s
I20260923 19:50:18.404094 6454 raft_consensus.cc:359] T 0e123b69877e4b1fbcdb2b27960864e9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.404325 6454 raft_consensus.cc:385] T 0e123b69877e4b1fbcdb2b27960864e9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:18.404522 6454 raft_consensus.cc:740] T 0e123b69877e4b1fbcdb2b27960864e9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:18.405543 6454 consensus_queue.cc:260] T 0e123b69877e4b1fbcdb2b27960864e9 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.406276 5804 master_service.cc:960] ReplaceTablet: received request to replace tablet d5d3f96ebf1c4d05aceb06ef53737e4f from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:18.407224 6454 ts_tablet_manager.cc:1434] T 0e123b69877e4b1fbcdb2b27960864e9 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260923 19:50:18.414829 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e123b69877e4b1fbcdb2b27960864e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:18.421980 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d905af116d9446ab001555014b2a2d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:18.422963 6306 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d905af116d9446ab001555014b2a2d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:18.425014 6166 tablet_service.cc:1511] Processing CreateTablet for tablet 2264e12537ea4224bc75fafe2cf2f862 (DEFAULT_TABLE table=default.Table_da6325e1e8c2435883ac5b9710afe956 [id=7460c33253164c00bd5840e9945a27be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.425457 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2264e12537ea4224bc75fafe2cf2f862. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.429488 6459 ts_tablet_manager.cc:1929] T 18bab39d85f94f4283f0b18c1c9b48a2 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:18.430413 6457 tablet_bootstrap.cc:492] T e1de117713f34b51bbda0c712f0b837c P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:18.430639 6457 ts_tablet_manager.cc:1403] T e1de117713f34b51bbda0c712f0b837c P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.098s user 0.006s sys 0.001s
I20260923 19:50:18.430665 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_4d52ed9150ac42568c3fd0be274b49e0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:18.431241 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d52ed9150ac42568c3fd0be274b49e0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:18.431527 6457 raft_consensus.cc:359] T e1de117713f34b51bbda0c712f0b837c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.431704 6457 raft_consensus.cc:385] T e1de117713f34b51bbda0c712f0b837c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:18.431782 6457 raft_consensus.cc:740] T e1de117713f34b51bbda0c712f0b837c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:18.432060 6457 consensus_queue.cc:260] T e1de117713f34b51bbda0c712f0b837c P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.432533 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_8929125ac27f4ec0b64e59becd7c2027"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:18.432986 6457 ts_tablet_manager.cc:1434] T e1de117713f34b51bbda0c712f0b837c P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
W20260923 19:50:18.433137 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8929125ac27f4ec0b64e59becd7c2027 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:18.433346 6106 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
I20260923 19:50:18.434314 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_6dfb8074013b4f1ea483ee1f73af6dda"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:18.434928 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6dfb8074013b4f1ea483ee1f73af6dda in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:18.439921 6027 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c537304c32c44adaa1e05de4496293f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:18.446420 6306 tablet_service.cc:1511] Processing CreateTablet for tablet 2264e12537ea4224bc75fafe2cf2f862 (DEFAULT_TABLE table=default.Table_da6325e1e8c2435883ac5b9710afe956 [id=7460c33253164c00bd5840e9945a27be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.446841 6306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2264e12537ea4224bc75fafe2cf2f862. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.447546 6027 tablet_service.cc:1511] Processing CreateTablet for tablet 2264e12537ea4224bc75fafe2cf2f862 (DEFAULT_TABLE table=default.Table_da6325e1e8c2435883ac5b9710afe956 [id=7460c33253164c00bd5840e9945a27be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.447968 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2264e12537ea4224bc75fafe2cf2f862. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.452471 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_c249eef0ba2046fba3b52297ffb6d16c" } new_table_name: "default.Table_f7689828ca5b47309bff533ce9410d33" modify_external_catalogs: true
I20260923 19:50:18.453940 6034 tablet_service.cc:1511] Processing CreateTablet for tablet fa2f4219b66c4e0b99f9bfa55b1b2c87 (DEFAULT_TABLE table=default.Table_9873b1fe765149cd908dac5d4de14e46 [id=95714148dfad446a8dd587e828c9b8c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.454453 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa2f4219b66c4e0b99f9bfa55b1b2c87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.455313 6461 ts_tablet_manager.cc:1929] T e6e04d16675443fc923a5f8216e292b6 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:18.455427 6461 log.cc:1199] T e6e04d16675443fc923a5f8216e292b6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/e6e04d16675443fc923a5f8216e292b6
I20260923 19:50:18.455744 6461 ts_tablet_manager.cc:1950] T e6e04d16675443fc923a5f8216e292b6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:18.456699 6461 tablet_replica.cc:333] T 0c537304c32c44adaa1e05de4496293f P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:18.456894 6461 raft_consensus.cc:2243] T 0c537304c32c44adaa1e05de4496293f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:18.457052 6461 raft_consensus.cc:2272] T 0c537304c32c44adaa1e05de4496293f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:18.459966 5804 catalog_manager.cc:5838] T 2398c59871d241f985bca1761e722180 P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:18.463842 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet e6e04d16675443fc923a5f8216e292b6 (table default.Table_ea8c4179d37e4165869f5bf030971467 [id=5c206f48fb1a4be587f17803f654ce5a]) successfully deleted
I20260923 19:50:18.433353 6457 tablet_bootstrap.cc:492] T 684eb2576b4b4730813b993e36b242df P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
W20260923 19:50:18.464390 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 717101b8668f4cadb5180bb8e17939e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 717101b8668f4cadb5180bb8e17939e9 already in progress: creating tablet
W20260923 19:50:18.464828 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 355b2fc61d4f4efd918204079f1ebf35 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 355b2fc61d4f4efd918204079f1ebf35 already in progress: creating tablet
W20260923 19:50:18.465343 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet c462a9a5bde64e8094d7a2ca09740fc9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c462a9a5bde64e8094d7a2ca09740fc9 already in progress: creating tablet
I20260923 19:50:18.473240 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_e48ab580d16248b1b302453b13b24af7" } modify_external_catalogs: true
I20260923 19:50:18.473484 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_e48ab580d16248b1b302453b13b24af7" } modify_external_catalogs: true
I20260923 19:50:18.473549 5800 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_9f11e4333c1242e1bfd461bd7c79a6d7" } modify_external_catalogs: true
I20260923 19:50:18.473695 5800 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_9f11e4333c1242e1bfd461bd7c79a6d7" } modify_external_catalogs: true
W20260923 19:50:18.477465 5797 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e9a5f103a5bf406e97f1384b9968da96 consensus state has no leader
I20260923 19:50:18.481572 6456 tablet_bootstrap.cc:492] T a53f2eb08330411ebe417d4e1e414db6 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:18.481904 6459 log.cc:1199] T 18bab39d85f94f4283f0b18c1c9b48a2 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/18bab39d85f94f4283f0b18c1c9b48a2
I20260923 19:50:18.482625 5798 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f5155af0d4e041c282bb316389c2275f" } modify_external_catalogs: true
I20260923 19:50:18.482802 5798 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f5155af0d4e041c282bb316389c2275f" } modify_external_catalogs: true
I20260923 19:50:18.482743 6457 tablet_bootstrap.cc:654] T 684eb2576b4b4730813b993e36b242df P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:18.484099 6456 ts_tablet_manager.cc:1403] T a53f2eb08330411ebe417d4e1e414db6 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.109s user 0.003s sys 0.001s
I20260923 19:50:18.484962 6456 raft_consensus.cc:359] T a53f2eb08330411ebe417d4e1e414db6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.485443 6456 raft_consensus.cc:385] T a53f2eb08330411ebe417d4e1e414db6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:18.485634 6456 raft_consensus.cc:740] T a53f2eb08330411ebe417d4e1e414db6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:18.486008 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d905af116d9446ab001555014b2a2d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:18.441042 6454 tablet_bootstrap.cc:492] T 66739afdf147413787acb0363aa37df6 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:18.489598 6459 ts_tablet_manager.cc:1950] T 18bab39d85f94f4283f0b18c1c9b48a2 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:18.490393 6461 ts_tablet_manager.cc:1916] T 0c537304c32c44adaa1e05de4496293f P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:18.463495 6181 tablet_service.cc:1511] Processing CreateTablet for tablet fa2f4219b66c4e0b99f9bfa55b1b2c87 (DEFAULT_TABLE table=default.Table_9873b1fe765149cd908dac5d4de14e46 [id=95714148dfad446a8dd587e828c9b8c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.491597 5797 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_1d212a8856d940d8898230b16d0e0aa2" } modify_external_catalogs: true
I20260923 19:50:18.491797 5797 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_1d212a8856d940d8898230b16d0e0aa2" } modify_external_catalogs: true
I20260923 19:50:18.489605 6456 consensus_queue.cc:260] T a53f2eb08330411ebe417d4e1e414db6 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.493850 6458 ts_tablet_manager.cc:1929] T 223edddace234a16b2d360504a99c28b P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260923 19:50:18.498450 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet e1de117713f34b51bbda0c712f0b837c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:18.501255 6174 tablet_service.cc:1511] Processing CreateTablet for tablet 8c5ac79e5fa2438a87db948792d448b1 (DEFAULT_TABLE table=default.Table_4182e2a68072409081f00598f5232c5a [id=49efaa9081454324923363c7eb724a09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.502717 6166 tablet_service.cc:1511] Processing CreateTablet for tablet 1dbb9b8db3624128997858ff42d0c11f (DEFAULT_TABLE table=default.Table_0dc41b18f4d248faa5eb104b1f413442 [id=caa0783682334a5bba91e58264ba7b00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.504307 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 8c5ac79e5fa2438a87db948792d448b1 (DEFAULT_TABLE table=default.Table_4182e2a68072409081f00598f5232c5a [id=49efaa9081454324923363c7eb724a09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.505035 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c5ac79e5fa2438a87db948792d448b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.506048 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 1dbb9b8db3624128997858ff42d0c11f (DEFAULT_TABLE table=default.Table_0dc41b18f4d248faa5eb104b1f413442 [id=caa0783682334a5bba91e58264ba7b00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.511794 6457 tablet_bootstrap.cc:492] T 684eb2576b4b4730813b993e36b242df P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:18.512072 6457 ts_tablet_manager.cc:1403] T 684eb2576b4b4730813b993e36b242df P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.079s user 0.004s sys 0.000s
W20260923 19:50:18.513375 5805 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5f1a3b9bd2754a868908973cc79262e2 consensus state has no leader
I20260923 19:50:18.513571 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dbb9b8db3624128997858ff42d0c11f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.513378 6457 raft_consensus.cc:359] T 684eb2576b4b4730813b993e36b242df P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.513805 6457 raft_consensus.cc:385] T 684eb2576b4b4730813b993e36b242df P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:18.514001 6457 raft_consensus.cc:740] T 684eb2576b4b4730813b993e36b242df P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:18.514503 6457 consensus_queue.cc:260] T 684eb2576b4b4730813b993e36b242df P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.518316 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 806) took 1263 ms. Trace:
I20260923 19:50:18.518501 6459 rpcz_store.cc:276] 0923 19:50:17.255175 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:17.255319 (+ 144us) service_pool.cc:224] Handling call
0923 19:50:18.165033 (+909714us) ts_tablet_manager.cc:1151] Deleting tablet 18bab39d85f94f4283f0b18c1c9b48a2
0923 19:50:18.165041 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:18.409010 (+243969us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:18.429447 (+ 20437us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:18.518240 (+ 88793us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":909595}
I20260923 19:50:18.519289 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 807) took 1050 ms. Trace:
I20260923 19:50:18.519481 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 18bab39d85f94f4283f0b18c1c9b48a2 (table default.Table_a0bee41bcb2d439fb8619a6c19152813 [id=8a710c10b5ca42548116d743cb0812c3]) successfully deleted
I20260923 19:50:18.519423 6459 rpcz_store.cc:276] 0923 19:50:17.468487 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:17.469032 (+ 545us) service_pool.cc:224] Handling call
0923 19:50:18.519039 (+1050007us) ts_tablet_manager.cc:1151] Deleting tablet ca73c91b58954537af373face5ad2f67
0923 19:50:18.519049 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:18.519213 (+ 164us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1049796}
W20260923 19:50:18.519934 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet ca73c91b58954537af373face5ad2f67 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca73c91b58954537af373face5ad2f67 already in progress: creating tablet
I20260923 19:50:18.523047 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 808) took 1054 ms. Trace:
I20260923 19:50:18.523203 6459 rpcz_store.cc:276] 0923 19:50:17.468621 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:17.469278 (+ 657us) service_pool.cc:224] Handling call
0923 19:50:18.522850 (+1053572us) ts_tablet_manager.cc:1151] Deleting tablet d1258abcb244430ca8456ad146aa0e67
0923 19:50:18.522862 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:18.522991 (+ 129us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1053400}
W20260923 19:50:18.523810 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet d1258abcb244430ca8456ad146aa0e67 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1258abcb244430ca8456ad146aa0e67 already in progress: creating tablet
I20260923 19:50:18.524174 6459 tablet_replica.cc:333] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:18.524672 6459 raft_consensus.cc:2243] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:18.525149 6459 pending_rounds.cc:70] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:18.525269 6459 pending_rounds.cc:77] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630599157714944 op_type: NO_OP noop_request { }
I20260923 19:50:18.525477 6459 raft_consensus.cc:2889] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:18.525705 6459 raft_consensus.cc:2272] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:18.526881 5796 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 6c663348a7bd40d28386baa4be64d9b7
I20260923 19:50:18.526629 6457 ts_tablet_manager.cc:1434] T 684eb2576b4b4730813b993e36b242df P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260923 19:50:18.528926 6025 tablet_service.cc:1558] Processing DeleteTablet for tablet 684eb2576b4b4730813b993e36b242df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:18.534384 6457 tablet_bootstrap.cc:492] T a10d35bf564d45488524d3d21721f4e5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:18.536146 6165 tablet_service.cc:1511] Processing CreateTablet for tablet 4d5da49e63c14afea85949915c50af99 (DEFAULT_TABLE table=default.Table_03428c96fc774fd9921788967964ed5a [id=b1770a362d8846728e2b7ba76ddb0a22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.537330 6025 tablet_service.cc:1511] Processing CreateTablet for tablet 4d5da49e63c14afea85949915c50af99 (DEFAULT_TABLE table=default.Table_03428c96fc774fd9921788967964ed5a [id=b1770a362d8846728e2b7ba76ddb0a22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.537684 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d5da49e63c14afea85949915c50af99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.541275 6182 tablet_service.cc:1511] Processing CreateTablet for tablet df2b2d1c61344203be4bedbb71e699c2 (DEFAULT_TABLE table=default.Table_37285845f6354f36bb1f2c008dd28922 [id=e3aa89515b94474a989ad2b1c52975ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.541695 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 55607f0a082c4a8abe2746eb9fbf66df (DEFAULT_TABLE table=default.Table_5933ddc6cf2343c2a39ead3bd433f063 [id=6ccdcf3c8e924011bec3b0ef610306e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.542034 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55607f0a082c4a8abe2746eb9fbf66df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.543002 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa2f4219b66c4e0b99f9bfa55b1b2c87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.543720 6165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d5da49e63c14afea85949915c50af99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.543123 6180 tablet_service.cc:1511] Processing CreateTablet for tablet 55607f0a082c4a8abe2746eb9fbf66df (DEFAULT_TABLE table=default.Table_5933ddc6cf2343c2a39ead3bd433f063 [id=6ccdcf3c8e924011bec3b0ef610306e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.544023 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c5ac79e5fa2438a87db948792d448b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.543550 6024 tablet_service.cc:1511] Processing CreateTablet for tablet df2b2d1c61344203be4bedbb71e699c2 (DEFAULT_TABLE table=default.Table_37285845f6354f36bb1f2c008dd28922 [id=e3aa89515b94474a989ad2b1c52975ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.544377 6182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df2b2d1c61344203be4bedbb71e699c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.544495 5800 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 2c6b2e4dac9749e58d01a838c2472bbc
I20260923 19:50:18.545461 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c6b2e4dac9749e58d01a838c2472bbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:18.545557 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dbb9b8db3624128997858ff42d0c11f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.549844 6457 tablet_bootstrap.cc:654] T a10d35bf564d45488524d3d21721f4e5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:18.550778 6024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df2b2d1c61344203be4bedbb71e699c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.554432 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 377f4454d8c846e08d6207ceacf4797a
I20260923 19:50:18.555146 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet 377f4454d8c846e08d6207ceacf4797a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:18.557688 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_10049cc67e6841259815c979fd9bad48"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:18.558259 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10049cc67e6841259815c979fd9bad48 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:18.565160 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a6baec3d4ff94a14a032737c8ae498ef" } new_table_name: "default.Table_81913ff2a1fe405ea3487507f13f7f6a" modify_external_catalogs: true
I20260923 19:50:18.567215 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet a53f2eb08330411ebe417d4e1e414db6
I20260923 19:50:18.567912 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet a53f2eb08330411ebe417d4e1e414db6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:18.571974 5804 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_118d48fa59bb4a43a18182adeab5ca66" } new_table_name: "default.Table_0158dbcf5a774d1d94e43e1eda699b75" modify_external_catalogs: true
I20260923 19:50:18.577579 6458 log.cc:1199] T 223edddace234a16b2d360504a99c28b P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/223edddace234a16b2d360504a99c28b
I20260923 19:50:18.579274 6458 ts_tablet_manager.cc:1950] T 223edddace234a16b2d360504a99c28b P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:18.579758 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_87982e7afa2e42a58c2ac6ec233bb411"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:18.580605 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_87982e7afa2e42a58c2ac6ec233bb411 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:18.581074 7587 tablet.cc:1751] T ec4284d6a0fa416ca95b4d675c8e3912 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:18.496932 6456 ts_tablet_manager.cc:1434] T a53f2eb08330411ebe417d4e1e414db6 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260923 19:50:18.498971 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 1dbb9b8db3624128997858ff42d0c11f (DEFAULT_TABLE table=default.Table_0dc41b18f4d248faa5eb104b1f413442 [id=caa0783682334a5bba91e58264ba7b00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.502147 6313 tablet_service.cc:1511] Processing CreateTablet for tablet 8c5ac79e5fa2438a87db948792d448b1 (DEFAULT_TABLE table=default.Table_4182e2a68072409081f00598f5232c5a [id=49efaa9081454324923363c7eb724a09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.491156 6306 tablet_service.cc:1511] Processing CreateTablet for tablet fa2f4219b66c4e0b99f9bfa55b1b2c87 (DEFAULT_TABLE table=default.Table_9873b1fe765149cd908dac5d4de14e46 [id=95714148dfad446a8dd587e828c9b8c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.538455 6307 tablet_service.cc:1511] Processing CreateTablet for tablet 4d5da49e63c14afea85949915c50af99 (DEFAULT_TABLE table=default.Table_03428c96fc774fd9921788967964ed5a [id=b1770a362d8846728e2b7ba76ddb0a22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.582290 7608 tablet.cc:1751] T ec4284d6a0fa416ca95b4d675c8e3912 P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:18.540087 6323 tablet_service.cc:1511] Processing CreateTablet for tablet 55607f0a082c4a8abe2746eb9fbf66df (DEFAULT_TABLE table=default.Table_5933ddc6cf2343c2a39ead3bd433f063 [id=6ccdcf3c8e924011bec3b0ef610306e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.546622 6322 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c6b2e4dac9749e58d01a838c2472bbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:18.555995 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet 377f4454d8c846e08d6207ceacf4797a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:18.569257 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet a53f2eb08330411ebe417d4e1e414db6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:18.591840 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55607f0a082c4a8abe2746eb9fbf66df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.598124 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_f6c8d3b2c3bc4486a54aecf1753705b5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:18.598325 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c6b2e4dac9749e58d01a838c2472bbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:18.598539 6025 tablet_service.cc:1558] Processing DeleteTablet for tablet a53f2eb08330411ebe417d4e1e414db6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:18.598738 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f6c8d3b2c3bc4486a54aecf1753705b5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:18.598948 6454 tablet_bootstrap.cc:654] T 66739afdf147413787acb0363aa37df6 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:18.600538 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3f1f46ea8b894c8693ecf2d752e2507e consensus state has no leader
I20260923 19:50:18.605216 6459 ts_tablet_manager.cc:1916] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:18.606550 6457 tablet_bootstrap.cc:492] T a10d35bf564d45488524d3d21721f4e5 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:18.606695 6457 ts_tablet_manager.cc:1403] T a10d35bf564d45488524d3d21721f4e5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.073s user 0.003s sys 0.002s
I20260923 19:50:18.607352 6324 tablet_service.cc:1511] Processing CreateTablet for tablet df2b2d1c61344203be4bedbb71e699c2 (DEFAULT_TABLE table=default.Table_37285845f6354f36bb1f2c008dd28922 [id=e3aa89515b94474a989ad2b1c52975ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.608021 6181 tablet_service.cc:1511] Processing CreateTablet for tablet ab81b40554e2411780ecfe12ef4a8f7d (DEFAULT_TABLE table=default.Table_57f19c72a7cd4e4d8288370ebcb5c9db [id=74308c78fb8949c4b76b33b89119799e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.608481 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab81b40554e2411780ecfe12ef4a8f7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.610571 6024 tablet_service.cc:1558] Processing DeleteTablet for tablet 377f4454d8c846e08d6207ceacf4797a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:18.613915 5797 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_0e8b64b05f104a458762900a86b66629" } modify_external_catalogs: true
I20260923 19:50:18.614096 5797 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_0e8b64b05f104a458762900a86b66629" } modify_external_catalogs: true
I20260923 19:50:18.616127 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 721) took 3203 ms. Trace:
I20260923 19:50:18.616257 6458 rpcz_store.cc:276] 0923 19:50:15.412611 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.423094 (+ 10483us) service_pool.cc:224] Handling call
0923 19:50:18.354215 (+2931121us) ts_tablet_manager.cc:1151] Deleting tablet 223edddace234a16b2d360504a99c28b
0923 19:50:18.354230 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:18.436027 (+ 81797us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:18.493800 (+ 57773us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:18.616081 (+122281us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2930955}
I20260923 19:50:18.616536 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_587300eb5ddd4e2f9227cd18c6691ff7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:18.617100 6458 tablet_replica.cc:333] T 66739afdf147413787acb0363aa37df6 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
W20260923 19:50:18.617116 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_587300eb5ddd4e2f9227cd18c6691ff7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:18.617388 6458 raft_consensus.cc:2243] T 66739afdf147413787acb0363aa37df6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:18.617609 6458 raft_consensus.cc:2272] T 66739afdf147413787acb0363aa37df6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:18.618216 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_b2f1f40fddb3415583705da88451978d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:18.618297 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_bc1d6b30c09142929d85e4cc6da64601"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:18.618433 6458 ts_tablet_manager.cc:1916] T 66739afdf147413787acb0363aa37df6 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:18.618675 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bc1d6b30c09142929d85e4cc6da64601 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:18.618681 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2f1f40fddb3415583705da88451978d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:18.620479 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 223edddace234a16b2d360504a99c28b (table default.Table_4b2190aa0f324c3987e02081e95555e4 [id=ed438085f7054d9993a39852df4cc790]) successfully deleted
W20260923 19:50:18.622464 5804 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dadb3ab2082b4f749182b0616cf6e8f5 consensus state has no leader
I20260923 19:50:18.624665 6456 tablet_bootstrap.cc:492] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:18.625075 6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c5ac79e5fa2438a87db948792d448b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.626036 6456 tablet_bootstrap.cc:654] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:18.629796 6457 raft_consensus.cc:359] T a10d35bf564d45488524d3d21721f4e5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.629974 6457 raft_consensus.cc:385] T a10d35bf564d45488524d3d21721f4e5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:18.630024 6457 raft_consensus.cc:740] T a10d35bf564d45488524d3d21721f4e5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:18.630266 6457 consensus_queue.cc:260] T a10d35bf564d45488524d3d21721f4e5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.630792 6457 ts_tablet_manager.cc:1434] T a10d35bf564d45488524d3d21721f4e5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.024s user 0.002s sys 0.000s
I20260923 19:50:18.631156 6454 tablet_bootstrap.cc:492] T 66739afdf147413787acb0363aa37df6 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:18.631285 6454 ts_tablet_manager.cc:1403] T 66739afdf147413787acb0363aa37df6 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.190s user 0.004s sys 0.001s
I20260923 19:50:18.632463 6311 tablet_service.cc:1511] Processing CreateTablet for tablet ab81b40554e2411780ecfe12ef4a8f7d (DEFAULT_TABLE table=default.Table_57f19c72a7cd4e4d8288370ebcb5c9db [id=74308c78fb8949c4b76b33b89119799e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.632812 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab81b40554e2411780ecfe12ef4a8f7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.632794 6454 raft_consensus.cc:359] T 66739afdf147413787acb0363aa37df6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.632957 6454 raft_consensus.cc:385] T 66739afdf147413787acb0363aa37df6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:18.633020 6454 raft_consensus.cc:740] T 66739afdf147413787acb0363aa37df6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:18.633208 6454 consensus_queue.cc:260] T 66739afdf147413787acb0363aa37df6 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.633364 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 6c33a99f88a9401fa296c4fefb8bcfc1
I20260923 19:50:18.634268 6322 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c33a99f88a9401fa296c4fefb8bcfc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:18.637079 6454 ts_tablet_manager.cc:1434] T 66739afdf147413787acb0363aa37df6 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260923 19:50:18.637691 6454 tablet_bootstrap.cc:492] T d09faa67bdc54d31a7f7a1b012de9ba1 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:18.639151 6306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa2f4219b66c4e0b99f9bfa55b1b2c87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.641637 6174 tablet_service.cc:1511] Processing CreateTablet for tablet 0c2890033a1f4204b954911dd8fe3dfb (DEFAULT_TABLE table=default.Table_1ddcefc310ff4feca41bc3475393eac1 [id=ca880cac23b04b72b249e059e7077ed6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.642071 6307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d5da49e63c14afea85949915c50af99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.642241 6454 tablet_bootstrap.cc:654] T d09faa67bdc54d31a7f7a1b012de9ba1 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:18.642274 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df2b2d1c61344203be4bedbb71e699c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.642570 7602 raft_consensus.cc:493] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:18.642688 7602 raft_consensus.cc:515] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.643224 7602 leader_election.cc:290] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:18.643724 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c012b2a92dc14f2ab5d9f4fe8a6a7779" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:18.644194 6280 leader_election.cc:343] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:18.645967 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55607f0a082c4a8abe2746eb9fbf66df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.649966 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c2890033a1f4204b954911dd8fe3dfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.653759 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dbb9b8db3624128997858ff42d0c11f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.654560 6454 tablet_bootstrap.cc:492] T d09faa67bdc54d31a7f7a1b012de9ba1 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:18.654731 6454 ts_tablet_manager.cc:1403] T d09faa67bdc54d31a7f7a1b012de9ba1 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.017s user 0.009s sys 0.000s
I20260923 19:50:18.655553 6454 raft_consensus.cc:359] T d09faa67bdc54d31a7f7a1b012de9ba1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.655814 6454 raft_consensus.cc:385] T d09faa67bdc54d31a7f7a1b012de9ba1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:18.655922 6454 raft_consensus.cc:740] T d09faa67bdc54d31a7f7a1b012de9ba1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:18.656217 6454 consensus_queue.cc:260] T d09faa67bdc54d31a7f7a1b012de9ba1 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.656881 6454 ts_tablet_manager.cc:1434] T d09faa67bdc54d31a7f7a1b012de9ba1 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:18.657194 6454 tablet_bootstrap.cc:492] T 12f4abb573bd4be6961b55c27c684d06 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:18.658325 6182 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c33a99f88a9401fa296c4fefb8bcfc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:18.658910 6454 tablet_bootstrap.cc:654] T 12f4abb573bd4be6961b55c27c684d06 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:18.662444 6025 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c33a99f88a9401fa296c4fefb8bcfc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:18.666177 6024 tablet_service.cc:1511] Processing CreateTablet for tablet ab81b40554e2411780ecfe12ef4a8f7d (DEFAULT_TABLE table=default.Table_57f19c72a7cd4e4d8288370ebcb5c9db [id=74308c78fb8949c4b76b33b89119799e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.667356 6024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab81b40554e2411780ecfe12ef4a8f7d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:18.671075 6279 leader_election.cc:343] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: c012b2a92dc14f2ab5d9f4fe8a6a7779
I20260923 19:50:18.671212 6279 leader_election.cc:304] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:18.671679 7256 raft_consensus.cc:2749] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:18.673003 6025 tablet_service.cc:1511] Processing CreateTablet for tablet 0c2890033a1f4204b954911dd8fe3dfb (DEFAULT_TABLE table=default.Table_1ddcefc310ff4feca41bc3475393eac1 [id=ca880cac23b04b72b249e059e7077ed6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.673164 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet a10d35bf564d45488524d3d21721f4e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:18.673367 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c2890033a1f4204b954911dd8fe3dfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.675056 6323 tablet_service.cc:1511] Processing CreateTablet for tablet 5e1acdba2fb44609a0ac0cd296e95c44 (DEFAULT_TABLE table=default.Table_64a90e659c564472a7b8ff265be1cea8 [id=cceabba3d3fa489e96239ed96d8908b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.675415 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e1acdba2fb44609a0ac0cd296e95c44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.678562 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_be2d57dc97394f3a9f8b723a664793ff" } new_table_name: "default.Table_c58f36e09d464c3fb0a88f2a5aef1b25" modify_external_catalogs: true
I20260923 19:50:18.684608 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_f4be4141550e453789b0f2db9e3b41f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:18.685189 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4be4141550e453789b0f2db9e3b41f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:18.686350 5796 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_2e5272f3f9b443fbbbb342873d0065b6" } new_table_name: "default.Table_7e24cd84eb8e40fd83840f7e674b4393" modify_external_catalogs: true
I20260923 19:50:18.693446 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_ac60821f06524a51b2ed9bcfa142bb9d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:18.694160 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac60821f06524a51b2ed9bcfa142bb9d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:18.698412 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_ea4cde6ff2da418aa42fc25013dbfa0e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:18.699060 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea4cde6ff2da418aa42fc25013dbfa0e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:18.700714 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_7a5a122018e24c8892027c5bf26c4ee8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:18.701143 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a5a122018e24c8892027c5bf26c4ee8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:18.701318 6323 tablet_service.cc:1511] Processing CreateTablet for tablet d1d85df84f2245ccb99c1f810fed270a (DEFAULT_TABLE table=default.Table_495d1f81e9a94fa4b7a63f4df12aa190 [id=f5e004ae7e9948a596bc6c11db469fae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.701719 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1d85df84f2245ccb99c1f810fed270a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:18.702440 6280 consensus_peers.cc:597] T ed9fb0cab0bd43b7a05d7376125b187e P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:18.702822 6166 tablet_service.cc:1511] Processing CreateTablet for tablet d1d85df84f2245ccb99c1f810fed270a (DEFAULT_TABLE table=default.Table_495d1f81e9a94fa4b7a63f4df12aa190 [id=f5e004ae7e9948a596bc6c11db469fae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.703209 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1d85df84f2245ccb99c1f810fed270a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.705143 5798 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_053f0e613bb44662b6348691d23eae65 [id=29a38060f3bf43f3900ad0ee42fbde9a] alter complete (version 2)
W20260923 19:50:18.705485 5796 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3ad17f4d65784842a4dd2f5a5d06393a consensus state has no leader
W20260923 19:50:18.706835 5800 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 242a63d6282f435aa94fb4307c15ca8a consensus state has no leader
I20260923 19:50:18.710646 5802 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 8d87f05f29bd476386ff6516676ce31a (table default.Table_9fa8f8bfc6124f398a4acdf5e1e0b33a [id=02d2ab56def342c482c86ce96110342f]). Expected version 1 got 0
I20260923 19:50:18.714437 6180 tablet_service.cc:1558] Processing DeleteTablet for tablet 66739afdf147413787acb0363aa37df6 with delete_type TABLET_DATA_DELETED (replaced by tablet e4ad9baac560463fabc80828074b46c1) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:18.714686 6165 tablet_service.cc:1558] Processing DeleteTablet for tablet d09faa67bdc54d31a7f7a1b012de9ba1 with delete_type TABLET_DATA_DELETED (replaced by tablet 146a402ff29a4e0b834a9f270d61e21c) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:18.715355 6182 tablet_service.cc:1511] Processing CreateTablet for tablet 5e1acdba2fb44609a0ac0cd296e95c44 (DEFAULT_TABLE table=default.Table_64a90e659c564472a7b8ff265be1cea8 [id=cceabba3d3fa489e96239ed96d8908b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.715736 6182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e1acdba2fb44609a0ac0cd296e95c44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.718101 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_22eef68f3e1e499db53058abaf7b3fab" } new_table_name: "default.Table_42710edebf0e439ba99e3c85c82be9f4" modify_external_catalogs: true
I20260923 19:50:18.720716 6313 tablet_service.cc:1511] Processing CreateTablet for tablet 0c2890033a1f4204b954911dd8fe3dfb (DEFAULT_TABLE table=default.Table_1ddcefc310ff4feca41bc3475393eac1 [id=ca880cac23b04b72b249e059e7077ed6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.721205 6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c2890033a1f4204b954911dd8fe3dfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.725050 6174 tablet_service.cc:1511] Processing CreateTablet for tablet 17ce050f2db24708b4d96316e3da7478 (DEFAULT_TABLE table=default.Table_c40ca6fb16fc44fca87eec30e15b47d0 [id=2cd51a2c75e24d189fd4a888187e60e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.726739 7566 raft_consensus.cc:493] T d39a64531dd24eb4aa1f7e0c418b985b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:18.726933 6461 ts_tablet_manager.cc:1929] T 0c537304c32c44adaa1e05de4496293f P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:18.726917 7566 raft_consensus.cc:515] T d39a64531dd24eb4aa1f7e0c418b985b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.727087 6461 log.cc:1199] T 0c537304c32c44adaa1e05de4496293f P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/0c537304c32c44adaa1e05de4496293f
I20260923 19:50:18.727456 6461 ts_tablet_manager.cc:1950] T 0c537304c32c44adaa1e05de4496293f P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:18.727608 7566 leader_election.cc:290] T d39a64531dd24eb4aa1f7e0c418b985b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:18.728106 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d39a64531dd24eb4aa1f7e0c418b985b" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:18.728570 6461 tablet_replica.cc:333] T e1de117713f34b51bbda0c712f0b837c P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
W20260923 19:50:18.728602 5996 leader_election.cc:343] T d39a64531dd24eb4aa1f7e0c418b985b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:18.729029 6461 raft_consensus.cc:2243] T e1de117713f34b51bbda0c712f0b837c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:18.729708 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_17d1d2de473849f79d13c8d52085d52b" } modify_external_catalogs: true
I20260923 19:50:18.729969 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_17d1d2de473849f79d13c8d52085d52b" } modify_external_catalogs: true
I20260923 19:50:18.730486 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d39a64531dd24eb4aa1f7e0c418b985b" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:18.731082 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 0c537304c32c44adaa1e05de4496293f (table default.Table_5febe26a78884634a01aa0ec62f36604 [id=e2a29fc060074c45918b97001dd03207]) successfully deleted
I20260923 19:50:18.731540 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17ce050f2db24708b4d96316e3da7478. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.731602 6025 tablet_service.cc:1511] Processing CreateTablet for tablet 5e1acdba2fb44609a0ac0cd296e95c44 (DEFAULT_TABLE table=default.Table_64a90e659c564472a7b8ff265be1cea8 [id=cceabba3d3fa489e96239ed96d8908b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.732018 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e1acdba2fb44609a0ac0cd296e95c44. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:18.735273 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 1d905af116d9446ab001555014b2a2d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d905af116d9446ab001555014b2a2d2 already in progress: creating tablet
W20260923 19:50:18.735905 5995 leader_election.cc:343] T d39a64531dd24eb4aa1f7e0c418b985b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:18.736141 5995 leader_election.cc:304] T d39a64531dd24eb4aa1f7e0c418b985b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:18.736467 7566 raft_consensus.cc:2749] T d39a64531dd24eb4aa1f7e0c418b985b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:18.736507 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 17ce050f2db24708b4d96316e3da7478 (DEFAULT_TABLE table=default.Table_c40ca6fb16fc44fca87eec30e15b47d0 [id=2cd51a2c75e24d189fd4a888187e60e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.736861 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17ce050f2db24708b4d96316e3da7478. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.739353 6457 tablet_bootstrap.cc:492] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:18.741353 6457 tablet_bootstrap.cc:654] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:18.743093 6165 tablet_service.cc:1511] Processing CreateTablet for tablet 344d1ee75b2e44f2a19a9b70175b9862 (DEFAULT_TABLE table=default.Table_07aaf9a4da6443b482d23a3267f97a0a [id=1e41bd291f1d4c62b17cd8419eb61d9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.743517 6165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 344d1ee75b2e44f2a19a9b70175b9862. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.744907 6034 tablet_service.cc:1511] Processing CreateTablet for tablet d1d85df84f2245ccb99c1f810fed270a (DEFAULT_TABLE table=default.Table_495d1f81e9a94fa4b7a63f4df12aa190 [id=f5e004ae7e9948a596bc6c11db469fae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.745262 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1d85df84f2245ccb99c1f810fed270a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.750339 6027 tablet_service.cc:1511] Processing CreateTablet for tablet 344d1ee75b2e44f2a19a9b70175b9862 (DEFAULT_TABLE table=default.Table_07aaf9a4da6443b482d23a3267f97a0a [id=1e41bd291f1d4c62b17cd8419eb61d9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.750679 6457 tablet_bootstrap.cc:492] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:18.750770 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 344d1ee75b2e44f2a19a9b70175b9862. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.750882 6457 ts_tablet_manager.cc:1403] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.000s
I20260923 19:50:18.751060 6324 tablet_service.cc:1511] Processing CreateTablet for tablet 344d1ee75b2e44f2a19a9b70175b9862 (DEFAULT_TABLE table=default.Table_07aaf9a4da6443b482d23a3267f97a0a [id=1e41bd291f1d4c62b17cd8419eb61d9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.751420 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 344d1ee75b2e44f2a19a9b70175b9862. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.751739 6457 raft_consensus.cc:359] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:18.751984 6457 raft_consensus.cc:385] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:18.752110 6457 raft_consensus.cc:740] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:18.752441 6457 consensus_queue.cc:260] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:18.755153 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 17ce050f2db24708b4d96316e3da7478 (DEFAULT_TABLE table=default.Table_c40ca6fb16fc44fca87eec30e15b47d0 [id=2cd51a2c75e24d189fd4a888187e60e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.755453 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17ce050f2db24708b4d96316e3da7478. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.764108 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_289a14904b5c40c589dd9edaefd30fb2" } modify_external_catalogs: true
I20260923 19:50:18.764295 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_289a14904b5c40c589dd9edaefd30fb2" } modify_external_catalogs: true
I20260923 19:50:18.766062 5804 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_fe9e363eed7f4a9d8c22168528b69faa" } modify_external_catalogs: true
I20260923 19:50:18.766156 6165 tablet_service.cc:1511] Processing CreateTablet for tablet 75958985ee414a5a9907ec0c7dece252 (DEFAULT_TABLE table=default.Table_105f26b7d508479ab5114c279aca4dfb [id=7eee19aa1d0348e08accd2764d2cfdce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.766232 5804 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_fe9e363eed7f4a9d8c22168528b69faa" } modify_external_catalogs: true
I20260923 19:50:18.766597 6165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75958985ee414a5a9907ec0c7dece252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.767529 6324 tablet_service.cc:1511] Processing CreateTablet for tablet 75958985ee414a5a9907ec0c7dece252 (DEFAULT_TABLE table=default.Table_105f26b7d508479ab5114c279aca4dfb [id=7eee19aa1d0348e08accd2764d2cfdce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.767905 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75958985ee414a5a9907ec0c7dece252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.771347 5798 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_aa2654e8c2db467ab317ae37cf1985aa" } modify_external_catalogs: true
I20260923 19:50:18.771507 5798 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_aa2654e8c2db467ab317ae37cf1985aa" } modify_external_catalogs: true
I20260923 19:50:18.778700 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_ed0607fb34e24f6793003de00c2f4e8a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:18.779269 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed0607fb34e24f6793003de00c2f4e8a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:18.779911 7627 tablet.cc:1751] T ec4284d6a0fa416ca95b4d675c8e3912 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:18.783185 6456 tablet_bootstrap.cc:492] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:18.783411 6456 ts_tablet_manager.cc:1403] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.159s user 0.004s sys 0.006s
I20260923 19:50:18.784380 7591 raft_consensus.cc:493] T 0e123b69877e4b1fbcdb2b27960864e9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:18.784499 7591 raft_consensus.cc:515] T 0e123b69877e4b1fbcdb2b27960864e9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.785059 7591 leader_election.cc:290] T 0e123b69877e4b1fbcdb2b27960864e9 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:18.785914 6461 raft_consensus.cc:2272] T e1de117713f34b51bbda0c712f0b837c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:18.786164 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e123b69877e4b1fbcdb2b27960864e9" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:18.786331 6340 raft_consensus.cc:2468] T 0e123b69877e4b1fbcdb2b27960864e9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
W20260923 19:50:18.786387 7566 raft_consensus.cc:670] T e1de117713f34b51bbda0c712f0b837c P e546f660e7e541d1aa9ae38e5ee5b9c0: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopped
I20260923 19:50:18.786720 6139 leader_election.cc:304] T 0e123b69877e4b1fbcdb2b27960864e9 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:18.786949 7591 raft_consensus.cc:2804] T 0e123b69877e4b1fbcdb2b27960864e9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:18.787011 7591 raft_consensus.cc:493] T 0e123b69877e4b1fbcdb2b27960864e9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:18.787081 7591 raft_consensus.cc:3060] T 0e123b69877e4b1fbcdb2b27960864e9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:18.789673 7591 raft_consensus.cc:515] T 0e123b69877e4b1fbcdb2b27960864e9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.729050 6459 ts_tablet_manager.cc:1929] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:18.789953 6459 log.cc:1199] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/b92aaac328934d95a89e0fc08a80b0b1
W20260923 19:50:18.790056 6137 leader_election.cc:343] T 0e123b69877e4b1fbcdb2b27960864e9 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 0e123b69877e4b1fbcdb2b27960864e9
I20260923 19:50:18.790383 6459 ts_tablet_manager.cc:1950] T b92aaac328934d95a89e0fc08a80b0b1 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:18.790678 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 809) took 1321 ms. Trace:
I20260923 19:50:18.790736 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e123b69877e4b1fbcdb2b27960864e9" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:18.790884 6340 raft_consensus.cc:3060] T 0e123b69877e4b1fbcdb2b27960864e9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:18.790792 6459 rpcz_store.cc:276] 0923 19:50:17.468748 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:17.469436 (+ 688us) service_pool.cc:224] Handling call
0923 19:50:18.524068 (+1054632us) ts_tablet_manager.cc:1151] Deleting tablet b92aaac328934d95a89e0fc08a80b0b1
0923 19:50:18.524076 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:18.629778 (+105702us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:18.728973 (+ 99195us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:18.790661 (+ 61688us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1054502}
I20260923 19:50:18.791275 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet b92aaac328934d95a89e0fc08a80b0b1 (table default.Table_9bd23e83d2144f82a8487f44b70458fc [id=93b330743f8d47f2b3e06f43ec3658b2]) successfully deleted
I20260923 19:50:18.791559 6459 tablet_replica.cc:333] T c0ff8838ab17433ab733d3b293d4964f P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:18.791555 5805 master_service.cc:960] ReplaceTablet: received request to replace tablet 6393303f6d664fe3bbc9c9052cd0b717 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:18.791729 6459 raft_consensus.cc:2243] T c0ff8838ab17433ab733d3b293d4964f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:18.791858 6459 raft_consensus.cc:2272] T c0ff8838ab17433ab733d3b293d4964f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:18.792326 6459 ts_tablet_manager.cc:1916] T c0ff8838ab17433ab733d3b293d4964f P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:18.793453 6461 ts_tablet_manager.cc:1916] T e1de117713f34b51bbda0c712f0b837c P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:18.793529 6340 raft_consensus.cc:2468] T 0e123b69877e4b1fbcdb2b27960864e9 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:18.794199 6139 leader_election.cc:304] T 0e123b69877e4b1fbcdb2b27960864e9 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
W20260923 19:50:18.794951 6137 leader_election.cc:343] T 0e123b69877e4b1fbcdb2b27960864e9 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 0e123b69877e4b1fbcdb2b27960864e9
I20260923 19:50:18.795382 7591 leader_election.cc:290] T 0e123b69877e4b1fbcdb2b27960864e9 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:18.795656 7591 raft_consensus.cc:2804] T 0e123b69877e4b1fbcdb2b27960864e9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:18.795941 7591 raft_consensus.cc:697] T 0e123b69877e4b1fbcdb2b27960864e9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:18.796682 7591 consensus_queue.cc:237] T 0e123b69877e4b1fbcdb2b27960864e9 P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.802623 6458 ts_tablet_manager.cc:1929] T 66739afdf147413787acb0363aa37df6 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:18.802866 6458 log.cc:1199] T 66739afdf147413787acb0363aa37df6 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/66739afdf147413787acb0363aa37df6
I20260923 19:50:18.803519 6458 ts_tablet_manager.cc:1950] T 66739afdf147413787acb0363aa37df6 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:18.803618 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_2e6167b1010f4df8be79e4234ebd5866" } new_table_name: "default.Table_c44ab23a399a40bb919961ac93c1cde4" modify_external_catalogs: true
I20260923 19:50:18.805047 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 723) took 3389 ms. Trace:
I20260923 19:50:18.805950 5797 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 9c4a200d16464676976694656cbe28e2 (table default.Table_1e9ebf5c3c644666a5b6c1966fde4ed5 [id=5f2289c487ba40b9b7954c9d56918687]). Expected version 1 got 0
I20260923 19:50:18.808892 7566 raft_consensus.cc:493] T 684eb2576b4b4730813b993e36b242df P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:18.809015 7566 raft_consensus.cc:515] T 684eb2576b4b4730813b993e36b242df P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.809638 7566 leader_election.cc:290] T 684eb2576b4b4730813b993e36b242df P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:18.809679 6306 tablet_service.cc:1511] Processing CreateTablet for tablet 7595c09be8784a948027dd923c4b023e (DEFAULT_TABLE table=default.Table_5f9a8360065c42c6b42e7ab6deb71bdf [id=1e1ce17e7c394d7cbb8a4ec6e64dee8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.810071 6306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7595c09be8784a948027dd923c4b023e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.784140 6456 raft_consensus.cc:359] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.810232 6456 raft_consensus.cc:385] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:18.810284 6456 raft_consensus.cc:740] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:18.811444 6456 consensus_queue.cc:260] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.816514 6456 ts_tablet_manager.cc:1434] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.033s user 0.001s sys 0.001s
I20260923 19:50:18.816876 6456 tablet_bootstrap.cc:492] T 2948d729e1ec4dfca70789bcad513e52 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:18.818054 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684eb2576b4b4730813b993e36b242df" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:18.820536 5996 leader_election.cc:343] T 684eb2576b4b4730813b993e36b242df P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:18.795614 6166 tablet_service.cc:1511] Processing CreateTablet for tablet 7595c09be8784a948027dd923c4b023e (DEFAULT_TABLE table=default.Table_5f9a8360065c42c6b42e7ab6deb71bdf [id=1e1ce17e7c394d7cbb8a4ec6e64dee8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.823271 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7595c09be8784a948027dd923c4b023e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.824841 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b1d1d63c07d44208b5d0b2542e9590af" } new_table_name: "default.Table_d17a9611b1ee46e78b9fe959ceae3f17" modify_external_catalogs: true
I20260923 19:50:18.827340 7362 raft_consensus.cc:493] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:18.827461 7362 raft_consensus.cc:515] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.828042 7362 leader_election.cc:290] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:18.828306 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 3dead6c00e2c4516aa01547496a207fe
W20260923 19:50:18.830926 5800 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1f6df2c7b8c34ff2a358acdc58543991 consensus state has no leader
I20260923 19:50:18.831712 6307 tablet_service.cc:1558] Processing DeleteTablet for tablet 3dead6c00e2c4516aa01547496a207fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:18.836542 6454 tablet_bootstrap.cc:492] T 12f4abb573bd4be6961b55c27c684d06 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:18.836786 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_bd61cd1b68ec4ef69749319768dfe74c" } modify_external_catalogs: true
I20260923 19:50:18.836997 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_bd61cd1b68ec4ef69749319768dfe74c" } modify_external_catalogs: true
I20260923 19:50:18.837060 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 3dead6c00e2c4516aa01547496a207fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:18.835911 6457 ts_tablet_manager.cc:1434] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.085s user 0.008s sys 0.015s
I20260923 19:50:18.838443 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_fcfe761be2c94ee2ab52f12e87ed7fb7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:18.838963 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fcfe761be2c94ee2ab52f12e87ed7fb7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:18.841027 6279 leader_election.cc:343] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 9be4c46ee8eb4dbaad01d492b701a9e0
I20260923 19:50:18.843873 6307 tablet_service.cc:1558] Processing DeleteTablet for tablet 9be4c46ee8eb4dbaad01d492b701a9e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:18.844357 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 75958985ee414a5a9907ec0c7dece252 (DEFAULT_TABLE table=default.Table_105f26b7d508479ab5114c279aca4dfb [id=7eee19aa1d0348e08accd2764d2cfdce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.805280 6458 rpcz_store.cc:276] 0923 19:50:15.415939 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.423870 (+ 7931us) service_pool.cc:224] Handling call
0923 19:50:18.617016 (+3193146us) ts_tablet_manager.cc:1151] Deleting tablet 66739afdf147413787acb0363aa37df6
0923 19:50:18.617028 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:18.695422 (+ 78394us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:18.802561 (+107139us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:18.804999 (+ 2438us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3192967}
I20260923 19:50:18.844748 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75958985ee414a5a9907ec0c7dece252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.845027 6458 tablet_replica.cc:333] T 7e41501bf01e4765853c27e4cac21e2b P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:18.845328 6458 raft_consensus.cc:2243] T 7e41501bf01e4765853c27e4cac21e2b P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:18.845575 6458 raft_consensus.cc:2272] T 7e41501bf01e4765853c27e4cac21e2b P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:18.846655 6457 tablet_bootstrap.cc:492] T 554655516bb547ad9c2aa1ee66dc8deb P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:18.846948 6454 ts_tablet_manager.cc:1403] T 12f4abb573bd4be6961b55c27c684d06 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.190s user 0.018s sys 0.035s
I20260923 19:50:18.840770 6180 tablet_service.cc:1558] Processing DeleteTablet for tablet 3dead6c00e2c4516aa01547496a207fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:18.843847 6137 consensus_peers.cc:597] T efc63a151f6444dfb03c3f15f6f54473 P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: efc63a151f6444dfb03c3f15f6f54473. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:18.843914 6164 tablet_service.cc:1511] Processing CreateTablet for tablet c3bac0c76df144e2b2ae4fbb809e2d84 (DEFAULT_TABLE table=default.Table_2a3f607a23af430ba52036fcf8b35948 [id=6f9ac3e4264245358d37624ba8d8fa73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.847585 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3bac0c76df144e2b2ae4fbb809e2d84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.848325 6458 ts_tablet_manager.cc:1916] T 7e41501bf01e4765853c27e4cac21e2b P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:18.840425 7591 raft_consensus.cc:493] T 66739afdf147413787acb0363aa37df6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:18.853772 7591 raft_consensus.cc:515] T 66739afdf147413787acb0363aa37df6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.854578 6456 tablet_bootstrap.cc:654] T 2948d729e1ec4dfca70789bcad513e52 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:18.854854 7591 leader_election.cc:290] T 66739afdf147413787acb0363aa37df6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:18.855628 6454 raft_consensus.cc:359] T 12f4abb573bd4be6961b55c27c684d06 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:18.857178 6137 leader_election.cc:343] T 66739afdf147413787acb0363aa37df6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 66739afdf147413787acb0363aa37df6
I20260923 19:50:18.857739 6454 raft_consensus.cc:385] T 12f4abb573bd4be6961b55c27c684d06 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:18.857806 6454 raft_consensus.cc:740] T 12f4abb573bd4be6961b55c27c684d06 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:18.848790 6028 tablet_service.cc:1511] Processing CreateTablet for tablet c3bac0c76df144e2b2ae4fbb809e2d84 (DEFAULT_TABLE table=default.Table_2a3f607a23af430ba52036fcf8b35948 [id=6f9ac3e4264245358d37624ba8d8fa73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.858042 6454 consensus_queue.cc:260] T 12f4abb573bd4be6961b55c27c684d06 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.858347 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3bac0c76df144e2b2ae4fbb809e2d84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.858486 6454 ts_tablet_manager.cc:1434] T 12f4abb573bd4be6961b55c27c684d06 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260923 19:50:18.858753 6454 tablet_bootstrap.cc:492] T c19298691d5d4209b2d1147a1aad2f6f P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:18.860687 6454 tablet_bootstrap.cc:654] T c19298691d5d4209b2d1147a1aad2f6f P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:18.862686 6457 tablet_bootstrap.cc:654] T 554655516bb547ad9c2aa1ee66dc8deb P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:18.868180 7629 raft_consensus.cc:493] T a10d35bf564d45488524d3d21721f4e5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:18.868439 7629 raft_consensus.cc:515] T a10d35bf564d45488524d3d21721f4e5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.869441 7629 leader_election.cc:290] T a10d35bf564d45488524d3d21721f4e5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:18.871865 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet f36c34465066473f94da61da73f521ff
I20260923 19:50:18.873363 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet f36c34465066473f94da61da73f521ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:18.875548 5796 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 9c4a200d16464676976694656cbe28e2 (table default.Table_1e9ebf5c3c644666a5b6c1966fde4ed5 [id=5f2289c487ba40b9b7954c9d56918687]). Expected version 1 got 0
I20260923 19:50:18.879034 6459 ts_tablet_manager.cc:1929] T c0ff8838ab17433ab733d3b293d4964f P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:18.879832 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet f36c34465066473f94da61da73f521ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:18.880059 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_d50291ec9ea0471fa057aa648cf81187"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:18.880709 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d50291ec9ea0471fa057aa648cf81187 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:18.853618 6024 tablet_service.cc:1511] Processing CreateTablet for tablet 7595c09be8784a948027dd923c4b023e (DEFAULT_TABLE table=default.Table_5f9a8360065c42c6b42e7ab6deb71bdf [id=1e1ce17e7c394d7cbb8a4ec6e64dee8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.885370 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 77aa9699460440e7906957855b97448e
I20260923 19:50:18.885663 6024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7595c09be8784a948027dd923c4b023e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.871083 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10d35bf564d45488524d3d21721f4e5" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:18.879261 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet f36c34465066473f94da61da73f521ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:18.890282 7362 consensus_queue.cc:1048] T ed9fb0cab0bd43b7a05d7376125b187e P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:18.887732 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 77aa9699460440e7906957855b97448e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:18.890487 5996 leader_election.cc:343] T a10d35bf564d45488524d3d21721f4e5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:18.883519 6324 tablet_service.cc:1511] Processing CreateTablet for tablet c3bac0c76df144e2b2ae4fbb809e2d84 (DEFAULT_TABLE table=default.Table_2a3f607a23af430ba52036fcf8b35948 [id=6f9ac3e4264245358d37624ba8d8fa73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:18.900925 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3bac0c76df144e2b2ae4fbb809e2d84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:18.887909 6313 tablet_service.cc:1558] Processing DeleteTablet for tablet 77aa9699460440e7906957855b97448e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:18.904814 6391 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
I20260923 19:50:18.907205 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_9be717e88e1e4262b2603dcc966e9979"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:18.907857 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9be717e88e1e4262b2603dcc966e9979 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:18.910969 5797 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_3a11a15c5e5b4bc38332d423f3d559e7" } new_table_name: "default.Table_b1d58b8b9cff44cb9e744a5e5d9226d8" modify_external_catalogs: true
I20260923 19:50:18.911607 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 5427b0f0218d4131b68a39e8e3bf02e7
I20260923 19:50:18.912436 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_90f6ff642d1548868810ba9fc019170b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:18.912945 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_90f6ff642d1548868810ba9fc019170b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:18.913357 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 5427b0f0218d4131b68a39e8e3bf02e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:18.914358 5799 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_2f6075b4791c4a4cb8bda36d17569bcb" } new_table_name: "default.Table_272113986f364033a09b595d0a36f8ae" modify_external_catalogs: true
I20260923 19:50:18.915517 6456 tablet_bootstrap.cc:492] T 2948d729e1ec4dfca70789bcad513e52 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:18.915515 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 6393303f6d664fe3bbc9c9052cd0b717
I20260923 19:50:18.915635 6456 ts_tablet_manager.cc:1403] T 2948d729e1ec4dfca70789bcad513e52 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.099s user 0.003s sys 0.000s
I20260923 19:50:18.915973 5805 catalog_manager.cc:6934] ReplaceTablet: tablet 6393303f6d664fe3bbc9c9052cd0b717 deleted and replaced by tablet ba47e3d0c32f47a39f9d7f021f3398f3
I20260923 19:50:18.916285 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_6926f64a6e24455aae8f5261e871c225"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:18.916730 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6926f64a6e24455aae8f5261e871c225 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:18.916761 6456 raft_consensus.cc:359] T 2948d729e1ec4dfca70789bcad513e52 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.916909 6456 raft_consensus.cc:385] T 2948d729e1ec4dfca70789bcad513e52 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:18.916968 6456 raft_consensus.cc:740] T 2948d729e1ec4dfca70789bcad513e52 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:18.918480 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 6393303f6d664fe3bbc9c9052cd0b717 with delete_type TABLET_DATA_DELETED (replaced by tablet ba47e3d0c32f47a39f9d7f021f3398f3) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:18.919615 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet 6393303f6d664fe3bbc9c9052cd0b717 with delete_type TABLET_DATA_DELETED (replaced by tablet ba47e3d0c32f47a39f9d7f021f3398f3) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:18.919863 6313 tablet_service.cc:1558] Processing DeleteTablet for tablet 5427b0f0218d4131b68a39e8e3bf02e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:18.924594 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b0ddcbe6166a4a2cb89cb60b3d8458fb consensus state has no leader
W20260923 19:50:18.928141 5803 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d39a64531dd24eb4aa1f7e0c418b985b consensus state has no leader
I20260923 19:50:18.931330 6456 consensus_queue.cc:260] T 2948d729e1ec4dfca70789bcad513e52 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.931574 7362 raft_consensus.cc:493] T 2948d729e1ec4dfca70789bcad513e52 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:18.931681 7362 raft_consensus.cc:515] T 2948d729e1ec4dfca70789bcad513e52 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.932474 7362 leader_election.cc:290] T 2948d729e1ec4dfca70789bcad513e52 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:18.936566 6279 leader_election.cc:343] T 2948d729e1ec4dfca70789bcad513e52 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 2948d729e1ec4dfca70789bcad513e52
I20260923 19:50:18.937546 6456 ts_tablet_manager.cc:1434] T 2948d729e1ec4dfca70789bcad513e52 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
I20260923 19:50:18.945583 7256 raft_consensus.cc:493] T 15a9d1d4adaa402f90d774e77010c928 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:18.945746 7256 raft_consensus.cc:515] T 15a9d1d4adaa402f90d774e77010c928 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.946370 7256 leader_election.cc:290] T 15a9d1d4adaa402f90d774e77010c928 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:18.947556 6457 tablet_bootstrap.cc:492] T 554655516bb547ad9c2aa1ee66dc8deb P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:18.948144 6457 ts_tablet_manager.cc:1403] T 554655516bb547ad9c2aa1ee66dc8deb P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.102s user 0.010s sys 0.011s
I20260923 19:50:18.948277 7629 raft_consensus.cc:493] T 1c43641327d14a888a2815e49a2762c8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:18.948386 7629 raft_consensus.cc:515] T 1c43641327d14a888a2815e49a2762c8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.948946 6457 raft_consensus.cc:359] T 554655516bb547ad9c2aa1ee66dc8deb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.949098 6457 raft_consensus.cc:385] T 554655516bb547ad9c2aa1ee66dc8deb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:18.949579 6459 log.cc:1199] T c0ff8838ab17433ab733d3b293d4964f P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/c0ff8838ab17433ab733d3b293d4964f
I20260923 19:50:18.950058 6459 ts_tablet_manager.cc:1950] T c0ff8838ab17433ab733d3b293d4964f P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:18.950317 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c43641327d14a888a2815e49a2762c8" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:18.951260 6279 leader_election.cc:343] T 15a9d1d4adaa402f90d774e77010c928 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 15a9d1d4adaa402f90d774e77010c928
I20260923 19:50:18.952844 6456 tablet_bootstrap.cc:492] T b18548ba557f448880c5e617fc03cbe0 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:18.954895 6456 tablet_bootstrap.cc:654] T b18548ba557f448880c5e617fc03cbe0 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:18.955979 6310 tablet_service.cc:1558] Processing DeleteTablet for tablet 2948d729e1ec4dfca70789bcad513e52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:18.914181 6139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.195:32855, user_credentials={real_user=slave}} blocked reactor thread for 119994us
I20260923 19:50:18.918991 6182 tablet_service.cc:1558] Processing DeleteTablet for tablet 6393303f6d664fe3bbc9c9052cd0b717 with delete_type TABLET_DATA_DELETED (replaced by tablet ba47e3d0c32f47a39f9d7f021f3398f3) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:18.919835 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet 5427b0f0218d4131b68a39e8e3bf02e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:18.926542 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be4c46ee8eb4dbaad01d492b701a9e0" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:18.946657 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2948d729e1ec4dfca70789bcad513e52" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:18.958967 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684eb2576b4b4730813b993e36b242df" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:18.959069 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10d35bf564d45488524d3d21721f4e5" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:18.959108 6280 leader_election.cc:343] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:18.948129 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a9d1d4adaa402f90d774e77010c928" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:18.959226 6280 leader_election.cc:304] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:18.959431 7256 raft_consensus.cc:2749] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:18.959508 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c43641327d14a888a2815e49a2762c8" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:18.959687 6280 leader_election.cc:343] T 2948d729e1ec4dfca70789bcad513e52 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:18.959784 6280 leader_election.cc:304] T 2948d729e1ec4dfca70789bcad513e52 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:18.959968 7256 raft_consensus.cc:2749] T 2948d729e1ec4dfca70789bcad513e52 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:18.960304 6280 leader_election.cc:343] T 15a9d1d4adaa402f90d774e77010c928 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:18.960418 6280 leader_election.cc:304] T 15a9d1d4adaa402f90d774e77010c928 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:18.960479 6139 leader_election.cc:343] T 66739afdf147413787acb0363aa37df6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 66739afdf147413787acb0363aa37df6
I20260923 19:50:18.906327 6165 tablet_service.cc:1558] Processing DeleteTablet for tablet 77aa9699460440e7906957855b97448e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:18.960666 7256 raft_consensus.cc:2749] T 15a9d1d4adaa402f90d774e77010c928 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:18.949527 7629 leader_election.cc:290] T 1c43641327d14a888a2815e49a2762c8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:18.955229 5996 leader_election.cc:343] T 1c43641327d14a888a2815e49a2762c8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:18.960601 6139 leader_election.cc:304] T 66739afdf147413787acb0363aa37df6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:18.961009 6457 raft_consensus.cc:740] T 554655516bb547ad9c2aa1ee66dc8deb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
W20260923 19:50:18.961269 5995 leader_election.cc:343] T 684eb2576b4b4730813b993e36b242df P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:18.961274 7630 raft_consensus.cc:2749] T 66739afdf147413787acb0363aa37df6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:18.961385 6457 consensus_queue.cc:260] T 554655516bb547ad9c2aa1ee66dc8deb P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.961493 5995 leader_election.cc:304] T 684eb2576b4b4730813b993e36b242df P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:18.961781 7629 raft_consensus.cc:2749] T 684eb2576b4b4730813b993e36b242df P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:18.962231 5995 leader_election.cc:343] T a10d35bf564d45488524d3d21721f4e5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:18.962383 5995 leader_election.cc:304] T a10d35bf564d45488524d3d21721f4e5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:18.962486 7630 consensus_queue.cc:1048] T efc63a151f6444dfb03c3f15f6f54473 P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:18.962611 7629 raft_consensus.cc:2749] T a10d35bf564d45488524d3d21721f4e5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:18.962975 5995 leader_election.cc:343] T 1c43641327d14a888a2815e49a2762c8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:18.963514 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 4935c06f29cf4c729946f35829dfdf92
I20260923 19:50:18.963122 5995 leader_election.cc:304] T 1c43641327d14a888a2815e49a2762c8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:18.963701 7629 raft_consensus.cc:2749] T 1c43641327d14a888a2815e49a2762c8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:18.964474 6310 tablet_service.cc:1558] Processing DeleteTablet for tablet 4935c06f29cf4c729946f35829dfdf92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:18.965996 6457 ts_tablet_manager.cc:1434] T 554655516bb547ad9c2aa1ee66dc8deb P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
I20260923 19:50:18.967561 6165 tablet_service.cc:1558] Processing DeleteTablet for tablet 4935c06f29cf4c729946f35829dfdf92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:18.967729 6106 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
I20260923 19:50:18.968779 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet 4935c06f29cf4c729946f35829dfdf92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:18.969027 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 810) took 1500 ms. Trace:
I20260923 19:50:18.969784 6459 rpcz_store.cc:276] 0923 19:50:17.468851 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:17.469587 (+ 736us) service_pool.cc:224] Handling call
0923 19:50:18.791515 (+1321928us) ts_tablet_manager.cc:1151] Deleting tablet c0ff8838ab17433ab733d3b293d4964f
0923 19:50:18.791525 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:18.875607 (+ 84082us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:18.878974 (+ 3367us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:18.969006 (+ 90032us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1321793}
I20260923 19:50:18.970618 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet c0ff8838ab17433ab733d3b293d4964f (table default.Table_c67ffb2902d446cba5c75e4a3d46d559 [id=b703874c0f19412b96d6776a2cda5caa]) successfully deleted
I20260923 19:50:18.971745 5801 master_service.cc:960] ReplaceTablet: received request to replace tablet 6d29923f139445cc86379c80ac15df5d from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:18.972035 6454 tablet_bootstrap.cc:492] T c19298691d5d4209b2d1147a1aad2f6f P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:18.972272 6454 ts_tablet_manager.cc:1403] T c19298691d5d4209b2d1147a1aad2f6f P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.114s user 0.000s sys 0.019s
I20260923 19:50:18.973130 6454 raft_consensus.cc:359] T c19298691d5d4209b2d1147a1aad2f6f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.973362 6454 raft_consensus.cc:385] T c19298691d5d4209b2d1147a1aad2f6f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:18.973462 6454 raft_consensus.cc:740] T c19298691d5d4209b2d1147a1aad2f6f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:18.973749 6454 consensus_queue.cc:260] T c19298691d5d4209b2d1147a1aad2f6f P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:18.976647 6249 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
I20260923 19:50:18.984385 6454 ts_tablet_manager.cc:1434] T c19298691d5d4209b2d1147a1aad2f6f P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260923 19:50:18.984198 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet c19298691d5d4209b2d1147a1aad2f6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:07 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:18.986043 6459 tablet_replica.cc:333] T 870db252d8414be7bbe613ea467b5f3a P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:18.986419 6459 raft_consensus.cc:2243] T 870db252d8414be7bbe613ea467b5f3a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:18.986601 6459 raft_consensus.cc:2272] T 870db252d8414be7bbe613ea467b5f3a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:18.986568 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_ceb8ad1770064991add54f6cc371d9fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:18.987135 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ceb8ad1770064991add54f6cc371d9fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:18.987166 6459 ts_tablet_manager.cc:1916] T 870db252d8414be7bbe613ea467b5f3a P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:18.990056 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_5f6fd703ce9046b59580474f3aee2f7b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:18.990543 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f6fd703ce9046b59580474f3aee2f7b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:18.993969 5995 consensus_peers.cc:597] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0 -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:18.994495 6454 tablet_bootstrap.cc:492] T a11ecef9a24f4e4a812ec220b6a92cc4 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:18.996767 6458 ts_tablet_manager.cc:1929] T 7e41501bf01e4765853c27e4cac21e2b P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:18.996973 6458 log.cc:1199] T 7e41501bf01e4765853c27e4cac21e2b P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/7e41501bf01e4765853c27e4cac21e2b
I20260923 19:50:18.997505 6458 ts_tablet_manager.cc:1950] T 7e41501bf01e4765853c27e4cac21e2b P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:18.998065 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 712) took 3755 ms. Trace:
I20260923 19:50:18.998230 6458 rpcz_store.cc:276] 0923 19:50:15.242569 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.369218 (+126649us) service_pool.cc:224] Handling call
0923 19:50:18.844956 (+3475738us) ts_tablet_manager.cc:1151] Deleting tablet 7e41501bf01e4765853c27e4cac21e2b
0923 19:50:18.844969 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:18.902485 (+ 57516us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:18.996710 (+ 94225us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:18.998025 (+ 1315us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3420716}
I20260923 19:50:18.999140 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 7e41501bf01e4765853c27e4cac21e2b (table default.Table_5c35e08897f74660ad23df9a2c751741 [id=9b387d21c8824514b7f3fae8c26b489d]) successfully deleted
I20260923 19:50:18.999194 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 725) took 3498 ms. Trace:
I20260923 19:50:18.999411 6458 rpcz_store.cc:276] 0923 19:50:15.500956 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.501012 (+ 56us) service_pool.cc:224] Handling call
0923 19:50:18.998959 (+3497947us) ts_tablet_manager.cc:1151] Deleting tablet 717995ec489343118809ada2a6b58804
0923 19:50:18.998967 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:18.999177 (+ 210us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3497740}
I20260923 19:50:19.000356 6458 tablet_replica.cc:333] T c19298691d5d4209b2d1147a1aad2f6f P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:19.000823 6458 raft_consensus.cc:2243] T c19298691d5d4209b2d1147a1aad2f6f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:19.001155 6458 raft_consensus.cc:2272] T c19298691d5d4209b2d1147a1aad2f6f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:19.001304 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 717995ec489343118809ada2a6b58804 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 717995ec489343118809ada2a6b58804 already in progress: creating tablet
I20260923 19:50:19.002876 6458 ts_tablet_manager.cc:1916] T c19298691d5d4209b2d1147a1aad2f6f P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:19.007040 6454 tablet_bootstrap.cc:654] T a11ecef9a24f4e4a812ec220b6a92cc4 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:19.009840 6279 consensus_peers.cc:597] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: edb52bd88b424129bbdc45de89b56efb. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:19.012022 6457 tablet_bootstrap.cc:492] T f1c1d4f73488499a9e5add81e9d5e2d6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:19.012450 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_aa6a5920d6334591884766939675ec50"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:19.013623 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa6a5920d6334591884766939675ec50 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:19.019970 6454 tablet_bootstrap.cc:492] T a11ecef9a24f4e4a812ec220b6a92cc4 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:19.020179 6454 ts_tablet_manager.cc:1403] T a11ecef9a24f4e4a812ec220b6a92cc4 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.001s
I20260923 19:50:19.020939 6454 raft_consensus.cc:359] T a11ecef9a24f4e4a812ec220b6a92cc4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.021277 6454 raft_consensus.cc:385] T a11ecef9a24f4e4a812ec220b6a92cc4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:19.021379 6454 raft_consensus.cc:740] T a11ecef9a24f4e4a812ec220b6a92cc4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:19.021632 6454 consensus_queue.cc:260] T a11ecef9a24f4e4a812ec220b6a92cc4 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.023730 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet 554655516bb547ad9c2aa1ee66dc8deb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:19.026947 6454 ts_tablet_manager.cc:1434] T a11ecef9a24f4e4a812ec220b6a92cc4 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260923 19:50:19.031107 6456 tablet_bootstrap.cc:492] T b18548ba557f448880c5e617fc03cbe0 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:19.033461 6454 tablet_bootstrap.cc:492] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:19.035211 6457 tablet_bootstrap.cc:654] T f1c1d4f73488499a9e5add81e9d5e2d6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:19.035310 6454 tablet_bootstrap.cc:654] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:19.037101 6456 ts_tablet_manager.cc:1403] T b18548ba557f448880c5e617fc03cbe0 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.099s user 0.004s sys 0.000s
I20260923 19:50:19.037575 6200 raft_consensus.cc:3060] T 35f46a1be80c4194b592c5d00fe1f342 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:19.037853 6456 raft_consensus.cc:359] T b18548ba557f448880c5e617fc03cbe0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.038038 6456 raft_consensus.cc:385] T b18548ba557f448880c5e617fc03cbe0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:19.038084 6456 raft_consensus.cc:740] T b18548ba557f448880c5e617fc03cbe0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:19.041595 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_ffc6ba8328d44410bccf50fc1273e92e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:19.043488 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ffc6ba8328d44410bccf50fc1273e92e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:19.044176 6456 consensus_queue.cc:260] T b18548ba557f448880c5e617fc03cbe0 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.044798 6456 ts_tablet_manager.cc:1434] T b18548ba557f448880c5e617fc03cbe0 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260923 19:50:19.046224 5805 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_14291874bbe14b46940404de2dc7b51e" } modify_external_catalogs: true
I20260923 19:50:19.046401 5805 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_14291874bbe14b46940404de2dc7b51e" } modify_external_catalogs: true
I20260923 19:50:19.047780 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a319c1b23b8e44d9ac3fcb5c7406d7a4" } new_table_name: "default.Table_6675fe8cb9db43518eac9103c2c60ba1" modify_external_catalogs: true
W20260923 19:50:19.049103 5799 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2072d5cda2d046898df6ccddb872c92e consensus state has no leader
I20260923 19:50:19.050418 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet a11ecef9a24f4e4a812ec220b6a92cc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:19.051308 5801 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 6d29923f139445cc86379c80ac15df5d
I20260923 19:50:19.052217 5801 catalog_manager.cc:6934] ReplaceTablet: tablet 6d29923f139445cc86379c80ac15df5d deleted and replaced by tablet 25a1122a9ed44525b53752f230b875af
I20260923 19:50:19.052230 6454 tablet_bootstrap.cc:492] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:19.052367 6454 ts_tablet_manager.cc:1403] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.006s
I20260923 19:50:19.052930 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d29923f139445cc86379c80ac15df5d with delete_type TABLET_DATA_DELETED (replaced by tablet 25a1122a9ed44525b53752f230b875af) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:19.053177 6024 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d29923f139445cc86379c80ac15df5d with delete_type TABLET_DATA_DELETED (replaced by tablet 25a1122a9ed44525b53752f230b875af) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:19.053548 6456 tablet_bootstrap.cc:492] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
W20260923 19:50:19.055152 5797 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e8b0d0a8e4e54ec195893127f7a76bed consensus state has no leader
I20260923 19:50:19.056844 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d29923f139445cc86379c80ac15df5d with delete_type TABLET_DATA_DELETED (replaced by tablet 25a1122a9ed44525b53752f230b875af) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:19.059013 5791 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 146a402ff29a4e0b834a9f270d61e21c (table default.Table_605d43f9448e4b4bb429f8bf52d6ac55 [id=834c18797d8e48a79c45628c5180b80b], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 146a402ff29a4e0b834a9f270d61e21c consensus state has no leader
I20260923 19:50:19.066236 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet b18548ba557f448880c5e617fc03cbe0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:19.071309 6457 tablet_bootstrap.cc:492] T f1c1d4f73488499a9e5add81e9d5e2d6 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:19.071518 6457 ts_tablet_manager.cc:1403] T f1c1d4f73488499a9e5add81e9d5e2d6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.060s user 0.003s sys 0.000s
I20260923 19:50:19.071588 6454 raft_consensus.cc:359] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.072203 6457 raft_consensus.cc:359] T f1c1d4f73488499a9e5add81e9d5e2d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:19.072441 6457 raft_consensus.cc:385] T f1c1d4f73488499a9e5add81e9d5e2d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:19.072541 6457 raft_consensus.cc:740] T f1c1d4f73488499a9e5add81e9d5e2d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:19.072808 6457 consensus_queue.cc:260] T f1c1d4f73488499a9e5add81e9d5e2d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:19.075964 6457 ts_tablet_manager.cc:1434] T f1c1d4f73488499a9e5add81e9d5e2d6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260923 19:50:19.076471 6457 tablet_bootstrap.cc:492] T 397ec5e49673406cb26a2efab0ad8401 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:19.076805 6454 raft_consensus.cc:385] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:19.076905 5800 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet f1c1d4f73488499a9e5add81e9d5e2d6 (table default.Table_7f7907c8e1bc4ad1ae68faf5f072b318 [id=80e3a84f7199464fa96426daeeeb84cd]). Expected version 2 got 0
I20260923 19:50:19.076975 6454 raft_consensus.cc:740] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:19.077239 6454 consensus_queue.cc:260] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.085223 6454 ts_tablet_manager.cc:1434] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.033s user 0.001s sys 0.001s
I20260923 19:50:19.088193 6454 tablet_bootstrap.cc:492] T 2ce6378a6bd844a485aebb96081307e3 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:19.090204 6456 tablet_bootstrap.cc:654] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:19.079600 5800 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_605d43f9448e4b4bb429f8bf52d6ac55" } modify_external_catalogs: true
I20260923 19:50:19.095387 5800 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_605d43f9448e4b4bb429f8bf52d6ac55" } modify_external_catalogs: true
I20260923 19:50:19.089574 5797 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet f1c1d4f73488499a9e5add81e9d5e2d6 (table default.Table_7f7907c8e1bc4ad1ae68faf5f072b318 [id=80e3a84f7199464fa96426daeeeb84cd]). Expected version 2 got 0
I20260923 19:50:19.091460 5804 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f3099aec2da54c33b79ac8261f13f6a2" } modify_external_catalogs: true
I20260923 19:50:19.096724 5804 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f3099aec2da54c33b79ac8261f13f6a2" } modify_external_catalogs: true
I20260923 19:50:19.079028 5801 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 35f46a1be80c4194b592c5d00fe1f342 (table default.Table_f6755f452e8d41c4b9d64c3ee2735188 [id=d6a2d0fc236a4056b224d01249f045b0]). Expected version 1 got 0
I20260923 19:50:19.100857 6459 ts_tablet_manager.cc:1929] T 870db252d8414be7bbe613ea467b5f3a P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:19.101032 6459 log.cc:1199] T 870db252d8414be7bbe613ea467b5f3a P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/870db252d8414be7bbe613ea467b5f3a
I20260923 19:50:19.101500 6459 ts_tablet_manager.cc:1950] T 870db252d8414be7bbe613ea467b5f3a P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:19.104710 6454 tablet_bootstrap.cc:654] T 2ce6378a6bd844a485aebb96081307e3 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:19.104923 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 812) took 1571 ms. Trace:
I20260923 19:50:19.105162 6459 rpcz_store.cc:276] 0923 19:50:17.533484 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:17.533568 (+ 84us) service_pool.cc:224] Handling call
0923 19:50:18.985994 (+1452426us) ts_tablet_manager.cc:1151] Deleting tablet 870db252d8414be7bbe613ea467b5f3a
0923 19:50:18.986005 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.036230 (+ 50225us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:19.100796 (+ 64566us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:19.104906 (+ 4110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1452198}
I20260923 19:50:19.105594 7629 consensus_queue.cc:1048] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:19.110366 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 80386e27facd494bb11a46ddf83e7b23
I20260923 19:50:19.111963 6024 tablet_service.cc:1558] Processing DeleteTablet for tablet 80386e27facd494bb11a46ddf83e7b23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:19.112792 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet 80386e27facd494bb11a46ddf83e7b23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:19.116017 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_ae675838bcf846309b17e86c9b8abef1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:19.116710 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae675838bcf846309b17e86c9b8abef1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:19.117026 5797 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_0158dbcf5a774d1d94e43e1eda699b75" } modify_external_catalogs: true
I20260923 19:50:19.117311 5797 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_0158dbcf5a774d1d94e43e1eda699b75" } modify_external_catalogs: true
I20260923 19:50:19.111323 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet 80386e27facd494bb11a46ddf83e7b23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:19.112159 6454 tablet_bootstrap.cc:492] T 2ce6378a6bd844a485aebb96081307e3 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:19.122089 6454 ts_tablet_manager.cc:1403] T 2ce6378a6bd844a485aebb96081307e3 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.034s user 0.001s sys 0.005s
I20260923 19:50:19.122613 6457 tablet_bootstrap.cc:654] T 397ec5e49673406cb26a2efab0ad8401 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:19.122922 6454 raft_consensus.cc:359] T 2ce6378a6bd844a485aebb96081307e3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.123087 6454 raft_consensus.cc:385] T 2ce6378a6bd844a485aebb96081307e3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:19.123153 6454 raft_consensus.cc:740] T 2ce6378a6bd844a485aebb96081307e3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:19.123405 6454 consensus_queue.cc:260] T 2ce6378a6bd844a485aebb96081307e3 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.124029 6454 ts_tablet_manager.cc:1434] T 2ce6378a6bd844a485aebb96081307e3 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260923 19:50:19.118543 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet 474e34e902064764864ba06ef41b1d94 with delete_type TABLET_DATA_DELETED (replaced by tablet 12bda2ae961446bea2f34e792f4f1706) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:19.124439 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 870db252d8414be7bbe613ea467b5f3a (table default.Table_24178fa82e3c4d878ed35fe32867eb98 [id=450e80ee217e4c6f91172b176cdda58c]) successfully deleted
I20260923 19:50:19.126015 6459 tablet_replica.cc:333] T efc63a151f6444dfb03c3f15f6f54473 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:19.126189 6459 raft_consensus.cc:2243] T efc63a151f6444dfb03c3f15f6f54473 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:19.128477 6459 raft_consensus.cc:2272] T efc63a151f6444dfb03c3f15f6f54473 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:19.129451 5802 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ebe7885970c7419aaa4094f753351c78" } new_table_name: "default.Table_f0cdb5a015e54dc8af1c6790ea549345" modify_external_catalogs: true
I20260923 19:50:19.130937 5796 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_9c0e162f59774279a9e240130af9e199" } new_table_name: "default.Table_1fcbce6f006d4bf9a2c26b1a496e54df" modify_external_catalogs: true
I20260923 19:50:19.131279 6454 tablet_bootstrap.cc:492] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:19.131505 6459 ts_tablet_manager.cc:1916] T efc63a151f6444dfb03c3f15f6f54473 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:19.132951 5801 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 2ce6378a6bd844a485aebb96081307e3 (table default.Table_4d1a0d71d11f4c0a8c80b3ba7ea0c358 [id=ef9a6c259ceb4c189c8902a776fb3bfa]). Expected version 1 got 0
I20260923 19:50:19.137036 5803 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 2ce6378a6bd844a485aebb96081307e3 (table default.Table_4d1a0d71d11f4c0a8c80b3ba7ea0c358 [id=ef9a6c259ceb4c189c8902a776fb3bfa]). Expected version 1 got 0
I20260923 19:50:19.137154 6454 tablet_bootstrap.cc:654] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:19.137807 6459 ts_tablet_manager.cc:1929] T efc63a151f6444dfb03c3f15f6f54473 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260923 19:50:19.142230 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f0915e6df24f42b3b8b1a558b7ebc7ff consensus state has no leader
I20260923 19:50:19.144472 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 12f4abb573bd4be6961b55c27c684d06
I20260923 19:50:19.147408 6024 tablet_service.cc:1558] Processing DeleteTablet for tablet 12f4abb573bd4be6961b55c27c684d06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:19.147305 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet 12f4abb573bd4be6961b55c27c684d06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:19.139882 6456 tablet_bootstrap.cc:492] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:19.148108 6456 ts_tablet_manager.cc:1403] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.095s user 0.004s sys 0.000s
I20260923 19:50:19.149310 6456 raft_consensus.cc:359] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.149582 6461 ts_tablet_manager.cc:1929] T e1de117713f34b51bbda0c712f0b837c P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:19.152256 5805 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet ad29d22a82434023991ffcacf7f9bee5 (table default.Table_0eb28975495e4bedaf7c538454e525f6 [id=ea52a2330cd643e486e5b348dabbd295]). Expected version 1 got 0
I20260923 19:50:19.153421 5804 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet ad29d22a82434023991ffcacf7f9bee5 (table default.Table_0eb28975495e4bedaf7c538454e525f6 [id=ea52a2330cd643e486e5b348dabbd295]). Expected version 1 got 0
I20260923 19:50:19.157418 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet dadb3ab2082b4f749182b0616cf6e8f5
I20260923 19:50:19.158329 6461 log.cc:1199] T e1de117713f34b51bbda0c712f0b837c P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/e1de117713f34b51bbda0c712f0b837c
I20260923 19:50:19.158741 6461 ts_tablet_manager.cc:1950] T e1de117713f34b51bbda0c712f0b837c P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:19.158841 6024 tablet_service.cc:1558] Processing DeleteTablet for tablet dadb3ab2082b4f749182b0616cf6e8f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:19.159024 5805 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet ad29d22a82434023991ffcacf7f9bee5 (table default.Table_0eb28975495e4bedaf7c538454e525f6 [id=ea52a2330cd643e486e5b348dabbd295]). Expected version 1 got 0
I20260923 19:50:19.159834 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet e1de117713f34b51bbda0c712f0b837c (table default.Table_9d716833c456436cbc514b6a9070c9e1 [id=e3fafc4359af49c88437fb5815526518]) successfully deleted
I20260923 19:50:19.160176 6461 tablet_replica.cc:333] T 684eb2576b4b4730813b993e36b242df P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:19.160739 6461 raft_consensus.cc:2243] T 684eb2576b4b4730813b993e36b242df P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:19.161698 6461 raft_consensus.cc:2272] T 684eb2576b4b4730813b993e36b242df P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:19.162312 6461 ts_tablet_manager.cc:1916] T 684eb2576b4b4730813b993e36b242df P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:19.162755 5802 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 00eba27e9f2948e8a298c3fbca52a282 consensus state has no leader
I20260923 19:50:19.167165 5804 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_3f7aea8c4b01456887ad705c059f1572" } modify_external_catalogs: true
I20260923 19:50:19.167377 5804 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_3f7aea8c4b01456887ad705c059f1572" } modify_external_catalogs: true
I20260923 19:50:19.165520 7566 raft_consensus.cc:493] T f1c1d4f73488499a9e5add81e9d5e2d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:19.168020 7566 raft_consensus.cc:515] T f1c1d4f73488499a9e5add81e9d5e2d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:19.168686 7566 leader_election.cc:290] T f1c1d4f73488499a9e5add81e9d5e2d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:19.173143 7627 tablet.cc:1751] T 2db82e6f314f412385b41720c7efdef5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260923 19:50:19.159595 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet dadb3ab2082b4f749182b0616cf6e8f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:19.169427 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c1d4f73488499a9e5add81e9d5e2d6" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:19.179199 6456 raft_consensus.cc:385] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:19.179431 6456 raft_consensus.cc:740] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:19.170766 6458 ts_tablet_manager.cc:1929] T c19298691d5d4209b2d1147a1aad2f6f P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:19.179773 6458 log.cc:1199] T c19298691d5d4209b2d1147a1aad2f6f P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/c19298691d5d4209b2d1147a1aad2f6f
W20260923 19:50:19.179762 5996 leader_election.cc:343] T f1c1d4f73488499a9e5add81e9d5e2d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:19.180154 6458 ts_tablet_manager.cc:1950] T c19298691d5d4209b2d1147a1aad2f6f P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:19.180495 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 726) took 3523 ms. Trace:
I20260923 19:50:19.171446 7655 tablet.cc:1751] T 2db82e6f314f412385b41720c7efdef5 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260923 19:50:19.180714 6456 consensus_queue.cc:260] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.147709 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet 12f4abb573bd4be6961b55c27c684d06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:19.159510 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet dadb3ab2082b4f749182b0616cf6e8f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:19.169179 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c1d4f73488499a9e5add81e9d5e2d6" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:19.182827 6459 log.cc:1199] T efc63a151f6444dfb03c3f15f6f54473 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/efc63a151f6444dfb03c3f15f6f54473
I20260923 19:50:19.183259 6459 ts_tablet_manager.cc:1950] T efc63a151f6444dfb03c3f15f6f54473 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
W20260923 19:50:19.183883 5995 leader_election.cc:343] T f1c1d4f73488499a9e5add81e9d5e2d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:19.183993 5995 leader_election.cc:304] T f1c1d4f73488499a9e5add81e9d5e2d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:19.184309 7566 raft_consensus.cc:2749] T f1c1d4f73488499a9e5add81e9d5e2d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:19.185319 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_909fd03d65a449dda03f331de5e6cec1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:19.186106 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_909fd03d65a449dda03f331de5e6cec1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:19.187167 5797 master_service.cc:960] ReplaceTablet: received request to replace tablet a0d817069e664199bff0d7591548e2d7 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:19.182132 6454 tablet_bootstrap.cc:492] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:19.187458 6454 ts_tablet_manager.cc:1403] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.059s user 0.003s sys 0.000s
W20260923 19:50:19.189343 5796 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a5cd258b6ff44e3db0d4cb66b51874b0 consensus state has no leader
I20260923 19:50:19.190759 6454 raft_consensus.cc:359] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.190996 6454 raft_consensus.cc:385] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:19.191114 6454 raft_consensus.cc:740] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:19.191399 6454 consensus_queue.cc:260] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.192099 6454 ts_tablet_manager.cc:1434] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260923 19:50:19.171096 7656 tablet.cc:1751] T 2db82e6f314f412385b41720c7efdef5 P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260923 19:50:19.193508 6456 ts_tablet_manager.cc:1434] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.045s user 0.002s sys 0.000s
I20260923 19:50:19.193861 6454 tablet_bootstrap.cc:492] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:19.180649 6458 rpcz_store.cc:276] 0923 19:50:15.657444 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.657913 (+ 469us) service_pool.cc:224] Handling call
0923 19:50:19.000280 (+3342367us) ts_tablet_manager.cc:1151] Deleting tablet c19298691d5d4209b2d1147a1aad2f6f
0923 19:50:19.000289 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.112490 (+112201us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:19.170711 (+ 58221us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:19.180480 (+ 9769us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3342189}
I20260923 19:50:19.195811 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet c19298691d5d4209b2d1147a1aad2f6f (table default.Table_22f84157ac664f81ae5266143e743737 [id=4bf839f09513412ea20c5e0afece9c37]) successfully deleted
I20260923 19:50:19.198702 5802 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_fa1d82a491c04ba89f5cf3162578d550 [id=6d79e588fb9e4936aedf8cd500f68d60] alter complete (version 3)
I20260923 19:50:19.198859 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet 58ea466d1b2b40e9b9b4cd5be51f79e0 with delete_type TABLET_DATA_DELETED (replaced by tablet 839bcf991b754f9e95a1dd6c4f826e71) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:19.200073 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 729) took 3525 ms. Trace:
I20260923 19:50:19.200225 6458 rpcz_store.cc:276] 0923 19:50:15.674876 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.674929 (+ 53us) service_pool.cc:224] Handling call
0923 19:50:19.196087 (+3521158us) ts_tablet_manager.cc:1151] Deleting tablet 5494818771f04f92b37a6991b73e40a6
0923 19:50:19.196097 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.200048 (+ 3951us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3520985}
W20260923 19:50:19.200809 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 5494818771f04f92b37a6991b73e40a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5494818771f04f92b37a6991b73e40a6 already in progress: creating tablet
I20260923 19:50:19.201618 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 811) took 1668 ms. Trace:
I20260923 19:50:19.202112 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 730) took 3520 ms. Trace:
I20260923 19:50:19.202253 6458 rpcz_store.cc:276] 0923 19:50:15.681274 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.681335 (+ 61us) service_pool.cc:224] Handling call
0923 19:50:19.202000 (+3520665us) ts_tablet_manager.cc:1151] Deleting tablet 22c89609da884c47b1dbc1470b37efbe
0923 19:50:19.202011 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.202094 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3520484}
I20260923 19:50:19.203754 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_4a2086f6ae26496887ae6c132d8456b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:19.204284 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4a2086f6ae26496887ae6c132d8456b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:19.205446 6459 rpcz_store.cc:276] 0923 19:50:17.533331 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:17.533583 (+ 252us) service_pool.cc:224] Handling call
0923 19:50:19.125964 (+1592381us) ts_tablet_manager.cc:1151] Deleting tablet efc63a151f6444dfb03c3f15f6f54473
0923 19:50:19.125976 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.134802 (+ 8826us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:19.137761 (+ 2959us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:19.201603 (+ 63842us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1591874}
I20260923 19:50:19.205840 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 813) took 1624 ms. Trace:
I20260923 19:50:19.205822 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet efc63a151f6444dfb03c3f15f6f54473 (table default.Table_ee5fbb39c54a49c89eaaff48f72a9c3c [id=20b663f1b2504d4199c2a9a2e9667d5c]) successfully deleted
I20260923 19:50:19.205926 6459 rpcz_store.cc:276] 0923 19:50:17.581130 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:17.581190 (+ 60us) service_pool.cc:224] Handling call
0923 19:50:19.205730 (+1624540us) ts_tablet_manager.cc:1151] Deleting tablet d5d3f96ebf1c4d05aceb06ef53737e4f
0923 19:50:19.205739 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.205825 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1624332}
I20260923 19:50:19.211347 6461 ts_tablet_manager.cc:1929] T 684eb2576b4b4730813b993e36b242df P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260923 19:50:19.211321 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 22c89609da884c47b1dbc1470b37efbe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22c89609da884c47b1dbc1470b37efbe already in progress: creating tablet
I20260923 19:50:19.211742 6458 tablet_replica.cc:333] T 6a2564a99c274e07a7e43da739a2458b P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:19.212019 6458 raft_consensus.cc:2243] T 6a2564a99c274e07a7e43da739a2458b P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:19.212234 6458 raft_consensus.cc:2272] T 6a2564a99c274e07a7e43da739a2458b P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:19.213346 6454 tablet_bootstrap.cc:654] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:19.213744 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet d5d3f96ebf1c4d05aceb06ef53737e4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d5d3f96ebf1c4d05aceb06ef53737e4f already in progress: creating tablet
I20260923 19:50:19.215497 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_4e88efe698fb4357af59132b292c500e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:19.216122 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4e88efe698fb4357af59132b292c500e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:19.216665 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 814) took 1630 ms. Trace:
I20260923 19:50:19.216738 6459 rpcz_store.cc:276] 0923 19:50:17.586246 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:17.586304 (+ 58us) service_pool.cc:224] Handling call
0923 19:50:19.213631 (+1627327us) ts_tablet_manager.cc:1151] Deleting tablet e4375ff709a74bc6b8ef2073fb2c1d18
0923 19:50:19.216551 (+ 2920us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.216647 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":221056,"tablet-delete.queue_time_us":1627123}
I20260923 19:50:19.217247 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 815) took 1563 ms. Trace:
I20260923 19:50:19.217347 6459 rpcz_store.cc:276] 0923 19:50:17.653334 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:17.653479 (+ 145us) service_pool.cc:224] Handling call
0923 19:50:19.217137 (+1563658us) ts_tablet_manager.cc:1151] Deleting tablet e55ab069a0fa48398b39bbb9e7c65cd1
0923 19:50:19.217149 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.217229 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1563470}
W20260923 19:50:19.217840 6137 consensus_peers.cc:597] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6a2564a99c274e07a7e43da739a2458b. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:19.218056 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 816) took 1389 ms. Trace:
I20260923 19:50:19.218221 6459 rpcz_store.cc:276] 0923 19:50:17.828984 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:17.831315 (+ 2331us) service_pool.cc:224] Handling call
0923 19:50:19.217958 (+1386643us) ts_tablet_manager.cc:1151] Deleting tablet 5ad33cd4913941c6aa2fea717608ef7c
0923 19:50:19.217966 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.218041 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1386438}
I20260923 19:50:19.218855 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 817) took 1389 ms. Trace:
I20260923 19:50:19.218915 6458 ts_tablet_manager.cc:1916] T 6a2564a99c274e07a7e43da739a2458b P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:19.218981 6459 rpcz_store.cc:276] 0923 19:50:17.829069 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:17.831567 (+ 2498us) service_pool.cc:224] Handling call
0923 19:50:19.218766 (+1387199us) ts_tablet_manager.cc:1151] Deleting tablet ec5793bdec5244aa8cf13b7fb3b84b8a
0923 19:50:19.218775 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.218841 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1387091}
I20260923 19:50:19.219485 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 823) took 1389 ms. Trace:
I20260923 19:50:19.219610 6459 rpcz_store.cc:276] 0923 19:50:17.829577 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:17.837489 (+ 7912us) service_pool.cc:224] Handling call
0923 19:50:19.219393 (+1381904us) ts_tablet_manager.cc:1151] Deleting tablet 4a034eb9b02d4532b4b68e74c8e5b3fa
0923 19:50:19.219402 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.219471 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1381718}
I20260923 19:50:19.220103 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 828) took 1212 ms. Trace:
W20260923 19:50:19.220104 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet e4375ff709a74bc6b8ef2073fb2c1d18 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4375ff709a74bc6b8ef2073fb2c1d18 already in progress: creating tablet
I20260923 19:50:19.220244 6459 rpcz_store.cc:276] 0923 19:50:18.007235 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.007470 (+ 235us) service_pool.cc:224] Handling call
0923 19:50:19.219996 (+1212526us) ts_tablet_manager.cc:1151] Deleting tablet 37769256de33432697e9d4fb235f473f
0923 19:50:19.220006 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.220074 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1207837}
W20260923 19:50:19.220352 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet e55ab069a0fa48398b39bbb9e7c65cd1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e55ab069a0fa48398b39bbb9e7c65cd1 already in progress: creating tablet
W20260923 19:50:19.220557 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 5ad33cd4913941c6aa2fea717608ef7c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ad33cd4913941c6aa2fea717608ef7c already in progress: creating tablet
W20260923 19:50:19.220796 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet ec5793bdec5244aa8cf13b7fb3b84b8a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ec5793bdec5244aa8cf13b7fb3b84b8a already in progress: creating tablet
W20260923 19:50:19.221007 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 4a034eb9b02d4532b4b68e74c8e5b3fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4a034eb9b02d4532b4b68e74c8e5b3fa already in progress: creating tablet
W20260923 19:50:19.221257 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 37769256de33432697e9d4fb235f473f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 37769256de33432697e9d4fb235f473f already in progress: creating tablet
I20260923 19:50:19.221050 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 829) took 1213 ms. Trace:
I20260923 19:50:19.222998 6461 log.cc:1199] T 684eb2576b4b4730813b993e36b242df P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/684eb2576b4b4730813b993e36b242df
I20260923 19:50:19.223133 6459 rpcz_store.cc:276] 0923 19:50:18.007412 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.007507 (+ 95us) service_pool.cc:224] Handling call
0923 19:50:19.220949 (+1213442us) ts_tablet_manager.cc:1151] Deleting tablet b9c084a319c449328b639d604c00946a
0923 19:50:19.220958 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.221035 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1208606}
I20260923 19:50:19.224367 6461 ts_tablet_manager.cc:1950] T 684eb2576b4b4730813b993e36b242df P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
W20260923 19:50:19.224694 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet b9c084a319c449328b639d604c00946a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9c084a319c449328b639d604c00946a already in progress: creating tablet
I20260923 19:50:19.224862 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 830) took 1160 ms. Trace:
I20260923 19:50:19.224967 6459 rpcz_store.cc:276] 0923 19:50:18.064126 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.064347 (+ 221us) service_pool.cc:224] Handling call
0923 19:50:19.224695 (+1160348us) ts_tablet_manager.cc:1151] Deleting tablet 88640e1a21154073ae0db18b171408b7
0923 19:50:19.224706 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.224845 (+ 139us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1156500}
I20260923 19:50:19.227236 6459 tablet_replica.cc:333] T edb52bd88b424129bbdc45de89b56efb P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:19.227474 6459 raft_consensus.cc:2243] T edb52bd88b424129bbdc45de89b56efb P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:19.227985 6459 raft_consensus.cc:2272] T edb52bd88b424129bbdc45de89b56efb P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:19.230523 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 88640e1a21154073ae0db18b171408b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 88640e1a21154073ae0db18b171408b7 already in progress: creating tablet
I20260923 19:50:19.234282 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 684eb2576b4b4730813b993e36b242df (table default.Table_af4eb1297d19460fade71cf33df073a4 [id=9673e7b97bef46628623a1926735866e]) successfully deleted
I20260923 19:50:19.234357 6461 tablet_replica.cc:333] T a53f2eb08330411ebe417d4e1e414db6 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:19.234540 6461 raft_consensus.cc:2243] T a53f2eb08330411ebe417d4e1e414db6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:19.235373 6454 tablet_bootstrap.cc:492] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:19.235556 6454 ts_tablet_manager.cc:1403] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.042s user 0.003s sys 0.000s
I20260923 19:50:19.236346 6454 raft_consensus.cc:359] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.236590 6454 raft_consensus.cc:385] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:19.236704 6454 raft_consensus.cc:740] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:19.237082 6456 tablet_bootstrap.cc:492] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:19.236995 6454 consensus_queue.cc:260] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.238065 6454 ts_tablet_manager.cc:1434] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:19.241185 6454 tablet_bootstrap.cc:492] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:19.244266 6459 ts_tablet_manager.cc:1916] T edb52bd88b424129bbdc45de89b56efb P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:19.244146 7566 raft_consensus.cc:493] T 6d29923f139445cc86379c80ac15df5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:19.245299 7566 raft_consensus.cc:515] T 6d29923f139445cc86379c80ac15df5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.245949 7566 leader_election.cc:290] T 6d29923f139445cc86379c80ac15df5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:19.246059 7566 raft_consensus.cc:493] T 554655516bb547ad9c2aa1ee66dc8deb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:19.246163 7566 raft_consensus.cc:515] T 554655516bb547ad9c2aa1ee66dc8deb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.246628 7566 leader_election.cc:290] T 554655516bb547ad9c2aa1ee66dc8deb P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:19.247794 6461 raft_consensus.cc:2272] T a53f2eb08330411ebe417d4e1e414db6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:19.248366 6461 ts_tablet_manager.cc:1916] T a53f2eb08330411ebe417d4e1e414db6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:19.248953 6454 tablet_bootstrap.cc:654] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:19.247579 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d29923f139445cc86379c80ac15df5d" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:19.247704 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554655516bb547ad9c2aa1ee66dc8deb" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:19.252159 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_3acadd8cadca4312aa3ab2ff02db21dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:19.252817 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3acadd8cadca4312aa3ab2ff02db21dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:19.252825 5996 leader_election.cc:343] T 6d29923f139445cc86379c80ac15df5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:19.249362 6458 ts_tablet_manager.cc:1929] T 6a2564a99c274e07a7e43da739a2458b P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:19.252987 6458 log.cc:1199] T 6a2564a99c274e07a7e43da739a2458b P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/6a2564a99c274e07a7e43da739a2458b
I20260923 19:50:19.253295 6458 ts_tablet_manager.cc:1950] T 6a2564a99c274e07a7e43da739a2458b P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:19.253582 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 731) took 3566 ms. Trace:
I20260923 19:50:19.253646 6458 rpcz_store.cc:276] 0923 19:50:15.687364 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.687412 (+ 48us) service_pool.cc:224] Handling call
0923 19:50:19.211694 (+3524282us) ts_tablet_manager.cc:1151] Deleting tablet 6a2564a99c274e07a7e43da739a2458b
0923 19:50:19.211704 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.238196 (+ 26492us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:19.249133 (+ 10937us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:19.253570 (+ 4437us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3524126}
I20260923 19:50:19.254045 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 733) took 3533 ms. Trace:
I20260923 19:50:19.254122 6458 rpcz_store.cc:276] 0923 19:50:15.720956 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.721014 (+ 58us) service_pool.cc:224] Handling call
0923 19:50:19.253942 (+3532928us) ts_tablet_manager.cc:1151] Deleting tablet 8788f1917cb0449f84f92df2c81feff6
0923 19:50:19.253951 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.254030 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3518414}
I20260923 19:50:19.254410 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 734) took 3533 ms. Trace:
I20260923 19:50:19.254479 6458 rpcz_store.cc:276] 0923 19:50:15.721055 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.721157 (+ 102us) service_pool.cc:224] Handling call
0923 19:50:19.254320 (+3533163us) ts_tablet_manager.cc:1151] Deleting tablet 8b4c2a0ae64841c6971a0840c1d5b739
0923 19:50:19.254328 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.254395 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3518729}
I20260923 19:50:19.254818 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 735) took 3533 ms. Trace:
I20260923 19:50:19.254861 6456 tablet_bootstrap.cc:654] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:19.254892 6458 rpcz_store.cc:276] 0923 19:50:15.721134 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.721176 (+ 42us) service_pool.cc:224] Handling call
0923 19:50:19.254699 (+3533523us) ts_tablet_manager.cc:1151] Deleting tablet 900726a4f2f84dde90e8bb3ab26b71c9
0923 19:50:19.254707 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.254805 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3519050}
I20260923 19:50:19.255874 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 6a2564a99c274e07a7e43da739a2458b (table default.Table_504b18d33ff6487da9b8f40467850853 [id=97f3cda15d6f4e258eece32745c45b50]) successfully deleted
I20260923 19:50:19.256086 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 737) took 3534 ms. Trace:
W20260923 19:50:19.256135 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 8788f1917cb0449f84f92df2c81feff6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8788f1917cb0449f84f92df2c81feff6 already in progress: creating tablet
I20260923 19:50:19.256155 6458 rpcz_store.cc:276] 0923 19:50:15.721277 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.721323 (+ 46us) service_pool.cc:224] Handling call
0923 19:50:19.255966 (+3534643us) ts_tablet_manager.cc:1151] Deleting tablet 950428e098994f2a9b5b17eeb36915cd
0923 19:50:19.255974 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.256062 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3520278}
I20260923 19:50:19.256382 6458 tablet_replica.cc:333] T d09faa67bdc54d31a7f7a1b012de9ba1 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
W20260923 19:50:19.256364 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 8b4c2a0ae64841c6971a0840c1d5b739 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b4c2a0ae64841c6971a0840c1d5b739 already in progress: creating tablet
I20260923 19:50:19.256548 6458 raft_consensus.cc:2243] T d09faa67bdc54d31a7f7a1b012de9ba1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:19.256685 6458 raft_consensus.cc:2272] T d09faa67bdc54d31a7f7a1b012de9ba1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:19.256983 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 900726a4f2f84dde90e8bb3ab26b71c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 900726a4f2f84dde90e8bb3ab26b71c9 already in progress: creating tablet
I20260923 19:50:19.257164 6458 ts_tablet_manager.cc:1916] T d09faa67bdc54d31a7f7a1b012de9ba1 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:19.257200 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 950428e098994f2a9b5b17eeb36915cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 950428e098994f2a9b5b17eeb36915cd already in progress: creating tablet
I20260923 19:50:19.257603 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_f51ff8d9bbeb4df183cff372b5f59ea3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:19.259958 7490 raft_consensus.cc:493] T c504ec668a33451fb1249f697bb5e2bb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:19.260072 7490 raft_consensus.cc:515] T c504ec668a33451fb1249f697bb5e2bb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.260700 7490 leader_election.cc:290] T c504ec668a33451fb1249f697bb5e2bb P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:19.260999 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504ec668a33451fb1249f697bb5e2bb" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:19.261523 6280 leader_election.cc:343] T c504ec668a33451fb1249f697bb5e2bb P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:19.262745 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f51ff8d9bbeb4df183cff372b5f59ea3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:19.264384 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet 15a9d1d4adaa402f90d774e77010c928 with delete_type TABLET_DATA_DELETED (replaced by tablet 1cf016ff0bb8418d84358d17876338bf) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:19.266350 5996 leader_election.cc:343] T 554655516bb547ad9c2aa1ee66dc8deb P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:19.268296 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 2c6b2e4dac9749e58d01a838c2472bbc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c6b2e4dac9749e58d01a838c2472bbc already in progress: creating tablet
I20260923 19:50:19.268761 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d29923f139445cc86379c80ac15df5d" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:19.268927 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554655516bb547ad9c2aa1ee66dc8deb" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:19.276489 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_0acd2ce4479c42c698a11f94b972a715"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:19.277063 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0acd2ce4479c42c698a11f94b972a715 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:19.279362 5796 master_service.cc:960] ReplaceTablet: received request to replace tablet b92aaac328934d95a89e0fc08a80b0b1 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:19.279695 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_9873b1fe765149cd908dac5d4de14e46" } new_table_name: "default.Table_6c7bfeb2c18a4072b4c7fbae8e9f4d01" modify_external_catalogs: true
I20260923 19:50:19.280802 7630 raft_consensus.cc:493] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:19.280928 7630 raft_consensus.cc:515] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.281459 5797 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_53ff161409a94c28a2d7f0a67a6eb839" } new_table_name: "default.Table_3d9342fd2cd6461fbe41bd5fb06e783c" modify_external_catalogs: true
I20260923 19:50:19.281558 7630 leader_election.cc:290] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:19.282222 6137 leader_election.cc:343] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 474e34e902064764864ba06ef41b1d94
W20260923 19:50:19.282639 6280 consensus_peers.cc:597] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:19.282960 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "474e34e902064764864ba06ef41b1d94" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:19.283139 6342 raft_consensus.cc:2468] T 474e34e902064764864ba06ef41b1d94 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:19.283502 6139 leader_election.cc:304] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:19.283870 7630 raft_consensus.cc:2804] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:19.283949 7630 raft_consensus.cc:493] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:19.284024 7630 raft_consensus.cc:3060] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:19.285827 6454 tablet_bootstrap.cc:492] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:19.285969 6454 ts_tablet_manager.cc:1403] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.045s user 0.002s sys 0.001s
I20260923 19:50:19.286569 7630 raft_consensus.cc:515] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.287732 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "474e34e902064764864ba06ef41b1d94" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:19.287899 6342 raft_consensus.cc:3060] T 474e34e902064764864ba06ef41b1d94 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:19.291168 6342 raft_consensus.cc:2468] T 474e34e902064764864ba06ef41b1d94 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:19.291623 6139 leader_election.cc:304] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:19.291873 7633 raft_consensus.cc:2804] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:19.292012 7633 raft_consensus.cc:697] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:19.292265 7633 consensus_queue.cc:237] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.293196 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_afb0915cafc4475889ceb6252cd0eb9c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:19.291873 7630 leader_election.cc:290] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:19.293859 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_afb0915cafc4475889ceb6252cd0eb9c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:19.295179 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_387466f7eef54d308b97edbff5fb6587"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:19.295626 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_387466f7eef54d308b97edbff5fb6587 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:19.300148 6459 ts_tablet_manager.cc:1929] T edb52bd88b424129bbdc45de89b56efb P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:19.303438 6456 tablet_bootstrap.cc:492] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:19.303691 6456 ts_tablet_manager.cc:1403] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.067s user 0.004s sys 0.000s
I20260923 19:50:19.304881 6456 raft_consensus.cc:359] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.305204 6456 raft_consensus.cc:385] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:19.305349 6456 raft_consensus.cc:740] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:19.305548 6458 ts_tablet_manager.cc:1929] T d09faa67bdc54d31a7f7a1b012de9ba1 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260923 19:50:19.311348 5995 leader_election.cc:343] T 6d29923f139445cc86379c80ac15df5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:19.311478 5995 leader_election.cc:304] T 6d29923f139445cc86379c80ac15df5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
W20260923 19:50:19.311857 5995 leader_election.cc:343] T 554655516bb547ad9c2aa1ee66dc8deb P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:19.311940 5995 leader_election.cc:304] T 554655516bb547ad9c2aa1ee66dc8deb P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:19.312254 7566 raft_consensus.cc:2749] T 6d29923f139445cc86379c80ac15df5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:19.312420 7566 raft_consensus.cc:2749] T 554655516bb547ad9c2aa1ee66dc8deb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:19.314517 5805 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7b0ae7c8259245379ef654b3a96718e0" } modify_external_catalogs: true
I20260923 19:50:19.314778 5805 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7b0ae7c8259245379ef654b3a96718e0" } modify_external_catalogs: true
I20260923 19:50:19.314853 6461 ts_tablet_manager.cc:1929] T a53f2eb08330411ebe417d4e1e414db6 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:19.314957 6461 log.cc:1199] T a53f2eb08330411ebe417d4e1e414db6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/a53f2eb08330411ebe417d4e1e414db6
I20260923 19:50:19.315264 6461 ts_tablet_manager.cc:1950] T a53f2eb08330411ebe417d4e1e414db6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:19.316253 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet a53f2eb08330411ebe417d4e1e414db6 (table default.Table_1d212a8856d940d8898230b16d0e0aa2 [id=24a351e6e5744e70abf6776a741dbbe3]) successfully deleted
I20260923 19:50:19.316431 6461 tablet_replica.cc:333] T a10d35bf564d45488524d3d21721f4e5 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:19.316604 6461 raft_consensus.cc:2243] T a10d35bf564d45488524d3d21721f4e5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:19.316740 6461 raft_consensus.cc:2272] T a10d35bf564d45488524d3d21721f4e5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:19.316769 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 377f4454d8c846e08d6207ceacf4797a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 377f4454d8c846e08d6207ceacf4797a already in progress: creating tablet
W20260923 19:50:19.317005 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 6c33a99f88a9401fa296c4fefb8bcfc1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c33a99f88a9401fa296c4fefb8bcfc1 already in progress: creating tablet
I20260923 19:50:19.317261 6461 ts_tablet_manager.cc:1916] T a10d35bf564d45488524d3d21721f4e5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:19.300273 6459 log.cc:1199] T edb52bd88b424129bbdc45de89b56efb P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/edb52bd88b424129bbdc45de89b56efb
I20260923 19:50:19.318322 6459 ts_tablet_manager.cc:1950] T edb52bd88b424129bbdc45de89b56efb P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:19.318861 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 831) took 1254 ms. Trace:
I20260923 19:50:19.318977 6459 rpcz_store.cc:276] 0923 19:50:18.064223 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.064543 (+ 320us) service_pool.cc:224] Handling call
0923 19:50:19.227190 (+1162647us) ts_tablet_manager.cc:1151] Deleting tablet edb52bd88b424129bbdc45de89b56efb
0923 19:50:19.227200 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.278531 (+ 51331us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:19.300088 (+ 21557us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:19.318845 (+ 18757us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1158935}
I20260923 19:50:19.319416 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet edb52bd88b424129bbdc45de89b56efb (table default.Table_42710edebf0e439ba99e3c85c82be9f4 [id=918936f42dad4927bd643541a36f9e5a]) successfully deleted
W20260923 19:50:19.319532 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fa2f4219b66c4e0b99f9bfa55b1b2c87 consensus state has no leader
I20260923 19:50:19.319600 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 832) took 1255 ms. Trace:
I20260923 19:50:19.319660 6459 rpcz_store.cc:276] 0923 19:50:18.064307 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.064651 (+ 344us) service_pool.cc:224] Handling call
0923 19:50:19.319443 (+1254792us) ts_tablet_manager.cc:1151] Deleting tablet 29e6ea6b3eda4df88a539627d4505885
0923 19:50:19.319452 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.319582 (+ 130us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1251146}
W20260923 19:50:19.320034 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 29e6ea6b3eda4df88a539627d4505885 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29e6ea6b3eda4df88a539627d4505885 already in progress: creating tablet
I20260923 19:50:19.320370 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 833) took 1230 ms. Trace:
I20260923 19:50:19.320477 6459 rpcz_store.cc:276] 0923 19:50:18.089563 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.089628 (+ 65us) service_pool.cc:224] Handling call
0923 19:50:19.320004 (+1230376us) ts_tablet_manager.cc:1151] Deleting tablet 0c30bd7ab8fa42dea5de04c8d36f2e54
0923 19:50:19.320013 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.320351 (+ 338us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1191943}
I20260923 19:50:19.320551 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_d754487fb38a4e219f51df72bb4c51a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:19.320870 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 0c30bd7ab8fa42dea5de04c8d36f2e54 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c30bd7ab8fa42dea5de04c8d36f2e54 already in progress: creating tablet
I20260923 19:50:19.321019 6459 tablet_replica.cc:333] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
W20260923 19:50:19.321144 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d754487fb38a4e219f51df72bb4c51a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:19.321269 6459 raft_consensus.cc:2243] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:19.321557 6459 pending_rounds.cc:70] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:19.321718 6458 log.cc:1199] T d09faa67bdc54d31a7f7a1b012de9ba1 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/d09faa67bdc54d31a7f7a1b012de9ba1
I20260923 19:50:19.321817 6459 pending_rounds.cc:77] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630602724143104 op_type: NO_OP noop_request { }
W20260923 19:50:19.313553 6279 leader_election.cc:343] T c504ec668a33451fb1249f697bb5e2bb P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: c504ec668a33451fb1249f697bb5e2bb
I20260923 19:50:19.322257 6458 ts_tablet_manager.cc:1950] T d09faa67bdc54d31a7f7a1b012de9ba1 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:19.322296 6279 leader_election.cc:304] T c504ec668a33451fb1249f697bb5e2bb P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:19.322830 7256 raft_consensus.cc:2749] T c504ec668a33451fb1249f697bb5e2bb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:19.322950 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 743) took 3557 ms. Trace:
I20260923 19:50:19.323012 6458 rpcz_store.cc:276] 0923 19:50:15.765176 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.781168 (+ 15992us) service_pool.cc:224] Handling call
0923 19:50:19.256344 (+3475176us) ts_tablet_manager.cc:1151] Deleting tablet d09faa67bdc54d31a7f7a1b012de9ba1
0923 19:50:19.256352 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.284598 (+ 28246us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:19.305501 (+ 20903us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:19.322935 (+ 17434us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3475005}
I20260923 19:50:19.323436 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 753) took 3395 ms. Trace:
I20260923 19:50:19.323645 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet d09faa67bdc54d31a7f7a1b012de9ba1 (table default.Table_605d43f9448e4b4bb429f8bf52d6ac55 [id=834c18797d8e48a79c45628c5180b80b]) successfully deleted
I20260923 19:50:19.324178 6459 raft_consensus.cc:2889] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:19.324317 6459 raft_consensus.cc:2272] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:19.324882 6459 ts_tablet_manager.cc:1916] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:19.311239 6249 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
I20260923 19:50:19.305804 6456 consensus_queue.cc:260] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.318089 7490 raft_consensus.cc:493] T a53f2eb08330411ebe417d4e1e414db6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:19.329274 7490 raft_consensus.cc:515] T a53f2eb08330411ebe417d4e1e414db6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.286586 6454 raft_consensus.cc:359] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:19.313452 6137 leader_election.cc:343] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 474e34e902064764864ba06ef41b1d94
I20260923 19:50:19.329679 6457 tablet_bootstrap.cc:492] T 397ec5e49673406cb26a2efab0ad8401 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:19.329741 6454 raft_consensus.cc:385] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:19.329813 6457 ts_tablet_manager.cc:1403] T 397ec5e49673406cb26a2efab0ad8401 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.253s user 0.003s sys 0.010s
I20260923 19:50:19.329820 6454 raft_consensus.cc:740] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:19.329931 7490 leader_election.cc:290] T a53f2eb08330411ebe417d4e1e414db6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:19.330031 6454 consensus_queue.cc:260] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.330492 6457 raft_consensus.cc:359] T 397ec5e49673406cb26a2efab0ad8401 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:19.330653 6457 raft_consensus.cc:385] T 397ec5e49673406cb26a2efab0ad8401 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:19.330705 6457 raft_consensus.cc:740] T 397ec5e49673406cb26a2efab0ad8401 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:19.330900 6457 consensus_queue.cc:260] T 397ec5e49673406cb26a2efab0ad8401 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:19.331413 6457 ts_tablet_manager.cc:1434] T 397ec5e49673406cb26a2efab0ad8401 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:19.331669 6457 tablet_bootstrap.cc:492] T 64e8951eb899461aa9c0b36e3f7555e2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:19.331589 6454 ts_tablet_manager.cc:1434] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.045s user 0.001s sys 0.000s
I20260923 19:50:19.332533 6454 tablet_bootstrap.cc:492] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:19.333037 6457 tablet_bootstrap.cc:654] T 64e8951eb899461aa9c0b36e3f7555e2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:19.333806 6279 leader_election.cc:343] T a53f2eb08330411ebe417d4e1e414db6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: a53f2eb08330411ebe417d4e1e414db6
I20260923 19:50:19.334429 6456 ts_tablet_manager.cc:1434] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.031s user 0.002s sys 0.000s
I20260923 19:50:19.339273 6456 tablet_bootstrap.cc:492] T b9c187ee1fa8438397c83bc2c2b16925 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:19.340332 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a53f2eb08330411ebe417d4e1e414db6" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:19.342854 6280 leader_election.cc:343] T a53f2eb08330411ebe417d4e1e414db6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:19.342972 6280 leader_election.cc:304] T a53f2eb08330411ebe417d4e1e414db6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:19.343442 7490 raft_consensus.cc:2749] T a53f2eb08330411ebe417d4e1e414db6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:19.346642 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f7689828ca5b47309bff533ce9410d33" } new_table_name: "default.Table_ad8fc0dedf9e422a8e5b3ff52a7a1a8d" modify_external_catalogs: true
W20260923 19:50:19.349153 5797 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7f9ec2a95bad40f7b229482b275110a3 consensus state has no leader
I20260923 19:50:19.350329 5797 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_1916c5305d984163ac72fcf98ce30e62" } modify_external_catalogs: true
I20260923 19:50:19.351212 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet 28f9d03be14a4072aab7fd03834c3f6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:19.351224 5797 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_1916c5305d984163ac72fcf98ce30e62" } modify_external_catalogs: true
I20260923 19:50:19.350816 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_03758cc797e644e98a922d8a281f2cd6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:19.351866 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_03758cc797e644e98a922d8a281f2cd6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:19.353991 6456 tablet_bootstrap.cc:654] T b9c187ee1fa8438397c83bc2c2b16925 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:19.354848 6458 rpcz_store.cc:276] 0923 19:50:15.928194 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.930070 (+ 1876us) service_pool.cc:224] Handling call
0923 19:50:19.323303 (+3393233us) ts_tablet_manager.cc:1151] Deleting tablet f9687b3f4b904e438d83533fb67cc92f
0923 19:50:19.323314 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.323418 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3392996}
I20260923 19:50:19.355239 6458 tablet_replica.cc:333] T a11ecef9a24f4e4a812ec220b6a92cc4 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
W20260923 19:50:19.355600 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet f9687b3f4b904e438d83533fb67cc92f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f9687b3f4b904e438d83533fb67cc92f already in progress: creating tablet
I20260923 19:50:19.357175 6454 tablet_bootstrap.cc:654] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:19.358065 6458 raft_consensus.cc:2243] T a11ecef9a24f4e4a812ec220b6a92cc4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:19.359313 5803 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_0f07ebb3890d464f8787e3406572d342" } modify_external_catalogs: true
I20260923 19:50:19.359499 5803 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_0f07ebb3890d464f8787e3406572d342" } modify_external_catalogs: true
I20260923 19:50:19.362005 6458 raft_consensus.cc:2272] T a11ecef9a24f4e4a812ec220b6a92cc4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:19.362165 6280 consensus_peers.cc:597] T 2398c59871d241f985bca1761e722180 P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:19.362607 6458 ts_tablet_manager.cc:1916] T a11ecef9a24f4e4a812ec220b6a92cc4 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:19.367614 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_c58f36e09d464c3fb0a88f2a5aef1b25" } new_table_name: "default.Table_136cce45fffc467a96f186223617bc28" modify_external_catalogs: true
I20260923 19:50:19.370569 6457 tablet_bootstrap.cc:492] T 64e8951eb899461aa9c0b36e3f7555e2 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:19.370806 6457 ts_tablet_manager.cc:1403] T 64e8951eb899461aa9c0b36e3f7555e2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.039s user 0.005s sys 0.004s
I20260923 19:50:19.374696 6457 raft_consensus.cc:359] T 64e8951eb899461aa9c0b36e3f7555e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:19.374982 6457 raft_consensus.cc:385] T 64e8951eb899461aa9c0b36e3f7555e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:19.375133 6457 raft_consensus.cc:740] T 64e8951eb899461aa9c0b36e3f7555e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:19.375514 6457 consensus_queue.cc:260] T 64e8951eb899461aa9c0b36e3f7555e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
W20260923 19:50:19.375890 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5f1a3b9bd2754a868908973cc79262e2 consensus state has no leader
I20260923 19:50:19.385075 6459 ts_tablet_manager.cc:1929] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:19.385169 6457 ts_tablet_manager.cc:1434] T 64e8951eb899461aa9c0b36e3f7555e2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260923 19:50:19.385593 6459 log.cc:1199] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/6a2564a99c274e07a7e43da739a2458b
W20260923 19:50:19.386086 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 242a63d6282f435aa94fb4307c15ca8a consensus state has no leader
I20260923 19:50:19.387014 6459 ts_tablet_manager.cc:1950] T 6a2564a99c274e07a7e43da739a2458b P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:19.385648 6457 tablet_bootstrap.cc:492] T 92f94b93d1364bb1a2562eb577707cf1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:19.388923 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 834) took 1248 ms. Trace:
I20260923 19:50:19.391441 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_4182e2a68072409081f00598f5232c5a" } new_table_name: "default.Table_96971b48003e446cb8778c53a97923f3" modify_external_catalogs: true
I20260923 19:50:19.393143 6459 rpcz_store.cc:276] 0923 19:50:18.140325 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.140381 (+ 56us) service_pool.cc:224] Handling call
0923 19:50:19.320978 (+1180597us) ts_tablet_manager.cc:1151] Deleting tablet 6a2564a99c274e07a7e43da739a2458b
0923 19:50:19.320987 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.366679 (+ 45692us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:19.385010 (+ 18331us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:19.388904 (+ 3894us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1180363}
I20260923 19:50:19.394075 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 835) took 1246 ms. Trace:
I20260923 19:50:19.394809 7362 raft_consensus.cc:493] T b18548ba557f448880c5e617fc03cbe0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:19.394953 7362 raft_consensus.cc:515] T b18548ba557f448880c5e617fc03cbe0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.395539 7362 leader_election.cc:290] T b18548ba557f448880c5e617fc03cbe0 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:19.398000 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 6a2564a99c274e07a7e43da739a2458b (table default.Table_504b18d33ff6487da9b8f40467850853 [id=97f3cda15d6f4e258eece32745c45b50]) successfully deleted
W20260923 19:50:19.398361 6279 leader_election.cc:343] T b18548ba557f448880c5e617fc03cbe0 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: b18548ba557f448880c5e617fc03cbe0
I20260923 19:50:19.401396 5799 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 397ec5e49673406cb26a2efab0ad8401 (table default.Table_92f3bea4e4164a738fb75f01e95cd776 [id=0b80967a8fb94518ad872fbce9bae934]). Expected version 1 got 0
I20260923 19:50:19.407593 6024 tablet_service.cc:1558] Processing DeleteTablet for tablet 64e8951eb899461aa9c0b36e3f7555e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:19.408607 6457 tablet_bootstrap.cc:654] T 92f94b93d1364bb1a2562eb577707cf1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:19.409349 5802 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 85b7dcf131c54187a6e61f8503c797f8 (table default.Table_23c500b65dba4b6790b4349e5a5b0a07 [id=647997210f5349a68aa98d24e12a33cd]). Expected version 2 got 0
I20260923 19:50:19.397987 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b18548ba557f448880c5e617fc03cbe0" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:19.402743 6454 tablet_bootstrap.cc:492] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:19.411419 6454 ts_tablet_manager.cc:1403] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.079s user 0.003s sys 0.001s
I20260923 19:50:19.411521 6459 rpcz_store.cc:276] 0923 19:50:18.147672 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.147730 (+ 58us) service_pool.cc:224] Handling call
0923 19:50:19.393944 (+1246214us) ts_tablet_manager.cc:1151] Deleting tablet 670d9cb0e6e2414092f72ffd5e6b00ea
0923 19:50:19.393955 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.394058 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1246038}
W20260923 19:50:19.411732 6280 leader_election.cc:343] T b18548ba557f448880c5e617fc03cbe0 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:19.411898 6280 leader_election.cc:304] T b18548ba557f448880c5e617fc03cbe0 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:19.412281 7362 raft_consensus.cc:2749] T b18548ba557f448880c5e617fc03cbe0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:19.412201 6454 raft_consensus.cc:359] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.412760 6454 raft_consensus.cc:385] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:19.412842 6454 raft_consensus.cc:740] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:19.413110 6454 consensus_queue.cc:260] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.415972 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet d8c8bfa9b7424b9f80f76e0bb05cbc0c with delete_type TABLET_DATA_DELETED (replaced by tablet cf64073cdde748bc8ed3ce7580a71160) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:19.417047 6454 ts_tablet_manager.cc:1434] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260923 19:50:19.417341 6454 tablet_bootstrap.cc:492] T a53f2eb08330411ebe417d4e1e414db6 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
W20260923 19:50:19.418843 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 670d9cb0e6e2414092f72ffd5e6b00ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 670d9cb0e6e2414092f72ffd5e6b00ea already in progress: creating tablet
I20260923 19:50:19.420576 5800 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 146a402ff29a4e0b834a9f270d61e21c
I20260923 19:50:19.421245 6024 tablet_service.cc:1558] Processing DeleteTablet for tablet 146a402ff29a4e0b834a9f270d61e21c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:19.419003 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 836) took 1221 ms. Trace:
I20260923 19:50:19.412516 6458 ts_tablet_manager.cc:1929] T a11ecef9a24f4e4a812ec220b6a92cc4 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:19.422220 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet 146a402ff29a4e0b834a9f270d61e21c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:19.423878 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet 146a402ff29a4e0b834a9f270d61e21c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:19.422794 6458 log.cc:1199] T a11ecef9a24f4e4a812ec220b6a92cc4 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/a11ecef9a24f4e4a812ec220b6a92cc4
I20260923 19:50:19.421990 6459 rpcz_store.cc:276] 0923 19:50:18.198000 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.198168 (+ 168us) service_pool.cc:224] Handling call
0923 19:50:19.418262 (+1220094us) ts_tablet_manager.cc:1151] Deleting tablet e5fce24b9dc244c88ccbc16b633924fe
0923 19:50:19.418310 (+ 48us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.418984 (+ 674us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1216101}
W20260923 19:50:19.426105 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet e5fce24b9dc244c88ccbc16b633924fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e5fce24b9dc244c88ccbc16b633924fe already in progress: creating tablet
I20260923 19:50:19.426808 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_4acfbc383985447a8e2fdce9f2eb4732"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:19.426995 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 838) took 1156 ms. Trace:
W20260923 19:50:19.427431 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4acfbc383985447a8e2fdce9f2eb4732 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:19.427652 6458 ts_tablet_manager.cc:1950] T a11ecef9a24f4e4a812ec220b6a92cc4 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:19.427390 6459 rpcz_store.cc:276] 0923 19:50:18.270180 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.270368 (+ 188us) service_pool.cc:224] Handling call
0923 19:50:19.426057 (+1155689us) ts_tablet_manager.cc:1151] Deleting tablet 717101b8668f4cadb5180bb8e17939e9
0923 19:50:19.426073 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.426800 (+ 727us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1155287}
W20260923 19:50:19.431104 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 717101b8668f4cadb5180bb8e17939e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 717101b8668f4cadb5180bb8e17939e9 already in progress: creating tablet
I20260923 19:50:19.431490 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_513c611bb84f4cd298d10c9d544be1dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:19.432147 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_513c611bb84f4cd298d10c9d544be1dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:19.431808 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 839) took 1160 ms. Trace:
I20260923 19:50:19.432418 6459 rpcz_store.cc:276] 0923 19:50:18.270313 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.270786 (+ 473us) service_pool.cc:224] Handling call
0923 19:50:19.429617 (+1158831us) ts_tablet_manager.cc:1151] Deleting tablet e6e04d16675443fc923a5f8216e292b6
0923 19:50:19.429627 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.430490 (+ 863us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1158522}
I20260923 19:50:19.434669 6199 raft_consensus.cc:3060] T 12f4abb573bd4be6961b55c27c684d06 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:19.441048 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet c504ec668a33451fb1249f697bb5e2bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:19.444118 7633 raft_consensus.cc:493] T 2ce6378a6bd844a485aebb96081307e3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:19.444247 7633 raft_consensus.cc:515] T 2ce6378a6bd844a485aebb96081307e3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.444871 6457 tablet_bootstrap.cc:492] T 92f94b93d1364bb1a2562eb577707cf1 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:19.444981 7633 leader_election.cc:290] T 2ce6378a6bd844a485aebb96081307e3 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:19.445019 6457 ts_tablet_manager.cc:1403] T 92f94b93d1364bb1a2562eb577707cf1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.059s user 0.002s sys 0.002s
I20260923 19:50:19.446364 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ce6378a6bd844a485aebb96081307e3" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:19.445825 6457 raft_consensus.cc:359] T 92f94b93d1364bb1a2562eb577707cf1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:19.446573 6457 raft_consensus.cc:385] T 92f94b93d1364bb1a2562eb577707cf1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:19.446636 6457 raft_consensus.cc:740] T 92f94b93d1364bb1a2562eb577707cf1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:19.446974 6457 consensus_queue.cc:260] T 92f94b93d1364bb1a2562eb577707cf1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:19.447695 6457 ts_tablet_manager.cc:1434] T 92f94b93d1364bb1a2562eb577707cf1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:50:19.447770 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_d16de156c2e44c64bc6c3e69d8e5e229"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:19.448047 6454 tablet_bootstrap.cc:654] T a53f2eb08330411ebe417d4e1e414db6 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:19.448459 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d16de156c2e44c64bc6c3e69d8e5e229 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:19.452569 6024 tablet_service.cc:1558] Processing DeleteTablet for tablet 92f94b93d1364bb1a2562eb577707cf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:19.460650 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8c5ac79e5fa2438a87db948792d448b1 consensus state has no leader
I20260923 19:50:19.461023 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 373d6442546d41e2b5567dfc92ae07b1
I20260923 19:50:19.461621 6457 tablet_bootstrap.cc:492] T ba639d8c68cf49a49a5ec5729143cf6b P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:19.462652 6024 tablet_service.cc:1558] Processing DeleteTablet for tablet 373d6442546d41e2b5567dfc92ae07b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:19.464020 6457 tablet_bootstrap.cc:654] T ba639d8c68cf49a49a5ec5729143cf6b P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:19.466077 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet 373d6442546d41e2b5567dfc92ae07b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:19.470711 7633 raft_consensus.cc:493] T c19298691d5d4209b2d1147a1aad2f6f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:19.470847 7633 raft_consensus.cc:515] T c19298691d5d4209b2d1147a1aad2f6f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.471472 7633 leader_election.cc:290] T c19298691d5d4209b2d1147a1aad2f6f P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:19.471333 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_881b324c0d704404a8ae93733a126fc6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:19.472167 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_881b324c0d704404a8ae93733a126fc6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:19.472843 6137 leader_election.cc:343] T c19298691d5d4209b2d1147a1aad2f6f P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: c19298691d5d4209b2d1147a1aad2f6f
I20260923 19:50:19.478863 6454 tablet_bootstrap.cc:492] T a53f2eb08330411ebe417d4e1e414db6 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:19.479060 6454 ts_tablet_manager.cc:1403] T a53f2eb08330411ebe417d4e1e414db6 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.062s user 0.004s sys 0.005s
I20260923 19:50:19.481536 6454 raft_consensus.cc:359] T a53f2eb08330411ebe417d4e1e414db6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.482347 6454 raft_consensus.cc:385] T a53f2eb08330411ebe417d4e1e414db6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:19.482478 6454 raft_consensus.cc:740] T a53f2eb08330411ebe417d4e1e414db6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:19.482592 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_837af71cfb55497889202017772a3869"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:19.482785 6454 consensus_queue.cc:260] T a53f2eb08330411ebe417d4e1e414db6 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:19.483129 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_837af71cfb55497889202017772a3869 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:19.483345 6454 ts_tablet_manager.cc:1434] T a53f2eb08330411ebe417d4e1e414db6 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260923 19:50:19.483624 6454 tablet_bootstrap.cc:492] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
W20260923 19:50:19.485190 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet e6e04d16675443fc923a5f8216e292b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6e04d16675443fc923a5f8216e292b6 already in progress: creating tablet
I20260923 19:50:19.485375 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 754) took 3524 ms. Trace:
I20260923 19:50:19.485751 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 843) took 1192 ms. Trace:
I20260923 19:50:19.485824 6459 rpcz_store.cc:276] 0923 19:50:18.293329 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.293396 (+ 67us) service_pool.cc:224] Handling call
0923 19:50:19.484900 (+1191504us) ts_tablet_manager.cc:1151] Deleting tablet c462a9a5bde64e8094d7a2ca09740fc9
0923 19:50:19.485635 (+ 735us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.485728 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1191308}
W20260923 19:50:19.486754 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet c462a9a5bde64e8094d7a2ca09740fc9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c462a9a5bde64e8094d7a2ca09740fc9 already in progress: creating tablet
I20260923 19:50:19.487036 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 841) took 1194 ms. Trace:
I20260923 19:50:19.487118 6459 rpcz_store.cc:276] 0923 19:50:18.293092 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.301756 (+ 8664us) service_pool.cc:224] Handling call
0923 19:50:19.486744 (+1184988us) ts_tablet_manager.cc:1151] Deleting tablet 355b2fc61d4f4efd918204079f1ebf35
0923 19:50:19.486929 (+ 185us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.487020 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1184779}
W20260923 19:50:19.487462 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 355b2fc61d4f4efd918204079f1ebf35 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 355b2fc61d4f4efd918204079f1ebf35 already in progress: creating tablet
I20260923 19:50:19.485483 6458 rpcz_store.cc:276] 0923 19:50:15.960423 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.961625 (+ 1202us) service_pool.cc:224] Handling call
0923 19:50:19.355193 (+3393568us) ts_tablet_manager.cc:1151] Deleting tablet a11ecef9a24f4e4a812ec220b6a92cc4
0923 19:50:19.355202 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.381893 (+ 26691us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:19.412465 (+ 30572us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:19.485350 (+ 72885us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3388201}
I20260923 19:50:19.488045 6458 tablet_replica.cc:333] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:19.488221 6458 raft_consensus.cc:2243] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:19.488421 6459 tablet_replica.cc:333] T 0e123b69877e4b1fbcdb2b27960864e9 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:19.488817 6459 raft_consensus.cc:2243] T 0e123b69877e4b1fbcdb2b27960864e9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:19.488615 6458 raft_consensus.cc:2272] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:19.489502 6458 ts_tablet_manager.cc:1916] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:19.489805 6459 pending_rounds.cc:70] T 0e123b69877e4b1fbcdb2b27960864e9 P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:19.490689 6459 pending_rounds.cc:77] T 0e123b69877e4b1fbcdb2b27960864e9 P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630604998770688 op_type: NO_OP noop_request { }
I20260923 19:50:19.490886 6459 raft_consensus.cc:2889] T 0e123b69877e4b1fbcdb2b27960864e9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:19.491041 6459 raft_consensus.cc:2272] T 0e123b69877e4b1fbcdb2b27960864e9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:19.493372 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet a11ecef9a24f4e4a812ec220b6a92cc4 (table default.Table_ba859ce2dc954a94ac103be8f6037961 [id=712c6403e1b74895b79a3f7484db7347]) successfully deleted
I20260923 19:50:19.496909 6454 tablet_bootstrap.cc:654] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:19.498133 6459 ts_tablet_manager.cc:1916] T 0e123b69877e4b1fbcdb2b27960864e9 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:19.500538 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ce6378a6bd844a485aebb96081307e3" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:19.374708 6461 ts_tablet_manager.cc:1929] T a10d35bf564d45488524d3d21721f4e5 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:19.501502 6461 log.cc:1199] T a10d35bf564d45488524d3d21721f4e5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/a10d35bf564d45488524d3d21721f4e5
I20260923 19:50:19.502254 6461 ts_tablet_manager.cc:1950] T a10d35bf564d45488524d3d21721f4e5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:19.502955 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_6a2816b94a404ecfb0b24bd5bddc4a51"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:19.503672 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a2816b94a404ecfb0b24bd5bddc4a51 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:19.504123 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet 373d6442546d41e2b5567dfc92ae07b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:19.504830 6139 leader_election.cc:304] T 2ce6378a6bd844a485aebb96081307e3 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:19.504859 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet a10d35bf564d45488524d3d21721f4e5 (table default.Table_c670311ee64c4e728677dc29691ea3f9 [id=fa0ce77597ba4d37aca817429efd86b7]) successfully deleted
I20260923 19:50:19.505388 7633 raft_consensus.cc:2749] T 2ce6378a6bd844a485aebb96081307e3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:19.505906 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 3dead6c00e2c4516aa01547496a207fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3dead6c00e2c4516aa01547496a207fe already in progress: creating tablet
W20260923 19:50:19.506136 6139 leader_election.cc:343] T c19298691d5d4209b2d1147a1aad2f6f P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: c19298691d5d4209b2d1147a1aad2f6f
I20260923 19:50:19.506258 6139 leader_election.cc:304] T c19298691d5d4209b2d1147a1aad2f6f P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:19.506592 7630 raft_consensus.cc:2749] T c19298691d5d4209b2d1147a1aad2f6f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:19.515496 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet f36c34465066473f94da61da73f521ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f36c34465066473f94da61da73f521ff already in progress: creating tablet
W20260923 19:50:19.518018 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 77aa9699460440e7906957855b97448e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 77aa9699460440e7906957855b97448e already in progress: creating tablet
I20260923 19:50:19.519233 6457 tablet_bootstrap.cc:492] T ba639d8c68cf49a49a5ec5729143cf6b P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:19.519433 6457 ts_tablet_manager.cc:1403] T ba639d8c68cf49a49a5ec5729143cf6b P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.071s user 0.004s sys 0.000s
I20260923 19:50:19.520228 6457 raft_consensus.cc:359] T ba639d8c68cf49a49a5ec5729143cf6b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:19.520565 6457 raft_consensus.cc:385] T ba639d8c68cf49a49a5ec5729143cf6b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:19.520674 6457 raft_consensus.cc:740] T ba639d8c68cf49a49a5ec5729143cf6b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:19.520959 6457 consensus_queue.cc:260] T ba639d8c68cf49a49a5ec5729143cf6b P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:19.521515 7362 consensus_queue.cc:1048] T 2398c59871d241f985bca1761e722180 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:19.521998 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 94a6af2036ae47cfbbd0f6940b596218
I20260923 19:50:19.523419 6457 ts_tablet_manager.cc:1434] T ba639d8c68cf49a49a5ec5729143cf6b P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260923 19:50:19.523483 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet 94a6af2036ae47cfbbd0f6940b596218 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:19.525523 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet 94a6af2036ae47cfbbd0f6940b596218 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:19.524494 6024 tablet_service.cc:1558] Processing DeleteTablet for tablet 94a6af2036ae47cfbbd0f6940b596218 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:19.526686 6457 tablet_bootstrap.cc:492] T f8052b05169b4673b387ac8b716ffc4e P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:19.527613 5799 master_service.cc:960] ReplaceTablet: received request to replace tablet 670d9cb0e6e2414092f72ffd5e6b00ea from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:19.528196 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_4d1a0d71d11f4c0a8c80b3ba7ea0c358" } new_table_name: "default.Table_4204ac3c27de40fa97f12202e7d55cb1" modify_external_catalogs: true
I20260923 19:50:19.528788 6456 tablet_bootstrap.cc:492] T b9c187ee1fa8438397c83bc2c2b16925 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:19.528908 6456 ts_tablet_manager.cc:1403] T b9c187ee1fa8438397c83bc2c2b16925 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.190s user 0.006s sys 0.009s
I20260923 19:50:19.529592 6456 raft_consensus.cc:359] T b9c187ee1fa8438397c83bc2c2b16925 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.529734 6456 raft_consensus.cc:385] T b9c187ee1fa8438397c83bc2c2b16925 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:19.529779 6456 raft_consensus.cc:740] T b9c187ee1fa8438397c83bc2c2b16925 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:19.530519 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_5963af8353624db69dbdcb2fb3f0ecb1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:19.531054 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5963af8353624db69dbdcb2fb3f0ecb1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:19.531795 6456 consensus_queue.cc:260] T b9c187ee1fa8438397c83bc2c2b16925 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.537658 6461 tablet_replica.cc:333] T 5427b0f0218d4131b68a39e8e3bf02e7 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:19.539288 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 9ee02922d2be45f5a1473a53a6f253c4
I20260923 19:50:19.540457 6024 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ee02922d2be45f5a1473a53a6f253c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:19.540731 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet b9c187ee1fa8438397c83bc2c2b16925 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:19.540902 6310 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ee02922d2be45f5a1473a53a6f253c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:19.541447 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ee02922d2be45f5a1473a53a6f253c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:19.541966 6456 ts_tablet_manager.cc:1434] T b9c187ee1fa8438397c83bc2c2b16925 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.013s user 0.000s sys 0.002s
I20260923 19:50:19.541761 6461 raft_consensus.cc:2243] T 5427b0f0218d4131b68a39e8e3bf02e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:19.546339 6456 tablet_bootstrap.cc:492] T e4f00490b0364f0e9f1b9569b870808e P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:19.548094 7629 raft_consensus.cc:493] T 92f94b93d1364bb1a2562eb577707cf1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:19.548252 7629 raft_consensus.cc:515] T 92f94b93d1364bb1a2562eb577707cf1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:19.549010 7629 leader_election.cc:290] T 92f94b93d1364bb1a2562eb577707cf1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:19.549710 6461 raft_consensus.cc:2272] T 5427b0f0218d4131b68a39e8e3bf02e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:19.549710 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f94b93d1364bb1a2562eb577707cf1" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:19.551226 5996 leader_election.cc:343] T 92f94b93d1364bb1a2562eb577707cf1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:19.551580 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f94b93d1364bb1a2562eb577707cf1" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:19.552304 5995 leader_election.cc:343] T 92f94b93d1364bb1a2562eb577707cf1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:19.552452 5995 leader_election.cc:304] T 92f94b93d1364bb1a2562eb577707cf1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:19.552886 7629 raft_consensus.cc:2749] T 92f94b93d1364bb1a2562eb577707cf1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:19.553251 7629 raft_consensus.cc:493] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:19.553377 7629 raft_consensus.cc:515] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:19.554208 7629 leader_election.cc:290] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:19.554600 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet f1157d983bdc42a4a98326154d5f4eb4
I20260923 19:50:19.554673 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4a200d16464676976694656cbe28e2" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:19.555171 5996 leader_election.cc:343] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:19.555349 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet f1157d983bdc42a4a98326154d5f4eb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:19.555760 6024 tablet_service.cc:1558] Processing DeleteTablet for tablet f1157d983bdc42a4a98326154d5f4eb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:19.555954 6310 tablet_service.cc:1558] Processing DeleteTablet for tablet f1157d983bdc42a4a98326154d5f4eb4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:19.555982 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4a200d16464676976694656cbe28e2" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:19.556488 5995 leader_election.cc:343] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:19.556600 5995 leader_election.cc:304] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:19.556999 7629 raft_consensus.cc:2749] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:19.559098 6456 tablet_bootstrap.cc:654] T e4f00490b0364f0e9f1b9569b870808e P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:19.559623 6461 ts_tablet_manager.cc:1916] T 5427b0f0218d4131b68a39e8e3bf02e7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:19.559794 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_13c4ea7cf77644a4ada7c2f3fa3b0fab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:19.559962 5804 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b6a984d11ea34876becc2d10cf242e3f" } new_table_name: "default.Table_f2b30e3d5f94427995273bb78cad8ded" modify_external_catalogs: true
W20260923 19:50:19.560325 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_13c4ea7cf77644a4ada7c2f3fa3b0fab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:19.561376 6454 tablet_bootstrap.cc:492] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:19.567291 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_9335f049ac99441a83a2dbe2cd1e2a56"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:19.567799 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9335f049ac99441a83a2dbe2cd1e2a56 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:19.572211 6454 ts_tablet_manager.cc:1403] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.089s user 0.002s sys 0.002s
I20260923 19:50:19.573140 6454 raft_consensus.cc:359] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.573431 6454 raft_consensus.cc:385] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:19.573567 6454 raft_consensus.cc:740] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:19.574374 6024 tablet_service.cc:1558] Processing DeleteTablet for tablet ba639d8c68cf49a49a5ec5729143cf6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:19.577975 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_34e4d53df0104f8293e479963158ec39"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:19.578521 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34e4d53df0104f8293e479963158ec39 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:19.564383 6457 tablet_bootstrap.cc:654] T f8052b05169b4673b387ac8b716ffc4e P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:19.581509 5802 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_4acfbc383985447a8e2fdce9f2eb4732" } new_table_name: "default.Table_7ac9b6906d0746dab9ddc8e5f177b78f" modify_external_catalogs: true
I20260923 19:50:19.580869 6106 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
I20260923 19:50:19.590113 7630 raft_consensus.cc:493] T d09faa67bdc54d31a7f7a1b012de9ba1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:19.590286 7630 raft_consensus.cc:515] T d09faa67bdc54d31a7f7a1b012de9ba1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.590967 7630 leader_election.cc:290] T d09faa67bdc54d31a7f7a1b012de9ba1 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:19.592255 6139 leader_election.cc:343] T d09faa67bdc54d31a7f7a1b012de9ba1 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: d09faa67bdc54d31a7f7a1b012de9ba1
W20260923 19:50:19.593043 6137 leader_election.cc:343] T d09faa67bdc54d31a7f7a1b012de9ba1 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: d09faa67bdc54d31a7f7a1b012de9ba1
I20260923 19:50:19.593190 6137 leader_election.cc:304] T d09faa67bdc54d31a7f7a1b012de9ba1 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:19.593760 7630 raft_consensus.cc:2749] T d09faa67bdc54d31a7f7a1b012de9ba1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:19.594681 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_6525269b0ed345d9a2b2cb1dea0f47aa" } new_table_name: "default.Table_9430735288754d599f68f15e1d52c0cf" modify_external_catalogs: true
I20260923 19:50:19.597311 7256 raft_consensus.cc:493] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:19.597464 7256 raft_consensus.cc:515] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.598171 7256 leader_election.cc:290] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:19.599217 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85b7dcf131c54187a6e61f8503c797f8" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:19.599848 6060 raft_consensus.cc:2468] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:19.600215 6458 ts_tablet_manager.cc:1929] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:19.600318 6279 leader_election.cc:304] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:19.600732 7490 raft_consensus.cc:2804] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:19.600801 7490 raft_consensus.cc:493] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:19.600854 7490 raft_consensus.cc:3060] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:19.603600 7490 raft_consensus.cc:515] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.604694 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85b7dcf131c54187a6e61f8503c797f8" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:19.604851 7490 leader_election.cc:290] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:19.604941 6060 raft_consensus.cc:3060] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:19.608891 6060 raft_consensus.cc:2468] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:19.609642 6279 leader_election.cc:304] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:19.612538 7490 raft_consensus.cc:2804] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:19.612849 7490 raft_consensus.cc:697] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:19.613152 7490 consensus_queue.cc:237] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.620877 6456 tablet_bootstrap.cc:492] T e4f00490b0364f0e9f1b9569b870808e P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:19.622407 6456 ts_tablet_manager.cc:1403] T e4f00490b0364f0e9f1b9569b870808e P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.076s user 0.002s sys 0.003s
I20260923 19:50:19.622462 5800 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_8ff522cbded24ea9a5c6976986574fcb" } modify_external_catalogs: true
I20260923 19:50:19.622646 5800 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_8ff522cbded24ea9a5c6976986574fcb" } modify_external_catalogs: true
I20260923 19:50:19.623355 6456 raft_consensus.cc:359] T e4f00490b0364f0e9f1b9569b870808e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.623497 6456 raft_consensus.cc:385] T e4f00490b0364f0e9f1b9569b870808e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:19.623548 6456 raft_consensus.cc:740] T e4f00490b0364f0e9f1b9569b870808e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:19.626621 6454 consensus_queue.cc:260] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.627123 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85b7dcf131c54187a6e61f8503c797f8" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:19.627158 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85b7dcf131c54187a6e61f8503c797f8" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:19.627456 7630 raft_consensus.cc:493] T a11ecef9a24f4e4a812ec220b6a92cc4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260923 19:50:19.629455 6280 leader_election.cc:343] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:19.629808 6280 leader_election.cc:343] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:19.632495 6458 log.cc:1199] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/58ea466d1b2b40e9b9b4cd5be51f79e0
I20260923 19:50:19.634033 6457 tablet_bootstrap.cc:492] T f8052b05169b4673b387ac8b716ffc4e P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:19.634153 6457 ts_tablet_manager.cc:1403] T f8052b05169b4673b387ac8b716ffc4e P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.108s user 0.004s sys 0.002s
I20260923 19:50:19.634831 6457 raft_consensus.cc:359] T f8052b05169b4673b387ac8b716ffc4e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:19.634989 6457 raft_consensus.cc:385] T f8052b05169b4673b387ac8b716ffc4e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:19.635035 6457 raft_consensus.cc:740] T f8052b05169b4673b387ac8b716ffc4e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:19.635306 6457 consensus_queue.cc:260] T f8052b05169b4673b387ac8b716ffc4e P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:19.636001 6457 ts_tablet_manager.cc:1434] T f8052b05169b4673b387ac8b716ffc4e P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:50:19.636484 6457 tablet_bootstrap.cc:492] T 0e650824e4ae474787faeb6c22a4b43f P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:19.643338 7630 raft_consensus.cc:515] T a11ecef9a24f4e4a812ec220b6a92cc4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.646247 5797 catalog_manager.cc:5838] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:19.646708 5797 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 85b7dcf131c54187a6e61f8503c797f8 (table default.Table_23c500b65dba4b6790b4349e5a5b0a07 [id=647997210f5349a68aa98d24e12a33cd]). Expected version 2 got 0
I20260923 19:50:19.648516 7629 raft_consensus.cc:493] T 397ec5e49673406cb26a2efab0ad8401 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:19.648666 7629 raft_consensus.cc:515] T 397ec5e49673406cb26a2efab0ad8401 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:19.648744 5805 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet f8052b05169b4673b387ac8b716ffc4e (table default.Table_a9e7f8c6300f47c7ba79e2dbe36d7849 [id=8bac5d4f5c9c41f7b121d81382633a49]). Expected version 1 got 0
I20260923 19:50:19.648874 6458 ts_tablet_manager.cc:1950] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:19.649238 7629 leader_election.cc:290] T 397ec5e49673406cb26a2efab0ad8401 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:19.649739 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec5e49673406cb26a2efab0ad8401" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:19.650046 6454 ts_tablet_manager.cc:1434] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.058s user 0.000s sys 0.002s
W20260923 19:50:19.650187 5996 leader_election.cc:343] T 397ec5e49673406cb26a2efab0ad8401 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:19.650574 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec5e49673406cb26a2efab0ad8401" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:19.650628 7633 raft_consensus.cc:493] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:19.650769 7633 raft_consensus.cc:515] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:19.651707 5995 leader_election.cc:343] T 397ec5e49673406cb26a2efab0ad8401 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:19.651813 5995 leader_election.cc:304] T 397ec5e49673406cb26a2efab0ad8401 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:19.652500 7629 raft_consensus.cc:2749] T 397ec5e49673406cb26a2efab0ad8401 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:19.653640 6137 leader_election.cc:343] T a11ecef9a24f4e4a812ec220b6a92cc4 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: a11ecef9a24f4e4a812ec220b6a92cc4
I20260923 19:50:19.653687 7633 leader_election.cc:290] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:19.653928 6139 leader_election.cc:343] T a11ecef9a24f4e4a812ec220b6a92cc4 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: a11ecef9a24f4e4a812ec220b6a92cc4
I20260923 19:50:19.654050 6139 leader_election.cc:304] T a11ecef9a24f4e4a812ec220b6a92cc4 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:19.653652 7630 leader_election.cc:290] T a11ecef9a24f4e4a812ec220b6a92cc4 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:19.654579 7630 raft_consensus.cc:2749] T a11ecef9a24f4e4a812ec220b6a92cc4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:19.655050 6139 leader_election.cc:343] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 58ea466d1b2b40e9b9b4cd5be51f79e0
I20260923 19:50:19.657354 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet 9be4c46ee8eb4dbaad01d492b701a9e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:19.657420 6456 consensus_queue.cc:260] T e4f00490b0364f0e9f1b9569b870808e P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.658613 5805 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet f8052b05169b4673b387ac8b716ffc4e (table default.Table_a9e7f8c6300f47c7ba79e2dbe36d7849 [id=8bac5d4f5c9c41f7b121d81382633a49]). Expected version 1 got 0
I20260923 19:50:19.660071 7629 raft_consensus.cc:493] T ba639d8c68cf49a49a5ec5729143cf6b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:19.660189 7629 raft_consensus.cc:515] T ba639d8c68cf49a49a5ec5729143cf6b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:19.660791 7629 leader_election.cc:290] T ba639d8c68cf49a49a5ec5729143cf6b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:19.661283 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba639d8c68cf49a49a5ec5729143cf6b" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:19.662731 5996 leader_election.cc:343] T ba639d8c68cf49a49a5ec5729143cf6b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:19.663094 6459 ts_tablet_manager.cc:1929] T 0e123b69877e4b1fbcdb2b27960864e9 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:19.664685 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_053f0e613bb44662b6348691d23eae65" } new_table_name: "default.Table_c0397fc0ea5c4afaba12f570b10262f3" modify_external_catalogs: true
I20260923 19:50:19.667127 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 755) took 3699 ms. Trace:
I20260923 19:50:19.667484 6457 tablet_bootstrap.cc:654] T 0e650824e4ae474787faeb6c22a4b43f P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:19.668005 6458 rpcz_store.cc:276] 0923 19:50:15.967898 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.973869 (+ 5971us) service_pool.cc:224] Handling call
0923 19:50:19.487998 (+3514129us) ts_tablet_manager.cc:1151] Deleting tablet 58ea466d1b2b40e9b9b4cd5be51f79e0
0923 19:50:19.488010 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.553704 (+ 65694us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:19.600162 (+ 46458us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:19.667107 (+ 66945us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3513228}
I20260923 19:50:19.668640 6458 tablet_replica.cc:333] T 035abecfbee7474d9dd048f35e28e867 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:19.669081 6458 raft_consensus.cc:2243] T 035abecfbee7474d9dd048f35e28e867 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:19.669723 6461 ts_tablet_manager.cc:1929] T 5427b0f0218d4131b68a39e8e3bf02e7 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:19.669835 6461 log.cc:1199] T 5427b0f0218d4131b68a39e8e3bf02e7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/5427b0f0218d4131b68a39e8e3bf02e7
I20260923 19:50:19.670192 6461 ts_tablet_manager.cc:1950] T 5427b0f0218d4131b68a39e8e3bf02e7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:19.667860 6456 ts_tablet_manager.cc:1434] T e4f00490b0364f0e9f1b9569b870808e P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.045s user 0.001s sys 0.001s
I20260923 19:50:19.670255 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 58ea466d1b2b40e9b9b4cd5be51f79e0 (table default.Table_c61ffa0e84514cddb714dc30da0a21f6 [id=3ee0e52e785f4cb39add98261628d513]) successfully deleted
I20260923 19:50:19.672013 5799 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_81c9757c73ef447b84367e06b0dc1614" } modify_external_catalogs: true
I20260923 19:50:19.672161 5799 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_81c9757c73ef447b84367e06b0dc1614" } modify_external_catalogs: true
I20260923 19:50:19.672593 6200 raft_consensus.cc:3060] T 2ce6378a6bd844a485aebb96081307e3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:19.672870 6456 tablet_bootstrap.cc:492] T dbe06eba8067413a903e4a07c2768484 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:19.674443 6456 tablet_bootstrap.cc:654] T dbe06eba8067413a903e4a07c2768484 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:19.676105 6137 leader_election.cc:343] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 58ea466d1b2b40e9b9b4cd5be51f79e0
I20260923 19:50:19.676273 6137 leader_election.cc:304] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:19.676383 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba639d8c68cf49a49a5ec5729143cf6b" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:19.676687 7633 raft_consensus.cc:2749] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:19.677174 5995 leader_election.cc:343] T ba639d8c68cf49a49a5ec5729143cf6b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:19.677285 5995 leader_election.cc:304] T ba639d8c68cf49a49a5ec5729143cf6b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:19.677755 7629 raft_consensus.cc:2749] T ba639d8c68cf49a49a5ec5729143cf6b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:19.678133 6459 log.cc:1199] T 0e123b69877e4b1fbcdb2b27960864e9 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/0e123b69877e4b1fbcdb2b27960864e9
I20260923 19:50:19.680215 6454 tablet_bootstrap.cc:492] T 2398c59871d241f985bca1761e722180 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
W20260923 19:50:19.684087 5804 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b1670d13d05c4c63874223d479e3e192 consensus state has no leader
I20260923 19:50:19.674649 6458 raft_consensus.cc:2272] T 035abecfbee7474d9dd048f35e28e867 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:19.685106 6458 ts_tablet_manager.cc:1916] T 035abecfbee7474d9dd048f35e28e867 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:19.690279 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_54c68b91839f4aedb198f2923ab18193"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:19.690886 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_54c68b91839f4aedb198f2923ab18193 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:19.700112 5802 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4737b8f458144727838355a19e85ac24 has no consensus state
I20260923 19:50:19.700856 6391 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
I20260923 19:50:19.701670 6459 ts_tablet_manager.cc:1950] T 0e123b69877e4b1fbcdb2b27960864e9 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:19.702154 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 849) took 1287 ms. Trace:
I20260923 19:50:19.702347 6459 rpcz_store.cc:276] 0923 19:50:18.414728 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.414784 (+ 56us) service_pool.cc:224] Handling call
0923 19:50:19.488383 (+1073599us) ts_tablet_manager.cc:1151] Deleting tablet 0e123b69877e4b1fbcdb2b27960864e9
0923 19:50:19.488391 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.640432 (+152041us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:19.663039 (+ 22607us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:19.702121 (+ 39082us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1073420}
I20260923 19:50:19.703013 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 848) took 1309 ms. Trace:
I20260923 19:50:19.703173 6459 rpcz_store.cc:276] 0923 19:50:18.393737 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.421930 (+ 28193us) service_pool.cc:224] Handling call
0923 19:50:19.702885 (+1280955us) ts_tablet_manager.cc:1151] Deleting tablet 1d905af116d9446ab001555014b2a2d2
0923 19:50:19.702895 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.702983 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1280722}
I20260923 19:50:19.703651 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 0e123b69877e4b1fbcdb2b27960864e9 (table default.Table_0562db93b14243108d8731231ae538c1 [id=74e85060f50e45069c378e7fd4cc7dba]) successfully deleted
I20260923 19:50:19.703824 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 857) took 1158 ms. Trace:
W20260923 19:50:19.703917 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 1d905af116d9446ab001555014b2a2d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d905af116d9446ab001555014b2a2d2 already in progress: creating tablet
I20260923 19:50:19.703907 6459 rpcz_store.cc:276] 0923 19:50:18.545342 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.545414 (+ 72us) service_pool.cc:224] Handling call
0923 19:50:19.703709 (+1158295us) ts_tablet_manager.cc:1151] Deleting tablet 2c6b2e4dac9749e58d01a838c2472bbc
0923 19:50:19.703718 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.703793 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1158103}
W20260923 19:50:19.704267 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 2c6b2e4dac9749e58d01a838c2472bbc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c6b2e4dac9749e58d01a838c2472bbc already in progress: creating tablet
I20260923 19:50:19.710958 6454 tablet_bootstrap.cc:654] T 2398c59871d241f985bca1761e722180 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:19.711761 6458 ts_tablet_manager.cc:1929] T 035abecfbee7474d9dd048f35e28e867 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260923 19:50:19.713291 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 40adb472162042e48fdbb496b342996a consensus state has no leader
I20260923 19:50:19.713727 6458 log.cc:1199] T 035abecfbee7474d9dd048f35e28e867 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/035abecfbee7474d9dd048f35e28e867
I20260923 19:50:19.714367 6458 ts_tablet_manager.cc:1950] T 035abecfbee7474d9dd048f35e28e867 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:19.715350 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 858) took 1152 ms. Trace:
I20260923 19:50:19.715456 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 756) took 3732 ms. Trace:
I20260923 19:50:19.715634 6459 rpcz_store.cc:276] 0923 19:50:18.555011 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.555067 (+ 56us) service_pool.cc:224] Handling call
0923 19:50:19.707698 (+1152631us) ts_tablet_manager.cc:1151] Deleting tablet 377f4454d8c846e08d6207ceacf4797a
0923 19:50:19.707708 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.707797 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1152422}
I20260923 19:50:19.716269 6459 tablet_replica.cc:333] T a53f2eb08330411ebe417d4e1e414db6 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
W20260923 19:50:19.716308 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 377f4454d8c846e08d6207ceacf4797a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 377f4454d8c846e08d6207ceacf4797a already in progress: creating tablet
I20260923 19:50:19.716423 6458 rpcz_store.cc:276] 0923 19:50:15.982733 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:15.982778 (+ 45us) service_pool.cc:224] Handling call
0923 19:50:19.668595 (+3685817us) ts_tablet_manager.cc:1151] Deleting tablet 035abecfbee7474d9dd048f35e28e867
0923 19:50:19.668606 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.695904 (+ 27298us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:19.711662 (+ 15758us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:19.715437 (+ 3775us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3683913}
I20260923 19:50:19.717144 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 785) took 3358 ms. Trace:
I20260923 19:50:19.717209 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 035abecfbee7474d9dd048f35e28e867 (table default.Table_5a1ffa59de984ef3adb370cdf1142f24 [id=d2e859af377f491dbc81f6f3d4111640]) successfully deleted
I20260923 19:50:19.718348 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_8daeeb8f17384fc284bad32f5d6bdfa8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:19.718905 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8daeeb8f17384fc284bad32f5d6bdfa8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:19.719071 6458 rpcz_store.cc:276] 0923 19:50:16.359094 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:16.362249 (+ 3155us) service_pool.cc:224] Handling call
0923 19:50:19.717013 (+3354764us) ts_tablet_manager.cc:1151] Deleting tablet 62c0cf7f070e467dafaed442b6b8c15d
0923 19:50:19.717025 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.717128 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3354442}
I20260923 19:50:19.719388 6458 tablet_replica.cc:333] T efc63a151f6444dfb03c3f15f6f54473 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:19.719558 6458 raft_consensus.cc:2243] T efc63a151f6444dfb03c3f15f6f54473 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:19.719722 6458 raft_consensus.cc:2272] T efc63a151f6444dfb03c3f15f6f54473 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:19.720656 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 62c0cf7f070e467dafaed442b6b8c15d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 62c0cf7f070e467dafaed442b6b8c15d already in progress: creating tablet
I20260923 19:50:19.721104 6458 ts_tablet_manager.cc:1916] T efc63a151f6444dfb03c3f15f6f54473 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:19.726329 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_9acef25c391f4b8c9354ebc2c0a70c81" } modify_external_catalogs: true
I20260923 19:50:19.726856 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_9acef25c391f4b8c9354ebc2c0a70c81" } modify_external_catalogs: true
I20260923 19:50:19.729329 7490 raft_consensus.cc:493] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:19.734767 7490 raft_consensus.cc:515] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.735321 6166 tablet_service.cc:1511] Processing CreateTablet for tablet a424accc32ae4cf2854484960539cbdf (DEFAULT_TABLE table=default.Table_ea4cde6ff2da418aa42fc25013dbfa0e [id=900ba2848fed40a0aa27564d2b965bed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:19.735474 7490 leader_election.cc:290] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:19.735751 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a424accc32ae4cf2854484960539cbdf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:19.736768 6279 leader_election.cc:343] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: d8c8bfa9b7424b9f80f76e0bb05cbc0c
I20260923 19:50:19.737507 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c8bfa9b7424b9f80f76e0bb05cbc0c" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:19.738042 7633 raft_consensus.cc:493] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260923 19:50:19.738101 6280 leader_election.cc:343] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:19.738198 6280 leader_election.cc:304] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:19.738189 7633 raft_consensus.cc:515] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.738780 7633 leader_election.cc:290] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:19.739347 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504ec668a33451fb1249f697bb5e2bb" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:19.739516 6342 raft_consensus.cc:2468] T c504ec668a33451fb1249f697bb5e2bb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:19.739910 6139 leader_election.cc:304] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:19.740355 7633 raft_consensus.cc:2804] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:19.740453 7633 raft_consensus.cc:493] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:19.740530 7633 raft_consensus.cc:3060] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:19.740500 5803 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 2ce6378a6bd844a485aebb96081307e3 (table default.Table_4204ac3c27de40fa97f12202e7d55cb1 [id=ef9a6c259ceb4c189c8902a776fb3bfa]). Expected version 2 got 0
W20260923 19:50:19.742986 6137 leader_election.cc:343] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: c504ec668a33451fb1249f697bb5e2bb
I20260923 19:50:19.743170 7633 raft_consensus.cc:515] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.743376 7490 raft_consensus.cc:2749] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:19.743449 7256 raft_consensus.cc:493] T b9c187ee1fa8438397c83bc2c2b16925 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:19.743553 7256 raft_consensus.cc:515] T b9c187ee1fa8438397c83bc2c2b16925 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.744102 7256 leader_election.cc:290] T b9c187ee1fa8438397c83bc2c2b16925 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:19.744052 5803 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_136cce45fffc467a96f186223617bc28" } modify_external_catalogs: true
I20260923 19:50:19.744210 5803 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_136cce45fffc467a96f186223617bc28" } modify_external_catalogs: true
I20260923 19:50:19.744653 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c187ee1fa8438397c83bc2c2b16925" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:19.745090 6280 leader_election.cc:343] T b9c187ee1fa8438397c83bc2c2b16925 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:19.745172 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504ec668a33451fb1249f697bb5e2bb" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:19.745317 6342 raft_consensus.cc:3060] T c504ec668a33451fb1249f697bb5e2bb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
W20260923 19:50:19.746742 6279 leader_election.cc:343] T b9c187ee1fa8438397c83bc2c2b16925 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: b9c187ee1fa8438397c83bc2c2b16925
I20260923 19:50:19.746862 6279 leader_election.cc:304] T b9c187ee1fa8438397c83bc2c2b16925 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:19.748085 6342 raft_consensus.cc:2468] T c504ec668a33451fb1249f697bb5e2bb P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:19.748600 7256 raft_consensus.cc:2749] T b9c187ee1fa8438397c83bc2c2b16925 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:19.750687 6459 raft_consensus.cc:2243] T a53f2eb08330411ebe417d4e1e414db6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:19.750952 6459 raft_consensus.cc:2272] T a53f2eb08330411ebe417d4e1e414db6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:19.753153 5796 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 2ce6378a6bd844a485aebb96081307e3 (table default.Table_4204ac3c27de40fa97f12202e7d55cb1 [id=ef9a6c259ceb4c189c8902a776fb3bfa]). Expected version 2 got 0
I20260923 19:50:19.753793 5796 master_service.cc:960] ReplaceTablet: received request to replace tablet e1de117713f34b51bbda0c712f0b837c from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:19.759925 6139 leader_election.cc:304] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:19.761644 5798 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b57c902238674ae8bafb70e9cb0f65aa" } modify_external_catalogs: true
I20260923 19:50:19.761816 5798 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b57c902238674ae8bafb70e9cb0f65aa" } modify_external_catalogs: true
I20260923 19:50:19.761977 6459 ts_tablet_manager.cc:1916] T a53f2eb08330411ebe417d4e1e414db6 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:19.762320 7633 leader_election.cc:290] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:19.771091 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_9e03c535926d4d6f95cc6bebf3c3ea0f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:19.771704 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9e03c535926d4d6f95cc6bebf3c3ea0f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:19.772032 6459 ts_tablet_manager.cc:1929] T a53f2eb08330411ebe417d4e1e414db6 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:19.772143 6459 log.cc:1199] T a53f2eb08330411ebe417d4e1e414db6 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/a53f2eb08330411ebe417d4e1e414db6
I20260923 19:50:19.772552 6459 ts_tablet_manager.cc:1950] T a53f2eb08330411ebe417d4e1e414db6 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:19.772915 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 859) took 1205 ms. Trace:
I20260923 19:50:19.773016 6459 rpcz_store.cc:276] 0923 19:50:18.567782 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.567837 (+ 55us) service_pool.cc:224] Handling call
0923 19:50:19.716150 (+1148313us) ts_tablet_manager.cc:1151] Deleting tablet a53f2eb08330411ebe417d4e1e414db6
0923 19:50:19.716160 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.766834 (+ 50674us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:19.771971 (+ 5137us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:19.772894 (+ 923us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1148093}
I20260923 19:50:19.773466 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet a53f2eb08330411ebe417d4e1e414db6 (table default.Table_1d212a8856d940d8898230b16d0e0aa2 [id=24a351e6e5744e70abf6776a741dbbe3]) successfully deleted
I20260923 19:50:19.780655 6454 tablet_bootstrap.cc:492] T 2398c59871d241f985bca1761e722180 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:19.780858 6454 ts_tablet_manager.cc:1403] T 2398c59871d241f985bca1761e722180 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.115s user 0.002s sys 0.003s
I20260923 19:50:19.781824 6454 raft_consensus.cc:359] T 2398c59871d241f985bca1761e722180 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.782148 6454 raft_consensus.cc:385] T 2398c59871d241f985bca1761e722180 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:19.782250 6454 raft_consensus.cc:740] T 2398c59871d241f985bca1761e722180 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:19.782509 6454 consensus_queue.cc:260] T 2398c59871d241f985bca1761e722180 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.783792 6456 tablet_bootstrap.cc:492] T dbe06eba8067413a903e4a07c2768484 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:19.784157 6456 ts_tablet_manager.cc:1403] T dbe06eba8067413a903e4a07c2768484 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.111s user 0.004s sys 0.008s
W20260923 19:50:19.784294 6137 leader_election.cc:343] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: c504ec668a33451fb1249f697bb5e2bb
I20260923 19:50:19.784698 6454 ts_tablet_manager.cc:1434] T 2398c59871d241f985bca1761e722180 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260923 19:50:19.784847 7630 raft_consensus.cc:2804] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:19.784956 7630 raft_consensus.cc:697] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:19.784965 6456 raft_consensus.cc:359] T dbe06eba8067413a903e4a07c2768484 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.785130 6456 raft_consensus.cc:385] T dbe06eba8067413a903e4a07c2768484 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:19.785175 6456 raft_consensus.cc:740] T dbe06eba8067413a903e4a07c2768484 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:19.785167 7630 consensus_queue.cc:237] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.785399 6456 consensus_queue.cc:260] T dbe06eba8067413a903e4a07c2768484 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.784943 6454 tablet_bootstrap.cc:492] T e4f00490b0364f0e9f1b9569b870808e P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:19.790138 6456 ts_tablet_manager.cc:1434] T dbe06eba8067413a903e4a07c2768484 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260923 19:50:19.791558 6456 tablet_bootstrap.cc:492] T 7af330ae1aaa48209f2bd1880bcfebb1 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:19.792335 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 5427b0f0218d4131b68a39e8e3bf02e7 (table default.Table_aa2654e8c2db467ab317ae37cf1985aa [id=325a9dcdfe3c44fca0e5b9d0bc0cd1f0]) successfully deleted
I20260923 19:50:19.792619 6461 tablet_replica.cc:333] T 554655516bb547ad9c2aa1ee66dc8deb P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:19.792877 6461 raft_consensus.cc:2243] T 554655516bb547ad9c2aa1ee66dc8deb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260923 19:50:19.792987 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 6393303f6d664fe3bbc9c9052cd0b717 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6393303f6d664fe3bbc9c9052cd0b717 already in progress: creating tablet
I20260923 19:50:19.793045 6461 raft_consensus.cc:2272] T 554655516bb547ad9c2aa1ee66dc8deb P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:19.793207 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 4935c06f29cf4c729946f35829dfdf92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4935c06f29cf4c729946f35829dfdf92 already in progress: creating tablet
I20260923 19:50:19.793684 6461 ts_tablet_manager.cc:1916] T 554655516bb547ad9c2aa1ee66dc8deb P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:19.794898 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 862) took 1157 ms. Trace:
I20260923 19:50:19.795076 6459 rpcz_store.cc:276] 0923 19:50:18.637779 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.658237 (+ 20458us) service_pool.cc:224] Handling call
0923 19:50:19.794739 (+1136502us) ts_tablet_manager.cc:1151] Deleting tablet 6c33a99f88a9401fa296c4fefb8bcfc1
0923 19:50:19.794754 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.794874 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1136215}
I20260923 19:50:19.795727 6459 tablet_replica.cc:333] T 66739afdf147413787acb0363aa37df6 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
W20260923 19:50:19.795717 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 6c33a99f88a9401fa296c4fefb8bcfc1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c33a99f88a9401fa296c4fefb8bcfc1 already in progress: creating tablet
I20260923 19:50:19.795990 6459 raft_consensus.cc:2243] T 66739afdf147413787acb0363aa37df6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:19.796236 6459 raft_consensus.cc:2272] T 66739afdf147413787acb0363aa37df6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:19.796662 6456 tablet_bootstrap.cc:654] T 7af330ae1aaa48209f2bd1880bcfebb1 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:19.796918 6459 ts_tablet_manager.cc:1916] T 66739afdf147413787acb0363aa37df6 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:19.801651 7682 tablet.cc:1751] T 2ce6378a6bd844a485aebb96081307e3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:19.803728 6024 tablet_service.cc:1511] Processing CreateTablet for tablet a424accc32ae4cf2854484960539cbdf (DEFAULT_TABLE table=default.Table_ea4cde6ff2da418aa42fc25013dbfa0e [id=900ba2848fed40a0aa27564d2b965bed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:19.804159 6024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a424accc32ae4cf2854484960539cbdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:19.804441 6310 tablet_service.cc:1511] Processing CreateTablet for tablet a424accc32ae4cf2854484960539cbdf (DEFAULT_TABLE table=default.Table_ea4cde6ff2da418aa42fc25013dbfa0e [id=900ba2848fed40a0aa27564d2b965bed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:19.804790 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a424accc32ae4cf2854484960539cbdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:19.805729 6454 tablet_bootstrap.cc:654] T e4f00490b0364f0e9f1b9569b870808e P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:19.806660 6458 ts_tablet_manager.cc:1929] T efc63a151f6444dfb03c3f15f6f54473 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:19.807924 6458 log.cc:1199] T efc63a151f6444dfb03c3f15f6f54473 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/efc63a151f6444dfb03c3f15f6f54473
I20260923 19:50:19.810472 6458 ts_tablet_manager.cc:1950] T efc63a151f6444dfb03c3f15f6f54473 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:19.814255 6181 tablet_service.cc:1511] Processing CreateTablet for tablet 401061423caf48639929bd8864c53218 (DEFAULT_TABLE table=default.Table_f4be4141550e453789b0f2db9e3b41f5 [id=f6b56d8f7fcc4deeba75b10ef8ced153]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:19.813946 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 786) took 3451 ms. Trace:
I20260923 19:50:19.814726 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 401061423caf48639929bd8864c53218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:19.814416 6458 rpcz_store.cc:276] 0923 19:50:16.362814 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:16.362869 (+ 55us) service_pool.cc:224] Handling call
0923 19:50:19.719340 (+3356471us) ts_tablet_manager.cc:1151] Deleting tablet efc63a151f6444dfb03c3f15f6f54473
0923 19:50:19.719349 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.776510 (+ 57161us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:19.806386 (+ 29876us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:19.813924 (+ 7538us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3356261}
I20260923 19:50:19.816331 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet efc63a151f6444dfb03c3f15f6f54473 (table default.Table_ee5fbb39c54a49c89eaaff48f72a9c3c [id=20b663f1b2504d4199c2a9a2e9667d5c]) successfully deleted
I20260923 19:50:19.818056 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 788) took 3335 ms. Trace:
I20260923 19:50:19.818753 6458 rpcz_store.cc:276] 0923 19:50:16.482187 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:16.482245 (+ 58us) service_pool.cc:224] Handling call
0923 19:50:19.817254 (+3335009us) ts_tablet_manager.cc:1151] Deleting tablet f4313a4d8a9c411fad593b05ad655fc4
0923 19:50:19.817265 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.818032 (+ 767us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3334506}
W20260923 19:50:19.820514 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet f4313a4d8a9c411fad593b05ad655fc4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4313a4d8a9c411fad593b05ad655fc4 already in progress: creating tablet
I20260923 19:50:19.821522 5800 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 9603acbedc27465eab5a8146fed41587
I20260923 19:50:19.822485 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 787) took 3341 ms. Trace:
I20260923 19:50:19.823180 6458 rpcz_store.cc:276] 0923 19:50:16.481038 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:16.510162 (+ 29124us) service_pool.cc:224] Handling call
0923 19:50:19.821327 (+3311165us) ts_tablet_manager.cc:1151] Deleting tablet 382daee3555642b7a767a35c2f49b98a
0923 19:50:19.821565 (+ 238us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.822237 (+ 672us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3310954}
W20260923 19:50:19.824777 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 382daee3555642b7a767a35c2f49b98a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 382daee3555642b7a767a35c2f49b98a already in progress: creating tablet
I20260923 19:50:19.826669 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 789) took 3313 ms. Trace:
I20260923 19:50:19.827522 6310 tablet_service.cc:1558] Processing DeleteTablet for tablet 9603acbedc27465eab5a8146fed41587 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:19.827243 6458 rpcz_store.cc:276] 0923 19:50:16.512603 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:16.513032 (+ 429us) service_pool.cc:224] Handling call
0923 19:50:19.825736 (+3312704us) ts_tablet_manager.cc:1151] Deleting tablet cffe24ab4df745e3a34f82e8ca7b39f5
0923 19:50:19.825750 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.826433 (+ 683us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3312016}
W20260923 19:50:19.828943 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet cffe24ab4df745e3a34f82e8ca7b39f5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cffe24ab4df745e3a34f82e8ca7b39f5 already in progress: creating tablet
I20260923 19:50:19.831221 6024 tablet_service.cc:1558] Processing DeleteTablet for tablet 9603acbedc27465eab5a8146fed41587 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:19.831037 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 790) took 3312 ms. Trace:
I20260923 19:50:19.832125 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet 9603acbedc27465eab5a8146fed41587 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:19.834048 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_32b329b9fb0d4ea2a12965fdf2adfd24"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:19.834672 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_32b329b9fb0d4ea2a12965fdf2adfd24 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:19.842725 7683 tablet.cc:1751] T 2ce6378a6bd844a485aebb96081307e3 P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:19.853451 6024 tablet_service.cc:1511] Processing CreateTablet for tablet 401061423caf48639929bd8864c53218 (DEFAULT_TABLE table=default.Table_f4be4141550e453789b0f2db9e3b41f5 [id=f6b56d8f7fcc4deeba75b10ef8ced153]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:19.853711 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 401061423caf48639929bd8864c53218 (DEFAULT_TABLE table=default.Table_f4be4141550e453789b0f2db9e3b41f5 [id=f6b56d8f7fcc4deeba75b10ef8ced153]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:19.854182 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 401061423caf48639929bd8864c53218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:19.854214 6024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 401061423caf48639929bd8864c53218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:19.867548 6181 tablet_service.cc:1511] Processing CreateTablet for tablet b02b14b8c1b243acb3419c349a8d0c3d (DEFAULT_TABLE table=default.Table_b2f1f40fddb3415583705da88451978d [id=8e6cf71c01134655930f6f8763eb2eb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:19.867974 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b02b14b8c1b243acb3419c349a8d0c3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:19.871649 6029 tablet_service.cc:1511] Processing CreateTablet for tablet b02b14b8c1b243acb3419c349a8d0c3d (DEFAULT_TABLE table=default.Table_b2f1f40fddb3415583705da88451978d [id=8e6cf71c01134655930f6f8763eb2eb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:19.872102 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b02b14b8c1b243acb3419c349a8d0c3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:19.872238 6457 tablet_bootstrap.cc:492] T 0e650824e4ae474787faeb6c22a4b43f P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:19.872504 6457 ts_tablet_manager.cc:1403] T 0e650824e4ae474787faeb6c22a4b43f P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.236s user 0.005s sys 0.000s
I20260923 19:50:19.873265 6457 raft_consensus.cc:359] T 0e650824e4ae474787faeb6c22a4b43f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:19.873512 6457 raft_consensus.cc:385] T 0e650824e4ae474787faeb6c22a4b43f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:19.873610 6457 raft_consensus.cc:740] T 0e650824e4ae474787faeb6c22a4b43f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:19.873934 6457 consensus_queue.cc:260] T 0e650824e4ae474787faeb6c22a4b43f P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:19.874183 6324 tablet_service.cc:1511] Processing CreateTablet for tablet b02b14b8c1b243acb3419c349a8d0c3d (DEFAULT_TABLE table=default.Table_b2f1f40fddb3415583705da88451978d [id=8e6cf71c01134655930f6f8763eb2eb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:19.874554 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b02b14b8c1b243acb3419c349a8d0c3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:19.874660 6457 ts_tablet_manager.cc:1434] T 0e650824e4ae474787faeb6c22a4b43f P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:19.874907 6457 tablet_bootstrap.cc:492] T ea2ef507c6e24d369427048171dfec06 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:19.876448 6457 tablet_bootstrap.cc:654] T ea2ef507c6e24d369427048171dfec06 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:19.888675 6454 tablet_bootstrap.cc:492] T e4f00490b0364f0e9f1b9569b870808e P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:19.888931 6454 ts_tablet_manager.cc:1403] T e4f00490b0364f0e9f1b9569b870808e P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.104s user 0.026s sys 0.027s
I20260923 19:50:19.890228 6454 raft_consensus.cc:359] T e4f00490b0364f0e9f1b9569b870808e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.890508 6454 raft_consensus.cc:385] T e4f00490b0364f0e9f1b9569b870808e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:19.890647 6454 raft_consensus.cc:740] T e4f00490b0364f0e9f1b9569b870808e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:19.891042 6454 consensus_queue.cc:260] T e4f00490b0364f0e9f1b9569b870808e P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.893841 6454 ts_tablet_manager.cc:1434] T e4f00490b0364f0e9f1b9569b870808e P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260923 19:50:19.894724 6454 tablet_bootstrap.cc:492] T 6238d16b1be74dd88fd2e089fbd85d33 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:19.897351 6454 tablet_bootstrap.cc:654] T 6238d16b1be74dd88fd2e089fbd85d33 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:19.897310 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_863bd219e51649d09aba43c4d7cbbb4a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:19.898583 6313 tablet_service.cc:1558] Processing DeleteTablet for tablet dbe06eba8067413a903e4a07c2768484 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:19.901129 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_863bd219e51649d09aba43c4d7cbbb4a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:19.902976 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet e4f00490b0364f0e9f1b9569b870808e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:19.911211 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_ab85ba414cb249c8a35044fa2a653bb4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:19.911774 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab85ba414cb249c8a35044fa2a653bb4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:19.912427 7681 tablet.cc:1751] T 2ce6378a6bd844a485aebb96081307e3 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:19.917855 5799 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 5bc33295d8684e8583508124a8db5b8a
I20260923 19:50:19.918588 5799 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_015ff0f9bdf44e38890887c344423b1f" } new_table_name: "default.Table_0011c21321cd41989d01b99786fcde06" modify_external_catalogs: true
I20260923 19:50:19.922021 6165 tablet_service.cc:1558] Processing DeleteTablet for tablet 5bc33295d8684e8583508124a8db5b8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:19.927227 5801 master_service.cc:960] ReplaceTablet: received request to replace tablet 8b4c2a0ae64841c6971a0840c1d5b739 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:19.927634 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 3c713a0973dc45debf61c228a4bf13bf
I20260923 19:50:19.928381 6165 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c713a0973dc45debf61c228a4bf13bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:19.929170 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c713a0973dc45debf61c228a4bf13bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:19.929852 6313 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c713a0973dc45debf61c228a4bf13bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:19.931145 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet 5bc33295d8684e8583508124a8db5b8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:19.931371 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet 5bc33295d8684e8583508124a8db5b8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:19.932542 6456 tablet_bootstrap.cc:492] T 7af330ae1aaa48209f2bd1880bcfebb1 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:19.932719 6456 ts_tablet_manager.cc:1403] T 7af330ae1aaa48209f2bd1880bcfebb1 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.141s user 0.005s sys 0.001s
I20260923 19:50:19.933452 6456 raft_consensus.cc:359] T 7af330ae1aaa48209f2bd1880bcfebb1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.933679 6456 raft_consensus.cc:385] T 7af330ae1aaa48209f2bd1880bcfebb1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:19.933782 6456 raft_consensus.cc:740] T 7af330ae1aaa48209f2bd1880bcfebb1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:19.934083 6456 consensus_queue.cc:260] T 7af330ae1aaa48209f2bd1880bcfebb1 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.934587 6456 ts_tablet_manager.cc:1434] T 7af330ae1aaa48209f2bd1880bcfebb1 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:19.934882 6456 tablet_bootstrap.cc:492] T 98f61ace3a984938ace1fedbaa1dafa3 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:19.935801 7630 raft_consensus.cc:493] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:19.935938 7630 raft_consensus.cc:515] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.936072 6457 tablet_bootstrap.cc:492] T ea2ef507c6e24d369427048171dfec06 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:19.936308 6457 ts_tablet_manager.cc:1403] T ea2ef507c6e24d369427048171dfec06 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.061s user 0.003s sys 0.000s
I20260923 19:50:19.936530 7630 leader_election.cc:290] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:19.937726 6137 leader_election.cc:343] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 28f9d03be14a4072aab7fd03834c3f6b
I20260923 19:50:19.938251 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f9d03be14a4072aab7fd03834c3f6b" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:19.938416 6342 raft_consensus.cc:2468] T 28f9d03be14a4072aab7fd03834c3f6b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:19.938314 6457 raft_consensus.cc:359] T ea2ef507c6e24d369427048171dfec06 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:19.938591 6457 raft_consensus.cc:385] T ea2ef507c6e24d369427048171dfec06 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:19.938707 6457 raft_consensus.cc:740] T ea2ef507c6e24d369427048171dfec06 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:19.939152 6139 leader_election.cc:304] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:19.939566 7630 raft_consensus.cc:2804] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:19.939654 7630 raft_consensus.cc:493] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:19.939713 7630 raft_consensus.cc:3060] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:19.939260 6457 consensus_queue.cc:260] T ea2ef507c6e24d369427048171dfec06 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:19.939702 6029 tablet_service.cc:1511] Processing CreateTablet for tablet e6ebb766244f40a28e5fd96ecbb3e4f6 (DEFAULT_TABLE table=default.Table_bc1d6b30c09142929d85e4cc6da64601 [id=be259deb83ec48618aab32d13278c645]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:19.940083 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6ebb766244f40a28e5fd96ecbb3e4f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:19.941455 6457 ts_tablet_manager.cc:1434] T ea2ef507c6e24d369427048171dfec06 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260923 19:50:19.942000 7633 raft_consensus.cc:493] T 2398c59871d241f985bca1761e722180 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:19.942122 7633 raft_consensus.cc:515] T 2398c59871d241f985bca1761e722180 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.942516 6457 tablet_bootstrap.cc:492] T 21bf33904ede470b80a074dc9a458baf P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:19.942674 7633 leader_election.cc:290] T 2398c59871d241f985bca1761e722180 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:19.943526 6461 ts_tablet_manager.cc:1929] T 554655516bb547ad9c2aa1ee66dc8deb P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:19.943630 6461 log.cc:1199] T 554655516bb547ad9c2aa1ee66dc8deb P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/554655516bb547ad9c2aa1ee66dc8deb
I20260923 19:50:19.943966 6461 ts_tablet_manager.cc:1950] T 554655516bb547ad9c2aa1ee66dc8deb P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:19.945355 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 89b7199603014c5f84e4d581d1389c59 (DEFAULT_TABLE table=default.Table_87982e7afa2e42a58c2ac6ec233bb411 [id=757be1131d234a06a60eeab82f38d37e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:19.946319 6027 tablet_service.cc:1511] Processing CreateTablet for tablet 9e341a8bf3324ac4811b90e6653cfd4c (DEFAULT_TABLE table=default.Table_f6c8d3b2c3bc4486a54aecf1753705b5 [id=6b3a64b93a094342991c3a1ea783396b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:19.947566 6313 tablet_service.cc:1511] Processing CreateTablet for tablet 89b7199603014c5f84e4d581d1389c59 (DEFAULT_TABLE table=default.Table_87982e7afa2e42a58c2ac6ec233bb411 [id=757be1131d234a06a60eeab82f38d37e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:19.947917 6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89b7199603014c5f84e4d581d1389c59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:19.949589 6457 tablet_bootstrap.cc:654] T 21bf33904ede470b80a074dc9a458baf P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:19.950027 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398c59871d241f985bca1761e722180" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:19.951377 6165 tablet_service.cc:1511] Processing CreateTablet for tablet e6ebb766244f40a28e5fd96ecbb3e4f6 (DEFAULT_TABLE table=default.Table_bc1d6b30c09142929d85e4cc6da64601 [id=be259deb83ec48618aab32d13278c645]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:19.951592 6459 ts_tablet_manager.cc:1929] T 66739afdf147413787acb0363aa37df6 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:19.951756 6165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6ebb766244f40a28e5fd96ecbb3e4f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:19.954492 6174 tablet_service.cc:1511] Processing CreateTablet for tablet 89b7199603014c5f84e4d581d1389c59 (DEFAULT_TABLE table=default.Table_87982e7afa2e42a58c2ac6ec233bb411 [id=757be1131d234a06a60eeab82f38d37e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:19.961421 6459 log.cc:1199] T 66739afdf147413787acb0363aa37df6 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/66739afdf147413787acb0363aa37df6
I20260923 19:50:19.961539 7630 raft_consensus.cc:515] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:19.954996 6182 tablet_service.cc:1511] Processing CreateTablet for tablet 9e341a8bf3324ac4811b90e6653cfd4c (DEFAULT_TABLE table=default.Table_f6c8d3b2c3bc4486a54aecf1753705b5 [id=6b3a64b93a094342991c3a1ea783396b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:19.961560 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89b7199603014c5f84e4d581d1389c59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:19.962025 6459 ts_tablet_manager.cc:1950] T 66739afdf147413787acb0363aa37df6 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:19.962445 7630 leader_election.cc:290] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:19.963269 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f9d03be14a4072aab7fd03834c3f6b" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:19.963416 6342 raft_consensus.cc:3060] T 28f9d03be14a4072aab7fd03834c3f6b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:19.965744 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 865) took 1251 ms. Trace:
I20260923 19:50:19.965824 6459 rpcz_store.cc:276] 0923 19:50:18.714266 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.714336 (+ 70us) service_pool.cc:224] Handling call
0923 19:50:19.795679 (+1081343us) ts_tablet_manager.cc:1151] Deleting tablet 66739afdf147413787acb0363aa37df6
0923 19:50:19.795689 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.889551 (+ 93862us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:19.951540 (+ 61989us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:19.965723 (+ 14183us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1081077}
I20260923 19:50:19.966130 6342 raft_consensus.cc:2468] T 28f9d03be14a4072aab7fd03834c3f6b P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:19.966984 6324 tablet_service.cc:1511] Processing CreateTablet for tablet e6ebb766244f40a28e5fd96ecbb3e4f6 (DEFAULT_TABLE table=default.Table_bc1d6b30c09142929d85e4cc6da64601 [id=be259deb83ec48618aab32d13278c645]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:19.967437 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6ebb766244f40a28e5fd96ecbb3e4f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:19.968461 6457 tablet_bootstrap.cc:492] T 21bf33904ede470b80a074dc9a458baf P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:19.969002 6457 ts_tablet_manager.cc:1403] T 21bf33904ede470b80a074dc9a458baf P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.004s
I20260923 19:50:19.966236 6182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e341a8bf3324ac4811b90e6653cfd4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:19.966606 6139 leader_election.cc:304] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:19.969849 7630 raft_consensus.cc:2804] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:19.970095 6459 tablet_replica.cc:333] T d09faa67bdc54d31a7f7a1b012de9ba1 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:19.970885 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2398c59871d241f985bca1761e722180" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:19.971954 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89b7199603014c5f84e4d581d1389c59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:19.972612 6457 raft_consensus.cc:359] T 21bf33904ede470b80a074dc9a458baf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:19.973215 6457 raft_consensus.cc:385] T 21bf33904ede470b80a074dc9a458baf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:19.973417 6457 raft_consensus.cc:740] T 21bf33904ede470b80a074dc9a458baf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:19.974177 6457 consensus_queue.cc:260] T 21bf33904ede470b80a074dc9a458baf P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:19.976482 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 66739afdf147413787acb0363aa37df6 (table default.Table_973f7a2560ab48ad8d84aeb2f4fc235b [id=72c42d0bf8264d809c5ec888d05db821]) successfully deleted
I20260923 19:50:19.976533 6457 ts_tablet_manager.cc:1434] T 21bf33904ede470b80a074dc9a458baf P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.007s user 0.000s sys 0.003s
I20260923 19:50:19.977487 6457 tablet_bootstrap.cc:492] T d3f7b33bbf3f453e8e841ee5d99c5b31 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:19.979734 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e341a8bf3324ac4811b90e6653cfd4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:19.991839 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 9e341a8bf3324ac4811b90e6653cfd4c (DEFAULT_TABLE table=default.Table_f6c8d3b2c3bc4486a54aecf1753705b5 [id=6b3a64b93a094342991c3a1ea783396b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:19.992215 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e341a8bf3324ac4811b90e6653cfd4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:19.997153 6456 tablet_bootstrap.cc:654] T 98f61ace3a984938ace1fedbaa1dafa3 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:20.000445 6457 tablet_bootstrap.cc:654] T d3f7b33bbf3f453e8e841ee5d99c5b31 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:20.002118 7681 tablet.cc:1751] T ec4284d6a0fa416ca95b4d675c8e3912 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260923 19:50:20.003815 6313 tablet_service.cc:1511] Processing CreateTablet for tablet 60b1f8ceb7d74156926ed601b5a1be62 (DEFAULT_TABLE table=default.Table_10049cc67e6841259815c979fd9bad48 [id=b911d7d4ae144a2e9c3b77b2ba4cc8da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.003791 5802 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7dbacc6620d24105a6e2a2b21c26af26" } new_table_name: "default.Table_e0717523aad6431c88669309ddb19134" modify_external_catalogs: true
I20260923 19:50:20.004184 6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60b1f8ceb7d74156926ed601b5a1be62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.004520 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_4305227618d74000ad56a8f612ac3621"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:20.005106 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4305227618d74000ad56a8f612ac3621 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:20.015460 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 60b1f8ceb7d74156926ed601b5a1be62 (DEFAULT_TABLE table=default.Table_10049cc67e6841259815c979fd9bad48 [id=b911d7d4ae144a2e9c3b77b2ba4cc8da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.016149 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60b1f8ceb7d74156926ed601b5a1be62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.016350 6457 tablet_bootstrap.cc:492] T d3f7b33bbf3f453e8e841ee5d99c5b31 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:20.016918 6457 ts_tablet_manager.cc:1403] T d3f7b33bbf3f453e8e841ee5d99c5b31 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.040s user 0.007s sys 0.002s
I20260923 19:50:20.021711 6457 raft_consensus.cc:359] T d3f7b33bbf3f453e8e841ee5d99c5b31 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:20.022858 6457 raft_consensus.cc:385] T d3f7b33bbf3f453e8e841ee5d99c5b31 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:20.023085 6024 tablet_service.cc:1511] Processing CreateTablet for tablet 12ec3c7cdec64f6b8812b9eed8182719 (DEFAULT_TABLE table=default.Table_6dfb8074013b4f1ea483ee1f73af6dda [id=38f0b7759f594acba288707ef3dbc37d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.023214 6457 raft_consensus.cc:740] T d3f7b33bbf3f453e8e841ee5d99c5b31 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:20.023555 6024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12ec3c7cdec64f6b8812b9eed8182719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.024755 6313 tablet_service.cc:1511] Processing CreateTablet for tablet 12ec3c7cdec64f6b8812b9eed8182719 (DEFAULT_TABLE table=default.Table_6dfb8074013b4f1ea483ee1f73af6dda [id=38f0b7759f594acba288707ef3dbc37d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.024461 6457 consensus_queue.cc:260] T d3f7b33bbf3f453e8e841ee5d99c5b31 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:20.025144 6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12ec3c7cdec64f6b8812b9eed8182719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.025487 6027 tablet_service.cc:1511] Processing CreateTablet for tablet cb2a11a2ff934d599aa56ea86cc9e9e2 (DEFAULT_TABLE table=default.Table_8929125ac27f4ec0b64e59becd7c2027 [id=c1136a220875411e80688c14802dc8b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.025828 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb2a11a2ff934d599aa56ea86cc9e9e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.026089 6323 tablet_service.cc:1511] Processing CreateTablet for tablet cb2a11a2ff934d599aa56ea86cc9e9e2 (DEFAULT_TABLE table=default.Table_8929125ac27f4ec0b64e59becd7c2027 [id=c1136a220875411e80688c14802dc8b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.026407 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb2a11a2ff934d599aa56ea86cc9e9e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.027463 6457 ts_tablet_manager.cc:1434] T d3f7b33bbf3f453e8e841ee5d99c5b31 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.010s user 0.001s sys 0.002s
I20260923 19:50:20.032778 7682 tablet.cc:1751] T ec4284d6a0fa416ca95b4d675c8e3912 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260923 19:50:19.970144 7630 raft_consensus.cc:697] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:20.049412 7630 consensus_queue.cc:237] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:19.970767 6137 leader_election.cc:343] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 28f9d03be14a4072aab7fd03834c3f6b
W20260923 19:50:20.050855 6137 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.193:39887, user_credentials={real_user=slave}} blocked reactor thread for 80089.3us
I20260923 19:50:20.051170 6137 leader_election.cc:304] T 2398c59871d241f985bca1761e722180 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:19.978219 7633 raft_consensus.cc:493] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:20.051658 7633 raft_consensus.cc:515] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.052330 7633 leader_election.cc:290] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:20.052477 7633 raft_consensus.cc:2749] T 2398c59871d241f985bca1761e722180 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:20.054299 6164 tablet_service.cc:1511] Processing CreateTablet for tablet d0a618976a1748cb94089b5da5a66912 (DEFAULT_TABLE table=default.Table_4d52ed9150ac42568c3fd0be274b49e0 [id=def85f29718b4af79ca0794970a586a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.054775 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0a618976a1748cb94089b5da5a66912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.056162 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 242a63d6282f435aa94fb4307c15ca8a
I20260923 19:50:20.057423 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet a2a793179a6a48cc9e9c2f0da9231416
I20260923 19:50:20.059531 6025 tablet_service.cc:1558] Processing DeleteTablet for tablet 242a63d6282f435aa94fb4307c15ca8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:20.059751 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet a2a793179a6a48cc9e9c2f0da9231416 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:20.061517 6180 tablet_service.cc:1558] Processing DeleteTablet for tablet 242a63d6282f435aa94fb4307c15ca8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:20.061746 6169 tablet_service.cc:1558] Processing DeleteTablet for tablet a2a793179a6a48cc9e9c2f0da9231416 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:20.064821 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_4ca10cac18b944db817de4dbe3bcae86"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:20.064981 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be4c46ee8eb4dbaad01d492b701a9e0" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:20.065238 6342 raft_consensus.cc:2468] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
W20260923 19:50:20.065335 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4ca10cac18b944db817de4dbe3bcae86 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:20.065927 6139 leader_election.cc:304] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:20.066377 7633 raft_consensus.cc:2804] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:20.066468 7633 raft_consensus.cc:493] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:20.066560 7633 raft_consensus.cc:3060] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:20.067139 5796 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b02341c81d754834894152a71d2b3fef" } new_table_name: "default.Table_6daa2c6f70ea40539e4cef7688061c38" modify_external_catalogs: true
I20260923 19:50:20.068318 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_3b64a099365449d4993169c3ea7499e2" } new_table_name: "default.Table_5b3378ec349b41b9b9773a2dfb93c974" modify_external_catalogs: true
I20260923 19:50:20.069454 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_478638fdb21b4fe399163e013b5bce2f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:20.069936 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_478638fdb21b4fe399163e013b5bce2f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:20.070749 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet ea2ef507c6e24d369427048171dfec06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:20.073508 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet a2a793179a6a48cc9e9c2f0da9231416 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:20.073793 5799 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ab3ebc7b91334209aff6147bfcffcf04 consensus state has no leader
I20260923 19:50:20.075078 7256 raft_consensus.cc:493] T dbe06eba8067413a903e4a07c2768484 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:20.075281 7256 raft_consensus.cc:515] T dbe06eba8067413a903e4a07c2768484 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.076378 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe06eba8067413a903e4a07c2768484" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:20.076944 6280 leader_election.cc:343] T dbe06eba8067413a903e4a07c2768484 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:20.077247 7256 leader_election.cc:290] T dbe06eba8067413a903e4a07c2768484 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:20.077831 6279 leader_election.cc:343] T dbe06eba8067413a903e4a07c2768484 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: dbe06eba8067413a903e4a07c2768484
I20260923 19:50:20.077943 6279 leader_election.cc:304] T dbe06eba8067413a903e4a07c2768484 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:20.078454 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet 242a63d6282f435aa94fb4307c15ca8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:20.078660 7256 raft_consensus.cc:2749] T dbe06eba8067413a903e4a07c2768484 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:20.079322 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_a7e155229f914ff4a728fe306c34c505"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:20.079542 6458 rpcz_store.cc:276] 0923 19:50:16.518676 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:16.534244 (+ 15568us) service_pool.cc:224] Handling call
0923 19:50:19.829733 (+3295489us) ts_tablet_manager.cc:1151] Deleting tablet 401d909c37ec4daaa210e4fc32d838aa
0923 19:50:19.829973 (+ 240us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.830790 (+ 817us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3295268}
W20260923 19:50:20.079850 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a7e155229f914ff4a728fe306c34c505 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:20.080554 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 401d909c37ec4daaa210e4fc32d838aa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 401d909c37ec4daaa210e4fc32d838aa already in progress: creating tablet
I20260923 19:50:20.081316 5799 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_4a2086f6ae26496887ae6c132d8456b4" } modify_external_catalogs: true
I20260923 19:50:20.081470 5799 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_4a2086f6ae26496887ae6c132d8456b4" } modify_external_catalogs: true
I20260923 19:50:20.082152 7697 raft_consensus.cc:493] T 64e8951eb899461aa9c0b36e3f7555e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:20.082257 7633 raft_consensus.cc:515] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.082300 7697 raft_consensus.cc:515] T 64e8951eb899461aa9c0b36e3f7555e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:20.083122 7697 leader_election.cc:290] T 64e8951eb899461aa9c0b36e3f7555e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:20.083351 7633 leader_election.cc:290] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:20.083351 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e8951eb899461aa9c0b36e3f7555e2" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:20.083422 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e8951eb899461aa9c0b36e3f7555e2" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:20.083730 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be4c46ee8eb4dbaad01d492b701a9e0" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
W20260923 19:50:20.083817 5996 leader_election.cc:343] T 64e8951eb899461aa9c0b36e3f7555e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:20.083917 6342 raft_consensus.cc:3060] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:20.084383 5801 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_4204ac3c27de40fa97f12202e7d55cb1 [id=ef9a6c259ceb4c189c8902a776fb3bfa] alter complete (version 2)
W20260923 19:50:20.086447 5995 leader_election.cc:343] T 64e8951eb899461aa9c0b36e3f7555e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:20.086601 5995 leader_election.cc:304] T 64e8951eb899461aa9c0b36e3f7555e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:20.086889 7697 raft_consensus.cc:2749] T 64e8951eb899461aa9c0b36e3f7555e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:20.089224 6456 tablet_bootstrap.cc:492] T 98f61ace3a984938ace1fedbaa1dafa3 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:20.089354 6456 ts_tablet_manager.cc:1403] T 98f61ace3a984938ace1fedbaa1dafa3 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.155s user 0.002s sys 0.001s
I20260923 19:50:20.089649 6342 raft_consensus.cc:2468] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:20.090078 6456 raft_consensus.cc:359] T 98f61ace3a984938ace1fedbaa1dafa3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.090309 6456 raft_consensus.cc:385] T 98f61ace3a984938ace1fedbaa1dafa3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:20.090303 6139 leader_election.cc:304] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
W20260923 19:50:20.090579 5790 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet b0ddcbe6166a4a2cb89cb60b3d8458fb (table default.Table_c44ab23a399a40bb919961ac93c1cde4 [id=3d69b12598b2419fa6b5bfdcde469d88], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet b0ddcbe6166a4a2cb89cb60b3d8458fb consensus state has no leader
I20260923 19:50:20.090401 6456 raft_consensus.cc:740] T 98f61ace3a984938ace1fedbaa1dafa3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:20.090977 6456 consensus_queue.cc:260] T 98f61ace3a984938ace1fedbaa1dafa3 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.091006 6034 tablet_service.cc:1511] Processing CreateTablet for tablet d0a618976a1748cb94089b5da5a66912 (DEFAULT_TABLE table=default.Table_4d52ed9150ac42568c3fd0be274b49e0 [id=def85f29718b4af79ca0794970a586a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.091492 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0a618976a1748cb94089b5da5a66912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.091753 6456 ts_tablet_manager.cc:1434] T 98f61ace3a984938ace1fedbaa1dafa3 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:50:20.094959 5801 master_service.cc:960] ReplaceTablet: received request to replace tablet 7595c09be8784a948027dd923c4b023e from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:20.095832 7633 raft_consensus.cc:2804] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:20.096082 7633 raft_consensus.cc:697] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:20.096046 6323 tablet_service.cc:1511] Processing CreateTablet for tablet d0a618976a1748cb94089b5da5a66912 (DEFAULT_TABLE table=default.Table_4d52ed9150ac42568c3fd0be274b49e0 [id=def85f29718b4af79ca0794970a586a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.096473 7633 consensus_queue.cc:237] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.097493 6169 tablet_service.cc:1511] Processing CreateTablet for tablet 493a14f69a264d65be53750d6d8cd7dd (DEFAULT_TABLE table=default.Table_10a60aec581f467fb0c09e6585a852d7 [id=6c6917b802994d2699318c4b6415159d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.097977 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 493a14f69a264d65be53750d6d8cd7dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.101379 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 493a14f69a264d65be53750d6d8cd7dd (DEFAULT_TABLE table=default.Table_10a60aec581f467fb0c09e6585a852d7 [id=6c6917b802994d2699318c4b6415159d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.101824 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 493a14f69a264d65be53750d6d8cd7dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.104347 6324 tablet_service.cc:1511] Processing CreateTablet for tablet 493a14f69a264d65be53750d6d8cd7dd (DEFAULT_TABLE table=default.Table_10a60aec581f467fb0c09e6585a852d7 [id=6c6917b802994d2699318c4b6415159d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.109154 6025 tablet_service.cc:1511] Processing CreateTablet for tablet 047783b76a7b4db7b3939b1cbb89028a (DEFAULT_TABLE table=default.Table_7a874d08526d43f6a0a3e37b65be3167 [id=e2b846bec87247b6a434b226bbf08ca8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.109544 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 047783b76a7b4db7b3939b1cbb89028a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.109776 6180 tablet_service.cc:1511] Processing CreateTablet for tablet 047783b76a7b4db7b3939b1cbb89028a (DEFAULT_TABLE table=default.Table_7a874d08526d43f6a0a3e37b65be3167 [id=e2b846bec87247b6a434b226bbf08ca8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.110236 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 047783b76a7b4db7b3939b1cbb89028a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.122007 6458 tablet_replica.cc:333] T 474e34e902064764864ba06ef41b1d94 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:20.122311 6458 raft_consensus.cc:2243] T 474e34e902064764864ba06ef41b1d94 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:20.122244 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_9e03c535926d4d6f95cc6bebf3c3ea0f" } new_table_name: "default.Table_58fdbcba107b44b78bc5f5a04a636493" modify_external_catalogs: true
I20260923 19:50:20.122599 6458 raft_consensus.cc:2272] T 474e34e902064764864ba06ef41b1d94 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:20.123169 6458 ts_tablet_manager.cc:1916] T 474e34e902064764864ba06ef41b1d94 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:20.125809 7362 raft_consensus.cc:493] T 7af330ae1aaa48209f2bd1880bcfebb1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:20.125939 7362 raft_consensus.cc:515] T 7af330ae1aaa48209f2bd1880bcfebb1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.126502 7362 leader_election.cc:290] T 7af330ae1aaa48209f2bd1880bcfebb1 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:20.127408 6279 leader_election.cc:343] T 7af330ae1aaa48209f2bd1880bcfebb1 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 7af330ae1aaa48209f2bd1880bcfebb1
I20260923 19:50:20.128957 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7af330ae1aaa48209f2bd1880bcfebb1" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:20.130414 6456 tablet_bootstrap.cc:492] T a01a86b6fd4b44d3808c2040525d7b61 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
W20260923 19:50:20.130445 6280 leader_election.cc:343] T 7af330ae1aaa48209f2bd1880bcfebb1 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:20.130589 6280 leader_election.cc:304] T 7af330ae1aaa48209f2bd1880bcfebb1 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:20.130903 7697 raft_consensus.cc:493] T f8052b05169b4673b387ac8b716ffc4e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:20.130951 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0a618976a1748cb94089b5da5a66912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.131033 7697 raft_consensus.cc:515] T f8052b05169b4673b387ac8b716ffc4e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:20.131148 7256 raft_consensus.cc:2749] T 7af330ae1aaa48209f2bd1880bcfebb1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:20.131582 7697 leader_election.cc:290] T f8052b05169b4673b387ac8b716ffc4e P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:20.132155 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8052b05169b4673b387ac8b716ffc4e" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:20.132769 5995 leader_election.cc:343] T f8052b05169b4673b387ac8b716ffc4e P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:20.133554 6456 tablet_bootstrap.cc:654] T a01a86b6fd4b44d3808c2040525d7b61 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:20.133841 6306 tablet_service.cc:1511] Processing CreateTablet for tablet 047783b76a7b4db7b3939b1cbb89028a (DEFAULT_TABLE table=default.Table_7a874d08526d43f6a0a3e37b65be3167 [id=e2b846bec87247b6a434b226bbf08ca8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.134194 6306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 047783b76a7b4db7b3939b1cbb89028a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.134460 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 992ffd38518347fd9b69cd2d9e99c28a (DEFAULT_TABLE table=default.Table_37fae96810d94ad084dc55119b52f9d6 [id=d8e38a580fd94c39a0efcd544404f9fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.134900 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 992ffd38518347fd9b69cd2d9e99c28a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.140112 7256 raft_consensus.cc:493] T 98f61ace3a984938ace1fedbaa1dafa3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:20.140223 7256 raft_consensus.cc:515] T 98f61ace3a984938ace1fedbaa1dafa3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.140743 7256 leader_election.cc:290] T 98f61ace3a984938ace1fedbaa1dafa3 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:20.142030 6458 ts_tablet_manager.cc:1929] T 474e34e902064764864ba06ef41b1d94 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:20.142122 6458 log.cc:1199] T 474e34e902064764864ba06ef41b1d94 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/474e34e902064764864ba06ef41b1d94
I20260923 19:50:20.142380 6458 ts_tablet_manager.cc:1950] T 474e34e902064764864ba06ef41b1d94 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:20.142426 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f61ace3a984938ace1fedbaa1dafa3" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:20.142642 6059 raft_consensus.cc:2468] T 98f61ace3a984938ace1fedbaa1dafa3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:20.143043 6279 leader_election.cc:304] T 98f61ace3a984938ace1fedbaa1dafa3 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:20.143829 7256 raft_consensus.cc:2804] T 98f61ace3a984938ace1fedbaa1dafa3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:20.143923 7256 raft_consensus.cc:493] T 98f61ace3a984938ace1fedbaa1dafa3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:20.143976 7256 raft_consensus.cc:3060] T 98f61ace3a984938ace1fedbaa1dafa3 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:20.143298 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 793) took 3158 ms. Trace:
I20260923 19:50:20.146113 6458 rpcz_store.cc:276] 0923 19:50:16.984640 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:16.984801 (+ 161us) service_pool.cc:224] Handling call
0923 19:50:20.079803 (+3095002us) ts_tablet_manager.cc:1151] Deleting tablet 474e34e902064764864ba06ef41b1d94
0923 19:50:20.121945 (+ 42142us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.126468 (+ 4523us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.141986 (+ 15518us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.143284 (+ 1298us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3094815}
I20260923 19:50:20.146426 6458 tablet_replica.cc:333] T 0e123b69877e4b1fbcdb2b27960864e9 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:20.146584 6458 raft_consensus.cc:2243] T 0e123b69877e4b1fbcdb2b27960864e9 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:20.146705 6458 raft_consensus.cc:2272] T 0e123b69877e4b1fbcdb2b27960864e9 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:20.148492 7256 raft_consensus.cc:515] T 98f61ace3a984938ace1fedbaa1dafa3 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.149655 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f61ace3a984938ace1fedbaa1dafa3" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:20.149711 6458 ts_tablet_manager.cc:1916] T 0e123b69877e4b1fbcdb2b27960864e9 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:20.149812 6059 raft_consensus.cc:3060] T 98f61ace3a984938ace1fedbaa1dafa3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:20.150183 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f61ace3a984938ace1fedbaa1dafa3" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:20.151226 7703 raft_consensus.cc:493] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:20.151413 7703 raft_consensus.cc:515] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.151708 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 474e34e902064764864ba06ef41b1d94 (table default.Table_89c60db74742422086b6dcf76932a865 [id=2d69a962a7234afeb8366c66555b91e1]) successfully deleted
I20260923 19:50:20.152534 6059 raft_consensus.cc:2468] T 98f61ace3a984938ace1fedbaa1dafa3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:20.153126 6279 leader_election.cc:304] T 98f61ace3a984938ace1fedbaa1dafa3 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:20.153362 7362 raft_consensus.cc:2804] T 98f61ace3a984938ace1fedbaa1dafa3 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:20.153448 7362 raft_consensus.cc:697] T 98f61ace3a984938ace1fedbaa1dafa3 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:20.153658 7362 consensus_queue.cc:237] T 98f61ace3a984938ace1fedbaa1dafa3 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.153606 7703 leader_election.cc:290] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:20.154654 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a9d1d4adaa402f90d774e77010c928" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:20.154798 6340 raft_consensus.cc:2468] T 15a9d1d4adaa402f90d774e77010c928 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
W20260923 19:50:20.155344 6280 leader_election.cc:343] T 98f61ace3a984938ace1fedbaa1dafa3 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:20.155340 6139 leader_election.cc:304] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:20.155640 7703 raft_consensus.cc:2804] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:20.155807 7703 raft_consensus.cc:493] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:19.991403 6165 tablet_service.cc:1511] Processing CreateTablet for tablet 60b1f8ceb7d74156926ed601b5a1be62 (DEFAULT_TABLE table=default.Table_10049cc67e6841259815c979fd9bad48 [id=b911d7d4ae144a2e9c3b77b2ba4cc8da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.156574 7703 raft_consensus.cc:3060] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:20.021669 6182 tablet_service.cc:1511] Processing CreateTablet for tablet 12ec3c7cdec64f6b8812b9eed8182719 (DEFAULT_TABLE table=default.Table_6dfb8074013b4f1ea483ee1f73af6dda [id=38f0b7759f594acba288707ef3dbc37d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.024544 6174 tablet_service.cc:1511] Processing CreateTablet for tablet cb2a11a2ff934d599aa56ea86cc9e9e2 (DEFAULT_TABLE table=default.Table_8929125ac27f4ec0b64e59becd7c2027 [id=c1136a220875411e80688c14802dc8b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.156004 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f61ace3a984938ace1fedbaa1dafa3" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:20.156745 6165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60b1f8ceb7d74156926ed601b5a1be62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.160727 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb2a11a2ff934d599aa56ea86cc9e9e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.162544 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8052b05169b4673b387ac8b716ffc4e" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:20.164747 6182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12ec3c7cdec64f6b8812b9eed8182719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.167424 7703 raft_consensus.cc:515] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.170981 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a9d1d4adaa402f90d774e77010c928" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:20.171228 6342 raft_consensus.cc:3060] T 15a9d1d4adaa402f90d774e77010c928 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:19.987881 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet e4f00490b0364f0e9f1b9569b870808e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:20.175462 5996 leader_election.cc:343] T f8052b05169b4673b387ac8b716ffc4e P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:20.175593 5996 leader_election.cc:304] T f8052b05169b4673b387ac8b716ffc4e P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:20.175969 7697 raft_consensus.cc:2749] T f8052b05169b4673b387ac8b716ffc4e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:20.175884 6342 raft_consensus.cc:2468] T 15a9d1d4adaa402f90d774e77010c928 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:20.176406 6139 leader_election.cc:304] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
W20260923 19:50:20.176440 6280 leader_election.cc:343] T 98f61ace3a984938ace1fedbaa1dafa3 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:20.180632 7256 leader_election.cc:290] T 98f61ace3a984938ace1fedbaa1dafa3 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:20.181907 6458 ts_tablet_manager.cc:1929] T 0e123b69877e4b1fbcdb2b27960864e9 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:20.021323 7683 tablet.cc:1751] T ec4284d6a0fa416ca95b4d675c8e3912 P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260923 19:50:20.182400 7697 raft_consensus.cc:493] T 0e650824e4ae474787faeb6c22a4b43f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:20.182540 7697 raft_consensus.cc:515] T 0e650824e4ae474787faeb6c22a4b43f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:20.183261 7697 leader_election.cc:290] T 0e650824e4ae474787faeb6c22a4b43f P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:20.184186 6458 log.cc:1199] T 0e123b69877e4b1fbcdb2b27960864e9 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/0e123b69877e4b1fbcdb2b27960864e9
I20260923 19:50:20.184273 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e650824e4ae474787faeb6c22a4b43f" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:20.184894 5996 leader_election.cc:343] T 0e650824e4ae474787faeb6c22a4b43f P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:20.185927 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 493a14f69a264d65be53750d6d8cd7dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.186192 6458 ts_tablet_manager.cc:1950] T 0e123b69877e4b1fbcdb2b27960864e9 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:20.187029 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 794) took 3202 ms. Trace:
I20260923 19:50:20.192210 6458 rpcz_store.cc:276] 0923 19:50:16.984754 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:16.990506 (+ 5752us) service_pool.cc:224] Handling call
0923 19:50:20.146375 (+3155869us) ts_tablet_manager.cc:1151] Deleting tablet 0e123b69877e4b1fbcdb2b27960864e9
0923 19:50:20.146387 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.152736 (+ 6349us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.181825 (+ 29089us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.187012 (+ 5187us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3155662}
I20260923 19:50:20.192485 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e650824e4ae474787faeb6c22a4b43f" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:20.193044 5995 leader_election.cc:343] T 0e650824e4ae474787faeb6c22a4b43f P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:20.193133 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 0e123b69877e4b1fbcdb2b27960864e9 (table default.Table_0562db93b14243108d8731231ae538c1 [id=74e85060f50e45069c378e7fd4cc7dba]) successfully deleted
I20260923 19:50:20.193177 5995 leader_election.cc:304] T 0e650824e4ae474787faeb6c22a4b43f P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:20.193449 7697 raft_consensus.cc:2749] T 0e650824e4ae474787faeb6c22a4b43f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:20.194195 6458 tablet_replica.cc:333] T 28f9d03be14a4072aab7fd03834c3f6b P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:20.191640 7703 leader_election.cc:290] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:20.194595 6458 raft_consensus.cc:2243] T 28f9d03be14a4072aab7fd03834c3f6b P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:20.194828 7706 raft_consensus.cc:2804] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:20.195029 6458 raft_consensus.cc:2272] T 28f9d03be14a4072aab7fd03834c3f6b P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:20.195732 6458 ts_tablet_manager.cc:1916] T 28f9d03be14a4072aab7fd03834c3f6b P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:20.196339 6139 consensus_peers.cc:597] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Couldn't send request to peer 2bf41435f70447f19992d368ca6b46bd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 474e34e902064764864ba06ef41b1d94. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:20.196709 7706 raft_consensus.cc:697] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:20.197424 7706 consensus_queue.cc:237] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:20.202767 5802 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet adafe0a6b58c4de5a97d17053f7c6bf1 consensus state has no leader
I20260923 19:50:20.206702 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_1eb5249515fc4eab900531c4d0e96923" } modify_external_catalogs: true
I20260923 19:50:20.207026 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_1eb5249515fc4eab900531c4d0e96923" } modify_external_catalogs: true
I20260923 19:50:20.209398 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 900) took 1185 ms. Trace:
I20260923 19:50:20.209542 6461 rpcz_store.cc:276] 0923 19:50:19.023624 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.023674 (+ 50us) service_pool.cc:224] Handling call
0923 19:50:19.792570 (+768896us) ts_tablet_manager.cc:1151] Deleting tablet 554655516bb547ad9c2aa1ee66dc8deb
0923 19:50:19.792579 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:19.938657 (+146078us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:19.943485 (+ 4828us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.209375 (+265890us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":768570}
I20260923 19:50:20.210112 6461 tablet_replica.cc:333] T 6d29923f139445cc86379c80ac15df5d P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:20.210328 6461 raft_consensus.cc:2243] T 6d29923f139445cc86379c80ac15df5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:20.210508 6461 raft_consensus.cc:2272] T 6d29923f139445cc86379c80ac15df5d P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:20.211017 6461 ts_tablet_manager.cc:1916] T 6d29923f139445cc86379c80ac15df5d P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:20.211558 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 554655516bb547ad9c2aa1ee66dc8deb (table default.Table_bf20f5ba63594cce94f323629947c04c [id=648700f6ed984eb8942ecfc647e8c725]) successfully deleted
I20260923 19:50:20.214334 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet 7af330ae1aaa48209f2bd1880bcfebb1 with delete_type TABLET_DATA_DELETED (replaced by tablet 55991fab89be47afba7fcd08673ef82f) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:20.218263 6459 raft_consensus.cc:2243] T d09faa67bdc54d31a7f7a1b012de9ba1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:20.218492 6459 raft_consensus.cc:2272] T d09faa67bdc54d31a7f7a1b012de9ba1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:20.219185 6459 ts_tablet_manager.cc:1916] T d09faa67bdc54d31a7f7a1b012de9ba1 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:20.221902 6458 ts_tablet_manager.cc:1929] T 28f9d03be14a4072aab7fd03834c3f6b P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:20.229437 6164 tablet_service.cc:1511] Processing CreateTablet for tablet 3d224df1bca44e30aff2b307281e399f (DEFAULT_TABLE table=default.Table_7731869fe4bd4efd97e95739dbb3398d [id=33a36cca7746493d8f5065759e7c24e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.229923 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d224df1bca44e30aff2b307281e399f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.229903 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 3d224df1bca44e30aff2b307281e399f (DEFAULT_TABLE table=default.Table_7731869fe4bd4efd97e95739dbb3398d [id=33a36cca7746493d8f5065759e7c24e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.230293 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d224df1bca44e30aff2b307281e399f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.231009 6167 tablet_service.cc:1511] Processing CreateTablet for tablet e6baf2c29bf949fcbc1a4948da3e6575 (DEFAULT_TABLE table=default.Table_b115b41e555e48ee912c9be01ed1700c [id=c2ca52bda1d34ddaa0fc1a3cc897e369]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.231070 6025 tablet_service.cc:1511] Processing CreateTablet for tablet e6baf2c29bf949fcbc1a4948da3e6575 (DEFAULT_TABLE table=default.Table_b115b41e555e48ee912c9be01ed1700c [id=c2ca52bda1d34ddaa0fc1a3cc897e369]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.231379 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6baf2c29bf949fcbc1a4948da3e6575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.231400 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6baf2c29bf949fcbc1a4948da3e6575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.234112 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 992ffd38518347fd9b69cd2d9e99c28a (DEFAULT_TABLE table=default.Table_37fae96810d94ad084dc55119b52f9d6 [id=d8e38a580fd94c39a0efcd544404f9fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.234483 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 992ffd38518347fd9b69cd2d9e99c28a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.231186 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 3d224df1bca44e30aff2b307281e399f (DEFAULT_TABLE table=default.Table_7731869fe4bd4efd97e95739dbb3398d [id=33a36cca7746493d8f5065759e7c24e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.238291 6458 log.cc:1199] T 28f9d03be14a4072aab7fd03834c3f6b P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/28f9d03be14a4072aab7fd03834c3f6b
I20260923 19:50:20.238519 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d224df1bca44e30aff2b307281e399f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.238850 6458 ts_tablet_manager.cc:1950] T 28f9d03be14a4072aab7fd03834c3f6b P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:20.239423 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 795) took 3245 ms. Trace:
I20260923 19:50:20.239841 6458 rpcz_store.cc:276] 0923 19:50:16.994051 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:16.997305 (+ 3254us) service_pool.cc:224] Handling call
0923 19:50:20.194151 (+3196846us) ts_tablet_manager.cc:1151] Deleting tablet 28f9d03be14a4072aab7fd03834c3f6b
0923 19:50:20.194160 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.211318 (+ 17158us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.221834 (+ 10516us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.239408 (+ 17574us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3196638}
I20260923 19:50:20.240451 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 798) took 3087 ms. Trace:
I20260923 19:50:20.240517 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 28f9d03be14a4072aab7fd03834c3f6b (table default.Table_2b35ad69600645618a826140c33c4da8 [id=6a9d5cc3eb1a4dbdbf6a5acaafa07ec7]) successfully deleted
I20260923 19:50:20.231647 6324 tablet_service.cc:1511] Processing CreateTablet for tablet 992ffd38518347fd9b69cd2d9e99c28a (DEFAULT_TABLE table=default.Table_37fae96810d94ad084dc55119b52f9d6 [id=d8e38a580fd94c39a0efcd544404f9fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.240892 6458 rpcz_store.cc:276] 0923 19:50:17.152710 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:17.153942 (+ 1232us) service_pool.cc:224] Handling call
0923 19:50:20.240341 (+3086399us) ts_tablet_manager.cc:1151] Deleting tablet d3f7b33bbf3f453e8e841ee5d99c5b31
0923 19:50:20.240350 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.240437 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3086184}
I20260923 19:50:20.241226 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 992ffd38518347fd9b69cd2d9e99c28a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:20.241701 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet d3f7b33bbf3f453e8e841ee5d99c5b31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3f7b33bbf3f453e8e841ee5d99c5b31 already in progress: creating tablet
I20260923 19:50:20.241928 6457 tablet_bootstrap.cc:492] T c5cb76fa5e084604aa58bf888cfe4852 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:20.242157 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 800) took 3084 ms. Trace:
I20260923 19:50:20.242224 6458 rpcz_store.cc:276] 0923 19:50:17.157338 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:17.157387 (+ 49us) service_pool.cc:224] Handling call
0923 19:50:20.242050 (+3084663us) ts_tablet_manager.cc:1151] Deleting tablet 3a4b9d48f02a4372adce6d9eb80935f6
0923 19:50:20.242059 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.242141 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3084496}
W20260923 19:50:20.242588 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 3a4b9d48f02a4372adce6d9eb80935f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3a4b9d48f02a4372adce6d9eb80935f6 already in progress: creating tablet
I20260923 19:50:20.243281 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 799) took 3086 ms. Trace:
I20260923 19:50:20.243346 6458 rpcz_store.cc:276] 0923 19:50:17.157231 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:17.157585 (+ 354us) service_pool.cc:224] Handling call
0923 19:50:20.243190 (+3085605us) ts_tablet_manager.cc:1151] Deleting tablet f8007918eca14c81947e5999fe13a705
0923 19:50:20.243198 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.243265 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3085486}
I20260923 19:50:20.243484 6457 tablet_bootstrap.cc:654] T c5cb76fa5e084604aa58bf888cfe4852 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:20.243734 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet f8007918eca14c81947e5999fe13a705 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f8007918eca14c81947e5999fe13a705 already in progress: creating tablet
I20260923 19:50:20.244405 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 797) took 3091 ms. Trace:
I20260923 19:50:20.244480 6458 rpcz_store.cc:276] 0923 19:50:17.152614 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:17.162565 (+ 9951us) service_pool.cc:224] Handling call
0923 19:50:20.244311 (+3081746us) ts_tablet_manager.cc:1151] Deleting tablet d39bfd7ec454447cbcc6ed965973355c
0923 19:50:20.244319 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.244389 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3081554}
W20260923 19:50:20.244843 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet d39bfd7ec454447cbcc6ed965973355c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d39bfd7ec454447cbcc6ed965973355c already in progress: creating tablet
I20260923 19:50:20.245776 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 801) took 2783 ms. Trace:
I20260923 19:50:20.246100 6458 rpcz_store.cc:276] 0923 19:50:17.462536 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:17.462606 (+ 70us) service_pool.cc:224] Handling call
0923 19:50:20.245683 (+2783077us) ts_tablet_manager.cc:1151] Deleting tablet ca73c91b58954537af373face5ad2f67
0923 19:50:20.245691 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.245761 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2782888}
W20260923 19:50:20.246701 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet ca73c91b58954537af373face5ad2f67 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca73c91b58954537af373face5ad2f67 already in progress: creating tablet
I20260923 19:50:20.247087 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 802) took 2779 ms. Trace:
I20260923 19:50:20.249782 6458 rpcz_store.cc:276] 0923 19:50:17.467789 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:17.467851 (+ 62us) service_pool.cc:224] Handling call
0923 19:50:20.246984 (+2779133us) ts_tablet_manager.cc:1151] Deleting tablet d1258abcb244430ca8456ad146aa0e67
0923 19:50:20.246992 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.247059 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2778938}
W20260923 19:50:20.250638 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet d1258abcb244430ca8456ad146aa0e67 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1258abcb244430ca8456ad146aa0e67 already in progress: creating tablet
I20260923 19:50:20.251013 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 805) took 2665 ms. Trace:
I20260923 19:50:20.253862 6458 rpcz_store.cc:276] 0923 19:50:17.585713 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:17.585767 (+ 54us) service_pool.cc:224] Handling call
0923 19:50:20.250918 (+2665151us) ts_tablet_manager.cc:1151] Deleting tablet e4375ff709a74bc6b8ef2073fb2c1d18
0923 19:50:20.250927 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.250998 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2587894}
W20260923 19:50:20.254633 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet e4375ff709a74bc6b8ef2073fb2c1d18 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4375ff709a74bc6b8ef2073fb2c1d18 already in progress: creating tablet
I20260923 19:50:20.255143 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 804) took 2669 ms. Trace:
I20260923 19:50:20.255458 6458 rpcz_store.cc:276] 0923 19:50:17.585556 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:17.585937 (+ 381us) service_pool.cc:224] Handling call
0923 19:50:20.255036 (+2669099us) ts_tablet_manager.cc:1151] Deleting tablet d5d3f96ebf1c4d05aceb06ef53737e4f
0923 19:50:20.255044 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.255126 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2591957}
W20260923 19:50:20.256031 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet d5d3f96ebf1c4d05aceb06ef53737e4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d5d3f96ebf1c4d05aceb06ef53737e4f already in progress: creating tablet
I20260923 19:50:20.256593 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 806) took 2669 ms. Trace:
I20260923 19:50:20.256995 6458 rpcz_store.cc:276] 0923 19:50:17.587009 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:17.587061 (+ 52us) service_pool.cc:224] Handling call
0923 19:50:20.256474 (+2669413us) ts_tablet_manager.cc:1151] Deleting tablet e55ab069a0fa48398b39bbb9e7c65cd1
0923 19:50:20.256484 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.256576 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2593342}
W20260923 19:50:20.257637 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet e55ab069a0fa48398b39bbb9e7c65cd1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e55ab069a0fa48398b39bbb9e7c65cd1 already in progress: creating tablet
I20260923 19:50:20.258111 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 807) took 2669 ms. Trace:
I20260923 19:50:20.258443 6458 rpcz_store.cc:276] 0923 19:50:17.588287 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:17.588338 (+ 51us) service_pool.cc:224] Handling call
0923 19:50:20.258013 (+2669675us) ts_tablet_manager.cc:1151] Deleting tablet 5ad33cd4913941c6aa2fea717608ef7c
0923 19:50:20.258024 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.258096 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2592025}
W20260923 19:50:20.259032 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 5ad33cd4913941c6aa2fea717608ef7c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ad33cd4913941c6aa2fea717608ef7c already in progress: creating tablet
I20260923 19:50:20.259444 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 808) took 2667 ms. Trace:
I20260923 19:50:20.263422 6458 rpcz_store.cc:276] 0923 19:50:17.592134 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:17.592436 (+ 302us) service_pool.cc:224] Handling call
0923 19:50:20.259330 (+2666894us) ts_tablet_manager.cc:1151] Deleting tablet ec5793bdec5244aa8cf13b7fb3b84b8a
0923 19:50:20.259339 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.259427 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2593299}
W20260923 19:50:20.264197 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet ec5793bdec5244aa8cf13b7fb3b84b8a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ec5793bdec5244aa8cf13b7fb3b84b8a already in progress: creating tablet
I20260923 19:50:20.264971 6458 tablet_replica.cc:333] T b7ba284e81bc4388bbd6456a41d1f9f4 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:20.265216 6458 raft_consensus.cc:2243] T b7ba284e81bc4388bbd6456a41d1f9f4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:20.265407 6458 raft_consensus.cc:2272] T b7ba284e81bc4388bbd6456a41d1f9f4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:20.266090 6458 ts_tablet_manager.cc:1916] T b7ba284e81bc4388bbd6456a41d1f9f4 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:20.285501 6458 ts_tablet_manager.cc:1929] T b7ba284e81bc4388bbd6456a41d1f9f4 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:20.286168 6458 log.cc:1199] T b7ba284e81bc4388bbd6456a41d1f9f4 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/b7ba284e81bc4388bbd6456a41d1f9f4
I20260923 19:50:20.286458 6458 ts_tablet_manager.cc:1950] T b7ba284e81bc4388bbd6456a41d1f9f4 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:20.262010 7629 raft_consensus.cc:493] T 21bf33904ede470b80a074dc9a458baf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:20.287462 7629 raft_consensus.cc:515] T 21bf33904ede470b80a074dc9a458baf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:20.287622 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 809) took 2684 ms. Trace:
I20260923 19:50:20.287698 6458 rpcz_store.cc:276] 0923 19:50:17.603173 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:17.603225 (+ 52us) service_pool.cc:224] Handling call
0923 19:50:20.264539 (+2661314us) ts_tablet_manager.cc:1151] Deleting tablet b7ba284e81bc4388bbd6456a41d1f9f4
0923 19:50:20.264936 (+ 397us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.275378 (+ 10442us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.285446 (+ 10068us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.287603 (+ 2157us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2593933}
I20260923 19:50:20.288133 7629 leader_election.cc:290] T 21bf33904ede470b80a074dc9a458baf P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:20.288825 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bf33904ede470b80a074dc9a458baf" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:20.289593 5996 leader_election.cc:343] T 21bf33904ede470b80a074dc9a458baf P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:20.289810 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet b7ba284e81bc4388bbd6456a41d1f9f4 (table default.Table_91a9675177604eb39c32e86718c59d31 [id=bf85ae2ea4884de58391fc9e7b140b7f]) successfully deleted
I20260923 19:50:20.291484 6458 tablet_replica.cc:333] T a75c4436a67f453e973a7a7645de79b1 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:20.292475 6456 tablet_bootstrap.cc:492] T a01a86b6fd4b44d3808c2040525d7b61 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:20.292661 6456 ts_tablet_manager.cc:1403] T a01a86b6fd4b44d3808c2040525d7b61 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.162s user 0.011s sys 0.024s
I20260923 19:50:20.293459 6456 raft_consensus.cc:359] T a01a86b6fd4b44d3808c2040525d7b61 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.293615 6456 raft_consensus.cc:385] T a01a86b6fd4b44d3808c2040525d7b61 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:20.293687 6456 raft_consensus.cc:740] T a01a86b6fd4b44d3808c2040525d7b61 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:20.293918 6456 consensus_queue.cc:260] T a01a86b6fd4b44d3808c2040525d7b61 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.294492 6456 ts_tablet_manager.cc:1434] T a01a86b6fd4b44d3808c2040525d7b61 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:20.291894 6458 raft_consensus.cc:2243] T a75c4436a67f453e973a7a7645de79b1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:20.294631 6458 raft_consensus.cc:2272] T a75c4436a67f453e973a7a7645de79b1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:20.295099 6458 ts_tablet_manager.cc:1916] T a75c4436a67f453e973a7a7645de79b1 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:20.297747 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bf33904ede470b80a074dc9a458baf" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:20.298403 5995 leader_election.cc:343] T 21bf33904ede470b80a074dc9a458baf P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:20.298509 5995 leader_election.cc:304] T 21bf33904ede470b80a074dc9a458baf P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:20.298882 7629 raft_consensus.cc:2749] T 21bf33904ede470b80a074dc9a458baf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:20.303462 6456 tablet_bootstrap.cc:492] T 6d29923f139445cc86379c80ac15df5d P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:20.306649 6456 tablet_bootstrap.cc:654] T 6d29923f139445cc86379c80ac15df5d P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:20.315485 6324 tablet_service.cc:1511] Processing CreateTablet for tablet e6baf2c29bf949fcbc1a4948da3e6575 (DEFAULT_TABLE table=default.Table_b115b41e555e48ee912c9be01ed1700c [id=c2ca52bda1d34ddaa0fc1a3cc897e369]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.315946 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6baf2c29bf949fcbc1a4948da3e6575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.332453 6458 ts_tablet_manager.cc:1929] T a75c4436a67f453e973a7a7645de79b1 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:20.334200 6454 tablet_bootstrap.cc:492] T 6238d16b1be74dd88fd2e089fbd85d33 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:20.334375 6458 log.cc:1199] T a75c4436a67f453e973a7a7645de79b1 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/a75c4436a67f453e973a7a7645de79b1
I20260923 19:50:20.334784 6458 ts_tablet_manager.cc:1950] T a75c4436a67f453e973a7a7645de79b1 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:20.334980 6454 ts_tablet_manager.cc:1403] T 6238d16b1be74dd88fd2e089fbd85d33 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.440s user 0.077s sys 0.114s
I20260923 19:50:20.335911 6454 raft_consensus.cc:359] T 6238d16b1be74dd88fd2e089fbd85d33 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:20.336027 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 810) took 2732 ms. Trace:
I20260923 19:50:20.336177 6458 rpcz_store.cc:276] 0923 19:50:17.603573 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:17.603686 (+ 113us) service_pool.cc:224] Handling call
0923 19:50:20.291439 (+2687753us) ts_tablet_manager.cc:1151] Deleting tablet a75c4436a67f453e973a7a7645de79b1
0923 19:50:20.291449 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.298145 (+ 6696us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.332349 (+ 34204us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.335997 (+ 3648us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2618669}
I20260923 19:50:20.336891 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet a75c4436a67f453e973a7a7645de79b1 (table default.Table_30ce30e86cff4c8f9995423040b349c9 [id=e579cc40ccb84a7aa8c508342e6e19be]) successfully deleted
I20260923 19:50:20.337004 6454 raft_consensus.cc:385] T 6238d16b1be74dd88fd2e089fbd85d33 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:20.337061 6454 raft_consensus.cc:740] T 6238d16b1be74dd88fd2e089fbd85d33 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:20.337240 6454 consensus_queue.cc:260] T 6238d16b1be74dd88fd2e089fbd85d33 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:20.338764 6166 tablet_service.cc:1511] Processing CreateTablet for tablet 42116098fe5440959411399b6a7ba090 (DEFAULT_TABLE table=default.Table_b8c82428065244aeb53ee2590094329c [id=b48019e836044ef2be9c5315ed844752]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.339283 6454 ts_tablet_manager.cc:1434] T 6238d16b1be74dd88fd2e089fbd85d33 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260923 19:50:20.340922 6458 tablet_replica.cc:333] T 5e711e48156b46b5a517b330d6d41309 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:20.341202 6458 raft_consensus.cc:2243] T 5e711e48156b46b5a517b330d6d41309 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:20.341418 6458 raft_consensus.cc:2272] T 5e711e48156b46b5a517b330d6d41309 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:20.342042 6458 ts_tablet_manager.cc:1916] T 5e711e48156b46b5a517b330d6d41309 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:20.342396 6454 tablet_bootstrap.cc:492] T 2948d729e1ec4dfca70789bcad513e52 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:20.343942 7629 raft_consensus.cc:493] T ea2ef507c6e24d369427048171dfec06 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:20.344075 7629 raft_consensus.cc:515] T ea2ef507c6e24d369427048171dfec06 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:20.344710 7629 leader_election.cc:290] T ea2ef507c6e24d369427048171dfec06 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:20.345331 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2ef507c6e24d369427048171dfec06" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:20.346424 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2ef507c6e24d369427048171dfec06" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:20.347628 6324 tablet_service.cc:1511] Processing CreateTablet for tablet 42116098fe5440959411399b6a7ba090 (DEFAULT_TABLE table=default.Table_b8c82428065244aeb53ee2590094329c [id=b48019e836044ef2be9c5315ed844752]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.348155 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42116098fe5440959411399b6a7ba090. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.352905 6456 tablet_bootstrap.cc:492] T 6d29923f139445cc86379c80ac15df5d P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:20.353118 6456 ts_tablet_manager.cc:1403] T 6d29923f139445cc86379c80ac15df5d P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.050s user 0.018s sys 0.003s
I20260923 19:50:20.353369 6027 tablet_service.cc:1511] Processing CreateTablet for tablet 42116098fe5440959411399b6a7ba090 (DEFAULT_TABLE table=default.Table_b8c82428065244aeb53ee2590094329c [id=b48019e836044ef2be9c5315ed844752]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.353760 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42116098fe5440959411399b6a7ba090. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.354048 6458 ts_tablet_manager.cc:1929] T 5e711e48156b46b5a517b330d6d41309 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:20.354213 6458 log.cc:1199] T 5e711e48156b46b5a517b330d6d41309 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/5e711e48156b46b5a517b330d6d41309
I20260923 19:50:20.354627 6458 ts_tablet_manager.cc:1950] T 5e711e48156b46b5a517b330d6d41309 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:20.354602 6456 raft_consensus.cc:359] T 6d29923f139445cc86379c80ac15df5d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.354944 6456 raft_consensus.cc:385] T 6d29923f139445cc86379c80ac15df5d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:20.355069 6456 raft_consensus.cc:740] T 6d29923f139445cc86379c80ac15df5d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:20.355455 6456 consensus_queue.cc:260] T 6d29923f139445cc86379c80ac15df5d P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.357576 6456 ts_tablet_manager.cc:1434] T 6d29923f139445cc86379c80ac15df5d P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260923 19:50:20.359524 6456 tablet_bootstrap.cc:492] T c031d99a6f9844c29664236662e8d5f8 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:20.369427 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 811) took 2765 ms. Trace:
I20260923 19:50:20.369606 6458 rpcz_store.cc:276] 0923 19:50:17.603949 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:17.603999 (+ 50us) service_pool.cc:224] Handling call
0923 19:50:20.336594 (+2732595us) ts_tablet_manager.cc:1151] Deleting tablet 5e711e48156b46b5a517b330d6d41309
0923 19:50:20.340877 (+ 4283us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.349187 (+ 8310us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.353993 (+ 4806us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.369400 (+ 15407us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2663322}
I20260923 19:50:20.369906 6456 tablet_bootstrap.cc:654] T c031d99a6f9844c29664236662e8d5f8 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:20.370314 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 5e711e48156b46b5a517b330d6d41309 (table default.Table_f68f50c8c0a74d59826e623c007a41a8 [id=24509437bc6049aab27952daeb610184]) successfully deleted
I20260923 19:50:20.371896 6458 tablet_replica.cc:333] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:20.372193 6458 raft_consensus.cc:2243] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:20.372617 6458 pending_rounds.cc:70] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd: Trying to abort 1 pending ops.
I20260923 19:50:20.372740 6458 pending_rounds.cc:77] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630602086252544 op_type: NO_OP noop_request { }
I20260923 19:50:20.372948 6458 raft_consensus.cc:2889] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:20.373134 6458 raft_consensus.cc:2272] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:20.373929 6458 ts_tablet_manager.cc:1916] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:20.382534 6164 tablet_service.cc:1511] Processing CreateTablet for tablet 4f0de9a4b9164e05874d322a0b4a8e46 (DEFAULT_TABLE table=default.Table_c9caa816995b4d02b2b42ef1f29e41e1 [id=0cfdf5f8a7d54ce69a8eca5603a93ff8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:20.386562 5796 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0e650824e4ae474787faeb6c22a4b43f consensus state has no leader
I20260923 19:50:20.387859 6458 ts_tablet_manager.cc:1929] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:20.388037 6458 log.cc:1199] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/edb52bd88b424129bbdc45de89b56efb
I20260923 19:50:20.388442 6458 ts_tablet_manager.cc:1950] T edb52bd88b424129bbdc45de89b56efb P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
W20260923 19:50:20.388543 5800 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0e817b7284e4496caf519b06a47b8e90 consensus state has no leader
I20260923 19:50:20.389359 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 813) took 2757 ms. Trace:
I20260923 19:50:20.389487 6458 rpcz_store.cc:276] 0923 19:50:17.631984 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:17.632034 (+ 50us) service_pool.cc:224] Handling call
0923 19:50:20.370662 (+2738628us) ts_tablet_manager.cc:1151] Deleting tablet edb52bd88b424129bbdc45de89b56efb
0923 19:50:20.371802 (+ 1140us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.383127 (+ 11325us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.387805 (+ 4678us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.389337 (+ 1532us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2696993}
I20260923 19:50:20.389918 6458 tablet_replica.cc:333] T d6d3601a392f4723b4ca00f6e12b950c P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:20.390156 6458 raft_consensus.cc:2243] T d6d3601a392f4723b4ca00f6e12b950c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:20.390338 6458 raft_consensus.cc:2272] T d6d3601a392f4723b4ca00f6e12b950c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:20.390461 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet edb52bd88b424129bbdc45de89b56efb (table default.Table_42710edebf0e439ba99e3c85c82be9f4 [id=918936f42dad4927bd643541a36f9e5a]) successfully deleted
I20260923 19:50:20.390898 6458 ts_tablet_manager.cc:1916] T d6d3601a392f4723b4ca00f6e12b950c P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:20.395547 6456 tablet_bootstrap.cc:492] T c031d99a6f9844c29664236662e8d5f8 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:20.395771 6456 ts_tablet_manager.cc:1403] T c031d99a6f9844c29664236662e8d5f8 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.037s user 0.002s sys 0.005s
I20260923 19:50:20.397182 6456 raft_consensus.cc:359] T c031d99a6f9844c29664236662e8d5f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.397495 6456 raft_consensus.cc:385] T c031d99a6f9844c29664236662e8d5f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:20.397643 6456 raft_consensus.cc:740] T c031d99a6f9844c29664236662e8d5f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:20.397737 5799 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 206445f79869410f8e9109c2b85256e9
I20260923 19:50:20.397698 6458 ts_tablet_manager.cc:1929] T d6d3601a392f4723b4ca00f6e12b950c P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:20.398051 6458 log.cc:1199] T d6d3601a392f4723b4ca00f6e12b950c P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/d6d3601a392f4723b4ca00f6e12b950c
I20260923 19:50:20.398124 6456 consensus_queue.cc:260] T c031d99a6f9844c29664236662e8d5f8 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.398487 6458 ts_tablet_manager.cc:1950] T d6d3601a392f4723b4ca00f6e12b950c P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:20.399262 6456 ts_tablet_manager.cc:1434] T c031d99a6f9844c29664236662e8d5f8 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:50:20.401041 6456 tablet_bootstrap.cc:492] T 1b1d9413e1e24547b491a160d851377b P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:20.406216 6197 raft_consensus.cc:3060] T 2398c59871d241f985bca1761e722180 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
W20260923 19:50:20.406886 6137 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.193:39887, user_credentials={real_user=slave}} blocked reactor thread for 355713us
I20260923 19:50:20.411621 6456 tablet_bootstrap.cc:654] T 1b1d9413e1e24547b491a160d851377b P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:20.429626 6457 tablet_bootstrap.cc:492] T c5cb76fa5e084604aa58bf888cfe4852 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:20.429780 6457 ts_tablet_manager.cc:1403] T c5cb76fa5e084604aa58bf888cfe4852 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.188s user 0.007s sys 0.032s
I20260923 19:50:20.430864 6457 raft_consensus.cc:359] T c5cb76fa5e084604aa58bf888cfe4852 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:20.431049 6457 raft_consensus.cc:385] T c5cb76fa5e084604aa58bf888cfe4852 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:20.431119 6457 raft_consensus.cc:740] T c5cb76fa5e084604aa58bf888cfe4852 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:20.431382 6457 consensus_queue.cc:260] T c5cb76fa5e084604aa58bf888cfe4852 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:20.434507 6457 ts_tablet_manager.cc:1434] T c5cb76fa5e084604aa58bf888cfe4852 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
W20260923 19:50:20.418452 6137 leader_election.cc:343] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 9be4c46ee8eb4dbaad01d492b701a9e0
I20260923 19:50:20.435859 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 814) took 2803 ms. Trace:
I20260923 19:50:20.436350 6456 tablet_bootstrap.cc:492] T 1b1d9413e1e24547b491a160d851377b P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:20.436411 6458 rpcz_store.cc:276] 0923 19:50:17.632451 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:17.632502 (+ 51us) service_pool.cc:224] Handling call
0923 19:50:20.389845 (+2757343us) ts_tablet_manager.cc:1151] Deleting tablet d6d3601a392f4723b4ca00f6e12b950c
0923 19:50:20.389857 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.394553 (+ 4696us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.397654 (+ 3101us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.435836 (+ 38182us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2716098}
I20260923 19:50:20.436860 5801 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 7595c09be8784a948027dd923c4b023e
I20260923 19:50:20.437131 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet d6d3601a392f4723b4ca00f6e12b950c (table default.Table_74b3ada03dc14044b09a369b0e3782c7 [id=6c09f84a1d19402b8b59bbc60ae92bcb]) successfully deleted
I20260923 19:50:20.437332 5799 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7731869fe4bd4efd97e95739dbb3398d" } modify_external_catalogs: true
I20260923 19:50:20.437566 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 819) took 2734 ms. Trace:
I20260923 19:50:20.437587 5799 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7731869fe4bd4efd97e95739dbb3398d" } modify_external_catalogs: true
I20260923 19:50:20.437640 6458 rpcz_store.cc:276] 0923 19:50:17.703272 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:17.703444 (+ 172us) service_pool.cc:224] Handling call
0923 19:50:20.437445 (+2734001us) ts_tablet_manager.cc:1151] Deleting tablet 4a034eb9b02d4532b4b68e74c8e5b3fa
0923 19:50:20.437457 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.437551 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2707251}
I20260923 19:50:20.437911 6458 tablet_replica.cc:333] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:20.437970 6310 tablet_service.cc:1558] Processing DeleteTablet for tablet 7595c09be8784a948027dd923c4b023e with delete_type TABLET_DATA_DELETED (replaced by tablet caeb98aa3fbe4216b1672e6f8867f298) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:20.438082 6458 raft_consensus.cc:2243] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:20.438212 6458 raft_consensus.cc:2272] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:20.438411 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 4a034eb9b02d4532b4b68e74c8e5b3fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4a034eb9b02d4532b4b68e74c8e5b3fa already in progress: creating tablet
I20260923 19:50:20.438688 6458 ts_tablet_manager.cc:1916] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:20.438825 6456 ts_tablet_manager.cc:1403] T 1b1d9413e1e24547b491a160d851377b P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.038s user 0.000s sys 0.007s
I20260923 19:50:20.437435 5801 catalog_manager.cc:6934] ReplaceTablet: tablet 7595c09be8784a948027dd923c4b023e deleted and replaced by tablet caeb98aa3fbe4216b1672e6f8867f298
I20260923 19:50:20.439296 5801 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_9facb802b3094c0b9bf0aeb831c771f6" } modify_external_catalogs: true
I20260923 19:50:20.439464 5801 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_9facb802b3094c0b9bf0aeb831c771f6" } modify_external_catalogs: true
I20260923 19:50:20.440280 6456 raft_consensus.cc:359] T 1b1d9413e1e24547b491a160d851377b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.440806 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_4e659925285b492f84b4407a73a22df4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:20.442804 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_1897b70d41264c8bb98149a4706b6241"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:20.443454 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1897b70d41264c8bb98149a4706b6241 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:20.443531 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_41570ed681004d9ab578895331e71f3d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:20.444046 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41570ed681004d9ab578895331e71f3d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:20.444983 5805 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d3fd774b813349ad97efc22b5a85001d" } modify_external_catalogs: true
I20260923 19:50:20.445214 5805 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d3fd774b813349ad97efc22b5a85001d" } modify_external_catalogs: true
I20260923 19:50:20.447315 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_3d78c480be184d61b66155d65fa315a9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:20.447983 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d78c480be184d61b66155d65fa315a9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:20.448105 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet 7595c09be8784a948027dd923c4b023e with delete_type TABLET_DATA_DELETED (replaced by tablet caeb98aa3fbe4216b1672e6f8867f298) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:20.448794 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c4b38cbca5ca4d18b5985397ab229b70 has no consensus state
W20260923 19:50:20.449116 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4e659925285b492f84b4407a73a22df4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:20.450645 6456 raft_consensus.cc:385] T 1b1d9413e1e24547b491a160d851377b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:20.450641 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_15698f6ba4eb46b28ed8802eec49ff69"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:20.450902 6456 raft_consensus.cc:740] T 1b1d9413e1e24547b491a160d851377b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
W20260923 19:50:20.451140 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_15698f6ba4eb46b28ed8802eec49ff69 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:20.451377 6456 consensus_queue.cc:260] T 1b1d9413e1e24547b491a160d851377b P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.452422 5796 catalog_manager.cc:5838] T 98f61ace3a984938ace1fedbaa1dafa3 P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:20.452904 5796 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 98f61ace3a984938ace1fedbaa1dafa3 (table default.Table_c624a31c5179478cb6c54a36d7a36892 [id=26caa02bc37e471abdf29bbbb3acba69]). Expected version 3 got 0
I20260923 19:50:20.455179 6456 ts_tablet_manager.cc:1434] T 1b1d9413e1e24547b491a160d851377b P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260923 19:50:20.456700 6456 tablet_bootstrap.cc:492] T 6ac04be575704a69994f98e00411a254 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:20.464617 6391 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
W20260923 19:50:20.466372 6137 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.193:39887, user_credentials={real_user=slave}} blocked reactor thread for 48041.4us
W20260923 19:50:20.466764 6137 leader_election.cc:343] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 9be4c46ee8eb4dbaad01d492b701a9e0
I20260923 19:50:20.466887 6456 tablet_bootstrap.cc:654] T 6ac04be575704a69994f98e00411a254 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:20.467265 6137 leader_election.cc:343] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 15a9d1d4adaa402f90d774e77010c928
I20260923 19:50:20.467798 7256 raft_consensus.cc:493] T 6d29923f139445cc86379c80ac15df5d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260923 19:50:20.467797 6137 leader_election.cc:343] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 15a9d1d4adaa402f90d774e77010c928
I20260923 19:50:20.467913 7256 raft_consensus.cc:515] T 6d29923f139445cc86379c80ac15df5d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:20.468262 6137 consensus_peers.cc:597] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 474e34e902064764864ba06ef41b1d94. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:20.468451 7256 leader_election.cc:290] T 6d29923f139445cc86379c80ac15df5d P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:20.469210 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d29923f139445cc86379c80ac15df5d" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:20.470048 6280 leader_election.cc:343] T 6d29923f139445cc86379c80ac15df5d P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:20.473764 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet c82bb40047b342d5b9468ecc374ef829
I20260923 19:50:20.473941 7256 raft_consensus.cc:493] T a01a86b6fd4b44d3808c2040525d7b61 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:20.474061 7256 raft_consensus.cc:515] T a01a86b6fd4b44d3808c2040525d7b61 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.474722 7256 leader_election.cc:290] T a01a86b6fd4b44d3808c2040525d7b61 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:20.475206 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet c82bb40047b342d5b9468ecc374ef829 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:20 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:20.475281 6310 tablet_service.cc:1558] Processing DeleteTablet for tablet c82bb40047b342d5b9468ecc374ef829 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:20 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:20.476327 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01a86b6fd4b44d3808c2040525d7b61" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:20.476908 6280 leader_election.cc:343] T a01a86b6fd4b44d3808c2040525d7b61 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:20.478379 6457 tablet_bootstrap.cc:492] T 2e1c19a751904a6295897376e9c5ee56 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:20.479887 6457 tablet_bootstrap.cc:654] T 2e1c19a751904a6295897376e9c5ee56 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:20.482100 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 4f0de9a4b9164e05874d322a0b4a8e46 (DEFAULT_TABLE table=default.Table_c9caa816995b4d02b2b42ef1f29e41e1 [id=0cfdf5f8a7d54ce69a8eca5603a93ff8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.482501 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f0de9a4b9164e05874d322a0b4a8e46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.484383 6458 ts_tablet_manager.cc:1929] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:20.484516 6458 log.cc:1199] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/c012b2a92dc14f2ab5d9f4fe8a6a7779
I20260923 19:50:20.484953 6458 ts_tablet_manager.cc:1950] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:20.486053 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 822) took 2732 ms. Trace:
I20260923 19:50:20.486209 6458 rpcz_store.cc:276] 0923 19:50:17.754080 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:17.775068 (+ 20988us) service_pool.cc:224] Handling call
0923 19:50:20.437844 (+2662776us) ts_tablet_manager.cc:1151] Deleting tablet c012b2a92dc14f2ab5d9f4fe8a6a7779
0923 19:50:20.437854 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.444386 (+ 6532us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.484338 (+ 39952us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.486036 (+ 1698us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2660907}
I20260923 19:50:20.486764 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet c012b2a92dc14f2ab5d9f4fe8a6a7779 (table default.Table_036d9052e0264e978bf3e3698ca8c08b [id=b2fef7fe862a41e493f5e1646b41bd5f]) successfully deleted
I20260923 19:50:20.487248 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 828) took 2481 ms. Trace:
I20260923 19:50:20.487378 6458 rpcz_store.cc:276] 0923 19:50:18.006230 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.006409 (+ 179us) service_pool.cc:224] Handling call
0923 19:50:20.487110 (+2480701us) ts_tablet_manager.cc:1151] Deleting tablet b9c084a319c449328b639d604c00946a
0923 19:50:20.487120 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.487232 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2480444}
I20260923 19:50:20.487807 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f0de9a4b9164e05874d322a0b4a8e46. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:20.487927 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet b9c084a319c449328b639d604c00946a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9c084a319c449328b639d604c00946a already in progress: creating tablet
I20260923 19:50:20.488265 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 827) took 2485 ms. Trace:
I20260923 19:50:20.488335 6458 rpcz_store.cc:276] 0923 19:50:18.002871 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.006698 (+ 3827us) service_pool.cc:224] Handling call
0923 19:50:20.488165 (+2481467us) ts_tablet_manager.cc:1151] Deleting tablet 37769256de33432697e9d4fb235f473f
0923 19:50:20.488174 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.488249 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2481295}
W20260923 19:50:20.488834 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 37769256de33432697e9d4fb235f473f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 37769256de33432697e9d4fb235f473f already in progress: creating tablet
I20260923 19:50:20.489176 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 831) took 2426 ms. Trace:
I20260923 19:50:20.489248 6458 rpcz_store.cc:276] 0923 19:50:18.062292 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.062349 (+ 57us) service_pool.cc:224] Handling call
0923 19:50:20.489057 (+2426708us) ts_tablet_manager.cc:1151] Deleting tablet 29e6ea6b3eda4df88a539627d4505885
0923 19:50:20.489067 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.489162 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2404527}
W20260923 19:50:20.489658 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 29e6ea6b3eda4df88a539627d4505885 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29e6ea6b3eda4df88a539627d4505885 already in progress: creating tablet
I20260923 19:50:20.489985 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 830) took 2435 ms. Trace:
I20260923 19:50:20.490099 6458 rpcz_store.cc:276] 0923 19:50:18.054635 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.063071 (+ 8436us) service_pool.cc:224] Handling call
0923 19:50:20.489867 (+2426796us) ts_tablet_manager.cc:1151] Deleting tablet 88640e1a21154073ae0db18b171408b7
0923 19:50:20.489891 (+ 24us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.489964 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2405265}
W20260923 19:50:20.490535 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 88640e1a21154073ae0db18b171408b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 88640e1a21154073ae0db18b171408b7 already in progress: creating tablet
I20260923 19:50:20.490645 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42116098fe5440959411399b6a7ba090. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.490881 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 832) took 2409 ms. Trace:
I20260923 19:50:20.490969 6458 rpcz_store.cc:276] 0923 19:50:18.081763 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.081830 (+ 67us) service_pool.cc:224] Handling call
0923 19:50:20.490783 (+2408953us) ts_tablet_manager.cc:1151] Deleting tablet 0c30bd7ab8fa42dea5de04c8d36f2e54
0923 19:50:20.490791 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.490865 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2406129}
W20260923 19:50:20.491408 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 0c30bd7ab8fa42dea5de04c8d36f2e54 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c30bd7ab8fa42dea5de04c8d36f2e54 already in progress: creating tablet
I20260923 19:50:20.491803 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 833) took 2348 ms. Trace:
I20260923 19:50:20.491914 6458 rpcz_store.cc:276] 0923 19:50:18.143599 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.143656 (+ 57us) service_pool.cc:224] Handling call
0923 19:50:20.491655 (+2347999us) ts_tablet_manager.cc:1151] Deleting tablet 670d9cb0e6e2414092f72ffd5e6b00ea
0923 19:50:20.491665 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.491785 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2347814}
W20260923 19:50:20.492563 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 670d9cb0e6e2414092f72ffd5e6b00ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 670d9cb0e6e2414092f72ffd5e6b00ea already in progress: creating tablet
I20260923 19:50:20.493048 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 834) took 2294 ms. Trace:
I20260923 19:50:20.493171 6458 rpcz_store.cc:276] 0923 19:50:18.198415 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.198467 (+ 52us) service_pool.cc:224] Handling call
0923 19:50:20.492937 (+2294470us) ts_tablet_manager.cc:1151] Deleting tablet e5fce24b9dc244c88ccbc16b633924fe
0923 19:50:20.492946 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.493030 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2294299}
W20260923 19:50:20.493631 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet e5fce24b9dc244c88ccbc16b633924fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e5fce24b9dc244c88ccbc16b633924fe already in progress: creating tablet
I20260923 19:50:20.494045 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 835) took 2225 ms. Trace:
I20260923 19:50:20.494171 6458 rpcz_store.cc:276] 0923 19:50:18.268412 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.268562 (+ 150us) service_pool.cc:224] Handling call
0923 19:50:20.493931 (+2225369us) ts_tablet_manager.cc:1151] Deleting tablet 717101b8668f4cadb5180bb8e17939e9
0923 19:50:20.493940 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.494028 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2225088}
W20260923 19:50:20.494628 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 717101b8668f4cadb5180bb8e17939e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 717101b8668f4cadb5180bb8e17939e9 already in progress: creating tablet
I20260923 19:50:20.494984 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 836) took 2226 ms. Trace:
I20260923 19:50:20.495103 6458 rpcz_store.cc:276] 0923 19:50:18.268514 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.268825 (+ 311us) service_pool.cc:224] Handling call
0923 19:50:20.494879 (+2226054us) ts_tablet_manager.cc:1151] Deleting tablet e6e04d16675443fc923a5f8216e292b6
0923 19:50:20.494889 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.494964 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2225918}
W20260923 19:50:20.495561 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet e6e04d16675443fc923a5f8216e292b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6e04d16675443fc923a5f8216e292b6 already in progress: creating tablet
I20260923 19:50:20.496052 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 838) took 2214 ms. Trace:
I20260923 19:50:20.496176 6458 rpcz_store.cc:276] 0923 19:50:18.281818 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.286281 (+ 4463us) service_pool.cc:224] Handling call
0923 19:50:20.495939 (+2209658us) ts_tablet_manager.cc:1151] Deleting tablet 355b2fc61d4f4efd918204079f1ebf35
0923 19:50:20.495949 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.496037 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2209484}
W20260923 19:50:20.496619 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 355b2fc61d4f4efd918204079f1ebf35 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 355b2fc61d4f4efd918204079f1ebf35 already in progress: creating tablet
I20260923 19:50:20.496969 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 840) took 2208 ms. Trace:
I20260923 19:50:20.497084 6458 rpcz_store.cc:276] 0923 19:50:18.288245 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.288518 (+ 273us) service_pool.cc:224] Handling call
0923 19:50:20.496865 (+2208347us) ts_tablet_manager.cc:1151] Deleting tablet c462a9a5bde64e8094d7a2ca09740fc9
0923 19:50:20.496875 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.496949 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2208177}
W20260923 19:50:20.497538 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet c462a9a5bde64e8094d7a2ca09740fc9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c462a9a5bde64e8094d7a2ca09740fc9 already in progress: creating tablet
I20260923 19:50:20.497841 6458 tablet_replica.cc:333] T 15a9d1d4adaa402f90d774e77010c928 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:20.498097 6458 raft_consensus.cc:2243] T 15a9d1d4adaa402f90d774e77010c928 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:20.498297 6458 raft_consensus.cc:2272] T 15a9d1d4adaa402f90d774e77010c928 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:20.498893 6458 ts_tablet_manager.cc:1916] T 15a9d1d4adaa402f90d774e77010c928 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:20.501545 6167 tablet_service.cc:1511] Processing CreateTablet for tablet f5f285e125dc445197a59e02e199a606 (DEFAULT_TABLE table=default.Table_3974c6faa5a94a44a6c15aae07db7da2 [id=86709da2c4584321bb1919876bdc72c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.501912 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f285e125dc445197a59e02e199a606. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.505527 6458 ts_tablet_manager.cc:1929] T 15a9d1d4adaa402f90d774e77010c928 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:20.505625 6458 log.cc:1199] T 15a9d1d4adaa402f90d774e77010c928 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/15a9d1d4adaa402f90d774e77010c928
I20260923 19:50:20.505978 6458 ts_tablet_manager.cc:1950] T 15a9d1d4adaa402f90d774e77010c928 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:20.507131 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 848) took 2140 ms. Trace:
I20260923 19:50:20.507268 6458 rpcz_store.cc:276] 0923 19:50:18.366517 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.366656 (+ 139us) service_pool.cc:224] Handling call
0923 19:50:20.497800 (+2131144us) ts_tablet_manager.cc:1151] Deleting tablet 15a9d1d4adaa402f90d774e77010c928
0923 19:50:20.497808 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.502325 (+ 4517us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.505479 (+ 3154us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.507108 (+ 1629us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2130901}
I20260923 19:50:20.507834 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 15a9d1d4adaa402f90d774e77010c928 (table default.Table_527c2568db7446559d0c719602184b02 [id=9e398f48d86e4c5898cac7336d3c24bf]) successfully deleted
I20260923 19:50:20.508194 6458 tablet_replica.cc:333] T c504ec668a33451fb1249f697bb5e2bb P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:20.508435 6458 raft_consensus.cc:2243] T c504ec668a33451fb1249f697bb5e2bb P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:20.508637 6458 raft_consensus.cc:2272] T c504ec668a33451fb1249f697bb5e2bb P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:20.509207 6458 ts_tablet_manager.cc:1916] T c504ec668a33451fb1249f697bb5e2bb P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:20.510838 6310 tablet_service.cc:1511] Processing CreateTablet for tablet f5f285e125dc445197a59e02e199a606 (DEFAULT_TABLE table=default.Table_3974c6faa5a94a44a6c15aae07db7da2 [id=86709da2c4584321bb1919876bdc72c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.511235 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f285e125dc445197a59e02e199a606. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.515813 6458 ts_tablet_manager.cc:1929] T c504ec668a33451fb1249f697bb5e2bb P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:20.515988 6458 log.cc:1199] T c504ec668a33451fb1249f697bb5e2bb P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/c504ec668a33451fb1249f697bb5e2bb
I20260923 19:50:20.516331 6459 ts_tablet_manager.cc:1929] T d09faa67bdc54d31a7f7a1b012de9ba1 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:20.516396 6458 ts_tablet_manager.cc:1950] T c504ec668a33451fb1249f697bb5e2bb P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:20.516501 6459 log.cc:1199] T d09faa67bdc54d31a7f7a1b012de9ba1 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/d09faa67bdc54d31a7f7a1b012de9ba1
I20260923 19:50:20.516785 6459 ts_tablet_manager.cc:1950] T d09faa67bdc54d31a7f7a1b012de9ba1 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:20.517303 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 847) took 2150 ms. Trace:
I20260923 19:50:20.517303 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 866) took 1802 ms. Trace:
I20260923 19:50:20.517464 6458 rpcz_store.cc:276] 0923 19:50:18.366387 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.366930 (+ 543us) service_pool.cc:224] Handling call
0923 19:50:20.508147 (+2141217us) ts_tablet_manager.cc:1151] Deleting tablet c504ec668a33451fb1249f697bb5e2bb
0923 19:50:20.508156 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.512656 (+ 4500us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.515771 (+ 3115us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.517286 (+ 1515us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2141070}
I20260923 19:50:20.517434 6459 rpcz_store.cc:276] 0923 19:50:18.714521 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.714643 (+ 122us) service_pool.cc:224] Handling call
0923 19:50:19.969817 (+1255174us) ts_tablet_manager.cc:1151] Deleting tablet d09faa67bdc54d31a7f7a1b012de9ba1
0923 19:50:19.969830 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.359972 (+390142us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.516285 (+156313us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.517286 (+ 1001us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16761,"tablet-delete.queue_time_us":1255019}
I20260923 19:50:20.518095 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet c504ec668a33451fb1249f697bb5e2bb (table default.Table_870cfa1b62c4442d866d3b9b1aec4bc7 [id=b8b525ace3444e3fb6548fb9f2064765]) successfully deleted
I20260923 19:50:20.518477 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 849) took 2123 ms. Trace:
I20260923 19:50:20.518477 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 871) took 1677 ms. Trace:
I20260923 19:50:20.518615 6458 rpcz_store.cc:276] 0923 19:50:18.394754 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.422908 (+ 28154us) service_pool.cc:224] Handling call
0923 19:50:20.518379 (+2095471us) ts_tablet_manager.cc:1151] Deleting tablet 1d905af116d9446ab001555014b2a2d2
0923 19:50:20.518387 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.518461 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2095253}
I20260923 19:50:20.518608 6459 rpcz_store.cc:276] 0923 19:50:18.840677 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.840728 (+ 51us) service_pool.cc:224] Handling call
0923 19:50:20.518278 (+1677550us) ts_tablet_manager.cc:1151] Deleting tablet 3dead6c00e2c4516aa01547496a207fe
0923 19:50:20.518288 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.518436 (+ 148us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1670976}
W20260923 19:50:20.519168 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 1d905af116d9446ab001555014b2a2d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d905af116d9446ab001555014b2a2d2 already in progress: creating tablet
W20260923 19:50:20.519173 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 3dead6c00e2c4516aa01547496a207fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3dead6c00e2c4516aa01547496a207fe already in progress: creating tablet
I20260923 19:50:20.519488 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 873) took 1646 ms. Trace:
I20260923 19:50:20.519825 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 857) took 1973 ms. Trace:
I20260923 19:50:20.519942 6458 rpcz_store.cc:276] 0923 19:50:18.546499 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.546558 (+ 59us) service_pool.cc:224] Handling call
0923 19:50:20.519645 (+1973087us) ts_tablet_manager.cc:1151] Deleting tablet 2c6b2e4dac9749e58d01a838c2472bbc
0923 19:50:20.519654 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.519763 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1937002}
W20260923 19:50:20.520505 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 2c6b2e4dac9749e58d01a838c2472bbc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c6b2e4dac9749e58d01a838c2472bbc already in progress: creating tablet
I20260923 19:50:20.520919 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 858) took 1965 ms. Trace:
I20260923 19:50:20.519956 6459 rpcz_store.cc:276] 0923 19:50:18.873242 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.873305 (+ 63us) service_pool.cc:224] Handling call
0923 19:50:20.519302 (+1645997us) ts_tablet_manager.cc:1151] Deleting tablet f36c34465066473f94da61da73f521ff
0923 19:50:20.519338 (+ 36us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.519472 (+ 134us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1645795}
I20260923 19:50:20.521037 6458 rpcz_store.cc:276] 0923 19:50:18.555893 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.555947 (+ 54us) service_pool.cc:224] Handling call
0923 19:50:20.520826 (+1964879us) ts_tablet_manager.cc:1151] Deleting tablet 377f4454d8c846e08d6207ceacf4797a
0923 19:50:20.520834 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.520904 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1938076}
W20260923 19:50:20.521591 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 377f4454d8c846e08d6207ceacf4797a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 377f4454d8c846e08d6207ceacf4797a already in progress: creating tablet
W20260923 19:50:20.521951 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet f36c34465066473f94da61da73f521ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f36c34465066473f94da61da73f521ff already in progress: creating tablet
I20260923 19:50:20.522271 6458 tablet_replica.cc:333] T a53f2eb08330411ebe417d4e1e414db6 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:20.522419 6461 ts_tablet_manager.cc:1929] T 6d29923f139445cc86379c80ac15df5d P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:20.522498 6458 raft_consensus.cc:2243] T a53f2eb08330411ebe417d4e1e414db6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:20.522609 6461 log.cc:1199] T 6d29923f139445cc86379c80ac15df5d P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/6d29923f139445cc86379c80ac15df5d
I20260923 19:50:20.522699 6458 raft_consensus.cc:2272] T a53f2eb08330411ebe417d4e1e414db6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:20.522982 6461 ts_tablet_manager.cc:1950] T 6d29923f139445cc86379c80ac15df5d P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:20.523017 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 876) took 1604 ms. Trace:
I20260923 19:50:20.523288 6458 ts_tablet_manager.cc:1916] T a53f2eb08330411ebe417d4e1e414db6 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:20.523852 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 901) took 1470 ms. Trace:
I20260923 19:50:20.523998 6461 rpcz_store.cc:276] 0923 19:50:19.053041 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.053107 (+ 66us) service_pool.cc:224] Handling call
0923 19:50:20.210067 (+1156960us) ts_tablet_manager.cc:1151] Deleting tablet 6d29923f139445cc86379c80ac15df5d
0923 19:50:20.210077 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.214908 (+ 4831us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.522361 (+307453us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.523833 (+ 1472us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1156706}
I20260923 19:50:20.524397 7256 raft_consensus.cc:493] T e4f00490b0364f0e9f1b9569b870808e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:20.524598 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 902) took 1412 ms. Trace:
I20260923 19:50:20.524519 7256 raft_consensus.cc:515] T e4f00490b0364f0e9f1b9569b870808e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.524729 6461 rpcz_store.cc:276] 0923 19:50:19.111859 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.111906 (+ 47us) service_pool.cc:224] Handling call
0923 19:50:20.524430 (+1412524us) ts_tablet_manager.cc:1151] Deleting tablet 80386e27facd494bb11a46ddf83e7b23
0923 19:50:20.524439 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.524581 (+ 142us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1412257}
I20260923 19:50:20.525107 7256 leader_election.cc:290] T e4f00490b0364f0e9f1b9569b870808e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:20.525632 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f00490b0364f0e9f1b9569b870808e" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:20.525807 6197 raft_consensus.cc:2468] T e4f00490b0364f0e9f1b9569b870808e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:20.526845 6280 leader_election.cc:304] T e4f00490b0364f0e9f1b9569b870808e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:20.527063 7490 raft_consensus.cc:493] T c031d99a6f9844c29664236662e8d5f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:20.527115 7256 raft_consensus.cc:2804] T e4f00490b0364f0e9f1b9569b870808e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:20.527182 7490 raft_consensus.cc:515] T c031d99a6f9844c29664236662e8d5f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.523471 6459 rpcz_store.cc:276] 0923 19:50:18.918775 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.918933 (+ 158us) service_pool.cc:224] Handling call
0923 19:50:20.522239 (+1603306us) ts_tablet_manager.cc:1151] Deleting tablet 6393303f6d664fe3bbc9c9052cd0b717
0923 19:50:20.522252 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.522841 (+ 589us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1563493}
I20260923 19:50:20.527747 7490 leader_election.cc:290] T c031d99a6f9844c29664236662e8d5f8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:20.527189 7256 raft_consensus.cc:493] T e4f00490b0364f0e9f1b9569b870808e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:20.528083 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c031d99a6f9844c29664236662e8d5f8" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:20.528235 7256 raft_consensus.cc:3060] T e4f00490b0364f0e9f1b9569b870808e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
W20260923 19:50:20.528647 6280 leader_election.cc:343] T c031d99a6f9844c29664236662e8d5f8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:20.529295 5799 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 3d224df1bca44e30aff2b307281e399f
I20260923 19:50:20.529536 6454 tablet_bootstrap.cc:654] T 2948d729e1ec4dfca70789bcad513e52 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:20.530187 5801 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 13b21aadd7464b1aa2afe7a1ebc9e77f
I20260923 19:50:20.530071 6459 tablet_replica.cc:333] T 5427b0f0218d4131b68a39e8e3bf02e7 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:20.531167 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_9a23ee2e94444e61b9742cf0457c7384"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:20.531931 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a23ee2e94444e61b9742cf0457c7384 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:20.531461 6459 raft_consensus.cc:2243] T 5427b0f0218d4131b68a39e8e3bf02e7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:20.532138 7256 raft_consensus.cc:515] T e4f00490b0364f0e9f1b9569b870808e P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.532866 6459 raft_consensus.cc:2272] T 5427b0f0218d4131b68a39e8e3bf02e7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:20.534194 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 6393303f6d664fe3bbc9c9052cd0b717 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6393303f6d664fe3bbc9c9052cd0b717 already in progress: creating tablet
I20260923 19:50:20.534281 7256 leader_election.cc:290] T e4f00490b0364f0e9f1b9569b870808e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:20.534677 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f00490b0364f0e9f1b9569b870808e" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:20.534816 6197 raft_consensus.cc:3060] T e4f00490b0364f0e9f1b9569b870808e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:20.535497 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet 13b21aadd7464b1aa2afe7a1ebc9e77f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:20 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:20.535930 7256 raft_consensus.cc:493] T 1b1d9413e1e24547b491a160d851377b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:20.536067 7256 raft_consensus.cc:515] T 1b1d9413e1e24547b491a160d851377b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.536218 5799 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_aace4bdffc84478db1c7cca8eb7be0be" } new_table_name: "default.Table_23fcf2ef4c694abc977587761dc39258" modify_external_catalogs: true
I20260923 19:50:20.536926 7256 leader_election.cc:290] T 1b1d9413e1e24547b491a160d851377b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:20.537735 6197 raft_consensus.cc:2468] T e4f00490b0364f0e9f1b9569b870808e P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:20.538432 6458 ts_tablet_manager.cc:1929] T a53f2eb08330411ebe417d4e1e414db6 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:20.538437 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b1d9413e1e24547b491a160d851377b" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:20.538525 6458 log.cc:1199] T a53f2eb08330411ebe417d4e1e414db6 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/a53f2eb08330411ebe417d4e1e414db6
I20260923 19:50:20.538846 6458 ts_tablet_manager.cc:1950] T a53f2eb08330411ebe417d4e1e414db6 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
W20260923 19:50:20.538941 6280 leader_election.cc:343] T 1b1d9413e1e24547b491a160d851377b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:20.539486 6280 leader_election.cc:304] T e4f00490b0364f0e9f1b9569b870808e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:20.539512 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet 13b21aadd7464b1aa2afe7a1ebc9e77f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:20 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:20.539582 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 859) took 1970 ms. Trace:
I20260923 19:50:20.539705 7256 raft_consensus.cc:2804] T e4f00490b0364f0e9f1b9569b870808e P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:20.539822 7256 raft_consensus.cc:697] T e4f00490b0364f0e9f1b9569b870808e P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:20.539877 6310 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d224df1bca44e30aff2b307281e399f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:20 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:20.540053 7256 consensus_queue.cc:237] T e4f00490b0364f0e9f1b9569b870808e P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.540544 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d224df1bca44e30aff2b307281e399f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:20 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:20.541456 6249 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
I20260923 19:50:20.543864 6459 ts_tablet_manager.cc:1916] T 5427b0f0218d4131b68a39e8e3bf02e7 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:20.545167 6280 consensus_peers.cc:597] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:20.545531 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 501921b0f23b4713b0c53e8844c9f423 (DEFAULT_TABLE table=default.Table_c1c26750ec3d49c3b1144b79fa4089cb [id=eeba1521989c4c7ea8ac68fd69ae4baa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.546016 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 501921b0f23b4713b0c53e8844c9f423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.550146 6164 tablet_service.cc:1511] Processing CreateTablet for tablet 2dcf8b340f74457ba55deaca2f38ea7c (DEFAULT_TABLE table=default.Table_587300eb5ddd4e2f9227cd18c6691ff7 [id=3ad7b7ba4169442fb8f5d0f8b89cb771]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.550529 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dcf8b340f74457ba55deaca2f38ea7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.566316 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 2dcf8b340f74457ba55deaca2f38ea7c (DEFAULT_TABLE table=default.Table_587300eb5ddd4e2f9227cd18c6691ff7 [id=3ad7b7ba4169442fb8f5d0f8b89cb771]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.566674 6454 tablet_bootstrap.cc:492] T 2948d729e1ec4dfca70789bcad513e52 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:20.566867 6454 ts_tablet_manager.cc:1403] T 2948d729e1ec4dfca70789bcad513e52 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.225s user 0.006s sys 0.016s
I20260923 19:50:20.539644 6458 rpcz_store.cc:276] 0923 19:50:18.569137 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.569190 (+ 53us) service_pool.cc:224] Handling call
0923 19:50:20.522229 (+1953039us) ts_tablet_manager.cc:1151] Deleting tablet a53f2eb08330411ebe417d4e1e414db6
0923 19:50:20.522240 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.526566 (+ 4326us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.538381 (+ 11815us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.539565 (+ 1184us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1939414}
I20260923 19:50:20.567853 6454 raft_consensus.cc:359] T 2948d729e1ec4dfca70789bcad513e52 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.568209 6454 raft_consensus.cc:385] T 2948d729e1ec4dfca70789bcad513e52 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:20.568322 6454 raft_consensus.cc:740] T 2948d729e1ec4dfca70789bcad513e52 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:20.568595 6454 consensus_queue.cc:260] T 2948d729e1ec4dfca70789bcad513e52 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.572625 6454 ts_tablet_manager.cc:1434] T 2948d729e1ec4dfca70789bcad513e52 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260923 19:50:20.572746 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet a53f2eb08330411ebe417d4e1e414db6 (table default.Table_1d212a8856d940d8898230b16d0e0aa2 [id=24a351e6e5744e70abf6776a741dbbe3]) successfully deleted
I20260923 19:50:20.572984 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dcf8b340f74457ba55deaca2f38ea7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.573066 6454 tablet_bootstrap.cc:492] T 85b7dcf131c54187a6e61f8503c797f8 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:20.573681 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 862) took 1939 ms. Trace:
I20260923 19:50:20.574370 6458 rpcz_store.cc:276] 0923 19:50:18.634173 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.634224 (+ 51us) service_pool.cc:224] Handling call
0923 19:50:20.573543 (+1939319us) ts_tablet_manager.cc:1151] Deleting tablet 6c33a99f88a9401fa296c4fefb8bcfc1
0923 19:50:20.573557 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.573664 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1939164}
W20260923 19:50:20.581272 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 6c33a99f88a9401fa296c4fefb8bcfc1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c33a99f88a9401fa296c4fefb8bcfc1 already in progress: creating tablet
I20260923 19:50:20.581744 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 870) took 1750 ms. Trace:
I20260923 19:50:20.581883 6458 rpcz_store.cc:276] 0923 19:50:18.831022 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.831643 (+ 621us) service_pool.cc:224] Handling call
0923 19:50:20.581627 (+1749984us) ts_tablet_manager.cc:1151] Deleting tablet 3dead6c00e2c4516aa01547496a207fe
0923 19:50:20.581636 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.581727 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1749759}
W20260923 19:50:20.582432 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 3dead6c00e2c4516aa01547496a207fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3dead6c00e2c4516aa01547496a207fe already in progress: creating tablet
I20260923 19:50:20.582753 6458 tablet_replica.cc:333] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:20.582996 6458 raft_consensus.cc:2243] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:20.584856 6454 tablet_bootstrap.cc:654] T 85b7dcf131c54187a6e61f8503c797f8 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:20.585311 6166 tablet_service.cc:1511] Processing CreateTablet for tablet 3eb8d0a6a2a14388a60b6901106b2856 (DEFAULT_TABLE table=default.Table_78600d43ea2249ca9fbfd813317ee3d5 [id=b4507a98f9334467877d58449f79170a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.585666 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eb8d0a6a2a14388a60b6901106b2856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.585803 6458 raft_consensus.cc:2272] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:20.586333 6323 tablet_service.cc:1511] Processing CreateTablet for tablet 3eb8d0a6a2a14388a60b6901106b2856 (DEFAULT_TABLE table=default.Table_78600d43ea2249ca9fbfd813317ee3d5 [id=b4507a98f9334467877d58449f79170a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.586623 6458 ts_tablet_manager.cc:1916] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:20.587352 6169 tablet_service.cc:1511] Processing CreateTablet for tablet d1a0acab800f4fb5a26c14f7dbe294c2 (DEFAULT_TABLE table=default.Table_3de87a9c328940219e659fef1ebb0db8 [id=41cdd60d8c6f4849b474718fc58c5ca3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.587651 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a0acab800f4fb5a26c14f7dbe294c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.586688 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eb8d0a6a2a14388a60b6901106b2856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.595371 6324 tablet_service.cc:1511] Processing CreateTablet for tablet 501921b0f23b4713b0c53e8844c9f423 (DEFAULT_TABLE table=default.Table_c1c26750ec3d49c3b1144b79fa4089cb [id=eeba1521989c4c7ea8ac68fd69ae4baa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.595805 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 501921b0f23b4713b0c53e8844c9f423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.559267 6457 tablet_bootstrap.cc:492] T 2e1c19a751904a6295897376e9c5ee56 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:20.598135 6457 ts_tablet_manager.cc:1403] T 2e1c19a751904a6295897376e9c5ee56 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.120s user 0.002s sys 0.002s
I20260923 19:50:20.598949 6457 raft_consensus.cc:359] T 2e1c19a751904a6295897376e9c5ee56 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:20.599185 6457 raft_consensus.cc:385] T 2e1c19a751904a6295897376e9c5ee56 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:20.599275 6457 raft_consensus.cc:740] T 2e1c19a751904a6295897376e9c5ee56 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:20.600078 6457 consensus_queue.cc:260] T 2e1c19a751904a6295897376e9c5ee56 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:20.600664 6457 ts_tablet_manager.cc:1434] T 2e1c19a751904a6295897376e9c5ee56 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:20.601017 6457 tablet_bootstrap.cc:492] T 2852e91ccd0c44b3b16f8189e57575d7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:20.602442 6457 tablet_bootstrap.cc:654] T 2852e91ccd0c44b3b16f8189e57575d7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:20.603520 6461 tablet_replica.cc:333] T 12f4abb573bd4be6961b55c27c684d06 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:20.603744 6461 raft_consensus.cc:2243] T 12f4abb573bd4be6961b55c27c684d06 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:20.603941 6461 raft_consensus.cc:2272] T 12f4abb573bd4be6961b55c27c684d06 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:20.604770 6461 ts_tablet_manager.cc:1916] T 12f4abb573bd4be6961b55c27c684d06 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:20.607167 6458 ts_tablet_manager.cc:1929] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:20.607343 6458 log.cc:1199] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/9be4c46ee8eb4dbaad01d492b701a9e0
I20260923 19:50:20.607713 6458 ts_tablet_manager.cc:1950] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:20.608184 6310 tablet_service.cc:1511] Processing CreateTablet for tablet d1a0acab800f4fb5a26c14f7dbe294c2 (DEFAULT_TABLE table=default.Table_3de87a9c328940219e659fef1ebb0db8 [id=41cdd60d8c6f4849b474718fc58c5ca3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.607962 6459 ts_tablet_manager.cc:1929] T 5427b0f0218d4131b68a39e8e3bf02e7 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:20.608634 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a0acab800f4fb5a26c14f7dbe294c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.608914 6459 log.cc:1199] T 5427b0f0218d4131b68a39e8e3bf02e7 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/5427b0f0218d4131b68a39e8e3bf02e7
I20260923 19:50:20.609808 6323 tablet_service.cc:1511] Processing CreateTablet for tablet 60fec1c062234257b08429e50c965ebc (DEFAULT_TABLE table=default.Table_b065e06a599f4668a7ac9c2e0bd7d989 [id=5d5f431801bb41ee9b9b4373e04d0ed9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.610170 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60fec1c062234257b08429e50c965ebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.610441 6456 tablet_bootstrap.cc:492] T 6ac04be575704a69994f98e00411a254 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:20.610626 6456 ts_tablet_manager.cc:1403] T 6ac04be575704a69994f98e00411a254 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.154s user 0.017s sys 0.009s
I20260923 19:50:20.611166 6459 ts_tablet_manager.cc:1950] T 5427b0f0218d4131b68a39e8e3bf02e7 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:20.611421 6456 raft_consensus.cc:359] T 6ac04be575704a69994f98e00411a254 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.611601 6456 raft_consensus.cc:385] T 6ac04be575704a69994f98e00411a254 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:20.611654 6456 raft_consensus.cc:740] T 6ac04be575704a69994f98e00411a254 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:20.611883 6456 consensus_queue.cc:260] T 6ac04be575704a69994f98e00411a254 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.612421 6456 ts_tablet_manager.cc:1434] T 6ac04be575704a69994f98e00411a254 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:20.613209 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 875) took 1694 ms. Trace:
I20260923 19:50:20.613751 6459 rpcz_store.cc:276] 0923 19:50:18.918628 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.919785 (+ 1157us) service_pool.cc:224] Handling call
0923 19:50:20.529659 (+1609874us) ts_tablet_manager.cc:1151] Deleting tablet 5427b0f0218d4131b68a39e8e3bf02e7
0923 19:50:20.529670 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.578134 (+ 48464us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.607567 (+ 29433us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.613187 (+ 5620us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1568878}
I20260923 19:50:20.617699 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 5427b0f0218d4131b68a39e8e3bf02e7 (table default.Table_aa2654e8c2db467ab317ae37cf1985aa [id=325a9dcdfe3c44fca0e5b9d0bc0cd1f0]) successfully deleted
I20260923 19:50:20.619234 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 874) took 1731 ms. Trace:
I20260923 19:50:20.619714 6459 rpcz_store.cc:276] 0923 19:50:18.887156 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.906212 (+ 19056us) service_pool.cc:224] Handling call
0923 19:50:20.618453 (+1712241us) ts_tablet_manager.cc:1151] Deleting tablet 77aa9699460440e7906957855b97448e
0923 19:50:20.618466 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.619051 (+ 585us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1657567}
I20260923 19:50:20.620808 6456 tablet_bootstrap.cc:492] T 6238d16b1be74dd88fd2e089fbd85d33 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
W20260923 19:50:20.345911 5995 leader_election.cc:343] T ea2ef507c6e24d369427048171dfec06 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:20.622007 5996 leader_election.cc:343] T ea2ef507c6e24d369427048171dfec06 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:20.622002 5995 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 276082us
I20260923 19:50:20.622337 5996 leader_election.cc:304] T ea2ef507c6e24d369427048171dfec06 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
W20260923 19:50:20.622670 5996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.195:32855, user_credentials={real_user=slave}} blocked reactor thread for 275734us
I20260923 19:50:20.622767 7629 raft_consensus.cc:2749] T ea2ef507c6e24d369427048171dfec06 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:20.623303 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 6d29923f139445cc86379c80ac15df5d (table default.Table_0bf993fb53a243408934c3ce7812f300 [id=1dc5c4b9cfe242b099053cbb53aac5ce]) successfully deleted
I20260923 19:50:20.623705 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 871) took 1779 ms. Trace:
I20260923 19:50:20.623847 6458 rpcz_store.cc:276] 0923 19:50:18.843761 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.843811 (+ 50us) service_pool.cc:224] Handling call
0923 19:50:20.582710 (+1738899us) ts_tablet_manager.cc:1151] Deleting tablet 9be4c46ee8eb4dbaad01d492b701a9e0
0923 19:50:20.582720 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.593781 (+ 11061us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.607108 (+ 13327us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.623685 (+ 16577us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1738708}
W20260923 19:50:20.624163 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 80386e27facd494bb11a46ddf83e7b23 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 80386e27facd494bb11a46ddf83e7b23 already in progress: creating tablet
I20260923 19:50:20.624554 7629 raft_consensus.cc:493] T d3f7b33bbf3f453e8e841ee5d99c5b31 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:20.624670 7629 raft_consensus.cc:515] T d3f7b33bbf3f453e8e841ee5d99c5b31 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:20.625232 7629 leader_election.cc:290] T d3f7b33bbf3f453e8e841ee5d99c5b31 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:20.625447 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 9be4c46ee8eb4dbaad01d492b701a9e0 (table default.Table_bb91666519bc41aaaf1fc7f8e8b26691 [id=1b974d4dff8c4868947a4d7765208c97]) successfully deleted
I20260923 19:50:20.626042 7629 raft_consensus.cc:493] T c5cb76fa5e084604aa58bf888cfe4852 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:20.626147 7629 raft_consensus.cc:515] T c5cb76fa5e084604aa58bf888cfe4852 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:20.626616 7629 leader_election.cc:290] T c5cb76fa5e084604aa58bf888cfe4852 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:20.626581 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f7b33bbf3f453e8e841ee5d99c5b31" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:20.627636 5996 leader_election.cc:343] T d3f7b33bbf3f453e8e841ee5d99c5b31 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:20.627728 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5cb76fa5e084604aa58bf888cfe4852" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:20.627976 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 873) took 1748 ms. Trace:
W20260923 19:50:20.628145 5996 leader_election.cc:343] T c5cb76fa5e084604aa58bf888cfe4852 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:20.628309 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 77aa9699460440e7906957855b97448e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 77aa9699460440e7906957855b97448e already in progress: creating tablet
I20260923 19:50:20.628842 6458 rpcz_store.cc:276] 0923 19:50:18.879095 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.879204 (+ 109us) service_pool.cc:224] Handling call
0923 19:50:20.627869 (+1748665us) ts_tablet_manager.cc:1151] Deleting tablet f36c34465066473f94da61da73f521ff
0923 19:50:20.627878 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.627960 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1737654}
W20260923 19:50:20.629690 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet f36c34465066473f94da61da73f521ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f36c34465066473f94da61da73f521ff already in progress: creating tablet
I20260923 19:50:20.630266 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 874) took 1744 ms. Trace:
I20260923 19:50:20.631050 6458 rpcz_store.cc:276] 0923 19:50:18.886111 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.887854 (+ 1743us) service_pool.cc:224] Handling call
0923 19:50:20.630062 (+1742208us) ts_tablet_manager.cc:1151] Deleting tablet 77aa9699460440e7906957855b97448e
0923 19:50:20.630075 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.630243 (+ 168us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1728766}
W20260923 19:50:20.631752 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 77aa9699460440e7906957855b97448e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 77aa9699460440e7906957855b97448e already in progress: creating tablet
I20260923 19:50:20.632172 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 876) took 1712 ms. Trace:
I20260923 19:50:20.632306 6458 rpcz_store.cc:276] 0923 19:50:18.919460 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.919567 (+ 107us) service_pool.cc:224] Handling call
0923 19:50:20.632071 (+1712504us) ts_tablet_manager.cc:1151] Deleting tablet 6393303f6d664fe3bbc9c9052cd0b717
0923 19:50:20.632079 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.632155 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1712332}
I20260923 19:50:20.630980 6456 tablet_bootstrap.cc:654] T 6238d16b1be74dd88fd2e089fbd85d33 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:20.633785 5797 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f0ae26687ca54a6085e4b7cf494fc482" } new_table_name: "default.Table_c93df90095224de5a2f127b7d03ba79c" modify_external_catalogs: true
I20260923 19:50:20.634485 6027 tablet_service.cc:1558] Processing DeleteTablet for tablet 7595c09be8784a948027dd923c4b023e with delete_type TABLET_DATA_DELETED (replaced by tablet caeb98aa3fbe4216b1672e6f8867f298) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:20.635211 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 6393303f6d664fe3bbc9c9052cd0b717 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6393303f6d664fe3bbc9c9052cd0b717 already in progress: creating tablet
I20260923 19:50:20.635596 6458 tablet_replica.cc:333] T 5427b0f0218d4131b68a39e8e3bf02e7 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:20.636799 5800 master_service.cc:960] ReplaceTablet: received request to replace tablet f74e7cb3e5f54dfdb2280c795ce2ce53 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:20.637307 6458 raft_consensus.cc:2243] T 5427b0f0218d4131b68a39e8e3bf02e7 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:20.638401 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_6ce6125963624df69740ab6735995c70"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:20.639024 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6ce6125963624df69740ab6735995c70 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:20.640698 5804 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5fdf1ec98959467c8800e108f541e3d7" } new_table_name: "default.Table_01ba57f1813948ec921501f2550adc9a" modify_external_catalogs: true
I20260923 19:50:20.641251 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 877) took 1676 ms. Trace:
I20260923 19:50:20.642319 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_37285845f6354f36bb1f2c008dd28922" } new_table_name: "default.Table_9b99dd71b66245afb743da2b9d0f8825" modify_external_catalogs: true
I20260923 19:50:20.642562 6027 tablet_service.cc:1558] Processing DeleteTablet for tablet d3f7b33bbf3f453e8e841ee5d99c5b31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:20.643234 6027 tablet_service.cc:1558] Processing DeleteTablet for tablet c82bb40047b342d5b9468ecc374ef829 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:20 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:20.642045 6459 rpcz_store.cc:276] 0923 19:50:18.964525 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.967505 (+ 2980us) service_pool.cc:224] Handling call
0923 19:50:20.639826 (+1672321us) ts_tablet_manager.cc:1151] Deleting tablet 4935c06f29cf4c729946f35829dfdf92
0923 19:50:20.639843 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.640857 (+ 1014us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1671910}
I20260923 19:50:20.644066 6027 tablet_service.cc:1511] Processing CreateTablet for tablet f5f285e125dc445197a59e02e199a606 (DEFAULT_TABLE table=default.Table_3974c6faa5a94a44a6c15aae07db7da2 [id=86709da2c4584321bb1919876bdc72c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.644284 6458 raft_consensus.cc:2272] T 5427b0f0218d4131b68a39e8e3bf02e7 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:20.644361 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 4935c06f29cf4c729946f35829dfdf92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4935c06f29cf4c729946f35829dfdf92 already in progress: creating tablet
I20260923 19:50:20.644824 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f285e125dc445197a59e02e199a606. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.644893 6458 ts_tablet_manager.cc:1916] T 5427b0f0218d4131b68a39e8e3bf02e7 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:20.645776 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 4f0de9a4b9164e05874d322a0b4a8e46 (DEFAULT_TABLE table=default.Table_c9caa816995b4d02b2b42ef1f29e41e1 [id=0cfdf5f8a7d54ce69a8eca5603a93ff8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.645663 6459 tablet_replica.cc:333] T c19298691d5d4209b2d1147a1aad2f6f P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:20.646162 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f0de9a4b9164e05874d322a0b4a8e46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.647130 6459 raft_consensus.cc:2243] T c19298691d5d4209b2d1147a1aad2f6f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:20.648343 6459 raft_consensus.cc:2272] T c19298691d5d4209b2d1147a1aad2f6f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:20.650429 6024 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d224df1bca44e30aff2b307281e399f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:20 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:20.650501 6025 tablet_service.cc:1558] Processing DeleteTablet for tablet 13b21aadd7464b1aa2afe7a1ebc9e77f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:20 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:20.650910 6025 tablet_service.cc:1511] Processing CreateTablet for tablet 2dcf8b340f74457ba55deaca2f38ea7c (DEFAULT_TABLE table=default.Table_587300eb5ddd4e2f9227cd18c6691ff7 [id=3ad7b7ba4169442fb8f5d0f8b89cb771]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.650910 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 60fec1c062234257b08429e50c965ebc (DEFAULT_TABLE table=default.Table_b065e06a599f4668a7ac9c2e0bd7d989 [id=5d5f431801bb41ee9b9b4373e04d0ed9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.651253 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dcf8b340f74457ba55deaca2f38ea7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.651253 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60fec1c062234257b08429e50c965ebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.652864 6459 ts_tablet_manager.cc:1916] T c19298691d5d4209b2d1147a1aad2f6f P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:20.657557 6458 ts_tablet_manager.cc:1929] T 5427b0f0218d4131b68a39e8e3bf02e7 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:20.658903 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 83fdbb8a5352447b8ad6570e44674e97
I20260923 19:50:20.662835 6454 tablet_bootstrap.cc:492] T 85b7dcf131c54187a6e61f8503c797f8 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:20.663050 6169 tablet_service.cc:1558] Processing DeleteTablet for tablet 83fdbb8a5352447b8ad6570e44674e97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:20 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:20.663688 6024 tablet_service.cc:1511] Processing CreateTablet for tablet 3eb8d0a6a2a14388a60b6901106b2856 (DEFAULT_TABLE table=default.Table_78600d43ea2249ca9fbfd813317ee3d5 [id=b4507a98f9334467877d58449f79170a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.663879 6021 tablet_service.cc:1558] Processing DeleteTablet for tablet 83fdbb8a5352447b8ad6570e44674e97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:20 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:20.663827 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 60fec1c062234257b08429e50c965ebc (DEFAULT_TABLE table=default.Table_b065e06a599f4668a7ac9c2e0bd7d989 [id=5d5f431801bb41ee9b9b4373e04d0ed9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.663070 6454 ts_tablet_manager.cc:1403] T 85b7dcf131c54187a6e61f8503c797f8 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.090s user 0.006s sys 0.000s
I20260923 19:50:20.664136 6024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eb8d0a6a2a14388a60b6901106b2856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.664991 6034 tablet_service.cc:1511] Processing CreateTablet for tablet d1a0acab800f4fb5a26c14f7dbe294c2 (DEFAULT_TABLE table=default.Table_3de87a9c328940219e659fef1ebb0db8 [id=41cdd60d8c6f4849b474718fc58c5ca3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.664160 6025 tablet_service.cc:1511] Processing CreateTablet for tablet 501921b0f23b4713b0c53e8844c9f423 (DEFAULT_TABLE table=default.Table_c1c26750ec3d49c3b1144b79fa4089cb [id=eeba1521989c4c7ea8ac68fd69ae4baa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.660979 6306 tablet_service.cc:1558] Processing DeleteTablet for tablet 83fdbb8a5352447b8ad6570e44674e97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:20 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:20.665383 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a0acab800f4fb5a26c14f7dbe294c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.665400 6458 log.cc:1199] T 5427b0f0218d4131b68a39e8e3bf02e7 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/5427b0f0218d4131b68a39e8e3bf02e7
I20260923 19:50:20.665833 6458 ts_tablet_manager.cc:1950] T 5427b0f0218d4131b68a39e8e3bf02e7 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:20.665982 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 501921b0f23b4713b0c53e8844c9f423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.667037 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_90b8b5eeaa954dd58bdb2813185930e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:20.667586 6279 leader_election.cc:343] T a01a86b6fd4b44d3808c2040525d7b61 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: a01a86b6fd4b44d3808c2040525d7b61
W20260923 19:50:20.667683 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_90b8b5eeaa954dd58bdb2813185930e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:20.667728 6279 leader_election.cc:304] T a01a86b6fd4b44d3808c2040525d7b61 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:20.668078 7256 raft_consensus.cc:2749] T a01a86b6fd4b44d3808c2040525d7b61 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:20.668501 6279 leader_election.cc:343] T 6d29923f139445cc86379c80ac15df5d P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 6d29923f139445cc86379c80ac15df5d
I20260923 19:50:20.668586 6279 leader_election.cc:304] T 6d29923f139445cc86379c80ac15df5d P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:20.668881 7256 raft_consensus.cc:2749] T 6d29923f139445cc86379c80ac15df5d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:20.669731 6456 tablet_bootstrap.cc:492] T 6238d16b1be74dd88fd2e089fbd85d33 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:20.669942 6456 ts_tablet_manager.cc:1403] T 6238d16b1be74dd88fd2e089fbd85d33 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.049s user 0.002s sys 0.007s
I20260923 19:50:20.671352 6461 ts_tablet_manager.cc:1929] T 12f4abb573bd4be6961b55c27c684d06 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260923 19:50:20.673295 6279 leader_election.cc:343] T e4f00490b0364f0e9f1b9569b870808e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: e4f00490b0364f0e9f1b9569b870808e
I20260923 19:50:20.666803 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f7b33bbf3f453e8e841ee5d99c5b31" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:20.669901 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5cb76fa5e084604aa58bf888cfe4852" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:20.665114 6454 raft_consensus.cc:359] T 85b7dcf131c54187a6e61f8503c797f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:20.674986 6279 leader_election.cc:343] T c031d99a6f9844c29664236662e8d5f8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: c031d99a6f9844c29664236662e8d5f8
I20260923 19:50:20.675088 6279 leader_election.cc:304] T c031d99a6f9844c29664236662e8d5f8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:20.675400 7256 raft_consensus.cc:2749] T c031d99a6f9844c29664236662e8d5f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:20.676575 6279 leader_election.cc:343] T e4f00490b0364f0e9f1b9569b870808e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: e4f00490b0364f0e9f1b9569b870808e
I20260923 19:50:20.675732 6454 raft_consensus.cc:385] T 85b7dcf131c54187a6e61f8503c797f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260923 19:50:20.677440 6279 leader_election.cc:343] T 1b1d9413e1e24547b491a160d851377b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 1b1d9413e1e24547b491a160d851377b
I20260923 19:50:20.677531 6279 leader_election.cc:304] T 1b1d9413e1e24547b491a160d851377b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:20.677881 7256 raft_consensus.cc:2749] T 1b1d9413e1e24547b491a160d851377b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:20.678194 6454 raft_consensus.cc:740] T 85b7dcf131c54187a6e61f8503c797f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:20.678947 6454 consensus_queue.cc:260] T 85b7dcf131c54187a6e61f8503c797f8 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.684669 6306 tablet_service.cc:1511] Processing CreateTablet for tablet 3c8b3d6cf0f44b23bfe0444be513fb3d (DEFAULT_TABLE table=default.Table_e81b9a7863b44739aebfd551dc96b551 [id=3d40d6008af249e2b84590ed0f028e0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.685060 6306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c8b3d6cf0f44b23bfe0444be513fb3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.685532 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 875) took 1766 ms. Trace:
I20260923 19:50:20.685604 6458 rpcz_store.cc:276] 0923 19:50:18.919128 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.919829 (+ 701us) service_pool.cc:224] Handling call
0923 19:50:20.635539 (+1715710us) ts_tablet_manager.cc:1151] Deleting tablet 5427b0f0218d4131b68a39e8e3bf02e7
0923 19:50:20.635552 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.654216 (+ 18664us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.657506 (+ 3290us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.685513 (+ 28007us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1715525}
I20260923 19:50:20.685896 6458 tablet_replica.cc:333] T 2948d729e1ec4dfca70789bcad513e52 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:20.686074 6458 raft_consensus.cc:2243] T 2948d729e1ec4dfca70789bcad513e52 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:20.686209 6458 raft_consensus.cc:2272] T 2948d729e1ec4dfca70789bcad513e52 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:20.686661 6458 ts_tablet_manager.cc:1916] T 2948d729e1ec4dfca70789bcad513e52 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:20.690626 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 5427b0f0218d4131b68a39e8e3bf02e7 (table default.Table_aa2654e8c2db467ab317ae37cf1985aa [id=325a9dcdfe3c44fca0e5b9d0bc0cd1f0]) successfully deleted
I20260923 19:50:20.696892 6458 ts_tablet_manager.cc:1929] T 2948d729e1ec4dfca70789bcad513e52 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:20.697108 6458 log.cc:1199] T 2948d729e1ec4dfca70789bcad513e52 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/2948d729e1ec4dfca70789bcad513e52
I20260923 19:50:20.697477 6458 ts_tablet_manager.cc:1950] T 2948d729e1ec4dfca70789bcad513e52 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:20.683172 6169 tablet_service.cc:1511] Processing CreateTablet for tablet 3c8b3d6cf0f44b23bfe0444be513fb3d (DEFAULT_TABLE table=default.Table_e81b9a7863b44739aebfd551dc96b551 [id=3d40d6008af249e2b84590ed0f028e0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.699815 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c8b3d6cf0f44b23bfe0444be513fb3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.700342 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 877) took 1744 ms. Trace:
I20260923 19:50:20.700480 6458 rpcz_store.cc:276] 0923 19:50:18.955491 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.955927 (+ 436us) service_pool.cc:224] Handling call
0923 19:50:20.685836 (+1729909us) ts_tablet_manager.cc:1151] Deleting tablet 2948d729e1ec4dfca70789bcad513e52
0923 19:50:20.685845 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.692645 (+ 6800us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.696841 (+ 4196us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.700322 (+ 3481us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1729666}
I20260923 19:50:20.701094 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 2948d729e1ec4dfca70789bcad513e52 (table default.Table_0fabac277720489788ff4ee29635ba66 [id=ff040ccffd9c4e24be8e0eaafa134785]) successfully deleted
I20260923 19:50:20.701619 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 878) took 1737 ms. Trace:
I20260923 19:50:20.701758 6458 rpcz_store.cc:276] 0923 19:50:18.964289 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.964428 (+ 139us) service_pool.cc:224] Handling call
0923 19:50:20.701487 (+1737059us) ts_tablet_manager.cc:1151] Deleting tablet 4935c06f29cf4c729946f35829dfdf92
0923 19:50:20.701498 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.701600 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1736835}
W20260923 19:50:20.702373 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 4935c06f29cf4c729946f35829dfdf92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4935c06f29cf4c729946f35829dfdf92 already in progress: creating tablet
I20260923 19:50:20.702750 6458 tablet_replica.cc:333] T 6d29923f139445cc86379c80ac15df5d P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:20.703150 6458 raft_consensus.cc:2243] T 6d29923f139445cc86379c80ac15df5d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:20.703343 6458 raft_consensus.cc:2272] T 6d29923f139445cc86379c80ac15df5d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:20.702855 6456 raft_consensus.cc:359] T 6238d16b1be74dd88fd2e089fbd85d33 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:20.703606 6456 raft_consensus.cc:385] T 6238d16b1be74dd88fd2e089fbd85d33 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:20.703699 6456 raft_consensus.cc:740] T 6238d16b1be74dd88fd2e089fbd85d33 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:20.703994 6456 consensus_queue.cc:260] T 6238d16b1be74dd88fd2e089fbd85d33 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:20.707226 6456 ts_tablet_manager.cc:1434] T 6238d16b1be74dd88fd2e089fbd85d33 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260923 19:50:20.690173 6021 tablet_service.cc:1511] Processing CreateTablet for tablet 3c8b3d6cf0f44b23bfe0444be513fb3d (DEFAULT_TABLE table=default.Table_e81b9a7863b44739aebfd551dc96b551 [id=3d40d6008af249e2b84590ed0f028e0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.693971 6026 tablet_service.cc:1511] Processing CreateTablet for tablet b297338b1d5a4e5797d364b891081548 (DEFAULT_TABLE table=default.Table_1b26a697bf2a472995a21b28dc49a95f [id=8c8c99c342564d41b87f0f19a7d17adf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.708770 6059 raft_consensus.cc:1275] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Refusing update from remote peer 2bf41435f70447f19992d368ca6b46bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:50:20.694221 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60fec1c062234257b08429e50c965ebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.708425 6461 log.cc:1199] T 12f4abb573bd4be6961b55c27c684d06 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/12f4abb573bd4be6961b55c27c684d06
W20260923 19:50:20.710243 5995 leader_election.cc:343] T c5cb76fa5e084604aa58bf888cfe4852 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:20.710951 5995 leader_election.cc:304] T c5cb76fa5e084604aa58bf888cfe4852 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:20.704754 6458 ts_tablet_manager.cc:1916] T 6d29923f139445cc86379c80ac15df5d P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:20.712194 6454 ts_tablet_manager.cc:1434] T 85b7dcf131c54187a6e61f8503c797f8 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.048s user 0.002s sys 0.000s
I20260923 19:50:20.712958 7629 raft_consensus.cc:2749] T c5cb76fa5e084604aa58bf888cfe4852 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:20.713451 6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c8b3d6cf0f44b23bfe0444be513fb3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.713572 6461 ts_tablet_manager.cc:1950] T 12f4abb573bd4be6961b55c27c684d06 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:20.708827 6456 tablet_bootstrap.cc:492] T 3d74560614b744188e759b981ad89a7d P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:20.685367 6166 tablet_service.cc:1511] Processing CreateTablet for tablet b297338b1d5a4e5797d364b891081548 (DEFAULT_TABLE table=default.Table_1b26a697bf2a472995a21b28dc49a95f [id=8c8c99c342564d41b87f0f19a7d17adf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.719091 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b297338b1d5a4e5797d364b891081548. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.722434 6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b297338b1d5a4e5797d364b891081548. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.723166 6456 tablet_bootstrap.cc:654] T 3d74560614b744188e759b981ad89a7d P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:20.724972 6458 ts_tablet_manager.cc:1929] T 6d29923f139445cc86379c80ac15df5d P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:20.725950 6458 log.cc:1199] T 6d29923f139445cc86379c80ac15df5d P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/6d29923f139445cc86379c80ac15df5d
I20260923 19:50:20.726261 6457 tablet_bootstrap.cc:492] T 2852e91ccd0c44b3b16f8189e57575d7 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:20.726413 6458 ts_tablet_manager.cc:1950] T 6d29923f139445cc86379c80ac15df5d P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:20.726537 6457 ts_tablet_manager.cc:1403] T 2852e91ccd0c44b3b16f8189e57575d7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.126s user 0.003s sys 0.006s
I20260923 19:50:20.727459 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 879) took 1675 ms. Trace:
I20260923 19:50:20.727640 6457 raft_consensus.cc:359] T 2852e91ccd0c44b3b16f8189e57575d7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:20.727972 6457 raft_consensus.cc:385] T 2852e91ccd0c44b3b16f8189e57575d7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:20.728119 6457 raft_consensus.cc:740] T 2852e91ccd0c44b3b16f8189e57575d7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:20.728355 6458 rpcz_store.cc:276] 0923 19:50:19.052121 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.056753 (+ 4632us) service_pool.cc:224] Handling call
0923 19:50:20.702705 (+1645952us) ts_tablet_manager.cc:1151] Deleting tablet 6d29923f139445cc86379c80ac15df5d
0923 19:50:20.702714 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.715553 (+ 12839us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.724924 (+ 9371us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.727439 (+ 2515us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1645714}
I20260923 19:50:20.728471 6457 consensus_queue.cc:260] T 2852e91ccd0c44b3b16f8189e57575d7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:20.729130 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 6d29923f139445cc86379c80ac15df5d (table default.Table_0bf993fb53a243408934c3ce7812f300 [id=1dc5c4b9cfe242b099053cbb53aac5ce]) successfully deleted
I20260923 19:50:20.729534 6458 tablet_replica.cc:333] T b18548ba557f448880c5e617fc03cbe0 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:20.729773 6457 ts_tablet_manager.cc:1434] T 2852e91ccd0c44b3b16f8189e57575d7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:50:20.729960 6458 raft_consensus.cc:2243] T b18548ba557f448880c5e617fc03cbe0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:20.730372 6458 raft_consensus.cc:2272] T b18548ba557f448880c5e617fc03cbe0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:20.731081 6458 ts_tablet_manager.cc:1916] T b18548ba557f448880c5e617fc03cbe0 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:20.731302 6137 consensus_peers.cc:597] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c504ec668a33451fb1249f697bb5e2bb. This is attempt 1: this message will repeat every 5th retry.
W20260923 19:50:20.718356 5995 leader_election.cc:343] T d3f7b33bbf3f453e8e841ee5d99c5b31 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:20.734094 5995 leader_election.cc:304] T d3f7b33bbf3f453e8e841ee5d99c5b31 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:20.734390 7697 raft_consensus.cc:2749] T d3f7b33bbf3f453e8e841ee5d99c5b31 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:20.735342 7256 consensus_queue.cc:1048] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:20.735870 5801 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 35f46a1be80c4194b592c5d00fe1f342 (table default.Table_f6755f452e8d41c4b9d64c3ee2735188 [id=d6a2d0fc236a4056b224d01249f045b0]). Expected version 1 got 0
I20260923 19:50:20.745051 6306 tablet_service.cc:1511] Processing CreateTablet for tablet b297338b1d5a4e5797d364b891081548 (DEFAULT_TABLE table=default.Table_1b26a697bf2a472995a21b28dc49a95f [id=8c8c99c342564d41b87f0f19a7d17adf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.745182 6164 tablet_service.cc:1511] Processing CreateTablet for tablet 605093b0f8034a638b3df925ea31de34 (DEFAULT_TABLE table=default.Table_8b491f6b8220479ba54f424bc16d9251 [id=7a769e7c536f4b34b59ce5149f3e0646]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.745682 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 605093b0f8034a638b3df925ea31de34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.745698 6306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b297338b1d5a4e5797d364b891081548. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.746183 6459 ts_tablet_manager.cc:1929] T c19298691d5d4209b2d1147a1aad2f6f P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:20.747001 6459 log.cc:1199] T c19298691d5d4209b2d1147a1aad2f6f P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/c19298691d5d4209b2d1147a1aad2f6f
I20260923 19:50:20.718962 6454 tablet_bootstrap.cc:492] T ed9fb0cab0bd43b7a05d7376125b187e P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:20.749336 6459 ts_tablet_manager.cc:1950] T c19298691d5d4209b2d1147a1aad2f6f P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:20.751524 6454 tablet_bootstrap.cc:654] T ed9fb0cab0bd43b7a05d7376125b187e P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:20.751937 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 878) took 1768 ms. Trace:
I20260923 19:50:20.755726 6458 ts_tablet_manager.cc:1929] T b18548ba557f448880c5e617fc03cbe0 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:20.755851 6458 log.cc:1199] T b18548ba557f448880c5e617fc03cbe0 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/b18548ba557f448880c5e617fc03cbe0
I20260923 19:50:20.759300 6458 ts_tablet_manager.cc:1950] T b18548ba557f448880c5e617fc03cbe0 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:20.760134 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 881) took 1694 ms. Trace:
I20260923 19:50:20.760731 6458 rpcz_store.cc:276] 0923 19:50:19.066016 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.066165 (+ 149us) service_pool.cc:224] Handling call
0923 19:50:20.729474 (+1663309us) ts_tablet_manager.cc:1151] Deleting tablet b18548ba557f448880c5e617fc03cbe0
0923 19:50:20.729483 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.736120 (+ 6637us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.755661 (+ 19541us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.760111 (+ 4450us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19200,"tablet-delete.queue_time_us":1663014}
I20260923 19:50:20.761543 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet b18548ba557f448880c5e617fc03cbe0 (table default.Table_b7610081818744a5b76680621ab7212d [id=8b14917d9dc6415dbb75917bccf09502]) successfully deleted
I20260923 19:50:20.762032 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 882) took 1649 ms. Trace:
I20260923 19:50:20.762422 6458 rpcz_store.cc:276] 0923 19:50:19.112274 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.112741 (+ 467us) service_pool.cc:224] Handling call
0923 19:50:20.761905 (+1649164us) ts_tablet_manager.cc:1151] Deleting tablet 80386e27facd494bb11a46ddf83e7b23
0923 19:50:20.761914 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.762014 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1648917}
I20260923 19:50:20.752586 6459 rpcz_store.cc:276] 0923 19:50:18.983789 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:18.984141 (+ 352us) service_pool.cc:224] Handling call
0923 19:50:20.645181 (+1661040us) ts_tablet_manager.cc:1151] Deleting tablet c19298691d5d4209b2d1147a1aad2f6f
0923 19:50:20.645193 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.676541 (+ 31348us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.745762 (+ 69221us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.751752 (+ 5990us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1659820}
W20260923 19:50:20.763118 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 80386e27facd494bb11a46ddf83e7b23 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 80386e27facd494bb11a46ddf83e7b23 already in progress: creating tablet
I20260923 19:50:20.763460 6458 tablet_replica.cc:333] T 12f4abb573bd4be6961b55c27c684d06 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:20.763856 6458 raft_consensus.cc:2243] T 12f4abb573bd4be6961b55c27c684d06 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:20.764134 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet c19298691d5d4209b2d1147a1aad2f6f (table default.Table_22f84157ac664f81ae5266143e743737 [id=4bf839f09513412ea20c5e0afece9c37]) successfully deleted
W20260923 19:50:20.764269 5799 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 391465b6abc24ba9b23f22fe212006eb consensus state has no leader
I20260923 19:50:20.764429 6458 raft_consensus.cc:2272] T 12f4abb573bd4be6961b55c27c684d06 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:20.765358 6458 ts_tablet_manager.cc:1916] T 12f4abb573bd4be6961b55c27c684d06 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:20.765831 6459 tablet_replica.cc:333] T a11ecef9a24f4e4a812ec220b6a92cc4 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:20.767601 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_b46cc598bb3b40e3961a7f2a2967e3cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:20.767524 6457 tablet_bootstrap.cc:492] T 40adb472162042e48fdbb496b342996a P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
W20260923 19:50:20.768189 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b46cc598bb3b40e3961a7f2a2967e3cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:20.768555 6459 raft_consensus.cc:2243] T a11ecef9a24f4e4a812ec220b6a92cc4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:20.770246 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 903) took 1624 ms. Trace:
I20260923 19:50:20.770599 6461 rpcz_store.cc:276] 0923 19:50:19.146014 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.147347 (+ 1333us) service_pool.cc:224] Handling call
0923 19:50:20.603475 (+1456128us) ts_tablet_manager.cc:1151] Deleting tablet 12f4abb573bd4be6961b55c27c684d06
0923 19:50:20.603484 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.607849 (+ 4365us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.671297 (+ 63448us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.770221 (+ 98924us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1455928}
I20260923 19:50:20.770140 6459 raft_consensus.cc:2272] T a11ecef9a24f4e4a812ec220b6a92cc4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:20.771761 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 904) took 1613 ms. Trace:
I20260923 19:50:20.772137 6461 rpcz_store.cc:276] 0923 19:50:19.158726 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.158784 (+ 58us) service_pool.cc:224] Handling call
0923 19:50:20.771652 (+1612868us) ts_tablet_manager.cc:1151] Deleting tablet dadb3ab2082b4f749182b0616cf6e8f5
0923 19:50:20.771660 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.771747 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1612691}
I20260923 19:50:20.772635 6461 tablet_replica.cc:333] T 64e8951eb899461aa9c0b36e3f7555e2 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:20.774791 6461 raft_consensus.cc:2243] T 64e8951eb899461aa9c0b36e3f7555e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:20.775183 6306 tablet_service.cc:1511] Processing CreateTablet for tablet 605093b0f8034a638b3df925ea31de34 (DEFAULT_TABLE table=default.Table_8b491f6b8220479ba54f424bc16d9251 [id=7a769e7c536f4b34b59ce5149f3e0646]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.775624 6306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 605093b0f8034a638b3df925ea31de34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.780035 6323 tablet_service.cc:1511] Processing CreateTablet for tablet 93e2504c43a143ceb64c2b9693c5fed9 (DEFAULT_TABLE table=default.Table_76e9093a6c7e44928a0ae7f1565e830a [id=f5f3b6f956594966b5ae0436e70eb8f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.782299 6459 ts_tablet_manager.cc:1916] T a11ecef9a24f4e4a812ec220b6a92cc4 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:20.780607 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93e2504c43a143ceb64c2b9693c5fed9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.784543 6456 tablet_bootstrap.cc:492] T 3d74560614b744188e759b981ad89a7d P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:20.785632 6456 ts_tablet_manager.cc:1403] T 3d74560614b744188e759b981ad89a7d P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.077s user 0.020s sys 0.000s
I20260923 19:50:20.786340 6456 raft_consensus.cc:359] T 3d74560614b744188e759b981ad89a7d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.786578 6456 raft_consensus.cc:385] T 3d74560614b744188e759b981ad89a7d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:20.786681 6456 raft_consensus.cc:740] T 3d74560614b744188e759b981ad89a7d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:20.786952 6456 consensus_queue.cc:260] T 3d74560614b744188e759b981ad89a7d P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.787520 6456 ts_tablet_manager.cc:1434] T 3d74560614b744188e759b981ad89a7d P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:20.789379 6458 ts_tablet_manager.cc:1929] T 12f4abb573bd4be6961b55c27c684d06 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:20.789530 6458 log.cc:1199] T 12f4abb573bd4be6961b55c27c684d06 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/12f4abb573bd4be6961b55c27c684d06
I20260923 19:50:20.789961 6458 ts_tablet_manager.cc:1950] T 12f4abb573bd4be6961b55c27c684d06 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:20.792644 6169 tablet_service.cc:1511] Processing CreateTablet for tablet 0e68dbeb4c564892aeb9b32894ea277b (DEFAULT_TABLE table=default.Table_7a5a122018e24c8892027c5bf26c4ee8 [id=778734ca1c6b43fa9358ffbfcb8aa265]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.793134 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e68dbeb4c564892aeb9b32894ea277b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.795614 6456 tablet_bootstrap.cc:492] T 34d62ab3d4aa457f8fea283cd9248a41 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:20.797056 6456 tablet_bootstrap.cc:654] T 34d62ab3d4aa457f8fea283cd9248a41 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:20.798401 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 883) took 1651 ms. Trace:
I20260923 19:50:20.798568 6458 rpcz_store.cc:276] 0923 19:50:19.146630 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.147239 (+ 609us) service_pool.cc:224] Handling call
0923 19:50:20.763415 (+1616176us) ts_tablet_manager.cc:1151] Deleting tablet 12f4abb573bd4be6961b55c27c684d06
0923 19:50:20.763426 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.770275 (+ 6849us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.789333 (+ 19058us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.798385 (+ 9052us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1615503}
I20260923 19:50:20.799176 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 12f4abb573bd4be6961b55c27c684d06 (table default.Table_f3099aec2da54c33b79ac8261f13f6a2 [id=e15861b2c6c2424a862634f2dc347039]) successfully deleted
I20260923 19:50:20.799748 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 884) took 1640 ms. Trace:
I20260923 19:50:20.799913 6458 rpcz_store.cc:276] 0923 19:50:19.159490 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.159543 (+ 53us) service_pool.cc:224] Handling call
0923 19:50:20.799557 (+1640014us) ts_tablet_manager.cc:1151] Deleting tablet dadb3ab2082b4f749182b0616cf6e8f5
0923 19:50:20.799569 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.799713 (+ 144us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1620505}
W20260923 19:50:20.800731 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet dadb3ab2082b4f749182b0616cf6e8f5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dadb3ab2082b4f749182b0616cf6e8f5 already in progress: creating tablet
I20260923 19:50:20.800792 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 93e2504c43a143ceb64c2b9693c5fed9 (DEFAULT_TABLE table=default.Table_76e9093a6c7e44928a0ae7f1565e830a [id=f5f3b6f956594966b5ae0436e70eb8f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.801188 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93e2504c43a143ceb64c2b9693c5fed9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.803272 6458 tablet_replica.cc:333] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:20.803890 6458 raft_consensus.cc:2243] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:20.804644 6458 raft_consensus.cc:2272] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:20.806571 5797 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 96577a68f4984c90b82cf4d32e701476 consensus state has no leader
I20260923 19:50:20.806993 5797 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_837af71cfb55497889202017772a3869" } modify_external_catalogs: true
I20260923 19:50:20.807179 5797 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_837af71cfb55497889202017772a3869" } modify_external_catalogs: true
I20260923 19:50:20.807260 6458 ts_tablet_manager.cc:1916] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:20.809159 5800 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet f74e7cb3e5f54dfdb2280c795ce2ce53
I20260923 19:50:20.809697 5800 catalog_manager.cc:6934] ReplaceTablet: tablet f74e7cb3e5f54dfdb2280c795ce2ce53 deleted and replaced by tablet b4d0cb6f85c34dd5977898049a5d84ee
I20260923 19:50:20.810130 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_4bbf679800954626b374c8909325d09a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:20.810779 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4bbf679800954626b374c8909325d09a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:20.812182 7732 tablet.cc:1751] T 35f46a1be80c4194b592c5d00fe1f342 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:20.813320 6306 tablet_service.cc:1558] Processing DeleteTablet for tablet f74e7cb3e5f54dfdb2280c795ce2ce53 with delete_type TABLET_DATA_DELETED (replaced by tablet b4d0cb6f85c34dd5977898049a5d84ee) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:20.814080 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet f74e7cb3e5f54dfdb2280c795ce2ce53 with delete_type TABLET_DATA_DELETED (replaced by tablet b4d0cb6f85c34dd5977898049a5d84ee) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:20.819217 7700 raft_consensus.cc:493] T 2948d729e1ec4dfca70789bcad513e52 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:20.819371 7700 raft_consensus.cc:515] T 2948d729e1ec4dfca70789bcad513e52 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.820009 7700 leader_election.cc:290] T 2948d729e1ec4dfca70789bcad513e52 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:20.821328 6137 leader_election.cc:343] T 2948d729e1ec4dfca70789bcad513e52 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 2948d729e1ec4dfca70789bcad513e52
W20260923 19:50:20.822359 6139 leader_election.cc:343] T 2948d729e1ec4dfca70789bcad513e52 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 2948d729e1ec4dfca70789bcad513e52
I20260923 19:50:20.822477 6139 leader_election.cc:304] T 2948d729e1ec4dfca70789bcad513e52 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:20.822955 7700 raft_consensus.cc:2749] T 2948d729e1ec4dfca70789bcad513e52 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:20.824333 6306 tablet_service.cc:1511] Processing CreateTablet for tablet 0e68dbeb4c564892aeb9b32894ea277b (DEFAULT_TABLE table=default.Table_7a5a122018e24c8892027c5bf26c4ee8 [id=778734ca1c6b43fa9358ffbfcb8aa265]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.824716 6306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e68dbeb4c564892aeb9b32894ea277b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.791342 6457 tablet_bootstrap.cc:654] T 40adb472162042e48fdbb496b342996a P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:20.829453 6461 raft_consensus.cc:2272] T 64e8951eb899461aa9c0b36e3f7555e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:20.816025 7731 tablet.cc:1751] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:20.830143 6461 ts_tablet_manager.cc:1916] T 64e8951eb899461aa9c0b36e3f7555e2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:20.833379 6306 tablet_service.cc:1511] Processing CreateTablet for tablet 3c0564c9dae543fa957c0925a8623f54 (DEFAULT_TABLE table=default.Table_ac60821f06524a51b2ed9bcfa142bb9d [id=17241c69ac1b49c5bacf4699df77212b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.833818 6306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c0564c9dae543fa957c0925a8623f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.834103 6169 tablet_service.cc:1511] Processing CreateTablet for tablet 3c0564c9dae543fa957c0925a8623f54 (DEFAULT_TABLE table=default.Table_ac60821f06524a51b2ed9bcfa142bb9d [id=17241c69ac1b49c5bacf4699df77212b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.835510 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c0564c9dae543fa957c0925a8623f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.836594 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 12f4abb573bd4be6961b55c27c684d06 (table default.Table_f3099aec2da54c33b79ac8261f13f6a2 [id=e15861b2c6c2424a862634f2dc347039]) successfully deleted
W20260923 19:50:20.837179 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet dadb3ab2082b4f749182b0616cf6e8f5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dadb3ab2082b4f749182b0616cf6e8f5 already in progress: creating tablet
I20260923 19:50:20.837944 6024 tablet_service.cc:1558] Processing DeleteTablet for tablet f74e7cb3e5f54dfdb2280c795ce2ce53 with delete_type TABLET_DATA_DELETED (replaced by tablet b4d0cb6f85c34dd5977898049a5d84ee) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:20.838192 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 3c0564c9dae543fa957c0925a8623f54 (DEFAULT_TABLE table=default.Table_ac60821f06524a51b2ed9bcfa142bb9d [id=17241c69ac1b49c5bacf4699df77212b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.838287 7697 raft_consensus.cc:493] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:20.838392 7697 raft_consensus.cc:515] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.838579 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c0564c9dae543fa957c0925a8623f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.839320 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 0e68dbeb4c564892aeb9b32894ea277b (DEFAULT_TABLE table=default.Table_7a5a122018e24c8892027c5bf26c4ee8 [id=778734ca1c6b43fa9358ffbfcb8aa265]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.839668 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e68dbeb4c564892aeb9b32894ea277b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.837954 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 605093b0f8034a638b3df925ea31de34 (DEFAULT_TABLE table=default.Table_8b491f6b8220479ba54f424bc16d9251 [id=7a769e7c536f4b34b59ce5149f3e0646]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.841676 6459 ts_tablet_manager.cc:1929] T a11ecef9a24f4e4a812ec220b6a92cc4 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:20.841984 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 605093b0f8034a638b3df925ea31de34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.845366 7697 leader_election.cc:290] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:20.845558 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac04be575704a69994f98e00411a254" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:20.845701 6025 tablet_service.cc:1511] Processing CreateTablet for tablet 93e2504c43a143ceb64c2b9693c5fed9 (DEFAULT_TABLE table=default.Table_76e9093a6c7e44928a0ae7f1565e830a [id=f5f3b6f956594966b5ae0436e70eb8f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.845824 6340 raft_consensus.cc:2468] T 6ac04be575704a69994f98e00411a254 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 0.
I20260923 19:50:20.846257 5996 leader_election.cc:304] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:20.846714 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93e2504c43a143ceb64c2b9693c5fed9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.846843 6458 ts_tablet_manager.cc:1929] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:20.847286 6458 log.cc:1199] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/d8c8bfa9b7424b9f80f76e0bb05cbc0c
I20260923 19:50:20.848415 6458 ts_tablet_manager.cc:1950] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:20.849967 7697 raft_consensus.cc:2804] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:20.850044 7697 raft_consensus.cc:493] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:20.850101 7697 raft_consensus.cc:3060] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:20.850564 6459 log.cc:1199] T a11ecef9a24f4e4a812ec220b6a92cc4 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/a11ecef9a24f4e4a812ec220b6a92cc4
I20260923 19:50:20.851083 6459 ts_tablet_manager.cc:1950] T a11ecef9a24f4e4a812ec220b6a92cc4 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:20.851760 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 879) took 1801 ms. Trace:
I20260923 19:50:20.851683 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 886) took 1435 ms. Trace:
I20260923 19:50:20.851897 6459 rpcz_store.cc:276] 0923 19:50:19.050299 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.050356 (+ 57us) service_pool.cc:224] Handling call
0923 19:50:20.765143 (+1714787us) ts_tablet_manager.cc:1151] Deleting tablet a11ecef9a24f4e4a812ec220b6a92cc4
0923 19:50:20.765158 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.795131 (+ 29973us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.841622 (+ 46491us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.851745 (+ 10123us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1714303}
I20260923 19:50:20.851946 6458 rpcz_store.cc:276] 0923 19:50:19.415862 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.415917 (+ 55us) service_pool.cc:224] Handling call
0923 19:50:20.803050 (+1387133us) ts_tablet_manager.cc:1151] Deleting tablet d8c8bfa9b7424b9f80f76e0bb05cbc0c
0923 19:50:20.803147 (+ 97us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.824668 (+ 21521us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.846706 (+ 22038us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.851568 (+ 4862us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1386939}
I20260923 19:50:20.852520 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet a11ecef9a24f4e4a812ec220b6a92cc4 (table default.Table_ba859ce2dc954a94ac103be8f6037961 [id=712c6403e1b74895b79a3f7484db7347]) successfully deleted
I20260923 19:50:20.852748 7697 raft_consensus.cc:515] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.852921 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 880) took 1801 ms. Trace:
I20260923 19:50:20.852995 6459 rpcz_store.cc:276] 0923 19:50:19.051885 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.052882 (+ 997us) service_pool.cc:224] Handling call
0923 19:50:20.852796 (+1799914us) ts_tablet_manager.cc:1151] Deleting tablet 6d29923f139445cc86379c80ac15df5d
0923 19:50:20.852806 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.852904 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1799736}
I20260923 19:50:20.853179 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet d8c8bfa9b7424b9f80f76e0bb05cbc0c (table default.Table_f9942fca28234830913277dada229375 [id=662eb0a4f944445486929d42c5ebfd01]) successfully deleted
W20260923 19:50:20.853523 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 6d29923f139445cc86379c80ac15df5d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d29923f139445cc86379c80ac15df5d already in progress: creating tablet
I20260923 19:50:20.853722 7697 leader_election.cc:290] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:20.853838 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac04be575704a69994f98e00411a254" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:20.854010 6340 raft_consensus.cc:3060] T 6ac04be575704a69994f98e00411a254 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:20.854107 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 887) took 1431 ms. Trace:
I20260923 19:50:20.854269 6458 rpcz_store.cc:276] 0923 19:50:19.422124 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.422179 (+ 55us) service_pool.cc:224] Handling call
0923 19:50:20.853671 (+1431492us) ts_tablet_manager.cc:1151] Deleting tablet 146a402ff29a4e0b834a9f270d61e21c
0923 19:50:20.853684 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.853997 (+ 313us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1431039}
W20260923 19:50:20.855191 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 146a402ff29a4e0b834a9f270d61e21c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 146a402ff29a4e0b834a9f270d61e21c already in progress: creating tablet
I20260923 19:50:20.856004 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 889) took 1352 ms. Trace:
I20260923 19:50:20.856165 6458 rpcz_store.cc:276] 0923 19:50:19.503760 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.504065 (+ 305us) service_pool.cc:224] Handling call
0923 19:50:20.855514 (+1351449us) ts_tablet_manager.cc:1151] Deleting tablet 373d6442546d41e2b5567dfc92ae07b1
0923 19:50:20.855614 (+ 100us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.855890 (+ 276us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1351241}
I20260923 19:50:20.856782 6340 raft_consensus.cc:2468] T 6ac04be575704a69994f98e00411a254 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 1.
W20260923 19:50:20.857141 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 373d6442546d41e2b5567dfc92ae07b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 373d6442546d41e2b5567dfc92ae07b1 already in progress: creating tablet
I20260923 19:50:20.857362 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 882) took 1746 ms. Trace:
I20260923 19:50:20.857407 5996 leader_election.cc:304] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:20.857445 6459 rpcz_store.cc:276] 0923 19:50:19.110982 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.111260 (+ 278us) service_pool.cc:224] Handling call
0923 19:50:20.857231 (+1745971us) ts_tablet_manager.cc:1151] Deleting tablet 80386e27facd494bb11a46ddf83e7b23
0923 19:50:20.857240 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.857325 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1735400}
I20260923 19:50:20.857645 7629 raft_consensus.cc:493] T d35ff653bf8d41cfbcf83359402a8f6a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:20.857752 7629 raft_consensus.cc:515] T d35ff653bf8d41cfbcf83359402a8f6a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:20.857832 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 80386e27facd494bb11a46ddf83e7b23 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 80386e27facd494bb11a46ddf83e7b23 already in progress: creating tablet
I20260923 19:50:20.858126 6459 tablet_replica.cc:333] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:20.858340 7629 leader_election.cc:290] T d35ff653bf8d41cfbcf83359402a8f6a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:20.858348 6459 raft_consensus.cc:2243] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:20.858465 7629 raft_consensus.cc:2804] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:20.858556 7629 raft_consensus.cc:697] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Becoming Leader. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Running, Role: LEADER
I20260923 19:50:20.858639 6459 pending_rounds.cc:70] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:20.858691 6459 pending_rounds.cc:77] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630607023575040 op_type: NO_OP noop_request { }
I20260923 19:50:20.858774 6459 raft_consensus.cc:2889] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:20.858786 7629 consensus_queue.cc:237] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.858901 6459 raft_consensus.cc:2272] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:20.859452 6459 ts_tablet_manager.cc:1916] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:20.859493 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 890) took 1334 ms. Trace:
I20260923 19:50:20.859752 6458 rpcz_store.cc:276] 0923 19:50:19.525384 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.525451 (+ 67us) service_pool.cc:224] Handling call
0923 19:50:20.859096 (+1333645us) ts_tablet_manager.cc:1151] Deleting tablet 94a6af2036ae47cfbbd0f6940b596218
0923 19:50:20.859200 (+ 104us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.859471 (+ 271us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1333410}
W20260923 19:50:20.860641 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 94a6af2036ae47cfbbd0f6940b596218 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 94a6af2036ae47cfbbd0f6940b596218 already in progress: creating tablet
I20260923 19:50:20.861111 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d35ff653bf8d41cfbcf83359402a8f6a" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:20.861313 6458 tablet_replica.cc:333] T b9c187ee1fa8438397c83bc2c2b16925 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
W20260923 19:50:20.861804 5996 leader_election.cc:343] T d35ff653bf8d41cfbcf83359402a8f6a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:20.862363 6458 raft_consensus.cc:2243] T b9c187ee1fa8438397c83bc2c2b16925 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:20.862666 6457 tablet_bootstrap.cc:492] T 40adb472162042e48fdbb496b342996a P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:20.862860 6457 ts_tablet_manager.cc:1403] T 40adb472162042e48fdbb496b342996a P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.096s user 0.005s sys 0.001s
I20260923 19:50:20.863116 6458 raft_consensus.cc:2272] T b9c187ee1fa8438397c83bc2c2b16925 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:20.863691 6457 raft_consensus.cc:359] T 40adb472162042e48fdbb496b342996a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:20.863935 6457 raft_consensus.cc:385] T 40adb472162042e48fdbb496b342996a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:20.864040 6457 raft_consensus.cc:740] T 40adb472162042e48fdbb496b342996a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:20.864315 6457 consensus_queue.cc:260] T 40adb472162042e48fdbb496b342996a P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:20.864292 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_cea4d04a92eb4480be6da3424c723326" } new_table_name: "default.Table_d42d1c583ed9482caaaf742a8a82f476" modify_external_catalogs: true
I20260923 19:50:20.864899 6457 ts_tablet_manager.cc:1434] T 40adb472162042e48fdbb496b342996a P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:20.864792 6458 ts_tablet_manager.cc:1916] T b9c187ee1fa8438397c83bc2c2b16925 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:20.865234 6457 tablet_bootstrap.cc:492] T 02fa9052a7054659baf9b07b770bb538 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:20.866734 6457 tablet_bootstrap.cc:654] T 02fa9052a7054659baf9b07b770bb538 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:20.871182 5804 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dde2782e5a054e7793ac0789eb4e9ba1 consensus state has no leader
I20260923 19:50:20.871610 5804 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_9f22e0d8c3e240478c41d7eb8e843594" } modify_external_catalogs: true
I20260923 19:50:20.871789 5804 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_9f22e0d8c3e240478c41d7eb8e843594" } modify_external_catalogs: true
I20260923 19:50:20.875659 6458 ts_tablet_manager.cc:1929] T b9c187ee1fa8438397c83bc2c2b16925 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:20.875912 6458 log.cc:1199] T b9c187ee1fa8438397c83bc2c2b16925 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/b9c187ee1fa8438397c83bc2c2b16925
I20260923 19:50:20.876559 6458 ts_tablet_manager.cc:1950] T b9c187ee1fa8438397c83bc2c2b16925 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:20.877744 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 891) took 1337 ms. Trace:
I20260923 19:50:20.877967 6458 rpcz_store.cc:276] 0923 19:50:19.540435 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.540686 (+ 251us) service_pool.cc:224] Handling call
0923 19:50:20.861094 (+1320408us) ts_tablet_manager.cc:1151] Deleting tablet b9c187ee1fa8438397c83bc2c2b16925
0923 19:50:20.861207 (+ 113us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.869996 (+ 8789us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.875558 (+ 5562us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.877706 (+ 2148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7936,"tablet-delete.queue_time_us":1320244}
I20260923 19:50:20.878157 6324 tablet_service.cc:1511] Processing CreateTablet for tablet 9d5f5dcaf6f94fd1afa713d42c0ab037 (DEFAULT_TABLE table=default.Table_d78d71ca18ac4335ad0c752f06e39dd8 [id=1a24727072ee46a684ceb088e9177562]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.878756 6169 tablet_service.cc:1511] Processing CreateTablet for tablet c98d854a58b147fe96368a792dd0c125 (DEFAULT_TABLE table=default.Table_d28de154c0f1433db6ef27cc9a3a67b1 [id=83d25be8e67b43ab88a01fe7fee60132]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.879128 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98d854a58b147fe96368a792dd0c125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.880756 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 9d5f5dcaf6f94fd1afa713d42c0ab037 (DEFAULT_TABLE table=default.Table_d78d71ca18ac4335ad0c752f06e39dd8 [id=1a24727072ee46a684ceb088e9177562]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.881076 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d5f5dcaf6f94fd1afa713d42c0ab037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.882102 6310 tablet_service.cc:1511] Processing CreateTablet for tablet c98d854a58b147fe96368a792dd0c125 (DEFAULT_TABLE table=default.Table_d28de154c0f1433db6ef27cc9a3a67b1 [id=83d25be8e67b43ab88a01fe7fee60132]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.882411 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98d854a58b147fe96368a792dd0c125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.882597 6166 tablet_service.cc:1511] Processing CreateTablet for tablet e2080ba1b62647c9a0d90e92982b7da9 (DEFAULT_TABLE table=default.Table_8ae3676f12e14ee5a82935897324e9d6 [id=2649f04864004b9f9b5ccacc0163bee8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.882894 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2080ba1b62647c9a0d90e92982b7da9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.881791 6313 tablet_service.cc:1511] Processing CreateTablet for tablet af0f632bd266480d9ab1f864db5cd93e (DEFAULT_TABLE table=default.Table_c8b250416a5b4e08a25804b2aea8c0f8 [id=cb0acd41ecda45f9a508643a5519d89e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.886529 6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af0f632bd266480d9ab1f864db5cd93e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.889461 6164 tablet_service.cc:1511] Processing CreateTablet for tablet af0f632bd266480d9ab1f864db5cd93e (DEFAULT_TABLE table=default.Table_c8b250416a5b4e08a25804b2aea8c0f8 [id=cb0acd41ecda45f9a508643a5519d89e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:20.895561 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet df2b2d1c61344203be4bedbb71e699c2 consensus state has no leader
I20260923 19:50:20.895808 5805 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_cac7a266c93b4f28a3ceff8c08002256" } modify_external_catalogs: true
I20260923 19:50:20.895931 5798 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_602f24694ce04fa887e6cb0112b325f3" } modify_external_catalogs: true
I20260923 19:50:20.896019 5805 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_cac7a266c93b4f28a3ceff8c08002256" } modify_external_catalogs: true
I20260923 19:50:20.896087 5798 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_602f24694ce04fa887e6cb0112b325f3" } modify_external_catalogs: true
I20260923 19:50:20.901170 6457 tablet_bootstrap.cc:492] T 02fa9052a7054659baf9b07b770bb538 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:20.901316 6457 ts_tablet_manager.cc:1403] T 02fa9052a7054659baf9b07b770bb538 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.036s user 0.003s sys 0.000s
I20260923 19:50:20.901523 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d5f5dcaf6f94fd1afa713d42c0ab037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.903030 6457 raft_consensus.cc:359] T 02fa9052a7054659baf9b07b770bb538 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.903290 6457 raft_consensus.cc:385] T 02fa9052a7054659baf9b07b770bb538 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:20.903390 6457 raft_consensus.cc:740] T 02fa9052a7054659baf9b07b770bb538 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:20.903669 5796 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_c0397fc0ea5c4afaba12f570b10262f3 [id=29a38060f3bf43f3900ad0ee42fbde9a] alter complete (version 3)
I20260923 19:50:20.903668 6457 consensus_queue.cc:260] T 02fa9052a7054659baf9b07b770bb538 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.904330 6457 ts_tablet_manager.cc:1434] T 02fa9052a7054659baf9b07b770bb538 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:50:20.904238 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_f9278375b70547d0882596f4fd9f1295"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:20.904754 6457 tablet_bootstrap.cc:492] T 2526884ab0ef404aaf93051cc842c695 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
W20260923 19:50:20.904798 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f9278375b70547d0882596f4fd9f1295 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:20.906797 6457 tablet_bootstrap.cc:654] T 2526884ab0ef404aaf93051cc842c695 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:20.907469 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_b6c9ee903c654e5bbda90c1fd2ce6868"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:20.908203 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b6c9ee903c654e5bbda90c1fd2ce6868 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:20.909282 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac04be575704a69994f98e00411a254" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:20.909926 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d35ff653bf8d41cfbcf83359402a8f6a" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:20.910074 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_8e41ae4fbbd24bfe8fd51fa5fb4d0e22"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:20.910969 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e41ae4fbbd24bfe8fd51fa5fb4d0e22 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:20.911791 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac04be575704a69994f98e00411a254" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:20.913864 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet 6238d16b1be74dd88fd2e089fbd85d33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:20.914608 6139 consensus_peers.cc:597] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Couldn't send request to peer 2bf41435f70447f19992d368ca6b46bd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c504ec668a33451fb1249f697bb5e2bb. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:20.919641 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af0f632bd266480d9ab1f864db5cd93e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.919937 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet b9c187ee1fa8438397c83bc2c2b16925 (table default.Table_76a4d42c4ee8417fa82124f036ec71de [id=220774101a2442309f08c3d6f8713956]) successfully deleted
I20260923 19:50:20.920940 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 892) took 1380 ms. Trace:
I20260923 19:50:20.921288 6458 rpcz_store.cc:276] 0923 19:50:19.540588 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.540876 (+ 288us) service_pool.cc:224] Handling call
0923 19:50:20.920538 (+1379662us) ts_tablet_manager.cc:1151] Deleting tablet 9ee02922d2be45f5a1473a53a6f253c4
0923 19:50:20.920549 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.920822 (+ 273us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1379469}
W20260923 19:50:20.922356 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 9ee02922d2be45f5a1473a53a6f253c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9ee02922d2be45f5a1473a53a6f253c4 already in progress: creating tablet
I20260923 19:50:20.922618 6456 tablet_bootstrap.cc:492] T 34d62ab3d4aa457f8fea283cd9248a41 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:20.922814 6456 ts_tablet_manager.cc:1403] T 34d62ab3d4aa457f8fea283cd9248a41 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.127s user 0.004s sys 0.002s
I20260923 19:50:20.923048 6459 ts_tablet_manager.cc:1929] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:20.923328 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 893) took 1367 ms. Trace:
I20260923 19:50:20.923528 6456 raft_consensus.cc:359] T 34d62ab3d4aa457f8fea283cd9248a41 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.923812 6456 raft_consensus.cc:385] T 34d62ab3d4aa457f8fea283cd9248a41 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:20.923920 6456 raft_consensus.cc:740] T 34d62ab3d4aa457f8fea283cd9248a41 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:20.923595 6458 rpcz_store.cc:276] 0923 19:50:19.555859 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.555909 (+ 50us) service_pool.cc:224] Handling call
0923 19:50:20.922936 (+1367027us) ts_tablet_manager.cc:1151] Deleting tablet f1157d983bdc42a4a98326154d5f4eb4
0923 19:50:20.922948 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.923223 (+ 275us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1366761}
I20260923 19:50:20.924180 6456 consensus_queue.cc:260] T 34d62ab3d4aa457f8fea283cd9248a41 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:20.924517 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet f1157d983bdc42a4a98326154d5f4eb4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1157d983bdc42a4a98326154d5f4eb4 already in progress: creating tablet
I20260923 19:50:20.925424 6456 ts_tablet_manager.cc:1434] T 34d62ab3d4aa457f8fea283cd9248a41 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:20.927268 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 896) took 1103 ms. Trace:
I20260923 19:50:20.927403 6458 rpcz_store.cc:276] 0923 19:50:19.823844 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.827457 (+ 3613us) service_pool.cc:224] Handling call
0923 19:50:20.925004 (+1097547us) ts_tablet_manager.cc:1151] Deleting tablet 9603acbedc27465eab5a8146fed41587
0923 19:50:20.925531 (+ 527us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.927252 (+ 1721us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1097352}
I20260923 19:50:20.927790 6458 tablet_replica.cc:333] T dbe06eba8067413a903e4a07c2768484 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:20.927999 6458 raft_consensus.cc:2243] T dbe06eba8067413a903e4a07c2768484 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:20.928179 6458 raft_consensus.cc:2272] T dbe06eba8067413a903e4a07c2768484 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:20.928887 6458 ts_tablet_manager.cc:1916] T dbe06eba8067413a903e4a07c2768484 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:20.928952 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 9603acbedc27465eab5a8146fed41587 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9603acbedc27465eab5a8146fed41587 already in progress: creating tablet
I20260923 19:50:20.930483 6459 log.cc:1199] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/474e34e902064764864ba06ef41b1d94
I20260923 19:50:20.930948 6459 ts_tablet_manager.cc:1950] T 474e34e902064764864ba06ef41b1d94 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:20.931340 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 881) took 1824 ms. Trace:
I20260923 19:50:20.931479 6459 rpcz_store.cc:276] 0923 19:50:19.107256 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.118481 (+ 11225us) service_pool.cc:224] Handling call
0923 19:50:20.858081 (+1739600us) ts_tablet_manager.cc:1151] Deleting tablet 474e34e902064764864ba06ef41b1d94
0923 19:50:20.858091 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.891688 (+ 33597us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.922989 (+ 31301us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.931320 (+ 8331us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1733920}
I20260923 19:50:20.931946 6037 tablet_service.cc:1511] Processing CreateTablet for tablet af0f632bd266480d9ab1f864db5cd93e (DEFAULT_TABLE table=default.Table_c8b250416a5b4e08a25804b2aea8c0f8 [id=cb0acd41ecda45f9a508643a5519d89e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.932287 6457 tablet_bootstrap.cc:492] T 2526884ab0ef404aaf93051cc842c695 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:20.932520 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af0f632bd266480d9ab1f864db5cd93e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.932565 6457 ts_tablet_manager.cc:1403] T 2526884ab0ef404aaf93051cc842c695 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.028s user 0.005s sys 0.000s
I20260923 19:50:20.931962 6028 tablet_service.cc:1511] Processing CreateTablet for tablet c98d854a58b147fe96368a792dd0c125 (DEFAULT_TABLE table=default.Table_d28de154c0f1433db6ef27cc9a3a67b1 [id=83d25be8e67b43ab88a01fe7fee60132]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.933365 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98d854a58b147fe96368a792dd0c125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.933836 6457 raft_consensus.cc:359] T 2526884ab0ef404aaf93051cc842c695 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:20.934166 6457 raft_consensus.cc:385] T 2526884ab0ef404aaf93051cc842c695 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:20.934298 6457 raft_consensus.cc:740] T 2526884ab0ef404aaf93051cc842c695 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:20.934705 6457 consensus_queue.cc:260] T 2526884ab0ef404aaf93051cc842c695 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:20.935899 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 474e34e902064764864ba06ef41b1d94 (table default.Table_89c60db74742422086b6dcf76932a865 [id=2d69a962a7234afeb8366c66555b91e1]) successfully deleted
I20260923 19:50:20.936295 6459 tablet_replica.cc:333] T 12f4abb573bd4be6961b55c27c684d06 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:20.936576 6459 raft_consensus.cc:2243] T 12f4abb573bd4be6961b55c27c684d06 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:20.936710 6457 ts_tablet_manager.cc:1434] T 2526884ab0ef404aaf93051cc842c695 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260923 19:50:20.937599 6457 tablet_bootstrap.cc:492] T 22c89609da884c47b1dbc1470b37efbe P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:20.937923 6459 raft_consensus.cc:2272] T 12f4abb573bd4be6961b55c27c684d06 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:20.938577 6459 ts_tablet_manager.cc:1916] T 12f4abb573bd4be6961b55c27c684d06 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:20.924278 6454 tablet_bootstrap.cc:492] T ed9fb0cab0bd43b7a05d7376125b187e P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:20.940894 6454 ts_tablet_manager.cc:1403] T ed9fb0cab0bd43b7a05d7376125b187e P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.224s user 0.001s sys 0.004s
I20260923 19:50:20.942535 6457 tablet_bootstrap.cc:654] T 22c89609da884c47b1dbc1470b37efbe P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:20.943476 6454 raft_consensus.cc:359] T ed9fb0cab0bd43b7a05d7376125b187e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:20.943750 6454 raft_consensus.cc:385] T ed9fb0cab0bd43b7a05d7376125b187e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:20.951020 6323 tablet_service.cc:1511] Processing CreateTablet for tablet e2080ba1b62647c9a0d90e92982b7da9 (DEFAULT_TABLE table=default.Table_8ae3676f12e14ee5a82935897324e9d6 [id=2649f04864004b9f9b5ccacc0163bee8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.951450 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2080ba1b62647c9a0d90e92982b7da9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.952433 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e1c19a751904a6295897376e9c5ee56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:20.952800 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet c5cb76fa5e084604aa58bf888cfe4852 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:20.953250 6029 tablet_service.cc:1511] Processing CreateTablet for tablet e2080ba1b62647c9a0d90e92982b7da9 (DEFAULT_TABLE table=default.Table_8ae3676f12e14ee5a82935897324e9d6 [id=2649f04864004b9f9b5ccacc0163bee8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.953622 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2080ba1b62647c9a0d90e92982b7da9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:20.957428 5797 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 1c3c414efd52482abca00f249f582e8e
I20260923 19:50:20.958250 5799 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 85b7dcf131c54187a6e61f8503c797f8 (table default.Table_23c500b65dba4b6790b4349e5a5b0a07 [id=647997210f5349a68aa98d24e12a33cd]). Expected version 2 got 0
I20260923 19:50:20.959605 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_6bce4bb4735140d1ae968385c454192f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:20.960187 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6bce4bb4735140d1ae968385c454192f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:20.962029 6169 tablet_service.cc:1558] Processing DeleteTablet for tablet 2948d729e1ec4dfca70789bcad513e52 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:20.962531 5995 leader_election.cc:343] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:20.962847 5995 leader_election.cc:343] T d35ff653bf8d41cfbcf83359402a8f6a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:20.963049 5995 leader_election.cc:304] T d35ff653bf8d41cfbcf83359402a8f6a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:20.963315 7629 raft_consensus.cc:2749] T d35ff653bf8d41cfbcf83359402a8f6a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:20.964036 6139 consensus_peers.cc:597] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Couldn't send request to peer 2bf41435f70447f19992d368ca6b46bd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9be4c46ee8eb4dbaad01d492b701a9e0. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:20.964293 5797 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 6ac04be575704a69994f98e00411a254 (table default.Table_346160aa15ec4313947a6b9f256cea06 [id=cefd3af14e2148c19281df9e59f07421]). Expected version 1 got 0
I20260923 19:50:20.973922 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_9d958e2f2c8d46938d212cb93c8884f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:20.974514 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9d958e2f2c8d46938d212cb93c8884f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:20.979117 5995 leader_election.cc:343] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:20.980978 7732 tablet.cc:1751] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260923 19:50:20.981487 5803 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 195d4fe5f92e4e2c9330dce34c303723 consensus state has no leader
I20260923 19:50:20.982028 5803 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_346160aa15ec4313947a6b9f256cea06" } modify_external_catalogs: true
I20260923 19:50:20.982235 5803 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_346160aa15ec4313947a6b9f256cea06" } modify_external_catalogs: true
I20260923 19:50:20.982597 6025 tablet_service.cc:1511] Processing CreateTablet for tablet 9d5f5dcaf6f94fd1afa713d42c0ab037 (DEFAULT_TABLE table=default.Table_d78d71ca18ac4335ad0c752f06e39dd8 [id=1a24727072ee46a684ceb088e9177562]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:20.986083 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet d689f30677c04fb880778d6723b1f5ac
I20260923 19:50:20.986770 5804 master_service.cc:960] ReplaceTablet: received request to replace tablet 940d876042844020833ccc2347d67c4c from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:20.988246 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet d689f30677c04fb880778d6723b1f5ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:20 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:20.990170 6461 ts_tablet_manager.cc:1929] T 64e8951eb899461aa9c0b36e3f7555e2 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:20.990690 6169 tablet_service.cc:1558] Processing DeleteTablet for tablet d689f30677c04fb880778d6723b1f5ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:20 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:21.000401 6461 log.cc:1199] T 64e8951eb899461aa9c0b36e3f7555e2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/64e8951eb899461aa9c0b36e3f7555e2
I20260923 19:50:20.991400 7731 tablet.cc:1751] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:20.990446 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d5f5dcaf6f94fd1afa713d42c0ab037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:21.008074 6456 tablet_bootstrap.cc:492] T c7369a5fc87f4b70bcfbe052ef021771 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:21.010059 6456 tablet_bootstrap.cc:654] T c7369a5fc87f4b70bcfbe052ef021771 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:21.010840 7629 raft_consensus.cc:493] T 2526884ab0ef404aaf93051cc842c695 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:21.011071 7629 raft_consensus.cc:515] T 2526884ab0ef404aaf93051cc842c695 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:21.012100 7629 leader_election.cc:290] T 2526884ab0ef404aaf93051cc842c695 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:21.012239 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2526884ab0ef404aaf93051cc842c695" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:21.012928 5996 leader_election.cc:343] T 2526884ab0ef404aaf93051cc842c695 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:21.017478 6461 ts_tablet_manager.cc:1950] T 64e8951eb899461aa9c0b36e3f7555e2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:21.018395 7362 consensus_queue.cc:1048] T 98f61ace3a984938ace1fedbaa1dafa3 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:21.022944 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 905) took 1615 ms. Trace:
I20260923 19:50:21.024606 6459 ts_tablet_manager.cc:1929] T 12f4abb573bd4be6961b55c27c684d06 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:21.024871 6459 log.cc:1199] T 12f4abb573bd4be6961b55c27c684d06 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/12f4abb573bd4be6961b55c27c684d06
I20260923 19:50:21.025410 6459 ts_tablet_manager.cc:1950] T 12f4abb573bd4be6961b55c27c684d06 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:21.026289 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 883) took 1881 ms. Trace:
I20260923 19:50:21.026871 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2526884ab0ef404aaf93051cc842c695" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:21.029395 6459 rpcz_store.cc:276] 0923 19:50:19.145209 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.147657 (+ 2448us) service_pool.cc:224] Handling call
0923 19:50:20.936235 (+1788578us) ts_tablet_manager.cc:1151] Deleting tablet 12f4abb573bd4be6961b55c27c684d06
0923 19:50:20.936248 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.975531 (+ 39283us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:21.024445 (+ 48914us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:21.026268 (+ 1823us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1753752}
I20260923 19:50:21.029938 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 884) took 1870 ms. Trace:
W20260923 19:50:21.029101 6139 consensus_peers.cc:597] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Couldn't send request to peer 2bf41435f70447f19992d368ca6b46bd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 15a9d1d4adaa402f90d774e77010c928. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:21.027398 7740 tablet.cc:1751] T 35f46a1be80c4194b592c5d00fe1f342 P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:21.030834 6459 rpcz_store.cc:276] 0923 19:50:19.159400 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.159459 (+ 59us) service_pool.cc:224] Handling call
0923 19:50:21.029791 (+1870332us) ts_tablet_manager.cc:1151] Deleting tablet dadb3ab2082b4f749182b0616cf6e8f5
0923 19:50:21.029802 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.029922 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1847252}
I20260923 19:50:21.031293 6459 tablet_replica.cc:333] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:21.031680 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 12f4abb573bd4be6961b55c27c684d06 (table default.Table_f3099aec2da54c33b79ac8261f13f6a2 [id=e15861b2c6c2424a862634f2dc347039]) successfully deleted
W20260923 19:50:21.031996 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet dadb3ab2082b4f749182b0616cf6e8f5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dadb3ab2082b4f749182b0616cf6e8f5 already in progress: creating tablet
I20260923 19:50:21.028721 7629 raft_consensus.cc:493] T 2852e91ccd0c44b3b16f8189e57575d7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:21.033800 7629 raft_consensus.cc:515] T 2852e91ccd0c44b3b16f8189e57575d7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:21.035063 7629 leader_election.cc:290] T 2852e91ccd0c44b3b16f8189e57575d7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:21.035108 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2852e91ccd0c44b3b16f8189e57575d7" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:21.035691 6459 raft_consensus.cc:2243] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260923 19:50:21.035717 5996 leader_election.cc:343] T 2852e91ccd0c44b3b16f8189e57575d7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:21.036701 6459 raft_consensus.cc:2272] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:21.037369 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 33a318872f6a4f838ed9f0c0260d4bfb
I20260923 19:50:21.039690 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet d689f30677c04fb880778d6723b1f5ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:20 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:21.039867 6461 rpcz_store.cc:276] 0923 19:50:19.407344 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.407528 (+ 184us) service_pool.cc:224] Handling call
0923 19:50:20.772593 (+1365065us) ts_tablet_manager.cc:1151] Deleting tablet 64e8951eb899461aa9c0b36e3f7555e2
0923 19:50:20.772602 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.927481 (+154879us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:20.990108 (+ 62627us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:21.022926 (+ 32818us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1364853}
I20260923 19:50:21.040284 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 906) took 1619 ms. Trace:
I20260923 19:50:21.040354 6461 rpcz_store.cc:276] 0923 19:50:19.421131 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.421191 (+ 60us) service_pool.cc:224] Handling call
0923 19:50:21.040166 (+1618975us) ts_tablet_manager.cc:1151] Deleting tablet 146a402ff29a4e0b834a9f270d61e21c
0923 19:50:21.040178 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.040269 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1618794}
I20260923 19:50:21.040616 6461 tablet_replica.cc:333] T 92f94b93d1364bb1a2562eb577707cf1 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:21.040808 6461 raft_consensus.cc:2243] T 92f94b93d1364bb1a2562eb577707cf1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:21.041733 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet 33a318872f6a4f838ed9f0c0260d4bfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:20 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:21.039494 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet 33a318872f6a4f838ed9f0c0260d4bfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:20 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:21.042629 6459 ts_tablet_manager.cc:1916] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:21.043510 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet ce42c5de0cd3435b85fcfca92d69cdd5
I20260923 19:50:21.044291 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_cefeef04a4b942298f483f3a6c87dbb7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:21.044902 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cefeef04a4b942298f483f3a6c87dbb7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:21.046351 5802 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ad8fc0dedf9e422a8e5b3ff52a7a1a8d" } new_table_name: "default.Table_bd3a6fc8d4ad4e04ab03b4d83c07d880" modify_external_catalogs: true
I20260923 19:50:21.047729 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d283141d43ef4b21bd1372ff52f6a711" } new_table_name: "default.Table_ea6ee64b98194b0e92e7dce3cada525d" modify_external_catalogs: true
I20260923 19:50:21.050500 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet ce42c5de0cd3435b85fcfca92d69cdd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:20 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:21.057909 6137 consensus_peers.cc:597] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 28f9d03be14a4072aab7fd03834c3f6b. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:21.058171 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 64e8951eb899461aa9c0b36e3f7555e2 (table default.Table_562543b3ee364c59a1a2a7fd61331c74 [id=d1195b250ce24d589296d3a776339d7b]) successfully deleted
I20260923 19:50:21.058353 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2852e91ccd0c44b3b16f8189e57575d7" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:21.058948 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet ce42c5de0cd3435b85fcfca92d69cdd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:20 UTC) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:21.060839 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 146a402ff29a4e0b834a9f270d61e21c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 146a402ff29a4e0b834a9f270d61e21c already in progress: creating tablet
I20260923 19:50:21.061131 6461 raft_consensus.cc:2272] T 92f94b93d1364bb1a2562eb577707cf1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:21.062530 6461 ts_tablet_manager.cc:1916] T 92f94b93d1364bb1a2562eb577707cf1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:21.064972 6454 raft_consensus.cc:740] T ed9fb0cab0bd43b7a05d7376125b187e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:21.061832 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 33a318872f6a4f838ed9f0c0260d4bfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:20 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:21.062971 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet ce42c5de0cd3435b85fcfca92d69cdd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:20 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:21.066493 5799 master_service.cc:960] ReplaceTablet: received request to replace tablet 1b7d35282dd148e7bfcf1277d34002bf from {username='slave'} at 127.0.0.1:59912
W20260923 19:50:21.064951 5995 leader_election.cc:343] T 2526884ab0ef404aaf93051cc842c695 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:21.068879 5995 leader_election.cc:304] T 2526884ab0ef404aaf93051cc842c695 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:21.069010 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_416deb1d1c5a42c9a6f56834e09561b8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:21.069657 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_416deb1d1c5a42c9a6f56834e09561b8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:21.072717 7697 raft_consensus.cc:2749] T 2526884ab0ef404aaf93051cc842c695 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:21.072847 6457 tablet_bootstrap.cc:492] T 22c89609da884c47b1dbc1470b37efbe P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:21.073092 6457 ts_tablet_manager.cc:1403] T 22c89609da884c47b1dbc1470b37efbe P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.136s user 0.033s sys 0.062s
I20260923 19:50:21.073479 6458 ts_tablet_manager.cc:1929] T dbe06eba8067413a903e4a07c2768484 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260923 19:50:21.073988 5995 leader_election.cc:343] T 2852e91ccd0c44b3b16f8189e57575d7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:21.081467 6458 log.cc:1199] T dbe06eba8067413a903e4a07c2768484 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/dbe06eba8067413a903e4a07c2768484
I20260923 19:50:21.074410 6457 raft_consensus.cc:359] T 22c89609da884c47b1dbc1470b37efbe P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:21.082762 6457 raft_consensus.cc:385] T 22c89609da884c47b1dbc1470b37efbe P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:21.082934 6457 raft_consensus.cc:740] T 22c89609da884c47b1dbc1470b37efbe P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:21.083011 6456 tablet_bootstrap.cc:492] T c7369a5fc87f4b70bcfbe052ef021771 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:21.083197 6456 ts_tablet_manager.cc:1403] T c7369a5fc87f4b70bcfbe052ef021771 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.075s user 0.001s sys 0.002s
I20260923 19:50:21.082595 5995 leader_election.cc:304] T 2852e91ccd0c44b3b16f8189e57575d7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:21.083369 6457 consensus_queue.cc:260] T 22c89609da884c47b1dbc1470b37efbe P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:21.083901 6456 raft_consensus.cc:359] T c7369a5fc87f4b70bcfbe052ef021771 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.084147 6456 raft_consensus.cc:385] T c7369a5fc87f4b70bcfbe052ef021771 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:21.084209 7697 raft_consensus.cc:2749] T 2852e91ccd0c44b3b16f8189e57575d7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:21.084249 6456 raft_consensus.cc:740] T c7369a5fc87f4b70bcfbe052ef021771 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:21.084656 6456 consensus_queue.cc:260] T c7369a5fc87f4b70bcfbe052ef021771 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.084976 6457 ts_tablet_manager.cc:1434] T 22c89609da884c47b1dbc1470b37efbe P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.012s user 0.003s sys 0.000s
I20260923 19:50:21.085477 6457 tablet_bootstrap.cc:492] T 3c713a0973dc45debf61c228a4bf13bf P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:21.087016 6456 ts_tablet_manager.cc:1434] T c7369a5fc87f4b70bcfbe052ef021771 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260923 19:50:21.087342 6456 tablet_bootstrap.cc:492] T 83dba06b0d0040889015fb052c642ec0 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:21.088207 6457 tablet_bootstrap.cc:654] T 3c713a0973dc45debf61c228a4bf13bf P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:21.091490 5792 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 1f6df2c7b8c34ff2a358acdc58543991 (table default.Table_42710edebf0e439ba99e3c85c82be9f4 [id=918936f42dad4927bd643541a36f9e5a], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 1f6df2c7b8c34ff2a358acdc58543991 consensus state has no leader
I20260923 19:50:21.092044 6458 ts_tablet_manager.cc:1950] T dbe06eba8067413a903e4a07c2768484 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:21.092535 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 900) took 1194 ms. Trace:
I20260923 19:50:21.092864 6458 rpcz_store.cc:276] 0923 19:50:19.898467 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.898517 (+ 50us) service_pool.cc:224] Handling call
0923 19:50:20.927746 (+1029229us) ts_tablet_manager.cc:1151] Deleting tablet dbe06eba8067413a903e4a07c2768484
0923 19:50:20.927757 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:20.999002 (+ 71245us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:21.073411 (+ 74409us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:21.092518 (+ 19107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1029021}
I20260923 19:50:21.092813 6456 tablet_bootstrap.cc:654] T 83dba06b0d0040889015fb052c642ec0 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:21.094336 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet dbe06eba8067413a903e4a07c2768484 (table default.Table_85f67787052f46c2b29555acf4abc05c [id=98fdaeb42b5a426f8d96225de816958d]) successfully deleted
I20260923 19:50:21.095243 6458 tablet_replica.cc:333] T e4f00490b0364f0e9f1b9569b870808e P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:21.095429 6458 raft_consensus.cc:2243] T e4f00490b0364f0e9f1b9569b870808e P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:21.095675 6458 pending_rounds.cc:70] T e4f00490b0364f0e9f1b9569b870808e P 2bf41435f70447f19992d368ca6b46bd: Trying to abort 1 pending ops.
I20260923 19:50:21.095732 6458 pending_rounds.cc:77] T e4f00490b0364f0e9f1b9569b870808e P 2bf41435f70447f19992d368ca6b46bd: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630612134309888 op_type: NO_OP noop_request { }
I20260923 19:50:21.095813 6458 raft_consensus.cc:2889] T e4f00490b0364f0e9f1b9569b870808e P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:21.095887 6458 raft_consensus.cc:2272] T e4f00490b0364f0e9f1b9569b870808e P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:21.094148 6454 consensus_queue.cc:260] T ed9fb0cab0bd43b7a05d7376125b187e P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.098510 6458 ts_tablet_manager.cc:1916] T e4f00490b0364f0e9f1b9569b870808e P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:21.107640 6454 ts_tablet_manager.cc:1434] T ed9fb0cab0bd43b7a05d7376125b187e P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.167s user 0.016s sys 0.002s
I20260923 19:50:21.110064 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 940d876042844020833ccc2347d67c4c
I20260923 19:50:21.110674 5804 catalog_manager.cc:6934] ReplaceTablet: tablet 940d876042844020833ccc2347d67c4c deleted and replaced by tablet 78911eed02894176b689fd9ce681de71
I20260923 19:50:21.111027 5804 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_01ba57f1813948ec921501f2550adc9a" } new_table_name: "default.Table_fa879ac4eea4448382ccbabe37cce375" modify_external_catalogs: true
I20260923 19:50:21.112946 5805 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 40adb472162042e48fdbb496b342996a (table default.Table_9430735288754d599f68f15e1d52c0cf [id=8fe16214ad774a54982dbadeac1b4235]). Expected version 2 got 0
I20260923 19:50:21.114240 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 6ac04be575704a69994f98e00411a254
I20260923 19:50:21.114928 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_9c16acffff0c4d29995f569e1fbc8944"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:21.115494 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9c16acffff0c4d29995f569e1fbc8944 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:21.117199 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ac04be575704a69994f98e00411a254 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:20 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:21.117506 6454 tablet_bootstrap.cc:492] T 5e711e48156b46b5a517b330d6d41309 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:21.119096 5797 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_f6755f452e8d41c4b9d64c3ee2735188 [id=d6a2d0fc236a4056b224d01249f045b0] alter complete (version 1)
I20260923 19:50:21.120523 5797 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_0275ce58991948e781ef59d63b7ce7e9" } new_table_name: "default.Table_046edb51135a4c2f80ccb860e92c9e81" modify_external_catalogs: true
I20260923 19:50:21.120599 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 940d876042844020833ccc2347d67c4c with delete_type TABLET_DATA_DELETED (replaced by tablet 78911eed02894176b689fd9ce681de71) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:21.121222 7700 raft_consensus.cc:493] T ed9fb0cab0bd43b7a05d7376125b187e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:21.121361 7700 raft_consensus.cc:515] T ed9fb0cab0bd43b7a05d7376125b187e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.122057 7700 leader_election.cc:290] T ed9fb0cab0bd43b7a05d7376125b187e P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:21.122229 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ac04be575704a69994f98e00411a254 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:20 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:21.122713 6310 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d74560614b744188e759b981ad89a7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:21.122895 6313 tablet_service.cc:1558] Processing DeleteTablet for tablet 6238d16b1be74dd88fd2e089fbd85d33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:21.122936 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet c031d99a6f9844c29664236662e8d5f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:21.123100 6310 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b1d9413e1e24547b491a160d851377b with delete_type TABLET_DATA_DELETED (replaced by tablet 355b2fc61d4f4efd918204079f1ebf35) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:21.123211 6306 tablet_service.cc:1558] Processing DeleteTablet for tablet a01a86b6fd4b44d3808c2040525d7b61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:07 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:21.125288 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ac04be575704a69994f98e00411a254 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:20 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:21.125463 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fb0cab0bd43b7a05d7376125b187e" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:21.126413 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fb0cab0bd43b7a05d7376125b187e" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:21.126992 6139 leader_election.cc:304] T ed9fb0cab0bd43b7a05d7376125b187e P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:21.127360 5800 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 34d62ab3d4aa457f8fea283cd9248a41 (table default.Table_71d7f590efb94aae8c345f9d9a620fc1 [id=b4e8e3f2a48a4b5496f506080b415805]). Expected version 1 got 0
I20260923 19:50:21.127416 7700 raft_consensus.cc:2749] T ed9fb0cab0bd43b7a05d7376125b187e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:21.128552 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet 940d876042844020833ccc2347d67c4c with delete_type TABLET_DATA_DELETED (replaced by tablet 78911eed02894176b689fd9ce681de71) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:21.128993 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet 940d876042844020833ccc2347d67c4c with delete_type TABLET_DATA_DELETED (replaced by tablet 78911eed02894176b689fd9ce681de71) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:21.132001 6454 tablet_bootstrap.cc:654] T 5e711e48156b46b5a517b330d6d41309 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:21.137018 6456 tablet_bootstrap.cc:492] T 83dba06b0d0040889015fb052c642ec0 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:21.137320 6456 ts_tablet_manager.cc:1403] T 83dba06b0d0040889015fb052c642ec0 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.050s user 0.002s sys 0.002s
I20260923 19:50:21.137094 6459 ts_tablet_manager.cc:1929] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:21.138015 6459 log.cc:1199] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/58ea466d1b2b40e9b9b4cd5be51f79e0
I20260923 19:50:21.138151 6456 raft_consensus.cc:359] T 83dba06b0d0040889015fb052c642ec0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.138377 6456 raft_consensus.cc:385] T 83dba06b0d0040889015fb052c642ec0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:21.138443 6459 ts_tablet_manager.cc:1950] T 58ea466d1b2b40e9b9b4cd5be51f79e0 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:21.138478 6456 raft_consensus.cc:740] T 83dba06b0d0040889015fb052c642ec0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:21.138695 6456 consensus_queue.cc:260] T 83dba06b0d0040889015fb052c642ec0 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.138857 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 885) took 1940 ms. Trace:
I20260923 19:50:21.139110 6459 rpcz_store.cc:276] 0923 19:50:19.198545 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.198805 (+ 260us) service_pool.cc:224] Handling call
0923 19:50:21.031237 (+1832432us) ts_tablet_manager.cc:1151] Deleting tablet 58ea466d1b2b40e9b9b4cd5be51f79e0
0923 19:50:21.031246 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.071055 (+ 39809us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:21.137016 (+ 65961us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:21.138839 (+ 1823us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1832255}
I20260923 19:50:21.139294 6456 ts_tablet_manager.cc:1434] T 83dba06b0d0040889015fb052c642ec0 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:21.139544 6456 tablet_bootstrap.cc:492] T a926ff092e6e495e981be156421e8d72 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:21.139979 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 58ea466d1b2b40e9b9b4cd5be51f79e0 (table default.Table_c61ffa0e84514cddb714dc30da0a21f6 [id=3ee0e52e785f4cb39add98261628d513]) successfully deleted
I20260923 19:50:21.140389 6459 tablet_replica.cc:333] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:21.140630 6459 raft_consensus.cc:2243] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:21.141086 6459 pending_rounds.cc:70] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:21.141216 6459 pending_rounds.cc:77] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630610735386624 op_type: NO_OP noop_request { }
I20260923 19:50:21.141372 6459 raft_consensus.cc:2889] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20260923 19:50:21.141439 6280 consensus_peers.cc:597] T 98f61ace3a984938ace1fedbaa1dafa3 P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:21.141510 6459 raft_consensus.cc:2272] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:21.143702 6458 ts_tablet_manager.cc:1929] T e4f00490b0364f0e9f1b9569b870808e P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:21.147377 6459 ts_tablet_manager.cc:1916] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:21.158500 6454 tablet_bootstrap.cc:492] T 5e711e48156b46b5a517b330d6d41309 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:21.158514 6457 tablet_bootstrap.cc:492] T 3c713a0973dc45debf61c228a4bf13bf P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:21.158741 6454 ts_tablet_manager.cc:1403] T 5e711e48156b46b5a517b330d6d41309 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.000s
I20260923 19:50:21.158727 6457 ts_tablet_manager.cc:1403] T 3c713a0973dc45debf61c228a4bf13bf P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.073s user 0.015s sys 0.013s
I20260923 19:50:21.160251 6457 raft_consensus.cc:359] T 3c713a0973dc45debf61c228a4bf13bf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:21.160635 6457 raft_consensus.cc:385] T 3c713a0973dc45debf61c228a4bf13bf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:21.160796 6457 raft_consensus.cc:740] T 3c713a0973dc45debf61c228a4bf13bf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:21.161216 6457 consensus_queue.cc:260] T 3c713a0973dc45debf61c228a4bf13bf P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
W20260923 19:50:21.162220 6137 consensus_peers.cc:597] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9be4c46ee8eb4dbaad01d492b701a9e0. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:21.162827 6454 raft_consensus.cc:359] T 5e711e48156b46b5a517b330d6d41309 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.163067 6454 raft_consensus.cc:385] T 5e711e48156b46b5a517b330d6d41309 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:21.163175 6454 raft_consensus.cc:740] T 5e711e48156b46b5a517b330d6d41309 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:21.163002 6457 ts_tablet_manager.cc:1434] T 3c713a0973dc45debf61c228a4bf13bf P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260923 19:50:21.163477 6454 consensus_queue.cc:260] T 5e711e48156b46b5a517b330d6d41309 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.164093 6457 tablet_bootstrap.cc:492] T d04b3a9ade7a405bb619704095fac279 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:21.171072 6457 tablet_bootstrap.cc:654] T d04b3a9ade7a405bb619704095fac279 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:21.177369 6454 ts_tablet_manager.cc:1434] T 5e711e48156b46b5a517b330d6d41309 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.018s user 0.001s sys 0.000s
W20260923 19:50:21.177932 5802 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5f1a3b9bd2754a868908973cc79262e2 consensus state has no leader
I20260923 19:50:21.178367 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_53109b2775f44e67bfd5e452e3481fc2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:21.179141 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 577a1dcfe5bd4ef990053466bda6454c consensus state has no leader
I20260923 19:50:21.179489 5801 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a9e7f8c6300f47c7ba79e2dbe36d7849" } modify_external_catalogs: true
I20260923 19:50:21.179659 5801 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a9e7f8c6300f47c7ba79e2dbe36d7849" } modify_external_catalogs: true
I20260923 19:50:21.179865 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_38a8b9b9f5ef4e75ab44c919e6c8015c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:21.180348 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_38a8b9b9f5ef4e75ab44c919e6c8015c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:21.181329 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_53109b2775f44e67bfd5e452e3481fc2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:21.181378 6454 tablet_bootstrap.cc:492] T d6d3601a392f4723b4ca00f6e12b950c P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
W20260923 19:50:21.181798 5804 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dde2782e5a054e7793ac0789eb4e9ba1 consensus state has no leader
W20260923 19:50:21.182240 5797 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fc71e2911b9e4d1eb3fcebe7d1e4d96c consensus state has no leader
I20260923 19:50:21.184523 6458 log.cc:1199] T e4f00490b0364f0e9f1b9569b870808e P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/e4f00490b0364f0e9f1b9569b870808e
I20260923 19:50:21.147648 7256 raft_consensus.cc:493] T 83dba06b0d0040889015fb052c642ec0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:21.185197 7256 raft_consensus.cc:515] T 83dba06b0d0040889015fb052c642ec0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.186132 7256 leader_election.cc:290] T 83dba06b0d0040889015fb052c642ec0 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:21.186168 5799 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 1b7d35282dd148e7bfcf1277d34002bf
I20260923 19:50:21.186173 6454 tablet_bootstrap.cc:654] T d6d3601a392f4723b4ca00f6e12b950c P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:21.156962 7490 raft_consensus.cc:493] T 34d62ab3d4aa457f8fea283cd9248a41 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:21.186364 7490 raft_consensus.cc:515] T 34d62ab3d4aa457f8fea283cd9248a41 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.186758 5799 catalog_manager.cc:6934] ReplaceTablet: tablet 1b7d35282dd148e7bfcf1277d34002bf deleted and replaced by tablet cc49df86b5b24c87bdb62bd723deaf3c
I20260923 19:50:21.186892 7490 leader_election.cc:290] T 34d62ab3d4aa457f8fea283cd9248a41 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:21.187875 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b7d35282dd148e7bfcf1277d34002bf with delete_type TABLET_DATA_DELETED (replaced by tablet cc49df86b5b24c87bdb62bd723deaf3c) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:21.188210 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b7d35282dd148e7bfcf1277d34002bf with delete_type TABLET_DATA_DELETED (replaced by tablet cc49df86b5b24c87bdb62bd723deaf3c) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:21.144780 6456 tablet_bootstrap.cc:654] T a926ff092e6e495e981be156421e8d72 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:21.188931 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dba06b0d0040889015fb052c642ec0" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:21.189116 6457 tablet_bootstrap.cc:492] T d04b3a9ade7a405bb619704095fac279 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:21.189355 6457 ts_tablet_manager.cc:1403] T d04b3a9ade7a405bb619704095fac279 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.026s user 0.006s sys 0.002s
I20260923 19:50:21.189378 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d62ab3d4aa457f8fea283cd9248a41" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:21.190711 6457 raft_consensus.cc:359] T d04b3a9ade7a405bb619704095fac279 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:21.191118 6457 raft_consensus.cc:385] T d04b3a9ade7a405bb619704095fac279 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:21.191293 6457 raft_consensus.cc:740] T d04b3a9ade7a405bb619704095fac279 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:21.191741 6457 consensus_queue.cc:260] T d04b3a9ade7a405bb619704095fac279 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
W20260923 19:50:21.192251 6139 consensus_peers.cc:597] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Couldn't send request to peer 2bf41435f70447f19992d368ca6b46bd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 28f9d03be14a4072aab7fd03834c3f6b. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:21.193320 6458 ts_tablet_manager.cc:1950] T e4f00490b0364f0e9f1b9569b870808e P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:21.194319 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 899) took 1296 ms. Trace:
I20260923 19:50:21.194594 6458 rpcz_store.cc:276] 0923 19:50:19.898352 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.902895 (+ 4543us) service_pool.cc:224] Handling call
0923 19:50:21.095194 (+1192299us) ts_tablet_manager.cc:1151] Deleting tablet e4f00490b0364f0e9f1b9569b870808e
0923 19:50:21.095204 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.140570 (+ 45366us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:21.143653 (+ 3083us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:21.194298 (+ 50645us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1192031}
W20260923 19:50:21.194887 5700 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 43889.8us
I20260923 19:50:21.193272 6457 ts_tablet_manager.cc:1434] T d04b3a9ade7a405bb619704095fac279 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260923 19:50:21.196139 6457 tablet_bootstrap.cc:492] T f8007918eca14c81947e5999fe13a705 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:21.197351 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e711e48156b46b5a517b330d6d41309 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:03 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:21.197373 5799 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_87bca22b5e614f978d7d3802b2557b53" } new_table_name: "default.Table_7af3b4dfc5ef42dfa8d7d6548d3fb022" modify_external_catalogs: true
I20260923 19:50:21.200515 5797 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_c5c45e9fda2041f4bbb52be7e6cbf9df" } modify_external_catalogs: true
I20260923 19:50:21.200747 6459 ts_tablet_manager.cc:1929] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:21.200742 5797 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_c5c45e9fda2041f4bbb52be7e6cbf9df" } modify_external_catalogs: true
I20260923 19:50:21.203472 6459 log.cc:1199] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/15a9d1d4adaa402f90d774e77010c928
I20260923 19:50:21.204463 6459 ts_tablet_manager.cc:1950] T 15a9d1d4adaa402f90d774e77010c928 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
W20260923 19:50:21.194712 6280 leader_election.cc:343] T 83dba06b0d0040889015fb052c642ec0 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:21.204519 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d62ab3d4aa457f8fea283cd9248a41" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
W20260923 19:50:21.204733 6280 leader_election.cc:343] T 34d62ab3d4aa457f8fea283cd9248a41 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:21.204766 6059 raft_consensus.cc:2468] T 34d62ab3d4aa457f8fea283cd9248a41 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:21.205101 6025 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b7d35282dd148e7bfcf1277d34002bf with delete_type TABLET_DATA_DELETED (replaced by tablet cc49df86b5b24c87bdb62bd723deaf3c) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:21.205173 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 903) took 1275 ms. Trace:
I20260923 19:50:21.205252 6458 rpcz_store.cc:276] 0923 19:50:19.929750 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.929800 (+ 50us) service_pool.cc:224] Handling call
0923 19:50:21.205048 (+1275248us) ts_tablet_manager.cc:1151] Deleting tablet 3c713a0973dc45debf61c228a4bf13bf
0923 19:50:21.205061 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.205156 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1275038}
I20260923 19:50:21.205394 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet e4f00490b0364f0e9f1b9569b870808e (table default.Table_701c81d7fd4844f09fc1ccc28f0eda9c [id=67292e21e6b546298c5d629c6ebcb718]) successfully deleted
I20260923 19:50:21.205564 6454 tablet_bootstrap.cc:492] T d6d3601a392f4723b4ca00f6e12b950c P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:21.205600 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 902) took 1284 ms. Trace:
I20260923 19:50:21.205665 6458 rpcz_store.cc:276] 0923 19:50:19.920683 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.931319 (+ 10636us) service_pool.cc:224] Handling call
0923 19:50:21.205513 (+1274194us) ts_tablet_manager.cc:1151] Deleting tablet 5bc33295d8684e8583508124a8db5b8a
0923 19:50:21.205521 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.205587 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1273955}
I20260923 19:50:21.205910 6454 ts_tablet_manager.cc:1403] T d6d3601a392f4723b4ca00f6e12b950c P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.001s
I20260923 19:50:21.205945 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 912) took 1141 ms. Trace:
I20260923 19:50:21.205998 6458 rpcz_store.cc:276] 0923 19:50:20.064676 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:20.073449 (+ 8773us) service_pool.cc:224] Handling call
0923 19:50:21.205838 (+1132389us) ts_tablet_manager.cc:1151] Deleting tablet a2a793179a6a48cc9e9c2f0da9231416
0923 19:50:21.205845 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.205934 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1132141}
W20260923 19:50:21.206127 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 3c713a0973dc45debf61c228a4bf13bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3c713a0973dc45debf61c228a4bf13bf already in progress: creating tablet
W20260923 19:50:21.206399 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 5bc33295d8684e8583508124a8db5b8a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5bc33295d8684e8583508124a8db5b8a already in progress: creating tablet
I20260923 19:50:21.207376 6454 raft_consensus.cc:359] T d6d3601a392f4723b4ca00f6e12b950c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.207713 6454 raft_consensus.cc:385] T d6d3601a392f4723b4ca00f6e12b950c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:21.207710 5804 master_service.cc:960] ReplaceTablet: received request to replace tablet e4ad9baac560463fabc80828074b46c1 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:21.207870 6454 raft_consensus.cc:740] T d6d3601a392f4723b4ca00f6e12b950c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:21.208292 6454 consensus_queue.cc:260] T d6d3601a392f4723b4ca00f6e12b950c P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.209123 6454 ts_tablet_manager.cc:1434] T d6d3601a392f4723b4ca00f6e12b950c P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:50:21.208987 6456 tablet_bootstrap.cc:492] T a926ff092e6e495e981be156421e8d72 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:21.209280 6456 ts_tablet_manager.cc:1403] T a926ff092e6e495e981be156421e8d72 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.070s user 0.005s sys 0.002s
I20260923 19:50:21.209789 6454 tablet_bootstrap.cc:492] T 6ac04be575704a69994f98e00411a254 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:21.210395 7629 raft_consensus.cc:493] T 3c713a0973dc45debf61c228a4bf13bf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:21.210534 7629 raft_consensus.cc:515] T 3c713a0973dc45debf61c228a4bf13bf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
W20260923 19:50:21.210565 6279 leader_election.cc:343] T 83dba06b0d0040889015fb052c642ec0 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 83dba06b0d0040889015fb052c642ec0
I20260923 19:50:21.210683 6279 leader_election.cc:304] T 83dba06b0d0040889015fb052c642ec0 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:21.210915 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet a2a793179a6a48cc9e9c2f0da9231416 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a2a793179a6a48cc9e9c2f0da9231416 already in progress: creating tablet
I20260923 19:50:21.211216 7629 leader_election.cc:290] T 3c713a0973dc45debf61c228a4bf13bf P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:21.211201 6279 leader_election.cc:304] T 34d62ab3d4aa457f8fea283cd9248a41 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:21.211549 7490 raft_consensus.cc:2749] T 83dba06b0d0040889015fb052c642ec0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:21.211719 7490 raft_consensus.cc:2804] T 34d62ab3d4aa457f8fea283cd9248a41 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:21.211781 7490 raft_consensus.cc:493] T 34d62ab3d4aa457f8fea283cd9248a41 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:21.211843 7490 raft_consensus.cc:3060] T 34d62ab3d4aa457f8fea283cd9248a41 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:21.212276 6249 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
I20260923 19:50:21.213629 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c713a0973dc45debf61c228a4bf13bf" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:21.213780 6454 tablet_bootstrap.cc:654] T 6ac04be575704a69994f98e00411a254 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:21.214221 5996 leader_election.cc:343] T 3c713a0973dc45debf61c228a4bf13bf P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:21.214368 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet d6d3601a392f4723b4ca00f6e12b950c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:21.215309 7490 raft_consensus.cc:515] T 34d62ab3d4aa457f8fea283cd9248a41 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.215852 7490 leader_election.cc:290] T 34d62ab3d4aa457f8fea283cd9248a41 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:21.216495 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d62ab3d4aa457f8fea283cd9248a41" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:21.216616 6461 ts_tablet_manager.cc:1929] T 92f94b93d1364bb1a2562eb577707cf1 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:21.216760 6461 log.cc:1199] T 92f94b93d1364bb1a2562eb577707cf1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/92f94b93d1364bb1a2562eb577707cf1
I20260923 19:50:21.217097 6461 ts_tablet_manager.cc:1950] T 92f94b93d1364bb1a2562eb577707cf1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
W20260923 19:50:21.217136 6280 leader_election.cc:343] T 34d62ab3d4aa457f8fea283cd9248a41 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:21.219856 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c713a0973dc45debf61c228a4bf13bf" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:21.210558 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 911) took 1146 ms. Trace:
I20260923 19:50:21.220407 7629 raft_consensus.cc:493] T f1f1df47dc32413d9cc9456f4198dca5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:21.220381 6458 rpcz_store.cc:276] 0923 19:50:20.064543 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:20.078410 (+ 13867us) service_pool.cc:224] Handling call
0923 19:50:21.210444 (+1132034us) ts_tablet_manager.cc:1151] Deleting tablet 242a63d6282f435aa94fb4307c15ca8a
0923 19:50:21.210454 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.210541 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1131829}
I20260923 19:50:21.220537 7629 raft_consensus.cc:515] T f1f1df47dc32413d9cc9456f4198dca5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
W20260923 19:50:21.220871 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 242a63d6282f435aa94fb4307c15ca8a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 242a63d6282f435aa94fb4307c15ca8a already in progress: creating tablet
I20260923 19:50:21.221177 7629 leader_election.cc:290] T f1f1df47dc32413d9cc9456f4198dca5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:21.221416 6458 tablet_replica.cc:333] T 7af330ae1aaa48209f2bd1880bcfebb1 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:21.210096 6456 raft_consensus.cc:359] T a926ff092e6e495e981be156421e8d72 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.221858 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f1df47dc32413d9cc9456f4198dca5" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:21.222003 6456 raft_consensus.cc:385] T a926ff092e6e495e981be156421e8d72 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:21.222064 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d62ab3d4aa457f8fea283cd9248a41" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:21.222180 6456 raft_consensus.cc:740] T a926ff092e6e495e981be156421e8d72 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:21.222324 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 886) took 1958 ms. Trace:
W20260923 19:50:21.222529 5996 leader_election.cc:343] T f1f1df47dc32413d9cc9456f4198dca5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:21.222609 6456 consensus_queue.cc:260] T a926ff092e6e495e981be156421e8d72 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.222731 6059 raft_consensus.cc:3060] T 34d62ab3d4aa457f8fea283cd9248a41 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:21.221856 6458 raft_consensus.cc:2243] T 7af330ae1aaa48209f2bd1880bcfebb1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:21.223984 6457 tablet_bootstrap.cc:654] T f8007918eca14c81947e5999fe13a705 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:21.225461 6458 raft_consensus.cc:2272] T 7af330ae1aaa48209f2bd1880bcfebb1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:21.226078 6458 ts_tablet_manager.cc:1916] T 7af330ae1aaa48209f2bd1880bcfebb1 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:21.226466 6456 ts_tablet_manager.cc:1434] T a926ff092e6e495e981be156421e8d72 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260923 19:50:21.228250 6059 raft_consensus.cc:2468] T 34d62ab3d4aa457f8fea283cd9248a41 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:21.228595 6456 tablet_bootstrap.cc:492] T b87872fb6cc0400c86eddffb29c898e8 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:21.222466 6459 rpcz_store.cc:276] 0923 19:50:19.264235 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.264332 (+ 97us) service_pool.cc:224] Handling call
0923 19:50:21.140337 (+1876005us) ts_tablet_manager.cc:1151] Deleting tablet 15a9d1d4adaa402f90d774e77010c928
0923 19:50:21.140346 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.187432 (+ 47086us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:21.200685 (+ 13253us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:21.222298 (+ 21613us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1875824}
I20260923 19:50:21.229229 6279 leader_election.cc:304] T 34d62ab3d4aa457f8fea283cd9248a41 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:21.229765 7490 raft_consensus.cc:2804] T 34d62ab3d4aa457f8fea283cd9248a41 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:21.229914 7490 raft_consensus.cc:697] T 34d62ab3d4aa457f8fea283cd9248a41 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:21.230198 7490 consensus_queue.cc:237] T 34d62ab3d4aa457f8fea283cd9248a41 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.228928 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f1df47dc32413d9cc9456f4198dca5" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:21.231542 6459 tablet_replica.cc:333] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:21.231767 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 15a9d1d4adaa402f90d774e77010c928 (table default.Table_527c2568db7446559d0c719602184b02 [id=9e398f48d86e4c5898cac7336d3c24bf]) successfully deleted
W20260923 19:50:21.232530 5995 leader_election.cc:343] T 3c713a0973dc45debf61c228a4bf13bf P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:21.232662 5995 leader_election.cc:304] T 3c713a0973dc45debf61c228a4bf13bf P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:21.232908 7629 raft_consensus.cc:2749] T 3c713a0973dc45debf61c228a4bf13bf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:21.233323 5995 leader_election.cc:343] T f1f1df47dc32413d9cc9456f4198dca5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:21.233464 5995 leader_election.cc:304] T f1f1df47dc32413d9cc9456f4198dca5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:21.233667 7629 raft_consensus.cc:2749] T f1f1df47dc32413d9cc9456f4198dca5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:21.235246 6456 tablet_bootstrap.cc:654] T b87872fb6cc0400c86eddffb29c898e8 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:21.236524 6459 raft_consensus.cc:2243] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:21.236913 6459 pending_rounds.cc:70] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:21.236980 6459 pending_rounds.cc:77] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630610125758464 op_type: NO_OP noop_request { }
I20260923 19:50:21.237114 6459 raft_consensus.cc:2889] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:21.237200 6459 raft_consensus.cc:2272] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:21.238214 6459 ts_tablet_manager.cc:1916] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:21.242630 5804 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_1fcbce6f006d4bf9a2c26b1a496e54df" } modify_external_catalogs: true
I20260923 19:50:21.242698 7700 raft_consensus.cc:493] T 6238d16b1be74dd88fd2e089fbd85d33 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:21.242882 5804 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_1fcbce6f006d4bf9a2c26b1a496e54df" } modify_external_catalogs: true
I20260923 19:50:21.242861 7700 raft_consensus.cc:515] T 6238d16b1be74dd88fd2e089fbd85d33 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:21.243614 7700 leader_election.cc:290] T 6238d16b1be74dd88fd2e089fbd85d33 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:21.244414 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238d16b1be74dd88fd2e089fbd85d33" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:21.244616 6340 raft_consensus.cc:2468] T 6238d16b1be74dd88fd2e089fbd85d33 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:21.245585 6139 leader_election.cc:304] T 6238d16b1be74dd88fd2e089fbd85d33 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:21.245985 7700 raft_consensus.cc:2804] T 6238d16b1be74dd88fd2e089fbd85d33 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:21.246088 7700 raft_consensus.cc:493] T 6238d16b1be74dd88fd2e089fbd85d33 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:21.246169 7700 raft_consensus.cc:3060] T 6238d16b1be74dd88fd2e089fbd85d33 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:21.246529 6391 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
I20260923 19:50:21.250641 7700 raft_consensus.cc:515] T 6238d16b1be74dd88fd2e089fbd85d33 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:21.251413 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_ef4075fc4b4042b6aefe48402acd9088"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:21.252033 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ef4075fc4b4042b6aefe48402acd9088 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:21.252321 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6238d16b1be74dd88fd2e089fbd85d33" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:21.252547 6340 raft_consensus.cc:3060] T 6238d16b1be74dd88fd2e089fbd85d33 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:21.253296 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_546176a528e34e3488adcb2f3ee2b4e2" } modify_external_catalogs: true
I20260923 19:50:21.253468 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_546176a528e34e3488adcb2f3ee2b4e2" } modify_external_catalogs: true
I20260923 19:50:21.254163 6456 tablet_bootstrap.cc:492] T b87872fb6cc0400c86eddffb29c898e8 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:21.254279 6456 ts_tablet_manager.cc:1403] T b87872fb6cc0400c86eddffb29c898e8 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.002s
W20260923 19:50:21.256038 6137 leader_election.cc:343] T 6238d16b1be74dd88fd2e089fbd85d33 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 6238d16b1be74dd88fd2e089fbd85d33
I20260923 19:50:21.256735 5805 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_23c500b65dba4b6790b4349e5a5b0a07 [id=647997210f5349a68aa98d24e12a33cd] alter complete (version 2)
I20260923 19:50:21.258271 6340 raft_consensus.cc:2468] T 6238d16b1be74dd88fd2e089fbd85d33 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:21.261521 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet c7369a5fc87f4b70bcfbe052ef021771 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:21.262099 6139 leader_election.cc:304] T 6238d16b1be74dd88fd2e089fbd85d33 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:21.265407 7700 leader_election.cc:290] T 6238d16b1be74dd88fd2e089fbd85d33 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:21.265492 5801 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet f8052b05169b4673b387ac8b716ffc4e
I20260923 19:50:21.265854 7700 raft_consensus.cc:2804] T 6238d16b1be74dd88fd2e089fbd85d33 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
W20260923 19:50:21.266304 5799 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet de871dbb0bb34e6fb3c38583a471a37f consensus state has no leader
I20260923 19:50:21.266326 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet f8052b05169b4673b387ac8b716ffc4e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:21 UTC) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:21.267484 6137 leader_election.cc:343] T 6238d16b1be74dd88fd2e089fbd85d33 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 6238d16b1be74dd88fd2e089fbd85d33
I20260923 19:50:21.269377 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_f4e94b13deef43fb9382f2eccb648126"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:21.270251 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4e94b13deef43fb9382f2eccb648126 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:21.269378 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_a6c5228ee79e4839b3314f4c4f3d23cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:21.271739 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_9d0cde87567243cd9d33dc6e593a9fed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:21.272174 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6c5228ee79e4839b3314f4c4f3d23cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:21.272377 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9d0cde87567243cd9d33dc6e593a9fed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:21.275163 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet c500791905944480840c25929bc7bbe1
I20260923 19:50:21.275864 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet f8052b05169b4673b387ac8b716ffc4e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:21 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:21.276178 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet c500791905944480840c25929bc7bbe1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:21 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:21.277197 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet c500791905944480840c25929bc7bbe1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:21 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:21.281746 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 4f3d70c3fb2c463db1d13dcbc428d30c
I20260923 19:50:21.282997 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f3d70c3fb2c463db1d13dcbc428d30c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:21 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:21.286036 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f3d70c3fb2c463db1d13dcbc428d30c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:21 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:21.291890 6456 raft_consensus.cc:359] T b87872fb6cc0400c86eddffb29c898e8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.292098 6456 raft_consensus.cc:385] T b87872fb6cc0400c86eddffb29c898e8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:21.292156 6456 raft_consensus.cc:740] T b87872fb6cc0400c86eddffb29c898e8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:21.295291 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet a5cd258b6ff44e3db0d4cb66b51874b0
I20260923 19:50:21.295820 7700 raft_consensus.cc:697] T 6238d16b1be74dd88fd2e089fbd85d33 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:21.296142 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet a5cd258b6ff44e3db0d4cb66b51874b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:21 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:21.296572 7700 consensus_queue.cc:237] T 6238d16b1be74dd88fd2e089fbd85d33 P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:21.296849 6456 consensus_queue.cc:260] T b87872fb6cc0400c86eddffb29c898e8 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.296769 7755 raft_consensus.cc:493] T 85b7dcf131c54187a6e61f8503c797f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:21.297269 7755 raft_consensus.cc:515] T 85b7dcf131c54187a6e61f8503c797f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.297983 6454 tablet_bootstrap.cc:492] T 6ac04be575704a69994f98e00411a254 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:21.298257 6454 ts_tablet_manager.cc:1403] T 6ac04be575704a69994f98e00411a254 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.089s user 0.016s sys 0.045s
I20260923 19:50:21.298370 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85b7dcf131c54187a6e61f8503c797f8" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:21.298501 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet a5cd258b6ff44e3db0d4cb66b51874b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:21 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:21.298763 6456 ts_tablet_manager.cc:1434] T b87872fb6cc0400c86eddffb29c898e8 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.044s user 0.002s sys 0.000s
I20260923 19:50:21.300251 6454 raft_consensus.cc:359] T 6ac04be575704a69994f98e00411a254 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.300774 6454 raft_consensus.cc:385] T 6ac04be575704a69994f98e00411a254 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:21.300942 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85b7dcf131c54187a6e61f8503c797f8" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:21.301180 6454 raft_consensus.cc:740] T 6ac04be575704a69994f98e00411a254 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:21.301749 6454 consensus_queue.cc:260] T 6ac04be575704a69994f98e00411a254 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.302598 6139 leader_election.cc:304] T 85b7dcf131c54187a6e61f8503c797f8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:21.300282 7755 leader_election.cc:290] T 85b7dcf131c54187a6e61f8503c797f8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:21.303117 7755 raft_consensus.cc:2749] T 85b7dcf131c54187a6e61f8503c797f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:21.303133 6454 ts_tablet_manager.cc:1434] T 6ac04be575704a69994f98e00411a254 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260923 19:50:21.303992 6454 tablet_bootstrap.cc:492] T 22e37d5afa8047989928596b4092c4b9 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:21.304454 6457 tablet_bootstrap.cc:492] T f8007918eca14c81947e5999fe13a705 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:21.304589 6457 ts_tablet_manager.cc:1403] T f8007918eca14c81947e5999fe13a705 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.109s user 0.009s sys 0.004s
I20260923 19:50:21.305377 6457 raft_consensus.cc:359] T f8007918eca14c81947e5999fe13a705 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:21.305550 6457 raft_consensus.cc:385] T f8007918eca14c81947e5999fe13a705 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:21.305605 6457 raft_consensus.cc:740] T f8007918eca14c81947e5999fe13a705 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:21.305819 6457 consensus_queue.cc:260] T f8007918eca14c81947e5999fe13a705 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:21.306352 6457 ts_tablet_manager.cc:1434] T f8007918eca14c81947e5999fe13a705 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:50:21.306915 6454 tablet_bootstrap.cc:654] T 22e37d5afa8047989928596b4092c4b9 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:21.307693 6457 tablet_bootstrap.cc:492] T 688bb1055ba94c2996cdfea6dea76416 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:21.311293 6458 ts_tablet_manager.cc:1929] T 7af330ae1aaa48209f2bd1880bcfebb1 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:21.311719 5799 master_service.cc:960] ReplaceTablet: received request to replace tablet 96577a68f4984c90b82cf4d32e701476 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:21.311926 6458 log.cc:1199] T 7af330ae1aaa48209f2bd1880bcfebb1 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/7af330ae1aaa48209f2bd1880bcfebb1
I20260923 19:50:21.312546 6458 ts_tablet_manager.cc:1950] T 7af330ae1aaa48209f2bd1880bcfebb1 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:21.315387 6459 ts_tablet_manager.cc:1929] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:21.317195 6454 tablet_bootstrap.cc:492] T 22e37d5afa8047989928596b4092c4b9 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:21.317507 6454 ts_tablet_manager.cc:1403] T 22e37d5afa8047989928596b4092c4b9 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.014s user 0.009s sys 0.001s
I20260923 19:50:21.317584 6457 tablet_bootstrap.cc:654] T 688bb1055ba94c2996cdfea6dea76416 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:21.318102 5995 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 84777.8us
I20260923 19:50:21.318737 6025 tablet_service.cc:1558] Processing DeleteTablet for tablet 2526884ab0ef404aaf93051cc842c695 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:21.319141 6454 raft_consensus.cc:359] T 22e37d5afa8047989928596b4092c4b9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.319510 6454 raft_consensus.cc:385] T 22e37d5afa8047989928596b4092c4b9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:21.319571 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_15fa9b0a330d4811bfe8b985c792ef90"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:21.319665 6454 raft_consensus.cc:740] T 22e37d5afa8047989928596b4092c4b9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
W20260923 19:50:21.320158 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_15fa9b0a330d4811bfe8b985c792ef90 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:21.317220 6459 log.cc:1199] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/28f9d03be14a4072aab7fd03834c3f6b
I20260923 19:50:21.320391 6454 consensus_queue.cc:260] T 22e37d5afa8047989928596b4092c4b9 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.323280 6459 ts_tablet_manager.cc:1950] T 28f9d03be14a4072aab7fd03834c3f6b P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:21.324200 6454 ts_tablet_manager.cc:1434] T 22e37d5afa8047989928596b4092c4b9 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260923 19:50:21.325119 5803 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f51ff8d9bbeb4df183cff372b5f59ea3" } modify_external_catalogs: true
I20260923 19:50:21.325021 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 887) took 1973 ms. Trace:
I20260923 19:50:21.325332 5803 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f51ff8d9bbeb4df183cff372b5f59ea3" } modify_external_catalogs: true
I20260923 19:50:21.325632 6454 tablet_bootstrap.cc:492] T 035abecfbee7474d9dd048f35e28e867 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:21.325533 6459 rpcz_store.cc:276] 0923 19:50:19.351110 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.351162 (+ 52us) service_pool.cc:224] Handling call
0923 19:50:21.231455 (+1880293us) ts_tablet_manager.cc:1151] Deleting tablet 28f9d03be14a4072aab7fd03834c3f6b
0923 19:50:21.231472 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.292600 (+ 61128us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:21.315306 (+ 22706us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:21.325001 (+ 9695us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1880096}
I20260923 19:50:21.326750 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 28f9d03be14a4072aab7fd03834c3f6b (table default.Table_2b35ad69600645618a826140c33c4da8 [id=6a9d5cc3eb1a4dbdbf6a5acaafa07ec7]) successfully deleted
I20260923 19:50:21.328366 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 888) took 1904 ms. Trace:
I20260923 19:50:21.328718 6459 rpcz_store.cc:276] 0923 19:50:19.423782 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.423835 (+ 53us) service_pool.cc:224] Handling call
0923 19:50:21.327860 (+1904025us) ts_tablet_manager.cc:1151] Deleting tablet 146a402ff29a4e0b834a9f270d61e21c
0923 19:50:21.327963 (+ 103us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.328255 (+ 292us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1903855}
W20260923 19:50:21.329774 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 146a402ff29a4e0b834a9f270d61e21c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 146a402ff29a4e0b834a9f270d61e21c already in progress: creating tablet
I20260923 19:50:21.330195 6459 tablet_replica.cc:333] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:21.331060 6459 raft_consensus.cc:2243] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:21.332096 6459 pending_rounds.cc:70] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:21.332408 6459 pending_rounds.cc:77] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630609039417344 op_type: NO_OP noop_request { }
I20260923 19:50:21.332854 6459 raft_consensus.cc:2889] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:21.333267 6454 tablet_bootstrap.cc:654] T 035abecfbee7474d9dd048f35e28e867 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:21.333210 6459 raft_consensus.cc:2272] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:21.335369 6459 ts_tablet_manager.cc:1916] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:21.340283 6106 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
W20260923 19:50:21.341415 7499 log.cc:927] Time spent T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae: Append to log took a long time: real 0.211s user 0.004s sys 0.000s
I20260923 19:50:21.349318 5801 master_service.cc:960] ReplaceTablet: received request to replace tablet 98f61ace3a984938ace1fedbaa1dafa3 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:21.354903 6456 tablet_bootstrap.cc:492] T 658253ff3d014361803e1aeda978e59a P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:21.357091 6456 tablet_bootstrap.cc:654] T 658253ff3d014361803e1aeda978e59a P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:21.359159 5801 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 98f61ace3a984938ace1fedbaa1dafa3
I20260923 19:50:21.360075 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 916) took 1151 ms. Trace:
I20260923 19:50:21.360176 6458 rpcz_store.cc:276] 0923 19:50:20.208666 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:20.214238 (+ 5572us) service_pool.cc:224] Handling call
0923 19:50:21.221363 (+1007125us) ts_tablet_manager.cc:1151] Deleting tablet 7af330ae1aaa48209f2bd1880bcfebb1
0923 19:50:21.221373 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.244853 (+ 23480us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:21.299168 (+ 54315us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:21.360039 (+ 60871us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2188,"tablet-delete.queue_time_us":1006751}
I20260923 19:50:21.360364 5801 catalog_manager.cc:6934] ReplaceTablet: tablet 98f61ace3a984938ace1fedbaa1dafa3 deleted and replaced by tablet 5946ac877d51461a89d33cce8c05bc16
I20260923 19:50:21.360358 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet 98f61ace3a984938ace1fedbaa1dafa3 with delete_type TABLET_DATA_DELETED (replaced by tablet 5946ac877d51461a89d33cce8c05bc16) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:21.361312 6458 tablet_replica.cc:333] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:21.361492 6458 raft_consensus.cc:2243] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:21.361992 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet 98f61ace3a984938ace1fedbaa1dafa3 with delete_type TABLET_DATA_DELETED (replaced by tablet 5946ac877d51461a89d33cce8c05bc16) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:21.362744 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 7af330ae1aaa48209f2bd1880bcfebb1 (table default.Table_cd491412a6264b6aba16b6648a128b0f [id=fda97d4d322f453296d283fffa052c35]) successfully deleted
W20260923 19:50:21.363018 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 7595c09be8784a948027dd923c4b023e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7595c09be8784a948027dd923c4b023e already in progress: creating tablet
W20260923 19:50:21.363310 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet c82bb40047b342d5b9468ecc374ef829 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c82bb40047b342d5b9468ecc374ef829 already in progress: creating tablet
W20260923 19:50:21.363549 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 13b21aadd7464b1aa2afe7a1ebc9e77f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 13b21aadd7464b1aa2afe7a1ebc9e77f already in progress: creating tablet
W20260923 19:50:21.363814 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 3d224df1bca44e30aff2b307281e399f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3d224df1bca44e30aff2b307281e399f already in progress: creating tablet
W20260923 19:50:21.364084 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 83fdbb8a5352447b8ad6570e44674e97 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 83fdbb8a5352447b8ad6570e44674e97 already in progress: creating tablet
I20260923 19:50:21.361830 6458 raft_consensus.cc:2272] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:21.367314 6458 ts_tablet_manager.cc:1916] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:21.370931 6454 tablet_bootstrap.cc:492] T 035abecfbee7474d9dd048f35e28e867 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:21.371238 6454 ts_tablet_manager.cc:1403] T 035abecfbee7474d9dd048f35e28e867 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.046s user 0.002s sys 0.005s
I20260923 19:50:21.372346 6454 raft_consensus.cc:359] T 035abecfbee7474d9dd048f35e28e867 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.372730 6454 raft_consensus.cc:385] T 035abecfbee7474d9dd048f35e28e867 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:21.372828 6454 raft_consensus.cc:740] T 035abecfbee7474d9dd048f35e28e867 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:21.373320 6454 consensus_queue.cc:260] T 035abecfbee7474d9dd048f35e28e867 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.374265 6454 ts_tablet_manager.cc:1434] T 035abecfbee7474d9dd048f35e28e867 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260923 19:50:21.374505 6197 raft_consensus.cc:3060] T 85b7dcf131c54187a6e61f8503c797f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:21.374943 6454 tablet_bootstrap.cc:492] T b7ba284e81bc4388bbd6456a41d1f9f4 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:21.377368 6454 tablet_bootstrap.cc:654] T b7ba284e81bc4388bbd6456a41d1f9f4 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:21.379040 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet c500791905944480840c25929bc7bbe1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:21 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:21.379297 6026 tablet_service.cc:1558] Processing DeleteTablet for tablet a5cd258b6ff44e3db0d4cb66b51874b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:21 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:21.379457 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet 98f61ace3a984938ace1fedbaa1dafa3 with delete_type TABLET_DATA_DELETED (replaced by tablet 5946ac877d51461a89d33cce8c05bc16) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:21.379601 6025 tablet_service.cc:1558] Processing DeleteTablet for tablet 02fa9052a7054659baf9b07b770bb538 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:21.379752 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 2852e91ccd0c44b3b16f8189e57575d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:21.379848 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 907) took 1927 ms. Trace:
I20260923 19:50:21.379910 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet f8052b05169b4673b387ac8b716ffc4e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:21 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:21.380067 6024 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f3d70c3fb2c463db1d13dcbc428d30c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:21 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:21.379915 6461 rpcz_store.cc:276] 0923 19:50:19.452445 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.452509 (+ 64us) service_pool.cc:224] Handling call
0923 19:50:21.040568 (+1588059us) ts_tablet_manager.cc:1151] Deleting tablet 92f94b93d1364bb1a2562eb577707cf1
0923 19:50:21.040576 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.164874 (+124298us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:21.216560 (+ 51686us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:21.379830 (+163270us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1587841}
I20260923 19:50:21.383731 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 908) took 1921 ms. Trace:
I20260923 19:50:21.383826 6461 rpcz_store.cc:276] 0923 19:50:19.462546 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.462598 (+ 52us) service_pool.cc:224] Handling call
0923 19:50:21.381366 (+1918768us) ts_tablet_manager.cc:1151] Deleting tablet 373d6442546d41e2b5567dfc92ae07b1
0923 19:50:21.383603 (+ 2237us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.383712 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1918581}
I20260923 19:50:21.384167 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 909) took 1860 ms. Trace:
I20260923 19:50:21.384239 6461 rpcz_store.cc:276] 0923 19:50:19.524183 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.524436 (+ 253us) service_pool.cc:224] Handling call
0923 19:50:21.384073 (+1859637us) ts_tablet_manager.cc:1151] Deleting tablet 94a6af2036ae47cfbbd0f6940b596218
0923 19:50:21.384082 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.384153 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1858215}
I20260923 19:50:21.384838 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 910) took 1844 ms. Trace:
I20260923 19:50:21.384918 6461 rpcz_store.cc:276] 0923 19:50:19.540348 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.540406 (+ 58us) service_pool.cc:224] Handling call
0923 19:50:21.384485 (+1844079us) ts_tablet_manager.cc:1151] Deleting tablet 9ee02922d2be45f5a1473a53a6f253c4
0923 19:50:21.384493 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.384817 (+ 324us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1843885}
I20260923 19:50:21.385254 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 911) took 1829 ms. Trace:
I20260923 19:50:21.385316 6461 rpcz_store.cc:276] 0923 19:50:19.555656 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.555716 (+ 60us) service_pool.cc:224] Handling call
0923 19:50:21.385158 (+1829442us) ts_tablet_manager.cc:1151] Deleting tablet f1157d983bdc42a4a98326154d5f4eb4
0923 19:50:21.385167 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.385240 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1829285}
I20260923 19:50:21.385558 6461 tablet_replica.cc:333] T ba639d8c68cf49a49a5ec5729143cf6b P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:21.385737 6461 raft_consensus.cc:2243] T ba639d8c68cf49a49a5ec5729143cf6b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:21.385903 6461 raft_consensus.cc:2272] T ba639d8c68cf49a49a5ec5729143cf6b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:21.386461 6461 ts_tablet_manager.cc:1916] T ba639d8c68cf49a49a5ec5729143cf6b P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:21.389475 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_6de7a682db5a4865b1c680cc672761ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:21.390090 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_54827ad1f0b04f789fc2533c59d86cd2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:21.390759 5796 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_863bd219e51649d09aba43c4d7cbbb4a" } new_table_name: "default.Table_889af07148934f888c1e9e6b7cb9e60a" modify_external_catalogs: true
I20260923 19:50:21.391768 6458 ts_tablet_manager.cc:1929] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:50:21.391880 6458 log.cc:1199] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/f74e7cb3e5f54dfdb2280c795ce2ce53
I20260923 19:50:21.391990 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_31f03213b57f4ae88e77e571772547cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:21.392225 6458 ts_tablet_manager.cc:1950] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:21.393136 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_9d0cde87567243cd9d33dc6e593a9fed" } new_table_name: "default.Table_f08a29f184db41a799596833fb608cdf" modify_external_catalogs: true
I20260923 19:50:21.395686 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a97c70dd1454425e9e3abc310ebc442b" } new_table_name: "default.Table_34145a62b6df4ad88c33a268f9f59a62" modify_external_catalogs: true
I20260923 19:50:21.398880 6457 tablet_bootstrap.cc:492] T 688bb1055ba94c2996cdfea6dea76416 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:21.400411 6457 ts_tablet_manager.cc:1403] T 688bb1055ba94c2996cdfea6dea76416 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.093s user 0.006s sys 0.001s
W20260923 19:50:21.402783 5796 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ca40c76ea0104e7182a7e16fc141fcc9 has no consensus state
I20260923 19:50:21.405390 6454 tablet_bootstrap.cc:492] T b7ba284e81bc4388bbd6456a41d1f9f4 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:21.405937 6454 ts_tablet_manager.cc:1403] T b7ba284e81bc4388bbd6456a41d1f9f4 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.006s
I20260923 19:50:21.406109 6457 raft_consensus.cc:359] T 688bb1055ba94c2996cdfea6dea76416 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.406337 6457 raft_consensus.cc:385] T 688bb1055ba94c2996cdfea6dea76416 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:21.406395 6457 raft_consensus.cc:740] T 688bb1055ba94c2996cdfea6dea76416 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:21.406620 6457 consensus_queue.cc:260] T 688bb1055ba94c2996cdfea6dea76416 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.407145 6457 ts_tablet_manager.cc:1434] T 688bb1055ba94c2996cdfea6dea76416 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.004s user 0.000s sys 0.000s
I20260923 19:50:21.407439 6457 tablet_bootstrap.cc:492] T f4313a4d8a9c411fad593b05ad655fc4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
W20260923 19:50:21.408318 5805 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a8ff365455654640945b173894de65c3 has no consensus state
I20260923 19:50:21.408260 6454 raft_consensus.cc:359] T b7ba284e81bc4388bbd6456a41d1f9f4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.408723 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_6926f64a6e24455aae8f5261e871c225" } new_table_name: "default.Table_21298e3a6a4143aeb230a266b5667d6f" modify_external_catalogs: true
I20260923 19:50:21.408977 6454 raft_consensus.cc:385] T b7ba284e81bc4388bbd6456a41d1f9f4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:21.409258 6454 raft_consensus.cc:740] T b7ba284e81bc4388bbd6456a41d1f9f4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:21.409597 6459 ts_tablet_manager.cc:1929] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:21.409703 6459 log.cc:1199] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/c504ec668a33451fb1249f697bb5e2bb
W20260923 19:50:21.413029 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5ce73f31a1f64a24835a272fea8d65c4 consensus state has no leader
I20260923 19:50:21.415035 6459 ts_tablet_manager.cc:1950] T c504ec668a33451fb1249f697bb5e2bb P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:21.415776 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 889) took 1974 ms. Trace:
I20260923 19:50:21.416275 6459 rpcz_store.cc:276] 0923 19:50:19.440945 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.440996 (+ 51us) service_pool.cc:224] Handling call
0923 19:50:21.330056 (+1889060us) ts_tablet_manager.cc:1151] Deleting tablet c504ec668a33451fb1249f697bb5e2bb
0923 19:50:21.330067 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.342437 (+ 12370us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:21.409537 (+ 67100us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:21.415758 (+ 6221us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1888758}
W20260923 19:50:21.417582 5805 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ef0604c2a884465aab7bfe6a1d2d7da6 has no consensus state
I20260923 19:50:21.418648 6456 tablet_bootstrap.cc:492] T 658253ff3d014361803e1aeda978e59a P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:21.418838 6456 ts_tablet_manager.cc:1403] T 658253ff3d014361803e1aeda978e59a P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.064s user 0.005s sys 0.004s
I20260923 19:50:21.419688 6456 raft_consensus.cc:359] T 658253ff3d014361803e1aeda978e59a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.419895 6456 raft_consensus.cc:385] T 658253ff3d014361803e1aeda978e59a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:21.419986 6456 raft_consensus.cc:740] T 658253ff3d014361803e1aeda978e59a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:21.420226 6456 consensus_queue.cc:260] T 658253ff3d014361803e1aeda978e59a P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.420774 6456 ts_tablet_manager.cc:1434] T 658253ff3d014361803e1aeda978e59a P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:21.421336 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 890) took 1955 ms. Trace:
I20260923 19:50:21.422164 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet c504ec668a33451fb1249f697bb5e2bb (table default.Table_870cfa1b62c4442d866d3b9b1aec4bc7 [id=b8b525ace3444e3fb6548fb9f2064765]) successfully deleted
I20260923 19:50:21.422331 6459 rpcz_store.cc:276] 0923 19:50:19.465726 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.466001 (+ 275us) service_pool.cc:224] Handling call
0923 19:50:21.421195 (+1955194us) ts_tablet_manager.cc:1151] Deleting tablet 373d6442546d41e2b5567dfc92ae07b1
0923 19:50:21.421207 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.421315 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1954959}
W20260923 19:50:21.422864 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 373d6442546d41e2b5567dfc92ae07b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 373d6442546d41e2b5567dfc92ae07b1 already in progress: creating tablet
I20260923 19:50:21.422942 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 891) took 1899 ms. Trace:
I20260923 19:50:21.423017 6459 rpcz_store.cc:276] 0923 19:50:19.523344 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.523415 (+ 71us) service_pool.cc:224] Handling call
0923 19:50:21.422824 (+1899409us) ts_tablet_manager.cc:1151] Deleting tablet 94a6af2036ae47cfbbd0f6940b596218
0923 19:50:21.422834 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.422923 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1899162}
W20260923 19:50:21.424638 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 94a6af2036ae47cfbbd0f6940b596218 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 94a6af2036ae47cfbbd0f6940b596218 already in progress: creating tablet
I20260923 19:50:21.425681 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 892) took 1884 ms. Trace:
I20260923 19:50:21.425802 6459 rpcz_store.cc:276] 0923 19:50:19.541342 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.541399 (+ 57us) service_pool.cc:224] Handling call
0923 19:50:21.425551 (+1884152us) ts_tablet_manager.cc:1151] Deleting tablet 9ee02922d2be45f5a1473a53a6f253c4
0923 19:50:21.425564 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.425662 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1883974}
I20260923 19:50:21.409159 6457 tablet_bootstrap.cc:654] T f4313a4d8a9c411fad593b05ad655fc4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:21.426887 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 9ee02922d2be45f5a1473a53a6f253c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9ee02922d2be45f5a1473a53a6f253c4 already in progress: creating tablet
I20260923 19:50:21.427265 6461 ts_tablet_manager.cc:1929] T ba639d8c68cf49a49a5ec5729143cf6b P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:21.427414 6461 log.cc:1199] T ba639d8c68cf49a49a5ec5729143cf6b P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/ba639d8c68cf49a49a5ec5729143cf6b
I20260923 19:50:21.427464 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 893) took 1872 ms. Trace:
I20260923 19:50:21.427572 6459 rpcz_store.cc:276] 0923 19:50:19.555233 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.555291 (+ 58us) service_pool.cc:224] Handling call
0923 19:50:21.427348 (+1872057us) ts_tablet_manager.cc:1151] Deleting tablet f1157d983bdc42a4a98326154d5f4eb4
0923 19:50:21.427358 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.427444 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1871821}
W20260923 19:50:21.428140 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet f1157d983bdc42a4a98326154d5f4eb4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1157d983bdc42a4a98326154d5f4eb4 already in progress: creating tablet
I20260923 19:50:21.410070 6454 consensus_queue.cc:260] T b7ba284e81bc4388bbd6456a41d1f9f4 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.431566 7490 raft_consensus.cc:493] T 3d74560614b744188e759b981ad89a7d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:21.431728 7490 raft_consensus.cc:515] T 3d74560614b744188e759b981ad89a7d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.432469 7490 leader_election.cc:290] T 3d74560614b744188e759b981ad89a7d P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:21.434343 6279 leader_election.cc:343] T 3d74560614b744188e759b981ad89a7d P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 3d74560614b744188e759b981ad89a7d
I20260923 19:50:21.436694 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet f74e7cb3e5f54dfdb2280c795ce2ce53 (table default.Table_fb92f0dc809c49018d4300eaf32b6a8b [id=8325a8f159124a2da260e2be3ce69500]) successfully deleted
W20260923 19:50:21.437583 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet d689f30677c04fb880778d6723b1f5ac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d689f30677c04fb880778d6723b1f5ac already in progress: creating tablet
W20260923 19:50:21.438267 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 33a318872f6a4f838ed9f0c0260d4bfb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33a318872f6a4f838ed9f0c0260d4bfb already in progress: creating tablet
I20260923 19:50:21.438705 6456 tablet_bootstrap.cc:492] T f7cf45d4c4d3480288698682c1c85869 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:21.433569 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d74560614b744188e759b981ad89a7d" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:21.439859 6280 leader_election.cc:343] T 3d74560614b744188e759b981ad89a7d P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:21.439975 6280 leader_election.cc:304] T 3d74560614b744188e759b981ad89a7d P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:21.440359 7490 raft_consensus.cc:2749] T 3d74560614b744188e759b981ad89a7d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:21.440346 7629 raft_consensus.cc:493] T d04b3a9ade7a405bb619704095fac279 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:21.440487 7629 raft_consensus.cc:515] T d04b3a9ade7a405bb619704095fac279 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:21.441102 7629 leader_election.cc:290] T d04b3a9ade7a405bb619704095fac279 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:21.441746 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet ce42c5de0cd3435b85fcfca92d69cdd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce42c5de0cd3435b85fcfca92d69cdd5 already in progress: creating tablet
I20260923 19:50:21.442082 6458 tablet_replica.cc:333] T 6ac04be575704a69994f98e00411a254 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:21.442288 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d04b3a9ade7a405bb619704095fac279" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:21.442819 5996 leader_election.cc:343] T d04b3a9ade7a405bb619704095fac279 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:21.443503 6456 tablet_bootstrap.cc:654] T f7cf45d4c4d3480288698682c1c85869 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:21.441146 6454 ts_tablet_manager.cc:1434] T b7ba284e81bc4388bbd6456a41d1f9f4 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.035s user 0.002s sys 0.000s
I20260923 19:50:21.442698 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d04b3a9ade7a405bb619704095fac279" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:21.444454 6454 tablet_bootstrap.cc:492] T ad29d22a82434023991ffcacf7f9bee5 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:21.442306 6458 raft_consensus.cc:2243] T 6ac04be575704a69994f98e00411a254 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:21.445050 6458 raft_consensus.cc:2272] T 6ac04be575704a69994f98e00411a254 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:21.445617 6458 ts_tablet_manager.cc:1916] T 6ac04be575704a69994f98e00411a254 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:21.446358 6454 tablet_bootstrap.cc:654] T ad29d22a82434023991ffcacf7f9bee5 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:21.445019 5995 leader_election.cc:343] T d04b3a9ade7a405bb619704095fac279 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:21.447160 5995 leader_election.cc:304] T d04b3a9ade7a405bb619704095fac279 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:21.448388 7629 raft_consensus.cc:2749] T d04b3a9ade7a405bb619704095fac279 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:21.450106 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_31f03213b57f4ae88e77e571772547cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:21.451839 6459 tablet_replica.cc:333] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:21.452075 6459 raft_consensus.cc:2243] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:21.452435 6459 pending_rounds.cc:70] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:21.452540 6459 pending_rounds.cc:77] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630610614751232 op_type: NO_OP noop_request { }
I20260923 19:50:21.452657 6459 raft_consensus.cc:2889] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:21.452755 6459 raft_consensus.cc:2272] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:21.452809 6461 ts_tablet_manager.cc:1950] T ba639d8c68cf49a49a5ec5729143cf6b P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:21.399708 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 92f94b93d1364bb1a2562eb577707cf1 (table default.Table_da77a1d14aed4fba88200eb53fd16559 [id=54986bca912743be8c7e5bcb2627d151]) successfully deleted
W20260923 19:50:21.453125 5790 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.5.143.193:39887, user_credentials={real_user=slave}} blocked reactor thread for 53443.8us
I20260923 19:50:21.453330 6459 ts_tablet_manager.cc:1916] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:21.453402 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 373d6442546d41e2b5567dfc92ae07b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 373d6442546d41e2b5567dfc92ae07b1 already in progress: creating tablet
W20260923 19:50:21.453605 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 94a6af2036ae47cfbbd0f6940b596218 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 94a6af2036ae47cfbbd0f6940b596218 already in progress: creating tablet
W20260923 19:50:21.453804 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 9ee02922d2be45f5a1473a53a6f253c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9ee02922d2be45f5a1473a53a6f253c4 already in progress: creating tablet
W20260923 19:50:21.454027 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet f1157d983bdc42a4a98326154d5f4eb4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1157d983bdc42a4a98326154d5f4eb4 already in progress: creating tablet
I20260923 19:50:21.454795 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 912) took 1880 ms. Trace:
W20260923 19:50:21.450306 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_54827ad1f0b04f789fc2533c59d86cd2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:21.450412 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6de7a682db5a4865b1c680cc672761ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:21.456259 7740 tablet.cc:1751] T 85b7dcf131c54187a6e61f8503c797f8 P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:21.459918 6461 rpcz_store.cc:276] 0923 19:50:19.574265 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.574321 (+ 56us) service_pool.cc:224] Handling call
0923 19:50:21.385514 (+1811193us) ts_tablet_manager.cc:1151] Deleting tablet ba639d8c68cf49a49a5ec5729143cf6b
0923 19:50:21.385522 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.389723 (+ 4201us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:21.427179 (+ 37456us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:21.454774 (+ 27595us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1810985}
I20260923 19:50:21.460410 6456 tablet_bootstrap.cc:492] T f7cf45d4c4d3480288698682c1c85869 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:21.460680 6456 ts_tablet_manager.cc:1403] T f7cf45d4c4d3480288698682c1c85869 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.002s
I20260923 19:50:21.461410 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 914) took 1638 ms. Trace:
I20260923 19:50:21.461565 6461 rpcz_store.cc:276] 0923 19:50:19.822896 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.831150 (+ 8254us) service_pool.cc:224] Handling call
0923 19:50:21.461241 (+1630091us) ts_tablet_manager.cc:1151] Deleting tablet 9603acbedc27465eab5a8146fed41587
0923 19:50:21.461256 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.461389 (+ 133us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1629804}
I20260923 19:50:21.462002 6461 tablet_replica.cc:333] T 3c713a0973dc45debf61c228a4bf13bf P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:21.462045 6456 raft_consensus.cc:359] T f7cf45d4c4d3480288698682c1c85869 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.462364 6456 raft_consensus.cc:385] T f7cf45d4c4d3480288698682c1c85869 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:21.462487 6456 raft_consensus.cc:740] T f7cf45d4c4d3480288698682c1c85869 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:21.462790 6461 raft_consensus.cc:2243] T 3c713a0973dc45debf61c228a4bf13bf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:21.462908 6456 consensus_queue.cc:260] T f7cf45d4c4d3480288698682c1c85869 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.463750 6456 ts_tablet_manager.cc:1434] T f7cf45d4c4d3480288698682c1c85869 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:50:21.458243 6457 tablet_bootstrap.cc:492] T f4313a4d8a9c411fad593b05ad655fc4 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:21.467666 6461 raft_consensus.cc:2272] T 3c713a0973dc45debf61c228a4bf13bf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:21.467823 6457 ts_tablet_manager.cc:1403] T f4313a4d8a9c411fad593b05ad655fc4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.060s user 0.003s sys 0.002s
I20260923 19:50:21.469444 6457 raft_consensus.cc:359] T f4313a4d8a9c411fad593b05ad655fc4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:21.470690 6457 raft_consensus.cc:385] T f4313a4d8a9c411fad593b05ad655fc4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:21.470890 6457 raft_consensus.cc:740] T f4313a4d8a9c411fad593b05ad655fc4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:21.471302 6457 consensus_queue.cc:260] T f4313a4d8a9c411fad593b05ad655fc4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:21.472281 6457 ts_tablet_manager.cc:1434] T f4313a4d8a9c411fad593b05ad655fc4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260923 19:50:21.472869 6457 tablet_bootstrap.cc:492] T f2799563250845b0b9d7d51b2367b16b P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:21.474852 6197 raft_consensus.cc:3060] T ed9fb0cab0bd43b7a05d7376125b187e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:21.475685 6456 tablet_bootstrap.cc:492] T fc151f4d78344efeada6d6e57af6eb9f P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:21.477427 6456 tablet_bootstrap.cc:654] T fc151f4d78344efeada6d6e57af6eb9f P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:21.477602 6461 ts_tablet_manager.cc:1916] T 3c713a0973dc45debf61c228a4bf13bf P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:21.479918 5805 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_1b26a697bf2a472995a21b28dc49a95f" } modify_external_catalogs: true
I20260923 19:50:21.480180 5805 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_1b26a697bf2a472995a21b28dc49a95f" } modify_external_catalogs: true
I20260923 19:50:21.481626 5798 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_9731ebe308dc4f34b1ad1b7bc1e8400b" } modify_external_catalogs: true
I20260923 19:50:21.481892 5798 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_9731ebe308dc4f34b1ad1b7bc1e8400b" } modify_external_catalogs: true
I20260923 19:50:21.482508 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_abc53c33a5f040e4b0d0367e7645d8f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:21.483335 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_8cd7b83d22794bc290a8d894a419250e" } new_table_name: "default.Table_2d809ca6c38141d3925103559da733ac" modify_external_catalogs: true
W20260923 19:50:21.491684 5800 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ff459c95d95746ccb2a931fdf6e28c57 consensus state has no leader
I20260923 19:50:21.492954 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_47d7836791f342e388fe773ca65aa4ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:21.493906 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_953f199da73c4745bc4d081e87c55973"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:21.494238 6454 tablet_bootstrap.cc:492] T ad29d22a82434023991ffcacf7f9bee5 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:21.494418 6454 ts_tablet_manager.cc:1403] T ad29d22a82434023991ffcacf7f9bee5 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.050s user 0.004s sys 0.003s
I20260923 19:50:21.495100 6454 raft_consensus.cc:359] T ad29d22a82434023991ffcacf7f9bee5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.495332 6454 raft_consensus.cc:385] T ad29d22a82434023991ffcacf7f9bee5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:21.495434 6454 raft_consensus.cc:740] T ad29d22a82434023991ffcacf7f9bee5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:21.495726 6454 consensus_queue.cc:260] T ad29d22a82434023991ffcacf7f9bee5 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.496395 6454 ts_tablet_manager.cc:1434] T ad29d22a82434023991ffcacf7f9bee5 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:21.500620 6454 tablet_bootstrap.cc:492] T a75c4436a67f453e973a7a7645de79b1 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:21.501407 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_c8b250416a5b4e08a25804b2aea8c0f8" } modify_external_catalogs: true
I20260923 19:50:21.503749 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_c8b250416a5b4e08a25804b2aea8c0f8" } modify_external_catalogs: true
I20260923 19:50:21.505340 6454 tablet_bootstrap.cc:654] T a75c4436a67f453e973a7a7645de79b1 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:21.509033 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_47d7836791f342e388fe773ca65aa4ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:21.510108 7700 raft_consensus.cc:493] T d6d3601a392f4723b4ca00f6e12b950c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:21.510245 7700 raft_consensus.cc:515] T d6d3601a392f4723b4ca00f6e12b950c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.510854 7700 leader_election.cc:290] T d6d3601a392f4723b4ca00f6e12b950c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:21.512005 6137 leader_election.cc:343] T d6d3601a392f4723b4ca00f6e12b950c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: d6d3601a392f4723b4ca00f6e12b950c
W20260923 19:50:21.512079 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_abc53c33a5f040e4b0d0367e7645d8f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:21.513068 6139 leader_election.cc:343] T d6d3601a392f4723b4ca00f6e12b950c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: d6d3601a392f4723b4ca00f6e12b950c
I20260923 19:50:21.513172 6139 leader_election.cc:304] T d6d3601a392f4723b4ca00f6e12b950c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:21.513602 7700 raft_consensus.cc:2749] T d6d3601a392f4723b4ca00f6e12b950c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:21.499455 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet ba639d8c68cf49a49a5ec5729143cf6b (table default.Table_53cf6ab2721c4d7baa36065c8d48ffc1 [id=d4cdad465f1a405e8723d0dcb01e0508]) successfully deleted
W20260923 19:50:21.518445 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 9603acbedc27465eab5a8146fed41587 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9603acbedc27465eab5a8146fed41587 already in progress: creating tablet
I20260923 19:50:21.518955 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_833ecfe514c54532bb2adee3323149cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:21.519605 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_833ecfe514c54532bb2adee3323149cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:21.520946 6454 tablet_bootstrap.cc:492] T a75c4436a67f453e973a7a7645de79b1 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:21.521114 6454 ts_tablet_manager.cc:1403] T a75c4436a67f453e973a7a7645de79b1 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.021s user 0.006s sys 0.000s
W20260923 19:50:21.521659 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_953f199da73c4745bc4d081e87c55973 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:21.521781 6454 raft_consensus.cc:359] T a75c4436a67f453e973a7a7645de79b1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.522541 6454 raft_consensus.cc:385] T a75c4436a67f453e973a7a7645de79b1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:21.522884 6454 raft_consensus.cc:740] T a75c4436a67f453e973a7a7645de79b1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:21.523324 6454 consensus_queue.cc:260] T a75c4436a67f453e973a7a7645de79b1 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.524120 6454 ts_tablet_manager.cc:1434] T a75c4436a67f453e973a7a7645de79b1 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260923 19:50:21.525038 6454 tablet_bootstrap.cc:492] T 6d29923f139445cc86379c80ac15df5d P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:21.525627 6024 tablet_service.cc:1558] Processing DeleteTablet for tablet d04b3a9ade7a405bb619704095fac279 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:07 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:21.527426 6024 tablet_service.cc:1558] Processing DeleteTablet for tablet 22c89609da884c47b1dbc1470b37efbe with delete_type TABLET_DATA_DELETED (replaced by tablet 295502f94faf4d4880e9516aa8d9cb79) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:21.529184 6024 tablet_service.cc:1558] Processing DeleteTablet for tablet f8007918eca14c81947e5999fe13a705 with delete_type TABLET_DATA_DELETED (replaced by tablet 75958985ee414a5a9907ec0c7dece252) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:21.530840 6454 tablet_bootstrap.cc:654] T 6d29923f139445cc86379c80ac15df5d P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:21.531956 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_57f19c72a7cd4e4d8288370ebcb5c9db" } modify_external_catalogs: true
I20260923 19:50:21.532226 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_57f19c72a7cd4e4d8288370ebcb5c9db" } modify_external_catalogs: true
I20260923 19:50:21.542467 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_9f02b4ba2e1244108432e0996acc51df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:21.543220 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f02b4ba2e1244108432e0996acc51df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:21.543277 6458 ts_tablet_manager.cc:1929] T 6ac04be575704a69994f98e00411a254 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:21.543483 6458 log.cc:1199] T 6ac04be575704a69994f98e00411a254 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/6ac04be575704a69994f98e00411a254
I20260923 19:50:21.543941 6458 ts_tablet_manager.cc:1950] T 6ac04be575704a69994f98e00411a254 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:21.545400 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 6ac04be575704a69994f98e00411a254 (table default.Table_346160aa15ec4313947a6b9f256cea06 [id=cefd3af14e2148c19281df9e59f07421]) successfully deleted
I20260923 19:50:21.545432 6458 tablet_replica.cc:333] T 3d74560614b744188e759b981ad89a7d P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:21.545655 6458 raft_consensus.cc:2243] T 3d74560614b744188e759b981ad89a7d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:21.546146 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_b8d3e92566e743de973df105d81e91bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:21.546975 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b8d3e92566e743de973df105d81e91bc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:21.549700 6197 raft_consensus.cc:3060] T ad29d22a82434023991ffcacf7f9bee5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:21.550252 7629 raft_consensus.cc:493] T f8007918eca14c81947e5999fe13a705 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:21.550369 7629 raft_consensus.cc:515] T f8007918eca14c81947e5999fe13a705 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:21.551052 7629 leader_election.cc:290] T f8007918eca14c81947e5999fe13a705 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:21.555155 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8007918eca14c81947e5999fe13a705" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:21.555384 6459 ts_tablet_manager.cc:1929] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:21.555477 6459 log.cc:1199] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/9be4c46ee8eb4dbaad01d492b701a9e0
I20260923 19:50:21.556540 6457 tablet_bootstrap.cc:654] T f2799563250845b0b9d7d51b2367b16b P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:21.564821 7629 raft_consensus.cc:493] T 22c89609da884c47b1dbc1470b37efbe P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:21.565014 7629 raft_consensus.cc:515] T 22c89609da884c47b1dbc1470b37efbe P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:21.569769 7629 leader_election.cc:290] T 22c89609da884c47b1dbc1470b37efbe P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:21.553293 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8007918eca14c81947e5999fe13a705" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:21.570604 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c89609da884c47b1dbc1470b37efbe" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:21.575065 6458 raft_consensus.cc:2272] T 3d74560614b744188e759b981ad89a7d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:21.575683 6458 ts_tablet_manager.cc:1916] T 3d74560614b744188e759b981ad89a7d P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:21.581801 5797 catalog_manager.cc:5838] T 34d62ab3d4aa457f8fea283cd9248a41 P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:21.582329 5797 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 34d62ab3d4aa457f8fea283cd9248a41 (table default.Table_71d7f590efb94aae8c345f9d9a620fc1 [id=b4e8e3f2a48a4b5496f506080b415805]). Expected version 1 got 0
W20260923 19:50:21.558766 5995 leader_election.cc:343] T f8007918eca14c81947e5999fe13a705 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:21.588585 5996 leader_election.cc:343] T f8007918eca14c81947e5999fe13a705 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:21.588881 5996 leader_election.cc:304] T f8007918eca14c81947e5999fe13a705 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
W20260923 19:50:21.589425 5996 leader_election.cc:343] T 22c89609da884c47b1dbc1470b37efbe P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:21.590652 7629 raft_consensus.cc:2749] T f8007918eca14c81947e5999fe13a705 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:21.594822 5804 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet ad29d22a82434023991ffcacf7f9bee5 (table default.Table_0eb28975495e4bedaf7c538454e525f6 [id=ea52a2330cd643e486e5b348dabbd295]). Expected version 1 got 0
I20260923 19:50:21.598933 6456 tablet_bootstrap.cc:492] T fc151f4d78344efeada6d6e57af6eb9f P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:21.599077 6456 ts_tablet_manager.cc:1403] T fc151f4d78344efeada6d6e57af6eb9f P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.123s user 0.013s sys 0.008s
I20260923 19:50:21.600857 6456 raft_consensus.cc:359] T fc151f4d78344efeada6d6e57af6eb9f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.601156 6456 raft_consensus.cc:385] T fc151f4d78344efeada6d6e57af6eb9f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:21.601231 6456 raft_consensus.cc:740] T fc151f4d78344efeada6d6e57af6eb9f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:21.601794 6456 consensus_queue.cc:260] T fc151f4d78344efeada6d6e57af6eb9f P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.580519 7700 raft_consensus.cc:493] T 6ac04be575704a69994f98e00411a254 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:21.604637 7700 raft_consensus.cc:515] T 6ac04be575704a69994f98e00411a254 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.604952 6459 ts_tablet_manager.cc:1950] T 9be4c46ee8eb4dbaad01d492b701a9e0 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:21.605309 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 894) took 1948 ms. Trace:
I20260923 19:50:21.605341 7700 leader_election.cc:290] T 6ac04be575704a69994f98e00411a254 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:21.605386 6459 rpcz_store.cc:276] 0923 19:50:19.657255 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.657307 (+ 52us) service_pool.cc:224] Handling call
0923 19:50:21.451776 (+1794469us) ts_tablet_manager.cc:1151] Deleting tablet 9be4c46ee8eb4dbaad01d492b701a9e0
0923 19:50:21.451789 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.551718 (+ 99929us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:21.555341 (+ 3623us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:21.605282 (+ 49941us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1794292}
I20260923 19:50:21.605845 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 897) took 1773 ms. Trace:
I20260923 19:50:21.605958 6459 rpcz_store.cc:276] 0923 19:50:19.832006 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.832061 (+ 55us) service_pool.cc:224] Handling call
0923 19:50:21.605711 (+1773650us) ts_tablet_manager.cc:1151] Deleting tablet 9603acbedc27465eab5a8146fed41587
0923 19:50:21.605721 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.605829 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1773394}
I20260923 19:50:21.591656 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet 22e37d5afa8047989928596b4092c4b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:21.606302 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 900) took 1685 ms. Trace:
I20260923 19:50:21.606367 6459 rpcz_store.cc:276] 0923 19:50:19.921101 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.921950 (+ 849us) service_pool.cc:224] Handling call
0923 19:50:21.606204 (+1684254us) ts_tablet_manager.cc:1151] Deleting tablet 5bc33295d8684e8583508124a8db5b8a
0923 19:50:21.606213 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.606285 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1684004}
W20260923 19:50:21.606619 6139 leader_election.cc:343] T 6ac04be575704a69994f98e00411a254 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 6ac04be575704a69994f98e00411a254
I20260923 19:50:21.606711 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 901) took 1678 ms. Trace:
I20260923 19:50:21.606776 6459 rpcz_store.cc:276] 0923 19:50:19.928210 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.928333 (+ 123us) service_pool.cc:224] Handling call
0923 19:50:21.606621 (+1678288us) ts_tablet_manager.cc:1151] Deleting tablet 3c713a0973dc45debf61c228a4bf13bf
0923 19:50:21.606629 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.606697 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1678078}
I20260923 19:50:21.607093 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 909) took 1545 ms. Trace:
I20260923 19:50:21.607187 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac04be575704a69994f98e00411a254" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:21.607157 6459 rpcz_store.cc:276] 0923 19:50:20.061231 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:20.061442 (+ 211us) service_pool.cc:224] Handling call
0923 19:50:21.606992 (+1545550us) ts_tablet_manager.cc:1151] Deleting tablet 242a63d6282f435aa94fb4307c15ca8a
0923 19:50:21.607001 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.607067 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1545318}
I20260923 19:50:21.607971 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 910) took 1546 ms. Trace:
I20260923 19:50:21.613783 6456 ts_tablet_manager.cc:1434] T fc151f4d78344efeada6d6e57af6eb9f P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.015s user 0.004s sys 0.000s
I20260923 19:50:21.614363 6456 tablet_bootstrap.cc:492] T e6e04d16675443fc923a5f8216e292b6 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:21.597429 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet a75c4436a67f453e973a7a7645de79b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:21.597864 6169 tablet_service.cc:1558] Processing DeleteTablet for tablet 035abecfbee7474d9dd048f35e28e867 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:07 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:21.598287 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet b7ba284e81bc4388bbd6456a41d1f9f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:21.608024 6137 leader_election.cc:304] T 6ac04be575704a69994f98e00411a254 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:21.615168 7700 raft_consensus.cc:2749] T 6ac04be575704a69994f98e00411a254 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:21.591755 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c89609da884c47b1dbc1470b37efbe" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:21.615753 6459 rpcz_store.cc:276] 0923 19:50:20.061379 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:20.061707 (+ 328us) service_pool.cc:224] Handling call
0923 19:50:21.607800 (+1546093us) ts_tablet_manager.cc:1151] Deleting tablet a2a793179a6a48cc9e9c2f0da9231416
0923 19:50:21.607816 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.607947 (+ 131us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1545845}
I20260923 19:50:21.616178 6459 tablet_replica.cc:333] T e4f00490b0364f0e9f1b9569b870808e P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:21.618959 6461 ts_tablet_manager.cc:1929] T 3c713a0973dc45debf61c228a4bf13bf P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:21.619169 6461 log.cc:1199] T 3c713a0973dc45debf61c228a4bf13bf P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/3c713a0973dc45debf61c228a4bf13bf
I20260923 19:50:21.619572 6461 ts_tablet_manager.cc:1950] T 3c713a0973dc45debf61c228a4bf13bf P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:21.621065 6456 tablet_bootstrap.cc:654] T e6e04d16675443fc923a5f8216e292b6 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:21.627206 6459 raft_consensus.cc:2243] T e4f00490b0364f0e9f1b9569b870808e P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:21.627422 6459 raft_consensus.cc:2272] T e4f00490b0364f0e9f1b9569b870808e P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:21.627993 6459 ts_tablet_manager.cc:1916] T e4f00490b0364f0e9f1b9569b870808e P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:21.624444 6457 tablet_bootstrap.cc:492] T f2799563250845b0b9d7d51b2367b16b P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:21.632777 6457 ts_tablet_manager.cc:1403] T f2799563250845b0b9d7d51b2367b16b P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.160s user 0.004s sys 0.004s
I20260923 19:50:21.633602 6457 raft_consensus.cc:359] T f2799563250845b0b9d7d51b2367b16b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:21.633786 6457 raft_consensus.cc:385] T f2799563250845b0b9d7d51b2367b16b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:21.633834 6457 raft_consensus.cc:740] T f2799563250845b0b9d7d51b2367b16b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:21.634277 6457 consensus_queue.cc:260] T f2799563250845b0b9d7d51b2367b16b P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:21.635146 6454 tablet_bootstrap.cc:492] T 6d29923f139445cc86379c80ac15df5d P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:21.635342 6454 ts_tablet_manager.cc:1403] T 6d29923f139445cc86379c80ac15df5d P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.110s user 0.004s sys 0.026s
I20260923 19:50:21.636109 6454 raft_consensus.cc:359] T 6d29923f139445cc86379c80ac15df5d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.636369 6454 raft_consensus.cc:385] T 6d29923f139445cc86379c80ac15df5d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:21.636533 6454 raft_consensus.cc:740] T 6d29923f139445cc86379c80ac15df5d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:21.637722 6454 consensus_queue.cc:260] T 6d29923f139445cc86379c80ac15df5d P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.638145 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 9be4c46ee8eb4dbaad01d492b701a9e0 (table default.Table_bb91666519bc41aaaf1fc7f8e8b26691 [id=1b974d4dff8c4868947a4d7765208c97]) successfully deleted
W20260923 19:50:21.638496 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 9603acbedc27465eab5a8146fed41587 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9603acbedc27465eab5a8146fed41587 already in progress: creating tablet
W20260923 19:50:21.638816 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 5bc33295d8684e8583508124a8db5b8a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5bc33295d8684e8583508124a8db5b8a already in progress: creating tablet
I20260923 19:50:21.638890 6454 ts_tablet_manager.cc:1434] T 6d29923f139445cc86379c80ac15df5d P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
W20260923 19:50:21.639117 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 3c713a0973dc45debf61c228a4bf13bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3c713a0973dc45debf61c228a4bf13bf already in progress: creating tablet
W20260923 19:50:21.639379 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 242a63d6282f435aa94fb4307c15ca8a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 242a63d6282f435aa94fb4307c15ca8a already in progress: creating tablet
W20260923 19:50:21.639616 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet a2a793179a6a48cc9e9c2f0da9231416 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a2a793179a6a48cc9e9c2f0da9231416 already in progress: creating tablet
I20260923 19:50:21.639771 6454 tablet_bootstrap.cc:492] T a01a86b6fd4b44d3808c2040525d7b61 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
W20260923 19:50:21.640461 5995 leader_election.cc:343] T 22c89609da884c47b1dbc1470b37efbe P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:21.640702 5995 leader_election.cc:304] T 22c89609da884c47b1dbc1470b37efbe P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:21.641112 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_16d436ca05ae40009afbe715675bdd6e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:21.641793 7629 raft_consensus.cc:2749] T 22c89609da884c47b1dbc1470b37efbe P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:21.642496 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_16d436ca05ae40009afbe715675bdd6e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:21.643005 6454 tablet_bootstrap.cc:654] T a01a86b6fd4b44d3808c2040525d7b61 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:21.645069 6456 tablet_bootstrap.cc:492] T e6e04d16675443fc923a5f8216e292b6 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:21.645268 6456 ts_tablet_manager.cc:1403] T e6e04d16675443fc923a5f8216e292b6 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.031s user 0.005s sys 0.002s
I20260923 19:50:21.646158 6456 raft_consensus.cc:359] T e6e04d16675443fc923a5f8216e292b6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.646392 6456 raft_consensus.cc:385] T e6e04d16675443fc923a5f8216e292b6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:21.646488 6456 raft_consensus.cc:740] T e6e04d16675443fc923a5f8216e292b6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:21.646741 6456 consensus_queue.cc:260] T e6e04d16675443fc923a5f8216e292b6 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.647285 6456 ts_tablet_manager.cc:1434] T e6e04d16675443fc923a5f8216e292b6 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:21.648524 6457 ts_tablet_manager.cc:1434] T f2799563250845b0b9d7d51b2367b16b P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260923 19:50:21.648851 6457 tablet_bootstrap.cc:492] T a263c0fc71424999b76ef01de9a51eda P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:21.650511 6457 tablet_bootstrap.cc:654] T a263c0fc71424999b76ef01de9a51eda P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:21.655853 6024 tablet_service.cc:1558] Processing DeleteTablet for tablet 688bb1055ba94c2996cdfea6dea76416 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:21.656302 6024 tablet_service.cc:1558] Processing DeleteTablet for tablet f4313a4d8a9c411fad593b05ad655fc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:21.658897 6306 tablet_service.cc:1558] Processing DeleteTablet for tablet 83dba06b0d0040889015fb052c642ec0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:21.659466 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet a926ff092e6e495e981be156421e8d72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:21.660707 6456 tablet_bootstrap.cc:492] T a10d35bf564d45488524d3d21721f4e5 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:21.666230 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet b87872fb6cc0400c86eddffb29c898e8 with delete_type TABLET_DATA_DELETED (replaced by tablet 37769256de33432697e9d4fb235f473f) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:21.647957 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d29923f139445cc86379c80ac15df5d with delete_type TABLET_DATA_DELETED (replaced by tablet 25a1122a9ed44525b53752f230b875af) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:21.667752 6306 tablet_service.cc:1558] Processing DeleteTablet for tablet 658253ff3d014361803e1aeda978e59a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:21.668308 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet f7cf45d4c4d3480288698682c1c85869 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:21.668716 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet e6e04d16675443fc923a5f8216e292b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:21.668865 5804 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_e68b828ba396413d8284d20c9047243c" } new_table_name: "default.Table_6a4a51075689459f805ac5399bf884a6" modify_external_catalogs: true
I20260923 19:50:21.669405 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet fc151f4d78344efeada6d6e57af6eb9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:21.670481 5797 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_20d2e475e3e744f99e0ab5cd2f094310" } new_table_name: "default.Table_09ab38c318f44fd396ce20d52024e4cb" modify_external_catalogs: true
I20260923 19:50:21.672529 6456 tablet_bootstrap.cc:654] T a10d35bf564d45488524d3d21721f4e5 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:21.678771 7775 raft_consensus.cc:493] T 2e1c19a751904a6295897376e9c5ee56 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:21.678992 7775 raft_consensus.cc:515] T 2e1c19a751904a6295897376e9c5ee56 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:21.679766 7775 leader_election.cc:290] T 2e1c19a751904a6295897376e9c5ee56 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:21.680336 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1c19a751904a6295897376e9c5ee56" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:21.680888 5995 leader_election.cc:343] T 2e1c19a751904a6295897376e9c5ee56 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:21.681429 5700 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 58848.2us
I20260923 19:50:21.681532 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 5c9768e71e0640ceb110a19e53484044
I20260923 19:50:21.682969 6458 ts_tablet_manager.cc:1929] T 3d74560614b744188e759b981ad89a7d P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:21.683065 6458 log.cc:1199] T 3d74560614b744188e759b981ad89a7d P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/3d74560614b744188e759b981ad89a7d
I20260923 19:50:21.683355 6458 ts_tablet_manager.cc:1950] T 3d74560614b744188e759b981ad89a7d P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:21.685114 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_6a2816b94a404ecfb0b24bd5bddc4a51" } new_table_name: "default.Table_3075031ad0a941ad8028a6c58b5084bc" modify_external_catalogs: true
I20260923 19:50:21.685520 6457 tablet_bootstrap.cc:492] T a263c0fc71424999b76ef01de9a51eda P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:21.685705 6457 ts_tablet_manager.cc:1403] T a263c0fc71424999b76ef01de9a51eda P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.037s user 0.000s sys 0.002s
I20260923 19:50:21.686537 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_0acd2ce4479c42c698a11f94b972a715" } new_table_name: "default.Table_f11dfe10dc5d494892d01fa19f92fdd4" modify_external_catalogs: true
I20260923 19:50:21.686860 6457 raft_consensus.cc:359] T a263c0fc71424999b76ef01de9a51eda P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:21.687093 6457 raft_consensus.cc:385] T a263c0fc71424999b76ef01de9a51eda P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:21.687192 6457 raft_consensus.cc:740] T a263c0fc71424999b76ef01de9a51eda P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:21.687497 6457 consensus_queue.cc:260] T a263c0fc71424999b76ef01de9a51eda P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:21.688015 6457 ts_tablet_manager.cc:1434] T a263c0fc71424999b76ef01de9a51eda P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260923 19:50:21.688338 5799 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 96577a68f4984c90b82cf4d32e701476
I20260923 19:50:21.689180 7775 raft_consensus.cc:493] T f2799563250845b0b9d7d51b2367b16b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:21.689374 7775 raft_consensus.cc:515] T f2799563250845b0b9d7d51b2367b16b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:21.690035 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e1c19a751904a6295897376e9c5ee56" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:21.690687 5996 leader_election.cc:343] T 2e1c19a751904a6295897376e9c5ee56 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:21.690881 5996 leader_election.cc:304] T 2e1c19a751904a6295897376e9c5ee56 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:21.691150 5799 catalog_manager.cc:6934] ReplaceTablet: tablet 96577a68f4984c90b82cf4d32e701476 deleted and replaced by tablet 0500d198ec2d483f99c7dfb291323f11
I20260923 19:50:21.691357 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2799563250845b0b9d7d51b2367b16b" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:21.691579 7629 raft_consensus.cc:2749] T 2e1c19a751904a6295897376e9c5ee56 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:21.691547 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_a664d00b589243eeb2c9fb5047b870fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:21.692276 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a664d00b589243eeb2c9fb5047b870fa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:21.694639 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c9768e71e0640ceb110a19e53484044 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:21 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:21.694710 6306 tablet_service.cc:1558] Processing DeleteTablet for tablet 96577a68f4984c90b82cf4d32e701476 with delete_type TABLET_DATA_DELETED (replaced by tablet 0500d198ec2d483f99c7dfb291323f11) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:21.692103 5995 leader_election.cc:343] T f2799563250845b0b9d7d51b2367b16b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:21.690735 7775 leader_election.cc:290] T f2799563250845b0b9d7d51b2367b16b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:21.695335 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2799563250845b0b9d7d51b2367b16b" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:21.696342 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 918) took 1767 ms. Trace:
W20260923 19:50:21.696712 5996 leader_election.cc:343] T f2799563250845b0b9d7d51b2367b16b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:21.696830 5996 leader_election.cc:304] T f2799563250845b0b9d7d51b2367b16b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:21.696460 6461 rpcz_store.cc:276] 0923 19:50:19.929040 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.929096 (+ 56us) service_pool.cc:224] Handling call
0923 19:50:21.461863 (+1532767us) ts_tablet_manager.cc:1151] Deleting tablet 3c713a0973dc45debf61c228a4bf13bf
0923 19:50:21.461965 (+ 102us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.596233 (+134268us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:21.618894 (+ 22661us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:21.696304 (+ 77410us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1532555}
I20260923 19:50:21.697630 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 917) took 1777 ms. Trace:
I20260923 19:50:21.697738 6461 rpcz_store.cc:276] 0923 19:50:19.920092 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.931104 (+ 11012us) service_pool.cc:224] Handling call
0923 19:50:21.697454 (+1766350us) ts_tablet_manager.cc:1151] Deleting tablet 5bc33295d8684e8583508124a8db5b8a
0923 19:50:21.697478 (+ 24us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.697591 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1766133}
I20260923 19:50:21.698161 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 926) took 1638 ms. Trace:
I20260923 19:50:21.698266 6461 rpcz_store.cc:276] 0923 19:50:20.059235 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:20.059469 (+ 234us) service_pool.cc:224] Handling call
0923 19:50:21.698013 (+1638544us) ts_tablet_manager.cc:1151] Deleting tablet 242a63d6282f435aa94fb4307c15ca8a
0923 19:50:21.698037 (+ 24us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.698123 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1638345}
I20260923 19:50:21.697751 7775 raft_consensus.cc:2749] T f2799563250845b0b9d7d51b2367b16b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:21.699959 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet ab81b40554e2411780ecfe12ef4a8f7d
I20260923 19:50:21.700788 6306 tablet_service.cc:1558] Processing DeleteTablet for tablet ab81b40554e2411780ecfe12ef4a8f7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:21 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:21.702615 6454 tablet_bootstrap.cc:492] T a01a86b6fd4b44d3808c2040525d7b61 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:21.702751 6454 ts_tablet_manager.cc:1403] T a01a86b6fd4b44d3808c2040525d7b61 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.063s user 0.006s sys 0.006s
I20260923 19:50:21.703552 6454 raft_consensus.cc:359] T a01a86b6fd4b44d3808c2040525d7b61 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.703708 6454 raft_consensus.cc:385] T a01a86b6fd4b44d3808c2040525d7b61 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:21.703759 6454 raft_consensus.cc:740] T a01a86b6fd4b44d3808c2040525d7b61 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:21.704836 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 3d74560614b744188e759b981ad89a7d (table default.Table_ca447ba1a2d04e7ab8954432c4a42c97 [id=7a040306f6064b3d8d10bdb87ab32247]) successfully deleted
I20260923 19:50:21.704721 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 927) took 1645 ms. Trace:
I20260923 19:50:21.704977 6461 rpcz_store.cc:276] 0923 19:50:20.059402 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:20.059714 (+ 312us) service_pool.cc:224] Handling call
0923 19:50:21.698490 (+1638776us) ts_tablet_manager.cc:1151] Deleting tablet a2a793179a6a48cc9e9c2f0da9231416
0923 19:50:21.701915 (+ 3425us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.704655 (+ 2740us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1638632}
I20260923 19:50:21.705164 6458 tablet_replica.cc:333] T 6238d16b1be74dd88fd2e089fbd85d33 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:21.705343 6458 raft_consensus.cc:2243] T 6238d16b1be74dd88fd2e089fbd85d33 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:21.705497 6458 raft_consensus.cc:2272] T 6238d16b1be74dd88fd2e089fbd85d33 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:21.704171 6454 consensus_queue.cc:260] T a01a86b6fd4b44d3808c2040525d7b61 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.709498 6457 tablet_bootstrap.cc:492] T 9ee02922d2be45f5a1473a53a6f253c4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:21.711403 6457 tablet_bootstrap.cc:654] T 9ee02922d2be45f5a1473a53a6f253c4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:21.714488 6454 ts_tablet_manager.cc:1434] T a01a86b6fd4b44d3808c2040525d7b61 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260923 19:50:21.718124 6458 ts_tablet_manager.cc:1916] T 6238d16b1be74dd88fd2e089fbd85d33 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:21.719909 6454 tablet_bootstrap.cc:492] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:21.721666 6454 tablet_bootstrap.cc:654] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:21.730026 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet ab81b40554e2411780ecfe12ef4a8f7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:21 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:21.730337 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 3c713a0973dc45debf61c228a4bf13bf (table default.Table_9acef25c391f4b8c9354ebc2c0a70c81 [id=7a872158deeb4117ba99842f7878ec46]) successfully deleted
I20260923 19:50:21.711679 6461 tablet_replica.cc:333] T ea2ef507c6e24d369427048171dfec06 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:21.724047 6024 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c9768e71e0640ceb110a19e53484044 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:21 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:21.724418 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet 96577a68f4984c90b82cf4d32e701476 with delete_type TABLET_DATA_DELETED (replaced by tablet 0500d198ec2d483f99c7dfb291323f11) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:21.730867 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 5bc33295d8684e8583508124a8db5b8a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5bc33295d8684e8583508124a8db5b8a already in progress: creating tablet
I20260923 19:50:21.727172 7775 raft_consensus.cc:493] T 40adb472162042e48fdbb496b342996a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:21.731180 7775 raft_consensus.cc:515] T 40adb472162042e48fdbb496b342996a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
W20260923 19:50:21.731410 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 242a63d6282f435aa94fb4307c15ca8a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 242a63d6282f435aa94fb4307c15ca8a already in progress: creating tablet
W20260923 19:50:21.731788 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet a2a793179a6a48cc9e9c2f0da9231416 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a2a793179a6a48cc9e9c2f0da9231416 already in progress: creating tablet
I20260923 19:50:21.731961 7775 leader_election.cc:290] T 40adb472162042e48fdbb496b342996a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:21.732713 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40adb472162042e48fdbb496b342996a" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:21.732965 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40adb472162042e48fdbb496b342996a" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:21.733459 5996 leader_election.cc:343] T 40adb472162042e48fdbb496b342996a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:21.733821 6461 raft_consensus.cc:2243] T ea2ef507c6e24d369427048171dfec06 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:21.734107 6461 raft_consensus.cc:2272] T ea2ef507c6e24d369427048171dfec06 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:21.734809 6461 ts_tablet_manager.cc:1916] T ea2ef507c6e24d369427048171dfec06 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:21.734807 5791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.143.252:45543, user_credentials={real_user=slave}} blocked reactor thread for 56593.2us
I20260923 19:50:21.735476 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c9768e71e0640ceb110a19e53484044 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:21 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:21.736469 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet 96577a68f4984c90b82cf4d32e701476 with delete_type TABLET_DATA_DELETED (replaced by tablet 0500d198ec2d483f99c7dfb291323f11) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:21.736763 6454 tablet_bootstrap.cc:492] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:21.736941 6454 ts_tablet_manager.cc:1403] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.003s
I20260923 19:50:21.737025 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet ab81b40554e2411780ecfe12ef4a8f7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:21 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:21.737581 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet a01a86b6fd4b44d3808c2040525d7b61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:07 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:21.737684 6454 raft_consensus.cc:359] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.741665 5800 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet f2799563250845b0b9d7d51b2367b16b (table default.Table_bc33f65d5674483c9854966514392420 [id=b6e6ca970bea466f80938e694f770e67]). Expected version 1 got 0
I20260923 19:50:21.743299 6454 raft_consensus.cc:385] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:21.743593 6454 raft_consensus.cc:740] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:21.743937 6454 consensus_queue.cc:260] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.747067 6457 tablet_bootstrap.cc:492] T 9ee02922d2be45f5a1473a53a6f253c4 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:21.747282 6457 ts_tablet_manager.cc:1403] T 9ee02922d2be45f5a1473a53a6f253c4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.038s user 0.004s sys 0.000s
I20260923 19:50:21.748098 6457 raft_consensus.cc:359] T 9ee02922d2be45f5a1473a53a6f253c4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:21.748353 6457 raft_consensus.cc:385] T 9ee02922d2be45f5a1473a53a6f253c4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:21.748445 6457 raft_consensus.cc:740] T 9ee02922d2be45f5a1473a53a6f253c4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:21.748685 6457 consensus_queue.cc:260] T 9ee02922d2be45f5a1473a53a6f253c4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:21.749285 6454 ts_tablet_manager.cc:1434] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260923 19:50:21.750036 6454 tablet_bootstrap.cc:492] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:21.751250 6457 ts_tablet_manager.cc:1434] T 9ee02922d2be45f5a1473a53a6f253c4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260923 19:50:21.751578 6457 tablet_bootstrap.cc:492] T 85f5ba9097674f9d889e178eaea4f0d7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:21.751904 6459 ts_tablet_manager.cc:1929] T e4f00490b0364f0e9f1b9569b870808e P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:21.753008 6457 tablet_bootstrap.cc:654] T 85f5ba9097674f9d889e178eaea4f0d7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:21.758526 6459 log.cc:1199] T e4f00490b0364f0e9f1b9569b870808e P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/e4f00490b0364f0e9f1b9569b870808e
I20260923 19:50:21.753206 7700 raft_consensus.cc:493] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:21.758922 7700 raft_consensus.cc:515] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.759634 7700 leader_election.cc:290] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:21.752154 6454 tablet_bootstrap.cc:654] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:21.758270 6461 ts_tablet_manager.cc:1929] T ea2ef507c6e24d369427048171dfec06 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:21.763226 6461 log.cc:1199] T ea2ef507c6e24d369427048171dfec06 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/ea2ef507c6e24d369427048171dfec06
I20260923 19:50:21.763387 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a926ff092e6e495e981be156421e8d72" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:21.763638 6461 ts_tablet_manager.cc:1950] T ea2ef507c6e24d369427048171dfec06 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:21.763608 6342 raft_consensus.cc:2468] T a926ff092e6e495e981be156421e8d72 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
W20260923 19:50:21.765964 6137 leader_election.cc:343] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: a926ff092e6e495e981be156421e8d72
I20260923 19:50:21.766126 6139 leader_election.cc:304] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:21.766605 6459 ts_tablet_manager.cc:1950] T e4f00490b0364f0e9f1b9569b870808e P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:21.766642 7700 raft_consensus.cc:2804] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:21.766714 7700 raft_consensus.cc:493] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:21.766776 7700 raft_consensus.cc:3060] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:21.766959 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 899) took 1851 ms. Trace:
I20260923 19:50:21.766970 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 928) took 1696 ms. Trace:
I20260923 19:50:21.767035 6459 rpcz_store.cc:276] 0923 19:50:19.915476 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:19.987820 (+ 72344us) service_pool.cc:224] Handling call
0923 19:50:21.616128 (+1628308us) ts_tablet_manager.cc:1151] Deleting tablet e4f00490b0364f0e9f1b9569b870808e
0923 19:50:21.616139 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.700156 (+ 84017us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:21.751842 (+ 51686us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:21.766944 (+ 15102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1442153}
I20260923 19:50:21.767462 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 918) took 1319 ms. Trace:
I20260923 19:50:21.767046 6461 rpcz_store.cc:276] 0923 19:50:20.070621 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:20.070688 (+ 67us) service_pool.cc:224] Handling call
0923 19:50:21.711606 (+1640918us) ts_tablet_manager.cc:1151] Deleting tablet ea2ef507c6e24d369427048171dfec06
0923 19:50:21.711616 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.744520 (+ 32904us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:21.758204 (+ 13684us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:21.766949 (+ 8745us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1640691}
I20260923 19:50:21.767537 6459 rpcz_store.cc:276] 0923 19:50:20.447929 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:20.448052 (+ 123us) service_pool.cc:224] Handling call
0923 19:50:21.767357 (+1319305us) ts_tablet_manager.cc:1151] Deleting tablet 7595c09be8784a948027dd923c4b023e
0923 19:50:21.767368 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.767448 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1319126}
I20260923 19:50:21.767830 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 936) took 1133 ms. Trace:
I20260923 19:50:21.767843 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 919) took 1292 ms. Trace:
I20260923 19:50:21.767907 6459 rpcz_store.cc:276] 0923 19:50:20.475089 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:20.475157 (+ 68us) service_pool.cc:224] Handling call
0923 19:50:21.767759 (+1292602us) ts_tablet_manager.cc:1151] Deleting tablet c82bb40047b342d5b9468ecc374ef829
0923 19:50:21.767767 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.767831 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1292427}
I20260923 19:50:21.771291 6458 ts_tablet_manager.cc:1929] T 6238d16b1be74dd88fd2e089fbd85d33 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:21.772415 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet af0f632bd266480d9ab1f864db5cd93e
I20260923 19:50:21.773928 6461 rpcz_store.cc:276] 0923 19:50:20.634401 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:20.634443 (+ 42us) service_pool.cc:224] Handling call
0923 19:50:21.767722 (+1133279us) ts_tablet_manager.cc:1151] Deleting tablet 7595c09be8784a948027dd923c4b023e
0923 19:50:21.767735 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.767816 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1133027}
I20260923 19:50:21.774654 6461 tablet_replica.cc:333] T d3f7b33bbf3f453e8e841ee5d99c5b31 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:21.774823 6461 raft_consensus.cc:2243] T d3f7b33bbf3f453e8e841ee5d99c5b31 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:21.774982 6461 raft_consensus.cc:2272] T d3f7b33bbf3f453e8e841ee5d99c5b31 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:21.774997 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_5063afc81fb14ad2ae7b3d909ab6f1ad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:21.775477 6461 ts_tablet_manager.cc:1916] T d3f7b33bbf3f453e8e841ee5d99c5b31 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:21.775550 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5063afc81fb14ad2ae7b3d909ab6f1ad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:21.770088 7700 raft_consensus.cc:515] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.779392 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet b297338b1d5a4e5797d364b891081548
I20260923 19:50:21.779958 5805 master_service.cc:960] ReplaceTablet: received request to replace tablet cc581dd78b6d4fb29fff701ae794a89d from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:21.780503 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_909fd03d65a449dda03f331de5e6cec1" } new_table_name: "default.Table_08a20ef0dba64e938efcbc71cdd2190e" modify_external_catalogs: true
W20260923 19:50:21.780646 6137 leader_election.cc:343] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: a926ff092e6e495e981be156421e8d72
I20260923 19:50:21.781111 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 922) took 1246 ms. Trace:
W20260923 19:50:21.783073 5804 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0e09a5dcef9e424e8cba58a9b15e6ea5 consensus state has no leader
I20260923 19:50:21.783423 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_e74d28acc2834aac812c922e8308ff53"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:21.783959 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e74d28acc2834aac812c922e8308ff53 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:21.784278 5995 leader_election.cc:343] T 40adb472162042e48fdbb496b342996a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:21.784530 5995 leader_election.cc:304] T 40adb472162042e48fdbb496b342996a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
W20260923 19:50:21.784796 5995 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 51318.2us
I20260923 19:50:21.785565 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet fcc32bda7c684e849161f9d4a3df79d3
I20260923 19:50:21.785610 7775 raft_consensus.cc:2749] T 40adb472162042e48fdbb496b342996a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:21.787894 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6cb97eb39775409aa1b5e9a46f892121 consensus state has no leader
I20260923 19:50:21.787964 6458 log.cc:1199] T 6238d16b1be74dd88fd2e089fbd85d33 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/6238d16b1be74dd88fd2e089fbd85d33
I20260923 19:50:21.788390 6458 ts_tablet_manager.cc:1950] T 6238d16b1be74dd88fd2e089fbd85d33 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:21.789324 6458 tablet_replica.cc:333] T c031d99a6f9844c29664236662e8d5f8 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:21.789499 6458 raft_consensus.cc:2243] T c031d99a6f9844c29664236662e8d5f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:21.789628 6458 raft_consensus.cc:2272] T c031d99a6f9844c29664236662e8d5f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:21.790119 6458 ts_tablet_manager.cc:1916] T c031d99a6f9844c29664236662e8d5f8 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:21.791642 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet af0f632bd266480d9ab1f864db5cd93e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:21 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:21.792183 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 6238d16b1be74dd88fd2e089fbd85d33 (table default.Table_ba9e77809f194febb243d6dc37df3ee0 [id=6cacf523bb724ea58690207d93819846]) successfully deleted
I20260923 19:50:21.792783 6310 tablet_service.cc:1558] Processing DeleteTablet for tablet fcc32bda7c684e849161f9d4a3df79d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:21 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:21.792940 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet b297338b1d5a4e5797d364b891081548 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:21 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:21.793453 5803 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8dd5af7c0c444142a4eeaa489a4a36ba consensus state has no leader
W20260923 19:50:21.794288 5797 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 16954e4999af443d8d91b234d8891df2 consensus state has no leader
I20260923 19:50:21.796658 6461 ts_tablet_manager.cc:1929] T d3f7b33bbf3f453e8e841ee5d99c5b31 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:21.799206 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet e4f00490b0364f0e9f1b9569b870808e (table default.Table_701c81d7fd4844f09fc1ccc28f0eda9c [id=67292e21e6b546298c5d629c6ebcb718]) successfully deleted
W20260923 19:50:21.799494 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 7595c09be8784a948027dd923c4b023e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7595c09be8784a948027dd923c4b023e already in progress: creating tablet
W20260923 19:50:21.800225 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet c82bb40047b342d5b9468ecc374ef829 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c82bb40047b342d5b9468ecc374ef829 already in progress: creating tablet
I20260923 19:50:21.801005 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet af0f632bd266480d9ab1f864db5cd93e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:21 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:21.801748 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet a926ff092e6e495e981be156421e8d72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:21.802891 5969 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 5c9768e71e0640ceb110a19e53484044
W20260923 19:50:21.784279 5996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.195:32855, user_credentials={real_user=slave}} blocked reactor thread for 50850.9us
I20260923 19:50:21.803649 6461 log.cc:1199] T d3f7b33bbf3f453e8e841ee5d99c5b31 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/d3f7b33bbf3f453e8e841ee5d99c5b31
I20260923 19:50:21.803761 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c9768e71e0640ceb110a19e53484044 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:21 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:21.804790 6461 ts_tablet_manager.cc:1950] T d3f7b33bbf3f453e8e841ee5d99c5b31 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:21.804701 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_6e9522911bb94a31ac059a895ae8af34"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:21.806211 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e9522911bb94a31ac059a895ae8af34 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:21.807080 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 937) took 1164 ms. Trace:
I20260923 19:50:21.810398 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet ea2ef507c6e24d369427048171dfec06 (table default.Table_d115f4f641e04087a0ed990be1431c58 [id=4d76230d0f7b4e5b9964f5e68525d0aa]) successfully deleted
W20260923 19:50:21.811192 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 7595c09be8784a948027dd923c4b023e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7595c09be8784a948027dd923c4b023e already in progress: creating tablet
I20260923 19:50:21.812168 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_a91fd2b80f484a57af9cc5aff55f5d4d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:21.812772 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a91fd2b80f484a57af9cc5aff55f5d4d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:21.818009 6323 tablet_service.cc:1511] Processing CreateTablet for tablet f68d58d3425f4e1dab7d95ffba1c1f1f (DEFAULT_TABLE table=default.Table_4bbf679800954626b374c8909325d09a [id=2b447f5655c74971a8846211f059eeb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:21.818445 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f68d58d3425f4e1dab7d95ffba1c1f1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:21.822184 6200 raft_consensus.cc:3060] T 6ac04be575704a69994f98e00411a254 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:21.825472 7256 raft_consensus.cc:493] T c7369a5fc87f4b70bcfbe052ef021771 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:21.825630 7256 raft_consensus.cc:515] T c7369a5fc87f4b70bcfbe052ef021771 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.826269 7256 leader_election.cc:290] T c7369a5fc87f4b70bcfbe052ef021771 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:21.781175 6459 rpcz_store.cc:276] 0923 19:50:20.534698 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:20.539449 (+ 4751us) service_pool.cc:224] Handling call
0923 19:50:21.781001 (+1241552us) ts_tablet_manager.cc:1151] Deleting tablet 13b21aadd7464b1aa2afe7a1ebc9e77f
0923 19:50:21.781013 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.781096 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1241356}
I20260923 19:50:21.827266 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 921) took 1292 ms. Trace:
I20260923 19:50:21.827348 6459 rpcz_store.cc:276] 0923 19:50:20.534563 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:20.540492 (+ 5929us) service_pool.cc:224] Handling call
0923 19:50:21.827133 (+1286641us) ts_tablet_manager.cc:1151] Deleting tablet 3d224df1bca44e30aff2b307281e399f
0923 19:50:21.827144 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.827247 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1286460}
I20260923 19:50:21.827677 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 928) took 1166 ms. Trace:
I20260923 19:50:21.827737 6459 rpcz_store.cc:276] 0923 19:50:20.661208 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:20.663000 (+ 1792us) service_pool.cc:224] Handling call
0923 19:50:21.827582 (+1164582us) ts_tablet_manager.cc:1151] Deleting tablet 83fdbb8a5352447b8ad6570e44674e97
0923 19:50:21.827590 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.827663 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1164398}
I20260923 19:50:21.828663 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 934) took 1014 ms. Trace:
I20260923 19:50:21.828913 6459 rpcz_store.cc:276] 0923 19:50:20.813972 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:20.814030 (+ 58us) service_pool.cc:224] Handling call
0923 19:50:21.828311 (+1014281us) ts_tablet_manager.cc:1151] Deleting tablet f74e7cb3e5f54dfdb2280c795ce2ce53
0923 19:50:21.828349 (+ 38us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.828603 (+ 254us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1013700}
I20260923 19:50:21.810671 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet af0f632bd266480d9ab1f864db5cd93e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:21 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:21.810899 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet fcc32bda7c684e849161f9d4a3df79d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:21 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:21.811151 6024 tablet_service.cc:1558] Processing DeleteTablet for tablet b297338b1d5a4e5797d364b891081548 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:21 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:21.830096 6279 leader_election.cc:343] T c7369a5fc87f4b70bcfbe052ef021771 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: c7369a5fc87f4b70bcfbe052ef021771
I20260923 19:50:21.830269 6459 tablet_replica.cc:333] T 6238d16b1be74dd88fd2e089fbd85d33 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:21.829711 6461 rpcz_store.cc:276] 0923 19:50:20.642453 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:20.642507 (+ 54us) service_pool.cc:224] Handling call
0923 19:50:21.774603 (+1132096us) ts_tablet_manager.cc:1151] Deleting tablet d3f7b33bbf3f453e8e841ee5d99c5b31
0923 19:50:21.774614 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.781366 (+ 6752us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:21.796604 (+ 15238us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:21.807063 (+ 10459us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1131856}
I20260923 19:50:21.830626 6459 raft_consensus.cc:2243] T 6238d16b1be74dd88fd2e089fbd85d33 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:21.831085 6459 pending_rounds.cc:70] T 6238d16b1be74dd88fd2e089fbd85d33 P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:21.831172 6459 pending_rounds.cc:77] T 6238d16b1be74dd88fd2e089fbd85d33 P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630615246974976 op_type: NO_OP noop_request { }
I20260923 19:50:21.831406 6459 raft_consensus.cc:2889] T 6238d16b1be74dd88fd2e089fbd85d33 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:21.831555 6459 raft_consensus.cc:2272] T 6238d16b1be74dd88fd2e089fbd85d33 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:21.831667 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 938) took 1188 ms. Trace:
I20260923 19:50:21.831928 6461 rpcz_store.cc:276] 0923 19:50:20.643137 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:20.643200 (+ 63us) service_pool.cc:224] Handling call
0923 19:50:21.831091 (+1187891us) ts_tablet_manager.cc:1151] Deleting tablet c82bb40047b342d5b9468ecc374ef829
0923 19:50:21.831114 (+ 23us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.831643 (+ 529us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1187687}
I20260923 19:50:21.832804 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 940) took 1182 ms. Trace:
I20260923 19:50:21.833276 6461 rpcz_store.cc:276] 0923 19:50:20.650319 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:20.650372 (+ 53us) service_pool.cc:224] Handling call
0923 19:50:21.832612 (+1182240us) ts_tablet_manager.cc:1151] Deleting tablet 3d224df1bca44e30aff2b307281e399f
0923 19:50:21.832622 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.832785 (+ 163us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1182026}
I20260923 19:50:21.834046 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 941) took 1183 ms. Trace:
I20260923 19:50:21.835171 6323 tablet_service.cc:1511] Processing CreateTablet for tablet 48ebdcf175f54994b0e0376ab0894ee3 (DEFAULT_TABLE table=default.Table_90b8b5eeaa954dd58bdb2813185930e2 [id=d036521ddc5742af93c634ddb05959f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:21.835656 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48ebdcf175f54994b0e0376ab0894ee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:21.835592 6461 rpcz_store.cc:276] 0923 19:50:20.650427 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:20.650475 (+ 48us) service_pool.cc:224] Handling call
0923 19:50:21.833936 (+1183461us) ts_tablet_manager.cc:1151] Deleting tablet 13b21aadd7464b1aa2afe7a1ebc9e77f
0923 19:50:21.833946 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.834031 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21,"tablet-delete.queue_time_us":1183346}
I20260923 19:50:21.836470 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 948) took 1172 ms. Trace:
I20260923 19:50:21.836813 6461 rpcz_store.cc:276] 0923 19:50:20.663780 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:20.663849 (+ 69us) service_pool.cc:224] Handling call
0923 19:50:21.836368 (+1172519us) ts_tablet_manager.cc:1151] Deleting tablet 83fdbb8a5352447b8ad6570e44674e97
0923 19:50:21.836377 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.836455 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1172366}
I20260923 19:50:21.837452 6461 tablet_replica.cc:333] T f74e7cb3e5f54dfdb2280c795ce2ce53 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:21.837837 6461 raft_consensus.cc:2243] T f74e7cb3e5f54dfdb2280c795ce2ce53 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:21.840660 6458 ts_tablet_manager.cc:1929] T c031d99a6f9844c29664236662e8d5f8 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:21.840816 6458 log.cc:1199] T c031d99a6f9844c29664236662e8d5f8 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/c031d99a6f9844c29664236662e8d5f8
I20260923 19:50:21.841192 6458 ts_tablet_manager.cc:1950] T c031d99a6f9844c29664236662e8d5f8 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:21.841207 6461 raft_consensus.cc:2272] T f74e7cb3e5f54dfdb2280c795ce2ce53 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:21.842093 6461 ts_tablet_manager.cc:1916] T f74e7cb3e5f54dfdb2280c795ce2ce53 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:21.842382 6458 tablet_replica.cc:333] T 1b1d9413e1e24547b491a160d851377b P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:21.842658 6458 raft_consensus.cc:2243] T 1b1d9413e1e24547b491a160d851377b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:21.842830 6458 raft_consensus.cc:2272] T 1b1d9413e1e24547b491a160d851377b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:21.843428 6458 ts_tablet_manager.cc:1916] T 1b1d9413e1e24547b491a160d851377b P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:21.843652 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet c031d99a6f9844c29664236662e8d5f8 (table default.Table_2c882fb60c3a4a5685508054fe5fa20d [id=4f2f07c1e27c431299438af5105e9f2e]) successfully deleted
I20260923 19:50:21.844609 6456 tablet_bootstrap.cc:492] T a10d35bf564d45488524d3d21721f4e5 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:21.844758 6456 ts_tablet_manager.cc:1403] T a10d35bf564d45488524d3d21721f4e5 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.184s user 0.017s sys 0.002s
I20260923 19:50:21.845685 6456 raft_consensus.cc:359] T a10d35bf564d45488524d3d21721f4e5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.845847 6456 raft_consensus.cc:385] T a10d35bf564d45488524d3d21721f4e5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:21.845945 6456 raft_consensus.cc:740] T a10d35bf564d45488524d3d21721f4e5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:21.846167 6456 consensus_queue.cc:260] T a10d35bf564d45488524d3d21721f4e5 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.848858 6456 ts_tablet_manager.cc:1434] T a10d35bf564d45488524d3d21721f4e5 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260923 19:50:21.851523 6310 tablet_service.cc:1558] Processing DeleteTablet for tablet a10d35bf564d45488524d3d21721f4e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:21.854238 6456 tablet_bootstrap.cc:492] T 0c537304c32c44adaa1e05de4496293f P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:21.855710 6456 tablet_bootstrap.cc:654] T 0c537304c32c44adaa1e05de4496293f P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:21.859654 5805 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 94980b71d1d04a94b9b1d43f66e6baf4 consensus state has no leader
I20260923 19:50:21.859901 7775 raft_consensus.cc:493] T 02fa9052a7054659baf9b07b770bb538 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:21.860044 7775 raft_consensus.cc:515] T 02fa9052a7054659baf9b07b770bb538 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.860728 7775 leader_election.cc:290] T 02fa9052a7054659baf9b07b770bb538 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:21.861428 7775 raft_consensus.cc:493] T f4313a4d8a9c411fad593b05ad655fc4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:21.861539 7775 raft_consensus.cc:515] T f4313a4d8a9c411fad593b05ad655fc4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:21.861637 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fa9052a7054659baf9b07b770bb538" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:21.862093 7775 leader_election.cc:290] T f4313a4d8a9c411fad593b05ad655fc4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:21.862357 5996 consensus_peers.cc:597] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0 -> Peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Couldn't send request to peer 2bf41435f70447f19992d368ca6b46bd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6ac04be575704a69994f98e00411a254. This is attempt 1: this message will repeat every 5th retry.
W20260923 19:50:21.862515 5996 leader_election.cc:343] T 02fa9052a7054659baf9b07b770bb538 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:21.862901 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4313a4d8a9c411fad593b05ad655fc4" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:21.863368 5996 leader_election.cc:343] T f4313a4d8a9c411fad593b05ad655fc4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:21.864620 5796 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet a263c0fc71424999b76ef01de9a51eda (table default.Table_634d169330774b228dacd2343d35d4e9 [id=59963339362940748a99a3ff36c31bbd]). Expected version 1 got 0
I20260923 19:50:21.865180 5796 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet ad29d22a82434023991ffcacf7f9bee5 (table default.Table_0eb28975495e4bedaf7c538454e525f6 [id=ea52a2330cd643e486e5b348dabbd295]). Expected version 1 got 0
I20260923 19:50:21.866829 6457 tablet_bootstrap.cc:492] T 85f5ba9097674f9d889e178eaea4f0d7 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:21.867108 6457 ts_tablet_manager.cc:1403] T 85f5ba9097674f9d889e178eaea4f0d7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.116s user 0.004s sys 0.012s
I20260923 19:50:21.867245 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_48613637f8bf43d1a98e656721ce6731"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:21.867808 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_48613637f8bf43d1a98e656721ce6731 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:21.868106 6457 raft_consensus.cc:359] T 85f5ba9097674f9d889e178eaea4f0d7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:21.868300 6457 raft_consensus.cc:385] T 85f5ba9097674f9d889e178eaea4f0d7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:21.868397 6457 raft_consensus.cc:740] T 85f5ba9097674f9d889e178eaea4f0d7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:21.868566 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_608e79573af4498e8ba356c79ad07f01"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:21.868688 6457 consensus_queue.cc:260] T 85f5ba9097674f9d889e178eaea4f0d7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
W20260923 19:50:21.869063 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_608e79573af4498e8ba356c79ad07f01 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:21.870005 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_fb38a603ce2c4e0d858c6766cbd28ebb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:21.873595 6024 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c9768e71e0640ceb110a19e53484044 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:21 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:21.873546 6028 tablet_service.cc:1511] Processing CreateTablet for tablet f68d58d3425f4e1dab7d95ffba1c1f1f (DEFAULT_TABLE table=default.Table_4bbf679800954626b374c8909325d09a [id=2b447f5655c74971a8846211f059eeb0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:21.873950 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fb38a603ce2c4e0d858c6766cbd28ebb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:21.877858 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet b297338b1d5a4e5797d364b891081548 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:21 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:21.880194 6024 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ee02922d2be45f5a1473a53a6f253c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:21.881184 5796 master_service.cc:960] ReplaceTablet: received request to replace tablet 441ec1cea9a74dd3ac4dc139d2b0baa2 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:21.882153 5800 master_service.cc:960] ReplaceTablet: received request to replace tablet d04b3a9ade7a405bb619704095fac279 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:21.882903 6457 ts_tablet_manager.cc:1434] T 85f5ba9097674f9d889e178eaea4f0d7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260923 19:50:21.885210 6454 tablet_bootstrap.cc:492] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:21.885390 6454 ts_tablet_manager.cc:1403] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.135s user 0.030s sys 0.030s
I20260923 19:50:21.887804 6457 tablet_bootstrap.cc:492] T ce6b86f947ce420994eaa5ff39ad9c87 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:21.889743 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet d3f7b33bbf3f453e8e841ee5d99c5b31 (table default.Table_8e3f5612c14448349fdc0fddeaead3d0 [id=57c63647576148739ad66655548492ce]) successfully deleted
W20260923 19:50:21.890602 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet c82bb40047b342d5b9468ecc374ef829 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c82bb40047b342d5b9468ecc374ef829 already in progress: creating tablet
I20260923 19:50:21.892409 6457 tablet_bootstrap.cc:654] T ce6b86f947ce420994eaa5ff39ad9c87 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:21.893610 6456 tablet_bootstrap.cc:492] T 0c537304c32c44adaa1e05de4496293f P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:21.893801 6456 ts_tablet_manager.cc:1403] T 0c537304c32c44adaa1e05de4496293f P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.001s
I20260923 19:50:21.894876 6456 raft_consensus.cc:359] T 0c537304c32c44adaa1e05de4496293f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.895130 6456 raft_consensus.cc:385] T 0c537304c32c44adaa1e05de4496293f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:21.895228 6456 raft_consensus.cc:740] T 0c537304c32c44adaa1e05de4496293f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:21.895560 6456 consensus_queue.cc:260] T 0c537304c32c44adaa1e05de4496293f P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.896024 6458 ts_tablet_manager.cc:1929] T 1b1d9413e1e24547b491a160d851377b P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260923 19:50:21.891335 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 13b21aadd7464b1aa2afe7a1ebc9e77f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 13b21aadd7464b1aa2afe7a1ebc9e77f already in progress: creating tablet
W20260923 19:50:21.896484 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 3d224df1bca44e30aff2b307281e399f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3d224df1bca44e30aff2b307281e399f already in progress: creating tablet
W20260923 19:50:21.896751 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 83fdbb8a5352447b8ad6570e44674e97 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 83fdbb8a5352447b8ad6570e44674e97 already in progress: creating tablet
I20260923 19:50:21.901294 6459 ts_tablet_manager.cc:1916] T 6238d16b1be74dd88fd2e089fbd85d33 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:21.904448 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7369a5fc87f4b70bcfbe052ef021771" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:21.904794 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4313a4d8a9c411fad593b05ad655fc4" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:21.905085 7700 leader_election.cc:290] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:21.905211 7700 raft_consensus.cc:493] T 22e37d5afa8047989928596b4092c4b9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:21.905305 7700 raft_consensus.cc:515] T 22e37d5afa8047989928596b4092c4b9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:21.906941 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 3d224df1bca44e30aff2b307281e399f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3d224df1bca44e30aff2b307281e399f already in progress: creating tablet
W20260923 19:50:21.907470 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 13b21aadd7464b1aa2afe7a1ebc9e77f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 13b21aadd7464b1aa2afe7a1ebc9e77f already in progress: creating tablet
I20260923 19:50:21.907908 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 441ec1cea9a74dd3ac4dc139d2b0baa2
W20260923 19:50:21.908152 5995 leader_election.cc:343] T f4313a4d8a9c411fad593b05ad655fc4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:21.908278 5995 leader_election.cc:304] T f4313a4d8a9c411fad593b05ad655fc4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:21.908504 7775 raft_consensus.cc:2749] T f4313a4d8a9c411fad593b05ad655fc4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:21.908851 5796 catalog_manager.cc:6934] ReplaceTablet: tablet 441ec1cea9a74dd3ac4dc139d2b0baa2 deleted and replaced by tablet 4b6aa676a2a54ee5a0d13d875eb03418
I20260923 19:50:21.918154 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f68d58d3425f4e1dab7d95ffba1c1f1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:21.928265 6458 log.cc:1199] T 1b1d9413e1e24547b491a160d851377b P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/1b1d9413e1e24547b491a160d851377b
I20260923 19:50:21.900658 6456 ts_tablet_manager.cc:1434] T 0c537304c32c44adaa1e05de4496293f P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260923 19:50:21.903885 6391 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
I20260923 19:50:21.906275 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a926ff092e6e495e981be156421e8d72" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:21.928730 6342 raft_consensus.cc:3060] T a926ff092e6e495e981be156421e8d72 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:21.930280 6456 tablet_bootstrap.cc:492] T 528fca12bfe04747830ad1d3bb323676 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:21.931653 6342 raft_consensus.cc:2468] T a926ff092e6e495e981be156421e8d72 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:21.906555 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 8ece20bacd6b43e4afe05164aa67fb09 (DEFAULT_TABLE table=default.Table_6ce6125963624df69740ab6735995c70 [id=d8ae423864b64397bb5f8fc4f4906952]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:21.932250 6456 tablet_bootstrap.cc:654] T 528fca12bfe04747830ad1d3bb323676 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:21.932456 6139 leader_election.cc:304] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:21.908740 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet 441ec1cea9a74dd3ac4dc139d2b0baa2 with delete_type TABLET_DATA_DELETED (replaced by tablet 4b6aa676a2a54ee5a0d13d875eb03418) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:21.908737 7256 raft_consensus.cc:493] T 0c537304c32c44adaa1e05de4496293f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:21.933146 7256 raft_consensus.cc:515] T 0c537304c32c44adaa1e05de4496293f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.933732 7256 leader_election.cc:290] T 0c537304c32c44adaa1e05de4496293f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:21.912281 6313 tablet_service.cc:1511] Processing CreateTablet for tablet 3272a27ea373449e820e01033bbbb8aa (DEFAULT_TABLE table=default.Table_15698f6ba4eb46b28ed8802eec49ff69 [id=63f117484c87401db610ce19a58bb7c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:21.915405 6323 tablet_service.cc:1511] Processing CreateTablet for tablet cb1fcf54a13d4e9d87d8cf11a77cc2fe (DEFAULT_TABLE table=default.Table_4ca10cac18b944db817de4dbe3bcae86 [id=e7a2291d75714be09118cf883667c903]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:21.916960 6307 tablet_service.cc:1511] Processing CreateTablet for tablet b7eb0f508dbc495d8b06dff9dbd29121 (DEFAULT_TABLE table=default.Table_4305227618d74000ad56a8f612ac3621 [id=2e80e8b04082412bbe5a08fb130f8d38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:21.917946 6311 tablet_service.cc:1511] Processing CreateTablet for tablet aab4a408c527427bad762c743b96b27b (DEFAULT_TABLE table=default.Table_ab85ba414cb249c8a35044fa2a653bb4 [id=cbed24f1754f4c098e91d8b5eab995e2]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:21.934909 6279 leader_election.cc:343] T 0c537304c32c44adaa1e05de4496293f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 0c537304c32c44adaa1e05de4496293f
I20260923 19:50:21.935333 6324 tablet_service.cc:1511] Processing CreateTablet for tablet ca40c76ea0104e7182a7e16fc141fcc9 (DEFAULT_TABLE table=default.Table_889af07148934f888c1e9e6b7cb9e60a [id=157b3e57537f40c396d1f11a5539daac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:21.932264 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ece20bacd6b43e4afe05164aa67fb09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:21.936501 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aab4a408c527427bad762c743b96b27b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:21.938148 6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3272a27ea373449e820e01033bbbb8aa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:21.939136 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 83fdbb8a5352447b8ad6570e44674e97 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 83fdbb8a5352447b8ad6570e44674e97 already in progress: creating tablet
I20260923 19:50:21.941198 6024 tablet_service.cc:1558] Processing DeleteTablet for tablet 85f5ba9097674f9d889e178eaea4f0d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:21.941491 6307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7eb0f508dbc495d8b06dff9dbd29121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:21.942521 6024 tablet_service.cc:1558] Processing DeleteTablet for tablet 441ec1cea9a74dd3ac4dc139d2b0baa2 with delete_type TABLET_DATA_DELETED (replaced by tablet 4b6aa676a2a54ee5a0d13d875eb03418) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:21.943378 6024 tablet_service.cc:1511] Processing CreateTablet for tablet 8ece20bacd6b43e4afe05164aa67fb09 (DEFAULT_TABLE table=default.Table_6ce6125963624df69740ab6735995c70 [id=d8ae423864b64397bb5f8fc4f4906952]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:21.943809 6024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ece20bacd6b43e4afe05164aa67fb09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:21.945264 6037 tablet_service.cc:1511] Processing CreateTablet for tablet b7eb0f508dbc495d8b06dff9dbd29121 (DEFAULT_TABLE table=default.Table_4305227618d74000ad56a8f612ac3621 [id=2e80e8b04082412bbe5a08fb130f8d38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:21.945725 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7eb0f508dbc495d8b06dff9dbd29121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:21.946434 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 3272a27ea373449e820e01033bbbb8aa (DEFAULT_TABLE table=default.Table_15698f6ba4eb46b28ed8802eec49ff69 [id=63f117484c87401db610ce19a58bb7c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:21.946767 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3272a27ea373449e820e01033bbbb8aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:21.946835 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca40c76ea0104e7182a7e16fc141fcc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:21.950201 6025 tablet_service.cc:1511] Processing CreateTablet for tablet cb1fcf54a13d4e9d87d8cf11a77cc2fe (DEFAULT_TABLE table=default.Table_4ca10cac18b944db817de4dbe3bcae86 [id=e7a2291d75714be09118cf883667c903]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:21.950589 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb1fcf54a13d4e9d87d8cf11a77cc2fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:21.953753 6037 tablet_service.cc:1511] Processing CreateTablet for tablet aab4a408c527427bad762c743b96b27b (DEFAULT_TABLE table=default.Table_ab85ba414cb249c8a35044fa2a653bb4 [id=cbed24f1754f4c098e91d8b5eab995e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:21.954139 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aab4a408c527427bad762c743b96b27b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:21.960320 7700 leader_election.cc:290] T 22e37d5afa8047989928596b4092c4b9 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:21.960493 7700 raft_consensus.cc:2804] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
W20260923 19:50:21.961158 6137 leader_election.cc:343] T 22e37d5afa8047989928596b4092c4b9 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 22e37d5afa8047989928596b4092c4b9
W20260923 19:50:21.962283 6139 leader_election.cc:343] T 22e37d5afa8047989928596b4092c4b9 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 22e37d5afa8047989928596b4092c4b9
I20260923 19:50:21.962391 6139 leader_election.cc:304] T 22e37d5afa8047989928596b4092c4b9 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:21.928745 6458 ts_tablet_manager.cc:1950] T 1b1d9413e1e24547b491a160d851377b P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:21.959904 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fa9052a7054659baf9b07b770bb538" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:21.973949 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 48ebdcf175f54994b0e0376ab0894ee3 (DEFAULT_TABLE table=default.Table_90b8b5eeaa954dd58bdb2813185930e2 [id=d036521ddc5742af93c634ddb05959f8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:21.974251 5995 leader_election.cc:343] T 02fa9052a7054659baf9b07b770bb538 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:21.974362 5995 leader_election.cc:304] T 02fa9052a7054659baf9b07b770bb538 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:21.974426 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48ebdcf175f54994b0e0376ab0894ee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:21.974713 7775 consensus_queue.cc:1048] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:21.974924 7629 raft_consensus.cc:2749] T 02fa9052a7054659baf9b07b770bb538 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:21.976260 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 1b1d9413e1e24547b491a160d851377b (table default.Table_f1842456992c4765924d809a3a062c07 [id=361a67b795ad41bb829dffbf0cc7dcc5]) successfully deleted
I20260923 19:50:21.976691 6458 tablet_replica.cc:333] T a01a86b6fd4b44d3808c2040525d7b61 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:21.976922 6458 raft_consensus.cc:2243] T a01a86b6fd4b44d3808c2040525d7b61 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:21.977108 6458 raft_consensus.cc:2272] T a01a86b6fd4b44d3808c2040525d7b61 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:21.977176 6457 tablet_bootstrap.cc:492] T ce6b86f947ce420994eaa5ff39ad9c87 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:21.977667 6457 ts_tablet_manager.cc:1403] T ce6b86f947ce420994eaa5ff39ad9c87 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.090s user 0.002s sys 0.003s
I20260923 19:50:21.977667 6458 ts_tablet_manager.cc:1916] T a01a86b6fd4b44d3808c2040525d7b61 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:21.978029 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb1fcf54a13d4e9d87d8cf11a77cc2fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:21.980969 6457 raft_consensus.cc:359] T ce6b86f947ce420994eaa5ff39ad9c87 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
W20260923 19:50:21.981562 5700 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 80879.4us
I20260923 19:50:21.983153 6454 raft_consensus.cc:359] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:21.983314 6454 raft_consensus.cc:385] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:21.983354 6454 raft_consensus.cc:740] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:21.983587 6454 consensus_queue.cc:260] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.000916 6458 ts_tablet_manager.cc:1929] T a01a86b6fd4b44d3808c2040525d7b61 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:22.001127 6458 log.cc:1199] T a01a86b6fd4b44d3808c2040525d7b61 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/a01a86b6fd4b44d3808c2040525d7b61
I20260923 19:50:22.001497 6458 ts_tablet_manager.cc:1950] T a01a86b6fd4b44d3808c2040525d7b61 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:22.002871 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet a01a86b6fd4b44d3808c2040525d7b61 (table default.Table_d2249132d73a45758b64da97b668320e [id=bf20ac3f66704af69ceb4531253cbd15]) successfully deleted
W20260923 19:50:22.003685 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 940d876042844020833ccc2347d67c4c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 940d876042844020833ccc2347d67c4c already in progress: creating tablet
W20260923 19:50:22.004467 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 1b7d35282dd148e7bfcf1277d34002bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b7d35282dd148e7bfcf1277d34002bf already in progress: creating tablet
I20260923 19:50:22.004781 6458 tablet_replica.cc:333] T c7369a5fc87f4b70bcfbe052ef021771 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:22.005016 6458 raft_consensus.cc:2243] T c7369a5fc87f4b70bcfbe052ef021771 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:22.005225 6458 raft_consensus.cc:2272] T c7369a5fc87f4b70bcfbe052ef021771 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:22.005779 6458 ts_tablet_manager.cc:1916] T c7369a5fc87f4b70bcfbe052ef021771 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:22.009918 7700 raft_consensus.cc:697] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:22.010509 7700 consensus_queue.cc:237] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.017724 6307 tablet_service.cc:1511] Processing CreateTablet for tablet 7fc282f278f343a5befc7be8484be46d (DEFAULT_TABLE table=default.Table_8daeeb8f17384fc284bad32f5d6bdfa8 [id=685aa76398e646f7bf144e38832c7227]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.018241 6307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fc282f278f343a5befc7be8484be46d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.024778 6458 ts_tablet_manager.cc:1929] T c7369a5fc87f4b70bcfbe052ef021771 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:22.025110 7789 raft_consensus.cc:2749] T 22e37d5afa8047989928596b4092c4b9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:22.027602 6458 log.cc:1199] T c7369a5fc87f4b70bcfbe052ef021771 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/c7369a5fc87f4b70bcfbe052ef021771
I20260923 19:50:22.027990 6458 ts_tablet_manager.cc:1950] T c7369a5fc87f4b70bcfbe052ef021771 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:22.029009 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet c7369a5fc87f4b70bcfbe052ef021771 (table default.Table_295f07d1ca7345d5a18a80da04089ca2 [id=26fc3d5dd42441098cdd17a5d73d219d]) successfully deleted
I20260923 19:50:22.029147 6458 tablet_replica.cc:333] T 98f61ace3a984938ace1fedbaa1dafa3 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:22.029317 6458 raft_consensus.cc:2243] T 98f61ace3a984938ace1fedbaa1dafa3 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Raft consensus shutting down.
W20260923 19:50:22.029313 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet f8052b05169b4673b387ac8b716ffc4e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f8052b05169b4673b387ac8b716ffc4e already in progress: creating tablet
I20260923 19:50:22.029598 6458 raft_consensus.cc:2272] T 98f61ace3a984938ace1fedbaa1dafa3 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:22.030350 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet c500791905944480840c25929bc7bbe1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c500791905944480840c25929bc7bbe1 already in progress: creating tablet
W20260923 19:50:22.030597 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 4f3d70c3fb2c463db1d13dcbc428d30c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f3d70c3fb2c463db1d13dcbc428d30c already in progress: creating tablet
W20260923 19:50:22.030826 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet a5cd258b6ff44e3db0d4cb66b51874b0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a5cd258b6ff44e3db0d4cb66b51874b0 already in progress: creating tablet
I20260923 19:50:22.030345 6458 ts_tablet_manager.cc:1916] T 98f61ace3a984938ace1fedbaa1dafa3 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:22.031324 6306 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c537304c32c44adaa1e05de4496293f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:22.036834 6454 ts_tablet_manager.cc:1434] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.151s user 0.002s sys 0.007s
I20260923 19:50:21.978168 6461 ts_tablet_manager.cc:1929] T f74e7cb3e5f54dfdb2280c795ce2ce53 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:50:22.037523 6454 tablet_bootstrap.cc:492] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:22.037757 6461 log.cc:1199] T f74e7cb3e5f54dfdb2280c795ce2ce53 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/f74e7cb3e5f54dfdb2280c795ce2ce53
I20260923 19:50:22.039062 6454 tablet_bootstrap.cc:654] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:22.039610 6461 ts_tablet_manager.cc:1950] T f74e7cb3e5f54dfdb2280c795ce2ce53 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:22.041524 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 953) took 1203 ms. Trace:
I20260923 19:50:22.042090 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c537304c32c44adaa1e05de4496293f" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:22.043642 7256 raft_consensus.cc:493] T 658253ff3d014361803e1aeda978e59a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:22.043771 7256 raft_consensus.cc:515] T 658253ff3d014361803e1aeda978e59a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.044335 7256 leader_election.cc:290] T 658253ff3d014361803e1aeda978e59a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:22.045506 6279 leader_election.cc:343] T 658253ff3d014361803e1aeda978e59a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 658253ff3d014361803e1aeda978e59a
W20260923 19:50:22.046274 6280 leader_election.cc:343] T c7369a5fc87f4b70bcfbe052ef021771 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:22.046370 6280 leader_election.cc:304] T c7369a5fc87f4b70bcfbe052ef021771 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:22.046509 6280 raft_consensus.cc:2686] T c7369a5fc87f4b70bcfbe052ef021771 P 2bf41435f70447f19992d368ca6b46bd: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260923 19:50:22.050704 5800 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_78600d43ea2249ca9fbfd813317ee3d5" } modify_external_catalogs: true
I20260923 19:50:22.050933 5800 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_78600d43ea2249ca9fbfd813317ee3d5" } modify_external_catalogs: true
W20260923 19:50:22.051499 6280 leader_election.cc:343] T 0c537304c32c44adaa1e05de4496293f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:22.051435 6306 tablet_service.cc:1511] Processing CreateTablet for tablet e44e67db6c354a9da587d982f25ae6e1 (DEFAULT_TABLE table=default.Table_54c68b91839f4aedb198f2923ab18193 [id=2c0aa6f0ebf64ca08798a5dc04f1079e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.051586 6280 leader_election.cc:304] T 0c537304c32c44adaa1e05de4496293f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:22.051822 6306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e44e67db6c354a9da587d982f25ae6e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.051905 7256 raft_consensus.cc:2749] T 0c537304c32c44adaa1e05de4496293f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:22.052227 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_5322c2cdfb42499d84b648cebc527d79"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:22.052749 6456 tablet_bootstrap.cc:492] T 528fca12bfe04747830ad1d3bb323676 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
W20260923 19:50:22.052774 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5322c2cdfb42499d84b648cebc527d79 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:22.052861 6456 ts_tablet_manager.cc:1403] T 528fca12bfe04747830ad1d3bb323676 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.123s user 0.002s sys 0.002s
I20260923 19:50:22.053620 6456 raft_consensus.cc:359] T 528fca12bfe04747830ad1d3bb323676 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.053755 6456 raft_consensus.cc:385] T 528fca12bfe04747830ad1d3bb323676 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:22.053797 6456 raft_consensus.cc:740] T 528fca12bfe04747830ad1d3bb323676 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:22.054013 6456 consensus_queue.cc:260] T 528fca12bfe04747830ad1d3bb323676 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.058007 6324 tablet_service.cc:1511] Processing CreateTablet for tablet 3afa8a920a534dfd958a465c5d8bf823 (DEFAULT_TABLE table=default.Table_5963af8353624db69dbdcb2fb3f0ecb1 [id=147a92621382455487e7f822985179ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.058530 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 8dd5af7c0c444142a4eeaa489a4a36ba (DEFAULT_TABLE table=default.Table_3075031ad0a941ad8028a6c58b5084bc [id=6117ddc1defc4ceaacb06978d4d4fdd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.064481 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3afa8a920a534dfd958a465c5d8bf823. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.065026 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dd5af7c0c444142a4eeaa489a4a36ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.065747 6456 ts_tablet_manager.cc:1434] T 528fca12bfe04747830ad1d3bb323676 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260923 19:50:22.066015 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet 528fca12bfe04747830ad1d3bb323676 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:22.069491 5800 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 3eb8d0a6a2a14388a60b6901106b2856
I20260923 19:50:22.069977 7700 raft_consensus.cc:493] T b7ba284e81bc4388bbd6456a41d1f9f4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:22.070132 7700 raft_consensus.cc:515] T b7ba284e81bc4388bbd6456a41d1f9f4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.070940 7700 leader_election.cc:290] T b7ba284e81bc4388bbd6456a41d1f9f4 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:22.071244 6454 tablet_bootstrap.cc:492] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:22.071357 6454 ts_tablet_manager.cc:1403] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.034s user 0.003s sys 0.000s
I20260923 19:50:22.072171 6454 raft_consensus.cc:359] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.072310 6454 raft_consensus.cc:385] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:22.072566 6454 raft_consensus.cc:740] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
W20260923 19:50:22.072827 6137 leader_election.cc:343] T b7ba284e81bc4388bbd6456a41d1f9f4 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: b7ba284e81bc4388bbd6456a41d1f9f4
I20260923 19:50:22.072808 6454 consensus_queue.cc:260] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.073293 6456 tablet_bootstrap.cc:492] T d39a64531dd24eb4aa1f7e0c418b985b P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:22.073364 6454 ts_tablet_manager.cc:1434] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:22.073597 6307 tablet_service.cc:1558] Processing DeleteTablet for tablet 3eb8d0a6a2a14388a60b6901106b2856 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:22 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:22.076383 6456 tablet_bootstrap.cc:654] T d39a64531dd24eb4aa1f7e0c418b985b P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:22.078915 6139 leader_election.cc:343] T b7ba284e81bc4388bbd6456a41d1f9f4 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: b7ba284e81bc4388bbd6456a41d1f9f4
I20260923 19:50:22.079036 6139 leader_election.cc:304] T b7ba284e81bc4388bbd6456a41d1f9f4 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:22.079447 7700 raft_consensus.cc:2749] T b7ba284e81bc4388bbd6456a41d1f9f4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:22.081748 6461 rpcz_store.cc:276] 0923 19:50:20.837818 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:20.837890 (+ 72us) service_pool.cc:224] Handling call
0923 19:50:21.837409 (+999519us) ts_tablet_manager.cc:1151] Deleting tablet f74e7cb3e5f54dfdb2280c795ce2ce53
0923 19:50:21.837418 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:21.848183 (+ 10765us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:21.977859 (+129676us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:22.041506 (+ 63647us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":999324}
I20260923 19:50:22.045055 6457 raft_consensus.cc:385] T ce6b86f947ce420994eaa5ff39ad9c87 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:22.082216 6457 raft_consensus.cc:740] T ce6b86f947ce420994eaa5ff39ad9c87 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:22.082516 6457 consensus_queue.cc:260] T ce6b86f947ce420994eaa5ff39ad9c87 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:22.083070 6457 ts_tablet_manager.cc:1434] T ce6b86f947ce420994eaa5ff39ad9c87 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.103s user 0.001s sys 0.001s
I20260923 19:50:22.083765 6454 tablet_bootstrap.cc:492] T 83dba06b0d0040889015fb052c642ec0 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:22.085180 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_15fa9b0a330d4811bfe8b985c792ef90" } modify_external_catalogs: true
I20260923 19:50:22.085484 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_15fa9b0a330d4811bfe8b985c792ef90" } modify_external_catalogs: true
I20260923 19:50:22.085940 6307 tablet_service.cc:1511] Processing CreateTablet for tablet c53b817e3ed7419b904a3c4b1c83e59f (DEFAULT_TABLE table=default.Table_881b324c0d704404a8ae93733a126fc6 [id=bc68f131a3b44e659965d01bcbdc27cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.086338 6307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c53b817e3ed7419b904a3c4b1c83e59f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.086457 6249 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
I20260923 19:50:22.088558 7700 raft_consensus.cc:493] T 5e711e48156b46b5a517b330d6d41309 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:22.088693 7700 raft_consensus.cc:515] T 5e711e48156b46b5a517b330d6d41309 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.088609 6458 ts_tablet_manager.cc:1929] T 98f61ace3a984938ace1fedbaa1dafa3 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:22.089265 7700 leader_election.cc:290] T 5e711e48156b46b5a517b330d6d41309 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:22.088944 6458 log.cc:1199] T 98f61ace3a984938ace1fedbaa1dafa3 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/98f61ace3a984938ace1fedbaa1dafa3
W20260923 19:50:22.090236 6137 leader_election.cc:343] T 5e711e48156b46b5a517b330d6d41309 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 5e711e48156b46b5a517b330d6d41309
I20260923 19:50:22.090497 5797 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_3d78c480be184d61b66155d65fa315a9" } modify_external_catalogs: true
I20260923 19:50:22.090660 6458 ts_tablet_manager.cc:1950] T 98f61ace3a984938ace1fedbaa1dafa3 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:22.090793 5797 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_3d78c480be184d61b66155d65fa315a9" } modify_external_catalogs: true
W20260923 19:50:22.091331 6139 leader_election.cc:343] T 5e711e48156b46b5a517b330d6d41309 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 5e711e48156b46b5a517b330d6d41309
I20260923 19:50:22.091431 6139 leader_election.cc:304] T 5e711e48156b46b5a517b330d6d41309 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:22.091784 7700 raft_consensus.cc:2749] T 5e711e48156b46b5a517b330d6d41309 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:22.092615 6461 tablet_replica.cc:333] T 2e1c19a751904a6295897376e9c5ee56 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:22.092813 6461 raft_consensus.cc:2243] T 2e1c19a751904a6295897376e9c5ee56 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:22.092978 6461 raft_consensus.cc:2272] T 2e1c19a751904a6295897376e9c5ee56 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:22.093411 7256 raft_consensus.cc:493] T b87872fb6cc0400c86eddffb29c898e8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:22.093530 7256 raft_consensus.cc:515] T b87872fb6cc0400c86eddffb29c898e8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.094113 7256 leader_election.cc:290] T b87872fb6cc0400c86eddffb29c898e8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:22.094105 5800 master_service.cc:960] ReplaceTablet: received request to replace tablet 771ad1e82bd743e597aefe5edafe63ea from {username='slave'} at 127.0.0.1:59912
W20260923 19:50:22.095049 6279 leader_election.cc:343] T b87872fb6cc0400c86eddffb29c898e8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: b87872fb6cc0400c86eddffb29c898e8
I20260923 19:50:22.096549 6454 tablet_bootstrap.cc:654] T 83dba06b0d0040889015fb052c642ec0 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:22.097245 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 98f61ace3a984938ace1fedbaa1dafa3 (table default.Table_c624a31c5179478cb6c54a36d7a36892 [id=26caa02bc37e471abdf29bbbb3acba69]) successfully deleted
I20260923 19:50:22.097623 6458 tablet_replica.cc:333] T 83dba06b0d0040889015fb052c642ec0 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:22.097936 6458 raft_consensus.cc:2243] T 83dba06b0d0040889015fb052c642ec0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:22.098170 6458 raft_consensus.cc:2272] T 83dba06b0d0040889015fb052c642ec0 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:22.099021 6458 ts_tablet_manager.cc:1916] T 83dba06b0d0040889015fb052c642ec0 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:22.099697 6324 tablet_service.cc:1511] Processing CreateTablet for tablet 3d55c70b319545ceaf746c6c4ebd8387 (DEFAULT_TABLE table=default.Table_d16de156c2e44c64bc6c3e69d8e5e229 [id=d9862f79ed244701b7c531a5a7baa4d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.099772 5796 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet cb2062fcccc64a609d82824ae8228a2a
I20260923 19:50:22.101207 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d55c70b319545ceaf746c6c4ebd8387. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.101568 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 2dbb1973dbcd46f5a796fb8a0a24f88f (DEFAULT_TABLE table=default.Table_03758cc797e644e98a922d8a281f2cd6 [id=70231966a15d4b9a85d1d01c58301d14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.102083 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dbb1973dbcd46f5a796fb8a0a24f88f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.102070 6457 tablet_bootstrap.cc:492] T ba0453ef529344dfbab1130daa985fef P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:22.102507 6323 tablet_service.cc:1511] Processing CreateTablet for tablet c9fe3ffc092a476fa0632581efc2fd6d (DEFAULT_TABLE table=default.Table_d754487fb38a4e219f51df72bb4c51a2 [id=3baed95ef2834115ad27368073a0a7cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.103695 6457 tablet_bootstrap.cc:654] T ba0453ef529344dfbab1130daa985fef P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:22.104107 6313 tablet_service.cc:1511] Processing CreateTablet for tablet 25117ec346224a85942d0106b4962a88 (DEFAULT_TABLE table=default.Table_387466f7eef54d308b97edbff5fb6587 [id=cd4e32eb3921431ab9b911a58f5bd216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.104436 6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25117ec346224a85942d0106b4962a88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.105098 6311 tablet_service.cc:1511] Processing CreateTablet for tablet cd215d72c9664285897129196624a58b (DEFAULT_TABLE table=default.Table_afb0915cafc4475889ceb6252cd0eb9c [id=477e6d8c228d4887be5f304f5cadd292]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.105393 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd215d72c9664285897129196624a58b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:22.105916 5789 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 7418058b0f5a44d189888b0b1714eb2e (table default.Table_4bda7de33be746b08324030612e45987 [id=41bc1e16f1224881ab414bf6c4659e06], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7418058b0f5a44d189888b0b1714eb2e consensus state has no leader
I20260923 19:50:22.106482 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet f45863a748ce4d2f94d1ad639c7e6bf7
I20260923 19:50:22.106848 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_fb368416c83d47ea95f8baa4754aa549"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:22.107385 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fb368416c83d47ea95f8baa4754aa549 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:22.107937 5800 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 771ad1e82bd743e597aefe5edafe63ea
I20260923 19:50:22.108448 5800 catalog_manager.cc:6934] ReplaceTablet: tablet 771ad1e82bd743e597aefe5edafe63ea deleted and replaced by tablet 516982de5f8546c1b4be8eb5df615f21
I20260923 19:50:22.109057 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 771ad1e82bd743e597aefe5edafe63ea with delete_type TABLET_DATA_DELETED (replaced by tablet 516982de5f8546c1b4be8eb5df615f21) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:22.110522 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658253ff3d014361803e1aeda978e59a" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:22.111333 6322 tablet_service.cc:1558] Processing DeleteTablet for tablet f45863a748ce4d2f94d1ad639c7e6bf7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:22 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:22.115283 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9fe3ffc092a476fa0632581efc2fd6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.117013 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_b2773a25e37d4447a06b7de13b4bb492"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:22.117522 7256 raft_consensus.cc:493] T f7cf45d4c4d3480288698682c1c85869 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:22.117662 7256 raft_consensus.cc:515] T f7cf45d4c4d3480288698682c1c85869 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.118321 7256 leader_election.cc:290] T f7cf45d4c4d3480288698682c1c85869 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:22.119920 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2773a25e37d4447a06b7de13b4bb492 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:22.120520 6279 leader_election.cc:343] T f7cf45d4c4d3480288698682c1c85869 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: f7cf45d4c4d3480288698682c1c85869
I20260923 19:50:22.122202 6458 ts_tablet_manager.cc:1929] T 83dba06b0d0040889015fb052c642ec0 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:22.123979 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_47d7836791f342e388fe773ca65aa4ed" } modify_external_catalogs: true
I20260923 19:50:22.124220 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_47d7836791f342e388fe773ca65aa4ed" } modify_external_catalogs: true
I20260923 19:50:22.125924 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87872fb6cc0400c86eddffb29c898e8" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:22.127658 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_6daa2c6f70ea40539e4cef7688061c38" } new_table_name: "default.Table_5264e08e4d19494aae8757ffbfebbc33" modify_external_catalogs: true
I20260923 19:50:22.130254 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7cf45d4c4d3480288698682c1c85869" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:22.130378 6454 tablet_bootstrap.cc:492] T 83dba06b0d0040889015fb052c642ec0 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:22.130396 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a1e299fcb1ab48a58822c77a8a198c90" } new_table_name: "default.Table_b5dd4db0324d43749d5fcf224d33c817" modify_external_catalogs: true
I20260923 19:50:22.130482 6454 ts_tablet_manager.cc:1403] T 83dba06b0d0040889015fb052c642ec0 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.047s user 0.002s sys 0.001s
I20260923 19:50:22.132313 6454 raft_consensus.cc:359] T 83dba06b0d0040889015fb052c642ec0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.132514 6454 raft_consensus.cc:385] T 83dba06b0d0040889015fb052c642ec0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:22.132565 6454 raft_consensus.cc:740] T 83dba06b0d0040889015fb052c642ec0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:22.132787 6454 consensus_queue.cc:260] T 83dba06b0d0040889015fb052c642ec0 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.133381 6454 ts_tablet_manager.cc:1434] T 83dba06b0d0040889015fb052c642ec0 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:50:22.133733 6454 tablet_bootstrap.cc:492] T 98f61ace3a984938ace1fedbaa1dafa3 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:22.135380 6454 tablet_bootstrap.cc:654] T 98f61ace3a984938ace1fedbaa1dafa3 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:22.136868 5796 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 9ca3c8f01de14f4d940a52d6c511dfde
I20260923 19:50:22.143301 5797 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b46cc598bb3b40e3961a7f2a2967e3cf" } modify_external_catalogs: true
W20260923 19:50:22.145612 5803 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0e650824e4ae474787faeb6c22a4b43f consensus state has no leader
I20260923 19:50:22.151681 5797 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b46cc598bb3b40e3961a7f2a2967e3cf" } modify_external_catalogs: true
I20260923 19:50:22.155766 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet fcc32bda7c684e849161f9d4a3df79d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:21 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:22.156260 6167 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c9768e71e0640ceb110a19e53484044 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:21 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:22.156883 6167 tablet_service.cc:1511] Processing CreateTablet for tablet f68d58d3425f4e1dab7d95ffba1c1f1f (DEFAULT_TABLE table=default.Table_4bbf679800954626b374c8909325d09a [id=2b447f5655c74971a8846211f059eeb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.157323 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f68d58d3425f4e1dab7d95ffba1c1f1f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:22.157622 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet f74e7cb3e5f54dfdb2280c795ce2ce53 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f74e7cb3e5f54dfdb2280c795ce2ce53 already in progress: creating tablet
I20260923 19:50:22.164443 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 2205316ed70543e5b3b001d88ab3ae5d
I20260923 19:50:22.170996 5804 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_095a7797fab845eeb9d72bad1309e2f4" } new_table_name: "default.Table_5f53e49722714067a059fe229ba79791" modify_external_catalogs: true
I20260923 19:50:22.173414 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_2ed8ffc6cc31434087136c0f3c997bb0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:22.177521 6454 tablet_bootstrap.cc:492] T 98f61ace3a984938ace1fedbaa1dafa3 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:22.129228 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 6cb97eb39775409aa1b5e9a46f892121 (DEFAULT_TABLE table=default.Table_f11dfe10dc5d494892d01fa19f92fdd4 [id=471fd5e1a48b46918e09e91f23b282eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.178869 6458 log.cc:1199] T 83dba06b0d0040889015fb052c642ec0 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/83dba06b0d0040889015fb052c642ec0
I20260923 19:50:22.179026 6454 ts_tablet_manager.cc:1403] T 98f61ace3a984938ace1fedbaa1dafa3 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.045s user 0.006s sys 0.001s
I20260923 19:50:22.179111 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cb97eb39775409aa1b5e9a46f892121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.179324 6458 ts_tablet_manager.cc:1950] T 83dba06b0d0040889015fb052c642ec0 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:22.180299 6458 tablet_replica.cc:333] T a926ff092e6e495e981be156421e8d72 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:22.180358 6454 raft_consensus.cc:359] T 98f61ace3a984938ace1fedbaa1dafa3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.180619 6458 raft_consensus.cc:2243] T a926ff092e6e495e981be156421e8d72 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:22.180778 6458 raft_consensus.cc:2272] T a926ff092e6e495e981be156421e8d72 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:22.181259 6458 ts_tablet_manager.cc:1916] T a926ff092e6e495e981be156421e8d72 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:22.151842 6324 tablet_service.cc:1511] Processing CreateTablet for tablet 5c9768e71e0640ceb110a19e53484044 (DEFAULT_TABLE table=default.Table_f51ff8d9bbeb4df183cff372b5f59ea3 [id=9867043eac6c46b38347465fb98c0a66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.182142 6454 raft_consensus.cc:385] T 98f61ace3a984938ace1fedbaa1dafa3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:22.182215 6454 raft_consensus.cc:740] T 98f61ace3a984938ace1fedbaa1dafa3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:22.182246 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c9768e71e0640ceb110a19e53484044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.182459 6454 consensus_queue.cc:260] T 98f61ace3a984938ace1fedbaa1dafa3 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.182569 6169 tablet_service.cc:1511] Processing CreateTablet for tablet 8ece20bacd6b43e4afe05164aa67fb09 (DEFAULT_TABLE table=default.Table_6ce6125963624df69740ab6735995c70 [id=d8ae423864b64397bb5f8fc4f4906952]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.182925 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ece20bacd6b43e4afe05164aa67fb09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.186800 6454 ts_tablet_manager.cc:1434] T 98f61ace3a984938ace1fedbaa1dafa3 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260923 19:50:22.187115 6454 tablet_bootstrap.cc:492] T b87872fb6cc0400c86eddffb29c898e8 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:22.191421 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 48ebdcf175f54994b0e0376ab0894ee3 (DEFAULT_TABLE table=default.Table_90b8b5eeaa954dd58bdb2813185930e2 [id=d036521ddc5742af93c634ddb05959f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.191931 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48ebdcf175f54994b0e0376ab0894ee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.153148 6323 tablet_service.cc:1511] Processing CreateTablet for tablet 287e734d8ed64538a25a85ae0ca62a1a (DEFAULT_TABLE table=default.Table_4e88efe698fb4357af59132b292c500e [id=22e36fdb414e4cb6884c239ddba527b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.197573 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 287e734d8ed64538a25a85ae0ca62a1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.198920 6454 tablet_bootstrap.cc:654] T b87872fb6cc0400c86eddffb29c898e8 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:22.199136 6456 tablet_bootstrap.cc:492] T d39a64531dd24eb4aa1f7e0c418b985b P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:22.155381 6306 tablet_service.cc:1511] Processing CreateTablet for tablet 524c11f83bc34c5fafd6c33d119ee926 (DEFAULT_TABLE table=default.Table_ae675838bcf846309b17e86c9b8abef1 [id=3cdbc7fb3fb94a679e1bcf6f65b8c4e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.199270 6456 ts_tablet_manager.cc:1403] T d39a64531dd24eb4aa1f7e0c418b985b P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.126s user 0.004s sys 0.001s
I20260923 19:50:22.199558 6306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 524c11f83bc34c5fafd6c33d119ee926. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.200069 6456 raft_consensus.cc:359] T d39a64531dd24eb4aa1f7e0c418b985b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.200215 6456 raft_consensus.cc:385] T d39a64531dd24eb4aa1f7e0c418b985b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:22.200258 6456 raft_consensus.cc:740] T d39a64531dd24eb4aa1f7e0c418b985b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:22.200430 6456 consensus_queue.cc:260] T d39a64531dd24eb4aa1f7e0c418b985b P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.163380 6313 tablet_service.cc:1511] Processing CreateTablet for tablet 559d80ce55254cc2b868df5adf32bedb (DEFAULT_TABLE table=default.Table_aa6a5920d6334591884766939675ec50 [id=b9a1de0a20ed47028a700c6dcdae0d1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.166082 6322 tablet_service.cc:1558] Processing DeleteTablet for tablet 2205316ed70543e5b3b001d88ab3ae5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:22 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:22.168815 6280 leader_election.cc:343] T 658253ff3d014361803e1aeda978e59a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:22.203147 6280 leader_election.cc:304] T 658253ff3d014361803e1aeda978e59a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:22.203258 6456 ts_tablet_manager.cc:1434] T d39a64531dd24eb4aa1f7e0c418b985b P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
W20260923 19:50:22.203896 6280 consensus_peers.cc:597] T 34d62ab3d4aa457f8fea283cd9248a41 P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260923 19:50:22.204041 6280 leader_election.cc:343] T b87872fb6cc0400c86eddffb29c898e8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:22.204121 6280 leader_election.cc:304] T b87872fb6cc0400c86eddffb29c898e8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:22.204705 7490 raft_consensus.cc:2749] T 658253ff3d014361803e1aeda978e59a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:22.205101 7490 raft_consensus.cc:2749] T b87872fb6cc0400c86eddffb29c898e8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:22.205679 6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 559d80ce55254cc2b868df5adf32bedb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.127008 6461 ts_tablet_manager.cc:1916] T 2e1c19a751904a6295897376e9c5ee56 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:22.213974 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d17a9611b1ee46e78b9fe959ceae3f17" } new_table_name: "default.Table_03f41ae74ce143c480c51cb8296efa58" modify_external_catalogs: true
I20260923 19:50:22.216260 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 83dba06b0d0040889015fb052c642ec0 (table default.Table_cabd4e85a8824c7699003c51f4f0ead6 [id=33aab54b056646fe9324af773098823b]) successfully deleted
I20260923 19:50:22.218047 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 530a0fedaf9942bab6733365161e843c (DEFAULT_TABLE table=default.Table_5f6fd703ce9046b59580474f3aee2f7b [id=7b8af3758b2048b18641f68db57f9e47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.218238 6322 tablet_service.cc:1511] Processing CreateTablet for tablet ef0604c2a884465aab7bfe6a1d2d7da6 (DEFAULT_TABLE table=default.Table_21298e3a6a4143aeb230a266b5667d6f [id=31506da53a214adf8fe5dd0c7eb9f4b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.218315 6325 tablet_service.cc:1511] Processing CreateTablet for tablet c1989e54d54e4c9daabd3727a2db0f40 (DEFAULT_TABLE table=default.Table_9be717e88e1e4262b2603dcc966e9979 [id=418dd46ddd4344c9b571b9567bcf2240]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.218436 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 8e7e79de311543cf889e5cfc3faf2435 (DEFAULT_TABLE table=default.Table_478638fdb21b4fe399163e013b5bce2f [id=6da78931a85949529e8a77a25c0e3b26]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:22.218848 5804 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2d42fd1960e0421b8f0a756bd084b946 consensus state has no leader
W20260923 19:50:22.219419 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2ed8ffc6cc31434087136c0f3c997bb0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:22.223812 5797 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_10049cc67e6841259815c979fd9bad48" } new_table_name: "default.Table_560f8aaa0ed44c7086f8132a88650cc8" modify_external_catalogs: true
W20260923 19:50:22.228000 5803 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d39a64531dd24eb4aa1f7e0c418b985b consensus state has no leader
I20260923 19:50:22.231009 6315 tablet_service.cc:1511] Processing CreateTablet for tablet f45863a748ce4d2f94d1ad639c7e6bf7 (DEFAULT_TABLE table=default.Table_3d78c480be184d61b66155d65fa315a9 [id=33437a5849ae4ce8ab42ecb1d3c4e61c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.231393 6308 tablet_service.cc:1511] Processing CreateTablet for tablet fb1ea962909b4e42a9c4fab048133077 (DEFAULT_TABLE table=default.Table_32b329b9fb0d4ea2a12965fdf2adfd24 [id=16b7e7794ca54bfca955d653a8ff0509]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.232824 6169 tablet_service.cc:1558] Processing DeleteTablet for tablet 441ec1cea9a74dd3ac4dc139d2b0baa2 with delete_type TABLET_DATA_DELETED (replaced by tablet 4b6aa676a2a54ee5a0d13d875eb03418) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:22.233853 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_79c60d04e1344d8db8ab8264fc2fadfb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:22.234618 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_79c60d04e1344d8db8ab8264fc2fadfb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:22.236642 6316 tablet_service.cc:1511] Processing CreateTablet for tablet ed9fcf8818c543faa310d081249c6521 (DEFAULT_TABLE table=default.Table_9a23ee2e94444e61b9742cf0457c7384 [id=e578b633a64d4f87a57bf432564a999b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.237463 6166 tablet_service.cc:1511] Processing CreateTablet for tablet 3272a27ea373449e820e01033bbbb8aa (DEFAULT_TABLE table=default.Table_15698f6ba4eb46b28ed8802eec49ff69 [id=63f117484c87401db610ce19a58bb7c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.237991 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3272a27ea373449e820e01033bbbb8aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.238823 6321 tablet_service.cc:1511] Processing CreateTablet for tablet fd4d9c2e4b7a4deda122379aeab67737 (DEFAULT_TABLE table=default.Table_9335f049ac99441a83a2dbe2cd1e2a56 [id=241daf6d418848cb8e7aecac8d25639e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.244123 6317 tablet_service.cc:1511] Processing CreateTablet for tablet 2205316ed70543e5b3b001d88ab3ae5d (DEFAULT_TABLE table=default.Table_b46cc598bb3b40e3961a7f2a2967e3cf [id=aed58a235614422f89fbf259dca25ea9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.246162 6166 tablet_service.cc:1511] Processing CreateTablet for tablet cb1fcf54a13d4e9d87d8cf11a77cc2fe (DEFAULT_TABLE table=default.Table_4ca10cac18b944db817de4dbe3bcae86 [id=e7a2291d75714be09118cf883667c903]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.246779 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e7e79de311543cf889e5cfc3faf2435. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.247031 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb1fcf54a13d4e9d87d8cf11a77cc2fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.248585 6320 tablet_service.cc:1511] Processing CreateTablet for tablet ba47e3d0c32f47a39f9d7f021f3398f3 (DEFAULT_TABLE table=default.Table_1ad06306ba71468dbaa1a583e056a06d [id=b1214f534ecd4a27aa6d26cd65e45ce8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.248939 6320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba47e3d0c32f47a39f9d7f021f3398f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.249102 6169 tablet_service.cc:1511] Processing CreateTablet for tablet b7eb0f508dbc495d8b06dff9dbd29121 (DEFAULT_TABLE table=default.Table_4305227618d74000ad56a8f612ac3621 [id=2e80e8b04082412bbe5a08fb130f8d38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.249517 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7eb0f508dbc495d8b06dff9dbd29121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.250357 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 530a0fedaf9942bab6733365161e843c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.250775 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_51ce07574ea94e9d9eac28bd48d0e462"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:22.251350 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51ce07574ea94e9d9eac28bd48d0e462 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:22.253427 7775 raft_consensus.cc:493] T 688bb1055ba94c2996cdfea6dea76416 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:22.253625 7775 raft_consensus.cc:515] T 688bb1055ba94c2996cdfea6dea76416 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.254758 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688bb1055ba94c2996cdfea6dea76416" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:22.255342 5995 leader_election.cc:343] T 688bb1055ba94c2996cdfea6dea76416 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:22.255714 7775 leader_election.cc:290] T 688bb1055ba94c2996cdfea6dea76416 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:22.256748 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd4d9c2e4b7a4deda122379aeab67737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.257318 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_fdf7b04e073842959f84cd5bcde8c992"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:22.258242 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fdf7b04e073842959f84cd5bcde8c992 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:22.261056 6164 tablet_service.cc:1511] Processing CreateTablet for tablet aab4a408c527427bad762c743b96b27b (DEFAULT_TABLE table=default.Table_ab85ba414cb249c8a35044fa2a653bb4 [id=cbed24f1754f4c098e91d8b5eab995e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.261487 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aab4a408c527427bad762c743b96b27b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.262176 6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed9fcf8818c543faa310d081249c6521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.266177 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb1ea962909b4e42a9c4fab048133077. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.270157 6322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef0604c2a884465aab7bfe6a1d2d7da6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.270742 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1989e54d54e4c9daabd3727a2db0f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.270889 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2205316ed70543e5b3b001d88ab3ae5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.274108 6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f45863a748ce4d2f94d1ad639c7e6bf7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:22.278846 5797 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 60b1f8ceb7d74156926ed601b5a1be62 consensus state has no leader
W20260923 19:50:22.286160 6280 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 82113.7us
W20260923 19:50:22.287091 6280 leader_election.cc:343] T f7cf45d4c4d3480288698682c1c85869 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:22.287811 6280 leader_election.cc:304] T f7cf45d4c4d3480288698682c1c85869 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:22.289458 7490 raft_consensus.cc:2749] T f7cf45d4c4d3480288698682c1c85869 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:22.289613 7490 raft_consensus.cc:493] T d39a64531dd24eb4aa1f7e0c418b985b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:22.289727 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688bb1055ba94c2996cdfea6dea76416" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:22.289700 7490 raft_consensus.cc:515] T d39a64531dd24eb4aa1f7e0c418b985b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.290581 7490 leader_election.cc:290] T d39a64531dd24eb4aa1f7e0c418b985b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:22.204727 6459 ts_tablet_manager.cc:1929] T 6238d16b1be74dd88fd2e089fbd85d33 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:22.208002 7700 raft_consensus.cc:493] T 6d29923f139445cc86379c80ac15df5d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:22.291062 7700 raft_consensus.cc:515] T 6d29923f139445cc86379c80ac15df5d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.291188 6054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d39a64531dd24eb4aa1f7e0c418b985b" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:22.291375 6054 raft_consensus.cc:2468] T d39a64531dd24eb4aa1f7e0c418b985b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:22.291792 7700 leader_election.cc:290] T 6d29923f139445cc86379c80ac15df5d P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:22.291862 5797 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet d39a64531dd24eb4aa1f7e0c418b985b (table default.Table_03f41ae74ce143c480c51cb8296efa58 [id=a56799b0709846cf8308d7d7b727427c]). Expected version 3 got 0
W20260923 19:50:22.292838 6137 leader_election.cc:343] T 6d29923f139445cc86379c80ac15df5d P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 6d29923f139445cc86379c80ac15df5d
I20260923 19:50:22.293773 6279 leader_election.cc:304] T d39a64531dd24eb4aa1f7e0c418b985b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
W20260923 19:50:22.293869 6139 leader_election.cc:343] T 6d29923f139445cc86379c80ac15df5d P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 6d29923f139445cc86379c80ac15df5d
I20260923 19:50:22.293984 6139 leader_election.cc:304] T 6d29923f139445cc86379c80ac15df5d P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:22.294229 7490 raft_consensus.cc:2804] T d39a64531dd24eb4aa1f7e0c418b985b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:22.294296 7490 raft_consensus.cc:493] T d39a64531dd24eb4aa1f7e0c418b985b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:22.294355 7490 raft_consensus.cc:3060] T d39a64531dd24eb4aa1f7e0c418b985b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:22.294327 7700 raft_consensus.cc:2749] T 6d29923f139445cc86379c80ac15df5d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:22.294679 7775 raft_consensus.cc:493] T a263c0fc71424999b76ef01de9a51eda P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:22.294796 7775 raft_consensus.cc:515] T a263c0fc71424999b76ef01de9a51eda P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:22.295630 7775 leader_election.cc:290] T a263c0fc71424999b76ef01de9a51eda P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:22.296350 6322 tablet_service.cc:1511] Processing CreateTablet for tablet fb44c10b4f6148738306c617aac88b43 (DEFAULT_TABLE table=default.Table_ceb8ad1770064991add54f6cc371d9fc [id=239e3795bb11406ba1b75b9ccffcc245]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.296715 6322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb44c10b4f6148738306c617aac88b43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.297067 7490 raft_consensus.cc:515] T d39a64531dd24eb4aa1f7e0c418b985b P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.299248 7490 leader_election.cc:290] T d39a64531dd24eb4aa1f7e0c418b985b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:22.299836 6164 tablet_service.cc:1511] Processing CreateTablet for tablet ca40c76ea0104e7182a7e16fc141fcc9 (DEFAULT_TABLE table=default.Table_889af07148934f888c1e9e6b7cb9e60a [id=157b3e57537f40c396d1f11a5539daac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.300266 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca40c76ea0104e7182a7e16fc141fcc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.300275 6054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d39a64531dd24eb4aa1f7e0c418b985b" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:22.300464 6054 raft_consensus.cc:3060] T d39a64531dd24eb4aa1f7e0c418b985b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:22.302270 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_7c0f53782acd4972bd270aafa5cfead6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:22.302975 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c0f53782acd4972bd270aafa5cfead6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:22.303376 6054 raft_consensus.cc:2468] T d39a64531dd24eb4aa1f7e0c418b985b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:22.304039 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a263c0fc71424999b76ef01de9a51eda" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:22.304498 5995 leader_election.cc:343] T a263c0fc71424999b76ef01de9a51eda P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:22.304478 6279 leader_election.cc:304] T d39a64531dd24eb4aa1f7e0c418b985b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:22.304946 7802 raft_consensus.cc:2804] T d39a64531dd24eb4aa1f7e0c418b985b P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:22.305253 7802 raft_consensus.cc:697] T d39a64531dd24eb4aa1f7e0c418b985b P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:22.305588 7802 consensus_queue.cc:237] T d39a64531dd24eb4aa1f7e0c418b985b P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.306732 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_dd8734e42a5d407782e8b34cad9c6e69"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:22.307298 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dd8734e42a5d407782e8b34cad9c6e69 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:22.309291 6308 tablet_service.cc:1511] Processing CreateTablet for tablet 01ec42e562c640abaac4ca1be0695738 (DEFAULT_TABLE table=default.Table_1897b70d41264c8bb98149a4706b6241 [id=f7599e54c37e41ec93052c8bbab8e22b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.309715 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01ec42e562c640abaac4ca1be0695738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.313990 6315 tablet_service.cc:1511] Processing CreateTablet for tablet 25a1122a9ed44525b53752f230b875af (DEFAULT_TABLE table=default.Table_0bf993fb53a243408934c3ce7812f300 [id=1dc5c4b9cfe242b099053cbb53aac5ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.314543 6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25a1122a9ed44525b53752f230b875af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.316211 7775 raft_consensus.cc:493] T 1c43641327d14a888a2815e49a2762c8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:22.316366 7775 raft_consensus.cc:515] T 1c43641327d14a888a2815e49a2762c8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.317292 7775 leader_election.cc:290] T 1c43641327d14a888a2815e49a2762c8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:22.317234 6316 tablet_service.cc:1511] Processing CreateTablet for tablet dd8dec210cdd4654a0cddaccfdc5515e (DEFAULT_TABLE table=default.Table_13c4ea7cf77644a4ada7c2f3fa3b0fab [id=97151fcc96a74f69b0ae4895d239379b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.317605 6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd8dec210cdd4654a0cddaccfdc5515e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.317654 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c43641327d14a888a2815e49a2762c8" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:22.316975 6310 tablet_service.cc:1511] Processing CreateTablet for tablet b4d0cb6f85c34dd5977898049a5d84ee (DEFAULT_TABLE table=default.Table_fb92f0dc809c49018d4300eaf32b6a8b [id=8325a8f159124a2da260e2be3ce69500]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.318473 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4d0cb6f85c34dd5977898049a5d84ee. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:22.319805 5995 leader_election.cc:343] T 1c43641327d14a888a2815e49a2762c8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:22.323927 6306 tablet_service.cc:1511] Processing CreateTablet for tablet 0fba5780da63463f8b6025e7c639a144 (DEFAULT_TABLE table=default.Table_fcfe761be2c94ee2ab52f12e87ed7fb7 [id=09b68217c16045eeb0c621540a404473]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.324638 6306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fba5780da63463f8b6025e7c639a144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.327483 7700 raft_consensus.cc:493] T 98f61ace3a984938ace1fedbaa1dafa3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:22.327677 7700 raft_consensus.cc:515] T 98f61ace3a984938ace1fedbaa1dafa3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.328681 7700 leader_election.cc:290] T 98f61ace3a984938ace1fedbaa1dafa3 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:22.329259 6182 tablet_service.cc:1511] Processing CreateTablet for tablet e44e67db6c354a9da587d982f25ae6e1 (DEFAULT_TABLE table=default.Table_54c68b91839f4aedb198f2923ab18193 [id=2c0aa6f0ebf64ca08798a5dc04f1079e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.329695 6182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e44e67db6c354a9da587d982f25ae6e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.329819 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_1f4842736433434a923eca1ef9999b74"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:22.327847 6174 tablet_service.cc:1511] Processing CreateTablet for tablet 7fc282f278f343a5befc7be8484be46d (DEFAULT_TABLE table=default.Table_8daeeb8f17384fc284bad32f5d6bdfa8 [id=685aa76398e646f7bf144e38832c7227]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.330621 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fc282f278f343a5befc7be8484be46d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:22.330677 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f4842736433434a923eca1ef9999b74 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:22.335475 6056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f61ace3a984938ace1fedbaa1dafa3" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:22.335913 7802 raft_consensus.cc:493] T e6e04d16675443fc923a5f8216e292b6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:22.336125 7802 raft_consensus.cc:515] T e6e04d16675443fc923a5f8216e292b6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.336377 6037 tablet_service.cc:1511] Processing CreateTablet for tablet ca40c76ea0104e7182a7e16fc141fcc9 (DEFAULT_TABLE table=default.Table_889af07148934f888c1e9e6b7cb9e60a [id=157b3e57537f40c396d1f11a5539daac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.336764 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca40c76ea0104e7182a7e16fc141fcc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.337342 7802 leader_election.cc:290] T e6e04d16675443fc923a5f8216e292b6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:22.340170 6279 leader_election.cc:343] T e6e04d16675443fc923a5f8216e292b6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: e6e04d16675443fc923a5f8216e292b6
W20260923 19:50:22.340497 5996 leader_election.cc:343] T 688bb1055ba94c2996cdfea6dea76416 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:22.340618 5996 leader_election.cc:304] T 688bb1055ba94c2996cdfea6dea76416 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:22.341456 7775 raft_consensus.cc:2749] T 688bb1055ba94c2996cdfea6dea76416 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:22.341475 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a263c0fc71424999b76ef01de9a51eda" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:22.342255 6165 tablet_service.cc:1511] Processing CreateTablet for tablet 3afa8a920a534dfd958a465c5d8bf823 (DEFAULT_TABLE table=default.Table_5963af8353624db69dbdcb2fb3f0ecb1 [id=147a92621382455487e7f822985179ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.342672 6165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3afa8a920a534dfd958a465c5d8bf823. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.348037 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 7fc282f278f343a5befc7be8484be46d (DEFAULT_TABLE table=default.Table_8daeeb8f17384fc284bad32f5d6bdfa8 [id=685aa76398e646f7bf144e38832c7227]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.348479 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fc282f278f343a5befc7be8484be46d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:22.349649 6139 leader_election.cc:343] T 98f61ace3a984938ace1fedbaa1dafa3 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 98f61ace3a984938ace1fedbaa1dafa3
I20260923 19:50:22.349778 6139 leader_election.cc:304] T 98f61ace3a984938ace1fedbaa1dafa3 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:22.350970 7700 raft_consensus.cc:2749] T 98f61ace3a984938ace1fedbaa1dafa3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:22.353312 6456 tablet_bootstrap.cc:492] T 684eb2576b4b4730813b993e36b242df P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:22.354220 6181 tablet_service.cc:1511] Processing CreateTablet for tablet 8dd5af7c0c444142a4eeaa489a4a36ba (DEFAULT_TABLE table=default.Table_3075031ad0a941ad8028a6c58b5084bc [id=6117ddc1defc4ceaacb06978d4d4fdd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.354197 6029 tablet_service.cc:1511] Processing CreateTablet for tablet e44e67db6c354a9da587d982f25ae6e1 (DEFAULT_TABLE table=default.Table_54c68b91839f4aedb198f2923ab18193 [id=2c0aa6f0ebf64ca08798a5dc04f1079e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.354578 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dd5af7c0c444142a4eeaa489a4a36ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.354586 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e44e67db6c354a9da587d982f25ae6e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.367262 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 3afa8a920a534dfd958a465c5d8bf823 (DEFAULT_TABLE table=default.Table_5963af8353624db69dbdcb2fb3f0ecb1 [id=147a92621382455487e7f822985179ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.367563 6181 tablet_service.cc:1511] Processing CreateTablet for tablet c53b817e3ed7419b904a3c4b1c83e59f (DEFAULT_TABLE table=default.Table_881b324c0d704404a8ae93733a126fc6 [id=bc68f131a3b44e659965d01bcbdc27cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.367693 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3afa8a920a534dfd958a465c5d8bf823. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.367991 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c53b817e3ed7419b904a3c4b1c83e59f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.369697 6182 tablet_service.cc:1558] Processing DeleteTablet for tablet 3eb8d0a6a2a14388a60b6901106b2856 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:22 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:22.371215 6459 log.cc:1199] T 6238d16b1be74dd88fd2e089fbd85d33 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/6238d16b1be74dd88fd2e089fbd85d33
I20260923 19:50:22.371858 6459 ts_tablet_manager.cc:1950] T 6238d16b1be74dd88fd2e089fbd85d33 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:22.373705 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 940) took 1459 ms. Trace:
I20260923 19:50:22.361454 7490 raft_consensus.cc:493] T 528fca12bfe04747830ad1d3bb323676 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:22.380554 7490 raft_consensus.cc:515] T 528fca12bfe04747830ad1d3bb323676 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.381331 7490 leader_election.cc:290] T 528fca12bfe04747830ad1d3bb323676 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:22.381561 6025 tablet_service.cc:1558] Processing DeleteTablet for tablet 3eb8d0a6a2a14388a60b6901106b2856 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:22 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:22.381549 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c43641327d14a888a2815e49a2762c8" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:22.382380 5996 leader_election.cc:343] T a263c0fc71424999b76ef01de9a51eda P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:22.382486 5996 leader_election.cc:304] T a263c0fc71424999b76ef01de9a51eda P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:22.382854 7775 raft_consensus.cc:2749] T a263c0fc71424999b76ef01de9a51eda P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:22.383040 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 8dd5af7c0c444142a4eeaa489a4a36ba (DEFAULT_TABLE table=default.Table_3075031ad0a941ad8028a6c58b5084bc [id=6117ddc1defc4ceaacb06978d4d4fdd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.383450 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dd5af7c0c444142a4eeaa489a4a36ba. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:22.384994 6279 leader_election.cc:343] T 528fca12bfe04747830ad1d3bb323676 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 528fca12bfe04747830ad1d3bb323676
I20260923 19:50:22.362943 7802 consensus_queue.cc:1048] T 34d62ab3d4aa457f8fea283cd9248a41 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:22.365222 6316 tablet_service.cc:1511] Processing CreateTablet for tablet c4b38cbca5ca4d18b5985397ab229b70 (DEFAULT_TABLE table=default.Table_58fdbcba107b44b78bc5f5a04a636493 [id=40c6f43aa080498f9c2f0b9803153961]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.365856 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 79c1326f5e9c4f0ba0707148cb9f264a (DEFAULT_TABLE table=default.Table_90f6ff642d1548868810ba9fc019170b [id=8222bb5bd4694b148c9654c6314e4888]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.386329 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79c1326f5e9c4f0ba0707148cb9f264a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.386502 6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4b38cbca5ca4d18b5985397ab229b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.378794 6182 tablet_service.cc:1511] Processing CreateTablet for tablet 3d55c70b319545ceaf746c6c4ebd8387 (DEFAULT_TABLE table=default.Table_d16de156c2e44c64bc6c3e69d8e5e229 [id=d9862f79ed244701b7c531a5a7baa4d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.392196 6170 tablet_service.cc:1558] Processing DeleteTablet for tablet d8c8bfa9b7424b9f80f76e0bb05cbc0c with delete_type TABLET_DATA_DELETED (replaced by tablet cf64073cdde748bc8ed3ce7580a71160) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:22.393083 6182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d55c70b319545ceaf746c6c4ebd8387. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.393299 6025 tablet_service.cc:1511] Processing CreateTablet for tablet c53b817e3ed7419b904a3c4b1c83e59f (DEFAULT_TABLE table=default.Table_881b324c0d704404a8ae93733a126fc6 [id=bc68f131a3b44e659965d01bcbdc27cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.379256 6174 tablet_service.cc:1511] Processing CreateTablet for tablet c9fe3ffc092a476fa0632581efc2fd6d (DEFAULT_TABLE table=default.Table_d754487fb38a4e219f51df72bb4c51a2 [id=3baed95ef2834115ad27368073a0a7cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.393711 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c53b817e3ed7419b904a3c4b1c83e59f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.393985 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9fe3ffc092a476fa0632581efc2fd6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.379537 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d39a64531dd24eb4aa1f7e0c418b985b" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:22.379575 6165 tablet_service.cc:1511] Processing CreateTablet for tablet 2dbb1973dbcd46f5a796fb8a0a24f88f (DEFAULT_TABLE table=default.Table_03758cc797e644e98a922d8a281f2cd6 [id=70231966a15d4b9a85d1d01c58301d14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.390933 6180 tablet_service.cc:1511] Processing CreateTablet for tablet 25117ec346224a85942d0106b4962a88 (DEFAULT_TABLE table=default.Table_387466f7eef54d308b97edbff5fb6587 [id=cd4e32eb3921431ab9b911a58f5bd216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.391544 6173 tablet_service.cc:1511] Processing CreateTablet for tablet cd215d72c9664285897129196624a58b (DEFAULT_TABLE table=default.Table_afb0915cafc4475889ceb6252cd0eb9c [id=477e6d8c228d4887be5f304f5cadd292]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.391755 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet f45863a748ce4d2f94d1ad639c7e6bf7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:22 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:22.391866 6168 tablet_service.cc:1511] Processing CreateTablet for tablet 5c9768e71e0640ceb110a19e53484044 (DEFAULT_TABLE table=default.Table_f51ff8d9bbeb4df183cff372b5f59ea3 [id=9867043eac6c46b38347465fb98c0a66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.396665 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd215d72c9664285897129196624a58b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.392009 6176 tablet_service.cc:1511] Processing CreateTablet for tablet 6cb97eb39775409aa1b5e9a46f892121 (DEFAULT_TABLE table=default.Table_f11dfe10dc5d494892d01fa19f92fdd4 [id=471fd5e1a48b46918e09e91f23b282eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.392704 6459 rpcz_store.cc:276] 0923 19:50:20.913752 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:20.913803 (+ 51us) service_pool.cc:224] Handling call
0923 19:50:21.829599 (+915796us) ts_tablet_manager.cc:1151] Deleting tablet 6238d16b1be74dd88fd2e089fbd85d33
0923 19:50:21.829667 (+ 68us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:22.024055 (+194388us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:22.204669 (+180614us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:22.373684 (+169015us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":915551}
I20260923 19:50:22.396515 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 4737b8f458144727838355a19e85ac24 (DEFAULT_TABLE table=default.Table_7ac9b6906d0746dab9ddc8e5f177b78f [id=812e369fb75a4bf88fcf579c6a7184cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.392189 6175 tablet_service.cc:1511] Processing CreateTablet for tablet 287e734d8ed64538a25a85ae0ca62a1a (DEFAULT_TABLE table=default.Table_4e88efe698fb4357af59132b292c500e [id=22e36fdb414e4cb6884c239ddba527b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.392424 6177 tablet_service.cc:1511] Processing CreateTablet for tablet 559d80ce55254cc2b868df5adf32bedb (DEFAULT_TABLE table=default.Table_aa6a5920d6334591884766939675ec50 [id=b9a1de0a20ed47028a700c6dcdae0d1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.392578 6178 tablet_service.cc:1558] Processing DeleteTablet for tablet 2205316ed70543e5b3b001d88ab3ae5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:22 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:22.391868 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet 771ad1e82bd743e597aefe5edafe63ea with delete_type TABLET_DATA_DELETED (replaced by tablet 516982de5f8546c1b4be8eb5df615f21) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:22.392009 6172 tablet_service.cc:1511] Processing CreateTablet for tablet 524c11f83bc34c5fafd6c33d119ee926 (DEFAULT_TABLE table=default.Table_ae675838bcf846309b17e86c9b8abef1 [id=3cdbc7fb3fb94a679e1bcf6f65b8c4e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.396930 6176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cb97eb39775409aa1b5e9a46f892121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.398022 6172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 524c11f83bc34c5fafd6c33d119ee926. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.398244 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4737b8f458144727838355a19e85ac24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.398955 6459 tablet_replica.cc:333] T 2948d729e1ec4dfca70789bcad513e52 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:22.400122 6459 raft_consensus.cc:2243] T 2948d729e1ec4dfca70789bcad513e52 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:22.400768 6459 raft_consensus.cc:2272] T 2948d729e1ec4dfca70789bcad513e52 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:22.402565 6021 tablet_service.cc:1511] Processing CreateTablet for tablet c9fe3ffc092a476fa0632581efc2fd6d (DEFAULT_TABLE table=default.Table_d754487fb38a4e219f51df72bb4c51a2 [id=3baed95ef2834115ad27368073a0a7cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.402966 6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9fe3ffc092a476fa0632581efc2fd6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.403010 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 25117ec346224a85942d0106b4962a88 (DEFAULT_TABLE table=default.Table_387466f7eef54d308b97edbff5fb6587 [id=cd4e32eb3921431ab9b911a58f5bd216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.403731 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25117ec346224a85942d0106b4962a88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.406312 7802 raft_consensus.cc:493] T fc151f4d78344efeada6d6e57af6eb9f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:22.406770 7802 raft_consensus.cc:515] T fc151f4d78344efeada6d6e57af6eb9f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:22.407671 5996 leader_election.cc:343] T 1c43641327d14a888a2815e49a2762c8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:22.407799 5996 leader_election.cc:304] T 1c43641327d14a888a2815e49a2762c8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:22.408308 6024 tablet_service.cc:1511] Processing CreateTablet for tablet 3d55c70b319545ceaf746c6c4ebd8387 (DEFAULT_TABLE table=default.Table_d16de156c2e44c64bc6c3e69d8e5e229 [id=d9862f79ed244701b7c531a5a7baa4d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.408756 6024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d55c70b319545ceaf746c6c4ebd8387. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.410133 6026 tablet_service.cc:1511] Processing CreateTablet for tablet 2dbb1973dbcd46f5a796fb8a0a24f88f (DEFAULT_TABLE table=default.Table_03758cc797e644e98a922d8a281f2cd6 [id=70231966a15d4b9a85d1d01c58301d14]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.410486 6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dbb1973dbcd46f5a796fb8a0a24f88f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.416275 7775 raft_consensus.cc:2749] T 1c43641327d14a888a2815e49a2762c8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:22.420570 6025 tablet_service.cc:1558] Processing DeleteTablet for tablet f45863a748ce4d2f94d1ad639c7e6bf7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:22 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:22.422248 7802 leader_election.cc:290] T fc151f4d78344efeada6d6e57af6eb9f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:22.423455 7499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae: Bootstrap replaying log segment 1/1 (52.3K/178.7K this segment, stats: ops{read=161 overwritten=0 applied=161 ignored=0} inserts{seen=153 ignored=0} mutations{seen=162 ignored=0} orphaned_commits=0)
I20260923 19:50:22.423586 7700 raft_consensus.cc:493] T a75c4436a67f453e973a7a7645de79b1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:22.423748 7700 raft_consensus.cc:515] T a75c4436a67f453e973a7a7645de79b1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.405452 5797 catalog_manager.cc:5838] T d39a64531dd24eb4aa1f7e0c418b985b P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:22.433950 5797 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet d39a64531dd24eb4aa1f7e0c418b985b (table default.Table_03f41ae74ce143c480c51cb8296efa58 [id=a56799b0709846cf8308d7d7b727427c]). Expected version 3 got 0
I20260923 19:50:22.440564 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet ce6b86f947ce420994eaa5ff39ad9c87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:22.441686 6456 tablet_bootstrap.cc:654] T 684eb2576b4b4730813b993e36b242df P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:22.446702 6279 leader_election.cc:343] T fc151f4d78344efeada6d6e57af6eb9f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: fc151f4d78344efeada6d6e57af6eb9f
I20260923 19:50:22.449958 6459 ts_tablet_manager.cc:1916] T 2948d729e1ec4dfca70789bcad513e52 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:22.449801 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d39a64531dd24eb4aa1f7e0c418b985b" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:22.452026 7775 raft_consensus.cc:493] T 9ee02922d2be45f5a1473a53a6f253c4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:22.452543 7775 raft_consensus.cc:515] T 9ee02922d2be45f5a1473a53a6f253c4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:22.453428 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 530a0fedaf9942bab6733365161e843c (DEFAULT_TABLE table=default.Table_5f6fd703ce9046b59580474f3aee2f7b [id=7b8af3758b2048b18641f68db57f9e47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.454070 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 8e7e79de311543cf889e5cfc3faf2435 (DEFAULT_TABLE table=default.Table_478638fdb21b4fe399163e013b5bce2f [id=6da78931a85949529e8a77a25c0e3b26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.454603 6179 tablet_service.cc:1511] Processing CreateTablet for tablet ef0604c2a884465aab7bfe6a1d2d7da6 (DEFAULT_TABLE table=default.Table_21298e3a6a4143aeb230a266b5667d6f [id=31506da53a214adf8fe5dd0c7eb9f4b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.454783 6171 tablet_service.cc:1511] Processing CreateTablet for tablet f45863a748ce4d2f94d1ad639c7e6bf7 (DEFAULT_TABLE table=default.Table_3d78c480be184d61b66155d65fa315a9 [id=33437a5849ae4ce8ab42ecb1d3c4e61c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.455067 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25117ec346224a85942d0106b4962a88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.455206 6165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dbb1973dbcd46f5a796fb8a0a24f88f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.455381 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c9768e71e0640ceb110a19e53484044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.455339 6170 tablet_service.cc:1511] Processing CreateTablet for tablet c1989e54d54e4c9daabd3727a2db0f40 (DEFAULT_TABLE table=default.Table_9be717e88e1e4262b2603dcc966e9979 [id=418dd46ddd4344c9b571b9567bcf2240]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.455579 6171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f45863a748ce4d2f94d1ad639c7e6bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.455849 7700 leader_election.cc:290] T a75c4436a67f453e973a7a7645de79b1 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:22.456878 6139 leader_election.cc:343] T a75c4436a67f453e973a7a7645de79b1 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: a75c4436a67f453e973a7a7645de79b1
I20260923 19:50:22.457065 6175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 287e734d8ed64538a25a85ae0ca62a1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.458443 6177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 559d80ce55254cc2b868df5adf32bedb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.458879 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef0604c2a884465aab7bfe6a1d2d7da6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.458983 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 6cb97eb39775409aa1b5e9a46f892121 (DEFAULT_TABLE table=default.Table_f11dfe10dc5d494892d01fa19f92fdd4 [id=471fd5e1a48b46918e09e91f23b282eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.459074 6170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1989e54d54e4c9daabd3727a2db0f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.459372 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cb97eb39775409aa1b5e9a46f892121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.459435 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e7e79de311543cf889e5cfc3faf2435. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.460091 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 530a0fedaf9942bab6733365161e843c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.460294 6021 tablet_service.cc:1511] Processing CreateTablet for tablet 287e734d8ed64538a25a85ae0ca62a1a (DEFAULT_TABLE table=default.Table_4e88efe698fb4357af59132b292c500e [id=22e36fdb414e4cb6884c239ddba527b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.460624 6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 287e734d8ed64538a25a85ae0ca62a1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.461601 6027 tablet_service.cc:1511] Processing CreateTablet for tablet 524c11f83bc34c5fafd6c33d119ee926 (DEFAULT_TABLE table=default.Table_ae675838bcf846309b17e86c9b8abef1 [id=3cdbc7fb3fb94a679e1bcf6f65b8c4e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.461954 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 524c11f83bc34c5fafd6c33d119ee926. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.463503 6036 tablet_service.cc:1511] Processing CreateTablet for tablet 559d80ce55254cc2b868df5adf32bedb (DEFAULT_TABLE table=default.Table_aa6a5920d6334591884766939675ec50 [id=b9a1de0a20ed47028a700c6dcdae0d1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.463881 6036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 559d80ce55254cc2b868df5adf32bedb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.470005 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e04d16675443fc923a5f8216e292b6" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:22.473008 6025 tablet_service.cc:1511] Processing CreateTablet for tablet 5c9768e71e0640ceb110a19e53484044 (DEFAULT_TABLE table=default.Table_f51ff8d9bbeb4df183cff372b5f59ea3 [id=9867043eac6c46b38347465fb98c0a66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.480764 6180 tablet_service.cc:1558] Processing DeleteTablet for tablet 83dba06b0d0040889015fb052c642ec0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:22.481248 6180 tablet_service.cc:1511] Processing CreateTablet for tablet fb1ea962909b4e42a9c4fab048133077 (DEFAULT_TABLE table=default.Table_32b329b9fb0d4ea2a12965fdf2adfd24 [id=16b7e7794ca54bfca955d653a8ff0509]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.481689 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb1ea962909b4e42a9c4fab048133077. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.483098 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528fca12bfe04747830ad1d3bb323676" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:22.485406 6024 tablet_service.cc:1511] Processing CreateTablet for tablet cd215d72c9664285897129196624a58b (DEFAULT_TABLE table=default.Table_afb0915cafc4475889ceb6252cd0eb9c [id=477e6d8c228d4887be5f304f5cadd292]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.485822 6024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd215d72c9664285897129196624a58b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:22.485774 6137 leader_election.cc:343] T a75c4436a67f453e973a7a7645de79b1 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: a75c4436a67f453e973a7a7645de79b1
I20260923 19:50:22.485914 6137 leader_election.cc:304] T a75c4436a67f453e973a7a7645de79b1 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:22.486310 7700 raft_consensus.cc:2749] T a75c4436a67f453e973a7a7645de79b1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:22.488190 6026 tablet_service.cc:1558] Processing DeleteTablet for tablet 771ad1e82bd743e597aefe5edafe63ea with delete_type TABLET_DATA_DELETED (replaced by tablet 516982de5f8546c1b4be8eb5df615f21) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:22.490163 6030 tablet_service.cc:1511] Processing CreateTablet for tablet c1989e54d54e4c9daabd3727a2db0f40 (DEFAULT_TABLE table=default.Table_9be717e88e1e4262b2603dcc966e9979 [id=418dd46ddd4344c9b571b9567bcf2240]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.490633 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1989e54d54e4c9daabd3727a2db0f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.492669 6032 tablet_service.cc:1511] Processing CreateTablet for tablet fb1ea962909b4e42a9c4fab048133077 (DEFAULT_TABLE table=default.Table_32b329b9fb0d4ea2a12965fdf2adfd24 [id=16b7e7794ca54bfca955d653a8ff0509]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.493114 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb1ea962909b4e42a9c4fab048133077. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.490185 6022 tablet_service.cc:1511] Processing CreateTablet for tablet f45863a748ce4d2f94d1ad639c7e6bf7 (DEFAULT_TABLE table=default.Table_3d78c480be184d61b66155d65fa315a9 [id=33437a5849ae4ce8ab42ecb1d3c4e61c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.494431 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f45863a748ce4d2f94d1ad639c7e6bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.494480 6031 tablet_service.cc:1511] Processing CreateTablet for tablet fd4d9c2e4b7a4deda122379aeab67737 (DEFAULT_TABLE table=default.Table_9335f049ac99441a83a2dbe2cd1e2a56 [id=241daf6d418848cb8e7aecac8d25639e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.496268 6040 tablet_service.cc:1511] Processing CreateTablet for tablet ba47e3d0c32f47a39f9d7f021f3398f3 (DEFAULT_TABLE table=default.Table_1ad06306ba71468dbaa1a583e056a06d [id=b1214f534ecd4a27aa6d26cd65e45ce8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.497545 6033 tablet_service.cc:1511] Processing CreateTablet for tablet 2205316ed70543e5b3b001d88ab3ae5d (DEFAULT_TABLE table=default.Table_b46cc598bb3b40e3961a7f2a2967e3cf [id=aed58a235614422f89fbf259dca25ea9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.497612 6026 tablet_service.cc:1511] Processing CreateTablet for tablet 530a0fedaf9942bab6733365161e843c (DEFAULT_TABLE table=default.Table_5f6fd703ce9046b59580474f3aee2f7b [id=7b8af3758b2048b18641f68db57f9e47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.497665 7775 leader_election.cc:290] T 9ee02922d2be45f5a1473a53a6f253c4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:22.498706 6457 tablet_bootstrap.cc:492] T ba0453ef529344dfbab1130daa985fef P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:22.498973 6035 tablet_service.cc:1511] Processing CreateTablet for tablet ef0604c2a884465aab7bfe6a1d2d7da6 (DEFAULT_TABLE table=default.Table_21298e3a6a4143aeb230a266b5667d6f [id=31506da53a214adf8fe5dd0c7eb9f4b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.498703 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet 2205316ed70543e5b3b001d88ab3ae5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:22 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:22.501592 6457 ts_tablet_manager.cc:1403] T ba0453ef529344dfbab1130daa985fef P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.400s user 0.001s sys 0.005s
I20260923 19:50:22.501713 5797 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 34d62ab3d4aa457f8fea283cd9248a41 (table default.Table_71d7f590efb94aae8c345f9d9a620fc1 [id=b4e8e3f2a48a4b5496f506080b415805]). Expected version 1 got 0
I20260923 19:50:22.502732 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee02922d2be45f5a1473a53a6f253c4" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:22.503480 5996 leader_election.cc:343] T 9ee02922d2be45f5a1473a53a6f253c4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:22.504930 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c9768e71e0640ceb110a19e53484044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.505189 6023 tablet_service.cc:1511] Processing CreateTablet for tablet ed9fcf8818c543faa310d081249c6521 (DEFAULT_TABLE table=default.Table_9a23ee2e94444e61b9742cf0457c7384 [id=e578b633a64d4f87a57bf432564a999b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.507771 6458 ts_tablet_manager.cc:1929] T a926ff092e6e495e981be156421e8d72 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:22.508116 6029 tablet_service.cc:1511] Processing CreateTablet for tablet fb44c10b4f6148738306c617aac88b43 (DEFAULT_TABLE table=default.Table_ceb8ad1770064991add54f6cc371d9fc [id=239e3795bb11406ba1b75b9ccffcc245]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.508884 6106 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
I20260923 19:50:22.510385 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet f74e7cb3e5f54dfdb2280c795ce2ce53 (table default.Table_fb92f0dc809c49018d4300eaf32b6a8b [id=8325a8f159124a2da260e2be3ce69500]) successfully deleted
I20260923 19:50:22.510691 6458 log.cc:1199] T a926ff092e6e495e981be156421e8d72 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/a926ff092e6e495e981be156421e8d72
I20260923 19:50:22.511364 6458 ts_tablet_manager.cc:1950] T a926ff092e6e495e981be156421e8d72 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:22.513892 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd4d9c2e4b7a4deda122379aeab67737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.515271 6038 tablet_service.cc:1511] Processing CreateTablet for tablet 25a1122a9ed44525b53752f230b875af (DEFAULT_TABLE table=default.Table_0bf993fb53a243408934c3ce7812f300 [id=1dc5c4b9cfe242b099053cbb53aac5ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.514941 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet a926ff092e6e495e981be156421e8d72 (table default.Table_413519bded0c44f3b92a3710f13f69bb [id=8a617888464a4c8c85dbe8f93d6ef9fb]) successfully deleted
I20260923 19:50:22.516376 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 8e7e79de311543cf889e5cfc3faf2435 (DEFAULT_TABLE table=default.Table_478638fdb21b4fe399163e013b5bce2f [id=6da78931a85949529e8a77a25c0e3b26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.518857 6040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba47e3d0c32f47a39f9d7f021f3398f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.519161 6033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2205316ed70543e5b3b001d88ab3ae5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.519850 6023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed9fcf8818c543faa310d081249c6521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.520282 6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 530a0fedaf9942bab6733365161e843c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.520574 6038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25a1122a9ed44525b53752f230b875af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.520328 6458 tablet_replica.cc:333] T b87872fb6cc0400c86eddffb29c898e8 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:22.521438 6306 tablet_service.cc:1511] Processing CreateTablet for tablet 43daca2f4f8c41709b32224531e4ff26 (DEFAULT_TABLE table=default.Table_a7e155229f914ff4a728fe306c34c505 [id=2e6e248356cf46d7b9176e8575fc2b8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.521576 6458 raft_consensus.cc:2243] T b87872fb6cc0400c86eddffb29c898e8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:22.521714 6458 raft_consensus.cc:2272] T b87872fb6cc0400c86eddffb29c898e8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:22.521838 6306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43daca2f4f8c41709b32224531e4ff26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.522251 6458 ts_tablet_manager.cc:1916] T b87872fb6cc0400c86eddffb29c898e8 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:22.523478 6322 tablet_service.cc:1511] Processing CreateTablet for tablet 2101601e949e42eebebdfe54596f6d45 (DEFAULT_TABLE table=default.Table_4e659925285b492f84b4407a73a22df4 [id=6894e3baf112495d8bfe119642dea2f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.523804 6322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2101601e949e42eebebdfe54596f6d45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.525374 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef0604c2a884465aab7bfe6a1d2d7da6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.521291 6456 tablet_bootstrap.cc:492] T 684eb2576b4b4730813b993e36b242df P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:22.526607 6456 ts_tablet_manager.cc:1403] T 684eb2576b4b4730813b993e36b242df P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.173s user 0.008s sys 0.000s
I20260923 19:50:22.530062 6456 raft_consensus.cc:359] T 684eb2576b4b4730813b993e36b242df P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.533071 6456 raft_consensus.cc:385] T 684eb2576b4b4730813b993e36b242df P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:22.533213 6456 raft_consensus.cc:740] T 684eb2576b4b4730813b993e36b242df P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:22.533094 6022 tablet_service.cc:1511] Processing CreateTablet for tablet 01ec42e562c640abaac4ca1be0695738 (DEFAULT_TABLE table=default.Table_1897b70d41264c8bb98149a4706b6241 [id=f7599e54c37e41ec93052c8bbab8e22b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.536926 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb44c10b4f6148738306c617aac88b43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.537315 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01ec42e562c640abaac4ca1be0695738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.537258 6456 consensus_queue.cc:260] T 684eb2576b4b4730813b993e36b242df P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.538506 6456 ts_tablet_manager.cc:1434] T 684eb2576b4b4730813b993e36b242df P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260923 19:50:22.538548 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e7e79de311543cf889e5cfc3faf2435. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.539831 6021 tablet_service.cc:1511] Processing CreateTablet for tablet b4d0cb6f85c34dd5977898049a5d84ee (DEFAULT_TABLE table=default.Table_fb92f0dc809c49018d4300eaf32b6a8b [id=8325a8f159124a2da260e2be3ce69500]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.540266 6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4d0cb6f85c34dd5977898049a5d84ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.489809 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee02922d2be45f5a1473a53a6f253c4" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:22.544760 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 0fba5780da63463f8b6025e7c639a144 (DEFAULT_TABLE table=default.Table_fcfe761be2c94ee2ab52f12e87ed7fb7 [id=09b68217c16045eeb0c621540a404473]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.545193 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fba5780da63463f8b6025e7c639a144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.545610 6456 tablet_bootstrap.cc:492] T d35ff653bf8d41cfbcf83359402a8f6a P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:22.548357 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc151f4d78344efeada6d6e57af6eb9f" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:22.556023 7700 raft_consensus.cc:493] T 83dba06b0d0040889015fb052c642ec0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:22.556241 7700 raft_consensus.cc:515] T 83dba06b0d0040889015fb052c642ec0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.557062 7700 leader_election.cc:290] T 83dba06b0d0040889015fb052c642ec0 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:22.558548 6139 leader_election.cc:343] T 83dba06b0d0040889015fb052c642ec0 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 83dba06b0d0040889015fb052c642ec0
I20260923 19:50:22.559790 6315 tablet_service.cc:1511] Processing CreateTablet for tablet a47c860a430843388a71162e02b6ffae (DEFAULT_TABLE table=default.Table_41570ed681004d9ab578895331e71f3d [id=a3de07abc18b44d8a544da8e6591e9a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.561142 6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a47c860a430843388a71162e02b6ffae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.561374 6454 tablet_bootstrap.cc:492] T b87872fb6cc0400c86eddffb29c898e8 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:22.561578 6454 ts_tablet_manager.cc:1403] T b87872fb6cc0400c86eddffb29c898e8 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.375s user 0.013s sys 0.017s
I20260923 19:50:22.563992 6164 tablet_service.cc:1511] Processing CreateTablet for tablet ed9fcf8818c543faa310d081249c6521 (DEFAULT_TABLE table=default.Table_9a23ee2e94444e61b9742cf0457c7384 [id=e578b633a64d4f87a57bf432564a999b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.565052 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed9fcf8818c543faa310d081249c6521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.567793 6454 raft_consensus.cc:359] T b87872fb6cc0400c86eddffb29c898e8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.573171 6167 tablet_service.cc:1511] Processing CreateTablet for tablet fd4d9c2e4b7a4deda122379aeab67737 (DEFAULT_TABLE table=default.Table_9335f049ac99441a83a2dbe2cd1e2a56 [id=241daf6d418848cb8e7aecac8d25639e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.573650 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd4d9c2e4b7a4deda122379aeab67737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.574185 6181 tablet_service.cc:1511] Processing CreateTablet for tablet 2205316ed70543e5b3b001d88ab3ae5d (DEFAULT_TABLE table=default.Table_b46cc598bb3b40e3961a7f2a2967e3cf [id=aed58a235614422f89fbf259dca25ea9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.574807 6454 raft_consensus.cc:385] T b87872fb6cc0400c86eddffb29c898e8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:22.574967 6454 raft_consensus.cc:740] T b87872fb6cc0400c86eddffb29c898e8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:22.575122 6457 raft_consensus.cc:359] T ba0453ef529344dfbab1130daa985fef P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:22.575403 6457 raft_consensus.cc:385] T ba0453ef529344dfbab1130daa985fef P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:22.575506 6457 raft_consensus.cc:740] T ba0453ef529344dfbab1130daa985fef P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:22.575768 6457 consensus_queue.cc:260] T ba0453ef529344dfbab1130daa985fef P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:22.575268 6454 consensus_queue.cc:260] T b87872fb6cc0400c86eddffb29c898e8 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.576574 6454 ts_tablet_manager.cc:1434] T b87872fb6cc0400c86eddffb29c898e8 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260923 19:50:22.584158 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2205316ed70543e5b3b001d88ab3ae5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.586300 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_5bdbdee3baac47d5866b840863e76535"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:22.587080 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5bdbdee3baac47d5866b840863e76535 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:22.588179 6458 ts_tablet_manager.cc:1929] T b87872fb6cc0400c86eddffb29c898e8 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:22.588304 6458 log.cc:1199] T b87872fb6cc0400c86eddffb29c898e8 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/b87872fb6cc0400c86eddffb29c898e8
I20260923 19:50:22.588730 6458 ts_tablet_manager.cc:1950] T b87872fb6cc0400c86eddffb29c898e8 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:22.588874 6032 tablet_service.cc:1511] Processing CreateTablet for tablet dd8dec210cdd4654a0cddaccfdc5515e (DEFAULT_TABLE table=default.Table_13c4ea7cf77644a4ada7c2f3fa3b0fab [id=97151fcc96a74f69b0ae4895d239379b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.589340 6458 tablet_replica.cc:333] T 658253ff3d014361803e1aeda978e59a P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:22.589689 6458 raft_consensus.cc:2243] T 658253ff3d014361803e1aeda978e59a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:22.590011 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd8dec210cdd4654a0cddaccfdc5515e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.590123 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet b87872fb6cc0400c86eddffb29c898e8 (table default.Table_59a69335b281437498cea78a9cb3fadb [id=ac71e26491774bcd93d004a319b086c8]) successfully deleted
I20260923 19:50:22.593096 6030 tablet_service.cc:1511] Processing CreateTablet for tablet c4b38cbca5ca4d18b5985397ab229b70 (DEFAULT_TABLE table=default.Table_58fdbcba107b44b78bc5f5a04a636493 [id=40c6f43aa080498f9c2f0b9803153961]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.599963 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4b38cbca5ca4d18b5985397ab229b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.601125 5803 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a9b0868c631e4f55a22ad70293408696" } modify_external_catalogs: true
I20260923 19:50:22.601292 5803 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a9b0868c631e4f55a22ad70293408696" } modify_external_catalogs: true
I20260923 19:50:22.595739 6306 tablet_service.cc:1558] Processing DeleteTablet for tablet 684eb2576b4b4730813b993e36b242df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:22.604745 6458 raft_consensus.cc:2272] T 658253ff3d014361803e1aeda978e59a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:22.606217 6306 tablet_service.cc:1511] Processing CreateTablet for tablet 37de46eabdd84065975a8e5a3c3758c4 (DEFAULT_TABLE table=default.Table_ed0607fb34e24f6793003de00c2f4e8a [id=df08e612cea748d7885a2b764aa410fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.606750 6306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37de46eabdd84065975a8e5a3c3758c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.606865 6458 ts_tablet_manager.cc:1916] T 658253ff3d014361803e1aeda978e59a P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:22.613565 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 7e8facf019054ac79fea193f44fc6742
I20260923 19:50:22.615953 5803 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_54827ad1f0b04f789fc2533c59d86cd2" } modify_external_catalogs: true
I20260923 19:50:22.616247 5803 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_54827ad1f0b04f789fc2533c59d86cd2" } modify_external_catalogs: true
W20260923 19:50:22.601076 6280 leader_election.cc:343] T d39a64531dd24eb4aa1f7e0c418b985b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:22.623769 5803 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet f473e4e977b64825aa5b056c39f519fa
W20260923 19:50:22.623718 6280 leader_election.cc:343] T d39a64531dd24eb4aa1f7e0c418b985b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:22.624223 6280 leader_election.cc:343] T e6e04d16675443fc923a5f8216e292b6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:22.624315 6280 leader_election.cc:304] T e6e04d16675443fc923a5f8216e292b6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:22.624815 6280 leader_election.cc:343] T 528fca12bfe04747830ad1d3bb323676 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:22.624818 7802 raft_consensus.cc:2749] T e6e04d16675443fc923a5f8216e292b6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:22.624965 6280 leader_election.cc:304] T 528fca12bfe04747830ad1d3bb323676 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:22.625180 7802 raft_consensus.cc:2749] T 528fca12bfe04747830ad1d3bb323676 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:22.628865 7809 log.cc:927] Time spent T 1fcd1c1bfd2c437a955c34569605a6d4 P 61022dd7f2f14dc19aebe3af5f08f430: Append to log took a long time: real 0.056s user 0.000s sys 0.000s
I20260923 19:50:22.628253 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 6238d16b1be74dd88fd2e089fbd85d33 (table default.Table_ba9e77809f194febb243d6dc37df3ee0 [id=6cacf523bb724ea58690207d93819846]) successfully deleted
I20260923 19:50:22.632619 6454 tablet_bootstrap.cc:492] T b18548ba557f448880c5e617fc03cbe0 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:22.632635 6178 tablet_service.cc:1511] Processing CreateTablet for tablet ba47e3d0c32f47a39f9d7f021f3398f3 (DEFAULT_TABLE table=default.Table_1ad06306ba71468dbaa1a583e056a06d [id=b1214f534ecd4a27aa6d26cd65e45ce8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.637202 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba47e3d0c32f47a39f9d7f021f3398f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.638279 6169 tablet_service.cc:1511] Processing CreateTablet for tablet fb44c10b4f6148738306c617aac88b43 (DEFAULT_TABLE table=default.Table_ceb8ad1770064991add54f6cc371d9fc [id=239e3795bb11406ba1b75b9ccffcc245]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.638622 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb44c10b4f6148738306c617aac88b43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.638595 6176 tablet_service.cc:1511] Processing CreateTablet for tablet 25a1122a9ed44525b53752f230b875af (DEFAULT_TABLE table=default.Table_0bf993fb53a243408934c3ce7812f300 [id=1dc5c4b9cfe242b099053cbb53aac5ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.640313 6459 ts_tablet_manager.cc:1929] T 2948d729e1ec4dfca70789bcad513e52 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:22.640487 6459 log.cc:1199] T 2948d729e1ec4dfca70789bcad513e52 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/2948d729e1ec4dfca70789bcad513e52
I20260923 19:50:22.640839 6459 ts_tablet_manager.cc:1950] T 2948d729e1ec4dfca70789bcad513e52 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:22.641211 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 941) took 1679 ms. Trace:
I20260923 19:50:22.643760 6168 tablet_service.cc:1511] Processing CreateTablet for tablet 01ec42e562c640abaac4ca1be0695738 (DEFAULT_TABLE table=default.Table_1897b70d41264c8bb98149a4706b6241 [id=f7599e54c37e41ec93052c8bbab8e22b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.644120 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01ec42e562c640abaac4ca1be0695738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.644376 5803 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_96971b48003e446cb8778c53a97923f3" } modify_external_catalogs: true
I20260923 19:50:22.644591 5803 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_96971b48003e446cb8778c53a97923f3" } modify_external_catalogs: true
I20260923 19:50:22.646246 7700 raft_consensus.cc:493] T 035abecfbee7474d9dd048f35e28e867 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:22.649121 7790 raft_consensus.cc:493] T a01a86b6fd4b44d3808c2040525d7b61 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:22.649257 7790 raft_consensus.cc:515] T a01a86b6fd4b44d3808c2040525d7b61 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.650923 7790 leader_election.cc:290] T a01a86b6fd4b44d3808c2040525d7b61 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:22.655767 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_80caca78e1824947a667ade1a7ec3e71"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:22.656345 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80caca78e1824947a667ade1a7ec3e71 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:22.669440 5805 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b0b796ec295042f8a2b294c7dd1d6136" } modify_external_catalogs: true
I20260923 19:50:22.670147 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_1690d3f3d0e848f3bfd0fd61fa3670c4" } new_table_name: "default.Table_3091843faf2b445294c246ab74246b26" modify_external_catalogs: true
I20260923 19:50:22.670833 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_5b2c1127e8b54b4aa302b5e946dcd8fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:22.671376 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b2c1127e8b54b4aa302b5e946dcd8fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:22.672200 5802 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7f31586785874f0995ea2cb31c2796e2" } new_table_name: "default.Table_b263b668ecaa431cb33df9f5f573f17e" modify_external_catalogs: true
I20260923 19:50:22.672526 5799 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_881b324c0d704404a8ae93733a126fc6" } modify_external_catalogs: true
I20260923 19:50:22.673591 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_52506d2d13c545bea0757f1a2802d817" } new_table_name: "default.Table_b99d3f192eb04474b4b05c9309fb01f3" modify_external_catalogs: true
I20260923 19:50:22.674618 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_38a8b9b9f5ef4e75ab44c919e6c8015c" } new_table_name: "default.Table_d087f441e7bb49f7a030bbbb241f7359" modify_external_catalogs: true
I20260923 19:50:22.676820 7700 raft_consensus.cc:515] T 035abecfbee7474d9dd048f35e28e867 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.677513 7700 leader_election.cc:290] T 035abecfbee7474d9dd048f35e28e867 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:22.641351 6459 rpcz_store.cc:276] 0923 19:50:20.961844 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:20.961948 (+ 104us) service_pool.cc:224] Handling call
0923 19:50:22.398701 (+1436753us) ts_tablet_manager.cc:1151] Deleting tablet 2948d729e1ec4dfca70789bcad513e52
0923 19:50:22.398814 (+ 113us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:22.480554 (+ 81740us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:22.640264 (+159710us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:22.641195 (+ 931us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1436399}
I20260923 19:50:22.687462 6176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25a1122a9ed44525b53752f230b875af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.690387 6166 tablet_service.cc:1511] Processing CreateTablet for tablet b4d0cb6f85c34dd5977898049a5d84ee (DEFAULT_TABLE table=default.Table_fb92f0dc809c49018d4300eaf32b6a8b [id=8325a8f159124a2da260e2be3ce69500]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.691243 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4d0cb6f85c34dd5977898049a5d84ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.691113 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 942) took 1700 ms. Trace:
I20260923 19:50:22.691550 6459 rpcz_store.cc:276] 0923 19:50:20.990554 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:20.990624 (+ 70us) service_pool.cc:224] Handling call
0923 19:50:22.685943 (+1695319us) ts_tablet_manager.cc:1151] Deleting tablet d689f30677c04fb880778d6723b1f5ac
0923 19:50:22.690505 (+ 4562us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:22.691033 (+ 528us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1694800}
I20260923 19:50:22.695299 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 943) took 1657 ms. Trace:
I20260923 19:50:22.696090 6459 rpcz_store.cc:276] 0923 19:50:21.038193 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.039386 (+ 1193us) service_pool.cc:224] Handling call
0923 19:50:22.694280 (+1654894us) ts_tablet_manager.cc:1151] Deleting tablet 33a318872f6a4f838ed9f0c0260d4bfb
0923 19:50:22.694365 (+ 85us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:22.695149 (+ 784us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1651965}
I20260923 19:50:22.703272 6461 ts_tablet_manager.cc:1929] T 2e1c19a751904a6295897376e9c5ee56 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:22.703409 6461 log.cc:1199] T 2e1c19a751904a6295897376e9c5ee56 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/2e1c19a751904a6295897376e9c5ee56
I20260923 19:50:22.703833 6039 tablet_service.cc:1511] Processing CreateTablet for tablet 79c1326f5e9c4f0ba0707148cb9f264a (DEFAULT_TABLE table=default.Table_90f6ff642d1548868810ba9fc019170b [id=8222bb5bd4694b148c9654c6314e4888]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.706899 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 0fba5780da63463f8b6025e7c639a144 (DEFAULT_TABLE table=default.Table_fcfe761be2c94ee2ab52f12e87ed7fb7 [id=09b68217c16045eeb0c621540a404473]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.710453 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_0b43ff62cacf4c2abf3ed1bdc818625e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:22.711169 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0b43ff62cacf4c2abf3ed1bdc818625e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:22.714318 5799 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_881b324c0d704404a8ae93733a126fc6" } modify_external_catalogs: true
I20260923 19:50:22.715544 5805 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b0b796ec295042f8a2b294c7dd1d6136" } modify_external_catalogs: true
I20260923 19:50:22.716622 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79c1326f5e9c4f0ba0707148cb9f264a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.718624 6461 ts_tablet_manager.cc:1950] T 2e1c19a751904a6295897376e9c5ee56 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:22.719004 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 959) took 1787 ms. Trace:
I20260923 19:50:22.719094 6461 rpcz_store.cc:276] 0923 19:50:20.931711 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:20.952357 (+ 20646us) service_pool.cc:224] Handling call
0923 19:50:22.092557 (+1140200us) ts_tablet_manager.cc:1151] Deleting tablet 2e1c19a751904a6295897376e9c5ee56
0923 19:50:22.092570 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:22.213581 (+121011us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:22.580404 (+366823us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:22.718982 (+138578us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1139972}
I20260923 19:50:22.719543 6024 tablet_service.cc:1511] Processing CreateTablet for tablet 4737b8f458144727838355a19e85ac24 (DEFAULT_TABLE table=default.Table_7ac9b6906d0746dab9ddc8e5f177b78f [id=812e369fb75a4bf88fcf579c6a7184cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.719969 6024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4737b8f458144727838355a19e85ac24. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:22.722108 5995 leader_election.cc:343] T 9ee02922d2be45f5a1473a53a6f253c4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:22.722239 5995 leader_election.cc:304] T 9ee02922d2be45f5a1473a53a6f253c4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:22.726914 6461 tablet_replica.cc:333] T c5cb76fa5e084604aa58bf888cfe4852 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:22.736018 6025 tablet_service.cc:1511] Processing CreateTablet for tablet 2101601e949e42eebebdfe54596f6d45 (DEFAULT_TABLE table=default.Table_4e659925285b492f84b4407a73a22df4 [id=6894e3baf112495d8bfe119642dea2f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.736418 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2101601e949e42eebebdfe54596f6d45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.765460 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 50ab89b0386640bfb012c87f09d6f3a6 (DEFAULT_TABLE table=default.Table_34e4d53df0104f8293e479963158ec39 [id=dcc130f0b3514223880a7e109183725b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.766335 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50ab89b0386640bfb012c87f09d6f3a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.767766 6027 tablet_service.cc:1511] Processing CreateTablet for tablet a47c860a430843388a71162e02b6ffae (DEFAULT_TABLE table=default.Table_41570ed681004d9ab578895331e71f3d [id=a3de07abc18b44d8a544da8e6591e9a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.768918 6032 tablet_service.cc:1511] Processing CreateTablet for tablet 43daca2f4f8c41709b32224531e4ff26 (DEFAULT_TABLE table=default.Table_a7e155229f914ff4a728fe306c34c505 [id=2e6e248356cf46d7b9176e8575fc2b8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.773115 6035 tablet_service.cc:1511] Processing CreateTablet for tablet 37de46eabdd84065975a8e5a3c3758c4 (DEFAULT_TABLE table=default.Table_ed0607fb34e24f6793003de00c2f4e8a [id=df08e612cea748d7885a2b764aa410fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.781095 6040 tablet_service.cc:1511] Processing CreateTablet for tablet 94980b71d1d04a94b9b1d43f66e6baf4 (DEFAULT_TABLE table=default.Table_08a20ef0dba64e938efcbc71cdd2190e [id=4fd26eed28fb494d9603eab89439cf67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.783679 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e8facf019054ac79fea193f44fc6742 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:22 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:22.784299 6028 tablet_service.cc:1511] Processing CreateTablet for tablet caeb98aa3fbe4216b1672e6f8867f298 (DEFAULT_TABLE table=default.Table_5f9a8360065c42c6b42e7ab6deb71bdf [id=1e1ce17e7c394d7cbb8a4ec6e64dee8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.786602 6457 ts_tablet_manager.cc:1434] T ba0453ef529344dfbab1130daa985fef P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.285s user 0.007s sys 0.012s
I20260923 19:50:22.789141 6457 tablet_bootstrap.cc:492] T cf64073cdde748bc8ed3ce7580a71160 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:22.789923 7629 raft_consensus.cc:493] T 85f5ba9097674f9d889e178eaea4f0d7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:22.792948 6180 tablet_service.cc:1511] Processing CreateTablet for tablet c4b38cbca5ca4d18b5985397ab229b70 (DEFAULT_TABLE table=default.Table_58fdbcba107b44b78bc5f5a04a636493 [id=40c6f43aa080498f9c2f0b9803153961]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.793715 6166 tablet_service.cc:1511] Processing CreateTablet for tablet 79c1326f5e9c4f0ba0707148cb9f264a (DEFAULT_TABLE table=default.Table_90f6ff642d1548868810ba9fc019170b [id=8222bb5bd4694b148c9654c6314e4888]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.794826 6165 tablet_service.cc:1511] Processing CreateTablet for tablet 4737b8f458144727838355a19e85ac24 (DEFAULT_TABLE table=default.Table_7ac9b6906d0746dab9ddc8e5f177b78f [id=812e369fb75a4bf88fcf579c6a7184cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.794940 6461 raft_consensus.cc:2243] T c5cb76fa5e084604aa58bf888cfe4852 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:22.795105 6461 raft_consensus.cc:2272] T c5cb76fa5e084604aa58bf888cfe4852 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:22.795658 6461 ts_tablet_manager.cc:1916] T c5cb76fa5e084604aa58bf888cfe4852 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:22.796337 7775 raft_consensus.cc:2749] T 9ee02922d2be45f5a1473a53a6f253c4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:22.796701 6454 tablet_bootstrap.cc:654] T b18548ba557f448880c5e617fc03cbe0 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:22.797848 6173 tablet_service.cc:1511] Processing CreateTablet for tablet dd8dec210cdd4654a0cddaccfdc5515e (DEFAULT_TABLE table=default.Table_13c4ea7cf77644a4ada7c2f3fa3b0fab [id=97151fcc96a74f69b0ae4895d239379b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.798671 6171 tablet_service.cc:1511] Processing CreateTablet for tablet 2101601e949e42eebebdfe54596f6d45 (DEFAULT_TABLE table=default.Table_4e659925285b492f84b4407a73a22df4 [id=6894e3baf112495d8bfe119642dea2f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.790122 7629 raft_consensus.cc:515] T 85f5ba9097674f9d889e178eaea4f0d7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:22.800598 6174 tablet_service.cc:1511] Processing CreateTablet for tablet a47c860a430843388a71162e02b6ffae (DEFAULT_TABLE table=default.Table_41570ed681004d9ab578895331e71f3d [id=a3de07abc18b44d8a544da8e6591e9a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.800974 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a47c860a430843388a71162e02b6ffae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.800957 6177 tablet_service.cc:1511] Processing CreateTablet for tablet 43daca2f4f8c41709b32224531e4ff26 (DEFAULT_TABLE table=default.Table_a7e155229f914ff4a728fe306c34c505 [id=2e6e248356cf46d7b9176e8575fc2b8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.806038 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43daca2f4f8c41709b32224531e4ff26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.811110 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37de46eabdd84065975a8e5a3c3758c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.812983 7700 raft_consensus.cc:493] T b87872fb6cc0400c86eddffb29c898e8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:22.813135 7700 raft_consensus.cc:515] T b87872fb6cc0400c86eddffb29c898e8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.814056 6040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94980b71d1d04a94b9b1d43f66e6baf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.814181 7700 leader_election.cc:290] T b87872fb6cc0400c86eddffb29c898e8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:22.814738 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fba5780da63463f8b6025e7c639a144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.815055 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79c1326f5e9c4f0ba0707148cb9f264a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.815215 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4b38cbca5ca4d18b5985397ab229b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.816227 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caeb98aa3fbe4216b1672e6f8867f298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.811088 7629 leader_election.cc:290] T 85f5ba9097674f9d889e178eaea4f0d7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:22.825314 6171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2101601e949e42eebebdfe54596f6d45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.830780 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 5272f93fad4944679302f94257d422ed (DEFAULT_TABLE table=default.Table_d50291ec9ea0471fa057aa648cf81187 [id=8c8ca5b5f58e462a8a2f3d7b373ef49e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.835260 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a47c860a430843388a71162e02b6ffae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.835840 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd8dec210cdd4654a0cddaccfdc5515e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.839090 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5272f93fad4944679302f94257d422ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.840567 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 9e20d623668646c688fbd82d2cbc7138 (DEFAULT_TABLE table=default.Table_ffc6ba8328d44410bccf50fc1273e92e [id=b3220a45d9764d2eb6c82d9783f21b5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.842708 6021 tablet_service.cc:1511] Processing CreateTablet for tablet 1725eba2072e41be8ef0f40a1b37dd5e (DEFAULT_TABLE table=default.Table_3acadd8cadca4312aa3ab2ff02db21dc [id=e3bf274979544c6c8ec47d35fae36a80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.843058 6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1725eba2072e41be8ef0f40a1b37dd5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.844960 6177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43daca2f4f8c41709b32224531e4ff26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.847870 6026 tablet_service.cc:1511] Processing CreateTablet for tablet b43f6c3b02254d9f8ac00f5c4d2cf4e2 (DEFAULT_TABLE table=default.Table_513c611bb84f4cd298d10c9d544be1dc [id=239e235c740e4f369c40cab3982061a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.848242 6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b43f6c3b02254d9f8ac00f5c4d2cf4e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.848734 6165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4737b8f458144727838355a19e85ac24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.848747 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e20d623668646c688fbd82d2cbc7138. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:22.851622 5802 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e076b89526a24344bea591eccfdde1e9 consensus state has no leader
W20260923 19:50:22.852989 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 690cf009543d40ba94cdde54274703d2 has no consensus state
W20260923 19:50:22.853473 5995 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 131371us
I20260923 19:50:22.857625 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 8c5ac79e5fa2438a87db948792d448b1
I20260923 19:50:22.859174 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 944) took 1811 ms. Trace:
I20260923 19:50:22.860167 6060 raft_consensus.cc:1275] T d39a64531dd24eb4aa1f7e0c418b985b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Refusing update from remote peer 2bf41435f70447f19992d368ca6b46bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:50:22.860735 6459 rpcz_store.cc:276] 0923 19:50:21.047344 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.049965 (+ 2621us) service_pool.cc:224] Handling call
0923 19:50:22.698961 (+1648996us) ts_tablet_manager.cc:1151] Deleting tablet ce42c5de0cd3435b85fcfca92d69cdd5
0923 19:50:22.699041 (+ 80us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:22.859147 (+160106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1639638}
W20260923 19:50:22.859213 6137 leader_election.cc:343] T 83dba06b0d0040889015fb052c642ec0 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 83dba06b0d0040889015fb052c642ec0
I20260923 19:50:22.861706 6137 leader_election.cc:304] T 83dba06b0d0040889015fb052c642ec0 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:22.862130 6137 leader_election.cc:343] T a01a86b6fd4b44d3808c2040525d7b61 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: a01a86b6fd4b44d3808c2040525d7b61
W20260923 19:50:22.862296 6137 leader_election.cc:343] T 035abecfbee7474d9dd048f35e28e867 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 035abecfbee7474d9dd048f35e28e867
W20260923 19:50:22.862442 6137 leader_election.cc:343] T b87872fb6cc0400c86eddffb29c898e8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: b87872fb6cc0400c86eddffb29c898e8
I20260923 19:50:22.862706 7700 raft_consensus.cc:2749] T 83dba06b0d0040889015fb052c642ec0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:22.866405 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 2e1c19a751904a6295897376e9c5ee56 (table default.Table_4761dd5028c84fd1beaa780170cbec4e [id=1b8502abd3df41d29e789b845fb0e984]) successfully deleted
I20260923 19:50:22.868094 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c5ac79e5fa2438a87db948792d448b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:22 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:22.867359 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_955b9947ea484161a6d4c16106d7d7be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:22.875564 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_955b9947ea484161a6d4c16106d7d7be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:22.868839 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2d8a5ec91fc84026aa31a41f4cca5d07 consensus state has no leader
I20260923 19:50:22.869194 5799 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet c53b817e3ed7419b904a3c4b1c83e59f
I20260923 19:50:22.870137 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet a55b2ff045d648339d7e207f13e2fa27
I20260923 19:50:22.878175 6306 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e8facf019054ac79fea193f44fc6742 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:22 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:22.871019 5800 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1aed1eee3d914dcab3b837bf9e7a831d consensus state has no leader
I20260923 19:50:22.878578 6315 tablet_service.cc:1511] Processing CreateTablet for tablet 94980b71d1d04a94b9b1d43f66e6baf4 (DEFAULT_TABLE table=default.Table_08a20ef0dba64e938efcbc71cdd2190e [id=4fd26eed28fb494d9603eab89439cf67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.878945 6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94980b71d1d04a94b9b1d43f66e6baf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.879825 6310 tablet_service.cc:1511] Processing CreateTablet for tablet b43f6c3b02254d9f8ac00f5c4d2cf4e2 (DEFAULT_TABLE table=default.Table_513c611bb84f4cd298d10c9d544be1dc [id=239e235c740e4f369c40cab3982061a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.880100 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b43f6c3b02254d9f8ac00f5c4d2cf4e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.880529 6325 tablet_service.cc:1511] Processing CreateTablet for tablet caeb98aa3fbe4216b1672e6f8867f298 (DEFAULT_TABLE table=default.Table_5f9a8360065c42c6b42e7ab6deb71bdf [id=1e1ce17e7c394d7cbb8a4ec6e64dee8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.880740 6316 tablet_service.cc:1511] Processing CreateTablet for tablet 9e20d623668646c688fbd82d2cbc7138 (DEFAULT_TABLE table=default.Table_ffc6ba8328d44410bccf50fc1273e92e [id=b3220a45d9764d2eb6c82d9783f21b5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.880817 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caeb98aa3fbe4216b1672e6f8867f298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.881011 6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e20d623668646c688fbd82d2cbc7138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.881731 6306 tablet_service.cc:1511] Processing CreateTablet for tablet 5272f93fad4944679302f94257d422ed (DEFAULT_TABLE table=default.Table_d50291ec9ea0471fa057aa648cf81187 [id=8c8ca5b5f58e462a8a2f3d7b373ef49e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.881950 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f5ba9097674f9d889e178eaea4f0d7" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:22.882372 6459 tablet_replica.cc:333] T 6ac04be575704a69994f98e00411a254 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:22.882511 6306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5272f93fad4944679302f94257d422ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.882714 6459 raft_consensus.cc:2243] T 6ac04be575704a69994f98e00411a254 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:22.882972 6459 raft_consensus.cc:2272] T 6ac04be575704a69994f98e00411a254 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:22.884658 5995 leader_election.cc:343] T 85f5ba9097674f9d889e178eaea4f0d7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:22.885246 6459 ts_tablet_manager.cc:1916] T 6ac04be575704a69994f98e00411a254 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:22.888439 6461 ts_tablet_manager.cc:1929] T c5cb76fa5e084604aa58bf888cfe4852 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:22.888558 6461 log.cc:1199] T c5cb76fa5e084604aa58bf888cfe4852 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/c5cb76fa5e084604aa58bf888cfe4852
I20260923 19:50:22.879609 6308 tablet_service.cc:1511] Processing CreateTablet for tablet 1725eba2072e41be8ef0f40a1b37dd5e (DEFAULT_TABLE table=default.Table_3acadd8cadca4312aa3ab2ff02db21dc [id=e3bf274979544c6c8ec47d35fae36a80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.898651 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1725eba2072e41be8ef0f40a1b37dd5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.900333 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet a55b2ff045d648339d7e207f13e2fa27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:22 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:22.900574 6457 tablet_bootstrap.cc:654] T cf64073cdde748bc8ed3ce7580a71160 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:22.901031 6307 tablet_service.cc:1511] Processing CreateTablet for tablet 50ab89b0386640bfb012c87f09d6f3a6 (DEFAULT_TABLE table=default.Table_34e4d53df0104f8293e479963158ec39 [id=dcc130f0b3514223880a7e109183725b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:22.901432 6307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50ab89b0386640bfb012c87f09d6f3a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:22.901641 6321 tablet_service.cc:1558] Processing DeleteTablet for tablet c53b817e3ed7419b904a3c4b1c83e59f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:22 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:22.902525 6461 ts_tablet_manager.cc:1950] T c5cb76fa5e084604aa58bf888cfe4852 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:22.903193 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 960) took 1950 ms. Trace:
I20260923 19:50:22.903275 6461 rpcz_store.cc:276] 0923 19:50:20.952731 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:20.952771 (+ 40us) service_pool.cc:224] Handling call
0923 19:50:22.726836 (+1774065us) ts_tablet_manager.cc:1151] Deleting tablet c5cb76fa5e084604aa58bf888cfe4852
0923 19:50:22.726855 (+ 19us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:22.804802 (+ 77947us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:22.888385 (+ 83583us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:22.903176 (+ 14791us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67787,"tablet-delete.queue_time_us":1773922}
I20260923 19:50:22.909981 6317 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c5ac79e5fa2438a87db948792d448b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:22 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:22.910992 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 962) took 1882 ms. Trace:
I20260923 19:50:22.911077 6461 rpcz_store.cc:276] 0923 19:50:21.028948 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.039622 (+ 10674us) service_pool.cc:224] Handling call
0923 19:50:22.910819 (+1871197us) ts_tablet_manager.cc:1151] Deleting tablet d689f30677c04fb880778d6723b1f5ac
0923 19:50:22.910833 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:22.910972 (+ 139us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1870988}
I20260923 19:50:22.911290 6456 tablet_bootstrap.cc:654] T d35ff653bf8d41cfbcf83359402a8f6a P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:22.911379 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 964) took 1849 ms. Trace:
I20260923 19:50:22.911440 6461 rpcz_store.cc:276] 0923 19:50:21.061743 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.062931 (+ 1188us) service_pool.cc:224] Handling call
0923 19:50:22.911290 (+1848359us) ts_tablet_manager.cc:1151] Deleting tablet ce42c5de0cd3435b85fcfca92d69cdd5
0923 19:50:22.911299 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:22.911366 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1845490}
I20260923 19:50:22.911698 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 963) took 1850 ms. Trace:
I20260923 19:50:22.911760 6461 rpcz_store.cc:276] 0923 19:50:21.061638 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.061784 (+ 146us) service_pool.cc:224] Handling call
0923 19:50:22.911617 (+1849833us) ts_tablet_manager.cc:1151] Deleting tablet 33a318872f6a4f838ed9f0c0260d4bfb
0923 19:50:22.911624 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:22.911686 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1845735}
I20260923 19:50:22.912027 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 965) took 1791 ms. Trace:
I20260923 19:50:22.912081 6461 rpcz_store.cc:276] 0923 19:50:21.120206 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.120551 (+ 345us) service_pool.cc:224] Handling call
0923 19:50:22.911942 (+1791391us) ts_tablet_manager.cc:1151] Deleting tablet 940d876042844020833ccc2347d67c4c
0923 19:50:22.911950 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:22.912015 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1791223}
I20260923 19:50:22.912279 6461 tablet_replica.cc:333] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:22.912463 6461 raft_consensus.cc:2243] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:22.912768 6461 raft_consensus.cc:2272] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:22.913929 6461 ts_tablet_manager.cc:1916] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:22.927049 6461 ts_tablet_manager.cc:1929] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:22.927618 6461 log.cc:1199] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/6ac04be575704a69994f98e00411a254
I20260923 19:50:22.929311 6461 ts_tablet_manager.cc:1950] T 6ac04be575704a69994f98e00411a254 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:22.930092 6458 ts_tablet_manager.cc:1929] T 658253ff3d014361803e1aeda978e59a P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:22.930212 6458 log.cc:1199] T 658253ff3d014361803e1aeda978e59a P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/658253ff3d014361803e1aeda978e59a
I20260923 19:50:22.930492 6458 ts_tablet_manager.cc:1950] T 658253ff3d014361803e1aeda978e59a P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:22.930828 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 969) took 1263 ms. Trace:
I20260923 19:50:22.930917 6458 rpcz_store.cc:276] 0923 19:50:21.667656 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.667709 (+ 53us) service_pool.cc:224] Handling call
0923 19:50:22.589291 (+921582us) ts_tablet_manager.cc:1151] Deleting tablet 658253ff3d014361803e1aeda978e59a
0923 19:50:22.589301 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:22.870923 (+281622us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:22.930031 (+ 59108us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:22.930808 (+ 777us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":921419}
I20260923 19:50:22.931326 6458 tablet_replica.cc:333] T f7cf45d4c4d3480288698682c1c85869 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:22.931516 6458 raft_consensus.cc:2243] T f7cf45d4c4d3480288698682c1c85869 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:22.931684 6458 raft_consensus.cc:2272] T f7cf45d4c4d3480288698682c1c85869 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:22.932250 6458 ts_tablet_manager.cc:1916] T f7cf45d4c4d3480288698682c1c85869 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:22.933296 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 966) took 1812 ms. Trace:
I20260923 19:50:22.934101 6454 tablet_bootstrap.cc:492] T b18548ba557f448880c5e617fc03cbe0 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:22.934270 6454 ts_tablet_manager.cc:1403] T b18548ba557f448880c5e617fc03cbe0 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.302s user 0.003s sys 0.003s
I20260923 19:50:22.933638 6461 rpcz_store.cc:276] 0923 19:50:21.120892 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.122182 (+ 1290us) service_pool.cc:224] Handling call
0923 19:50:22.912242 (+1790060us) ts_tablet_manager.cc:1151] Deleting tablet 6ac04be575704a69994f98e00411a254
0923 19:50:22.912250 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:22.917832 (+ 5582us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:22.926772 (+ 8940us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:22.933186 (+ 6414us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1789905}
I20260923 19:50:22.935912 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 967) took 1732 ms. Trace:
I20260923 19:50:22.936343 6461 rpcz_store.cc:276] 0923 19:50:21.203422 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.205054 (+ 1632us) service_pool.cc:224] Handling call
0923 19:50:22.935279 (+1730225us) ts_tablet_manager.cc:1151] Deleting tablet 1b7d35282dd148e7bfcf1277d34002bf
0923 19:50:22.935293 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:22.935698 (+ 405us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1729898}
I20260923 19:50:22.936977 6454 raft_consensus.cc:359] T b18548ba557f448880c5e617fc03cbe0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.937182 6454 raft_consensus.cc:385] T b18548ba557f448880c5e617fc03cbe0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:22.937233 6454 raft_consensus.cc:740] T b18548ba557f448880c5e617fc03cbe0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
W20260923 19:50:22.937374 7812 log.cc:927] Time spent T 34d62ab3d4aa457f8fea283cd9248a41 P 2bf41435f70447f19992d368ca6b46bd: Append to log took a long time: real 0.068s user 0.000s sys 0.000s
I20260923 19:50:22.937436 6454 consensus_queue.cc:260] T b18548ba557f448880c5e617fc03cbe0 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.939196 6454 ts_tablet_manager.cc:1434] T b18548ba557f448880c5e617fc03cbe0 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260923 19:50:22.939505 6454 tablet_bootstrap.cc:492] T c7369a5fc87f4b70bcfbe052ef021771 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:22.939926 6461 tablet_replica.cc:333] T 2526884ab0ef404aaf93051cc842c695 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:22.940138 5797 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet ad29d22a82434023991ffcacf7f9bee5 (table default.Table_0eb28975495e4bedaf7c538454e525f6 [id=ea52a2330cd643e486e5b348dabbd295]). Expected version 1 got 0
I20260923 19:50:22.940920 6461 raft_consensus.cc:2243] T 2526884ab0ef404aaf93051cc842c695 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:22.941002 5797 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 34d62ab3d4aa457f8fea283cd9248a41 (table default.Table_71d7f590efb94aae8c345f9d9a620fc1 [id=b4e8e3f2a48a4b5496f506080b415805]). Expected version 1 got 0
I20260923 19:50:22.941541 6461 raft_consensus.cc:2272] T 2526884ab0ef404aaf93051cc842c695 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:22.943444 6461 ts_tablet_manager.cc:1916] T 2526884ab0ef404aaf93051cc842c695 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:22.957087 6461 ts_tablet_manager.cc:1929] T 2526884ab0ef404aaf93051cc842c695 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:22.958139 6461 log.cc:1199] T 2526884ab0ef404aaf93051cc842c695 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/2526884ab0ef404aaf93051cc842c695
I20260923 19:50:22.961580 6461 ts_tablet_manager.cc:1950] T 2526884ab0ef404aaf93051cc842c695 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:22.963352 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 968) took 1644 ms. Trace:
I20260923 19:50:22.963682 6461 rpcz_store.cc:276] 0923 19:50:21.318620 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.318679 (+ 59us) service_pool.cc:224] Handling call
0923 19:50:22.937597 (+1618918us) ts_tablet_manager.cc:1151] Deleting tablet 2526884ab0ef404aaf93051cc842c695
0923 19:50:22.939775 (+ 2178us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:22.949339 (+ 9564us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:22.957011 (+ 7672us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:22.963300 (+ 6289us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1618695}
I20260923 19:50:22.964787 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 972) took 1585 ms. Trace:
I20260923 19:50:22.964995 6461 rpcz_store.cc:276] 0923 19:50:21.378924 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.378976 (+ 52us) service_pool.cc:224] Handling call
0923 19:50:22.964592 (+1585616us) ts_tablet_manager.cc:1151] Deleting tablet c500791905944480840c25929bc7bbe1
0923 19:50:22.964627 (+ 35us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:22.964768 (+ 141us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1585386}
I20260923 19:50:22.965693 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 974) took 1586 ms. Trace:
I20260923 19:50:22.965919 6461 rpcz_store.cc:276] 0923 19:50:21.379166 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.379257 (+ 91us) service_pool.cc:224] Handling call
0923 19:50:22.965553 (+1586296us) ts_tablet_manager.cc:1151] Deleting tablet a5cd258b6ff44e3db0d4cb66b51874b0
0923 19:50:22.965561 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:22.965679 (+ 118us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1586150}
I20260923 19:50:22.966519 6461 tablet_replica.cc:333] T 98f61ace3a984938ace1fedbaa1dafa3 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:22.966920 6461 raft_consensus.cc:2243] T 98f61ace3a984938ace1fedbaa1dafa3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:22.967203 6461 raft_consensus.cc:2272] T 98f61ace3a984938ace1fedbaa1dafa3 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:22.968266 6461 ts_tablet_manager.cc:1916] T 98f61ace3a984938ace1fedbaa1dafa3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:22.969113 7700 raft_consensus.cc:493] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:22.971499 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 2948d729e1ec4dfca70789bcad513e52 (table default.Table_0fabac277720489788ff4ee29635ba66 [id=ff040ccffd9c4e24be8e0eaafa134785]) successfully deleted
W20260923 19:50:22.972164 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet d689f30677c04fb880778d6723b1f5ac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d689f30677c04fb880778d6723b1f5ac already in progress: creating tablet
W20260923 19:50:22.972796 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 33a318872f6a4f838ed9f0c0260d4bfb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33a318872f6a4f838ed9f0c0260d4bfb already in progress: creating tablet
W20260923 19:50:22.977831 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet ce42c5de0cd3435b85fcfca92d69cdd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce42c5de0cd3435b85fcfca92d69cdd5 already in progress: creating tablet
I20260923 19:50:22.978353 6461 ts_tablet_manager.cc:1929] T 98f61ace3a984938ace1fedbaa1dafa3 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:22.978603 6461 log.cc:1199] T 98f61ace3a984938ace1fedbaa1dafa3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/98f61ace3a984938ace1fedbaa1dafa3
I20260923 19:50:22.979297 6461 ts_tablet_manager.cc:1950] T 98f61ace3a984938ace1fedbaa1dafa3 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:22.980712 6454 tablet_bootstrap.cc:654] T c7369a5fc87f4b70bcfbe052ef021771 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:22.980665 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 975) took 1601 ms. Trace:
I20260923 19:50:22.980794 6461 rpcz_store.cc:276] 0923 19:50:21.379298 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.379428 (+ 130us) service_pool.cc:224] Handling call
0923 19:50:22.966457 (+1587029us) ts_tablet_manager.cc:1151] Deleting tablet 98f61ace3a984938ace1fedbaa1dafa3
0923 19:50:22.966466 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:22.973731 (+ 7265us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:22.978286 (+ 4555us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:22.980646 (+ 2360us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1586908}
I20260923 19:50:22.969249 7700 raft_consensus.cc:515] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:22.981606 6461 tablet_replica.cc:333] T 02fa9052a7054659baf9b07b770bb538 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:22.981812 7700 leader_election.cc:290] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:22.982875 6461 raft_consensus.cc:2243] T 02fa9052a7054659baf9b07b770bb538 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260923 19:50:22.983261 6137 leader_election.cc:343] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: d8c8bfa9b7424b9f80f76e0bb05cbc0c
I20260923 19:50:22.983510 6461 raft_consensus.cc:2272] T 02fa9052a7054659baf9b07b770bb538 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:22.984707 6461 ts_tablet_manager.cc:1916] T 02fa9052a7054659baf9b07b770bb538 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:22.994473 7256 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s user 0.012s sys 0.031s
W20260923 19:50:22.994648 7256 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s user 0.012s sys 0.031s
I20260923 19:50:22.994910 6461 ts_tablet_manager.cc:1929] T 02fa9052a7054659baf9b07b770bb538 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:22.995195 6461 log.cc:1199] T 02fa9052a7054659baf9b07b770bb538 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/02fa9052a7054659baf9b07b770bb538
I20260923 19:50:22.995780 6461 ts_tablet_manager.cc:1950] T 02fa9052a7054659baf9b07b770bb538 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:22.997136 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 969) took 1618 ms. Trace:
I20260923 19:50:22.997345 6461 rpcz_store.cc:276] 0923 19:50:21.378521 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.379570 (+ 1049us) service_pool.cc:224] Handling call
0923 19:50:22.981534 (+1601964us) ts_tablet_manager.cc:1151] Deleting tablet 02fa9052a7054659baf9b07b770bb538
0923 19:50:22.981568 (+ 34us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:22.990122 (+ 8554us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:22.994829 (+ 4707us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:22.997112 (+ 2283us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1601847}
I20260923 19:50:22.998533 6461 tablet_replica.cc:333] T 2852e91ccd0c44b3b16f8189e57575d7 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:22.999459 6461 raft_consensus.cc:2243] T 2852e91ccd0c44b3b16f8189e57575d7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:23.000059 6461 raft_consensus.cc:2272] T 2852e91ccd0c44b3b16f8189e57575d7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:23.001266 6461 ts_tablet_manager.cc:1916] T 2852e91ccd0c44b3b16f8189e57575d7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:23.007635 6280 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 382223us
W20260923 19:50:23.008810 6280 consensus_peers.cc:597] T d39a64531dd24eb4aa1f7e0c418b985b P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260923 19:50:23.009104 6280 leader_election.cc:343] T fc151f4d78344efeada6d6e57af6eb9f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:23.009308 6280 leader_election.cc:304] T fc151f4d78344efeada6d6e57af6eb9f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:23.009586 7802 raft_consensus.cc:2749] T fc151f4d78344efeada6d6e57af6eb9f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:23.010082 6279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.143.193:39887, user_credentials={real_user=slave}} blocked reactor thread for 287302us
I20260923 19:50:23.013258 6461 ts_tablet_manager.cc:1929] T 2852e91ccd0c44b3b16f8189e57575d7 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:23.013603 6461 log.cc:1199] T 2852e91ccd0c44b3b16f8189e57575d7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/2852e91ccd0c44b3b16f8189e57575d7
I20260923 19:50:23.014720 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_5678be025a834aa88d502c41b36d6d3e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:23.014806 5797 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7ce588248ce944fc878bbe47bbbbc8fe" } new_table_name: "default.Table_c75b1c5a3f7e4e4eb1da292df4ee9e08" modify_external_catalogs: true
I20260923 19:50:23.015147 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_bc1d6b30c09142929d85e4cc6da64601" } modify_external_catalogs: true
I20260923 19:50:23.015265 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_bc1d6b30c09142929d85e4cc6da64601" } modify_external_catalogs: true
W20260923 19:50:23.015295 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5678be025a834aa88d502c41b36d6d3e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:23.016357 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_20e0bdcca82249c2b0afd8e0e7b82207"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:23.016780 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_20e0bdcca82249c2b0afd8e0e7b82207 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:23.017867 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_b1dec095ad12408aaad8e803a2290816"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:23.018273 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b1dec095ad12408aaad8e803a2290816 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:23.019371 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_a3507ac7adf44658b5b94187850e14c1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:23.019804 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3507ac7adf44658b5b94187850e14c1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:23.020358 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet c5cb76fa5e084604aa58bf888cfe4852 (table default.Table_1a74b652ec7a4165b28643c452000d6d [id=74399f12686743ebbd14943c316be210]) successfully deleted
I20260923 19:50:23.016433 6035 tablet_service.cc:1558] Processing DeleteTablet for tablet c53b817e3ed7419b904a3c4b1c83e59f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:22 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:23.016805 6040 tablet_service.cc:1558] Processing DeleteTablet for tablet a55b2ff045d648339d7e207f13e2fa27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:22 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:23.017968 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet ba0453ef529344dfbab1130daa985fef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:23.020120 7817 raft_consensus.cc:493] T ce6b86f947ce420994eaa5ff39ad9c87 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:23.021258 7817 raft_consensus.cc:515] T ce6b86f947ce420994eaa5ff39ad9c87 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:23.021867 7817 leader_election.cc:290] T ce6b86f947ce420994eaa5ff39ad9c87 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:23.022324 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce6b86f947ce420994eaa5ff39ad9c87" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:23.022771 5995 leader_election.cc:343] T ce6b86f947ce420994eaa5ff39ad9c87 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:23.014189 6461 ts_tablet_manager.cc:1950] T 2852e91ccd0c44b3b16f8189e57575d7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:23.024228 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 970) took 1645 ms. Trace:
I20260923 19:50:23.024411 6461 rpcz_store.cc:276] 0923 19:50:21.378673 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.379707 (+ 1034us) service_pool.cc:224] Handling call
0923 19:50:22.998335 (+1618628us) ts_tablet_manager.cc:1151] Deleting tablet 2852e91ccd0c44b3b16f8189e57575d7
0923 19:50:22.998349 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.006201 (+ 7852us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.013179 (+ 6978us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.024210 (+ 11031us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1618464}
I20260923 19:50:23.025100 6461 tablet_replica.cc:333] T f8052b05169b4673b387ac8b716ffc4e P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:23.025425 6461 raft_consensus.cc:2243] T f8052b05169b4673b387ac8b716ffc4e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:23.025664 6461 raft_consensus.cc:2272] T f8052b05169b4673b387ac8b716ffc4e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:23.026758 6461 ts_tablet_manager.cc:1916] T f8052b05169b4673b387ac8b716ffc4e P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:23.027035 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f5ba9097674f9d889e178eaea4f0d7" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:23.028365 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce6b86f947ce420994eaa5ff39ad9c87" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:23.030741 7802 consensus_queue.cc:1048] T d39a64531dd24eb4aa1f7e0c418b985b P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:23.040009 7817 raft_consensus.cc:493] T 397ec5e49673406cb26a2efab0ad8401 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:23.040143 7817 raft_consensus.cc:515] T 397ec5e49673406cb26a2efab0ad8401 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:23.040712 7817 leader_election.cc:290] T 397ec5e49673406cb26a2efab0ad8401 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:23.041122 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec5e49673406cb26a2efab0ad8401" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:23.041651 5995 leader_election.cc:343] T 397ec5e49673406cb26a2efab0ad8401 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:23.043717 7831 tablet.cc:1751] T 8d87f05f29bd476386ff6516676ce31a P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:23.045943 7817 raft_consensus.cc:493] T ba0453ef529344dfbab1130daa985fef P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:23.046099 7817 raft_consensus.cc:515] T ba0453ef529344dfbab1130daa985fef P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:23.046720 7817 leader_election.cc:290] T ba0453ef529344dfbab1130daa985fef P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:23.054531 7833 tablet.cc:1751] T 1fcd1c1bfd2c437a955c34569605a6d4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:23.059382 6461 ts_tablet_manager.cc:1929] T f8052b05169b4673b387ac8b716ffc4e P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:23.060078 6461 log.cc:1199] T f8052b05169b4673b387ac8b716ffc4e P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/f8052b05169b4673b387ac8b716ffc4e
I20260923 19:50:23.061264 6461 ts_tablet_manager.cc:1950] T f8052b05169b4673b387ac8b716ffc4e P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:23.062584 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 971) took 1683 ms. Trace:
I20260923 19:50:23.062965 6461 rpcz_store.cc:276] 0923 19:50:21.378784 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.379859 (+ 1075us) service_pool.cc:224] Handling call
0923 19:50:23.025033 (+1645174us) ts_tablet_manager.cc:1151] Deleting tablet f8052b05169b4673b387ac8b716ffc4e
0923 19:50:23.025043 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.044438 (+ 19395us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.059163 (+ 14725us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.062567 (+ 3404us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1645036}
I20260923 19:50:23.064605 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 973) took 1685 ms. Trace:
I20260923 19:50:23.064833 6461 rpcz_store.cc:276] 0923 19:50:21.379038 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.380021 (+ 983us) service_pool.cc:224] Handling call
0923 19:50:23.064146 (+1684125us) ts_tablet_manager.cc:1151] Deleting tablet 4f3d70c3fb2c463db1d13dcbc428d30c
0923 19:50:23.064157 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.064434 (+ 277us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1683878}
I20260923 19:50:23.065903 6461 tablet_replica.cc:333] T d04b3a9ade7a405bb619704095fac279 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:23.066480 6461 raft_consensus.cc:2243] T d04b3a9ade7a405bb619704095fac279 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:23.067076 6461 raft_consensus.cc:2272] T d04b3a9ade7a405bb619704095fac279 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:23.068737 6461 ts_tablet_manager.cc:1916] T d04b3a9ade7a405bb619704095fac279 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:23.047065 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba0453ef529344dfbab1130daa985fef" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:23.071974 7499 log.cc:927] Time spent T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae: Append to log took a long time: real 0.218s user 0.001s sys 0.003s
W20260923 19:50:23.071962 5995 leader_election.cc:343] T ba0453ef529344dfbab1130daa985fef P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:23.085356 6139 leader_election.cc:343] T a01a86b6fd4b44d3808c2040525d7b61 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: a01a86b6fd4b44d3808c2040525d7b61
I20260923 19:50:23.085749 7822 raft_consensus.cc:493] T 684eb2576b4b4730813b993e36b242df P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:23.085988 7822 raft_consensus.cc:515] T 684eb2576b4b4730813b993e36b242df P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:23.086619 7822 leader_election.cc:290] T 684eb2576b4b4730813b993e36b242df P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:23.090461 6461 ts_tablet_manager.cc:1929] T d04b3a9ade7a405bb619704095fac279 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:23.090806 6461 log.cc:1199] T d04b3a9ade7a405bb619704095fac279 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/d04b3a9ade7a405bb619704095fac279
I20260923 19:50:23.091595 6461 ts_tablet_manager.cc:1950] T d04b3a9ade7a405bb619704095fac279 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:23.092437 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 976) took 1586 ms. Trace:
I20260923 19:50:23.092905 7826 raft_consensus.cc:493] T a10d35bf564d45488524d3d21721f4e5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:23.092682 6461 rpcz_store.cc:276] 0923 19:50:21.525315 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.525509 (+ 194us) service_pool.cc:224] Handling call
0923 19:50:23.065744 (+1540235us) ts_tablet_manager.cc:1151] Deleting tablet d04b3a9ade7a405bb619704095fac279
0923 19:50:23.065753 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.083471 (+ 17718us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.090339 (+ 6868us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.092387 (+ 2048us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1539749}
I20260923 19:50:23.093114 7826 raft_consensus.cc:515] T a10d35bf564d45488524d3d21721f4e5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:23.093640 6461 tablet_replica.cc:333] T 22c89609da884c47b1dbc1470b37efbe P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:23.094018 7826 leader_election.cc:290] T a10d35bf564d45488524d3d21721f4e5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:23.094018 6461 raft_consensus.cc:2243] T 22c89609da884c47b1dbc1470b37efbe P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:23.094228 6461 raft_consensus.cc:2272] T 22c89609da884c47b1dbc1470b37efbe P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:23.095085 6461 ts_tablet_manager.cc:1916] T 22c89609da884c47b1dbc1470b37efbe P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:23.102880 6456 tablet_bootstrap.cc:492] T d35ff653bf8d41cfbcf83359402a8f6a P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:23.103096 6456 ts_tablet_manager.cc:1403] T d35ff653bf8d41cfbcf83359402a8f6a P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.558s user 0.004s sys 0.010s
I20260923 19:50:23.104004 6456 raft_consensus.cc:359] T d35ff653bf8d41cfbcf83359402a8f6a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:23.106570 6456 raft_consensus.cc:385] T d35ff653bf8d41cfbcf83359402a8f6a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:23.106817 6456 raft_consensus.cc:740] T d35ff653bf8d41cfbcf83359402a8f6a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:23.107182 6456 consensus_queue.cc:260] T d35ff653bf8d41cfbcf83359402a8f6a P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:23.108073 6456 ts_tablet_manager.cc:1434] T d35ff653bf8d41cfbcf83359402a8f6a P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260923 19:50:23.108469 6456 tablet_bootstrap.cc:492] T 1c43641327d14a888a2815e49a2762c8 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:23.110122 6456 tablet_bootstrap.cc:654] T 1c43641327d14a888a2815e49a2762c8 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:23.110150 6461 ts_tablet_manager.cc:1929] T 22c89609da884c47b1dbc1470b37efbe P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:23.110509 6461 log.cc:1199] T 22c89609da884c47b1dbc1470b37efbe P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/22c89609da884c47b1dbc1470b37efbe
I20260923 19:50:23.111114 6461 ts_tablet_manager.cc:1950] T 22c89609da884c47b1dbc1470b37efbe P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:23.111024 7832 tablet.cc:1751] T 1fcd1c1bfd2c437a955c34569605a6d4 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:23.112010 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 977) took 1585 ms. Trace:
I20260923 19:50:23.114518 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 37de46eabdd84065975a8e5a3c3758c4 (DEFAULT_TABLE table=default.Table_ed0607fb34e24f6793003de00c2f4e8a [id=df08e612cea748d7885a2b764aa410fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.115404 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 94980b71d1d04a94b9b1d43f66e6baf4 (DEFAULT_TABLE table=default.Table_08a20ef0dba64e938efcbc71cdd2190e [id=4fd26eed28fb494d9603eab89439cf67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.085508 6139 leader_election.cc:304] T a01a86b6fd4b44d3808c2040525d7b61 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:23.115896 6180 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e8facf019054ac79fea193f44fc6742 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:22 UTC) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:23.116111 6139 leader_election.cc:343] T 035abecfbee7474d9dd048f35e28e867 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 035abecfbee7474d9dd048f35e28e867
I20260923 19:50:23.116219 6139 leader_election.cc:304] T 035abecfbee7474d9dd048f35e28e867 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:23.116318 6180 tablet_service.cc:1511] Processing CreateTablet for tablet caeb98aa3fbe4216b1672e6f8867f298 (DEFAULT_TABLE table=default.Table_5f9a8360065c42c6b42e7ab6deb71bdf [id=1e1ce17e7c394d7cbb8a4ec6e64dee8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.115187 6461 rpcz_store.cc:276] 0923 19:50:21.527160 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.527375 (+ 215us) service_pool.cc:224] Handling call
0923 19:50:23.093573 (+1566198us) ts_tablet_manager.cc:1151] Deleting tablet 22c89609da884c47b1dbc1470b37efbe
0923 19:50:23.093582 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.100390 (+ 6808us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.109927 (+ 9537us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.111962 (+ 2035us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1565996}
W20260923 19:50:23.116564 6139 leader_election.cc:343] T b87872fb6cc0400c86eddffb29c898e8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: b87872fb6cc0400c86eddffb29c898e8
I20260923 19:50:23.116653 6139 leader_election.cc:304] T b87872fb6cc0400c86eddffb29c898e8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:23.116814 7700 raft_consensus.cc:2749] T a01a86b6fd4b44d3808c2040525d7b61 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:23.116907 6461 tablet_replica.cc:333] T f8007918eca14c81947e5999fe13a705 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:23.116966 7700 raft_consensus.cc:2749] T 035abecfbee7474d9dd048f35e28e867 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:23.117241 6461 raft_consensus.cc:2243] T f8007918eca14c81947e5999fe13a705 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:23.117517 6461 raft_consensus.cc:2272] T f8007918eca14c81947e5999fe13a705 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:23.118826 6279 leader_election.cc:343] T 684eb2576b4b4730813b993e36b242df P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 684eb2576b4b4730813b993e36b242df
I20260923 19:50:23.119511 6461 ts_tablet_manager.cc:1916] T f8007918eca14c81947e5999fe13a705 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:23.122359 7833 tablet.cc:1751] T 8d87f05f29bd476386ff6516676ce31a P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:23.124409 6457 tablet_bootstrap.cc:492] T cf64073cdde748bc8ed3ce7580a71160 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:23.124581 6457 ts_tablet_manager.cc:1403] T cf64073cdde748bc8ed3ce7580a71160 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.336s user 0.026s sys 0.033s
I20260923 19:50:23.125360 6457 raft_consensus.cc:359] T cf64073cdde748bc8ed3ce7580a71160 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:23.125521 5996 leader_election.cc:343] T 85f5ba9097674f9d889e178eaea4f0d7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:23.125593 6457 raft_consensus.cc:385] T cf64073cdde748bc8ed3ce7580a71160 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:23.125645 5996 leader_election.cc:304] T 85f5ba9097674f9d889e178eaea4f0d7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:23.125761 6457 raft_consensus.cc:740] T cf64073cdde748bc8ed3ce7580a71160 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:23.126186 7818 raft_consensus.cc:2749] T 85f5ba9097674f9d889e178eaea4f0d7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:23.126300 5996 leader_election.cc:343] T ce6b86f947ce420994eaa5ff39ad9c87 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:23.126390 5996 leader_election.cc:304] T ce6b86f947ce420994eaa5ff39ad9c87 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:23.126569 7813 raft_consensus.cc:2749] T ce6b86f947ce420994eaa5ff39ad9c87 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:23.126119 6457 consensus_queue.cc:260] T cf64073cdde748bc8ed3ce7580a71160 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:23.127275 6457 ts_tablet_manager.cc:1434] T cf64073cdde748bc8ed3ce7580a71160 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260923 19:50:23.128983 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec5e49673406cb26a2efab0ad8401" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:23.131340 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "684eb2576b4b4730813b993e36b242df" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:23.131650 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10d35bf564d45488524d3d21721f4e5" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:23.132761 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94980b71d1d04a94b9b1d43f66e6baf4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:23.132983 6139 leader_election.cc:343] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: d8c8bfa9b7424b9f80f76e0bb05cbc0c
I20260923 19:50:23.133082 6139 leader_election.cc:304] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:23.133476 6139 consensus_peers.cc:597] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Couldn't send request to peer 2bf41435f70447f19992d368ca6b46bd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a926ff092e6e495e981be156421e8d72. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:23.133785 7790 raft_consensus.cc:2749] T b87872fb6cc0400c86eddffb29c898e8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:23.133955 7790 raft_consensus.cc:2749] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:23.134851 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caeb98aa3fbe4216b1672e6f8867f298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.020834 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_b40d9e540b804d268db162e3c6166ff0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:23.140420 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b40d9e540b804d268db162e3c6166ff0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:23.141142 6166 tablet_service.cc:1511] Processing CreateTablet for tablet 5272f93fad4944679302f94257d422ed (DEFAULT_TABLE table=default.Table_d50291ec9ea0471fa057aa648cf81187 [id=8c8ca5b5f58e462a8a2f3d7b373ef49e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.141383 6181 tablet_service.cc:1511] Processing CreateTablet for tablet 1725eba2072e41be8ef0f40a1b37dd5e (DEFAULT_TABLE table=default.Table_3acadd8cadca4312aa3ab2ff02db21dc [id=e3bf274979544c6c8ec47d35fae36a80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.021152 5804 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_442d2690dd6a4cb681ac7f7146304efa" } modify_external_catalogs: true
I20260923 19:50:23.141634 5804 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_442d2690dd6a4cb681ac7f7146304efa" } modify_external_catalogs: true
I20260923 19:50:23.021410 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_8cb2657c9ef4484d9d886f77c7527eda"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:23.049258 5797 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cf3ab578ef1442f19d629b61dc73a970 consensus state has no leader
I20260923 19:50:23.084735 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 658253ff3d014361803e1aeda978e59a (table default.Table_493eae9e089b423ca42a863b541f4ec4 [id=374e9291e4564d47a5a9bab50f013952]) successfully deleted
W20260923 19:50:23.143368 5792 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.5.143.195:32855, user_credentials={real_user=slave}} blocked reactor thread for 58647.7us
W20260923 19:50:23.143592 5792 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 1aed1eee3d914dcab3b837bf9e7a831d (table default.Table_3091843faf2b445294c246ab74246b26 [id=a9d80c0da2e241b392d5306228ecc7f8], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 1aed1eee3d914dcab3b837bf9e7a831d consensus state has no leader
W20260923 19:50:23.144381 5792 catalog_manager.cc:5136] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): alter failed for tablet f74e7cb3e5f54dfdb2280c795ce2ce53 (table default.Table_fb92f0dc809c49018d4300eaf32b6a8b [id=8325a8f159124a2da260e2be3ce69500]),no further retry: Not found: Tablet not found: f74e7cb3e5f54dfdb2280c795ce2ce53
I20260923 19:50:23.109086 5805 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet d39a64531dd24eb4aa1f7e0c418b985b (table default.Table_03f41ae74ce143c480c51cb8296efa58 [id=a56799b0709846cf8308d7d7b727427c]). Expected version 3 got 0
W20260923 19:50:23.143379 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8cb2657c9ef4484d9d886f77c7527eda in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:23.145584 5790 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.5.143.193:39887, user_credentials={real_user=slave}} blocked reactor thread for 125221us
I20260923 19:50:23.147687 6177 tablet_service.cc:1511] Processing CreateTablet for tablet b43f6c3b02254d9f8ac00f5c4d2cf4e2 (DEFAULT_TABLE table=default.Table_513c611bb84f4cd298d10c9d544be1dc [id=239e235c740e4f369c40cab3982061a8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:23.148979 6137 consensus_peers.cc:597] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a926ff092e6e495e981be156421e8d72. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:23.149060 6459 ts_tablet_manager.cc:1929] T 6ac04be575704a69994f98e00411a254 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:23.149154 6459 log.cc:1199] T 6ac04be575704a69994f98e00411a254 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/6ac04be575704a69994f98e00411a254
I20260923 19:50:23.147513 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37de46eabdd84065975a8e5a3c3758c4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:23.150951 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet d689f30677c04fb880778d6723b1f5ac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d689f30677c04fb880778d6723b1f5ac already in progress: creating tablet
I20260923 19:50:23.151916 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5272f93fad4944679302f94257d422ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.152338 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1725eba2072e41be8ef0f40a1b37dd5e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:23.154026 6279 leader_election.cc:343] T a10d35bf564d45488524d3d21721f4e5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: a10d35bf564d45488524d3d21721f4e5
I20260923 19:50:23.154855 7833 tablet.cc:1751] T d39a64531dd24eb4aa1f7e0c418b985b P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260923 19:50:23.151261 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet ce42c5de0cd3435b85fcfca92d69cdd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce42c5de0cd3435b85fcfca92d69cdd5 already in progress: creating tablet
W20260923 19:50:23.155547 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 33a318872f6a4f838ed9f0c0260d4bfb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33a318872f6a4f838ed9f0c0260d4bfb already in progress: creating tablet
W20260923 19:50:23.155726 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 940d876042844020833ccc2347d67c4c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 940d876042844020833ccc2347d67c4c already in progress: creating tablet
I20260923 19:50:23.155861 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 6ac04be575704a69994f98e00411a254 (table default.Table_346160aa15ec4313947a6b9f256cea06 [id=cefd3af14e2148c19281df9e59f07421]) successfully deleted
W20260923 19:50:23.156023 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 1b7d35282dd148e7bfcf1277d34002bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b7d35282dd148e7bfcf1277d34002bf already in progress: creating tablet
I20260923 19:50:23.156157 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 2526884ab0ef404aaf93051cc842c695 (table default.Table_3690c4b8c8334a47930dd2af3aaa23ae [id=8b5af7ae4e48454e9204a5784912842d]) successfully deleted
W20260923 19:50:23.156298 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet c500791905944480840c25929bc7bbe1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c500791905944480840c25929bc7bbe1 already in progress: creating tablet
W20260923 19:50:23.156443 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet a5cd258b6ff44e3db0d4cb66b51874b0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a5cd258b6ff44e3db0d4cb66b51874b0 already in progress: creating tablet
I20260923 19:50:23.156674 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 98f61ace3a984938ace1fedbaa1dafa3 (table default.Table_c624a31c5179478cb6c54a36d7a36892 [id=26caa02bc37e471abdf29bbbb3acba69]) successfully deleted
I20260923 19:50:23.156812 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 02fa9052a7054659baf9b07b770bb538 (table default.Table_5812b40db6ab4814a5c5b3c869967f58 [id=df481a17409f4078a57a0aef11bef720]) successfully deleted
I20260923 19:50:23.156931 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 2852e91ccd0c44b3b16f8189e57575d7 (table default.Table_63a3afc2f4ac454cb8bb6551ba17376c [id=5a6519f52d71406bac54e12459ef85a3]) successfully deleted
I20260923 19:50:23.157056 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet f8052b05169b4673b387ac8b716ffc4e (table default.Table_a9e7f8c6300f47c7ba79e2dbe36d7849 [id=8bac5d4f5c9c41f7b121d81382633a49]) successfully deleted
W20260923 19:50:23.157236 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 4f3d70c3fb2c463db1d13dcbc428d30c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f3d70c3fb2c463db1d13dcbc428d30c already in progress: creating tablet
I20260923 19:50:23.157408 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet d04b3a9ade7a405bb619704095fac279 (table default.Table_b79ffd6b55d94f789da88e84cb293bb5 [id=cd3183840770461faead259af133d3d1]) successfully deleted
I20260923 19:50:23.157574 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 22c89609da884c47b1dbc1470b37efbe (table default.Table_5bf3acc342a34bba8f50e005425b4c5d [id=a34c7ad2f3004c6e908b87fb99389632]) successfully deleted
I20260923 19:50:23.158762 6458 ts_tablet_manager.cc:1929] T f7cf45d4c4d3480288698682c1c85869 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:23.159893 6458 log.cc:1199] T f7cf45d4c4d3480288698682c1c85869 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/f7cf45d4c4d3480288698682c1c85869
I20260923 19:50:23.160643 6458 ts_tablet_manager.cc:1950] T f7cf45d4c4d3480288698682c1c85869 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:23.162030 6457 tablet_bootstrap.cc:492] T cb11d6e082784ad98cfb5253dbb88707 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:23.162755 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 968) took 1495 ms. Trace:
I20260923 19:50:23.163115 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_6e9522911bb94a31ac059a895ae8af34" } new_table_name: "default.Table_64d45d8a6ff94d96a0c553131159ca09" modify_external_catalogs: true
I20260923 19:50:23.166518 6177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b43f6c3b02254d9f8ac00f5c4d2cf4e2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:23.164569 5996 leader_election.cc:343] T 397ec5e49673406cb26a2efab0ad8401 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:23.164781 6461 ts_tablet_manager.cc:1929] T f8007918eca14c81947e5999fe13a705 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:23.167565 6171 tablet_service.cc:1558] Processing DeleteTablet for tablet b87872fb6cc0400c86eddffb29c898e8 with delete_type TABLET_DATA_DELETED (replaced by tablet 37769256de33432697e9d4fb235f473f) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:23.167558 5996 leader_election.cc:304] T 397ec5e49673406cb26a2efab0ad8401 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:23.167651 6461 log.cc:1199] T f8007918eca14c81947e5999fe13a705 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/f8007918eca14c81947e5999fe13a705
I20260923 19:50:23.167951 7813 raft_consensus.cc:2749] T 397ec5e49673406cb26a2efab0ad8401 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:23.168236 6461 ts_tablet_manager.cc:1950] T f8007918eca14c81947e5999fe13a705 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:23.169606 6457 tablet_bootstrap.cc:654] T cb11d6e082784ad98cfb5253dbb88707 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:23.169996 6172 tablet_service.cc:1511] Processing CreateTablet for tablet 9e20d623668646c688fbd82d2cbc7138 (DEFAULT_TABLE table=default.Table_ffc6ba8328d44410bccf50fc1273e92e [id=b3220a45d9764d2eb6c82d9783f21b5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.170852 6174 tablet_service.cc:1511] Processing CreateTablet for tablet 50ab89b0386640bfb012c87f09d6f3a6 (DEFAULT_TABLE table=default.Table_34e4d53df0104f8293e479963158ec39 [id=dcc130f0b3514223880a7e109183725b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.170588 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 978) took 1642 ms. Trace:
I20260923 19:50:23.171392 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c5ac79e5fa2438a87db948792d448b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:22 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:23.171062 6461 rpcz_store.cc:276] 0923 19:50:21.528870 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.529139 (+ 269us) service_pool.cc:224] Handling call
0923 19:50:23.116814 (+1587675us) ts_tablet_manager.cc:1151] Deleting tablet f8007918eca14c81947e5999fe13a705
0923 19:50:23.116830 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.137220 (+ 20390us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.164710 (+ 27490us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.170569 (+ 5859us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1587501}
I20260923 19:50:23.172000 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet c53b817e3ed7419b904a3c4b1c83e59f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:22 UTC) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:23.172650 5803 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 763ed26edf67469191f966885665a2ac has no consensus state
I20260923 19:50:23.173071 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet a55b2ff045d648339d7e207f13e2fa27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:22 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:23.173046 6461 tablet_replica.cc:333] T 688bb1055ba94c2996cdfea6dea76416 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:23.173839 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet b18548ba557f448880c5e617fc03cbe0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:23.174192 6461 raft_consensus.cc:2243] T 688bb1055ba94c2996cdfea6dea76416 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:23.175212 6461 raft_consensus.cc:2272] T 688bb1055ba94c2996cdfea6dea76416 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:23.175895 7700 raft_consensus.cc:493] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:23.176018 7700 raft_consensus.cc:515] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:23.177374 6172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e20d623668646c688fbd82d2cbc7138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.177323 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_4ddeea53d948454ca19111e3aa369e28"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:23.177834 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4ddeea53d948454ca19111e3aa369e28 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:23.178715 6461 ts_tablet_manager.cc:1916] T 688bb1055ba94c2996cdfea6dea76416 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:23.178871 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50ab89b0386640bfb012c87f09d6f3a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.179345 6459 ts_tablet_manager.cc:1950] T 6ac04be575704a69994f98e00411a254 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:23.179661 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 946) took 2062 ms. Trace:
I20260923 19:50:23.179729 6459 rpcz_store.cc:276] 0923 19:50:21.116919 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.125236 (+ 8317us) service_pool.cc:224] Handling call
0923 19:50:22.861783 (+1736547us) ts_tablet_manager.cc:1151] Deleting tablet 6ac04be575704a69994f98e00411a254
0923 19:50:22.882308 (+ 20525us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.001632 (+119324us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.149010 (+147378us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.179646 (+ 30636us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66,"tablet-delete.queue_time_us":1736366}
I20260923 19:50:23.180195 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 6ac04be575704a69994f98e00411a254 (table default.Table_346160aa15ec4313947a6b9f256cea06 [id=cefd3af14e2148c19281df9e59f07421]) successfully deleted
I20260923 19:50:23.185267 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 945) took 2071 ms. Trace:
I20260923 19:50:23.185349 6459 rpcz_store.cc:276] 0923 19:50:21.113571 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.128499 (+ 14928us) service_pool.cc:224] Handling call
0923 19:50:23.180033 (+2051534us) ts_tablet_manager.cc:1151] Deleting tablet 940d876042844020833ccc2347d67c4c
0923 19:50:23.180044 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.185248 (+ 5204us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2051297}
I20260923 19:50:23.185693 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 947) took 1998 ms. Trace:
W20260923 19:50:23.186039 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 940d876042844020833ccc2347d67c4c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 940d876042844020833ccc2347d67c4c already in progress: creating tablet
I20260923 19:50:23.187398 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_1a1905b61f0a4ba2bec7b293119af35c" } new_table_name: "default.Table_bfb92692681246bf9ff3524c388b1bc4" modify_external_catalogs: true
I20260923 19:50:23.189236 7836 tablet.cc:1751] T 8d87f05f29bd476386ff6516676ce31a P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:23.191493 5805 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_0f595721f8434bcda65bc5803008bf06" } modify_external_catalogs: true
I20260923 19:50:23.191632 5805 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_0f595721f8434bcda65bc5803008bf06" } modify_external_catalogs: true
I20260923 19:50:23.163931 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba0453ef529344dfbab1130daa985fef" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:23.166467 6280 leader_election.cc:343] T 684eb2576b4b4730813b993e36b242df P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:23.173967 7831 tablet.cc:1751] T d39a64531dd24eb4aa1f7e0c418b985b P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260923 19:50:23.197417 6280 leader_election.cc:304] T 684eb2576b4b4730813b993e36b242df P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:23.197752 7256 raft_consensus.cc:2749] T 684eb2576b4b4730813b993e36b242df P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:23.199632 6280 leader_election.cc:343] T a10d35bf564d45488524d3d21721f4e5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:23.199852 6280 leader_election.cc:304] T a10d35bf564d45488524d3d21721f4e5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:23.200157 7256 raft_consensus.cc:2749] T a10d35bf564d45488524d3d21721f4e5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:23.185761 6459 rpcz_store.cc:276] 0923 19:50:21.187707 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.187781 (+ 74us) service_pool.cc:224] Handling call
0923 19:50:23.185586 (+1997805us) ts_tablet_manager.cc:1151] Deleting tablet 1b7d35282dd148e7bfcf1277d34002bf
0923 19:50:23.185595 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.185679 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1997545}
I20260923 19:50:23.201424 6459 tablet_replica.cc:333] T 5e711e48156b46b5a517b330d6d41309 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
W20260923 19:50:23.201619 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 1b7d35282dd148e7bfcf1277d34002bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b7d35282dd148e7bfcf1277d34002bf already in progress: creating tablet
I20260923 19:50:23.201643 6459 raft_consensus.cc:2243] T 5e711e48156b46b5a517b330d6d41309 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:23.201779 6459 raft_consensus.cc:2272] T 5e711e48156b46b5a517b330d6d41309 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:23.202299 6459 ts_tablet_manager.cc:1916] T 5e711e48156b46b5a517b330d6d41309 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:23.202853 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet f8007918eca14c81947e5999fe13a705 (table default.Table_105f26b7d508479ab5114c279aca4dfb [id=7eee19aa1d0348e08accd2764d2cfdce]) successfully deleted
I20260923 19:50:23.201236 6461 ts_tablet_manager.cc:1929] T 688bb1055ba94c2996cdfea6dea76416 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:23.204046 6461 log.cc:1199] T 688bb1055ba94c2996cdfea6dea76416 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/688bb1055ba94c2996cdfea6dea76416
I20260923 19:50:23.192238 6458 rpcz_store.cc:276] 0923 19:50:21.667106 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.668267 (+ 1161us) service_pool.cc:224] Handling call
0923 19:50:22.931278 (+1263011us) ts_tablet_manager.cc:1151] Deleting tablet f7cf45d4c4d3480288698682c1c85869
0923 19:50:22.931290 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:22.967168 (+ 35878us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.158701 (+191533us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.162732 (+ 4031us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1262859}
I20260923 19:50:23.204788 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet f7cf45d4c4d3480288698682c1c85869 (table default.Table_4cb745719e44465b8bdd1ed8a1e04b8e [id=e107798635ee473eb50362535f76985d]) successfully deleted
I20260923 19:50:23.205171 6458 tablet_replica.cc:333] T e6e04d16675443fc923a5f8216e292b6 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:23.205303 6461 ts_tablet_manager.cc:1950] T 688bb1055ba94c2996cdfea6dea76416 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:23.205446 6458 raft_consensus.cc:2243] T e6e04d16675443fc923a5f8216e292b6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:23.205684 6458 raft_consensus.cc:2272] T e6e04d16675443fc923a5f8216e292b6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:23.206332 6458 ts_tablet_manager.cc:1916] T e6e04d16675443fc923a5f8216e292b6 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:23.208032 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 979) took 1552 ms. Trace:
I20260923 19:50:23.208353 6461 rpcz_store.cc:276] 0923 19:50:21.655745 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.655796 (+ 51us) service_pool.cc:224] Handling call
0923 19:50:23.172840 (+1517044us) ts_tablet_manager.cc:1151] Deleting tablet 688bb1055ba94c2996cdfea6dea76416
0923 19:50:23.172854 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.189865 (+ 17011us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.201097 (+ 11232us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.208012 (+ 6915us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1516731}
I20260923 19:50:23.209793 6461 tablet_replica.cc:333] T f4313a4d8a9c411fad593b05ad655fc4 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:23.210902 6461 raft_consensus.cc:2243] T f4313a4d8a9c411fad593b05ad655fc4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:23.211714 6461 raft_consensus.cc:2272] T f4313a4d8a9c411fad593b05ad655fc4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:23.211941 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 688bb1055ba94c2996cdfea6dea76416 (table default.Table_f92387e003d44b0eb22010e7ca6598af [id=1e323f5b380a4af4acc3865649648e12]) successfully deleted
I20260923 19:50:23.213792 6391 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
I20260923 19:50:23.214675 7836 tablet.cc:1751] T 1fcd1c1bfd2c437a955c34569605a6d4 P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:23.214715 6461 ts_tablet_manager.cc:1916] T f4313a4d8a9c411fad593b05ad655fc4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:23.215219 5996 leader_election.cc:343] T ba0453ef529344dfbab1130daa985fef P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:23.215339 5996 leader_election.cc:304] T ba0453ef529344dfbab1130daa985fef P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:23.215739 7813 raft_consensus.cc:2749] T ba0453ef529344dfbab1130daa985fef P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:23.182698 7832 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:60210 (request call id 1005) took 1035 ms. Trace:
I20260923 19:50:23.218255 7832 rpcz_store.cc:276] 0923 19:50:22.146856 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:22.146947 (+ 91us) service_pool.cc:224] Handling call
0923 19:50:23.182681 (+1035734us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0923 19:50:22.177990 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0923 19:50:22.178099 (+ 109us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0923 19:50:22.178107 (+ 8us) alter_schema_op.cc:66] Acquired schema lock
0923 19:50:22.178114 (+ 7us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0923 19:50:22.178154 (+ 40us) alter_schema_op.cc:128] START. Timestamp: 1790193022178110
0923 19:50:22.178157 (+ 3us) op_driver.cc:348] REPLICATION: starting
0923 19:50:22.178347 (+ 190us) log.cc:844] Serialized 173 byte log entry
0923 19:50:23.007036 (+828689us) op_driver.cc:464] REPLICATION: finished
0923 19:50:23.110999 (+103963us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0923 19:50:23.111415 (+ 416us) log.cc:844] Serialized 5 byte log entry
0923 19:50:23.182377 (+ 70962us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.182602 (+ 225us) log.cc:844] Serialized 14 byte log entry
0923 19:50:23.182644 (+ 42us) alter_schema_op.cc:73] Released schema lock
0923 19:50:23.182648 (+ 4us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":71563,"prepare.queue_time_us":30645,"prepare.run_cpu_time_us":950,"prepare.run_wall_time_us":41631,"raft.queue_time_us":73,"raft.run_cpu_time_us":569,"raft.run_wall_time_us":571,"replication_time_us":828845,"thread_start_us":335664,"threads_started":3,"wal-append.queue_time_us":1142}]]}
I20260923 19:50:23.183466 6456 tablet_bootstrap.cc:492] T 1c43641327d14a888a2815e49a2762c8 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:23.219548 6456 ts_tablet_manager.cc:1403] T 1c43641327d14a888a2815e49a2762c8 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.111s user 0.003s sys 0.000s
I20260923 19:50:23.220130 7700 leader_election.cc:290] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:23.221148 6137 leader_election.cc:343] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: f74e7cb3e5f54dfdb2280c795ce2ce53
W20260923 19:50:23.221702 6139 leader_election.cc:343] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: f74e7cb3e5f54dfdb2280c795ce2ce53
I20260923 19:50:23.221793 6139 leader_election.cc:304] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:23.222914 7700 raft_consensus.cc:2749] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:23.223259 6456 raft_consensus.cc:359] T 1c43641327d14a888a2815e49a2762c8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:23.223465 6456 raft_consensus.cc:385] T 1c43641327d14a888a2815e49a2762c8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:23.223359 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_80da016ec382404792b58b67eb9132c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:23.223626 6456 raft_consensus.cc:740] T 1c43641327d14a888a2815e49a2762c8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
W20260923 19:50:23.223929 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80da016ec382404792b58b67eb9132c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:23.223946 6456 consensus_queue.cc:260] T 1c43641327d14a888a2815e49a2762c8 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:23.224545 6456 ts_tablet_manager.cc:1434] T 1c43641327d14a888a2815e49a2762c8 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260923 19:50:23.224797 6456 tablet_bootstrap.cc:492] T e1de117713f34b51bbda0c712f0b837c P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:23.226068 6456 tablet_bootstrap.cc:654] T e1de117713f34b51bbda0c712f0b837c P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:23.233197 6454 tablet_bootstrap.cc:492] T c7369a5fc87f4b70bcfbe052ef021771 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:23.233100 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_12be29ecddb1411893380f5d1d81bb57"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:23.233335 6454 ts_tablet_manager.cc:1403] T c7369a5fc87f4b70bcfbe052ef021771 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.294s user 0.003s sys 0.006s
W20260923 19:50:23.233604 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_12be29ecddb1411893380f5d1d81bb57 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:23.236747 5799 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_db49428dd8a94a17b044d011c905e20b" } new_table_name: "default.Table_4be47b20f8dc4ef3873fb2212ed096f6" modify_external_catalogs: true
I20260923 19:50:23.238782 5800 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_23c500b65dba4b6790b4349e5a5b0a07" } modify_external_catalogs: true
I20260923 19:50:23.238929 5800 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_23c500b65dba4b6790b4349e5a5b0a07" } modify_external_catalogs: true
I20260923 19:50:23.241030 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b5eb8fb996c44e1ebac34b604ebad0bc" } modify_external_catalogs: true
I20260923 19:50:23.241169 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b5eb8fb996c44e1ebac34b604ebad0bc" } modify_external_catalogs: true
I20260923 19:50:23.241755 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_c80b112b6ce9402f87b07ee8a6e1b78b" } new_table_name: "default.Table_160de6bdea3143189e7fecd95d9e3287" modify_external_catalogs: true
I20260923 19:50:23.243438 6461 ts_tablet_manager.cc:1929] T f4313a4d8a9c411fad593b05ad655fc4 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:23.243937 6461 log.cc:1199] T f4313a4d8a9c411fad593b05ad655fc4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/f4313a4d8a9c411fad593b05ad655fc4
I20260923 19:50:23.246050 6461 ts_tablet_manager.cc:1950] T f4313a4d8a9c411fad593b05ad655fc4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:23.246806 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_039bbf0a88654c2f9e8834f0bf2d8180"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:23.247303 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_039bbf0a88654c2f9e8834f0bf2d8180 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:23.247592 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 980) took 1591 ms. Trace:
I20260923 19:50:23.247870 6461 rpcz_store.cc:276] 0923 19:50:21.656226 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.656269 (+ 43us) service_pool.cc:224] Handling call
0923 19:50:23.209688 (+1553419us) ts_tablet_manager.cc:1151] Deleting tablet f4313a4d8a9c411fad593b05ad655fc4
0923 19:50:23.209724 (+ 36us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.232971 (+ 23247us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.243300 (+ 10329us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.247480 (+ 4180us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1553275}
I20260923 19:50:23.249536 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 983) took 1519 ms. Trace:
I20260923 19:50:23.249920 6461 rpcz_store.cc:276] 0923 19:50:21.729899 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.729949 (+ 50us) service_pool.cc:224] Handling call
0923 19:50:23.249022 (+1519073us) ts_tablet_manager.cc:1151] Deleting tablet ab81b40554e2411780ecfe12ef4a8f7d
0923 19:50:23.249122 (+ 100us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.249518 (+ 396us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1518844}
I20260923 19:50:23.251407 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 981) took 1527 ms. Trace:
I20260923 19:50:23.251811 6461 rpcz_store.cc:276] 0923 19:50:21.723906 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.723962 (+ 56us) service_pool.cc:224] Handling call
0923 19:50:23.251018 (+1527056us) ts_tablet_manager.cc:1151] Deleting tablet 5c9768e71e0640ceb110a19e53484044
0923 19:50:23.251028 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.251291 (+ 263us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1520044}
I20260923 19:50:23.253088 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 982) took 1528 ms. Trace:
I20260923 19:50:23.253396 6461 rpcz_store.cc:276] 0923 19:50:21.724299 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.724347 (+ 48us) service_pool.cc:224] Handling call
0923 19:50:23.252722 (+1528375us) ts_tablet_manager.cc:1151] Deleting tablet 96577a68f4984c90b82cf4d32e701476
0923 19:50:23.252730 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.252987 (+ 257us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1521728}
I20260923 19:50:23.254760 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 984) took 1444 ms. Trace:
I20260923 19:50:23.255046 6461 rpcz_store.cc:276] 0923 19:50:21.810536 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.810589 (+ 53us) service_pool.cc:224] Handling call
0923 19:50:23.254375 (+1443786us) ts_tablet_manager.cc:1151] Deleting tablet af0f632bd266480d9ab1f864db5cd93e
0923 19:50:23.254384 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.254656 (+ 272us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1424586}
W20260923 19:50:23.255520 5799 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 42387bc29fc54b4cbb3d669e821e759d consensus state has no leader
W20260923 19:50:23.256012 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7d654b14cafa453185179fe57a25e2d9 consensus state has no leader
I20260923 19:50:23.256326 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet f4313a4d8a9c411fad593b05ad655fc4 (table default.Table_76b550f8599f4650b443c16ae2483ba8 [id=e4f5c7258f02460aad591023927c0dfd]) successfully deleted
W20260923 19:50:23.256544 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet ab81b40554e2411780ecfe12ef4a8f7d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab81b40554e2411780ecfe12ef4a8f7d already in progress: creating tablet
W20260923 19:50:23.256731 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 5c9768e71e0640ceb110a19e53484044 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c9768e71e0640ceb110a19e53484044 already in progress: creating tablet
I20260923 19:50:23.256695 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 986) took 1445 ms. Trace:
W20260923 19:50:23.257059 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 96577a68f4984c90b82cf4d32e701476 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96577a68f4984c90b82cf4d32e701476 already in progress: creating tablet
W20260923 19:50:23.257262 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet af0f632bd266480d9ab1f864db5cd93e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet af0f632bd266480d9ab1f864db5cd93e already in progress: creating tablet
I20260923 19:50:23.257041 6461 rpcz_store.cc:276] 0923 19:50:21.810780 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.810837 (+ 57us) service_pool.cc:224] Handling call
0923 19:50:23.256159 (+1445322us) ts_tablet_manager.cc:1151] Deleting tablet fcc32bda7c684e849161f9d4a3df79d3
0923 19:50:23.256169 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.256517 (+ 348us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1426290}
W20260923 19:50:23.258080 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet fcc32bda7c684e849161f9d4a3df79d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fcc32bda7c684e849161f9d4a3df79d3 already in progress: creating tablet
I20260923 19:50:23.258991 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 985) took 1448 ms. Trace:
I20260923 19:50:23.259267 6461 rpcz_store.cc:276] 0923 19:50:21.810661 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.811089 (+ 428us) service_pool.cc:224] Handling call
0923 19:50:23.258634 (+1447545us) ts_tablet_manager.cc:1151] Deleting tablet b297338b1d5a4e5797d364b891081548
0923 19:50:23.258642 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.258890 (+ 248us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1428556}
W20260923 19:50:23.260058 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet b297338b1d5a4e5797d364b891081548 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b297338b1d5a4e5797d364b891081548 already in progress: creating tablet
I20260923 19:50:23.260932 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 987) took 1387 ms. Trace:
I20260923 19:50:23.261147 6461 rpcz_store.cc:276] 0923 19:50:21.873109 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.873554 (+ 445us) service_pool.cc:224] Handling call
0923 19:50:23.260566 (+1387012us) ts_tablet_manager.cc:1151] Deleting tablet 5c9768e71e0640ceb110a19e53484044
0923 19:50:23.260575 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.260832 (+ 257us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1386853}
W20260923 19:50:23.261933 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 5c9768e71e0640ceb110a19e53484044 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c9768e71e0640ceb110a19e53484044 already in progress: creating tablet
I20260923 19:50:23.262589 6461 tablet_replica.cc:333] T 9ee02922d2be45f5a1473a53a6f253c4 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:23.263304 6459 ts_tablet_manager.cc:1929] T 5e711e48156b46b5a517b330d6d41309 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:23.263345 6461 raft_consensus.cc:2243] T 9ee02922d2be45f5a1473a53a6f253c4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:23.263981 6461 raft_consensus.cc:2272] T 9ee02922d2be45f5a1473a53a6f253c4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:23.266551 6461 ts_tablet_manager.cc:1916] T 9ee02922d2be45f5a1473a53a6f253c4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:23.283737 5792 catalog_manager.cc:5136] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): alter failed for tablet 98f61ace3a984938ace1fedbaa1dafa3 (table default.Table_c624a31c5179478cb6c54a36d7a36892 [id=26caa02bc37e471abdf29bbbb3acba69]),no further retry: Not found: Tablet not found: 98f61ace3a984938ace1fedbaa1dafa3
I20260923 19:50:23.289409 6454 raft_consensus.cc:359] T c7369a5fc87f4b70bcfbe052ef021771 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:23.290499 6454 raft_consensus.cc:385] T c7369a5fc87f4b70bcfbe052ef021771 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:23.290815 6454 raft_consensus.cc:740] T c7369a5fc87f4b70bcfbe052ef021771 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:23.304412 7256 raft_consensus.cc:493] T 1c43641327d14a888a2815e49a2762c8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:23.304557 7256 raft_consensus.cc:515] T 1c43641327d14a888a2815e49a2762c8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:23.305070 7256 leader_election.cc:290] T 1c43641327d14a888a2815e49a2762c8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:23.306165 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c43641327d14a888a2815e49a2762c8" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:23.306341 6059 raft_consensus.cc:2468] T 1c43641327d14a888a2815e49a2762c8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:23.306666 6279 leader_election.cc:304] T 1c43641327d14a888a2815e49a2762c8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:23.306870 7256 raft_consensus.cc:2804] T 1c43641327d14a888a2815e49a2762c8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:23.306939 7256 raft_consensus.cc:493] T 1c43641327d14a888a2815e49a2762c8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:23.307003 7256 raft_consensus.cc:3060] T 1c43641327d14a888a2815e49a2762c8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:23.294553 6454 consensus_queue.cc:260] T c7369a5fc87f4b70bcfbe052ef021771 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:23.308898 6461 ts_tablet_manager.cc:1929] T 9ee02922d2be45f5a1473a53a6f253c4 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:23.309239 6461 log.cc:1199] T 9ee02922d2be45f5a1473a53a6f253c4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/9ee02922d2be45f5a1473a53a6f253c4
I20260923 19:50:23.309738 7256 raft_consensus.cc:515] T 1c43641327d14a888a2815e49a2762c8 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:23.305600 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c43641327d14a888a2815e49a2762c8" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:23.310926 7256 leader_election.cc:290] T 1c43641327d14a888a2815e49a2762c8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:23.310447 6280 leader_election.cc:343] T 1c43641327d14a888a2815e49a2762c8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:23.311522 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c43641327d14a888a2815e49a2762c8" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:23.311699 6461 ts_tablet_manager.cc:1950] T 9ee02922d2be45f5a1473a53a6f253c4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:23.313778 6454 ts_tablet_manager.cc:1434] T c7369a5fc87f4b70bcfbe052ef021771 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.080s user 0.000s sys 0.002s
W20260923 19:50:23.314211 6280 leader_election.cc:343] T 1c43641327d14a888a2815e49a2762c8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:23.314445 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 989) took 1434 ms. Trace:
I20260923 19:50:23.314878 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c43641327d14a888a2815e49a2762c8" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:23.315084 6059 raft_consensus.cc:3060] T 1c43641327d14a888a2815e49a2762c8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:23.315012 6461 rpcz_store.cc:276] 0923 19:50:21.880095 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.880148 (+ 53us) service_pool.cc:224] Handling call
0923 19:50:23.262460 (+1382312us) ts_tablet_manager.cc:1151] Deleting tablet 9ee02922d2be45f5a1473a53a6f253c4
0923 19:50:23.262469 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.279483 (+ 17014us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.308656 (+ 29173us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.314424 (+ 5768us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1382134}
I20260923 19:50:23.316110 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 9ee02922d2be45f5a1473a53a6f253c4 (table default.Table_3f7aea8c4b01456887ad705c059f1572 [id=2b72f46eeef54308965034c7d49f0947]) successfully deleted
I20260923 19:50:23.316761 6461 tablet_replica.cc:333] T 85f5ba9097674f9d889e178eaea4f0d7 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:23.317406 6461 raft_consensus.cc:2243] T 85f5ba9097674f9d889e178eaea4f0d7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:23.317834 6461 raft_consensus.cc:2272] T 85f5ba9097674f9d889e178eaea4f0d7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:23.318141 6059 raft_consensus.cc:2468] T 1c43641327d14a888a2815e49a2762c8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:23.318534 6279 leader_election.cc:304] T 1c43641327d14a888a2815e49a2762c8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:23.318960 7256 raft_consensus.cc:2804] T 1c43641327d14a888a2815e49a2762c8 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:23.319468 7256 raft_consensus.cc:697] T 1c43641327d14a888a2815e49a2762c8 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:23.319761 7256 consensus_queue.cc:237] T 1c43641327d14a888a2815e49a2762c8 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:23.319793 6461 ts_tablet_manager.cc:1916] T 85f5ba9097674f9d889e178eaea4f0d7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:23.320462 6457 tablet_bootstrap.cc:492] T cb11d6e082784ad98cfb5253dbb88707 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:23.321086 6454 tablet_bootstrap.cc:492] T f7cf45d4c4d3480288698682c1c85869 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:23.324945 7832 tablet.cc:1751] T 2398c59871d241f985bca1761e722180 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:23.327275 5801 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet cf64073cdde748bc8ed3ce7580a71160 (table default.Table_f9942fca28234830913277dada229375 [id=662eb0a4f944445486929d42c5ebfd01]). Expected version 2 got 0
I20260923 19:50:23.327440 7831 tablet.cc:1751] T ad29d22a82434023991ffcacf7f9bee5 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:23.328465 6459 log.cc:1199] T 5e711e48156b46b5a517b330d6d41309 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/5e711e48156b46b5a517b330d6d41309
I20260923 19:50:23.330041 6458 ts_tablet_manager.cc:1929] T e6e04d16675443fc923a5f8216e292b6 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:23.323030 7833 tablet.cc:1751] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:23.330612 5803 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 34d62ab3d4aa457f8fea283cd9248a41 (table default.Table_71d7f590efb94aae8c345f9d9a620fc1 [id=b4e8e3f2a48a4b5496f506080b415805]). Expected version 1 got 0
I20260923 19:50:23.330942 5803 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet d39a64531dd24eb4aa1f7e0c418b985b (table default.Table_03f41ae74ce143c480c51cb8296efa58 [id=a56799b0709846cf8308d7d7b727427c]). Expected version 3 got 0
I20260923 19:50:23.331200 6457 ts_tablet_manager.cc:1403] T cb11d6e082784ad98cfb5253dbb88707 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.169s user 0.003s sys 0.002s
I20260923 19:50:23.331270 5803 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 2398c59871d241f985bca1761e722180 (table default.Table_bfb92692681246bf9ff3524c388b1bc4 [id=4ec3992af15345ec89f8f727343e3df2]). Expected version 1 got 0
I20260923 19:50:23.333091 5800 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 85b7dcf131c54187a6e61f8503c797f8
I20260923 19:50:23.333822 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 85b7dcf131c54187a6e61f8503c797f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:23.334134 6459 ts_tablet_manager.cc:1950] T 5e711e48156b46b5a517b330d6d41309 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:23.334719 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 948) took 2137 ms. Trace:
I20260923 19:50:23.334805 6459 rpcz_store.cc:276] 0923 19:50:21.197199 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.197290 (+ 91us) service_pool.cc:224] Handling call
0923 19:50:23.201377 (+2004087us) ts_tablet_manager.cc:1151] Deleting tablet 5e711e48156b46b5a517b330d6d41309
0923 19:50:23.201389 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.225262 (+ 23873us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.263250 (+ 37988us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.334699 (+ 71449us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2003876}
I20260923 19:50:23.335140 6459 tablet_replica.cc:333] T d6d3601a392f4723b4ca00f6e12b950c P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:23.335728 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 5e711e48156b46b5a517b330d6d41309 (table default.Table_f68f50c8c0a74d59826e623c007a41a8 [id=24509437bc6049aab27952daeb610184]) successfully deleted
I20260923 19:50:23.337366 7833 tablet.cc:1751] T 2398c59871d241f985bca1761e722180 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:23.339947 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 78911eed02894176b689fd9ce681de71
I20260923 19:50:23.339987 6457 raft_consensus.cc:359] T cb11d6e082784ad98cfb5253dbb88707 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:23.340164 6457 raft_consensus.cc:385] T cb11d6e082784ad98cfb5253dbb88707 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:23.340221 6457 raft_consensus.cc:740] T cb11d6e082784ad98cfb5253dbb88707 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:23.340407 6457 consensus_queue.cc:260] T cb11d6e082784ad98cfb5253dbb88707 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:23.340564 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 78911eed02894176b689fd9ce681de71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:23.341107 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet b0534795317747b28bef09df8a1c7244
I20260923 19:50:23.341773 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet b0534795317747b28bef09df8a1c7244 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:23.342353 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 4661da9259c74a4fbe3a00df5048658d
I20260923 19:50:23.343333 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 4661da9259c74a4fbe3a00df5048658d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:23.347285 6177 tablet_service.cc:1558] Processing DeleteTablet for tablet b0534795317747b28bef09df8a1c7244 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:23.347489 6180 tablet_service.cc:1558] Processing DeleteTablet for tablet 4661da9259c74a4fbe3a00df5048658d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:23.335335 6459 raft_consensus.cc:2243] T d6d3601a392f4723b4ca00f6e12b950c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:23.358577 6459 raft_consensus.cc:2272] T d6d3601a392f4723b4ca00f6e12b950c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:23.360769 7813 raft_consensus.cc:493] T cf64073cdde748bc8ed3ce7580a71160 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:23.360920 7813 raft_consensus.cc:515] T cf64073cdde748bc8ed3ce7580a71160 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:23.361387 6458 log.cc:1199] T e6e04d16675443fc923a5f8216e292b6 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/e6e04d16675443fc923a5f8216e292b6
I20260923 19:50:23.361578 7813 leader_election.cc:290] T cf64073cdde748bc8ed3ce7580a71160 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:23.361747 6458 ts_tablet_manager.cc:1950] T e6e04d16675443fc923a5f8216e292b6 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:23.336856 6307 tablet_service.cc:1558] Processing DeleteTablet for tablet 85b7dcf131c54187a6e61f8503c797f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:23.340893 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 78911eed02894176b689fd9ce681de71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:23.342074 6308 tablet_service.cc:1558] Processing DeleteTablet for tablet b0534795317747b28bef09df8a1c7244 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:23.343302 6316 tablet_service.cc:1558] Processing DeleteTablet for tablet 4661da9259c74a4fbe3a00df5048658d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:23.363168 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 970) took 1694 ms. Trace:
I20260923 19:50:23.363175 6461 ts_tablet_manager.cc:1929] T 85f5ba9097674f9d889e178eaea4f0d7 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:23.362501 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf64073cdde748bc8ed3ce7580a71160" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:23.364099 5995 leader_election.cc:343] T cf64073cdde748bc8ed3ce7580a71160 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:23.363832 6461 log.cc:1199] T 85f5ba9097674f9d889e178eaea4f0d7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/85f5ba9097674f9d889e178eaea4f0d7
I20260923 19:50:23.364610 6459 ts_tablet_manager.cc:1916] T d6d3601a392f4723b4ca00f6e12b950c P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:23.365474 6461 ts_tablet_manager.cc:1950] T 85f5ba9097674f9d889e178eaea4f0d7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:23.366288 5969 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 78911eed02894176b689fd9ce681de71
I20260923 19:50:23.378075 6458 rpcz_store.cc:276] 0923 19:50:21.668637 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.668682 (+ 45us) service_pool.cc:224] Handling call
0923 19:50:23.205111 (+1536429us) ts_tablet_manager.cc:1151] Deleting tablet e6e04d16675443fc923a5f8216e292b6
0923 19:50:23.205126 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.210231 (+ 5105us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.329976 (+119745us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.363147 (+ 33171us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1536279}
I20260923 19:50:23.378979 6458 tablet_replica.cc:333] T fc151f4d78344efeada6d6e57af6eb9f P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:23.379238 6458 raft_consensus.cc:2243] T fc151f4d78344efeada6d6e57af6eb9f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:23.379457 6458 raft_consensus.cc:2272] T fc151f4d78344efeada6d6e57af6eb9f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:23.380074 6458 ts_tablet_manager.cc:1916] T fc151f4d78344efeada6d6e57af6eb9f P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:23.363320 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf64073cdde748bc8ed3ce7580a71160" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:23.390626 5996 leader_election.cc:343] T cf64073cdde748bc8ed3ce7580a71160 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:23.390772 5996 leader_election.cc:304] T cf64073cdde748bc8ed3ce7580a71160 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:23.391184 7813 raft_consensus.cc:2749] T cf64073cdde748bc8ed3ce7580a71160 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:23.345283 6456 tablet_bootstrap.cc:492] T e1de117713f34b51bbda0c712f0b837c P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:23.391600 6456 ts_tablet_manager.cc:1403] T e1de117713f34b51bbda0c712f0b837c P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.167s user 0.003s sys 0.003s
I20260923 19:50:23.392364 6456 raft_consensus.cc:359] T e1de117713f34b51bbda0c712f0b837c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:23.392622 6456 raft_consensus.cc:385] T e1de117713f34b51bbda0c712f0b837c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:23.392871 6456 raft_consensus.cc:740] T e1de117713f34b51bbda0c712f0b837c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:23.393157 6456 consensus_queue.cc:260] T e1de117713f34b51bbda0c712f0b837c P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:23.393664 6456 ts_tablet_manager.cc:1434] T e1de117713f34b51bbda0c712f0b837c P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:23.394090 6456 tablet_bootstrap.cc:492] T 554655516bb547ad9c2aa1ee66dc8deb P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:23.395422 6456 tablet_bootstrap.cc:654] T 554655516bb547ad9c2aa1ee66dc8deb P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:23.364774 6454 tablet_bootstrap.cc:654] T f7cf45d4c4d3480288698682c1c85869 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:23.365145 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet 85b7dcf131c54187a6e61f8503c797f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:23.365655 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet 78911eed02894176b689fd9ce681de71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:23.376969 7835 tablet.cc:1751] T 2398c59871d241f985bca1761e722180 P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:23.382699 7836 tablet.cc:1751] T ad29d22a82434023991ffcacf7f9bee5 P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:23.367992 5799 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_2a3f607a23af430ba52036fcf8b35948" } new_table_name: "default.Table_e526c19d02b9432eabd892ed7a9a291c" modify_external_catalogs: true
I20260923 19:50:23.399787 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 78911eed02894176b689fd9ce681de71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:23.368292 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_e8762f65676a42ceb73097d69b5b7906"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:23.400520 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e8762f65676a42ceb73097d69b5b7906 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:23.368630 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_1c62a72e74d344759378361cfe965e67"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:23.401762 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c62a72e74d344759378361cfe965e67 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:23.402145 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 991) took 1461 ms. Trace:
I20260923 19:50:23.368889 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_d7268848cedf45269016ad6fa5d306c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:23.403093 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d7268848cedf45269016ad6fa5d306c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:23.369122 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_15ccf3f89ba546298c74fb37b949b192"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:23.404161 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_15ccf3f89ba546298c74fb37b949b192 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:23.375571 5801 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_b5dd4db0324d43749d5fcf224d33c817 [id=05124f851929441c950eb291a1d269a0] alter complete (version 1)
W20260923 19:50:23.404698 5801 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet cf64073cdde748bc8ed3ce7580a71160 (table default.Table_f9942fca28234830913277dada229375 [id=662eb0a4f944445486929d42c5ebfd01], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet cf64073cdde748bc8ed3ce7580a71160 consensus state has no leader
I20260923 19:50:23.405097 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_99945eeb183b4b18be67e5b484ad3454" } new_table_name: "default.Table_7e5734fc77194af188bb85d254676e98" modify_external_catalogs: true
I20260923 19:50:23.405627 6180 tablet_service.cc:1511] Processing CreateTablet for tablet bf5b8f14341a4a9a98111215a68927a6 (DEFAULT_TABLE table=default.Table_51ce07574ea94e9d9eac28bd48d0e462 [id=27b2fada84b14d66ad33913d4cc11a02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.378760 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet e6e04d16675443fc923a5f8216e292b6 (table default.Table_ea8c4179d37e4165869f5bf030971467 [id=5c206f48fb1a4be587f17803f654ce5a]) successfully deleted
I20260923 19:50:23.406556 6177 tablet_service.cc:1511] Processing CreateTablet for tablet 6fcdd7795eac4b2fa6a987b14301330c (DEFAULT_TABLE table=default.Table_5322c2cdfb42499d84b648cebc527d79 [id=b84c84d2e05642088cf16af3760e3e24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.380816 5798 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_9fa8f8bfc6124f398a4acdf5e1e0b33a [id=02d2ab56def342c482c86ce96110342f] alter complete (version 1)
I20260923 19:50:23.407073 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_65c94b4a142e435dbd490ba30c1613f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:23.407459 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_65c94b4a142e435dbd490ba30c1613f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:23.408659 6308 tablet_service.cc:1558] Processing DeleteTablet for tablet 78911eed02894176b689fd9ce681de71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:23.382390 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_4f577cc850fd453ca04bab2db4388465"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:23.387904 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet e6ebb766244f40a28e5fd96ecbb3e4f6
I20260923 19:50:23.408982 6307 tablet_service.cc:1511] Processing CreateTablet for tablet bf5b8f14341a4a9a98111215a68927a6 (DEFAULT_TABLE table=default.Table_51ce07574ea94e9d9eac28bd48d0e462 [id=27b2fada84b14d66ad33913d4cc11a02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.409312 6307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf5b8f14341a4a9a98111215a68927a6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:23.409305 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f577cc850fd453ca04bab2db4388465 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:23.409641 5796 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_72032a8e8a254d2bad8358ebf75f1615" } new_table_name: "default.Table_49365e0053f94b40add73daa7fbd60e4" modify_external_catalogs: true
I20260923 19:50:23.410254 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 08d0508347964f0b8544e5ed5a2664f7 (DEFAULT_TABLE table=default.Table_dd8734e42a5d407782e8b34cad9c6e69 [id=312a610ec5ae46a099c029c0ed89c0b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.393267 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_8aec2b8ca8d846488ec51dd3691f5208"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:23.410584 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08d0508347964f0b8544e5ed5a2664f7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:23.410833 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8aec2b8ca8d846488ec51dd3691f5208 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:23.412321 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet e6ebb766244f40a28e5fd96ecbb3e4f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:23.414122 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet 78911eed02894176b689fd9ce681de71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:23.414321 6316 tablet_service.cc:1511] Processing CreateTablet for tablet 6fcdd7795eac4b2fa6a987b14301330c (DEFAULT_TABLE table=default.Table_5322c2cdfb42499d84b648cebc527d79 [id=b84c84d2e05642088cf16af3760e3e24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.408342 6181 tablet_service.cc:1511] Processing CreateTablet for tablet 08d0508347964f0b8544e5ed5a2664f7 (DEFAULT_TABLE table=default.Table_dd8734e42a5d407782e8b34cad9c6e69 [id=312a610ec5ae46a099c029c0ed89c0b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.417369 6308 tablet_service.cc:1558] Processing DeleteTablet for tablet e6ebb766244f40a28e5fd96ecbb3e4f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:23.418931 6308 tablet_service.cc:1511] Processing CreateTablet for tablet 7708e5907a2944ab8f07f3420151bbd9 (DEFAULT_TABLE table=default.Table_a91fd2b80f484a57af9cc5aff55f5d4d [id=08df51d17ddb44e4b82b03c318fc7fc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.419250 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7708e5907a2944ab8f07f3420151bbd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.420687 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 7708e5907a2944ab8f07f3420151bbd9 (DEFAULT_TABLE table=default.Table_a91fd2b80f484a57af9cc5aff55f5d4d [id=08df51d17ddb44e4b82b03c318fc7fc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.421021 6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fcdd7795eac4b2fa6a987b14301330c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.426579 6310 tablet_service.cc:1511] Processing CreateTablet for tablet eafe14d377204b02a6130c0f479d5cf7 (DEFAULT_TABLE table=default.Table_fb38a603ce2c4e0d858c6766cbd28ebb [id=0a6cdf68f7af4ed5b007f53b878280aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.426956 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eafe14d377204b02a6130c0f479d5cf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.415191 6039 tablet_service.cc:1558] Processing DeleteTablet for tablet e6ebb766244f40a28e5fd96ecbb3e4f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:23.415328 6040 tablet_service.cc:1511] Processing CreateTablet for tablet bf5b8f14341a4a9a98111215a68927a6 (DEFAULT_TABLE table=default.Table_51ce07574ea94e9d9eac28bd48d0e462 [id=27b2fada84b14d66ad33913d4cc11a02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.427956 6040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf5b8f14341a4a9a98111215a68927a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.429755 6174 tablet_service.cc:1511] Processing CreateTablet for tablet eafe14d377204b02a6130c0f479d5cf7 (DEFAULT_TABLE table=default.Table_fb38a603ce2c4e0d858c6766cbd28ebb [id=0a6cdf68f7af4ed5b007f53b878280aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.415478 6035 tablet_service.cc:1511] Processing CreateTablet for tablet 6fcdd7795eac4b2fa6a987b14301330c (DEFAULT_TABLE table=default.Table_5322c2cdfb42499d84b648cebc527d79 [id=b84c84d2e05642088cf16af3760e3e24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.430275 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fcdd7795eac4b2fa6a987b14301330c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.415642 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 08d0508347964f0b8544e5ed5a2664f7 (DEFAULT_TABLE table=default.Table_dd8734e42a5d407782e8b34cad9c6e69 [id=312a610ec5ae46a099c029c0ed89c0b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.434468 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08d0508347964f0b8544e5ed5a2664f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.423909 6032 tablet_service.cc:1511] Processing CreateTablet for tablet 7708e5907a2944ab8f07f3420151bbd9 (DEFAULT_TABLE table=default.Table_a91fd2b80f484a57af9cc5aff55f5d4d [id=08df51d17ddb44e4b82b03c318fc7fc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.438867 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7708e5907a2944ab8f07f3420151bbd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.438844 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 95d0a1cce0bc4c8db3e5e2b11545c0ab (DEFAULT_TABLE table=default.Table_608e79573af4498e8ba356c79ad07f01 [id=8cfbf59fd67a4b0882f7b4dfda50fd76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.440861 6454 tablet_bootstrap.cc:492] T f7cf45d4c4d3480288698682c1c85869 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:23.440990 6454 ts_tablet_manager.cc:1403] T f7cf45d4c4d3480288698682c1c85869 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.120s user 0.001s sys 0.005s
I20260923 19:50:23.441354 6033 tablet_service.cc:1511] Processing CreateTablet for tablet 95d0a1cce0bc4c8db3e5e2b11545c0ab (DEFAULT_TABLE table=default.Table_608e79573af4498e8ba356c79ad07f01 [id=8cfbf59fd67a4b0882f7b4dfda50fd76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.441691 6033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95d0a1cce0bc4c8db3e5e2b11545c0ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.441699 6454 raft_consensus.cc:359] T f7cf45d4c4d3480288698682c1c85869 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:23.441864 6454 raft_consensus.cc:385] T f7cf45d4c4d3480288698682c1c85869 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:23.441946 6454 raft_consensus.cc:740] T f7cf45d4c4d3480288698682c1c85869 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:23.442149 6039 tablet_service.cc:1511] Processing CreateTablet for tablet eafe14d377204b02a6130c0f479d5cf7 (DEFAULT_TABLE table=default.Table_fb38a603ce2c4e0d858c6766cbd28ebb [id=0a6cdf68f7af4ed5b007f53b878280aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.442217 6454 consensus_queue.cc:260] T f7cf45d4c4d3480288698682c1c85869 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:23.442456 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eafe14d377204b02a6130c0f479d5cf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.443575 6454 ts_tablet_manager.cc:1434] T f7cf45d4c4d3480288698682c1c85869 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260923 19:50:23.450997 6456 tablet_bootstrap.cc:492] T 554655516bb547ad9c2aa1ee66dc8deb P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:23.451206 6456 ts_tablet_manager.cc:1403] T 554655516bb547ad9c2aa1ee66dc8deb P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.057s user 0.003s sys 0.000s
I20260923 19:50:23.451954 6456 raft_consensus.cc:359] T 554655516bb547ad9c2aa1ee66dc8deb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:23.452186 6456 raft_consensus.cc:385] T 554655516bb547ad9c2aa1ee66dc8deb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:23.452276 6456 raft_consensus.cc:740] T 554655516bb547ad9c2aa1ee66dc8deb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:23.452579 6456 consensus_queue.cc:260] T 554655516bb547ad9c2aa1ee66dc8deb P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:23.452682 5799 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c3bac0c76df144e2b2ae4fbb809e2d84 consensus state has no leader
I20260923 19:50:23.455456 6456 ts_tablet_manager.cc:1434] T 554655516bb547ad9c2aa1ee66dc8deb P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260923 19:50:23.455797 6456 tablet_bootstrap.cc:492] T 670d9cb0e6e2414092f72ffd5e6b00ea P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:23.464319 6458 ts_tablet_manager.cc:1929] T fc151f4d78344efeada6d6e57af6eb9f P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:23.464491 6458 log.cc:1199] T fc151f4d78344efeada6d6e57af6eb9f P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/fc151f4d78344efeada6d6e57af6eb9f
I20260923 19:50:23.465508 6458 ts_tablet_manager.cc:1950] T fc151f4d78344efeada6d6e57af6eb9f P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:23.467482 5800 catalog_manager.cc:5838] T 1c43641327d14a888a2815e49a2762c8 P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:23.467881 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 971) took 1798 ms. Trace:
I20260923 19:50:23.467900 5800 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 1c43641327d14a888a2815e49a2762c8 (table default.Table_6a56e4926a7b43d29a2cc015f69e8684 [id=923a67e6f6534f4da28ce819cecd9171]). Expected version 2 got 0
I20260923 19:50:23.467960 6458 rpcz_store.cc:276] 0923 19:50:21.669325 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.669369 (+ 44us) service_pool.cc:224] Handling call
0923 19:50:23.378931 (+1709562us) ts_tablet_manager.cc:1151] Deleting tablet fc151f4d78344efeada6d6e57af6eb9f
0923 19:50:23.378941 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.387521 (+ 8580us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.464251 (+ 76730us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.467865 (+ 3614us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1709410}
I20260923 19:50:23.468397 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 972) took 1773 ms. Trace:
I20260923 19:50:23.468433 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet fc151f4d78344efeada6d6e57af6eb9f (table default.Table_412c7972d6ad4c9c9e44ad5763e7a6c7 [id=22bf03cd65ab4346af756b244875c007]) successfully deleted
I20260923 19:50:23.471376 5804 master_service.cc:960] ReplaceTablet: received request to replace tablet 4f0de9a4b9164e05874d322a0b4a8e46 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:23.402572 6461 rpcz_store.cc:276] 0923 19:50:21.941040 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.941108 (+ 68us) service_pool.cc:224] Handling call
0923 19:50:23.316629 (+1375521us) ts_tablet_manager.cc:1151] Deleting tablet 85f5ba9097674f9d889e178eaea4f0d7
0923 19:50:23.316725 (+ 96us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.351489 (+ 34764us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.363019 (+ 11530us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.402015 (+ 38996us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1375289}
I20260923 19:50:23.363197 6457 ts_tablet_manager.cc:1434] T cb11d6e082784ad98cfb5253dbb88707 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.032s user 0.001s sys 0.001s
I20260923 19:50:23.472942 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf5b8f14341a4a9a98111215a68927a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.473037 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 85f5ba9097674f9d889e178eaea4f0d7 (table default.Table_0b7f0cec058c44798de4db8eeaf31ef4 [id=ae0f416afa6d49d4a3ab11ed40f0df48]) successfully deleted
I20260923 19:50:23.476351 6457 tablet_bootstrap.cc:492] T 8d20b59aa99f49f0b2f4d7dd861470f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:23.479262 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 992) took 1536 ms. Trace:
I20260923 19:50:23.479523 6461 rpcz_store.cc:276] 0923 19:50:21.942410 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.942476 (+ 66us) service_pool.cc:224] Handling call
0923 19:50:23.479056 (+1536580us) ts_tablet_manager.cc:1151] Deleting tablet 441ec1cea9a74dd3ac4dc139d2b0baa2
0923 19:50:23.479068 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.479241 (+ 173us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1536372}
W20260923 19:50:23.480211 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 441ec1cea9a74dd3ac4dc139d2b0baa2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 441ec1cea9a74dd3ac4dc139d2b0baa2 already in progress: creating tablet
I20260923 19:50:23.481348 6307 tablet_service.cc:1511] Processing CreateTablet for tablet 95d0a1cce0bc4c8db3e5e2b11545c0ab (DEFAULT_TABLE table=default.Table_608e79573af4498e8ba356c79ad07f01 [id=8cfbf59fd67a4b0882f7b4dfda50fd76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.482021 6454 tablet_bootstrap.cc:492] T b9c187ee1fa8438397c83bc2c2b16925 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:23.468477 6458 rpcz_store.cc:276] 0923 19:50:21.694521 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.694582 (+ 61us) service_pool.cc:224] Handling call
0923 19:50:23.468253 (+1773671us) ts_tablet_manager.cc:1151] Deleting tablet 5c9768e71e0640ceb110a19e53484044
0923 19:50:23.468262 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.468354 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1773478}
I20260923 19:50:23.482475 6307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95d0a1cce0bc4c8db3e5e2b11545c0ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.483441 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7708e5907a2944ab8f07f3420151bbd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.486068 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eafe14d377204b02a6130c0f479d5cf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.486981 6454 tablet_bootstrap.cc:654] T b9c187ee1fa8438397c83bc2c2b16925 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:23.489300 6459 ts_tablet_manager.cc:1929] T d6d3601a392f4723b4ca00f6e12b950c P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:23.489391 6459 log.cc:1199] T d6d3601a392f4723b4ca00f6e12b950c P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/d6d3601a392f4723b4ca00f6e12b950c
I20260923 19:50:23.489701 6459 ts_tablet_manager.cc:1950] T d6d3601a392f4723b4ca00f6e12b950c P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:23.490870 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95d0a1cce0bc4c8db3e5e2b11545c0ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.483215 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 973) took 1788 ms. Trace:
I20260923 19:50:23.491259 6458 rpcz_store.cc:276] 0923 19:50:21.694636 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.694683 (+ 47us) service_pool.cc:224] Handling call
0923 19:50:23.482651 (+1787968us) ts_tablet_manager.cc:1151] Deleting tablet 96577a68f4984c90b82cf4d32e701476
0923 19:50:23.482758 (+ 107us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.483063 (+ 305us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1787802}
I20260923 19:50:23.491966 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 1003) took 1110 ms. Trace:
I20260923 19:50:23.492102 6461 rpcz_store.cc:276] 0923 19:50:22.381166 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:22.381505 (+ 339us) service_pool.cc:224] Handling call
0923 19:50:23.480274 (+1098769us) ts_tablet_manager.cc:1151] Deleting tablet 3eb8d0a6a2a14388a60b6901106b2856
0923 19:50:23.491805 (+ 11531us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.491939 (+ 134us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1098585}
W20260923 19:50:23.492627 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 3eb8d0a6a2a14388a60b6901106b2856 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3eb8d0a6a2a14388a60b6901106b2856 already in progress: creating tablet
I20260923 19:50:23.492806 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 975) took 1701 ms. Trace:
I20260923 19:50:23.492902 6458 rpcz_store.cc:276] 0923 19:50:21.791534 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.791594 (+ 60us) service_pool.cc:224] Handling call
0923 19:50:23.492681 (+1701087us) ts_tablet_manager.cc:1151] Deleting tablet af0f632bd266480d9ab1f864db5cd93e
0923 19:50:23.492693 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.492787 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1700914}
W20260923 19:50:23.494256 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 5c9768e71e0640ceb110a19e53484044 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c9768e71e0640ceb110a19e53484044 already in progress: creating tablet
W20260923 19:50:23.494493 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 96577a68f4984c90b82cf4d32e701476 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96577a68f4984c90b82cf4d32e701476 already in progress: creating tablet
W20260923 19:50:23.494699 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet af0f632bd266480d9ab1f864db5cd93e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet af0f632bd266480d9ab1f864db5cd93e already in progress: creating tablet
I20260923 19:50:23.495195 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 1009) took 1078 ms. Trace:
I20260923 19:50:23.495323 6461 rpcz_store.cc:276] 0923 19:50:22.417253 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:22.420414 (+ 3161us) service_pool.cc:224] Handling call
0923 19:50:23.492902 (+1072488us) ts_tablet_manager.cc:1151] Deleting tablet f45863a748ce4d2f94d1ad639c7e6bf7
0923 19:50:23.495043 (+ 2141us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.495175 (+ 132us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1071952}
W20260923 19:50:23.495831 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet f45863a748ce4d2f94d1ad639c7e6bf7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f45863a748ce4d2f94d1ad639c7e6bf7 already in progress: creating tablet
I20260923 19:50:23.496165 6461 tablet_replica.cc:333] T ce6b86f947ce420994eaa5ff39ad9c87 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:23.496526 6461 raft_consensus.cc:2243] T ce6b86f947ce420994eaa5ff39ad9c87 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:23.496842 6461 raft_consensus.cc:2272] T ce6b86f947ce420994eaa5ff39ad9c87 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:23.493817 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 977) took 1701 ms. Trace:
I20260923 19:50:23.497248 6458 rpcz_store.cc:276] 0923 19:50:21.792699 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.792745 (+ 46us) service_pool.cc:224] Handling call
0923 19:50:23.493723 (+1700978us) ts_tablet_manager.cc:1151] Deleting tablet fcc32bda7c684e849161f9d4a3df79d3
0923 19:50:23.493732 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.493803 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1700835}
I20260923 19:50:23.497980 6461 ts_tablet_manager.cc:1916] T ce6b86f947ce420994eaa5ff39ad9c87 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:23.500921 6177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fcdd7795eac4b2fa6a987b14301330c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.503983 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 976) took 1711 ms. Trace:
I20260923 19:50:23.505264 6458 rpcz_store.cc:276] 0923 19:50:21.792602 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.792913 (+ 311us) service_pool.cc:224] Handling call
0923 19:50:23.503872 (+1710959us) ts_tablet_manager.cc:1151] Deleting tablet b297338b1d5a4e5797d364b891081548
0923 19:50:23.503882 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.503965 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1710854}
I20260923 19:50:23.506018 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 978) took 1702 ms. Trace:
W20260923 19:50:23.507236 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet fcc32bda7c684e849161f9d4a3df79d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fcc32bda7c684e849161f9d4a3df79d3 already in progress: creating tablet
W20260923 19:50:23.507491 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet b297338b1d5a4e5797d364b891081548 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b297338b1d5a4e5797d364b891081548 already in progress: creating tablet
I20260923 19:50:23.509670 6458 rpcz_store.cc:276] 0923 19:50:21.803651 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.803710 (+ 59us) service_pool.cc:224] Handling call
0923 19:50:23.505917 (+1702207us) ts_tablet_manager.cc:1151] Deleting tablet 5c9768e71e0640ceb110a19e53484044
0923 19:50:23.505929 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.506004 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1702005}
W20260923 19:50:23.510386 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 5c9768e71e0640ceb110a19e53484044 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c9768e71e0640ceb110a19e53484044 already in progress: creating tablet
I20260923 19:50:23.510643 6172 tablet_service.cc:1511] Processing CreateTablet for tablet 649c044b675548048456b21476173ab5 (DEFAULT_TABLE table=default.Table_5063afc81fb14ad2ae7b3d909ab6f1ad [id=c6b53d9f923f4ab297d63e9eb14d61b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.510771 6458 tablet_replica.cc:333] T a10d35bf564d45488524d3d21721f4e5 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:23.510937 6458 raft_consensus.cc:2243] T a10d35bf564d45488524d3d21721f4e5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:23.511577 6458 raft_consensus.cc:2272] T a10d35bf564d45488524d3d21721f4e5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:23.512418 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 649c044b675548048456b21476173ab5 (DEFAULT_TABLE table=default.Table_5063afc81fb14ad2ae7b3d909ab6f1ad [id=c6b53d9f923f4ab297d63e9eb14d61b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.512584 6308 tablet_service.cc:1511] Processing CreateTablet for tablet 01185b90f2924320b40c96691b4fb3cd (DEFAULT_TABLE table=default.Table_a664d00b589243eeb2c9fb5047b870fa [id=7b5fce3da774429e986e060792fe44a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.512893 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 649c044b675548048456b21476173ab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.512938 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01185b90f2924320b40c96691b4fb3cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.514882 6165 tablet_service.cc:1511] Processing CreateTablet for tablet 01185b90f2924320b40c96691b4fb3cd (DEFAULT_TABLE table=default.Table_a664d00b589243eeb2c9fb5047b870fa [id=7b5fce3da774429e986e060792fe44a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.515460 6035 tablet_service.cc:1511] Processing CreateTablet for tablet 01185b90f2924320b40c96691b4fb3cd (DEFAULT_TABLE table=default.Table_a664d00b589243eeb2c9fb5047b870fa [id=7b5fce3da774429e986e060792fe44a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.517024 6457 tablet_bootstrap.cc:654] T 8d20b59aa99f49f0b2f4d7dd861470f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:23.517166 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08d0508347964f0b8544e5ed5a2664f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.517732 6310 tablet_service.cc:1511] Processing CreateTablet for tablet af50304bb95348ecb68e718719374f24 (DEFAULT_TABLE table=default.Table_16d436ca05ae40009afbe715675bdd6e [id=737897b71e94481f968ceb964f27a05d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.518091 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af50304bb95348ecb68e718719374f24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.518472 6166 tablet_service.cc:1511] Processing CreateTablet for tablet af50304bb95348ecb68e718719374f24 (DEFAULT_TABLE table=default.Table_16d436ca05ae40009afbe715675bdd6e [id=737897b71e94481f968ceb964f27a05d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.519949 6325 tablet_service.cc:1511] Processing CreateTablet for tablet fbb1f1f907414af58d98c79436c494ff (DEFAULT_TABLE table=default.Table_b8d3e92566e743de973df105d81e91bc [id=9703b6beabb448f18b3c42b223ce166b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.520358 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbb1f1f907414af58d98c79436c494ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.520561 6173 tablet_service.cc:1511] Processing CreateTablet for tablet fbb1f1f907414af58d98c79436c494ff (DEFAULT_TABLE table=default.Table_b8d3e92566e743de973df105d81e91bc [id=9703b6beabb448f18b3c42b223ce166b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.522393 6316 tablet_service.cc:1511] Processing CreateTablet for tablet 649c044b675548048456b21476173ab5 (DEFAULT_TABLE table=default.Table_5063afc81fb14ad2ae7b3d909ab6f1ad [id=c6b53d9f923f4ab297d63e9eb14d61b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.522807 6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 649c044b675548048456b21476173ab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.524384 6040 tablet_service.cc:1511] Processing CreateTablet for tablet fbb1f1f907414af58d98c79436c494ff (DEFAULT_TABLE table=default.Table_b8d3e92566e743de973df105d81e91bc [id=9703b6beabb448f18b3c42b223ce166b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.526698 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 68fa10d3909543b2b1bc3383b8c2a03a (DEFAULT_TABLE table=default.Table_abc53c33a5f040e4b0d0367e7645d8f5 [id=255cd08d3a214808b68e22fc33411fca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.526912 6171 tablet_service.cc:1511] Processing CreateTablet for tablet 68fa10d3909543b2b1bc3383b8c2a03a (DEFAULT_TABLE table=default.Table_abc53c33a5f040e4b0d0367e7645d8f5 [id=255cd08d3a214808b68e22fc33411fca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.526998 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68fa10d3909543b2b1bc3383b8c2a03a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.529109 6040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbb1f1f907414af58d98c79436c494ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.530004 6032 tablet_service.cc:1511] Processing CreateTablet for tablet af50304bb95348ecb68e718719374f24 (DEFAULT_TABLE table=default.Table_16d436ca05ae40009afbe715675bdd6e [id=737897b71e94481f968ceb964f27a05d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.530313 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af50304bb95348ecb68e718719374f24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.531141 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01185b90f2924320b40c96691b4fb3cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.533988 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 949) took 2319 ms. Trace:
I20260923 19:50:23.534133 6459 rpcz_store.cc:276] 0923 19:50:21.214264 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.214320 (+ 56us) service_pool.cc:224] Handling call
0923 19:50:23.335093 (+2120773us) ts_tablet_manager.cc:1151] Deleting tablet d6d3601a392f4723b4ca00f6e12b950c
0923 19:50:23.335105 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.486443 (+151338us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.489254 (+ 2811us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.533972 (+ 44718us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2120613}
I20260923 19:50:23.534653 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 950) took 2268 ms. Trace:
I20260923 19:50:23.534799 6459 rpcz_store.cc:276] 0923 19:50:21.266210 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.266267 (+ 57us) service_pool.cc:224] Handling call
0923 19:50:23.534521 (+2268254us) ts_tablet_manager.cc:1151] Deleting tablet f8052b05169b4673b387ac8b716ffc4e
0923 19:50:23.534530 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.534637 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2268066}
I20260923 19:50:23.535300 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 951) took 2259 ms. Trace:
I20260923 19:50:23.535444 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet d6d3601a392f4723b4ca00f6e12b950c (table default.Table_74b3ada03dc14044b09a369b0e3782c7 [id=6c09f84a1d19402b8b59bbc60ae92bcb]) successfully deleted
I20260923 19:50:23.535434 6459 rpcz_store.cc:276] 0923 19:50:21.276067 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.276125 (+ 58us) service_pool.cc:224] Handling call
0923 19:50:23.535207 (+2259082us) ts_tablet_manager.cc:1151] Deleting tablet c500791905944480840c25929bc7bbe1
0923 19:50:23.535216 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.535287 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2258887}
W20260923 19:50:23.535744 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet f8052b05169b4673b387ac8b716ffc4e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f8052b05169b4673b387ac8b716ffc4e already in progress: creating tablet
W20260923 19:50:23.535998 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet c500791905944480840c25929bc7bbe1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c500791905944480840c25929bc7bbe1 already in progress: creating tablet
I20260923 19:50:23.536028 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 952) took 2253 ms. Trace:
I20260923 19:50:23.531903 6039 tablet_service.cc:1511] Processing CreateTablet for tablet 68fa10d3909543b2b1bc3383b8c2a03a (DEFAULT_TABLE table=default.Table_abc53c33a5f040e4b0d0367e7645d8f5 [id=255cd08d3a214808b68e22fc33411fca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.536544 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68fa10d3909543b2b1bc3383b8c2a03a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.536098 6459 rpcz_store.cc:276] 0923 19:50:21.282879 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.282938 (+ 59us) service_pool.cc:224] Handling call
0923 19:50:23.535938 (+2253000us) ts_tablet_manager.cc:1151] Deleting tablet 4f3d70c3fb2c463db1d13dcbc428d30c
0923 19:50:23.535946 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.536014 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2252788}
I20260923 19:50:23.540170 6458 ts_tablet_manager.cc:1916] T a10d35bf564d45488524d3d21721f4e5 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:23.540234 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 4f3d70c3fb2c463db1d13dcbc428d30c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f3d70c3fb2c463db1d13dcbc428d30c already in progress: creating tablet
I20260923 19:50:23.541144 6454 tablet_bootstrap.cc:492] T b9c187ee1fa8438397c83bc2c2b16925 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:23.542407 6454 ts_tablet_manager.cc:1403] T b9c187ee1fa8438397c83bc2c2b16925 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.060s user 0.009s sys 0.000s
W20260923 19:50:23.542965 5700 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 46746.3us
I20260923 19:50:23.543175 6454 raft_consensus.cc:359] T b9c187ee1fa8438397c83bc2c2b16925 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:23.543344 6454 raft_consensus.cc:385] T b9c187ee1fa8438397c83bc2c2b16925 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:23.543397 6454 raft_consensus.cc:740] T b9c187ee1fa8438397c83bc2c2b16925 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:23.543625 6454 consensus_queue.cc:260] T b9c187ee1fa8438397c83bc2c2b16925 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:23.544304 6454 ts_tablet_manager.cc:1434] T b9c187ee1fa8438397c83bc2c2b16925 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:23.547304 6180 tablet_service.cc:1511] Processing CreateTablet for tablet a8ff365455654640945b173894de65c3 (DEFAULT_TABLE table=default.Table_f08a29f184db41a799596833fb608cdf [id=51e3ace74c314b61ab44d9152180bc1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.548518 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 953) took 2252 ms. Trace:
I20260923 19:50:23.548933 6459 rpcz_store.cc:276] 0923 19:50:21.296028 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.296089 (+ 61us) service_pool.cc:224] Handling call
0923 19:50:23.548385 (+2252296us) ts_tablet_manager.cc:1151] Deleting tablet a5cd258b6ff44e3db0d4cb66b51874b0
0923 19:50:23.548396 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.548500 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2252070}
I20260923 19:50:23.550174 6033 tablet_service.cc:1511] Processing CreateTablet for tablet a8ff365455654640945b173894de65c3 (DEFAULT_TABLE table=default.Table_f08a29f184db41a799596833fb608cdf [id=51e3ace74c314b61ab44d9152180bc1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.550551 6033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8ff365455654640945b173894de65c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.558537 6325 tablet_service.cc:1511] Processing CreateTablet for tablet a8ff365455654640945b173894de65c3 (DEFAULT_TABLE table=default.Table_f08a29f184db41a799596833fb608cdf [id=51e3ace74c314b61ab44d9152180bc1f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:23.559139 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet a5cd258b6ff44e3db0d4cb66b51874b0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a5cd258b6ff44e3db0d4cb66b51874b0 already in progress: creating tablet
I20260923 19:50:23.559522 6459 tablet_replica.cc:333] T 98f61ace3a984938ace1fedbaa1dafa3 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:23.561085 6454 tablet_bootstrap.cc:492] T 1b1d9413e1e24547b491a160d851377b P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:23.561816 6459 raft_consensus.cc:2243] T 98f61ace3a984938ace1fedbaa1dafa3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:23.563321 6456 tablet_bootstrap.cc:654] T 670d9cb0e6e2414092f72ffd5e6b00ea P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:23.563488 6459 raft_consensus.cc:2272] T 98f61ace3a984938ace1fedbaa1dafa3 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:23.563803 6308 tablet_service.cc:1511] Processing CreateTablet for tablet 3d741c4546bd477da6d13d8bf544dc08 (DEFAULT_TABLE table=default.Table_ef4075fc4b4042b6aefe48402acd9088 [id=bb993333bbbe42a892b4bdb714c36cc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.565234 6174 tablet_service.cc:1511] Processing CreateTablet for tablet 3d741c4546bd477da6d13d8bf544dc08 (DEFAULT_TABLE table=default.Table_ef4075fc4b4042b6aefe48402acd9088 [id=bb993333bbbe42a892b4bdb714c36cc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.566447 6459 ts_tablet_manager.cc:1916] T 98f61ace3a984938ace1fedbaa1dafa3 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:23.567646 6315 tablet_service.cc:1511] Processing CreateTablet for tablet b9b365957a1b4beca4d22f235b49a4ae (DEFAULT_TABLE table=default.Table_9c16acffff0c4d29995f569e1fbc8944 [id=cd58f7c5ff5f4b7695e006e3f242849a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.568011 6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9b365957a1b4beca4d22f235b49a4ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.569363 6171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68fa10d3909543b2b1bc3383b8c2a03a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.569545 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d741c4546bd477da6d13d8bf544dc08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.569639 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 3d741c4546bd477da6d13d8bf544dc08 (DEFAULT_TABLE table=default.Table_ef4075fc4b4042b6aefe48402acd9088 [id=bb993333bbbe42a892b4bdb714c36cc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.570055 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d741c4546bd477da6d13d8bf544dc08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.570292 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d741c4546bd477da6d13d8bf544dc08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.571854 6454 tablet_bootstrap.cc:654] T 1b1d9413e1e24547b491a160d851377b P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:23.573402 6165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01185b90f2924320b40c96691b4fb3cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.573833 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbb1f1f907414af58d98c79436c494ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.574234 6172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 649c044b675548048456b21476173ab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.575038 6183 tablet_service.cc:1511] Processing CreateTablet for tablet b9b365957a1b4beca4d22f235b49a4ae (DEFAULT_TABLE table=default.Table_9c16acffff0c4d29995f569e1fbc8944 [id=cd58f7c5ff5f4b7695e006e3f242849a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.578529 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9b365957a1b4beca4d22f235b49a4ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.582073 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af50304bb95348ecb68e718719374f24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.582851 6457 tablet_bootstrap.cc:492] T 8d20b59aa99f49f0b2f4d7dd861470f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:23.583050 6457 ts_tablet_manager.cc:1403] T 8d20b59aa99f49f0b2f4d7dd861470f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.107s user 0.004s sys 0.000s
I20260923 19:50:23.583807 6457 raft_consensus.cc:359] T 8d20b59aa99f49f0b2f4d7dd861470f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:23.584030 6457 raft_consensus.cc:385] T 8d20b59aa99f49f0b2f4d7dd861470f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:23.584133 6457 raft_consensus.cc:740] T 8d20b59aa99f49f0b2f4d7dd861470f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:23.584388 6457 consensus_queue.cc:260] T 8d20b59aa99f49f0b2f4d7dd861470f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:23.585147 6457 ts_tablet_manager.cc:1434] T 8d20b59aa99f49f0b2f4d7dd861470f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:23.589565 6457 tablet_bootstrap.cc:492] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:23.591293 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8ff365455654640945b173894de65c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.592470 6039 tablet_service.cc:1511] Processing CreateTablet for tablet b9b365957a1b4beca4d22f235b49a4ae (DEFAULT_TABLE table=default.Table_9c16acffff0c4d29995f569e1fbc8944 [id=cd58f7c5ff5f4b7695e006e3f242849a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.596086 6458 ts_tablet_manager.cc:1929] T a10d35bf564d45488524d3d21721f4e5 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:23.596256 6458 log.cc:1199] T a10d35bf564d45488524d3d21721f4e5 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/a10d35bf564d45488524d3d21721f4e5
I20260923 19:50:23.596608 6458 ts_tablet_manager.cc:1950] T a10d35bf564d45488524d3d21721f4e5 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:23.597422 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 981) took 1746 ms. Trace:
I20260923 19:50:23.597574 6458 rpcz_store.cc:276] 0923 19:50:21.851407 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.851472 (+ 65us) service_pool.cc:224] Handling call
0923 19:50:23.510726 (+1659254us) ts_tablet_manager.cc:1151] Deleting tablet a10d35bf564d45488524d3d21721f4e5
0923 19:50:23.510735 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.588258 (+ 77523us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.596036 (+ 7778us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.597404 (+ 1368us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1659049}
I20260923 19:50:23.598101 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 974) took 1897 ms. Trace:
I20260923 19:50:23.598225 6458 rpcz_store.cc:276] 0923 19:50:21.700695 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.700740 (+ 45us) service_pool.cc:224] Handling call
0923 19:50:23.597947 (+1897207us) ts_tablet_manager.cc:1151] Deleting tablet ab81b40554e2411780ecfe12ef4a8f7d
0923 19:50:23.597958 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.598085 (+ 127us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1675176}
I20260923 19:50:23.599447 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet a10d35bf564d45488524d3d21721f4e5 (table default.Table_c670311ee64c4e728677dc29691ea3f9 [id=fa0ce77597ba4d37aca817429efd86b7]) successfully deleted
W20260923 19:50:23.599949 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet ab81b40554e2411780ecfe12ef4a8f7d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab81b40554e2411780ecfe12ef4a8f7d already in progress: creating tablet
I20260923 19:50:23.598694 6308 tablet_service.cc:1511] Processing CreateTablet for tablet b483bc3a99864e6f96b12709e1a8681f (DEFAULT_TABLE table=default.Table_416deb1d1c5a42c9a6f56834e09561b8 [id=2153de06941d4af68cdc5c33b95b0485]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.599484 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8ff365455654640945b173894de65c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.602205 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b483bc3a99864e6f96b12709e1a8681f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.603982 6032 tablet_service.cc:1511] Processing CreateTablet for tablet b483bc3a99864e6f96b12709e1a8681f (DEFAULT_TABLE table=default.Table_416deb1d1c5a42c9a6f56834e09561b8 [id=2153de06941d4af68cdc5c33b95b0485]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.604938 6165 tablet_service.cc:1511] Processing CreateTablet for tablet 4cca260201224f1eb55b423e1a0a6593 (DEFAULT_TABLE table=default.Table_f9278375b70547d0882596f4fd9f1295 [id=f221a726316545ca8c0bf25e58971f73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.605306 6165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cca260201224f1eb55b423e1a0a6593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.605786 6315 tablet_service.cc:1511] Processing CreateTablet for tablet 4cca260201224f1eb55b423e1a0a6593 (DEFAULT_TABLE table=default.Table_f9278375b70547d0882596f4fd9f1295 [id=f221a726316545ca8c0bf25e58971f73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.606132 6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cca260201224f1eb55b423e1a0a6593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.608934 6459 ts_tablet_manager.cc:1929] T 98f61ace3a984938ace1fedbaa1dafa3 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:23.609066 6459 log.cc:1199] T 98f61ace3a984938ace1fedbaa1dafa3 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/98f61ace3a984938ace1fedbaa1dafa3
I20260923 19:50:23.609364 6459 ts_tablet_manager.cc:1950] T 98f61ace3a984938ace1fedbaa1dafa3 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:23.610390 6035 tablet_service.cc:1511] Processing CreateTablet for tablet 4cca260201224f1eb55b423e1a0a6593 (DEFAULT_TABLE table=default.Table_f9278375b70547d0882596f4fd9f1295 [id=f221a726316545ca8c0bf25e58971f73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.612399 6033 tablet_service.cc:1511] Processing CreateTablet for tablet 4e6190703b37481aae29dbed059fea52 (DEFAULT_TABLE table=default.Table_79c60d04e1344d8db8ab8264fc2fadfb [id=99824d2c41df4d16af50a28b6db1dc1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.615173 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9b365957a1b4beca4d22f235b49a4ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.616650 6025 tablet_service.cc:1511] Processing CreateTablet for tablet cc49df86b5b24c87bdb62bd723deaf3c (DEFAULT_TABLE table=default.Table_b1d43c43c77240748d3bf2c2eaee1d65 [id=748d7b66dd7a47c59f86817972b0dccc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.619424 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc49df86b5b24c87bdb62bd723deaf3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.625661 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b483bc3a99864e6f96b12709e1a8681f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.630125 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cca260201224f1eb55b423e1a0a6593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.630213 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_af92277fab3e4672b156efcbb1d09f0b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:23.630791 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af92277fab3e4672b156efcbb1d09f0b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:23.634222 6040 tablet_service.cc:1511] Processing CreateTablet for tablet 86288216ebcf4ff0a77159260dc666d0 (DEFAULT_TABLE table=default.Table_1f4842736433434a923eca1ef9999b74 [id=f906a84f556a40bd9332b949dc0ec504]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.634675 6040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86288216ebcf4ff0a77159260dc666d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.635114 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_3738a8a397604cfca0fe015c4efeefde"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:23.635643 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3738a8a397604cfca0fe015c4efeefde in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:23.637431 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ac60821f06524a51b2ed9bcfa142bb9d" } new_table_name: "default.Table_7ffdfcefdec94e4a9a44a0f9f9b637ed" modify_external_catalogs: true
I20260923 19:50:23.639814 6033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e6190703b37481aae29dbed059fea52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.640698 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 4e6190703b37481aae29dbed059fea52 (DEFAULT_TABLE table=default.Table_79c60d04e1344d8db8ab8264fc2fadfb [id=99824d2c41df4d16af50a28b6db1dc1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.640853 6306 tablet_service.cc:1511] Processing CreateTablet for tablet 86288216ebcf4ff0a77159260dc666d0 (DEFAULT_TABLE table=default.Table_1f4842736433434a923eca1ef9999b74 [id=f906a84f556a40bd9332b949dc0ec504]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.641185 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e6190703b37481aae29dbed059fea52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.641494 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 983) took 1732 ms. Trace:
I20260923 19:50:23.642670 6306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86288216ebcf4ff0a77159260dc666d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.646945 6457 tablet_bootstrap.cc:654] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:23.641561 6458 rpcz_store.cc:276] 0923 19:50:21.908594 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.908690 (+ 96us) service_pool.cc:224] Handling call
0923 19:50:23.641368 (+1732678us) ts_tablet_manager.cc:1151] Deleting tablet 441ec1cea9a74dd3ac4dc139d2b0baa2
0923 19:50:23.641379 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.641475 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1708434}
I20260923 19:50:23.648481 6458 tablet_replica.cc:333] T 0c537304c32c44adaa1e05de4496293f P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:23.648726 6458 raft_consensus.cc:2243] T 0c537304c32c44adaa1e05de4496293f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:23.648898 6458 raft_consensus.cc:2272] T 0c537304c32c44adaa1e05de4496293f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:23.650029 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 441ec1cea9a74dd3ac4dc139d2b0baa2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 441ec1cea9a74dd3ac4dc139d2b0baa2 already in progress: creating tablet
I20260923 19:50:23.650215 6458 ts_tablet_manager.cc:1916] T 0c537304c32c44adaa1e05de4496293f P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:23.651876 5796 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f5765057e685428da3caaaa65e6ed904 consensus state has no leader
I20260923 19:50:23.652705 5797 master_service.cc:960] ReplaceTablet: received request to replace tablet b8211238627b44468c8461bdc340b1bb from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:23.653507 5799 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_03f41ae74ce143c480c51cb8296efa58 [id=a56799b0709846cf8308d7d7b727427c] alter complete (version 3)
I20260923 19:50:23.660831 7813 raft_consensus.cc:493] T f1c1d4f73488499a9e5add81e9d5e2d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:23.660964 7813 raft_consensus.cc:515] T f1c1d4f73488499a9e5add81e9d5e2d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:23.661739 7813 leader_election.cc:290] T f1c1d4f73488499a9e5add81e9d5e2d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:23.662514 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c1d4f73488499a9e5add81e9d5e2d6" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:23.662982 5996 leader_election.cc:343] T f1c1d4f73488499a9e5add81e9d5e2d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:23.670081 6461 ts_tablet_manager.cc:1929] T ce6b86f947ce420994eaa5ff39ad9c87 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:23.670194 6461 log.cc:1199] T ce6b86f947ce420994eaa5ff39ad9c87 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/ce6b86f947ce420994eaa5ff39ad9c87
I20260923 19:50:23.670482 6461 ts_tablet_manager.cc:1950] T ce6b86f947ce420994eaa5ff39ad9c87 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:23.671265 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 1011) took 1230 ms. Trace:
I20260923 19:50:23.671341 6461 rpcz_store.cc:276] 0923 19:50:22.440349 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:22.440415 (+ 66us) service_pool.cc:224] Handling call
0923 19:50:23.496121 (+1055706us) ts_tablet_manager.cc:1151] Deleting tablet ce6b86f947ce420994eaa5ff39ad9c87
0923 19:50:23.496130 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.605431 (+109301us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.670028 (+ 64597us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.671246 (+ 1218us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1055391}
I20260923 19:50:23.671823 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet ce6b86f947ce420994eaa5ff39ad9c87 (table default.Table_145e4ce20b7d428da857269e35bbee83 [id=70f85c0de552418e98578790dded6b7c]) successfully deleted
I20260923 19:50:23.676020 6456 tablet_bootstrap.cc:492] T 670d9cb0e6e2414092f72ffd5e6b00ea P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:23.676239 6456 ts_tablet_manager.cc:1403] T 670d9cb0e6e2414092f72ffd5e6b00ea P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.221s user 0.001s sys 0.017s
I20260923 19:50:23.684151 6456 raft_consensus.cc:359] T 670d9cb0e6e2414092f72ffd5e6b00ea P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:23.684322 6456 raft_consensus.cc:385] T 670d9cb0e6e2414092f72ffd5e6b00ea P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:23.684366 6456 raft_consensus.cc:740] T 670d9cb0e6e2414092f72ffd5e6b00ea P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:23.684624 6456 consensus_queue.cc:260] T 670d9cb0e6e2414092f72ffd5e6b00ea P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:23.685510 6456 ts_tablet_manager.cc:1434] T 670d9cb0e6e2414092f72ffd5e6b00ea P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260923 19:50:23.672389 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 1010) took 1233 ms. Trace:
I20260923 19:50:23.691220 6456 tablet_bootstrap.cc:492] T f1f1df47dc32413d9cc9456f4198dca5 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:23.690925 6461 rpcz_store.cc:276] 0923 19:50:22.438494 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:22.438561 (+ 67us) service_pool.cc:224] Handling call
0923 19:50:23.672161 (+1233600us) ts_tablet_manager.cc:1151] Deleting tablet 771ad1e82bd743e597aefe5edafe63ea
0923 19:50:23.672174 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.672325 (+ 151us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1183800}
I20260923 19:50:23.694062 6456 tablet_bootstrap.cc:654] T f1f1df47dc32413d9cc9456f4198dca5 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:23.694623 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 771ad1e82bd743e597aefe5edafe63ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 771ad1e82bd743e597aefe5edafe63ea already in progress: creating tablet
I20260923 19:50:23.697628 6322 tablet_service.cc:1511] Processing CreateTablet for tablet 6cf5a8a047d547b58e08e50e9066018e (DEFAULT_TABLE table=default.Table_5bdbdee3baac47d5866b840863e76535 [id=a8dcf77ef11e4fb6977947675cb1a79f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.698110 6322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cf5a8a047d547b58e08e50e9066018e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.698348 6307 tablet_service.cc:1511] Processing CreateTablet for tablet cc49df86b5b24c87bdb62bd723deaf3c (DEFAULT_TABLE table=default.Table_b1d43c43c77240748d3bf2c2eaee1d65 [id=748d7b66dd7a47c59f86817972b0dccc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.698649 6307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc49df86b5b24c87bdb62bd723deaf3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.610489 7700 raft_consensus.cc:493] T f7cf45d4c4d3480288698682c1c85869 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:23.613847 6171 tablet_service.cc:1511] Processing CreateTablet for tablet 86288216ebcf4ff0a77159260dc666d0 (DEFAULT_TABLE table=default.Table_1f4842736433434a923eca1ef9999b74 [id=f906a84f556a40bd9332b949dc0ec504]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.701864 7700 raft_consensus.cc:515] T f7cf45d4c4d3480288698682c1c85869 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:23.702090 6171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86288216ebcf4ff0a77159260dc666d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.702565 7700 leader_election.cc:290] T f7cf45d4c4d3480288698682c1c85869 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:23.703326 6139 leader_election.cc:343] T f7cf45d4c4d3480288698682c1c85869 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: f7cf45d4c4d3480288698682c1c85869
W20260923 19:50:23.703431 6137 leader_election.cc:343] T f7cf45d4c4d3480288698682c1c85869 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: f7cf45d4c4d3480288698682c1c85869
I20260923 19:50:23.703523 6137 leader_election.cc:304] T f7cf45d4c4d3480288698682c1c85869 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:23.703832 7700 raft_consensus.cc:2749] T f7cf45d4c4d3480288698682c1c85869 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:23.704612 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 954) took 2344 ms. Trace:
I20260923 19:50:23.705941 6461 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56924 (request call id 1017) took 1244 ms. Trace:
I20260923 19:50:23.706034 6461 rpcz_store.cc:276] 0923 19:50:22.461956 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:22.462050 (+ 94us) service_pool.cc:224] Handling call
0923 19:50:23.695813 (+1233763us) ts_tablet_manager.cc:1151] Deleting tablet 2205316ed70543e5b3b001d88ab3ae5d
0923 19:50:23.696125 (+ 312us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.705919 (+ 9794us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1196122}
W20260923 19:50:23.706467 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 2205316ed70543e5b3b001d88ab3ae5d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2205316ed70543e5b3b001d88ab3ae5d already in progress: creating tablet
W20260923 19:50:23.708268 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 7e8facf019054ac79fea193f44fc6742 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e8facf019054ac79fea193f44fc6742 already in progress: creating tablet
I20260923 19:50:23.614109 6166 tablet_service.cc:1511] Processing CreateTablet for tablet 4e6190703b37481aae29dbed059fea52 (DEFAULT_TABLE table=default.Table_79c60d04e1344d8db8ab8264fc2fadfb [id=99824d2c41df4d16af50a28b6db1dc1f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:23.709652 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 8c5ac79e5fa2438a87db948792d448b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c5ac79e5fa2438a87db948792d448b1 already in progress: creating tablet
W20260923 19:50:23.710950 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet c53b817e3ed7419b904a3c4b1c83e59f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c53b817e3ed7419b904a3c4b1c83e59f already in progress: creating tablet
I20260923 19:50:23.711948 6458 ts_tablet_manager.cc:1929] T 0c537304c32c44adaa1e05de4496293f P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:23.712069 6458 log.cc:1199] T 0c537304c32c44adaa1e05de4496293f P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/0c537304c32c44adaa1e05de4496293f
W20260923 19:50:23.712213 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet a55b2ff045d648339d7e207f13e2fa27 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a55b2ff045d648339d7e207f13e2fa27 already in progress: creating tablet
I20260923 19:50:23.712457 6458 ts_tablet_manager.cc:1950] T 0c537304c32c44adaa1e05de4496293f P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:23.712773 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 988) took 1789 ms. Trace:
I20260923 19:50:23.712862 6458 rpcz_store.cc:276] 0923 19:50:21.923221 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:22.031251 (+108030us) service_pool.cc:224] Handling call
0923 19:50:23.648415 (+1617164us) ts_tablet_manager.cc:1151] Deleting tablet 0c537304c32c44adaa1e05de4496293f
0923 19:50:23.648430 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.671096 (+ 22666us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.711897 (+ 40801us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.712756 (+ 859us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1616849}
I20260923 19:50:23.713327 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 0c537304c32c44adaa1e05de4496293f (table default.Table_5febe26a78884634a01aa0ec62f36604 [id=e2a29fc060074c45918b97001dd03207]) successfully deleted
I20260923 19:50:23.713307 6461 tablet_replica.cc:333] T ba0453ef529344dfbab1130daa985fef P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:23.713641 6458 tablet_replica.cc:333] T 528fca12bfe04747830ad1d3bb323676 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:23.714443 6461 raft_consensus.cc:2243] T ba0453ef529344dfbab1130daa985fef P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:23.715440 6461 raft_consensus.cc:2272] T ba0453ef529344dfbab1130daa985fef P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:23.716198 7813 raft_consensus.cc:493] T 8d20b59aa99f49f0b2f4d7dd861470f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:23.716367 7813 raft_consensus.cc:515] T 8d20b59aa99f49f0b2f4d7dd861470f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:23.717061 7813 leader_election.cc:290] T 8d20b59aa99f49f0b2f4d7dd861470f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:23.717758 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d20b59aa99f49f0b2f4d7dd861470f8" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:23.718267 5996 leader_election.cc:343] T 8d20b59aa99f49f0b2f4d7dd861470f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:23.616605 6249 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
I20260923 19:50:23.625295 6454 tablet_bootstrap.cc:492] T 1b1d9413e1e24547b491a160d851377b P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:23.660378 6173 tablet_service.cc:1511] Processing CreateTablet for tablet cc49df86b5b24c87bdb62bd723deaf3c (DEFAULT_TABLE table=default.Table_b1d43c43c77240748d3bf2c2eaee1d65 [id=748d7b66dd7a47c59f86817972b0dccc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.662076 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c1d4f73488499a9e5add81e9d5e2d6" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:23.722007 5995 leader_election.cc:343] T f1c1d4f73488499a9e5add81e9d5e2d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:23.722116 5995 leader_election.cc:304] T f1c1d4f73488499a9e5add81e9d5e2d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:23.722379 7813 raft_consensus.cc:2749] T f1c1d4f73488499a9e5add81e9d5e2d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:23.713829 6458 raft_consensus.cc:2243] T 528fca12bfe04747830ad1d3bb323676 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:23.662257 6183 tablet_service.cc:1511] Processing CreateTablet for tablet b483bc3a99864e6f96b12709e1a8681f (DEFAULT_TABLE table=default.Table_416deb1d1c5a42c9a6f56834e09561b8 [id=2153de06941d4af68cdc5c33b95b0485]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.698362 6180 tablet_service.cc:1511] Processing CreateTablet for tablet 6cf5a8a047d547b58e08e50e9066018e (DEFAULT_TABLE table=default.Table_5bdbdee3baac47d5866b840863e76535 [id=a8dcf77ef11e4fb6977947675cb1a79f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.726241 6458 raft_consensus.cc:2272] T 528fca12bfe04747830ad1d3bb323676 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:23.727270 6458 ts_tablet_manager.cc:1916] T 528fca12bfe04747830ad1d3bb323676 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:23.732692 6040 tablet_service.cc:1511] Processing CreateTablet for tablet 6cf5a8a047d547b58e08e50e9066018e (DEFAULT_TABLE table=default.Table_5bdbdee3baac47d5866b840863e76535 [id=a8dcf77ef11e4fb6977947675cb1a79f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.733258 6040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cf5a8a047d547b58e08e50e9066018e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.734462 6456 tablet_bootstrap.cc:492] T f1f1df47dc32413d9cc9456f4198dca5 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:23.734604 6456 ts_tablet_manager.cc:1403] T f1f1df47dc32413d9cc9456f4198dca5 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.043s user 0.004s sys 0.008s
I20260923 19:50:23.704695 6459 rpcz_store.cc:276] 0923 19:50:21.359854 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.361927 (+ 2073us) service_pool.cc:224] Handling call
0923 19:50:23.559465 (+2197538us) ts_tablet_manager.cc:1151] Deleting tablet 98f61ace3a984938ace1fedbaa1dafa3
0923 19:50:23.559477 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.605982 (+ 46505us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.608886 (+ 2904us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.704594 (+ 95708us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2197329}
I20260923 19:50:23.735234 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 98f61ace3a984938ace1fedbaa1dafa3 (table default.Table_c624a31c5179478cb6c54a36d7a36892 [id=26caa02bc37e471abdf29bbbb3acba69]) successfully deleted
I20260923 19:50:23.735328 6456 raft_consensus.cc:359] T f1f1df47dc32413d9cc9456f4198dca5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:23.735519 6456 raft_consensus.cc:385] T f1f1df47dc32413d9cc9456f4198dca5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:23.735597 6456 raft_consensus.cc:740] T f1f1df47dc32413d9cc9456f4198dca5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:23.735795 6456 consensus_queue.cc:260] T f1f1df47dc32413d9cc9456f4198dca5 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:23.736455 6456 ts_tablet_manager.cc:1434] T f1f1df47dc32413d9cc9456f4198dca5 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:23.736750 6456 tablet_bootstrap.cc:492] T 92f94b93d1364bb1a2562eb577707cf1 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:23.736439 6461 ts_tablet_manager.cc:1916] T ba0453ef529344dfbab1130daa985fef P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:23.709205 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e6190703b37481aae29dbed059fea52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.721364 6454 ts_tablet_manager.cc:1403] T 1b1d9413e1e24547b491a160d851377b P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.160s user 0.004s sys 0.005s
I20260923 19:50:23.738256 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cf5a8a047d547b58e08e50e9066018e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.738977 6454 raft_consensus.cc:359] T 1b1d9413e1e24547b491a160d851377b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:23.739159 6454 raft_consensus.cc:385] T 1b1d9413e1e24547b491a160d851377b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:23.739231 6454 raft_consensus.cc:740] T 1b1d9413e1e24547b491a160d851377b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:23.739430 6454 consensus_queue.cc:260] T 1b1d9413e1e24547b491a160d851377b P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:23.739850 6454 ts_tablet_manager.cc:1434] T 1b1d9413e1e24547b491a160d851377b P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:23.740136 6454 tablet_bootstrap.cc:492] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:23.741672 6454 tablet_bootstrap.cc:654] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:23.717464 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d20b59aa99f49f0b2f4d7dd861470f8" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:23.742501 5995 leader_election.cc:343] T 8d20b59aa99f49f0b2f4d7dd861470f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:23.742621 5995 leader_election.cc:304] T 8d20b59aa99f49f0b2f4d7dd861470f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:23.745445 7816 raft_consensus.cc:2749] T 8d20b59aa99f49f0b2f4d7dd861470f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:23.746203 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b483bc3a99864e6f96b12709e1a8681f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.746847 6456 tablet_bootstrap.cc:654] T 92f94b93d1364bb1a2562eb577707cf1 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:23.751542 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc49df86b5b24c87bdb62bd723deaf3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.757323 7826 raft_consensus.cc:493] T f1f1df47dc32413d9cc9456f4198dca5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:23.757468 7826 raft_consensus.cc:515] T f1f1df47dc32413d9cc9456f4198dca5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:23.758234 7826 leader_election.cc:290] T f1f1df47dc32413d9cc9456f4198dca5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:23.758767 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f1df47dc32413d9cc9456f4198dca5" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:23.758941 6059 raft_consensus.cc:2468] T f1f1df47dc32413d9cc9456f4198dca5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:23.759429 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f1df47dc32413d9cc9456f4198dca5" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:23.759999 6279 leader_election.cc:304] T f1f1df47dc32413d9cc9456f4198dca5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
W20260923 19:50:23.760143 6280 leader_election.cc:343] T f1f1df47dc32413d9cc9456f4198dca5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:23.760322 7826 raft_consensus.cc:2804] T f1f1df47dc32413d9cc9456f4198dca5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:23.760387 7826 raft_consensus.cc:493] T f1f1df47dc32413d9cc9456f4198dca5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:23.760442 7826 raft_consensus.cc:3060] T f1f1df47dc32413d9cc9456f4198dca5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:23.763602 7826 raft_consensus.cc:515] T f1f1df47dc32413d9cc9456f4198dca5 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:23.764747 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f1df47dc32413d9cc9456f4198dca5" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
W20260923 19:50:23.765295 6280 leader_election.cc:343] T f1f1df47dc32413d9cc9456f4198dca5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:23.765787 7826 leader_election.cc:290] T f1f1df47dc32413d9cc9456f4198dca5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:23.766034 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f1df47dc32413d9cc9456f4198dca5" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:23.766181 6059 raft_consensus.cc:3060] T f1f1df47dc32413d9cc9456f4198dca5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:23.766904 6458 ts_tablet_manager.cc:1929] T 528fca12bfe04747830ad1d3bb323676 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:23.770334 6059 raft_consensus.cc:2468] T f1f1df47dc32413d9cc9456f4198dca5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:23.773783 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 516982de5f8546c1b4be8eb5df615f21 (DEFAULT_TABLE table=default.Table_69a0d472f9674736bf0d2560edc30b20 [id=69c9224863e74397887508bd35bd0a5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.770782 6279 leader_election.cc:304] T f1f1df47dc32413d9cc9456f4198dca5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:23.774474 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 516982de5f8546c1b4be8eb5df615f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.774801 7256 raft_consensus.cc:2804] T f1f1df47dc32413d9cc9456f4198dca5 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:23.774919 7256 raft_consensus.cc:697] T f1f1df47dc32413d9cc9456f4198dca5 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:23.775130 7256 consensus_queue.cc:237] T f1f1df47dc32413d9cc9456f4198dca5 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:23.775923 7700 raft_consensus.cc:493] T b18548ba557f448880c5e617fc03cbe0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:23.776070 7700 raft_consensus.cc:515] T b18548ba557f448880c5e617fc03cbe0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:23.776692 7700 leader_election.cc:290] T b18548ba557f448880c5e617fc03cbe0 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:23.773742 6315 tablet_service.cc:1511] Processing CreateTablet for tablet 516982de5f8546c1b4be8eb5df615f21 (DEFAULT_TABLE table=default.Table_69a0d472f9674736bf0d2560edc30b20 [id=69c9224863e74397887508bd35bd0a5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.778244 6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 516982de5f8546c1b4be8eb5df615f21. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:23.778308 6139 leader_election.cc:343] T b18548ba557f448880c5e617fc03cbe0 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: b18548ba557f448880c5e617fc03cbe0
W20260923 19:50:23.778949 6137 leader_election.cc:343] T b18548ba557f448880c5e617fc03cbe0 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: b18548ba557f448880c5e617fc03cbe0
I20260923 19:50:23.779083 6137 leader_election.cc:304] T b18548ba557f448880c5e617fc03cbe0 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:23.779518 7700 raft_consensus.cc:2749] T b18548ba557f448880c5e617fc03cbe0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:23.780119 6459 tablet_replica.cc:333] T 22e37d5afa8047989928596b4092c4b9 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:23.780354 6459 raft_consensus.cc:2243] T 22e37d5afa8047989928596b4092c4b9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:23.780565 6459 raft_consensus.cc:2272] T 22e37d5afa8047989928596b4092c4b9 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:23.781162 6459 ts_tablet_manager.cc:1916] T 22e37d5afa8047989928596b4092c4b9 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:23.782488 6457 tablet_bootstrap.cc:492] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:23.782687 6457 ts_tablet_manager.cc:1403] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.193s user 0.004s sys 0.008s
I20260923 19:50:23.782857 5796 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_4ddeea53d948454ca19111e3aa369e28" } new_table_name: "default.Table_fe0f6869307545d2807258b71107a778" modify_external_catalogs: true
I20260923 19:50:23.783533 6457 raft_consensus.cc:359] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:23.783795 6457 raft_consensus.cc:385] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:23.783897 6457 raft_consensus.cc:740] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:23.784235 6457 consensus_queue.cc:260] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:23.784555 6458 log.cc:1199] T 528fca12bfe04747830ad1d3bb323676 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/528fca12bfe04747830ad1d3bb323676
I20260923 19:50:23.784637 5797 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ffc6ba8328d44410bccf50fc1273e92e" } modify_external_catalogs: true
I20260923 19:50:23.784812 5797 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ffc6ba8328d44410bccf50fc1273e92e" } modify_external_catalogs: true
I20260923 19:50:23.784969 6458 ts_tablet_manager.cc:1950] T 528fca12bfe04747830ad1d3bb323676 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:23.786278 5803 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_03758cc797e644e98a922d8a281f2cd6" } modify_external_catalogs: true
I20260923 19:50:23.786446 5803 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_03758cc797e644e98a922d8a281f2cd6" } modify_external_catalogs: true
I20260923 19:50:23.789130 6457 ts_tablet_manager.cc:1434] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260923 19:50:23.789460 6457 tablet_bootstrap.cc:492] T 30fe07956e8940fcb7ba1e2e16ced463 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:23.789568 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 4f0de9a4b9164e05874d322a0b4a8e46
I20260923 19:50:23.790143 5804 catalog_manager.cc:6934] ReplaceTablet: tablet 4f0de9a4b9164e05874d322a0b4a8e46 deleted and replaced by tablet 5b875a66d9c0407585bb72a5b7b7df63
I20260923 19:50:23.792172 6033 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f0de9a4b9164e05874d322a0b4a8e46 with delete_type TABLET_DATA_DELETED (replaced by tablet 5b875a66d9c0407585bb72a5b7b7df63) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:23.794440 6040 tablet_service.cc:1511] Processing CreateTablet for tablet 516982de5f8546c1b4be8eb5df615f21 (DEFAULT_TABLE table=default.Table_69a0d472f9674736bf0d2560edc30b20 [id=69c9224863e74397887508bd35bd0a5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.797180 6040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 516982de5f8546c1b4be8eb5df615f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.801156 6033 tablet_service.cc:1511] Processing CreateTablet for tablet 5946ac877d51461a89d33cce8c05bc16 (DEFAULT_TABLE table=default.Table_c624a31c5179478cb6c54a36d7a36892 [id=26caa02bc37e471abdf29bbbb3acba69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.801544 6033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5946ac877d51461a89d33cce8c05bc16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.803797 6457 tablet_bootstrap.cc:654] T 30fe07956e8940fcb7ba1e2e16ced463 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:23.808368 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3c0564c9dae543fa957c0925a8623f54 consensus state has no leader
I20260923 19:50:23.814496 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_4aca5f24bf294b299ec64c356296aa31"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:23.814996 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4aca5f24bf294b299ec64c356296aa31 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:23.816418 5804 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ab816e7937ae4627a7a13c8e091caf19" } modify_external_catalogs: true
I20260923 19:50:23.816479 5801 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_29b8321a878b47ca9fef841557c0fad5" } modify_external_catalogs: true
I20260923 19:50:23.816650 5801 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_29b8321a878b47ca9fef841557c0fad5" } modify_external_catalogs: true
I20260923 19:50:23.816856 5805 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_4803d401dac84700919d6879b552cd8d" } modify_external_catalogs: true
I20260923 19:50:23.817082 5805 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_4803d401dac84700919d6879b552cd8d" } modify_external_catalogs: true
I20260923 19:50:23.817759 6461 ts_tablet_manager.cc:1929] T ba0453ef529344dfbab1130daa985fef P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:23.816658 5804 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ab816e7937ae4627a7a13c8e091caf19" } modify_external_catalogs: true
I20260923 19:50:23.818394 7813 raft_consensus.cc:493] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:23.818526 7813 raft_consensus.cc:515] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:23.819173 7813 leader_election.cc:290] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:23.792433 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f0de9a4b9164e05874d322a0b4a8e46 with delete_type TABLET_DATA_DELETED (replaced by tablet 5b875a66d9c0407585bb72a5b7b7df63) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:23.811251 6454 tablet_bootstrap.cc:492] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:23.821363 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bbd8fcc5ea1431ab9e4fadb7d52269e" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:23.825640 6180 tablet_service.cc:1558] Processing DeleteTablet for tablet c7369a5fc87f4b70bcfbe052ef021771 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:23.825752 6454 ts_tablet_manager.cc:1403] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.086s user 0.001s sys 0.010s
W20260923 19:50:23.826025 5995 leader_election.cc:343] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:23.826143 7835 tablet.cc:1751] T 26031fe469d046518cdd0f1e955e19d1 P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:23.826486 6454 raft_consensus.cc:359] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:23.826767 6454 raft_consensus.cc:385] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:23.826906 6454 raft_consensus.cc:740] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:23.786111 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 994) took 1724 ms. Trace:
I20260923 19:50:23.821090 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bbd8fcc5ea1431ab9e4fadb7d52269e" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:23.827178 6458 rpcz_store.cc:276] 0923 19:50:22.062067 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:22.065955 (+ 3888us) service_pool.cc:224] Handling call
0923 19:50:23.713591 (+1647636us) ts_tablet_manager.cc:1151] Deleting tablet 528fca12bfe04747830ad1d3bb323676
0923 19:50:23.713602 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.763174 (+ 49572us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.766858 (+ 3684us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.786088 (+ 19230us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1647433}
I20260923 19:50:23.813225 7831 tablet.cc:1751] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:23.827656 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 528fca12bfe04747830ad1d3bb323676 (table default.Table_141fc144025e434aa7d7a6e0ecb9c98d [id=f4622a8ebb6644cba5c5c4d18a9a22f1]) successfully deleted
I20260923 19:50:23.791983 6310 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f0de9a4b9164e05874d322a0b4a8e46 with delete_type TABLET_DATA_DELETED (replaced by tablet 5b875a66d9c0407585bb72a5b7b7df63) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:23.828289 5996 leader_election.cc:343] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:23.828420 5996 leader_election.cc:304] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:23.828830 7813 raft_consensus.cc:2749] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:23.828935 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 995) took 1758 ms. Trace:
I20260923 19:50:23.829001 6458 rpcz_store.cc:276] 0923 19:50:22.070855 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:22.073502 (+ 2647us) service_pool.cc:224] Handling call
0923 19:50:23.828762 (+1755260us) ts_tablet_manager.cc:1151] Deleting tablet 3eb8d0a6a2a14388a60b6901106b2856
0923 19:50:23.828772 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.828861 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1755056}
I20260923 19:50:23.829288 6454 consensus_queue.cc:260] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:23.829555 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 3eb8d0a6a2a14388a60b6901106b2856 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3eb8d0a6a2a14388a60b6901106b2856 already in progress: creating tablet
I20260923 19:50:23.829905 6454 ts_tablet_manager.cc:1434] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260923 19:50:23.830084 6461 log.cc:1199] T ba0453ef529344dfbab1130daa985fef P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/ba0453ef529344dfbab1130daa985fef
I20260923 19:50:23.831710 6461 ts_tablet_manager.cc:1950] T ba0453ef529344dfbab1130daa985fef P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:23.829926 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1003) took 1721 ms. Trace:
I20260923 19:50:23.833856 6458 rpcz_store.cc:276] 0923 19:50:22.108915 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:22.108997 (+ 82us) service_pool.cc:224] Handling call
0923 19:50:23.829807 (+1720810us) ts_tablet_manager.cc:1151] Deleting tablet 771ad1e82bd743e597aefe5edafe63ea
0923 19:50:23.829816 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.829911 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1720616}
I20260923 19:50:23.834018 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet ba0453ef529344dfbab1130daa985fef (table default.Table_a4db4b4f4a6b45eabe9a2ae50186a32c [id=3944a1ccbf364bb5a7920714dbe72c8e]) successfully deleted
I20260923 19:50:23.835002 6461 tablet_replica.cc:333] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
W20260923 19:50:23.835254 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 771ad1e82bd743e597aefe5edafe63ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 771ad1e82bd743e597aefe5edafe63ea already in progress: creating tablet
I20260923 19:50:23.835713 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1002) took 1728 ms. Trace:
I20260923 19:50:23.835827 6458 rpcz_store.cc:276] 0923 19:50:22.107581 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:22.107649 (+ 68us) service_pool.cc:224] Handling call
0923 19:50:23.835602 (+1727953us) ts_tablet_manager.cc:1151] Deleting tablet f45863a748ce4d2f94d1ad639c7e6bf7
0923 19:50:23.835610 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.835698 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1724138}
I20260923 19:50:23.836268 6461 raft_consensus.cc:2243] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:23.837242 6454 tablet_bootstrap.cc:492] T 3d74560614b744188e759b981ad89a7d P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:23.837471 6461 raft_consensus.cc:2272] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:23.840394 6461 ts_tablet_manager.cc:1916] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:23.840927 6454 tablet_bootstrap.cc:654] T 3d74560614b744188e759b981ad89a7d P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:23.842454 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet f45863a748ce4d2f94d1ad639c7e6bf7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f45863a748ce4d2f94d1ad639c7e6bf7 already in progress: creating tablet
I20260923 19:50:23.849448 6456 tablet_bootstrap.cc:492] T 92f94b93d1364bb1a2562eb577707cf1 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:23.849632 6456 ts_tablet_manager.cc:1403] T 92f94b93d1364bb1a2562eb577707cf1 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.113s user 0.008s sys 0.012s
I20260923 19:50:23.850643 6456 raft_consensus.cc:359] T 92f94b93d1364bb1a2562eb577707cf1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:23.850847 6456 raft_consensus.cc:385] T 92f94b93d1364bb1a2562eb577707cf1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:23.850930 6456 raft_consensus.cc:740] T 92f94b93d1364bb1a2562eb577707cf1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:23.851171 6456 consensus_queue.cc:260] T 92f94b93d1364bb1a2562eb577707cf1 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:23.851702 6456 ts_tablet_manager.cc:1434] T 92f94b93d1364bb1a2562eb577707cf1 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260923 19:50:23.853183 6180 tablet_service.cc:1511] Processing CreateTablet for tablet 5946ac877d51461a89d33cce8c05bc16 (DEFAULT_TABLE table=default.Table_c624a31c5179478cb6c54a36d7a36892 [id=26caa02bc37e471abdf29bbbb3acba69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.853646 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5946ac877d51461a89d33cce8c05bc16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.857096 5799 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_0eb28975495e4bedaf7c538454e525f6 [id=ea52a2330cd643e486e5b348dabbd295] alter complete (version 1)
W20260923 19:50:23.857606 5796 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ff8e469f4cf24e1abaf6774a9c199c98 has no consensus state
I20260923 19:50:23.858022 5796 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_e13bfd92341c4edea1d722b5eba5e696" } new_table_name: "default.Table_c597b356d6ee4513befd952af6d27954" modify_external_catalogs: true
I20260923 19:50:23.859344 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 9e20d623668646c688fbd82d2cbc7138
I20260923 19:50:23.860122 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_0795540c91fe4adba2e79f5f22689e50"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:23.860173 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e20d623668646c688fbd82d2cbc7138 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:23.860598 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0795540c91fe4adba2e79f5f22689e50 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:23.861819 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 2dbb1973dbcd46f5a796fb8a0a24f88f
I20260923 19:50:23.862517 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet 2dbb1973dbcd46f5a796fb8a0a24f88f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:23.862591 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_d6b2211da5d34c2aa2488f78bf0201ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:23.863008 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6b2211da5d34c2aa2488f78bf0201ff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:23.863955 5800 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_bfb92692681246bf9ff3524c388b1bc4 [id=4ec3992af15345ec89f8f727343e3df2] alter complete (version 1)
I20260923 19:50:23.865028 5800 master_service.cc:960] ReplaceTablet: received request to replace tablet 7f7ecbb8d9054dde96b2bb511697dd47 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:23.865648 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_3e51d8e802da43f19bedf3ef57864490"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:23.866160 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e51d8e802da43f19bedf3ef57864490 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:23.866884 6166 tablet_service.cc:1511] Processing CreateTablet for tablet 7db36c90d1f54657b9aa29ccd84932b4 (DEFAULT_TABLE table=default.Table_6de7a682db5a4865b1c680cc672761ed [id=e147daf105234a589578c58160575dd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.867265 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7db36c90d1f54657b9aa29ccd84932b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.867908 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_977e0518381747fbb64340cdf61de5fb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:23.868295 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_977e0518381747fbb64340cdf61de5fb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:23.869975 5799 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a6c5228ee79e4839b3314f4c4f3d23cd" } new_table_name: "default.Table_b507c4972421406bb16c75a7f8e46e4d" modify_external_catalogs: true
I20260923 19:50:23.870182 6456 tablet_bootstrap.cc:492] T 9c4a200d16464676976694656cbe28e2 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:23.871484 7700 raft_consensus.cc:493] T c7369a5fc87f4b70bcfbe052ef021771 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:23.871663 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet a83726da349c4cd1852e956c8fa2cda5
I20260923 19:50:23.871629 7700 raft_consensus.cc:515] T c7369a5fc87f4b70bcfbe052ef021771 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:23.872236 7700 leader_election.cc:290] T c7369a5fc87f4b70bcfbe052ef021771 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:23.872313 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_1cb75514d89441e7ae379bc433c84806"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:23.872757 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1cb75514d89441e7ae379bc433c84806 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:23.872967 6456 tablet_bootstrap.cc:654] T 9c4a200d16464676976694656cbe28e2 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:23.874984 6454 tablet_bootstrap.cc:492] T 3d74560614b744188e759b981ad89a7d P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:23.875144 6454 ts_tablet_manager.cc:1403] T 3d74560614b744188e759b981ad89a7d P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.038s user 0.003s sys 0.001s
I20260923 19:50:23.876032 6454 raft_consensus.cc:359] T 3d74560614b744188e759b981ad89a7d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:23.876276 6454 raft_consensus.cc:385] T 3d74560614b744188e759b981ad89a7d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:23.876394 6454 raft_consensus.cc:740] T 3d74560614b744188e759b981ad89a7d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:23.876682 6454 consensus_queue.cc:260] T 3d74560614b744188e759b981ad89a7d P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:23.877364 5801 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet a820bf5854324639b98c984ac583a4d7
I20260923 19:50:23.878036 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d28de154c0f1433db6ef27cc9a3a67b1" } new_table_name: "default.Table_56ff9e3b2fa24fdfb9b16d0ce56ca649" modify_external_catalogs: true
I20260923 19:50:23.879590 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet a820bf5854324639b98c984ac583a4d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:23.879814 6173 tablet_service.cc:1558] Processing DeleteTablet for tablet a83726da349c4cd1852e956c8fa2cda5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:23.883141 6171 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b1d9413e1e24547b491a160d851377b with delete_type TABLET_DATA_DELETED (replaced by tablet 355b2fc61d4f4efd918204079f1ebf35) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:23.883351 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet b9c187ee1fa8438397c83bc2c2b16925 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:23.883453 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet f7cf45d4c4d3480288698682c1c85869 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:23.883867 6173 tablet_service.cc:1511] Processing CreateTablet for tablet d525bdd4c25843c988865553bd2b3066 (DEFAULT_TABLE table=default.Table_f4e94b13deef43fb9382f2eccb648126 [id=5ad6f32144094ad5a2490651177cdf78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.884346 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d525bdd4c25843c988865553bd2b3066. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.885289 5798 catalog_manager.cc:5838] T f1f1df47dc32413d9cc9456f4198dca5 P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } }
I20260923 19:50:23.885546 6456 tablet_bootstrap.cc:492] T 9c4a200d16464676976694656cbe28e2 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:23.885663 6456 ts_tablet_manager.cc:1403] T 9c4a200d16464676976694656cbe28e2 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.002s
I20260923 19:50:23.885708 5798 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet f1f1df47dc32413d9cc9456f4198dca5 (table default.Table_5c873b003c7b4b09ba69db7f039b2f98 [id=6d285eda96a948b2b14fa1ef456ca5b2]). Expected version 2 got 0
I20260923 19:50:23.886077 6454 ts_tablet_manager.cc:1434] T 3d74560614b744188e759b981ad89a7d P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20260923 19:50:23.886650 6454 tablet_bootstrap.cc:492] T 658253ff3d014361803e1aeda978e59a P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:23.893142 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 86388fa08c454da9ad2ca0124dcba10b
I20260923 19:50:23.897043 6456 raft_consensus.cc:359] T 9c4a200d16464676976694656cbe28e2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:23.897605 6456 raft_consensus.cc:385] T 9c4a200d16464676976694656cbe28e2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:23.897644 6459 ts_tablet_manager.cc:1929] T 22e37d5afa8047989928596b4092c4b9 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:23.897812 6456 raft_consensus.cc:740] T 9c4a200d16464676976694656cbe28e2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:23.899169 6035 tablet_service.cc:1558] Processing DeleteTablet for tablet 2dbb1973dbcd46f5a796fb8a0a24f88f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:23.899371 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet cb11d6e082784ad98cfb5253dbb88707 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:23.899555 6025 tablet_service.cc:1558] Processing DeleteTablet for tablet a820bf5854324639b98c984ac583a4d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:23.899982 6034 tablet_service.cc:1511] Processing CreateTablet for tablet d525bdd4c25843c988865553bd2b3066 (DEFAULT_TABLE table=default.Table_f4e94b13deef43fb9382f2eccb648126 [id=5ad6f32144094ad5a2490651177cdf78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.902135 6456 consensus_queue.cc:260] T 9c4a200d16464676976694656cbe28e2 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:23.903091 6456 ts_tablet_manager.cc:1434] T 9c4a200d16464676976694656cbe28e2 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20260923 19:50:23.904258 6456 tablet_bootstrap.cc:492] T f1c1d4f73488499a9e5add81e9d5e2d6 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:23.909961 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1011) took 1744 ms. Trace:
I20260923 19:50:23.910138 6458 rpcz_store.cc:276] 0923 19:50:22.165672 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:22.165729 (+ 57us) service_pool.cc:224] Handling call
0923 19:50:23.909830 (+1744101us) ts_tablet_manager.cc:1151] Deleting tablet 2205316ed70543e5b3b001d88ab3ae5d
0923 19:50:23.909840 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.909942 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1706741}
I20260923 19:50:23.912945 6458 tablet_replica.cc:333] T 684eb2576b4b4730813b993e36b242df P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:23.913193 6458 raft_consensus.cc:2243] T 684eb2576b4b4730813b993e36b242df P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:23.914933 6458 raft_consensus.cc:2272] T 684eb2576b4b4730813b993e36b242df P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:23.915493 6458 ts_tablet_manager.cc:1916] T 684eb2576b4b4730813b993e36b242df P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:23.916487 7826 raft_consensus.cc:493] T 92f94b93d1364bb1a2562eb577707cf1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:23.916610 7826 raft_consensus.cc:515] T 92f94b93d1364bb1a2562eb577707cf1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:23.917125 7826 leader_election.cc:290] T 92f94b93d1364bb1a2562eb577707cf1 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:23.922398 7813 raft_consensus.cc:493] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:23.922614 7813 raft_consensus.cc:515] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:23.923135 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e20d623668646c688fbd82d2cbc7138 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:23.923327 7813 leader_election.cc:290] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:23.923357 6039 tablet_service.cc:1558] Processing DeleteTablet for tablet a83726da349c4cd1852e956c8fa2cda5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:23.923631 6030 tablet_service.cc:1511] Processing CreateTablet for tablet 7db36c90d1f54657b9aa29ccd84932b4 (DEFAULT_TABLE table=default.Table_6de7a682db5a4865b1c680cc672761ed [id=e147daf105234a589578c58160575dd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.923786 6456 tablet_bootstrap.cc:654] T f1c1d4f73488499a9e5add81e9d5e2d6 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:23.927479 5796 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3ca71d8573d1498a91aaf6cb4b9f0845 consensus state has no leader
I20260923 19:50:23.927986 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_a866cbd7e738424386654931f545b7ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:23.928938 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a866cbd7e738424386654931f545b7ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:23.930365 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_2491b66ec8974b4ba9fc7a96d4fd9cb5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:23.897893 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet 86388fa08c454da9ad2ca0124dcba10b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:23.898593 6137 leader_election.cc:343] T c7369a5fc87f4b70bcfbe052ef021771 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: c7369a5fc87f4b70bcfbe052ef021771
I20260923 19:50:23.900175 6174 tablet_service.cc:1511] Processing CreateTablet for tablet 98459d5dcb1b419da411aa697823f682 (DEFAULT_TABLE table=default.Table_2ed8ffc6cc31434087136c0f3c997bb0 [id=b837ca95f6904867be6a09e14047fa87]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:23.930820 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2491b66ec8974b4ba9fc7a96d4fd9cb5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:23.931136 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98459d5dcb1b419da411aa697823f682. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.932093 5803 master_service.cc:960] ReplaceTablet: received request to replace tablet 7bd0ccf56ee9498f9fa42c5a03a931b6 from {username='slave'} at 127.0.0.1:59912
W20260923 19:50:23.933350 5799 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ff2ceb52903a453ca73e2e0e06c4c079 consensus state has no leader
I20260923 19:50:23.902961 6171 tablet_service.cc:1511] Processing CreateTablet for tablet 416a0205bfb64f8eaa68085b183a80b3 (DEFAULT_TABLE table=default.Table_953f199da73c4745bc4d081e87c55973 [id=140b07d58ee54103bd559e043f72cc4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.903864 6454 tablet_bootstrap.cc:654] T 658253ff3d014361803e1aeda978e59a P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:23.904912 6181 tablet_service.cc:1511] Processing CreateTablet for tablet ff2ceb52903a453ca73e2e0e06c4c079 (DEFAULT_TABLE table=default.Table_a6c5228ee79e4839b3314f4c4f3d23cd [id=7be88fcc8d964a3d8be194d9ce08934d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.917897 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f94b93d1364bb1a2562eb577707cf1" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:23.934469 6171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 416a0205bfb64f8eaa68085b183a80b3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:23.935241 6280 leader_election.cc:343] T 92f94b93d1364bb1a2562eb577707cf1 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:23.935696 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4a200d16464676976694656cbe28e2" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:23.935920 6342 raft_consensus.cc:2468] T 9c4a200d16464676976694656cbe28e2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 0.
W20260923 19:50:23.936803 6279 leader_election.cc:343] T 92f94b93d1364bb1a2562eb577707cf1 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 92f94b93d1364bb1a2562eb577707cf1
I20260923 19:50:23.936924 6279 leader_election.cc:304] T 92f94b93d1364bb1a2562eb577707cf1 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:23.937750 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c98d854a58b147fe96368a792dd0c125 consensus state has no leader
I20260923 19:50:23.939649 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2ceb52903a453ca73e2e0e06c4c079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.940361 7826 raft_consensus.cc:2749] T 92f94b93d1364bb1a2562eb577707cf1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:23.941957 6454 tablet_bootstrap.cc:492] T 658253ff3d014361803e1aeda978e59a P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:23.942121 6454 ts_tablet_manager.cc:1403] T 658253ff3d014361803e1aeda978e59a P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.056s user 0.003s sys 0.003s
I20260923 19:50:23.942905 6454 raft_consensus.cc:359] T 658253ff3d014361803e1aeda978e59a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:23.946427 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d525bdd4c25843c988865553bd2b3066. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.951195 5996 leader_election.cc:304] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:23.951445 6035 tablet_service.cc:1511] Processing CreateTablet for tablet 416a0205bfb64f8eaa68085b183a80b3 (DEFAULT_TABLE table=default.Table_953f199da73c4745bc4d081e87c55973 [id=140b07d58ee54103bd559e043f72cc4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.951632 6032 tablet_service.cc:1511] Processing CreateTablet for tablet 98459d5dcb1b419da411aa697823f682 (DEFAULT_TABLE table=default.Table_2ed8ffc6cc31434087136c0f3c997bb0 [id=b837ca95f6904867be6a09e14047fa87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.951542 6454 raft_consensus.cc:385] T 658253ff3d014361803e1aeda978e59a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:23.951956 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98459d5dcb1b419da411aa697823f682. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.951988 6454 raft_consensus.cc:740] T 658253ff3d014361803e1aeda978e59a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:23.952478 6025 tablet_service.cc:1558] Processing DeleteTablet for tablet 86388fa08c454da9ad2ca0124dcba10b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:23.953927 6454 consensus_queue.cc:260] T 658253ff3d014361803e1aeda978e59a P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:23.956133 5802 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 8d20b59aa99f49f0b2f4d7dd861470f8 (table default.Table_3a666373aff54c2d8256d8fc785cfcc1 [id=57da80bd083d4763a5523608ea26f2bb]). Expected version 1 got 0
I20260923 19:50:23.956310 7816 raft_consensus.cc:493] T cb11d6e082784ad98cfb5253dbb88707 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:23.956424 7816 raft_consensus.cc:515] T cb11d6e082784ad98cfb5253dbb88707 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:23.956969 7816 leader_election.cc:290] T cb11d6e082784ad98cfb5253dbb88707 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:23.957907 7813 raft_consensus.cc:2804] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:23.957971 6454 ts_tablet_manager.cc:1434] T 658253ff3d014361803e1aeda978e59a P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260923 19:50:23.957998 7813 raft_consensus.cc:493] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:23.958069 7813 raft_consensus.cc:3060] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:23.958289 6454 tablet_bootstrap.cc:492] T 7af330ae1aaa48209f2bd1880bcfebb1 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:23.959133 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 7bd0ccf56ee9498f9fa42c5a03a931b6
I20260923 19:50:23.959982 5803 catalog_manager.cc:6934] ReplaceTablet: tablet 7bd0ccf56ee9498f9fa42c5a03a931b6 deleted and replaced by tablet 139c2fc3ab9c47a9b184e02424a88890
I20260923 19:50:23.960081 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb11d6e082784ad98cfb5253dbb88707" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:23.960668 7813 raft_consensus.cc:515] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:23.961184 7813 leader_election.cc:290] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:23.961351 5995 leader_election.cc:343] T cb11d6e082784ad98cfb5253dbb88707 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:23.961519 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4a200d16464676976694656cbe28e2" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
W20260923 19:50:23.962002 5995 leader_election.cc:343] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:23.962332 6021 tablet_service.cc:1558] Processing DeleteTablet for tablet 7bd0ccf56ee9498f9fa42c5a03a931b6 with delete_type TABLET_DATA_DELETED (replaced by tablet 139c2fc3ab9c47a9b184e02424a88890) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:23.962325 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet 7bd0ccf56ee9498f9fa42c5a03a931b6 with delete_type TABLET_DATA_DELETED (replaced by tablet 139c2fc3ab9c47a9b184e02424a88890) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:23.964063 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4a200d16464676976694656cbe28e2" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:23.964118 6039 tablet_service.cc:1511] Processing CreateTablet for tablet ff2ceb52903a453ca73e2e0e06c4c079 (DEFAULT_TABLE table=default.Table_a6c5228ee79e4839b3314f4c4f3d23cd [id=7be88fcc8d964a3d8be194d9ce08934d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.964252 6340 raft_consensus.cc:3060] T 9c4a200d16464676976694656cbe28e2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:23.964484 6025 tablet_service.cc:1511] Processing CreateTablet for tablet 4e3cdffa2c2a4e5da4980dea84d82c4e (DEFAULT_TABLE table=default.Table_e74d28acc2834aac812c922e8308ff53 [id=981285a81dd3489c8378902ff29a4b1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.964886 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 416a0205bfb64f8eaa68085b183a80b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.966753 6340 raft_consensus.cc:2468] T 9c4a200d16464676976694656cbe28e2 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 1.
I20260923 19:50:23.964084 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb11d6e082784ad98cfb5253dbb88707" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:23.968796 6454 tablet_bootstrap.cc:654] T 7af330ae1aaa48209f2bd1880bcfebb1 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:23.970261 5996 leader_election.cc:304] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
W20260923 19:50:23.970640 5996 leader_election.cc:343] T cb11d6e082784ad98cfb5253dbb88707 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:23.970770 5996 leader_election.cc:304] T cb11d6e082784ad98cfb5253dbb88707 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:23.971154 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2ceb52903a453ca73e2e0e06c4c079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.971192 7816 raft_consensus.cc:2804] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:23.971815 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e3cdffa2c2a4e5da4980dea84d82c4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.930397 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4a200d16464676976694656cbe28e2" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:23.930085 6180 tablet_service.cc:1511] Processing CreateTablet for tablet 763ed26edf67469191f966885665a2ac (DEFAULT_TABLE table=default.Table_64d45d8a6ff94d96a0c553131159ca09 [id=97c8181f35ea46609bd48e18a2673b5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:23.970012 7700 raft_consensus.cc:493] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260923 19:50:23.974495 5995 leader_election.cc:343] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:23.974611 7700 raft_consensus.cc:515] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:23.974956 7813 raft_consensus.cc:2749] T cb11d6e082784ad98cfb5253dbb88707 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:23.975312 7700 leader_election.cc:290] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:23.975332 5798 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_7e5734fc77194af188bb85d254676e98 [id=82cba3f0e2f64118a0747fe6ff9bc796] alter complete (version 1)
I20260923 19:50:23.976310 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 763ed26edf67469191f966885665a2ac. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:23.978546 6137 leader_election.cc:343] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: c012b2a92dc14f2ab5d9f4fe8a6a7779
I20260923 19:50:23.979539 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7db36c90d1f54657b9aa29ccd84932b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:23.982767 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d74560614b744188e759b981ad89a7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:23.986676 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet 658253ff3d014361803e1aeda978e59a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:23.988564 5798 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 9c4a200d16464676976694656cbe28e2 (table default.Table_1e9ebf5c3c644666a5b6c1966fde4ed5 [id=5f2289c487ba40b9b7954c9d56918687]). Expected version 1 got 0
W20260923 19:50:23.995252 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 2205316ed70543e5b3b001d88ab3ae5d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2205316ed70543e5b3b001d88ab3ae5d already in progress: creating tablet
I20260923 19:50:23.997043 6461 ts_tablet_manager.cc:1929] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:50:23.997973 6461 log.cc:1199] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/85b7dcf131c54187a6e61f8503c797f8
I20260923 19:50:23.998680 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_98fa8b434d3c43fe98c6a4bd5690233e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:23.999486 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_98fa8b434d3c43fe98c6a4bd5690233e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:24.006814 6461 ts_tablet_manager.cc:1950] T 85b7dcf131c54187a6e61f8503c797f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:24.007632 6456 tablet_bootstrap.cc:492] T f1c1d4f73488499a9e5add81e9d5e2d6 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:24.007838 6456 ts_tablet_manager.cc:1403] T f1c1d4f73488499a9e5add81e9d5e2d6 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.104s user 0.011s sys 0.000s
I20260923 19:50:24.008518 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 85b7dcf131c54187a6e61f8503c797f8 (table default.Table_23c500b65dba4b6790b4349e5a5b0a07 [id=647997210f5349a68aa98d24e12a33cd]) successfully deleted
I20260923 19:50:24.008563 6456 raft_consensus.cc:359] T f1c1d4f73488499a9e5add81e9d5e2d6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.008837 6456 raft_consensus.cc:385] T f1c1d4f73488499a9e5add81e9d5e2d6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:24.008971 6456 raft_consensus.cc:740] T f1c1d4f73488499a9e5add81e9d5e2d6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:24.009002 6310 tablet_service.cc:1558] Processing DeleteTablet for tablet 2dbb1973dbcd46f5a796fb8a0a24f88f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:24.009478 6310 tablet_service.cc:1558] Processing DeleteTablet for tablet e1de117713f34b51bbda0c712f0b837c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:24.009971 6456 consensus_queue.cc:260] T f1c1d4f73488499a9e5add81e9d5e2d6 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
W20260923 19:50:24.010052 5790 catalog_manager.cc:5030] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 78911eed02894176b689fd9ce681de71 because the tablet was not found. No further retry: Not found: Tablet not found: 78911eed02894176b689fd9ce681de71
I20260923 19:50:24.010074 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 5946ac877d51461a89d33cce8c05bc16 (DEFAULT_TABLE table=default.Table_c624a31c5179478cb6c54a36d7a36892 [id=26caa02bc37e471abdf29bbbb3acba69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.010306 6307 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e20d623668646c688fbd82d2cbc7138 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:24.010408 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5946ac877d51461a89d33cce8c05bc16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.010676 6456 ts_tablet_manager.cc:1434] T f1c1d4f73488499a9e5add81e9d5e2d6 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:50:24.010682 5796 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ed0607fb34e24f6793003de00c2f4e8a" } new_table_name: "default.Table_43de6815589f4a87b13b6dd0bbee9257" modify_external_catalogs: true
I20260923 19:50:24.011027 6456 tablet_bootstrap.cc:492] T 397ec5e49673406cb26a2efab0ad8401 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
W20260923 19:50:24.011516 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet b0534795317747b28bef09df8a1c7244 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b0534795317747b28bef09df8a1c7244 already in progress: creating tablet
I20260923 19:50:24.012261 6456 tablet_bootstrap.cc:654] T 397ec5e49673406cb26a2efab0ad8401 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:24.012801 6171 tablet_service.cc:1558] Processing DeleteTablet for tablet c012b2a92dc14f2ab5d9f4fe8a6a7779 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:24.014582 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 4661da9259c74a4fbe3a00df5048658d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4661da9259c74a4fbe3a00df5048658d already in progress: creating tablet
W20260923 19:50:24.016120 5790 catalog_manager.cc:5030] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 78911eed02894176b689fd9ce681de71 because the tablet was not found. No further retry: Not found: Tablet not found: 78911eed02894176b689fd9ce681de71
I20260923 19:50:23.928224 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 4e3cdffa2c2a4e5da4980dea84d82c4e (DEFAULT_TABLE table=default.Table_e74d28acc2834aac812c922e8308ff53 [id=981285a81dd3489c8378902ff29a4b1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.017093 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e3cdffa2c2a4e5da4980dea84d82c4e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:24.017122 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet e6ebb766244f40a28e5fd96ecbb3e4f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6ebb766244f40a28e5fd96ecbb3e4f6 already in progress: creating tablet
W20260923 19:50:24.018304 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 4f0de9a4b9164e05874d322a0b4a8e46 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f0de9a4b9164e05874d322a0b4a8e46 already in progress: creating tablet
W20260923 19:50:24.019623 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 2dbb1973dbcd46f5a796fb8a0a24f88f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2dbb1973dbcd46f5a796fb8a0a24f88f already in progress: creating tablet
I20260923 19:50:24.020009 5803 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet f1c1d4f73488499a9e5add81e9d5e2d6 (table default.Table_7f7907c8e1bc4ad1ae68faf5f072b318 [id=80e3a84f7199464fa96426daeeeb84cd]). Expected version 2 got 0
I20260923 19:50:24.021972 6459 log.cc:1199] T 22e37d5afa8047989928596b4092c4b9 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/22e37d5afa8047989928596b4092c4b9
I20260923 19:50:24.022039 6461 tablet_replica.cc:333] T cb11d6e082784ad98cfb5253dbb88707 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:24.022269 6461 raft_consensus.cc:2243] T cb11d6e082784ad98cfb5253dbb88707 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:24.022429 6461 raft_consensus.cc:2272] T cb11d6e082784ad98cfb5253dbb88707 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:24.022557 6459 ts_tablet_manager.cc:1950] T 22e37d5afa8047989928596b4092c4b9 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:24.022957 6461 ts_tablet_manager.cc:1916] T cb11d6e082784ad98cfb5253dbb88707 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:24.023504 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 955) took 2431 ms. Trace:
I20260923 19:50:24.023785 6459 rpcz_store.cc:276] 0923 19:50:21.591526 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.591601 (+ 75us) service_pool.cc:224] Handling call
0923 19:50:23.735881 (+2144280us) ts_tablet_manager.cc:1151] Deleting tablet 22e37d5afa8047989928596b4092c4b9
0923 19:50:23.780041 (+ 44160us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.894273 (+114232us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:23.897578 (+ 3305us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:24.023447 (+125869us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2129532}
I20260923 19:50:24.024577 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 22e37d5afa8047989928596b4092c4b9 (table default.Table_1141571b3d744e3b922ca1d9745fbadf [id=c0f9d6a40e364dd0ad7ce95fa73b5930]) successfully deleted
I20260923 19:50:24.024668 6459 tablet_replica.cc:333] T a75c4436a67f453e973a7a7645de79b1 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:24.024767 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_6bd43076ac0a41129669ca864669d1dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:24.024906 6459 raft_consensus.cc:2243] T a75c4436a67f453e973a7a7645de79b1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:24.025074 6459 raft_consensus.cc:2272] T a75c4436a67f453e973a7a7645de79b1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:24.025352 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6bd43076ac0a41129669ca864669d1dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:24.025662 6459 ts_tablet_manager.cc:1916] T a75c4436a67f453e973a7a7645de79b1 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:24.029152 7882 tablet.cc:1751] T 26031fe469d046518cdd0f1e955e19d1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:24.030154 6032 tablet_service.cc:1511] Processing CreateTablet for tablet 763ed26edf67469191f966885665a2ac (DEFAULT_TABLE table=default.Table_64d45d8a6ff94d96a0c553131159ca09 [id=97c8181f35ea46609bd48e18a2673b5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.030786 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 763ed26edf67469191f966885665a2ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.036481 6457 tablet_bootstrap.cc:492] T 30fe07956e8940fcb7ba1e2e16ced463 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:24.038386 6315 tablet_service.cc:1558] Processing DeleteTablet for tablet a820bf5854324639b98c984ac583a4d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:24.038455 5796 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 37de46eabdd84065975a8e5a3c3758c4 consensus state has no leader
I20260923 19:50:24.038976 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 98459d5dcb1b419da411aa697823f682 (DEFAULT_TABLE table=default.Table_2ed8ffc6cc31434087136c0f3c997bb0 [id=b837ca95f6904867be6a09e14047fa87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.039448 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98459d5dcb1b419da411aa697823f682. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.039332 6308 tablet_service.cc:1511] Processing CreateTablet for tablet 416a0205bfb64f8eaa68085b183a80b3 (DEFAULT_TABLE table=default.Table_953f199da73c4745bc4d081e87c55973 [id=140b07d58ee54103bd559e043f72cc4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.039587 6457 ts_tablet_manager.cc:1403] T 30fe07956e8940fcb7ba1e2e16ced463 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.250s user 0.005s sys 0.016s
I20260923 19:50:24.039707 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 416a0205bfb64f8eaa68085b183a80b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.039757 6317 tablet_service.cc:1511] Processing CreateTablet for tablet 763ed26edf67469191f966885665a2ac (DEFAULT_TABLE table=default.Table_64d45d8a6ff94d96a0c553131159ca09 [id=97c8181f35ea46609bd48e18a2673b5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.040040 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 763ed26edf67469191f966885665a2ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.040385 6457 raft_consensus.cc:359] T 30fe07956e8940fcb7ba1e2e16ced463 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.040551 6457 raft_consensus.cc:385] T 30fe07956e8940fcb7ba1e2e16ced463 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:24.040601 6457 raft_consensus.cc:740] T 30fe07956e8940fcb7ba1e2e16ced463 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:24.042098 6316 tablet_service.cc:1511] Processing CreateTablet for tablet 4e3cdffa2c2a4e5da4980dea84d82c4e (DEFAULT_TABLE table=default.Table_e74d28acc2834aac812c922e8308ff53 [id=981285a81dd3489c8378902ff29a4b1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.042382 6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e3cdffa2c2a4e5da4980dea84d82c4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.039058 6306 tablet_service.cc:1558] Processing DeleteTablet for tablet 86388fa08c454da9ad2ca0124dcba10b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:24.038964 6322 tablet_service.cc:1511] Processing CreateTablet for tablet d525bdd4c25843c988865553bd2b3066 (DEFAULT_TABLE table=default.Table_f4e94b13deef43fb9382f2eccb648126 [id=5ad6f32144094ad5a2490651177cdf78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.047801 6322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d525bdd4c25843c988865553bd2b3066. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.047289 6307 tablet_service.cc:1558] Processing DeleteTablet for tablet a83726da349c4cd1852e956c8fa2cda5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:24.032554 6180 tablet_service.cc:1511] Processing CreateTablet for tablet 690cf009543d40ba94cdde54274703d2 (DEFAULT_TABLE table=default.Table_d087f441e7bb49f7a030bbbb241f7359 [id=c719ca4650b04ce1ab57758bb5079d18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.050360 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 690cf009543d40ba94cdde54274703d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.047307 6315 tablet_service.cc:1511] Processing CreateTablet for tablet ff2ceb52903a453ca73e2e0e06c4c079 (DEFAULT_TABLE table=default.Table_a6c5228ee79e4839b3314f4c4f3d23cd [id=7be88fcc8d964a3d8be194d9ce08934d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.040781 6457 consensus_queue.cc:260] T 30fe07956e8940fcb7ba1e2e16ced463 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.050640 6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2ceb52903a453ca73e2e0e06c4c079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.051050 6457 ts_tablet_manager.cc:1434] T 30fe07956e8940fcb7ba1e2e16ced463 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260923 19:50:24.051319 6457 tablet_bootstrap.cc:492] T a6da9b3eea4547c9bb80b08bd26c5dc2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:24.057354 7256 raft_consensus.cc:493] T e1de117713f34b51bbda0c712f0b837c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:24.057510 7256 raft_consensus.cc:515] T e1de117713f34b51bbda0c712f0b837c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:24.058271 6458 ts_tablet_manager.cc:1929] T 684eb2576b4b4730813b993e36b242df P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:24.058362 6458 log.cc:1199] T 684eb2576b4b4730813b993e36b242df P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/684eb2576b4b4730813b993e36b242df
I20260923 19:50:24.058632 6458 ts_tablet_manager.cc:1950] T 684eb2576b4b4730813b993e36b242df P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:24.059346 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 7bd0ccf56ee9498f9fa42c5a03a931b6 with delete_type TABLET_DATA_DELETED (replaced by tablet 139c2fc3ab9c47a9b184e02424a88890) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:24.059644 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 670d9cb0e6e2414092f72ffd5e6b00ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:24.059908 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 554655516bb547ad9c2aa1ee66dc8deb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:24.060182 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 92f94b93d1364bb1a2562eb577707cf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:24.060742 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 690cf009543d40ba94cdde54274703d2 (DEFAULT_TABLE table=default.Table_d087f441e7bb49f7a030bbbb241f7359 [id=c719ca4650b04ce1ab57758bb5079d18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.060883 7256 leader_election.cc:290] T e1de117713f34b51bbda0c712f0b837c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:24.061156 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 690cf009543d40ba94cdde54274703d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.061748 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1de117713f34b51bbda0c712f0b837c" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:24.062166 6279 leader_election.cc:343] T e1de117713f34b51bbda0c712f0b837c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: e1de117713f34b51bbda0c712f0b837c
W20260923 19:50:24.062645 6280 leader_election.cc:343] T e1de117713f34b51bbda0c712f0b837c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:24.062740 6280 leader_election.cc:304] T e1de117713f34b51bbda0c712f0b837c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:24.063273 7826 raft_consensus.cc:2749] T e1de117713f34b51bbda0c712f0b837c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:24.063694 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_8d1b18b8cdb047b489016f3a439148ba" } new_table_name: "default.Table_c9ce8e1d314d4019892b2514940d31c9" modify_external_catalogs: true
I20260923 19:50:24.066480 7816 raft_consensus.cc:697] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Becoming Leader. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Running, Role: LEADER
I20260923 19:50:24.066793 7816 consensus_queue.cc:237] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.068578 6454 tablet_bootstrap.cc:492] T 7af330ae1aaa48209f2bd1880bcfebb1 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:24.068732 6454 ts_tablet_manager.cc:1403] T 7af330ae1aaa48209f2bd1880bcfebb1 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.111s user 0.009s sys 0.000s
I20260923 19:50:24.069483 6454 raft_consensus.cc:359] T 7af330ae1aaa48209f2bd1880bcfebb1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:24.069681 6454 raft_consensus.cc:385] T 7af330ae1aaa48209f2bd1880bcfebb1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:24.069761 6454 raft_consensus.cc:740] T 7af330ae1aaa48209f2bd1880bcfebb1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:24.070006 6454 consensus_queue.cc:260] T 7af330ae1aaa48209f2bd1880bcfebb1 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:24.070541 6454 ts_tablet_manager.cc:1434] T 7af330ae1aaa48209f2bd1880bcfebb1 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260923 19:50:24.071273 7826 raft_consensus.cc:493] T 554655516bb547ad9c2aa1ee66dc8deb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:24.071425 7826 raft_consensus.cc:515] T 554655516bb547ad9c2aa1ee66dc8deb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:24.072064 7826 leader_election.cc:290] T 554655516bb547ad9c2aa1ee66dc8deb P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:24.072321 6139 leader_election.cc:343] T c7369a5fc87f4b70bcfbe052ef021771 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: c7369a5fc87f4b70bcfbe052ef021771
I20260923 19:50:24.072476 6139 leader_election.cc:304] T c7369a5fc87f4b70bcfbe052ef021771 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:24.072853 6139 leader_election.cc:343] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: c012b2a92dc14f2ab5d9f4fe8a6a7779
I20260923 19:50:24.072979 6139 leader_election.cc:304] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:24.073307 7700 raft_consensus.cc:2749] T c7369a5fc87f4b70bcfbe052ef021771 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:24.073473 7700 raft_consensus.cc:2749] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:24.074518 6279 leader_election.cc:343] T 554655516bb547ad9c2aa1ee66dc8deb P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 554655516bb547ad9c2aa1ee66dc8deb
W20260923 19:50:24.074957 5805 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5815d903076e43f79d370261a74ef990 consensus state has no leader
I20260923 19:50:24.075398 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1035) took 1479 ms. Trace:
I20260923 19:50:24.075482 6458 rpcz_store.cc:276] 0923 19:50:22.595600 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:22.595671 (+ 71us) service_pool.cc:224] Handling call
0923 19:50:23.912900 (+1317229us) ts_tablet_manager.cc:1151] Deleting tablet 684eb2576b4b4730813b993e36b242df
0923 19:50:23.912910 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:23.974978 (+ 62068us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:24.058222 (+ 83244us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:24.075380 (+ 17158us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1308368}
I20260923 19:50:24.077041 6456 tablet_bootstrap.cc:492] T 397ec5e49673406cb26a2efab0ad8401 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:24.077165 6456 ts_tablet_manager.cc:1403] T 397ec5e49673406cb26a2efab0ad8401 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.066s user 0.003s sys 0.001s
I20260923 19:50:24.077822 6456 raft_consensus.cc:359] T 397ec5e49673406cb26a2efab0ad8401 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.078023 6456 raft_consensus.cc:385] T 397ec5e49673406cb26a2efab0ad8401 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:24.078078 6456 raft_consensus.cc:740] T 397ec5e49673406cb26a2efab0ad8401 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:24.078262 6456 consensus_queue.cc:260] T 397ec5e49673406cb26a2efab0ad8401 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.078660 6456 ts_tablet_manager.cc:1434] T 397ec5e49673406cb26a2efab0ad8401 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 19:50:24.079005 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1037) took 1201 ms. Trace:
I20260923 19:50:24.079071 6458 rpcz_store.cc:276] 0923 19:50:22.878047 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:22.878110 (+ 63us) service_pool.cc:224] Handling call
0923 19:50:24.078900 (+1200790us) ts_tablet_manager.cc:1151] Deleting tablet 7e8facf019054ac79fea193f44fc6742
0923 19:50:24.078908 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:24.078991 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1200585}
I20260923 19:50:24.079360 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1047) took 1179 ms. Trace:
I20260923 19:50:24.079430 6458 rpcz_store.cc:276] 0923 19:50:22.900217 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:22.900276 (+ 59us) service_pool.cc:224] Handling call
0923 19:50:24.079275 (+1178999us) ts_tablet_manager.cc:1151] Deleting tablet a55b2ff045d648339d7e207f13e2fa27
0923 19:50:24.079282 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:24.079347 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1178795}
I20260923 19:50:24.079682 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1046) took 1179 ms. Trace:
I20260923 19:50:24.079735 6458 rpcz_store.cc:276] 0923 19:50:22.900096 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:22.901601 (+ 1505us) service_pool.cc:224] Handling call
0923 19:50:24.079607 (+1178006us) ts_tablet_manager.cc:1151] Deleting tablet c53b817e3ed7419b904a3c4b1c83e59f
0923 19:50:24.079614 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:24.079672 (+ 58us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1177859}
I20260923 19:50:24.080018 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1045) took 1180 ms. Trace:
I20260923 19:50:24.080090 6458 rpcz_store.cc:276] 0923 19:50:22.900002 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:22.901569 (+ 1567us) service_pool.cc:224] Handling call
0923 19:50:24.079924 (+1178355us) ts_tablet_manager.cc:1151] Deleting tablet 8c5ac79e5fa2438a87db948792d448b1
0923 19:50:24.079933 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:24.080002 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1169745}
I20260923 19:50:24.080318 6458 tablet_replica.cc:333] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:24.080485 6458 raft_consensus.cc:2243] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:24.080772 6458 raft_consensus.cc:2272] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:24.082144 5805 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_9f93fd5514734871bf6a205b82e6e8ef" } modify_external_catalogs: true
I20260923 19:50:24.082355 5805 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_9f93fd5514734871bf6a205b82e6e8ef" } modify_external_catalogs: true
I20260923 19:50:24.083875 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d78d71ca18ac4335ad0c752f06e39dd8" } modify_external_catalogs: true
I20260923 19:50:24.084045 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d78d71ca18ac4335ad0c752f06e39dd8" } modify_external_catalogs: true
I20260923 19:50:24.086835 5803 catalog_manager.cc:5838] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193). New cstate: current_term: 1 leader_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:24.087126 5797 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_046edb51135a4c2f80ccb860e92c9e81" } modify_external_catalogs: true
I20260923 19:50:24.087275 5803 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 9c4a200d16464676976694656cbe28e2 (table default.Table_1e9ebf5c3c644666a5b6c1966fde4ed5 [id=5f2289c487ba40b9b7954c9d56918687]). Expected version 1 got 0
I20260923 19:50:24.087311 5797 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_046edb51135a4c2f80ccb860e92c9e81" } modify_external_catalogs: true
I20260923 19:50:24.087815 6030 tablet_service.cc:1511] Processing CreateTablet for tablet d35d749868aa488b99374483df2c5678 (DEFAULT_TABLE table=default.Table_b2773a25e37d4447a06b7de13b4bb492 [id=688ea8597c254313ac21325699af70f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.088227 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d35d749868aa488b99374483df2c5678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.088268 6025 tablet_service.cc:1511] Processing CreateTablet for tablet 00dc91d166fc49e49a803494e344030d (DEFAULT_TABLE table=default.Table_31f03213b57f4ae88e77e571772547cd [id=ae35f0d1b6d14dc3a8babc709d6d573a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.088415 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_37fae96810d94ad084dc55119b52f9d6" } modify_external_catalogs: true
I20260923 19:50:24.088541 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00dc91d166fc49e49a803494e344030d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.088593 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_37fae96810d94ad084dc55119b52f9d6" } modify_external_catalogs: true
I20260923 19:50:24.088804 6181 tablet_service.cc:1511] Processing CreateTablet for tablet d35d749868aa488b99374483df2c5678 (DEFAULT_TABLE table=default.Table_b2773a25e37d4447a06b7de13b4bb492 [id=688ea8597c254313ac21325699af70f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.090063 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_7ac640f9ac474cf9bcf6d412e838998e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:24.091149 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7ac640f9ac474cf9bcf6d412e838998e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:24.093609 6173 tablet_service.cc:1511] Processing CreateTablet for tablet 00dc91d166fc49e49a803494e344030d (DEFAULT_TABLE table=default.Table_31f03213b57f4ae88e77e571772547cd [id=ae35f0d1b6d14dc3a8babc709d6d573a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.097916 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 9d5f5dcaf6f94fd1afa713d42c0ab037
I20260923 19:50:24.099179 6171 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d5f5dcaf6f94fd1afa713d42c0ab037 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:24 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:24.099552 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 684eb2576b4b4730813b993e36b242df (table default.Table_af4eb1297d19460fade71cf33df073a4 [id=9673e7b97bef46628623a1926735866e]) successfully deleted
I20260923 19:50:24.099550 6039 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d5f5dcaf6f94fd1afa713d42c0ab037 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:24 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:24.099985 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 7e8facf019054ac79fea193f44fc6742 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e8facf019054ac79fea193f44fc6742 already in progress: creating tablet
I20260923 19:50:24.099951 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_21298e3a6a4143aeb230a266b5667d6f" } modify_external_catalogs: true
I20260923 19:50:24.100425 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_21298e3a6a4143aeb230a266b5667d6f" } modify_external_catalogs: true
W20260923 19:50:24.102924 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet a55b2ff045d648339d7e207f13e2fa27 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a55b2ff045d648339d7e207f13e2fa27 already in progress: creating tablet
W20260923 19:50:24.103487 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet c53b817e3ed7419b904a3c4b1c83e59f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c53b817e3ed7419b904a3c4b1c83e59f already in progress: creating tablet
W20260923 19:50:24.103919 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 8c5ac79e5fa2438a87db948792d448b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c5ac79e5fa2438a87db948792d448b1 already in progress: creating tablet
I20260923 19:50:24.107884 6454 tablet_bootstrap.cc:492] T c031d99a6f9844c29664236662e8d5f8 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:24.109067 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet fc71e2911b9e4d1eb3fcebe7d1e4d96c
I20260923 19:50:24.109719 6454 tablet_bootstrap.cc:654] T c031d99a6f9844c29664236662e8d5f8 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:24.109753 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 992ffd38518347fd9b69cd2d9e99c28a
I20260923 19:50:24.109805 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554655516bb547ad9c2aa1ee66dc8deb" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:24.114346 6039 tablet_service.cc:1558] Processing DeleteTablet for tablet 992ffd38518347fd9b69cd2d9e99c28a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:24 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:24.084172 7256 raft_consensus.cc:493] T d35ff653bf8d41cfbcf83359402a8f6a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:24.114739 6458 ts_tablet_manager.cc:1916] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:24.114655 7256 raft_consensus.cc:515] T d35ff653bf8d41cfbcf83359402a8f6a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:24.115032 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet 7af330ae1aaa48209f2bd1880bcfebb1 with delete_type TABLET_DATA_DELETED (replaced by tablet 55991fab89be47afba7fcd08673ef82f) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:24.115235 7256 leader_election.cc:290] T d35ff653bf8d41cfbcf83359402a8f6a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:24.115350 6171 tablet_service.cc:1558] Processing DeleteTablet for tablet fc71e2911b9e4d1eb3fcebe7d1e4d96c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:24 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:24.116612 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet 992ffd38518347fd9b69cd2d9e99c28a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:24 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:24.116886 6025 tablet_service.cc:1558] Processing DeleteTablet for tablet fc71e2911b9e4d1eb3fcebe7d1e4d96c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:24 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:24.117769 6025 tablet_service.cc:1558] Processing DeleteTablet for tablet 30fe07956e8940fcb7ba1e2e16ced463 with delete_type TABLET_DATA_DELETED (replaced by tablet 2ed8d49f1b3d4bee80b1822df2a7f495) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:24.117830 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 21bf33904ede470b80a074dc9a458baf
I20260923 19:50:24.118505 6307 tablet_service.cc:1558] Processing DeleteTablet for tablet 21bf33904ede470b80a074dc9a458baf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:24 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:24.119084 6054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d35ff653bf8d41cfbcf83359402a8f6a" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:24.119275 6054 raft_consensus.cc:2468] T d35ff653bf8d41cfbcf83359402a8f6a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:24.119704 6025 tablet_service.cc:1558] Processing DeleteTablet for tablet 21bf33904ede470b80a074dc9a458baf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:24 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:24.119724 6279 leader_election.cc:304] T d35ff653bf8d41cfbcf83359402a8f6a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:24.119979 7256 raft_consensus.cc:2804] T d35ff653bf8d41cfbcf83359402a8f6a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:24.120047 7256 raft_consensus.cc:493] T d35ff653bf8d41cfbcf83359402a8f6a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:24.120110 7256 raft_consensus.cc:3060] T d35ff653bf8d41cfbcf83359402a8f6a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:24.120152 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet 21bf33904ede470b80a074dc9a458baf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:24 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:24.121678 6458 ts_tablet_manager.cc:1929] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:50:24.121771 6458 log.cc:1199] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/85b7dcf131c54187a6e61f8503c797f8
I20260923 19:50:24.124424 6458 ts_tablet_manager.cc:1950] T 85b7dcf131c54187a6e61f8503c797f8 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:24.125854 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet ef0604c2a884465aab7bfe6a1d2d7da6
I20260923 19:50:24.125799 7256 raft_consensus.cc:515] T d35ff653bf8d41cfbcf83359402a8f6a P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:24.126570 7256 leader_election.cc:290] T d35ff653bf8d41cfbcf83359402a8f6a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:24.127202 6457 tablet_bootstrap.cc:654] T a6da9b3eea4547c9bb80b08bd26c5dc2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:24.127250 6307 tablet_service.cc:1558] Processing DeleteTablet for tablet ef0604c2a884465aab7bfe6a1d2d7da6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:24 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:24.127876 6054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d35ff653bf8d41cfbcf83359402a8f6a" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:24.128049 6054 raft_consensus.cc:3060] T d35ff653bf8d41cfbcf83359402a8f6a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:24.130271 6461 ts_tablet_manager.cc:1929] T cb11d6e082784ad98cfb5253dbb88707 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:24.130502 6461 log.cc:1199] T cb11d6e082784ad98cfb5253dbb88707 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/cb11d6e082784ad98cfb5253dbb88707
I20260923 19:50:24.130981 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet ef0604c2a884465aab7bfe6a1d2d7da6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:24 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:24.131383 6054 raft_consensus.cc:2468] T d35ff653bf8d41cfbcf83359402a8f6a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:24.131682 6316 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d5f5dcaf6f94fd1afa713d42c0ab037 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:24 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:24.131932 6322 tablet_service.cc:1558] Processing DeleteTablet for tablet fc71e2911b9e4d1eb3fcebe7d1e4d96c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:24 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:24.132293 6279 leader_election.cc:304] T d35ff653bf8d41cfbcf83359402a8f6a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:24.132690 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet ef0604c2a884465aab7bfe6a1d2d7da6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:24 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:24.133077 7256 raft_consensus.cc:2804] T d35ff653bf8d41cfbcf83359402a8f6a P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:24.133226 7256 raft_consensus.cc:697] T d35ff653bf8d41cfbcf83359402a8f6a P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:24.133504 7256 consensus_queue.cc:237] T d35ff653bf8d41cfbcf83359402a8f6a P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:24.134061 6461 ts_tablet_manager.cc:1950] T cb11d6e082784ad98cfb5253dbb88707 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:24.038964 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 7db36c90d1f54657b9aa29ccd84932b4 (DEFAULT_TABLE table=default.Table_6de7a682db5a4865b1c680cc672761ed [id=e147daf105234a589578c58160575dd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.135671 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7db36c90d1f54657b9aa29ccd84932b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.136471 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_3c3892a688cc4eb7b41d123435557716"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:24.137030 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c3892a688cc4eb7b41d123435557716 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:24.106853 6315 tablet_service.cc:1511] Processing CreateTablet for tablet 00dc91d166fc49e49a803494e344030d (DEFAULT_TABLE table=default.Table_31f03213b57f4ae88e77e571772547cd [id=ae35f0d1b6d14dc3a8babc709d6d573a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.107239 6308 tablet_service.cc:1511] Processing CreateTablet for tablet d35d749868aa488b99374483df2c5678 (DEFAULT_TABLE table=default.Table_b2773a25e37d4447a06b7de13b4bb492 [id=688ea8597c254313ac21325699af70f9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:24.110541 6280 consensus_peers.cc:597] T 1c43641327d14a888a2815e49a2762c8 P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:24.138051 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet cb11d6e082784ad98cfb5253dbb88707 (table default.Table_d178d42e78ae42b88975c9bc050e0041 [id=e3da2a14cd094e53b0a99042f93cb576]) successfully deleted
W20260923 19:50:24.138218 6280 leader_election.cc:343] T 554655516bb547ad9c2aa1ee66dc8deb P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:24.138271 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_7a5e4088446642aea66feb7e9eb3a838"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:24.138326 6280 leader_election.cc:304] T 554655516bb547ad9c2aa1ee66dc8deb P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:24.138554 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_889af07148934f888c1e9e6b7cb9e60a" } new_table_name: "default.Table_19787c511fad4e2cb8b4a937c11b4523" modify_external_catalogs: true
W20260923 19:50:24.138689 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a5e4088446642aea66feb7e9eb3a838 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:24.138860 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet a820bf5854324639b98c984ac583a4d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a820bf5854324639b98c984ac583a4d7 already in progress: creating tablet
W20260923 19:50:24.139572 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet a83726da349c4cd1852e956c8fa2cda5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a83726da349c4cd1852e956c8fa2cda5 already in progress: creating tablet
I20260923 19:50:24.139657 7826 raft_consensus.cc:2749] T 554655516bb547ad9c2aa1ee66dc8deb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:24.141151 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d35ff653bf8d41cfbcf83359402a8f6a" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:24.141223 5797 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 397ec5e49673406cb26a2efab0ad8401 (table default.Table_92f3bea4e4164a738fb75f01e95cd776 [id=0b80967a8fb94518ad872fbce9bae934]). Expected version 1 got 0
I20260923 19:50:24.141865 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d35ff653bf8d41cfbcf83359402a8f6a" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
W20260923 19:50:24.142601 6280 leader_election.cc:343] T d35ff653bf8d41cfbcf83359402a8f6a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:24.142639 7700 raft_consensus.cc:493] T b9c187ee1fa8438397c83bc2c2b16925 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:24.142772 7700 raft_consensus.cc:515] T b9c187ee1fa8438397c83bc2c2b16925 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:24.142882 6280 leader_election.cc:343] T d35ff653bf8d41cfbcf83359402a8f6a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:24.143348 7700 leader_election.cc:290] T b9c187ee1fa8438397c83bc2c2b16925 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:24.110917 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 992ffd38518347fd9b69cd2d9e99c28a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:24 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:24.144300 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d35d749868aa488b99374483df2c5678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.144412 6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00dc91d166fc49e49a803494e344030d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.144536 6032 tablet_service.cc:1511] Processing CreateTablet for tablet 690cf009543d40ba94cdde54274703d2 (DEFAULT_TABLE table=default.Table_d087f441e7bb49f7a030bbbb241f7359 [id=c719ca4650b04ce1ab57758bb5079d18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.114182 6456 tablet_bootstrap.cc:492] T 64e8951eb899461aa9c0b36e3f7555e2 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:24.146488 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 690cf009543d40ba94cdde54274703d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.147038 5797 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ef4075fc4b4042b6aefe48402acd9088" } new_table_name: "default.Table_e34666fdcca644d9ade094718ed5469d" modify_external_catalogs: true
I20260923 19:50:24.147341 7826 raft_consensus.cc:493] T f1c1d4f73488499a9e5add81e9d5e2d6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:24.147459 7826 raft_consensus.cc:515] T f1c1d4f73488499a9e5add81e9d5e2d6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.149055 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_743194c792634791a0ead89c8a687b50"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:24.149499 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_743194c792634791a0ead89c8a687b50 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:24.151849 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_9cf308a34d9d40728fc2e0535bd42fc2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:24.152302 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9cf308a34d9d40728fc2e0535bd42fc2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:24.154114 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_48f506d658aa4b7e9ac358f7f73d3b83"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:24.154551 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_48f506d658aa4b7e9ac358f7f73d3b83 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:24.158658 5797 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3d741c4546bd477da6d13d8bf544dc08 consensus state has no leader
W20260923 19:50:24.160212 5789 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet ff8e469f4cf24e1abaf6774a9c199c98 (table default.Table_fe0f6869307545d2807258b71107a778 [id=6cab12c5975d4e9e89110b041f53517f], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet ff8e469f4cf24e1abaf6774a9c199c98 has no consensus state
I20260923 19:50:24.160140 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_89cc104e23284794a696a358f691e3bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:24.161023 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89cc104e23284794a696a358f691e3bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:24.164314 6457 tablet_bootstrap.cc:492] T a6da9b3eea4547c9bb80b08bd26c5dc2 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:24.164516 6457 ts_tablet_manager.cc:1403] T a6da9b3eea4547c9bb80b08bd26c5dc2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.113s user 0.000s sys 0.004s
I20260923 19:50:24.164959 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_ca2186f8aabb45b296744c0f2eb8d87a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:24.165431 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca2186f8aabb45b296744c0f2eb8d87a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:24.165279 6457 raft_consensus.cc:359] T a6da9b3eea4547c9bb80b08bd26c5dc2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.165616 6457 raft_consensus.cc:385] T a6da9b3eea4547c9bb80b08bd26c5dc2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:24.165674 6457 raft_consensus.cc:740] T a6da9b3eea4547c9bb80b08bd26c5dc2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:24.165938 6457 consensus_queue.cc:260] T a6da9b3eea4547c9bb80b08bd26c5dc2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.166428 6457 ts_tablet_manager.cc:1434] T a6da9b3eea4547c9bb80b08bd26c5dc2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:24.167757 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00dc91d166fc49e49a803494e344030d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.168968 5802 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_769b0dad8d264f458b46793b701ef2bc" } new_table_name: "default.Table_d8f23c4ba0fb4170819c9cc0f6041519" modify_external_catalogs: true
I20260923 19:50:24.171947 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 85b7dcf131c54187a6e61f8503c797f8 (table default.Table_23c500b65dba4b6790b4349e5a5b0a07 [id=647997210f5349a68aa98d24e12a33cd]) successfully deleted
W20260923 19:50:24.172896 5792 catalog_manager.cc:5030] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 78911eed02894176b689fd9ce681de71 because the tablet was not found. No further retry: Not found: Tablet not found: 78911eed02894176b689fd9ce681de71
W20260923 19:50:24.174019 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet b0534795317747b28bef09df8a1c7244 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b0534795317747b28bef09df8a1c7244 already in progress: creating tablet
W20260923 19:50:24.177162 5805 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ca40c76ea0104e7182a7e16fc141fcc9 consensus state has no leader
W20260923 19:50:24.178618 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 4661da9259c74a4fbe3a00df5048658d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4661da9259c74a4fbe3a00df5048658d already in progress: creating tablet
W20260923 19:50:24.179139 6137 leader_election.cc:343] T b9c187ee1fa8438397c83bc2c2b16925 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: b9c187ee1fa8438397c83bc2c2b16925
W20260923 19:50:24.179764 5792 catalog_manager.cc:5030] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 78911eed02894176b689fd9ce681de71 because the tablet was not found. No further retry: Not found: Tablet not found: 78911eed02894176b689fd9ce681de71
I20260923 19:50:24.180629 6457 tablet_bootstrap.cc:492] T 7f47efa0cabd47aa8ed0deface7763ab P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
W20260923 19:50:24.180655 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet e6ebb766244f40a28e5fd96ecbb3e4f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6ebb766244f40a28e5fd96ecbb3e4f6 already in progress: creating tablet
W20260923 19:50:24.181515 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 4f0de9a4b9164e05874d322a0b4a8e46 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f0de9a4b9164e05874d322a0b4a8e46 already in progress: creating tablet
I20260923 19:50:24.182268 6457 tablet_bootstrap.cc:654] T 7f47efa0cabd47aa8ed0deface7763ab P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:24.182516 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 2dbb1973dbcd46f5a796fb8a0a24f88f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2dbb1973dbcd46f5a796fb8a0a24f88f already in progress: creating tablet
I20260923 19:50:24.183167 6458 tablet_replica.cc:333] T e1de117713f34b51bbda0c712f0b837c P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:24.183730 6458 raft_consensus.cc:2243] T e1de117713f34b51bbda0c712f0b837c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:24.184298 6458 raft_consensus.cc:2272] T e1de117713f34b51bbda0c712f0b837c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:24.185243 6458 ts_tablet_manager.cc:1916] T e1de117713f34b51bbda0c712f0b837c P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:24.186602 6106 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
I20260923 19:50:24.187501 6325 tablet_service.cc:1511] Processing CreateTablet for tablet efb7b459494e48c0a9b0c40d19724477 (DEFAULT_TABLE table=default.Table_53109b2775f44e67bfd5e452e3481fc2 [id=4747a3342bb547aaab8f4b427964ed04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.187881 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efb7b459494e48c0a9b0c40d19724477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.188684 6171 tablet_service.cc:1511] Processing CreateTablet for tablet c6cfe87ab3e14eaba461efaa108d1741 (DEFAULT_TABLE table=default.Table_48613637f8bf43d1a98e656721ce6731 [id=aecaa754a373445ea5b5540787d0109e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.189378 6166 tablet_service.cc:1511] Processing CreateTablet for tablet ca0882a0ae864d17acc1d9be69238f5d (DEFAULT_TABLE table=default.Table_9f02b4ba2e1244108432e0996acc51df [id=148248a6425842cca628080b6c242d63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.190094 6174 tablet_service.cc:1511] Processing CreateTablet for tablet efb7b459494e48c0a9b0c40d19724477 (DEFAULT_TABLE table=default.Table_53109b2775f44e67bfd5e452e3481fc2 [id=4747a3342bb547aaab8f4b427964ed04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.190304 6165 tablet_service.cc:1511] Processing CreateTablet for tablet 5dfb4a37cb5645a6a31f6ce0dbd27779 (DEFAULT_TABLE table=default.Table_fb368416c83d47ea95f8baa4754aa549 [id=4693d9b2aef542478b8239cfe89bbcdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.190891 7826 leader_election.cc:290] T f1c1d4f73488499a9e5add81e9d5e2d6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:24.191676 6307 tablet_service.cc:1511] Processing CreateTablet for tablet 5dfb4a37cb5645a6a31f6ce0dbd27779 (DEFAULT_TABLE table=default.Table_fb368416c83d47ea95f8baa4754aa549 [id=4693d9b2aef542478b8239cfe89bbcdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.191676 6306 tablet_service.cc:1511] Processing CreateTablet for tablet f994c5da7ed6483dacb47350531c0ea0 (DEFAULT_TABLE table=default.Table_833ecfe514c54532bb2adee3323149cc [id=6b3cdfeb7b5a487c8941c3b5e43e9f2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.192062 6306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f994c5da7ed6483dacb47350531c0ea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.192026 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c1d4f73488499a9e5add81e9d5e2d6" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:24.192039 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c1d4f73488499a9e5add81e9d5e2d6" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:24.192224 6059 raft_consensus.cc:2468] T f1c1d4f73488499a9e5add81e9d5e2d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:24.192639 6307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dfb4a37cb5645a6a31f6ce0dbd27779. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.192683 6279 leader_election.cc:304] T f1c1d4f73488499a9e5add81e9d5e2d6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
W20260923 19:50:24.193509 6280 leader_election.cc:343] T f1c1d4f73488499a9e5add81e9d5e2d6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:24.193904 7826 raft_consensus.cc:2804] T f1c1d4f73488499a9e5add81e9d5e2d6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:24.193985 7826 raft_consensus.cc:493] T f1c1d4f73488499a9e5add81e9d5e2d6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:24.194072 7826 raft_consensus.cc:3060] T f1c1d4f73488499a9e5add81e9d5e2d6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:24.197230 6456 tablet_bootstrap.cc:654] T 64e8951eb899461aa9c0b36e3f7555e2 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:24.198781 5802 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8e95ec2f36be418fa2f042cd14b7a8bd consensus state has no leader
I20260923 19:50:24.198856 6039 tablet_service.cc:1511] Processing CreateTablet for tablet 5dfb4a37cb5645a6a31f6ce0dbd27779 (DEFAULT_TABLE table=default.Table_fb368416c83d47ea95f8baa4754aa549 [id=4693d9b2aef542478b8239cfe89bbcdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.199035 6030 tablet_service.cc:1511] Processing CreateTablet for tablet efb7b459494e48c0a9b0c40d19724477 (DEFAULT_TABLE table=default.Table_53109b2775f44e67bfd5e452e3481fc2 [id=4747a3342bb547aaab8f4b427964ed04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.199244 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dfb4a37cb5645a6a31f6ce0dbd27779. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.199445 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efb7b459494e48c0a9b0c40d19724477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.199330 6322 tablet_service.cc:1511] Processing CreateTablet for tablet c6cfe87ab3e14eaba461efaa108d1741 (DEFAULT_TABLE table=default.Table_48613637f8bf43d1a98e656721ce6731 [id=aecaa754a373445ea5b5540787d0109e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.200412 6316 tablet_service.cc:1511] Processing CreateTablet for tablet ca0882a0ae864d17acc1d9be69238f5d (DEFAULT_TABLE table=default.Table_9f02b4ba2e1244108432e0996acc51df [id=148248a6425842cca628080b6c242d63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.202073 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d35d749868aa488b99374483df2c5678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.202201 6025 tablet_service.cc:1511] Processing CreateTablet for tablet ca0882a0ae864d17acc1d9be69238f5d (DEFAULT_TABLE table=default.Table_9f02b4ba2e1244108432e0996acc51df [id=148248a6425842cca628080b6c242d63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.202564 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca0882a0ae864d17acc1d9be69238f5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.203800 6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca0882a0ae864d17acc1d9be69238f5d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:24.206408 6139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.195:32855, user_credentials={real_user=slave}} blocked reactor thread for 133552us
I20260923 19:50:24.209781 6322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6cfe87ab3e14eaba461efaa108d1741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.211891 6028 tablet_service.cc:1511] Processing CreateTablet for tablet c6cfe87ab3e14eaba461efaa108d1741 (DEFAULT_TABLE table=default.Table_48613637f8bf43d1a98e656721ce6731 [id=aecaa754a373445ea5b5540787d0109e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.212455 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6cfe87ab3e14eaba461efaa108d1741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.218215 7826 raft_consensus.cc:515] T f1c1d4f73488499a9e5add81e9d5e2d6 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.218878 7826 leader_election.cc:290] T f1c1d4f73488499a9e5add81e9d5e2d6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:24.219545 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c1d4f73488499a9e5add81e9d5e2d6" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
W20260923 19:50:24.220134 6280 leader_election.cc:343] T f1c1d4f73488499a9e5add81e9d5e2d6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:24.220532 6181 tablet_service.cc:1511] Processing CreateTablet for tablet f994c5da7ed6483dacb47350531c0ea0 (DEFAULT_TABLE table=default.Table_833ecfe514c54532bb2adee3323149cc [id=6b3cdfeb7b5a487c8941c3b5e43e9f2a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:24.222040 6139 leader_election.cc:343] T b9c187ee1fa8438397c83bc2c2b16925 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: b9c187ee1fa8438397c83bc2c2b16925
I20260923 19:50:24.222584 6139 leader_election.cc:304] T b9c187ee1fa8438397c83bc2c2b16925 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:24.222620 5802 master_service.cc:960] ReplaceTablet: received request to replace tablet fb1ea962909b4e42a9c4fab048133077 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:24.222645 6025 tablet_service.cc:1511] Processing CreateTablet for tablet f994c5da7ed6483dacb47350531c0ea0 (DEFAULT_TABLE table=default.Table_833ecfe514c54532bb2adee3323149cc [id=6b3cdfeb7b5a487c8941c3b5e43e9f2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.223107 7884 raft_consensus.cc:2749] T b9c187ee1fa8438397c83bc2c2b16925 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:24.225128 6039 tablet_service.cc:1511] Processing CreateTablet for tablet 039419cd51504cf2af724d92cbaa8858 (DEFAULT_TABLE table=default.Table_cefeef04a4b942298f483f3a6c87dbb7 [id=201475aecf1a4a76ad8b6b593209240a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.223379 7877 raft_consensus.cc:493] T 30fe07956e8940fcb7ba1e2e16ced463 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:24.225867 7877 raft_consensus.cc:515] T 30fe07956e8940fcb7ba1e2e16ced463 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.225924 6306 tablet_service.cc:1511] Processing CreateTablet for tablet 9004a993929544d2af6fcc864d2fef38 (DEFAULT_TABLE table=default.Table_8e41ae4fbbd24bfe8fd51fa5fb4d0e22 [id=395de74e58b64b389257c4bb2e7a713e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.226361 6306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9004a993929544d2af6fcc864d2fef38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.227066 6030 tablet_service.cc:1511] Processing CreateTablet for tablet 9004a993929544d2af6fcc864d2fef38 (DEFAULT_TABLE table=default.Table_8e41ae4fbbd24bfe8fd51fa5fb4d0e22 [id=395de74e58b64b389257c4bb2e7a713e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.227146 7877 leader_election.cc:290] T 30fe07956e8940fcb7ba1e2e16ced463 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:24.227192 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30fe07956e8940fcb7ba1e2e16ced463" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:24.209734 6459 ts_tablet_manager.cc:1929] T a75c4436a67f453e973a7a7645de79b1 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260923 19:50:24.227619 5996 leader_election.cc:343] T 30fe07956e8940fcb7ba1e2e16ced463 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:24.224241 6461 tablet_replica.cc:333] T 86388fa08c454da9ad2ca0124dcba10b P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:24.228916 6180 tablet_service.cc:1511] Processing CreateTablet for tablet 039419cd51504cf2af724d92cbaa8858 (DEFAULT_TABLE table=default.Table_cefeef04a4b942298f483f3a6c87dbb7 [id=201475aecf1a4a76ad8b6b593209240a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.229103 6317 tablet_service.cc:1511] Processing CreateTablet for tablet 940432ed9d0a4ba98a90fcebbc4f33bd (DEFAULT_TABLE table=default.Table_6bce4bb4735140d1ae968385c454192f [id=397eec7e969f475a8a69b1699be9d241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.230494 6172 tablet_service.cc:1511] Processing CreateTablet for tablet 9004a993929544d2af6fcc864d2fef38 (DEFAULT_TABLE table=default.Table_8e41ae4fbbd24bfe8fd51fa5fb4d0e22 [id=395de74e58b64b389257c4bb2e7a713e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.230547 6032 tablet_service.cc:1511] Processing CreateTablet for tablet 940432ed9d0a4ba98a90fcebbc4f33bd (DEFAULT_TABLE table=default.Table_6bce4bb4735140d1ae968385c454192f [id=397eec7e969f475a8a69b1699be9d241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.230683 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f994c5da7ed6483dacb47350531c0ea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.230829 6461 raft_consensus.cc:2243] T 86388fa08c454da9ad2ca0124dcba10b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:24.232060 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 039419cd51504cf2af724d92cbaa8858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.232506 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9004a993929544d2af6fcc864d2fef38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.233157 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_16bf237e106f4eb1b2b1ddc2fab7cda8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:24.233681 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_16bf237e106f4eb1b2b1ddc2fab7cda8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:24.235893 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 940432ed9d0a4ba98a90fcebbc4f33bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.237306 6461 raft_consensus.cc:2272] T 86388fa08c454da9ad2ca0124dcba10b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:24.243621 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet fb1ea962909b4e42a9c4fab048133077
I20260923 19:50:24.243624 6040 tablet_service.cc:1511] Processing CreateTablet for tablet 78911eed02894176b689fd9ce681de71 (DEFAULT_TABLE table=default.Table_442d2690dd6a4cb681ac7f7146304efa [id=eec9dccd37884607a7b5e616340c5b9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.243942 6040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78911eed02894176b689fd9ce681de71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.244343 6461 ts_tablet_manager.cc:1916] T 86388fa08c454da9ad2ca0124dcba10b P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:24.244539 5802 catalog_manager.cc:6934] ReplaceTablet: tablet fb1ea962909b4e42a9c4fab048133077 deleted and replaced by tablet 8f80af68c91843928eedc386e6a5b967
I20260923 19:50:24.240242 6033 tablet_service.cc:1511] Processing CreateTablet for tablet a6f344e2095145b8a3670c99049030ef (DEFAULT_TABLE table=default.Table_7c0f53782acd4972bd270aafa5cfead6 [id=f70b6e2537c34bf8a8cb2da0a82db920]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.246104 6033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6f344e2095145b8a3670c99049030ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.251578 6457 tablet_bootstrap.cc:492] T 7f47efa0cabd47aa8ed0deface7763ab P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:24.251710 6457 ts_tablet_manager.cc:1403] T 7f47efa0cabd47aa8ed0deface7763ab P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.071s user 0.003s sys 0.000s
I20260923 19:50:24.252338 6457 raft_consensus.cc:359] T 7f47efa0cabd47aa8ed0deface7763ab P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:24.252509 6457 raft_consensus.cc:385] T 7f47efa0cabd47aa8ed0deface7763ab P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:24.252575 6457 raft_consensus.cc:740] T 7f47efa0cabd47aa8ed0deface7763ab P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:24.252761 6457 consensus_queue.cc:260] T 7f47efa0cabd47aa8ed0deface7763ab P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:24.253093 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30fe07956e8940fcb7ba1e2e16ced463" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:24.253620 6179 tablet_service.cc:1558] Processing DeleteTablet for tablet fb1ea962909b4e42a9c4fab048133077 with delete_type TABLET_DATA_DELETED (replaced by tablet 8f80af68c91843928eedc386e6a5b967) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:24.253755 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 940432ed9d0a4ba98a90fcebbc4f33bd (DEFAULT_TABLE table=default.Table_6bce4bb4735140d1ae968385c454192f [id=397eec7e969f475a8a69b1699be9d241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.254253 6177 tablet_service.cc:1511] Processing CreateTablet for tablet a6f344e2095145b8a3670c99049030ef (DEFAULT_TABLE table=default.Table_7c0f53782acd4972bd270aafa5cfead6 [id=f70b6e2537c34bf8a8cb2da0a82db920]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:24.255757 5995 leader_election.cc:343] T 30fe07956e8940fcb7ba1e2e16ced463 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:24.255887 5995 leader_election.cc:304] T 30fe07956e8940fcb7ba1e2e16ced463 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:24.256744 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_45dc6c5ba67e4dedb020fe098d5f95e5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:24.256851 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_69a0d472f9674736bf0d2560edc30b20" } new_table_name: "default.Table_2cec01b1c90f426284d080ebe29c31ff" modify_external_catalogs: true
W20260923 19:50:24.257441 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45dc6c5ba67e4dedb020fe098d5f95e5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:24.261577 7816 raft_consensus.cc:2749] T 30fe07956e8940fcb7ba1e2e16ced463 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:24.238387 6321 tablet_service.cc:1511] Processing CreateTablet for tablet a6f344e2095145b8a3670c99049030ef (DEFAULT_TABLE table=default.Table_7c0f53782acd4972bd270aafa5cfead6 [id=f70b6e2537c34bf8a8cb2da0a82db920]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.266728 5796 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 7f47efa0cabd47aa8ed0deface7763ab (table default.Table_f57f8cacbedb49c6be509b51c824b960 [id=ada5cc6ef65b4859bf027fd3af9ad0f2]). Expected version 2 got 0
W20260923 19:50:24.267218 5796 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 7f47efa0cabd47aa8ed0deface7763ab (table default.Table_f57f8cacbedb49c6be509b51c824b960 [id=ada5cc6ef65b4859bf027fd3af9ad0f2], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 7f47efa0cabd47aa8ed0deface7763ab consensus state has no leader
W20260923 19:50:24.270258 5805 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 516982de5f8546c1b4be8eb5df615f21 consensus state has no leader
I20260923 19:50:24.272109 7877 raft_consensus.cc:493] T 21bf33904ede470b80a074dc9a458baf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:24.272305 7877 raft_consensus.cc:515] T 21bf33904ede470b80a074dc9a458baf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.273411 7877 leader_election.cc:290] T 21bf33904ede470b80a074dc9a458baf P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:24.271886 6457 ts_tablet_manager.cc:1434] T 7f47efa0cabd47aa8ed0deface7763ab P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.020s user 0.003s sys 0.000s
I20260923 19:50:24.274238 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bf33904ede470b80a074dc9a458baf" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:24.271668 6039 tablet_service.cc:1558] Processing DeleteTablet for tablet fb1ea962909b4e42a9c4fab048133077 with delete_type TABLET_DATA_DELETED (replaced by tablet 8f80af68c91843928eedc386e6a5b967) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:24.274748 5996 leader_election.cc:343] T 21bf33904ede470b80a074dc9a458baf P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:24.276512 5802 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f9942fca28234830913277dada229375" } new_table_name: "default.Table_ec1f04b2e36247fa96e9591cb7ab7eff" modify_external_catalogs: true
I20260923 19:50:24.280200 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet fb1ea962909b4e42a9c4fab048133077 with delete_type TABLET_DATA_DELETED (replaced by tablet 8f80af68c91843928eedc386e6a5b967) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:24.280709 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 039419cd51504cf2af724d92cbaa8858 (DEFAULT_TABLE table=default.Table_cefeef04a4b942298f483f3a6c87dbb7 [id=201475aecf1a4a76ad8b6b593209240a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:24.282125 6279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.143.193:39887, user_credentials={real_user=slave}} blocked reactor thread for 87111.3us
I20260923 19:50:24.282801 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c1d4f73488499a9e5add81e9d5e2d6" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:24.282994 6059 raft_consensus.cc:3060] T f1c1d4f73488499a9e5add81e9d5e2d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:24.285276 5805 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 7f47efa0cabd47aa8ed0deface7763ab (table default.Table_f57f8cacbedb49c6be509b51c824b960 [id=ada5cc6ef65b4859bf027fd3af9ad0f2]). Expected version 2 got 0
I20260923 19:50:24.285750 6059 raft_consensus.cc:2468] T f1c1d4f73488499a9e5add81e9d5e2d6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:24.287326 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 940432ed9d0a4ba98a90fcebbc4f33bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.288446 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 039419cd51504cf2af724d92cbaa8858. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:24.288446 5802 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cf64073cdde748bc8ed3ce7580a71160 consensus state has no leader
I20260923 19:50:24.290395 6279 leader_election.cc:304] T f1c1d4f73488499a9e5add81e9d5e2d6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:24.290699 7822 raft_consensus.cc:2804] T f1c1d4f73488499a9e5add81e9d5e2d6 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:24.290994 7822 raft_consensus.cc:697] T f1c1d4f73488499a9e5add81e9d5e2d6 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:24.291320 6039 tablet_service.cc:1511] Processing CreateTablet for tablet d54e5b6d51ea457ab3cdac578289c7aa (DEFAULT_TABLE table=default.Table_fdf7b04e073842959f84cd5bcde8c992 [id=869d7d114d52402caa4248c50fdbf546]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.292251 7822 consensus_queue.cc:237] T f1c1d4f73488499a9e5add81e9d5e2d6 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.291915 6457 tablet_bootstrap.cc:492] T 559f3e3016aa470f9732a727b4528586 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:24.296733 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bf33904ede470b80a074dc9a458baf" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:24.296733 6171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6cfe87ab3e14eaba461efaa108d1741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.297627 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 0500d198ec2d483f99c7dfb291323f11 (DEFAULT_TABLE table=default.Table_c93df90095224de5a2f127b7d03ba79c [id=f922a13efe7b4c36a8e27481ee09de0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.298714 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 78911eed02894176b689fd9ce681de71 (DEFAULT_TABLE table=default.Table_442d2690dd6a4cb681ac7f7146304efa [id=eec9dccd37884607a7b5e616340c5b9b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:24.298717 5995 leader_election.cc:343] T 21bf33904ede470b80a074dc9a458baf P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:24.298884 5995 leader_election.cc:304] T 21bf33904ede470b80a074dc9a458baf P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:24.299960 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6f344e2095145b8a3670c99049030ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.300153 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 78911eed02894176b689fd9ce681de71 (DEFAULT_TABLE table=default.Table_442d2690dd6a4cb681ac7f7146304efa [id=eec9dccd37884607a7b5e616340c5b9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.300482 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78911eed02894176b689fd9ce681de71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.305162 7877 raft_consensus.cc:2749] T 21bf33904ede470b80a074dc9a458baf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:24.305680 6040 tablet_service.cc:1511] Processing CreateTablet for tablet 367a8b9a9b2b453e91082a8cc4f5f64c (DEFAULT_TABLE table=default.Table_9d958e2f2c8d46938d212cb93c8884f0 [id=f645b7abebb346779b58b261d7618982]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.307996 6168 tablet_service.cc:1511] Processing CreateTablet for tablet 367a8b9a9b2b453e91082a8cc4f5f64c (DEFAULT_TABLE table=default.Table_9d958e2f2c8d46938d212cb93c8884f0 [id=f645b7abebb346779b58b261d7618982]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.308115 6033 tablet_service.cc:1511] Processing CreateTablet for tablet 8019f7e579d246c0b559744a780c40f2 (DEFAULT_TABLE table=default.Table_b6c9ee903c654e5bbda90c1fd2ce6868 [id=aef09d010a564de99fc312836067b640]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.308565 6035 tablet_service.cc:1511] Processing CreateTablet for tablet 4b6aa676a2a54ee5a0d13d875eb03418 (DEFAULT_TABLE table=default.Table_61a67edc9b154897b37cedf4df6485f7 [id=606b76fabc8c42dc9d2c7b0061eee58f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.308979 6175 tablet_service.cc:1511] Processing CreateTablet for tablet 8019f7e579d246c0b559744a780c40f2 (DEFAULT_TABLE table=default.Table_b6c9ee903c654e5bbda90c1fd2ce6868 [id=aef09d010a564de99fc312836067b640]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.309278 6172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9004a993929544d2af6fcc864d2fef38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.309540 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efb7b459494e48c0a9b0c40d19724477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.309791 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f994c5da7ed6483dacb47350531c0ea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.311334 6459 log.cc:1199] T a75c4436a67f453e973a7a7645de79b1 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/a75c4436a67f453e973a7a7645de79b1
I20260923 19:50:24.312160 6179 tablet_service.cc:1511] Processing CreateTablet for tablet d54e5b6d51ea457ab3cdac578289c7aa (DEFAULT_TABLE table=default.Table_fdf7b04e073842959f84cd5bcde8c992 [id=869d7d114d52402caa4248c50fdbf546]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.310655 6170 tablet_service.cc:1511] Processing CreateTablet for tablet 4b6aa676a2a54ee5a0d13d875eb03418 (DEFAULT_TABLE table=default.Table_61a67edc9b154897b37cedf4df6485f7 [id=606b76fabc8c42dc9d2c7b0061eee58f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.313601 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 039419cd51504cf2af724d92cbaa8858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.315068 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_8b491f6b8220479ba54f424bc16d9251" } modify_external_catalogs: true
I20260923 19:50:24.315244 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_8b491f6b8220479ba54f424bc16d9251" } modify_external_catalogs: true
I20260923 19:50:24.316738 5805 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_43de6815589f4a87b13b6dd0bbee9257" } modify_external_catalogs: true
I20260923 19:50:24.316943 5805 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_43de6815589f4a87b13b6dd0bbee9257" } modify_external_catalogs: true
I20260923 19:50:24.317970 5797 catalog_manager.cc:5838] T d35ff653bf8d41cfbcf83359402a8f6a P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:24.320387 5800 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b1dec095ad12408aaad8e803a2290816" } modify_external_catalogs: true
I20260923 19:50:24.320536 5800 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b1dec095ad12408aaad8e803a2290816" } modify_external_catalogs: true
I20260923 19:50:24.325943 7877 raft_consensus.cc:493] T 0e650824e4ae474787faeb6c22a4b43f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:24.326926 7877 raft_consensus.cc:515] T 0e650824e4ae474787faeb6c22a4b43f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.328708 5803 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ae675838bcf846309b17e86c9b8abef1" } modify_external_catalogs: true
I20260923 19:50:24.328939 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_45980990efcf47dd845c1fa3f56fd91f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:24.329470 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45980990efcf47dd845c1fa3f56fd91f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:24.330072 6165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dfb4a37cb5645a6a31f6ce0dbd27779. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.330315 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0500d198ec2d483f99c7dfb291323f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.330524 6170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b6aa676a2a54ee5a0d13d875eb03418. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.337646 5803 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ae675838bcf846309b17e86c9b8abef1" } modify_external_catalogs: true
I20260923 19:50:24.337674 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 605093b0f8034a638b3df925ea31de34
I20260923 19:50:24.339638 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet 605093b0f8034a638b3df925ea31de34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:24 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:24.339888 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 37de46eabdd84065975a8e5a3c3758c4
I20260923 19:50:24.340688 6182 tablet_service.cc:1558] Processing DeleteTablet for tablet 37de46eabdd84065975a8e5a3c3758c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:24 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:24.341354 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet 37de46eabdd84065975a8e5a3c3758c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:24 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:24.343261 7877 leader_election.cc:290] T 0e650824e4ae474787faeb6c22a4b43f P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:24.346603 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e650824e4ae474787faeb6c22a4b43f" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:24.346936 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d54e5b6d51ea457ab3cdac578289c7aa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:24.347107 5996 leader_election.cc:343] T 0e650824e4ae474787faeb6c22a4b43f P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:24.349833 6459 ts_tablet_manager.cc:1950] T a75c4436a67f453e973a7a7645de79b1 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:24.351457 6457 tablet_bootstrap.cc:654] T 559f3e3016aa470f9732a727b4528586 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:24.351770 6310 tablet_service.cc:1511] Processing CreateTablet for tablet d54e5b6d51ea457ab3cdac578289c7aa (DEFAULT_TABLE table=default.Table_fdf7b04e073842959f84cd5bcde8c992 [id=869d7d114d52402caa4248c50fdbf546]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.353744 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d54e5b6d51ea457ab3cdac578289c7aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.354864 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_545540fd5e8f40c9ae3b3c88ff3d97fb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:24.355430 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_545540fd5e8f40c9ae3b3c88ff3d97fb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:24.356859 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e650824e4ae474787faeb6c22a4b43f" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:24.358492 6315 tablet_service.cc:1511] Processing CreateTablet for tablet 0500d198ec2d483f99c7dfb291323f11 (DEFAULT_TABLE table=default.Table_c93df90095224de5a2f127b7d03ba79c [id=f922a13efe7b4c36a8e27481ee09de0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.358907 6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0500d198ec2d483f99c7dfb291323f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.360157 6175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8019f7e579d246c0b559744a780c40f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.360221 6173 tablet_service.cc:1558] Processing DeleteTablet for tablet 605093b0f8034a638b3df925ea31de34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:24 UTC) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:24.357849 5995 leader_election.cc:343] T 0e650824e4ae474787faeb6c22a4b43f P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:24.366262 5995 leader_election.cc:304] T 0e650824e4ae474787faeb6c22a4b43f P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:24.367553 7877 raft_consensus.cc:2749] T 0e650824e4ae474787faeb6c22a4b43f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:24.359229 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 956) took 2761 ms. Trace:
I20260923 19:50:24.364029 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 0500d198ec2d483f99c7dfb291323f11 (DEFAULT_TABLE table=default.Table_c93df90095224de5a2f127b7d03ba79c [id=f922a13efe7b4c36a8e27481ee09de0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.368011 6459 rpcz_store.cc:276] 0923 19:50:21.597293 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.597378 (+ 85us) service_pool.cc:224] Handling call
0923 19:50:24.024592 (+2427214us) ts_tablet_manager.cc:1151] Deleting tablet a75c4436a67f453e973a7a7645de79b1
0923 19:50:24.024605 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:24.206464 (+181859us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:24.209670 (+ 3206us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:24.359211 (+149541us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2409680}
I20260923 19:50:24.370663 6040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 367a8b9a9b2b453e91082a8cc4f5f64c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.370981 6459 tablet_replica.cc:333] T 035abecfbee7474d9dd048f35e28e867 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:24.371232 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet a75c4436a67f453e973a7a7645de79b1 (table default.Table_30ce30e86cff4c8f9995423040b349c9 [id=e579cc40ccb84a7aa8c508342e6e19be]) successfully deleted
I20260923 19:50:24.371553 6459 raft_consensus.cc:2243] T 035abecfbee7474d9dd048f35e28e867 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:24.374104 6033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8019f7e579d246c0b559744a780c40f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.376820 6461 ts_tablet_manager.cc:1929] T 86388fa08c454da9ad2ca0124dcba10b P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:24.378485 6461 log.cc:1199] T 86388fa08c454da9ad2ca0124dcba10b P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/86388fa08c454da9ad2ca0124dcba10b
I20260923 19:50:24.378857 6461 ts_tablet_manager.cc:1950] T 86388fa08c454da9ad2ca0124dcba10b P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:24.379398 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b6aa676a2a54ee5a0d13d875eb03418. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.380407 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 86388fa08c454da9ad2ca0124dcba10b (table default.Table_4803d401dac84700919d6879b552cd8d [id=2973ea17373f4ec181b54ab66028a774]) successfully deleted
I20260923 19:50:24.381181 6457 tablet_bootstrap.cc:492] T 559f3e3016aa470f9732a727b4528586 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:24.381300 6457 ts_tablet_manager.cc:1403] T 559f3e3016aa470f9732a727b4528586 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.102s user 0.002s sys 0.001s
W20260923 19:50:24.381510 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 7bd0ccf56ee9498f9fa42c5a03a931b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7bd0ccf56ee9498f9fa42c5a03a931b6 already in progress: creating tablet
W20260923 19:50:24.381850 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 9d5f5dcaf6f94fd1afa713d42c0ab037 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d5f5dcaf6f94fd1afa713d42c0ab037 already in progress: creating tablet
W20260923 19:50:24.382091 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 992ffd38518347fd9b69cd2d9e99c28a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 992ffd38518347fd9b69cd2d9e99c28a already in progress: creating tablet
W20260923 19:50:24.382354 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet fc71e2911b9e4d1eb3fcebe7d1e4d96c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc71e2911b9e4d1eb3fcebe7d1e4d96c already in progress: creating tablet
I20260923 19:50:24.382404 6461 tablet_replica.cc:333] T 30fe07956e8940fcb7ba1e2e16ced463 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:24.382586 6461 raft_consensus.cc:2243] T 30fe07956e8940fcb7ba1e2e16ced463 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:24.382727 6461 raft_consensus.cc:2272] T 30fe07956e8940fcb7ba1e2e16ced463 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:24.383033 6457 raft_consensus.cc:359] T 559f3e3016aa470f9732a727b4528586 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.385111 6457 raft_consensus.cc:385] T 559f3e3016aa470f9732a727b4528586 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:24.385248 6457 raft_consensus.cc:740] T 559f3e3016aa470f9732a727b4528586 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:24.385550 6457 consensus_queue.cc:260] T 559f3e3016aa470f9732a727b4528586 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.385998 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 367a8b9a9b2b453e91082a8cc4f5f64c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.386245 6457 ts_tablet_manager.cc:1434] T 559f3e3016aa470f9732a727b4528586 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260923 19:50:24.387568 6461 ts_tablet_manager.cc:1916] T 30fe07956e8940fcb7ba1e2e16ced463 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:24.388309 6457 tablet_bootstrap.cc:492] T 373d6442546d41e2b5567dfc92ae07b1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:24.390733 6457 tablet_bootstrap.cc:654] T 373d6442546d41e2b5567dfc92ae07b1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:24.395329 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_c5386174bc9d489cbdf01f26dbc11740"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:24.395963 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c5386174bc9d489cbdf01f26dbc11740 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:24.397289 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_c47cec6c0da648918c78ebc636858eaa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:24.397805 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c47cec6c0da648918c78ebc636858eaa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:24.399142 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_d1fd0fa46a214d4895291f81394e7023"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:24.399628 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d1fd0fa46a214d4895291f81394e7023 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:24.400281 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b115b41e555e48ee912c9be01ed1700c" } new_table_name: "default.Table_f93d7474533e4043821432c7150dff6d" modify_external_catalogs: true
I20260923 19:50:24.401114 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_3e40d347b8bd45bcb5ce43a795e909c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:24.401547 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e40d347b8bd45bcb5ce43a795e909c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:24.407922 6459 raft_consensus.cc:2272] T 035abecfbee7474d9dd048f35e28e867 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:24.409960 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 940432ed9d0a4ba98a90fcebbc4f33bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.410451 6457 tablet_bootstrap.cc:492] T 373d6442546d41e2b5567dfc92ae07b1 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:24.410960 6457 ts_tablet_manager.cc:1403] T 373d6442546d41e2b5567dfc92ae07b1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.023s user 0.006s sys 0.001s
I20260923 19:50:24.411931 6457 raft_consensus.cc:359] T 373d6442546d41e2b5567dfc92ae07b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.413067 6457 raft_consensus.cc:385] T 373d6442546d41e2b5567dfc92ae07b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:24.413269 6457 raft_consensus.cc:740] T 373d6442546d41e2b5567dfc92ae07b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:24.413615 6457 consensus_queue.cc:260] T 373d6442546d41e2b5567dfc92ae07b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.414670 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0500d198ec2d483f99c7dfb291323f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.416033 6461 ts_tablet_manager.cc:1929] T 30fe07956e8940fcb7ba1e2e16ced463 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:24.427407 6461 log.cc:1199] T 30fe07956e8940fcb7ba1e2e16ced463 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/30fe07956e8940fcb7ba1e2e16ced463
I20260923 19:50:24.427836 6461 ts_tablet_manager.cc:1950] T 30fe07956e8940fcb7ba1e2e16ced463 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:24.428854 6461 tablet_replica.cc:333] T 21bf33904ede470b80a074dc9a458baf P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:24.429054 6461 raft_consensus.cc:2243] T 21bf33904ede470b80a074dc9a458baf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:24.429221 6461 raft_consensus.cc:2272] T 21bf33904ede470b80a074dc9a458baf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:24.429804 6461 ts_tablet_manager.cc:1916] T 21bf33904ede470b80a074dc9a458baf P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:24.433564 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78911eed02894176b689fd9ce681de71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.433816 6177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6f344e2095145b8a3670c99049030ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.434013 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca0882a0ae864d17acc1d9be69238f5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.434264 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 30fe07956e8940fcb7ba1e2e16ced463 (table default.Table_b0aaf57c3ec9414f89529017165bc65b [id=84b65375453448aebd9bce135f58bd90]) successfully deleted
I20260923 19:50:24.435421 7890 consensus_queue.cc:1048] T 1c43641327d14a888a2815e49a2762c8 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:24.436362 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_9d958e2f2c8d46938d212cb93c8884f0" } modify_external_catalogs: true
I20260923 19:50:24.437696 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_9d958e2f2c8d46938d212cb93c8884f0" } modify_external_catalogs: true
I20260923 19:50:24.437927 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d54e5b6d51ea457ab3cdac578289c7aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.439309 7877 raft_consensus.cc:493] T a6da9b3eea4547c9bb80b08bd26c5dc2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:24.439456 7877 raft_consensus.cc:515] T a6da9b3eea4547c9bb80b08bd26c5dc2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.440168 7877 leader_election.cc:290] T a6da9b3eea4547c9bb80b08bd26c5dc2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:24.440922 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6da9b3eea4547c9bb80b08bd26c5dc2" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:24.441462 5995 leader_election.cc:343] T a6da9b3eea4547c9bb80b08bd26c5dc2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:24.447536 6461 ts_tablet_manager.cc:1929] T 21bf33904ede470b80a074dc9a458baf P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:24.447675 6461 log.cc:1199] T 21bf33904ede470b80a074dc9a458baf P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/21bf33904ede470b80a074dc9a458baf
I20260923 19:50:24.448015 6461 ts_tablet_manager.cc:1950] T 21bf33904ede470b80a074dc9a458baf P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:24.454908 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 21bf33904ede470b80a074dc9a458baf (table default.Table_9f93fd5514734871bf6a205b82e6e8ef [id=29a9cb5a2b5e41f6a20555efb499eb00]) successfully deleted
W20260923 19:50:24.455610 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 9e20d623668646c688fbd82d2cbc7138 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e20d623668646c688fbd82d2cbc7138 already in progress: creating tablet
W20260923 19:50:24.461004 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet ef0604c2a884465aab7bfe6a1d2d7da6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef0604c2a884465aab7bfe6a1d2d7da6 already in progress: creating tablet
W20260923 19:50:24.461804 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet fb1ea962909b4e42a9c4fab048133077 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb1ea962909b4e42a9c4fab048133077 already in progress: creating tablet
W20260923 19:50:24.462440 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 605093b0f8034a638b3df925ea31de34 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 605093b0f8034a638b3df925ea31de34 already in progress: creating tablet
W20260923 19:50:24.467340 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 37de46eabdd84065975a8e5a3c3758c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 37de46eabdd84065975a8e5a3c3758c4 already in progress: creating tablet
I20260923 19:50:24.425159 6457 ts_tablet_manager.cc:1434] T 373d6442546d41e2b5567dfc92ae07b1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.014s user 0.001s sys 0.000s
I20260923 19:50:24.472843 6457 tablet_bootstrap.cc:492] T 3acf4a03174f45d5aee9c9b1454784f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:24.473716 7884 raft_consensus.cc:493] T 658253ff3d014361803e1aeda978e59a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:24.473917 7884 raft_consensus.cc:515] T 658253ff3d014361803e1aeda978e59a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:24.475907 6457 tablet_bootstrap.cc:654] T 3acf4a03174f45d5aee9c9b1454784f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:24.483779 6454 tablet_bootstrap.cc:492] T c031d99a6f9844c29664236662e8d5f8 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:24.484081 6454 ts_tablet_manager.cc:1403] T c031d99a6f9844c29664236662e8d5f8 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.376s user 0.001s sys 0.015s
I20260923 19:50:24.485621 6457 tablet_bootstrap.cc:492] T 3acf4a03174f45d5aee9c9b1454784f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:24.486917 6457 ts_tablet_manager.cc:1403] T 3acf4a03174f45d5aee9c9b1454784f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.000s
I20260923 19:50:24.489181 6457 raft_consensus.cc:359] T 3acf4a03174f45d5aee9c9b1454784f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.489442 6457 raft_consensus.cc:385] T 3acf4a03174f45d5aee9c9b1454784f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:24.489655 6457 raft_consensus.cc:740] T 3acf4a03174f45d5aee9c9b1454784f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:24.490080 6457 consensus_queue.cc:260] T 3acf4a03174f45d5aee9c9b1454784f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.490914 7884 leader_election.cc:290] T 658253ff3d014361803e1aeda978e59a P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:24.491567 6137 leader_election.cc:343] T 658253ff3d014361803e1aeda978e59a P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 658253ff3d014361803e1aeda978e59a
I20260923 19:50:24.492198 6457 ts_tablet_manager.cc:1434] T 3acf4a03174f45d5aee9c9b1454784f8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260923 19:50:24.494859 6457 tablet_bootstrap.cc:492] T 0f90406b20f54787bd27255d5ae81d1c P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:24.503647 6457 tablet_bootstrap.cc:654] T 0f90406b20f54787bd27255d5ae81d1c P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:24.503628 6459 ts_tablet_manager.cc:1916] T 035abecfbee7474d9dd048f35e28e867 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:24.506601 7256 raft_consensus.cc:493] T 670d9cb0e6e2414092f72ffd5e6b00ea P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:24.506783 7256 raft_consensus.cc:515] T 670d9cb0e6e2414092f72ffd5e6b00ea P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.507511 7256 leader_election.cc:290] T 670d9cb0e6e2414092f72ffd5e6b00ea P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:24.508729 6279 leader_election.cc:343] T 670d9cb0e6e2414092f72ffd5e6b00ea P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 670d9cb0e6e2414092f72ffd5e6b00ea
I20260923 19:50:24.509827 6457 tablet_bootstrap.cc:492] T 0f90406b20f54787bd27255d5ae81d1c P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:24.510473 6457 ts_tablet_manager.cc:1403] T 0f90406b20f54787bd27255d5ae81d1c P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.003s
I20260923 19:50:24.513425 6457 raft_consensus.cc:359] T 0f90406b20f54787bd27255d5ae81d1c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.514613 6457 raft_consensus.cc:385] T 0f90406b20f54787bd27255d5ae81d1c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:24.514837 6457 raft_consensus.cc:740] T 0f90406b20f54787bd27255d5ae81d1c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:24.515210 6457 consensus_queue.cc:260] T 0f90406b20f54787bd27255d5ae81d1c P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.516407 6457 ts_tablet_manager.cc:1434] T 0f90406b20f54787bd27255d5ae81d1c P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260923 19:50:24.519170 6315 tablet_service.cc:1511] Processing CreateTablet for tablet 8019f7e579d246c0b559744a780c40f2 (DEFAULT_TABLE table=default.Table_b6c9ee903c654e5bbda90c1fd2ce6868 [id=aef09d010a564de99fc312836067b640]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.519238 6321 tablet_service.cc:1511] Processing CreateTablet for tablet 4b6aa676a2a54ee5a0d13d875eb03418 (DEFAULT_TABLE table=default.Table_61a67edc9b154897b37cedf4df6485f7 [id=606b76fabc8c42dc9d2c7b0061eee58f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.382313 6307 tablet_service.cc:1511] Processing CreateTablet for tablet 367a8b9a9b2b453e91082a8cc4f5f64c (DEFAULT_TABLE table=default.Table_9d958e2f2c8d46938d212cb93c8884f0 [id=f645b7abebb346779b58b261d7618982]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:24.519603 6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8019f7e579d246c0b559744a780c40f2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:24.519680 7887 log.cc:927] Time spent T 34d62ab3d4aa457f8fea283cd9248a41 P 2bf41435f70447f19992d368ca6b46bd: Append to log took a long time: real 0.163s user 0.000s sys 0.000s
I20260923 19:50:24.522317 6307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 367a8b9a9b2b453e91082a8cc4f5f64c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.528980 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b6aa676a2a54ee5a0d13d875eb03418. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:24.531522 6457 tablet_bootstrap.cc:492] T 37769256de33432697e9d4fb235f473f P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:24.534251 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6da9b3eea4547c9bb80b08bd26c5dc2" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:24.534739 6457 tablet_bootstrap.cc:654] T 37769256de33432697e9d4fb235f473f P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:24.548359 6315 tablet_service.cc:1558] Processing DeleteTablet for tablet 37de46eabdd84065975a8e5a3c3758c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:24 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:24.550401 6457 tablet_bootstrap.cc:492] T 37769256de33432697e9d4fb235f473f P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:24.550637 6457 ts_tablet_manager.cc:1403] T 37769256de33432697e9d4fb235f473f P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.019s user 0.006s sys 0.001s
I20260923 19:50:24.551789 6457 raft_consensus.cc:359] T 37769256de33432697e9d4fb235f473f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:24.552050 6457 raft_consensus.cc:385] T 37769256de33432697e9d4fb235f473f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:24.552163 6457 raft_consensus.cc:740] T 37769256de33432697e9d4fb235f473f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:24.553027 6315 tablet_service.cc:1558] Processing DeleteTablet for tablet 605093b0f8034a638b3df925ea31de34 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:24 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:24.552524 6457 consensus_queue.cc:260] T 37769256de33432697e9d4fb235f473f P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:24.555923 6457 ts_tablet_manager.cc:1434] T 37769256de33432697e9d4fb235f473f P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260923 19:50:24.556352 6457 tablet_bootstrap.cc:492] T 772ece5283a949408d849f6e56f5f17b P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:24.558287 6457 tablet_bootstrap.cc:654] T 772ece5283a949408d849f6e56f5f17b P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:24.570640 5996 leader_election.cc:343] T a6da9b3eea4547c9bb80b08bd26c5dc2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:24.570834 5996 leader_election.cc:304] T a6da9b3eea4547c9bb80b08bd26c5dc2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:24.571163 7877 raft_consensus.cc:2749] T a6da9b3eea4547c9bb80b08bd26c5dc2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:24.573158 6457 tablet_bootstrap.cc:492] T 772ece5283a949408d849f6e56f5f17b P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:24.573396 6457 ts_tablet_manager.cc:1403] T 772ece5283a949408d849f6e56f5f17b P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.000s
I20260923 19:50:24.574296 6457 raft_consensus.cc:359] T 772ece5283a949408d849f6e56f5f17b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.574558 6457 raft_consensus.cc:385] T 772ece5283a949408d849f6e56f5f17b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:24.574638 6457 raft_consensus.cc:740] T 772ece5283a949408d849f6e56f5f17b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:24.574873 6457 consensus_queue.cc:260] T 772ece5283a949408d849f6e56f5f17b P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.575553 6457 ts_tablet_manager.cc:1434] T 772ece5283a949408d849f6e56f5f17b P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:50:24.575847 6457 tablet_bootstrap.cc:492] T 1ea8f44ac03b4ad196725f871a615cdd P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:24.576467 6106 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
I20260923 19:50:24.582015 6457 tablet_bootstrap.cc:654] T 1ea8f44ac03b4ad196725f871a615cdd P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:24.598655 6458 ts_tablet_manager.cc:1929] T e1de117713f34b51bbda0c712f0b837c P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:24.599407 6457 tablet_bootstrap.cc:492] T 1ea8f44ac03b4ad196725f871a615cdd P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:24.599552 6457 ts_tablet_manager.cc:1403] T 1ea8f44ac03b4ad196725f871a615cdd P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.005s
I20260923 19:50:24.600353 6457 raft_consensus.cc:359] T 1ea8f44ac03b4ad196725f871a615cdd P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:24.600529 6457 raft_consensus.cc:385] T 1ea8f44ac03b4ad196725f871a615cdd P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:24.600581 6457 raft_consensus.cc:740] T 1ea8f44ac03b4ad196725f871a615cdd P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:24.600783 6457 consensus_queue.cc:260] T 1ea8f44ac03b4ad196725f871a615cdd P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:24.600996 7884 raft_consensus.cc:493] T 3d74560614b744188e759b981ad89a7d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:24.601117 7884 raft_consensus.cc:515] T 3d74560614b744188e759b981ad89a7d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:24.601289 6457 ts_tablet_manager.cc:1434] T 1ea8f44ac03b4ad196725f871a615cdd P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260923 19:50:24.601569 6457 tablet_bootstrap.cc:492] T 664d849daee54b02b7b7e2bb340d92fa P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:24.614006 6458 log.cc:1199] T e1de117713f34b51bbda0c712f0b837c P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/e1de117713f34b51bbda0c712f0b837c
I20260923 19:50:24.614535 6342 raft_consensus.cc:1275] T 9c4a200d16464676976694656cbe28e2 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Refusing update from remote peer e546f660e7e541d1aa9ae38e5ee5b9c0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:50:24.615051 6458 ts_tablet_manager.cc:1950] T e1de117713f34b51bbda0c712f0b837c P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:24.615296 7877 consensus_queue.cc:1048] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:24.616125 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet e1de117713f34b51bbda0c712f0b837c (table default.Table_9d716833c456436cbc514b6a9070c9e1 [id=e3fafc4359af49c88437fb5815526518]) successfully deleted
W20260923 19:50:24.616818 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 9e20d623668646c688fbd82d2cbc7138 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e20d623668646c688fbd82d2cbc7138 already in progress: creating tablet
W20260923 19:50:24.617506 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet a820bf5854324639b98c984ac583a4d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a820bf5854324639b98c984ac583a4d7 already in progress: creating tablet
I20260923 19:50:24.617820 6458 tablet_replica.cc:333] T 86388fa08c454da9ad2ca0124dcba10b P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:24.618170 6458 raft_consensus.cc:2243] T 86388fa08c454da9ad2ca0124dcba10b P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:24.618177 7877 raft_consensus.cc:493] T 373d6442546d41e2b5567dfc92ae07b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:24.618315 7877 raft_consensus.cc:515] T 373d6442546d41e2b5567dfc92ae07b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.618611 6391 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
I20260923 19:50:24.618729 6458 raft_consensus.cc:2272] T 86388fa08c454da9ad2ca0124dcba10b P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:24.618975 7877 leader_election.cc:290] T 373d6442546d41e2b5567dfc92ae07b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:24.619346 6458 ts_tablet_manager.cc:1916] T 86388fa08c454da9ad2ca0124dcba10b P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:24.607008 6456 tablet_bootstrap.cc:492] T 64e8951eb899461aa9c0b36e3f7555e2 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:24.606690 7900 tablet.cc:1751] T 34d62ab3d4aa457f8fea283cd9248a41 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:24.619576 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373d6442546d41e2b5567dfc92ae07b1" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:24.621582 5996 leader_election.cc:343] T 373d6442546d41e2b5567dfc92ae07b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:24.619592 6456 ts_tablet_manager.cc:1403] T 64e8951eb899461aa9c0b36e3f7555e2 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.505s user 0.005s sys 0.012s
I20260923 19:50:24.626174 7905 tablet.cc:1751] T 34d62ab3d4aa457f8fea283cd9248a41 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:24.627249 6456 raft_consensus.cc:359] T 64e8951eb899461aa9c0b36e3f7555e2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.627470 6456 raft_consensus.cc:385] T 64e8951eb899461aa9c0b36e3f7555e2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:24.627588 6456 raft_consensus.cc:740] T 64e8951eb899461aa9c0b36e3f7555e2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:24.628039 6456 consensus_queue.cc:260] T 64e8951eb899461aa9c0b36e3f7555e2 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.628623 6456 ts_tablet_manager.cc:1434] T 64e8951eb899461aa9c0b36e3f7555e2 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:24.628973 6456 tablet_bootstrap.cc:492] T 0e650824e4ae474787faeb6c22a4b43f P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:24.630944 6456 tablet_bootstrap.cc:654] T 0e650824e4ae474787faeb6c22a4b43f P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:24.632241 5800 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet efa34bd3921b4971a01945b248e20b94
I20260923 19:50:24.637053 5804 catalog_manager.cc:5838] T f1c1d4f73488499a9e5add81e9d5e2d6 P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } }
I20260923 19:50:24.637483 5804 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet f1c1d4f73488499a9e5add81e9d5e2d6 (table default.Table_7f7907c8e1bc4ad1ae68faf5f072b318 [id=80e3a84f7199464fa96426daeeeb84cd]). Expected version 2 got 0
I20260923 19:50:24.640985 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_7acfabb21b234e30a1c4899081c86edc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:24.641559 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7acfabb21b234e30a1c4899081c86edc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:24.641911 6137 leader_election.cc:343] T 3d74560614b744188e759b981ad89a7d P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 3d74560614b744188e759b981ad89a7d
W20260923 19:50:24.643247 6139 leader_election.cc:343] T 658253ff3d014361803e1aeda978e59a P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 658253ff3d014361803e1aeda978e59a
I20260923 19:50:24.643371 6139 leader_election.cc:304] T 658253ff3d014361803e1aeda978e59a P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:24.644573 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 524c11f83bc34c5fafd6c33d119ee926
I20260923 19:50:24.645339 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7ef4fde492124fa28e7089765bab36d9" } new_table_name: "default.Table_53fa57a9229749ea88b0f747259812a5" modify_external_catalogs: true
I20260923 19:50:24.645665 7700 raft_consensus.cc:493] T 1b1d9413e1e24547b491a160d851377b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:24.645810 7700 raft_consensus.cc:515] T 1b1d9413e1e24547b491a160d851377b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:24.646440 7700 leader_election.cc:290] T 1b1d9413e1e24547b491a160d851377b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:24.646598 7700 raft_consensus.cc:2749] T 658253ff3d014361803e1aeda978e59a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:24.646746 7884 leader_election.cc:290] T 3d74560614b744188e759b981ad89a7d P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:24.649744 6137 leader_election.cc:343] T 1b1d9413e1e24547b491a160d851377b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 1b1d9413e1e24547b491a160d851377b
I20260923 19:50:24.656116 6454 raft_consensus.cc:359] T c031d99a6f9844c29664236662e8d5f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:24.656277 6454 raft_consensus.cc:385] T c031d99a6f9844c29664236662e8d5f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:24.656328 6454 raft_consensus.cc:740] T c031d99a6f9844c29664236662e8d5f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:24.658816 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet 524c11f83bc34c5fafd6c33d119ee926 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:24 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:24.661664 6454 consensus_queue.cc:260] T c031d99a6f9844c29664236662e8d5f8 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:24.663024 6035 tablet_service.cc:1558] Processing DeleteTablet for tablet 524c11f83bc34c5fafd6c33d119ee926 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:24 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:24.663024 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 559f3e3016aa470f9732a727b4528586 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:24.663904 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 524c11f83bc34c5fafd6c33d119ee926 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 524c11f83bc34c5fafd6c33d119ee926 already in progress: creating tablet
I20260923 19:50:24.669160 6461 tablet_replica.cc:333] T 559f3e3016aa470f9732a727b4528586 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:24.669374 6461 raft_consensus.cc:2243] T 559f3e3016aa470f9732a727b4528586 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:24.669524 6461 raft_consensus.cc:2272] T 559f3e3016aa470f9732a727b4528586 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:24.670262 6461 ts_tablet_manager.cc:1916] T 559f3e3016aa470f9732a727b4528586 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:24.674934 6454 ts_tablet_manager.cc:1434] T c031d99a6f9844c29664236662e8d5f8 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.191s user 0.001s sys 0.001s
I20260923 19:50:24.676528 6461 ts_tablet_manager.cc:1929] T 559f3e3016aa470f9732a727b4528586 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:24.676642 6461 log.cc:1199] T 559f3e3016aa470f9732a727b4528586 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/559f3e3016aa470f9732a727b4528586
I20260923 19:50:24.676904 6461 ts_tablet_manager.cc:1950] T 559f3e3016aa470f9732a727b4528586 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:24.678325 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 559f3e3016aa470f9732a727b4528586 (table default.Table_d7d1452530dc40018f8d5568a97f273b [id=7ceb51c74b464ca4a1c59cdac4d65f2a]) successfully deleted
I20260923 19:50:24.688897 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "670d9cb0e6e2414092f72ffd5e6b00ea" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:24.708468 7877 raft_consensus.cc:493] T 37769256de33432697e9d4fb235f473f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:24.708653 7877 raft_consensus.cc:515] T 37769256de33432697e9d4fb235f473f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:24.709328 7877 leader_election.cc:290] T 37769256de33432697e9d4fb235f473f P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:24.709899 6457 tablet_bootstrap.cc:654] T 664d849daee54b02b7b7e2bb340d92fa P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:24.727245 6457 tablet_bootstrap.cc:492] T 664d849daee54b02b7b7e2bb340d92fa P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:24.727609 6457 ts_tablet_manager.cc:1403] T 664d849daee54b02b7b7e2bb340d92fa P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.126s user 0.031s sys 0.004s
I20260923 19:50:24.728762 6457 raft_consensus.cc:359] T 664d849daee54b02b7b7e2bb340d92fa P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:24.729140 6457 raft_consensus.cc:385] T 664d849daee54b02b7b7e2bb340d92fa P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:24.729290 6457 raft_consensus.cc:740] T 664d849daee54b02b7b7e2bb340d92fa P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:24.729725 6457 consensus_queue.cc:260] T 664d849daee54b02b7b7e2bb340d92fa P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:24.742576 6457 ts_tablet_manager.cc:1434] T 664d849daee54b02b7b7e2bb340d92fa P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260923 19:50:24.745862 6454 tablet_bootstrap.cc:492] T dbe06eba8067413a903e4a07c2768484 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:24.752280 6457 tablet_bootstrap.cc:492] T a83726da349c4cd1852e956c8fa2cda5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:24.754247 6457 tablet_bootstrap.cc:654] T a83726da349c4cd1852e956c8fa2cda5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:24.760038 6457 tablet_bootstrap.cc:492] T a83726da349c4cd1852e956c8fa2cda5 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:24.760269 6457 ts_tablet_manager.cc:1403] T a83726da349c4cd1852e956c8fa2cda5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.002s
I20260923 19:50:24.761073 6457 raft_consensus.cc:359] T a83726da349c4cd1852e956c8fa2cda5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:24.761339 6457 raft_consensus.cc:385] T a83726da349c4cd1852e956c8fa2cda5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:24.761443 6457 raft_consensus.cc:740] T a83726da349c4cd1852e956c8fa2cda5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:24.761751 6457 consensus_queue.cc:260] T a83726da349c4cd1852e956c8fa2cda5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:24.765722 7499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae: Bootstrap replayed 1/1 log segments. Stats: ops{read=525 overwritten=0 applied=525 ignored=0} inserts{seen=501 ignored=0} mutations{seen=593 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 19:50:24.766498 7499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae: Bootstrap complete.
I20260923 19:50:24.767678 6457 ts_tablet_manager.cc:1434] T a83726da349c4cd1852e956c8fa2cda5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260923 19:50:24.770723 6454 tablet_bootstrap.cc:654] T dbe06eba8067413a903e4a07c2768484 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:24.773232 6457 tablet_bootstrap.cc:492] T 195d4fe5f92e4e2c9330dce34c303723 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:24.775826 6457 tablet_bootstrap.cc:654] T 195d4fe5f92e4e2c9330dce34c303723 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:24.775166 7499 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } }
I20260923 19:50:24.776360 7499 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3d628214a34b4fa3ca0c1abe422bae, State: Initialized, Role: FOLLOWER
I20260923 19:50:24.777453 7499 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 525, Last appended: 3.525, Last appended by leader: 525, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } }
W20260923 19:50:24.778967 6139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.195:32855, user_credentials={real_user=slave}} blocked reactor thread for 226385us
I20260923 19:50:24.781850 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373d6442546d41e2b5567dfc92ae07b1" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:24.782663 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37769256de33432697e9d4fb235f473f" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:24.783466 5995 consensus_peers.cc:597] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260923 19:50:24.783466 6139 leader_election.cc:343] T 3d74560614b744188e759b981ad89a7d P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 3d74560614b744188e759b981ad89a7d
I20260923 19:50:24.783604 6139 leader_election.cc:304] T 3d74560614b744188e759b981ad89a7d P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:24.783650 5995 leader_election.cc:343] T 373d6442546d41e2b5567dfc92ae07b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:24.783763 5995 leader_election.cc:304] T 373d6442546d41e2b5567dfc92ae07b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:24.784319 7884 raft_consensus.cc:2749] T 3d74560614b744188e759b981ad89a7d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:24.784302 5995 leader_election.cc:343] T 37769256de33432697e9d4fb235f473f P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:24.784899 7877 raft_consensus.cc:2749] T 373d6442546d41e2b5567dfc92ae07b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:24.785640 6139 leader_election.cc:343] T 1b1d9413e1e24547b491a160d851377b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 1b1d9413e1e24547b491a160d851377b
I20260923 19:50:24.785852 6139 leader_election.cc:304] T 1b1d9413e1e24547b491a160d851377b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:24.790179 7700 raft_consensus.cc:2749] T 1b1d9413e1e24547b491a160d851377b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:24.792336 7911 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } } }
I20260923 19:50:24.792814 7911 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:50:24.793675 7499 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [sys.catalog]: configured and running, proceeding with master startup.
I20260923 19:50:24.795156 6457 tablet_bootstrap.cc:492] T 195d4fe5f92e4e2c9330dce34c303723 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:24.795300 6457 ts_tablet_manager.cc:1403] T 195d4fe5f92e4e2c9330dce34c303723 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.004s
I20260923 19:50:24.796047 6457 raft_consensus.cc:359] T 195d4fe5f92e4e2c9330dce34c303723 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:24.796203 6457 raft_consensus.cc:385] T 195d4fe5f92e4e2c9330dce34c303723 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:24.796252 6457 raft_consensus.cc:740] T 195d4fe5f92e4e2c9330dce34c303723 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:24.796751 6457 consensus_queue.cc:260] T 195d4fe5f92e4e2c9330dce34c303723 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:24.797793 6457 ts_tablet_manager.cc:1434] T 195d4fe5f92e4e2c9330dce34c303723 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:24.800132 6457 tablet_bootstrap.cc:492] T 89b950342b66486fa6ec0cdf03ad4881 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:24.804320 6457 tablet_bootstrap.cc:654] T 89b950342b66486fa6ec0cdf03ad4881 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:24.809216 7700 raft_consensus.cc:493] T 7af330ae1aaa48209f2bd1880bcfebb1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:24.809367 7700 raft_consensus.cc:515] T 7af330ae1aaa48209f2bd1880bcfebb1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:24.810024 7700 leader_election.cc:290] T 7af330ae1aaa48209f2bd1880bcfebb1 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:24.810983 6137 leader_election.cc:343] T 7af330ae1aaa48209f2bd1880bcfebb1 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 7af330ae1aaa48209f2bd1880bcfebb1
I20260923 19:50:24.814648 7700 raft_consensus.cc:493] T c031d99a6f9844c29664236662e8d5f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:24.814839 7700 raft_consensus.cc:515] T c031d99a6f9844c29664236662e8d5f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:24.815637 7700 leader_election.cc:290] T c031d99a6f9844c29664236662e8d5f8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:24.816731 6137 leader_election.cc:343] T c031d99a6f9844c29664236662e8d5f8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: c031d99a6f9844c29664236662e8d5f8
I20260923 19:50:24.822728 6454 tablet_bootstrap.cc:492] T dbe06eba8067413a903e4a07c2768484 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:24.823093 6454 ts_tablet_manager.cc:1403] T dbe06eba8067413a903e4a07c2768484 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.077s user 0.003s sys 0.000s
I20260923 19:50:24.824090 6454 raft_consensus.cc:359] T dbe06eba8067413a903e4a07c2768484 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:24.824321 6454 raft_consensus.cc:385] T dbe06eba8067413a903e4a07c2768484 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:24.824384 6454 raft_consensus.cc:740] T dbe06eba8067413a903e4a07c2768484 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:24.824746 6454 consensus_queue.cc:260] T dbe06eba8067413a903e4a07c2768484 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:24.826344 6454 ts_tablet_manager.cc:1434] T dbe06eba8067413a903e4a07c2768484 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260923 19:50:24.840536 6459 ts_tablet_manager.cc:1929] T 035abecfbee7474d9dd048f35e28e867 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:24.840848 6459 log.cc:1199] T 035abecfbee7474d9dd048f35e28e867 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/035abecfbee7474d9dd048f35e28e867
W20260923 19:50:24.847998 6139 leader_election.cc:343] T 7af330ae1aaa48209f2bd1880bcfebb1 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 7af330ae1aaa48209f2bd1880bcfebb1
I20260923 19:50:24.848312 6139 leader_election.cc:304] T 7af330ae1aaa48209f2bd1880bcfebb1 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:24.848937 6139 leader_election.cc:343] T c031d99a6f9844c29664236662e8d5f8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: c031d99a6f9844c29664236662e8d5f8
I20260923 19:50:24.849339 6139 leader_election.cc:304] T c031d99a6f9844c29664236662e8d5f8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:24.849689 7700 raft_consensus.cc:2749] T 7af330ae1aaa48209f2bd1880bcfebb1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:24.849920 7700 raft_consensus.cc:2749] T c031d99a6f9844c29664236662e8d5f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:24.660344 6321 tablet_service.cc:1558] Processing DeleteTablet for tablet 524c11f83bc34c5fafd6c33d119ee926 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:24 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:24.690824 6280 leader_election.cc:343] T 670d9cb0e6e2414092f72ffd5e6b00ea P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:24.842329 7902 raft_consensus.cc:493] T 64e8951eb899461aa9c0b36e3f7555e2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:24.851706 6280 leader_election.cc:304] T 670d9cb0e6e2414092f72ffd5e6b00ea P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:24.851788 7902 raft_consensus.cc:515] T 64e8951eb899461aa9c0b36e3f7555e2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
W20260923 19:50:24.852097 6280 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 161275us
I20260923 19:50:24.852571 7902 leader_election.cc:290] T 64e8951eb899461aa9c0b36e3f7555e2 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:24.852686 7902 raft_consensus.cc:2749] T 670d9cb0e6e2414092f72ffd5e6b00ea P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:24.842447 7256 consensus_queue.cc:1048] T f1f1df47dc32413d9cc9456f4198dca5 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:24.853711 7905 tablet.cc:1751] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:24.855408 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e8951eb899461aa9c0b36e3f7555e2" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:24.856632 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37769256de33432697e9d4fb235f473f" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:24.857477 5996 leader_election.cc:343] T 37769256de33432697e9d4fb235f473f P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:24.857569 6280 consensus_peers.cc:597] T f1f1df47dc32413d9cc9456f4198dca5 P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:24.857592 5996 leader_election.cc:304] T 37769256de33432697e9d4fb235f473f P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
W20260923 19:50:24.857753 6280 leader_election.cc:343] T 64e8951eb899461aa9c0b36e3f7555e2 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:24.857987 7816 raft_consensus.cc:2749] T 37769256de33432697e9d4fb235f473f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:24.858709 6279 leader_election.cc:343] T 64e8951eb899461aa9c0b36e3f7555e2 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 64e8951eb899461aa9c0b36e3f7555e2
I20260923 19:50:24.858815 6279 leader_election.cc:304] T 64e8951eb899461aa9c0b36e3f7555e2 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:24.859395 7890 raft_consensus.cc:2749] T 64e8951eb899461aa9c0b36e3f7555e2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:24.860675 6106 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
I20260923 19:50:24.874625 6454 tablet_bootstrap.cc:492] T 34d62ab3d4aa457f8fea283cd9248a41 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:24.876631 7900 tablet.cc:1751] T 9c4a200d16464676976694656cbe28e2 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:24.883054 6456 tablet_bootstrap.cc:492] T 0e650824e4ae474787faeb6c22a4b43f P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:24.883324 6456 ts_tablet_manager.cc:1403] T 0e650824e4ae474787faeb6c22a4b43f P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.254s user 0.002s sys 0.002s
I20260923 19:50:24.884178 6456 raft_consensus.cc:359] T 0e650824e4ae474787faeb6c22a4b43f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.884341 6456 raft_consensus.cc:385] T 0e650824e4ae474787faeb6c22a4b43f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:24.884397 6456 raft_consensus.cc:740] T 0e650824e4ae474787faeb6c22a4b43f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:24.884614 6456 consensus_queue.cc:260] T 0e650824e4ae474787faeb6c22a4b43f P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.885092 6456 ts_tablet_manager.cc:1434] T 0e650824e4ae474787faeb6c22a4b43f P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:50:24.885735 7890 raft_consensus.cc:493] T 0e650824e4ae474787faeb6c22a4b43f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:24.885836 7890 raft_consensus.cc:515] T 0e650824e4ae474787faeb6c22a4b43f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.886444 7890 leader_election.cc:290] T 0e650824e4ae474787faeb6c22a4b43f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:24.887014 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e650824e4ae474787faeb6c22a4b43f" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:24.887181 6060 raft_consensus.cc:2468] T 0e650824e4ae474787faeb6c22a4b43f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:24.887883 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e650824e4ae474787faeb6c22a4b43f" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:24.888592 6279 leader_election.cc:304] T 0e650824e4ae474787faeb6c22a4b43f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
W20260923 19:50:24.888895 6280 leader_election.cc:343] T 0e650824e4ae474787faeb6c22a4b43f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:24.889626 7890 raft_consensus.cc:2804] T 0e650824e4ae474787faeb6c22a4b43f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:24.889700 7890 raft_consensus.cc:493] T 0e650824e4ae474787faeb6c22a4b43f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:24.889755 7890 raft_consensus.cc:3060] T 0e650824e4ae474787faeb6c22a4b43f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:24.892647 7890 raft_consensus.cc:515] T 0e650824e4ae474787faeb6c22a4b43f P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.893781 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e650824e4ae474787faeb6c22a4b43f" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
W20260923 19:50:24.894366 6280 leader_election.cc:343] T 0e650824e4ae474787faeb6c22a4b43f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:24.895138 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e650824e4ae474787faeb6c22a4b43f" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:24.895305 6060 raft_consensus.cc:3060] T 0e650824e4ae474787faeb6c22a4b43f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:24.901846 6060 raft_consensus.cc:2468] T 0e650824e4ae474787faeb6c22a4b43f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:24.902338 6279 leader_election.cc:304] T 0e650824e4ae474787faeb6c22a4b43f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:24.902591 7902 raft_consensus.cc:2804] T 0e650824e4ae474787faeb6c22a4b43f P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:24.902686 7902 raft_consensus.cc:697] T 0e650824e4ae474787faeb6c22a4b43f P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:24.902906 7902 consensus_queue.cc:237] T 0e650824e4ae474787faeb6c22a4b43f P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.905903 7890 leader_election.cc:290] T 0e650824e4ae474787faeb6c22a4b43f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:24.909803 7902 consensus_queue.cc:1048] T d35ff653bf8d41cfbcf83359402a8f6a P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:24.912062 7890 raft_consensus.cc:493] T 397ec5e49673406cb26a2efab0ad8401 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:24.912223 7890 raft_consensus.cc:515] T 397ec5e49673406cb26a2efab0ad8401 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.913195 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec5e49673406cb26a2efab0ad8401" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:24.913715 6280 leader_election.cc:343] T 397ec5e49673406cb26a2efab0ad8401 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:24.914574 7890 leader_election.cc:290] T 397ec5e49673406cb26a2efab0ad8401 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:24.914640 6056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec5e49673406cb26a2efab0ad8401" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:24.914803 6056 raft_consensus.cc:2468] T 397ec5e49673406cb26a2efab0ad8401 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:24.915695 6279 leader_election.cc:304] T 397ec5e49673406cb26a2efab0ad8401 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:24.916014 7902 raft_consensus.cc:2804] T 397ec5e49673406cb26a2efab0ad8401 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:24.916095 7902 raft_consensus.cc:493] T 397ec5e49673406cb26a2efab0ad8401 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:24.916162 7902 raft_consensus.cc:3060] T 397ec5e49673406cb26a2efab0ad8401 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:24.919166 7902 raft_consensus.cc:515] T 397ec5e49673406cb26a2efab0ad8401 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.919797 6458 ts_tablet_manager.cc:1929] T 86388fa08c454da9ad2ca0124dcba10b P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:24.919888 6458 log.cc:1199] T 86388fa08c454da9ad2ca0124dcba10b P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/86388fa08c454da9ad2ca0124dcba10b
I20260923 19:50:24.920281 6458 ts_tablet_manager.cc:1950] T 86388fa08c454da9ad2ca0124dcba10b P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:24.920631 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec5e49673406cb26a2efab0ad8401" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
W20260923 19:50:24.921211 6280 leader_election.cc:343] T 397ec5e49673406cb26a2efab0ad8401 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:24.924248 6280 consensus_peers.cc:597] T d35ff653bf8d41cfbcf83359402a8f6a P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:24.925457 7902 leader_election.cc:290] T 397ec5e49673406cb26a2efab0ad8401 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:24.925963 6056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec5e49673406cb26a2efab0ad8401" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:24.926124 6056 raft_consensus.cc:3060] T 397ec5e49673406cb26a2efab0ad8401 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:24.929316 6056 raft_consensus.cc:2468] T 397ec5e49673406cb26a2efab0ad8401 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:24.929781 6279 leader_election.cc:304] T 397ec5e49673406cb26a2efab0ad8401 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:24.930248 7890 raft_consensus.cc:2804] T 397ec5e49673406cb26a2efab0ad8401 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:24.930411 7890 raft_consensus.cc:697] T 397ec5e49673406cb26a2efab0ad8401 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:24.930757 7890 consensus_queue.cc:237] T 397ec5e49673406cb26a2efab0ad8401 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.932834 6457 tablet_bootstrap.cc:492] T 89b950342b66486fa6ec0cdf03ad4881 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
W20260923 19:50:24.935710 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e6baf2c29bf949fcbc1a4948da3e6575 consensus state has no leader
I20260923 19:50:24.936416 6456 tablet_bootstrap.cc:492] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:24.938287 6456 tablet_bootstrap.cc:654] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:24.936199 7816 raft_consensus.cc:493] T 772ece5283a949408d849f6e56f5f17b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:24.939625 7816 raft_consensus.cc:515] T 772ece5283a949408d849f6e56f5f17b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.940546 7816 leader_election.cc:290] T 772ece5283a949408d849f6e56f5f17b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:24.940855 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772ece5283a949408d849f6e56f5f17b" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:24.941375 5995 leader_election.cc:343] T 772ece5283a949408d849f6e56f5f17b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:24.941702 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_b2e5975cbc3e4d9fba8a7ee0743ed5ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:24.942234 7900 tablet.cc:1751] T 1c43641327d14a888a2815e49a2762c8 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260923 19:50:24.942344 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2e5975cbc3e4d9fba8a7ee0743ed5ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:24.944389 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_fd23b34609244c098737c8f88587ce5f" } new_table_name: "default.Table_6644fbc286ee4d75bb3a39ed265dfea1" modify_external_catalogs: true
I20260923 19:50:24.946374 7905 tablet.cc:1751] T 1c43641327d14a888a2815e49a2762c8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:24.948664 5797 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_16bf237e106f4eb1b2b1ddc2fab7cda8" } new_table_name: "default.Table_71bc8c1e8c3a49888b937afd57ba8087" modify_external_catalogs: true
I20260923 19:50:24.950112 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_dee6df557cd543ed83b05c9909e560ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:24.950729 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dee6df557cd543ed83b05c9909e560ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:24.952157 7877 raft_consensus.cc:493] T 664d849daee54b02b7b7e2bb340d92fa P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:24.952283 7877 raft_consensus.cc:515] T 664d849daee54b02b7b7e2bb340d92fa P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:24.952939 7877 leader_election.cc:290] T 664d849daee54b02b7b7e2bb340d92fa P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:24.958206 6459 ts_tablet_manager.cc:1950] T 035abecfbee7474d9dd048f35e28e867 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:24.958539 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 957) took 3360 ms. Trace:
I20260923 19:50:24.958608 6459 rpcz_store.cc:276] 0923 19:50:21.597757 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.597829 (+ 72us) service_pool.cc:224] Handling call
0923 19:50:24.370890 (+2773061us) ts_tablet_manager.cc:1151] Deleting tablet 035abecfbee7474d9dd048f35e28e867
0923 19:50:24.370900 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:24.713750 (+342850us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:24.840220 (+126470us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:24.958525 (+118305us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2755879}
I20260923 19:50:24.958930 6459 tablet_replica.cc:333] T b7ba284e81bc4388bbd6456a41d1f9f4 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:24.959147 6459 raft_consensus.cc:2243] T b7ba284e81bc4388bbd6456a41d1f9f4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:24.959283 6459 raft_consensus.cc:2272] T b7ba284e81bc4388bbd6456a41d1f9f4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:24.959384 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 035abecfbee7474d9dd048f35e28e867 (table default.Table_5a1ffa59de984ef3adb370cdf1142f24 [id=d2e859af377f491dbc81f6f3d4111640]) successfully deleted
I20260923 19:50:24.962832 6459 ts_tablet_manager.cc:1916] T b7ba284e81bc4388bbd6456a41d1f9f4 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:24.963083 6454 tablet_bootstrap.cc:654] T 34d62ab3d4aa457f8fea283cd9248a41 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:24.963505 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772ece5283a949408d849f6e56f5f17b" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:24.964283 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664d849daee54b02b7b7e2bb340d92fa" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:24.964387 5996 leader_election.cc:343] T 772ece5283a949408d849f6e56f5f17b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:24.964581 5996 leader_election.cc:304] T 772ece5283a949408d849f6e56f5f17b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:24.965569 7877 raft_consensus.cc:2749] T 772ece5283a949408d849f6e56f5f17b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:24.965907 5996 leader_election.cc:343] T 664d849daee54b02b7b7e2bb340d92fa P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:24.970036 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664d849daee54b02b7b7e2bb340d92fa" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:24.970494 5995 leader_election.cc:343] T 664d849daee54b02b7b7e2bb340d92fa P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:24.970686 5995 leader_election.cc:304] T 664d849daee54b02b7b7e2bb340d92fa P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:24.970974 7877 raft_consensus.cc:2749] T 664d849daee54b02b7b7e2bb340d92fa P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:24.970572 6456 tablet_bootstrap.cc:492] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:24.974375 6456 ts_tablet_manager.cc:1403] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.038s user 0.004s sys 0.000s
I20260923 19:50:24.976176 6457 ts_tablet_manager.cc:1403] T 89b950342b66486fa6ec0cdf03ad4881 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.176s user 0.009s sys 0.017s
I20260923 19:50:24.979394 6456 raft_consensus.cc:359] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.980068 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 86388fa08c454da9ad2ca0124dcba10b (table default.Table_4803d401dac84700919d6879b552cd8d [id=2973ea17373f4ec181b54ab66028a774]) successfully deleted
W20260923 19:50:24.980922 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet a83726da349c4cd1852e956c8fa2cda5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a83726da349c4cd1852e956c8fa2cda5 already in progress: creating tablet
W20260923 19:50:24.982378 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 7bd0ccf56ee9498f9fa42c5a03a931b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7bd0ccf56ee9498f9fa42c5a03a931b6 already in progress: creating tablet
I20260923 19:50:24.983897 6459 ts_tablet_manager.cc:1929] T b7ba284e81bc4388bbd6456a41d1f9f4 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:24.981757 6457 raft_consensus.cc:359] T 89b950342b66486fa6ec0cdf03ad4881 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:24.984720 6457 raft_consensus.cc:385] T 89b950342b66486fa6ec0cdf03ad4881 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:24.984890 6459 log.cc:1199] T b7ba284e81bc4388bbd6456a41d1f9f4 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/b7ba284e81bc4388bbd6456a41d1f9f4
I20260923 19:50:24.985472 6459 ts_tablet_manager.cc:1950] T b7ba284e81bc4388bbd6456a41d1f9f4 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:24.985483 6457 raft_consensus.cc:740] T 89b950342b66486fa6ec0cdf03ad4881 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:24.986178 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 958) took 3388 ms. Trace:
I20260923 19:50:24.986691 6459 rpcz_store.cc:276] 0923 19:50:21.598207 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.598254 (+ 47us) service_pool.cc:224] Handling call
0923 19:50:24.958883 (+3360629us) ts_tablet_manager.cc:1151] Deleting tablet b7ba284e81bc4388bbd6456a41d1f9f4
0923 19:50:24.958894 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:24.977574 (+ 18680us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:24.983841 (+ 6267us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:24.986161 (+ 2320us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3343875}
I20260923 19:50:24.986909 6457 consensus_queue.cc:260] T 89b950342b66486fa6ec0cdf03ad4881 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:24.987443 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet b7ba284e81bc4388bbd6456a41d1f9f4 (table default.Table_91a9675177604eb39c32e86718c59d31 [id=bf85ae2ea4884de58391fc9e7b140b7f]) successfully deleted
I20260923 19:50:24.987816 6459 tablet_replica.cc:333] T 6d29923f139445cc86379c80ac15df5d P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:24.988207 6459 raft_consensus.cc:2243] T 6d29923f139445cc86379c80ac15df5d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:24.988770 6459 raft_consensus.cc:2272] T 6d29923f139445cc86379c80ac15df5d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:24.989545 6459 ts_tablet_manager.cc:1916] T 6d29923f139445cc86379c80ac15df5d P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:24.990636 6454 tablet_bootstrap.cc:492] T 34d62ab3d4aa457f8fea283cd9248a41 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:24.990846 6454 ts_tablet_manager.cc:1403] T 34d62ab3d4aa457f8fea283cd9248a41 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.116s user 0.001s sys 0.006s
I20260923 19:50:24.991434 6454 raft_consensus.cc:359] T 34d62ab3d4aa457f8fea283cd9248a41 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:24.991655 6454 raft_consensus.cc:385] T 34d62ab3d4aa457f8fea283cd9248a41 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:24.991739 6454 raft_consensus.cc:740] T 34d62ab3d4aa457f8fea283cd9248a41 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:24.991977 6454 consensus_queue.cc:260] T 34d62ab3d4aa457f8fea283cd9248a41 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:24.992777 6454 ts_tablet_manager.cc:1434] T 34d62ab3d4aa457f8fea283cd9248a41 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260923 19:50:24.993117 6454 tablet_bootstrap.cc:492] T fc151f4d78344efeada6d6e57af6eb9f P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:24.994556 6454 tablet_bootstrap.cc:654] T fc151f4d78344efeada6d6e57af6eb9f P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:24.994892 6456 raft_consensus.cc:385] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:24.997848 6456 raft_consensus.cc:740] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:24.998343 6456 consensus_queue.cc:260] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:24.988482 6458 tablet_replica.cc:333] T 670d9cb0e6e2414092f72ffd5e6b00ea P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:25.001974 6458 raft_consensus.cc:2243] T 670d9cb0e6e2414092f72ffd5e6b00ea P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:25.002483 6458 raft_consensus.cc:2272] T 670d9cb0e6e2414092f72ffd5e6b00ea P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:25.003099 6458 ts_tablet_manager.cc:1916] T 670d9cb0e6e2414092f72ffd5e6b00ea P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:25.003160 6457 ts_tablet_manager.cc:1434] T 89b950342b66486fa6ec0cdf03ad4881 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
I20260923 19:50:25.006382 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet c031d99a6f9844c29664236662e8d5f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:25.006397 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_c2e466fad3084816b9e54b62b4c465d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:25.006857 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2e466fad3084816b9e54b62b4c465d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:25.009086 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet dbe06eba8067413a903e4a07c2768484 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:25.010200 6456 ts_tablet_manager.cc:1434] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.031s user 0.000s sys 0.002s
I20260923 19:50:25.010629 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 367a8b9a9b2b453e91082a8cc4f5f64c
W20260923 19:50:25.011405 5803 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f6a489aba98940fd888b9cc79a3a0b68 consensus state has no leader
I20260923 19:50:25.012513 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet 367a8b9a9b2b453e91082a8cc4f5f64c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:24 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:25.014045 6459 ts_tablet_manager.cc:1929] T 6d29923f139445cc86379c80ac15df5d P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:25.014580 6459 log.cc:1199] T 6d29923f139445cc86379c80ac15df5d P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/6d29923f139445cc86379c80ac15df5d
I20260923 19:50:25.014681 6321 tablet_service.cc:1558] Processing DeleteTablet for tablet 367a8b9a9b2b453e91082a8cc4f5f64c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:24 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:25.015007 6459 ts_tablet_manager.cc:1950] T 6d29923f139445cc86379c80ac15df5d P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:25.015740 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 959) took 3368 ms. Trace:
I20260923 19:50:25.016175 6459 rpcz_store.cc:276] 0923 19:50:21.647618 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.647900 (+ 282us) service_pool.cc:224] Handling call
0923 19:50:24.987772 (+3339872us) ts_tablet_manager.cc:1151] Deleting tablet 6d29923f139445cc86379c80ac15df5d
0923 19:50:24.987781 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.000177 (+ 12396us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:25.013994 (+ 13817us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:25.015726 (+ 1732us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3320681}
I20260923 19:50:25.016850 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 6d29923f139445cc86379c80ac15df5d (table default.Table_0bf993fb53a243408934c3ce7812f300 [id=1dc5c4b9cfe242b099053cbb53aac5ce]) successfully deleted
I20260923 19:50:25.017024 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 960) took 3281 ms. Trace:
I20260923 19:50:25.017103 6459 rpcz_store.cc:276] 0923 19:50:21.735359 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.735425 (+ 66us) service_pool.cc:224] Handling call
0923 19:50:25.016908 (+3281483us) ts_tablet_manager.cc:1151] Deleting tablet 5c9768e71e0640ceb110a19e53484044
0923 19:50:25.016918 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.017008 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3281308}
W20260923 19:50:25.017441 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 5c9768e71e0640ceb110a19e53484044 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c9768e71e0640ceb110a19e53484044 already in progress: creating tablet
I20260923 19:50:25.018002 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 961) took 3281 ms. Trace:
I20260923 19:50:25.018077 6459 rpcz_store.cc:276] 0923 19:50:21.736377 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.736432 (+ 55us) service_pool.cc:224] Handling call
0923 19:50:25.017912 (+3281480us) ts_tablet_manager.cc:1151] Deleting tablet 96577a68f4984c90b82cf4d32e701476
0923 19:50:25.017920 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.017989 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3281338}
I20260923 19:50:25.018679 5800 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f4be4141550e453789b0f2db9e3b41f5" } modify_external_catalogs: true
I20260923 19:50:25.018831 5800 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f4be4141550e453789b0f2db9e3b41f5" } modify_external_catalogs: true
I20260923 19:50:25.019356 5804 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_1fc9244b78694fdc9006399969d4f536" } modify_external_catalogs: true
I20260923 19:50:25.019471 5804 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_1fc9244b78694fdc9006399969d4f536" } modify_external_catalogs: true
I20260923 19:50:25.019912 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d7268848cedf45269016ad6fa5d306c4" } new_table_name: "default.Table_8e46ff2b6328484f9ad04a9afe961f63" modify_external_catalogs: true
W20260923 19:50:25.020551 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 96577a68f4984c90b82cf4d32e701476 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96577a68f4984c90b82cf4d32e701476 already in progress: creating tablet
I20260923 19:50:25.021986 5802 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 34d62ab3d4aa457f8fea283cd9248a41 (table default.Table_71d7f590efb94aae8c345f9d9a620fc1 [id=b4e8e3f2a48a4b5496f506080b415805]). Expected version 1 got 0
I20260923 19:50:25.026046 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 962) took 3289 ms. Trace:
I20260923 19:50:25.026144 6459 rpcz_store.cc:276] 0923 19:50:21.736941 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.736991 (+ 50us) service_pool.cc:224] Handling call
0923 19:50:25.025902 (+3288911us) ts_tablet_manager.cc:1151] Deleting tablet ab81b40554e2411780ecfe12ef4a8f7d
0923 19:50:25.025915 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.026023 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3288745}
I20260923 19:50:25.026765 6456 tablet_bootstrap.cc:492] T ba639d8c68cf49a49a5ec5729143cf6b P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:25.027181 6459 tablet_replica.cc:333] T a01a86b6fd4b44d3808c2040525d7b61 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:25.027366 6459 raft_consensus.cc:2243] T a01a86b6fd4b44d3808c2040525d7b61 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:25.027530 6459 raft_consensus.cc:2272] T a01a86b6fd4b44d3808c2040525d7b61 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:25.028805 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet ab81b40554e2411780ecfe12ef4a8f7d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab81b40554e2411780ecfe12ef4a8f7d already in progress: creating tablet
I20260923 19:50:25.029680 6459 ts_tablet_manager.cc:1916] T a01a86b6fd4b44d3808c2040525d7b61 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:25.037346 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1497ebe16d1a4eb6afbc1988dddf8951 consensus state has no leader
I20260923 19:50:25.042758 6454 tablet_bootstrap.cc:492] T fc151f4d78344efeada6d6e57af6eb9f P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:25.042968 6454 ts_tablet_manager.cc:1403] T fc151f4d78344efeada6d6e57af6eb9f P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.050s user 0.006s sys 0.003s
I20260923 19:50:25.044046 6454 raft_consensus.cc:359] T fc151f4d78344efeada6d6e57af6eb9f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.044315 6454 raft_consensus.cc:385] T fc151f4d78344efeada6d6e57af6eb9f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:25.044433 6454 raft_consensus.cc:740] T fc151f4d78344efeada6d6e57af6eb9f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:25.044703 6454 consensus_queue.cc:260] T fc151f4d78344efeada6d6e57af6eb9f P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.045282 6454 ts_tablet_manager.cc:1434] T fc151f4d78344efeada6d6e57af6eb9f P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:25.051260 6459 ts_tablet_manager.cc:1929] T a01a86b6fd4b44d3808c2040525d7b61 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:25.014035 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 367a8b9a9b2b453e91082a8cc4f5f64c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:24 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:25.041977 7877 raft_consensus.cc:493] T a83726da349c4cd1852e956c8fa2cda5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:25.057861 7877 raft_consensus.cc:515] T a83726da349c4cd1852e956c8fa2cda5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.058601 7877 leader_election.cc:290] T a83726da349c4cd1852e956c8fa2cda5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:25.059751 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 367a8b9a9b2b453e91082a8cc4f5f64c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 367a8b9a9b2b453e91082a8cc4f5f64c already in progress: creating tablet
I20260923 19:50:25.063930 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a83726da349c4cd1852e956c8fa2cda5" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:25.064842 5996 leader_election.cc:343] T a83726da349c4cd1852e956c8fa2cda5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:25.067188 6457 tablet_bootstrap.cc:492] T d2dd611746d741e88b6911bf5d51f3e5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:25.051659 6454 tablet_bootstrap.cc:492] T 0c537304c32c44adaa1e05de4496293f P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:25.068015 7877 raft_consensus.cc:493] T 3acf4a03174f45d5aee9c9b1454784f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:25.068132 7877 raft_consensus.cc:515] T 3acf4a03174f45d5aee9c9b1454784f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:25.068691 6454 tablet_bootstrap.cc:654] T 0c537304c32c44adaa1e05de4496293f P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:25.068750 7877 leader_election.cc:290] T 3acf4a03174f45d5aee9c9b1454784f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:25.059795 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a83726da349c4cd1852e956c8fa2cda5" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:25.069242 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3acf4a03174f45d5aee9c9b1454784f8" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:25.069380 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3acf4a03174f45d5aee9c9b1454784f8" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:25.067013 6249 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
W20260923 19:50:25.069913 5995 leader_election.cc:343] T a83726da349c4cd1852e956c8fa2cda5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:25.070015 5995 leader_election.cc:304] T a83726da349c4cd1852e956c8fa2cda5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
W20260923 19:50:25.070161 5996 leader_election.cc:343] T 3acf4a03174f45d5aee9c9b1454784f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:25.070382 5995 leader_election.cc:343] T 3acf4a03174f45d5aee9c9b1454784f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:25.070466 5995 leader_election.cc:304] T 3acf4a03174f45d5aee9c9b1454784f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:25.070791 7816 raft_consensus.cc:2749] T a83726da349c4cd1852e956c8fa2cda5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:25.070951 7816 raft_consensus.cc:2749] T 3acf4a03174f45d5aee9c9b1454784f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:25.073629 6459 log.cc:1199] T a01a86b6fd4b44d3808c2040525d7b61 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/a01a86b6fd4b44d3808c2040525d7b61
I20260923 19:50:25.074295 6457 tablet_bootstrap.cc:654] T d2dd611746d741e88b6911bf5d51f3e5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:25.076601 6459 ts_tablet_manager.cc:1950] T a01a86b6fd4b44d3808c2040525d7b61 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:25.077323 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 963) took 3339 ms. Trace:
I20260923 19:50:25.077797 6459 rpcz_store.cc:276] 0923 19:50:21.737508 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.737549 (+ 41us) service_pool.cc:224] Handling call
0923 19:50:25.027140 (+3289591us) ts_tablet_manager.cc:1151] Deleting tablet a01a86b6fd4b44d3808c2040525d7b61
0923 19:50:25.027149 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.047610 (+ 20461us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:25.051205 (+ 3595us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:25.077306 (+ 26101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3289459}
I20260923 19:50:25.078559 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet a01a86b6fd4b44d3808c2040525d7b61 (table default.Table_d2249132d73a45758b64da97b668320e [id=bf20ac3f66704af69ceb4531253cbd15]) successfully deleted
I20260923 19:50:25.079032 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 964) took 3278 ms. Trace:
I20260923 19:50:25.079406 6459 rpcz_store.cc:276] 0923 19:50:21.800878 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.800942 (+ 64us) service_pool.cc:224] Handling call
0923 19:50:25.078921 (+3277979us) ts_tablet_manager.cc:1151] Deleting tablet af0f632bd266480d9ab1f864db5cd93e
0923 19:50:25.078931 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.079017 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3277750}
I20260923 19:50:25.079425 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7c0f53782acd4972bd270aafa5cfead6" } modify_external_catalogs: true
I20260923 19:50:25.079582 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7c0f53782acd4972bd270aafa5cfead6" } modify_external_catalogs: true
W20260923 19:50:25.080010 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet af0f632bd266480d9ab1f864db5cd93e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet af0f632bd266480d9ab1f864db5cd93e already in progress: creating tablet
I20260923 19:50:25.080137 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_8c85b08bc85b4ed391b499a1b1871883"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:25.080497 6459 tablet_replica.cc:333] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
W20260923 19:50:25.080687 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c85b08bc85b4ed391b499a1b1871883 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:25.080950 6459 raft_consensus.cc:2243] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:25.081420 6459 pending_rounds.cc:70] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430: Trying to abort 1 pending ops.
I20260923 19:50:25.081755 6459 pending_rounds.cc:77] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7332630618215510016 op_type: NO_OP noop_request { }
I20260923 19:50:25.081863 5799 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f0cdb5a015e54dc8af1c6790ea549345" } modify_external_catalogs: true
I20260923 19:50:25.082046 6459 raft_consensus.cc:2889] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260923 19:50:25.082021 5799 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f0cdb5a015e54dc8af1c6790ea549345" } modify_external_catalogs: true
I20260923 19:50:25.082240 6459 raft_consensus.cc:2272] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:25.082901 6459 ts_tablet_manager.cc:1916] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:25.088573 5797 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b1eec74ca2b54d2cb47a8a13fb4b293a has no consensus state
I20260923 19:50:25.089172 7907 raft_consensus.cc:493] T dbe06eba8067413a903e4a07c2768484 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:25.089417 7907 raft_consensus.cc:515] T dbe06eba8067413a903e4a07c2768484 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.090032 7907 leader_election.cc:290] T dbe06eba8067413a903e4a07c2768484 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:25.091271 6137 leader_election.cc:343] T dbe06eba8067413a903e4a07c2768484 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: dbe06eba8067413a903e4a07c2768484
I20260923 19:50:25.091864 5797 master_service.cc:960] ReplaceTablet: received request to replace tablet 9e341a8bf3324ac4811b90e6653cfd4c from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:25.092846 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet fc151f4d78344efeada6d6e57af6eb9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:25.093277 6454 tablet_bootstrap.cc:492] T 0c537304c32c44adaa1e05de4496293f P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:25.093513 6454 ts_tablet_manager.cc:1403] T 0c537304c32c44adaa1e05de4496293f P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.042s user 0.004s sys 0.005s
I20260923 19:50:25.093797 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_fbc2e2a092eb47cda059f7093be1c090"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:25.094339 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fbc2e2a092eb47cda059f7093be1c090 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:25.094509 6454 raft_consensus.cc:359] T 0c537304c32c44adaa1e05de4496293f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.094718 6454 raft_consensus.cc:385] T 0c537304c32c44adaa1e05de4496293f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:25.094820 6454 raft_consensus.cc:740] T 0c537304c32c44adaa1e05de4496293f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:25.095124 6454 consensus_queue.cc:260] T 0c537304c32c44adaa1e05de4496293f P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.097460 6454 ts_tablet_manager.cc:1434] T 0c537304c32c44adaa1e05de4496293f P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260923 19:50:25.097774 6454 tablet_bootstrap.cc:492] T 528fca12bfe04747830ad1d3bb323676 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
W20260923 19:50:25.097747 6139 leader_election.cc:343] T dbe06eba8067413a903e4a07c2768484 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: dbe06eba8067413a903e4a07c2768484
I20260923 19:50:25.097975 6139 leader_election.cc:304] T dbe06eba8067413a903e4a07c2768484 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:25.098308 7907 raft_consensus.cc:2749] T dbe06eba8067413a903e4a07c2768484 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:25.099464 6454 tablet_bootstrap.cc:654] T 528fca12bfe04747830ad1d3bb323676 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:25.100642 6456 tablet_bootstrap.cc:654] T ba639d8c68cf49a49a5ec5729143cf6b P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:25.100986 5803 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4434c09950e74177ad0c4cc42f1dfbab has no consensus state
I20260923 19:50:25.103760 5798 master_service.cc:960] ReplaceTablet: received request to replace tablet c6598be958f842328a81fd092c6fcf64 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:25.107363 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_3e7a5e2b2469499ea5a8df240c5e0286"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:25.107918 6459 ts_tablet_manager.cc:1929] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:25.108089 6459 log.cc:1199] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/a926ff092e6e495e981be156421e8d72
W20260923 19:50:25.108107 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e7a5e2b2469499ea5a8df240c5e0286 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:25.108593 7907 raft_consensus.cc:493] T 34d62ab3d4aa457f8fea283cd9248a41 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:25.108711 7907 raft_consensus.cc:515] T 34d62ab3d4aa457f8fea283cd9248a41 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.109398 7907 leader_election.cc:290] T 34d62ab3d4aa457f8fea283cd9248a41 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:25.109925 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d62ab3d4aa457f8fea283cd9248a41" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:25.110288 6056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d62ab3d4aa457f8fea283cd9248a41" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
W20260923 19:50:25.110983 6280 consensus_peers.cc:597] T f1c1d4f73488499a9e5add81e9d5e2d6 P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:25.111101 6137 leader_election.cc:304] T 34d62ab3d4aa457f8fea283cd9248a41 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:25.111642 7907 raft_consensus.cc:2749] T 34d62ab3d4aa457f8fea283cd9248a41 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:25.112246 6459 ts_tablet_manager.cc:1950] T a926ff092e6e495e981be156421e8d72 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:25.112933 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 965) took 3311 ms. Trace:
I20260923 19:50:25.113229 6459 rpcz_store.cc:276] 0923 19:50:21.801648 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.801703 (+ 55us) service_pool.cc:224] Handling call
0923 19:50:25.080451 (+3278748us) ts_tablet_manager.cc:1151] Deleting tablet a926ff092e6e495e981be156421e8d72
0923 19:50:25.080459 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.103714 (+ 23255us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:25.107859 (+ 4145us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:25.112917 (+ 5058us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3278574}
I20260923 19:50:25.113931 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 966) took 3236 ms. Trace:
I20260923 19:50:25.113979 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet a926ff092e6e495e981be156421e8d72 (table default.Table_413519bded0c44f3b92a3710f13f69bb [id=8a617888464a4c8c85dbe8f93d6ef9fb]) successfully deleted
I20260923 19:50:25.114414 6459 rpcz_store.cc:276] 0923 19:50:21.877301 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:21.877798 (+ 497us) service_pool.cc:224] Handling call
0923 19:50:25.113769 (+3235971us) ts_tablet_manager.cc:1151] Deleting tablet b297338b1d5a4e5797d364b891081548
0923 19:50:25.113779 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.113866 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3235734}
I20260923 19:50:25.115007 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 967) took 2959 ms. Trace:
W20260923 19:50:25.115100 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet b297338b1d5a4e5797d364b891081548 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b297338b1d5a4e5797d364b891081548 already in progress: creating tablet
I20260923 19:50:25.115444 6459 rpcz_store.cc:276] 0923 19:50:22.155633 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:22.155701 (+ 68us) service_pool.cc:224] Handling call
0923 19:50:25.114904 (+2959203us) ts_tablet_manager.cc:1151] Deleting tablet fcc32bda7c684e849161f9d4a3df79d3
0923 19:50:25.114915 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.114991 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2958970}
I20260923 19:50:25.116066 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 968) took 2959 ms. Trace:
W20260923 19:50:25.116310 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet fcc32bda7c684e849161f9d4a3df79d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fcc32bda7c684e849161f9d4a3df79d3 already in progress: creating tablet
I20260923 19:50:25.116451 6459 rpcz_store.cc:276] 0923 19:50:22.156174 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:22.156221 (+ 47us) service_pool.cc:224] Handling call
0923 19:50:25.115960 (+2959739us) ts_tablet_manager.cc:1151] Deleting tablet 5c9768e71e0640ceb110a19e53484044
0923 19:50:25.115969 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.116051 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2959583}
I20260923 19:50:25.116623 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c537304c32c44adaa1e05de4496293f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:25.117122 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 972) took 2884 ms. Trace:
W20260923 19:50:25.117331 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 5c9768e71e0640ceb110a19e53484044 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c9768e71e0640ceb110a19e53484044 already in progress: creating tablet
I20260923 19:50:25.117605 6459 rpcz_store.cc:276] 0923 19:50:22.232647 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:22.232769 (+ 122us) service_pool.cc:224] Handling call
0923 19:50:25.117028 (+2884259us) ts_tablet_manager.cc:1151] Deleting tablet 441ec1cea9a74dd3ac4dc139d2b0baa2
0923 19:50:25.117037 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.117107 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2883654}
I20260923 19:50:25.118152 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 982) took 2753 ms. Trace:
W20260923 19:50:25.118600 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 441ec1cea9a74dd3ac4dc139d2b0baa2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 441ec1cea9a74dd3ac4dc139d2b0baa2 already in progress: creating tablet
I20260923 19:50:25.118757 6459 rpcz_store.cc:276] 0923 19:50:22.364679 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:22.369617 (+ 4938us) service_pool.cc:224] Handling call
0923 19:50:25.118058 (+2748441us) ts_tablet_manager.cc:1151] Deleting tablet 3eb8d0a6a2a14388a60b6901106b2856
0923 19:50:25.118067 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.118138 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2748129}
I20260923 19:50:25.119112 6459 tablet_replica.cc:333] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
W20260923 19:50:25.119223 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 3eb8d0a6a2a14388a60b6901106b2856 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3eb8d0a6a2a14388a60b6901106b2856 already in progress: creating tablet
I20260923 19:50:25.120162 6459 raft_consensus.cc:2243] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:25.119943 6454 tablet_bootstrap.cc:492] T 528fca12bfe04747830ad1d3bb323676 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:25.120436 6454 ts_tablet_manager.cc:1403] T 528fca12bfe04747830ad1d3bb323676 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.004s
I20260923 19:50:25.121187 6454 raft_consensus.cc:359] T 528fca12bfe04747830ad1d3bb323676 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.121419 6454 raft_consensus.cc:385] T 528fca12bfe04747830ad1d3bb323676 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:25.121515 6454 raft_consensus.cc:740] T 528fca12bfe04747830ad1d3bb323676 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:25.121953 6454 consensus_queue.cc:260] T 528fca12bfe04747830ad1d3bb323676 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.124140 6458 ts_tablet_manager.cc:1929] T 670d9cb0e6e2414092f72ffd5e6b00ea P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:25.125113 7890 raft_consensus.cc:493] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:25.125357 7890 raft_consensus.cc:515] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:25.125541 6454 ts_tablet_manager.cc:1434] T 528fca12bfe04747830ad1d3bb323676 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260923 19:50:25.125798 6454 tablet_bootstrap.cc:492] T e6e04d16675443fc923a5f8216e292b6 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:25.126034 7890 leader_election.cc:290] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:25.126348 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f7b33bbf3f453e8e841ee5d99c5b31" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:25.126762 6280 leader_election.cc:343] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:25.127288 6279 leader_election.cc:343] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: d3f7b33bbf3f453e8e841ee5d99c5b31
I20260923 19:50:25.127400 6279 leader_election.cc:304] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:25.128254 7902 raft_consensus.cc:2749] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:25.128332 6454 tablet_bootstrap.cc:654] T e6e04d16675443fc923a5f8216e292b6 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:25.126753 6458 log.cc:1199] T 670d9cb0e6e2414092f72ffd5e6b00ea P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/670d9cb0e6e2414092f72ffd5e6b00ea
I20260923 19:50:25.130460 6458 ts_tablet_manager.cc:1950] T 670d9cb0e6e2414092f72ffd5e6b00ea P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:25.132382 6459 raft_consensus.cc:2272] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:25.133116 6459 ts_tablet_manager.cc:1916] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:25.135049 6454 tablet_bootstrap.cc:492] T e6e04d16675443fc923a5f8216e292b6 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:25.135080 6456 tablet_bootstrap.cc:492] T ba639d8c68cf49a49a5ec5729143cf6b P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:25.135203 6456 ts_tablet_manager.cc:1403] T ba639d8c68cf49a49a5ec5729143cf6b P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.109s user 0.000s sys 0.004s
I20260923 19:50:25.135267 6454 ts_tablet_manager.cc:1403] T e6e04d16675443fc923a5f8216e292b6 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s
I20260923 19:50:25.135962 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet 528fca12bfe04747830ad1d3bb323676 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:25.136582 6454 raft_consensus.cc:359] T e6e04d16675443fc923a5f8216e292b6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.136782 6454 raft_consensus.cc:385] T e6e04d16675443fc923a5f8216e292b6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:25.136873 6454 raft_consensus.cc:740] T e6e04d16675443fc923a5f8216e292b6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:25.136723 6456 raft_consensus.cc:359] T ba639d8c68cf49a49a5ec5729143cf6b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:25.136991 6456 raft_consensus.cc:385] T ba639d8c68cf49a49a5ec5729143cf6b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:25.137094 6456 raft_consensus.cc:740] T ba639d8c68cf49a49a5ec5729143cf6b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:25.137100 6454 consensus_queue.cc:260] T e6e04d16675443fc923a5f8216e292b6 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.137393 6456 consensus_queue.cc:260] T ba639d8c68cf49a49a5ec5729143cf6b P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:25.137744 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_a1c157c570224093ae6a50f1b10aa01b" } new_table_name: "default.Table_1e1088639b6249c494e14d33b9f20f60" modify_external_catalogs: true
I20260923 19:50:25.139027 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_c54bb8999915481194627164d640f4d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:25.139470 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c54bb8999915481194627164d640f4d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:25.141337 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_a0ad9f8fcb0b4e6ca0b5b311d2e2c3d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:25.141775 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a0ad9f8fcb0b4e6ca0b5b311d2e2c3d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:25.145848 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cf538da9dc8c47a8a391efe4e17bb3a5 consensus state has no leader
I20260923 19:50:25.152274 6454 ts_tablet_manager.cc:1434] T e6e04d16675443fc923a5f8216e292b6 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260923 19:50:25.153627 6456 ts_tablet_manager.cc:1434] T ba639d8c68cf49a49a5ec5729143cf6b P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
I20260923 19:50:25.154700 7877 raft_consensus.cc:493] T 7f47efa0cabd47aa8ed0deface7763ab P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:25.154860 7877 raft_consensus.cc:515] T 7f47efa0cabd47aa8ed0deface7763ab P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.155241 7816 raft_consensus.cc:493] T 1ea8f44ac03b4ad196725f871a615cdd P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:25.155354 7816 raft_consensus.cc:515] T 1ea8f44ac03b4ad196725f871a615cdd P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.155504 7877 leader_election.cc:290] T 7f47efa0cabd47aa8ed0deface7763ab P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:25.155925 7816 leader_election.cc:290] T 1ea8f44ac03b4ad196725f871a615cdd P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:25.156013 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f47efa0cabd47aa8ed0deface7763ab" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:25.156131 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f47efa0cabd47aa8ed0deface7763ab" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:25.156517 5996 leader_election.cc:343] T 7f47efa0cabd47aa8ed0deface7763ab P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:25.156936 5995 leader_election.cc:343] T 7f47efa0cabd47aa8ed0deface7763ab P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:25.157018 5995 leader_election.cc:304] T 7f47efa0cabd47aa8ed0deface7763ab P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:25.157128 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ea8f44ac03b4ad196725f871a615cdd" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:25.157248 7816 raft_consensus.cc:2749] T 7f47efa0cabd47aa8ed0deface7763ab P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:25.157486 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ea8f44ac03b4ad196725f871a615cdd" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:25.157966 5996 leader_election.cc:343] T 1ea8f44ac03b4ad196725f871a615cdd P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:25.158079 5995 leader_election.cc:343] T 1ea8f44ac03b4ad196725f871a615cdd P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:25.158177 5995 leader_election.cc:304] T 1ea8f44ac03b4ad196725f871a615cdd P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:25.158366 7816 raft_consensus.cc:2749] T 1ea8f44ac03b4ad196725f871a615cdd P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:25.162920 6456 tablet_bootstrap.cc:492] T c5cb76fa5e084604aa58bf888cfe4852 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
W20260923 19:50:25.167354 5792 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 1aed1eee3d914dcab3b837bf9e7a831d (table default.Table_3091843faf2b445294c246ab74246b26 [id=a9d80c0da2e241b392d5306228ecc7f8], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 1aed1eee3d914dcab3b837bf9e7a831d consensus state has no leader
I20260923 19:50:25.172411 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet e6e04d16675443fc923a5f8216e292b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:25.135373 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1097) took 1075 ms. Trace:
I20260923 19:50:25.173357 6458 rpcz_store.cc:276] 0923 19:50:24.059575 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:24.059615 (+ 40us) service_pool.cc:224] Handling call
0923 19:50:24.988402 (+928787us) ts_tablet_manager.cc:1151] Deleting tablet 670d9cb0e6e2414092f72ffd5e6b00ea
0923 19:50:24.988416 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.009166 (+ 20750us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:25.124065 (+114899us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:25.135356 (+ 11291us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":231,"tablet-delete.queue_time_us":928660}
I20260923 19:50:25.173580 6454 tablet_bootstrap.cc:492] T 554655516bb547ad9c2aa1ee66dc8deb P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:25.174845 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_c774692bc686484c8f63d686c3d61dda"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:25.175357 6454 tablet_bootstrap.cc:654] T 554655516bb547ad9c2aa1ee66dc8deb P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:25.175424 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c774692bc686484c8f63d686c3d61dda in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:25.177069 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 670d9cb0e6e2414092f72ffd5e6b00ea (table default.Table_40208153d40d477c8a2d41c8efc1617c [id=8065910e86444becaf5f982fbdeb2aed]) successfully deleted
I20260923 19:50:25.177435 6458 tablet_replica.cc:333] T 554655516bb547ad9c2aa1ee66dc8deb P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:25.178325 6456 tablet_bootstrap.cc:654] T c5cb76fa5e084604aa58bf888cfe4852 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:25.177816 6458 raft_consensus.cc:2243] T 554655516bb547ad9c2aa1ee66dc8deb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:25.185750 6458 raft_consensus.cc:2272] T 554655516bb547ad9c2aa1ee66dc8deb P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:25.186510 6458 ts_tablet_manager.cc:1916] T 554655516bb547ad9c2aa1ee66dc8deb P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:25.188825 5798 master_service.cc:960] ReplaceTablet: received request to replace tablet b18ddbbf3ce84927bc330b8affc37bb8 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:25.191241 6459 ts_tablet_manager.cc:1929] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:25.191385 6459 log.cc:1199] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/d8c8bfa9b7424b9f80f76e0bb05cbc0c
I20260923 19:50:25.191697 6459 ts_tablet_manager.cc:1950] T d8c8bfa9b7424b9f80f76e0bb05cbc0c P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:25.207075 6454 tablet_bootstrap.cc:492] T 554655516bb547ad9c2aa1ee66dc8deb P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:25.207935 6454 ts_tablet_manager.cc:1403] T 554655516bb547ad9c2aa1ee66dc8deb P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.000s
I20260923 19:50:25.210624 6458 ts_tablet_manager.cc:1929] T 554655516bb547ad9c2aa1ee66dc8deb P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:25.213347 6458 log.cc:1199] T 554655516bb547ad9c2aa1ee66dc8deb P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/554655516bb547ad9c2aa1ee66dc8deb
I20260923 19:50:25.213909 6458 ts_tablet_manager.cc:1950] T 554655516bb547ad9c2aa1ee66dc8deb P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:25.214043 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 992) took 2822 ms. Trace:
I20260923 19:50:25.214213 6459 rpcz_store.cc:276] 0923 19:50:22.391585 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:22.392155 (+ 570us) service_pool.cc:224] Handling call
0923 19:50:25.119073 (+2726918us) ts_tablet_manager.cc:1151] Deleting tablet d8c8bfa9b7424b9f80f76e0bb05cbc0c
0923 19:50:25.119081 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.143735 (+ 24654us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:25.191176 (+ 47441us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:25.214016 (+ 22840us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2726167}
I20260923 19:50:25.214977 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_8e46ff2b6328484f9ad04a9afe961f63" } new_table_name: "default.Table_f2e2ed35560847c4b3b2fde259194e42" modify_external_catalogs: true
I20260923 19:50:25.215327 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 989) took 2823 ms. Trace:
I20260923 19:50:25.215497 6459 rpcz_store.cc:276] 0923 19:50:22.391378 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:22.391701 (+ 323us) service_pool.cc:224] Handling call
0923 19:50:25.214986 (+2823285us) ts_tablet_manager.cc:1151] Deleting tablet f45863a748ce4d2f94d1ad639c7e6bf7
0923 19:50:25.215024 (+ 38us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.215281 (+ 257us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2818386}
I20260923 19:50:25.216334 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 997) took 2824 ms. Trace:
I20260923 19:50:25.216563 6459 rpcz_store.cc:276] 0923 19:50:22.391990 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:22.392546 (+ 556us) service_pool.cc:224] Handling call
0923 19:50:25.216134 (+2823588us) ts_tablet_manager.cc:1151] Deleting tablet 2205316ed70543e5b3b001d88ab3ae5d
0923 19:50:25.216142 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.216313 (+ 171us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2818818}
I20260923 19:50:25.217265 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1098) took 1157 ms. Trace:
I20260923 19:50:25.217265 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 990) took 2825 ms. Trace:
I20260923 19:50:25.217386 6459 rpcz_store.cc:276] 0923 19:50:22.391450 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:22.391843 (+ 393us) service_pool.cc:224] Handling call
0923 19:50:25.217122 (+2825279us) ts_tablet_manager.cc:1151] Deleting tablet 771ad1e82bd743e597aefe5edafe63ea
0923 19:50:25.217131 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.217251 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2819744}
I20260923 19:50:25.218235 6459 tablet_replica.cc:333] T 83dba06b0d0040889015fb052c642ec0 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:25.218717 6459 raft_consensus.cc:2243] T 83dba06b0d0040889015fb052c642ec0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:25.219022 6459 raft_consensus.cc:2272] T 83dba06b0d0040889015fb052c642ec0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:25.218950 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_ac308acb0a664980af2a809547a864e4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:25.220685 6458 rpcz_store.cc:276] 0923 19:50:24.059829 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:24.059868 (+ 39us) service_pool.cc:224] Handling call
0923 19:50:25.177353 (+1117485us) ts_tablet_manager.cc:1151] Deleting tablet 554655516bb547ad9c2aa1ee66dc8deb
0923 19:50:25.177391 (+ 38us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.192395 (+ 15004us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:25.210553 (+ 18158us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:25.217243 (+ 6690us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1117343}
I20260923 19:50:25.221405 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 554655516bb547ad9c2aa1ee66dc8deb (table default.Table_bf20f5ba63594cce94f323629947c04c [id=648700f6ed984eb8942ecfc647e8c725]) successfully deleted
I20260923 19:50:25.221844 6458 tablet_replica.cc:333] T 92f94b93d1364bb1a2562eb577707cf1 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:25.222879 6457 tablet_bootstrap.cc:492] T d2dd611746d741e88b6911bf5d51f3e5 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:25.223105 6457 ts_tablet_manager.cc:1403] T d2dd611746d741e88b6911bf5d51f3e5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.156s user 0.004s sys 0.000s
I20260923 19:50:25.223960 6457 raft_consensus.cc:359] T d2dd611746d741e88b6911bf5d51f3e5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.224220 6457 raft_consensus.cc:385] T d2dd611746d741e88b6911bf5d51f3e5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:25.224330 6457 raft_consensus.cc:740] T d2dd611746d741e88b6911bf5d51f3e5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:25.224622 6457 consensus_queue.cc:260] T d2dd611746d741e88b6911bf5d51f3e5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.225831 6458 raft_consensus.cc:2243] T 92f94b93d1364bb1a2562eb577707cf1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:25.227238 6456 tablet_bootstrap.cc:492] T c5cb76fa5e084604aa58bf888cfe4852 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:25.227624 6456 ts_tablet_manager.cc:1403] T c5cb76fa5e084604aa58bf888cfe4852 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.065s user 0.005s sys 0.005s
I20260923 19:50:25.226086 6458 raft_consensus.cc:2272] T 92f94b93d1364bb1a2562eb577707cf1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:25.228204 6457 ts_tablet_manager.cc:1434] T d2dd611746d741e88b6911bf5d51f3e5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260923 19:50:25.228700 6457 tablet_bootstrap.cc:492] T 4e69656e9fc941e19eb7de5c87bc9050 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:25.229053 6458 ts_tablet_manager.cc:1916] T 92f94b93d1364bb1a2562eb577707cf1 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:25.220705 6459 ts_tablet_manager.cc:1916] T 83dba06b0d0040889015fb052c642ec0 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:25.230839 6456 raft_consensus.cc:359] T c5cb76fa5e084604aa58bf888cfe4852 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:25.231241 6456 raft_consensus.cc:385] T c5cb76fa5e084604aa58bf888cfe4852 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:25.231346 6456 raft_consensus.cc:740] T c5cb76fa5e084604aa58bf888cfe4852 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:25.231930 6456 consensus_queue.cc:260] T c5cb76fa5e084604aa58bf888cfe4852 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:25.235059 6457 tablet_bootstrap.cc:654] T 4e69656e9fc941e19eb7de5c87bc9050 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:25.240024 6456 ts_tablet_manager.cc:1434] T c5cb76fa5e084604aa58bf888cfe4852 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260923 19:50:25.242264 6456 tablet_bootstrap.cc:492] T 21bf33904ede470b80a074dc9a458baf P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:25.244477 6456 tablet_bootstrap.cc:654] T 21bf33904ede470b80a074dc9a458baf P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:25.246399 6454 raft_consensus.cc:359] T 554655516bb547ad9c2aa1ee66dc8deb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.246613 6454 raft_consensus.cc:385] T 554655516bb547ad9c2aa1ee66dc8deb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:25.246662 6454 raft_consensus.cc:740] T 554655516bb547ad9c2aa1ee66dc8deb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:25.247292 6454 consensus_queue.cc:260] T 554655516bb547ad9c2aa1ee66dc8deb P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.247828 6454 ts_tablet_manager.cc:1434] T 554655516bb547ad9c2aa1ee66dc8deb P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.040s user 0.001s sys 0.000s
I20260923 19:50:25.214756 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet d8c8bfa9b7424b9f80f76e0bb05cbc0c (table default.Table_ec1f04b2e36247fa96e9591cb7ab7eff [id=662eb0a4f944445486929d42c5ebfd01]) successfully deleted
W20260923 19:50:25.254099 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac308acb0a664980af2a809547a864e4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:25.254537 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet f45863a748ce4d2f94d1ad639c7e6bf7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f45863a748ce4d2f94d1ad639c7e6bf7 already in progress: creating tablet
I20260923 19:50:25.260236 7890 consensus_queue.cc:1048] T f1c1d4f73488499a9e5add81e9d5e2d6 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260923 19:50:25.258212 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 2205316ed70543e5b3b001d88ab3ae5d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2205316ed70543e5b3b001d88ab3ae5d already in progress: creating tablet
W20260923 19:50:25.262283 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 771ad1e82bd743e597aefe5edafe63ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 771ad1e82bd743e597aefe5edafe63ea already in progress: creating tablet
W20260923 19:50:25.264124 5803 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4434c09950e74177ad0c4cc42f1dfbab has no consensus state
I20260923 19:50:25.265237 6454 tablet_bootstrap.cc:492] T d39a64531dd24eb4aa1f7e0c418b985b P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:25.266397 5803 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_84d13e1ea6234e5ca45738376e83f537" } modify_external_catalogs: true
I20260923 19:50:25.266566 5803 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_84d13e1ea6234e5ca45738376e83f537" } modify_external_catalogs: true
I20260923 19:50:25.268985 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet 554655516bb547ad9c2aa1ee66dc8deb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:25.272954 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b99d3f192eb04474b4b05c9309fb01f3" } new_table_name: "default.Table_13efcedca8734bd08d6b7dc4d5221ece" modify_external_catalogs: true
W20260923 19:50:25.279981 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2d8a5ec91fc84026aa31a41f4cca5d07 consensus state has no leader
I20260923 19:50:25.280093 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 0a5ce253bcce410b9517449f133d39e8
I20260923 19:50:25.280964 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_ffcdb975fa2d4b6494baea2e3c84a99e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:25.281832 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ffcdb975fa2d4b6494baea2e3c84a99e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:25.282231 6321 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a5ce253bcce410b9517449f133d39e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:25 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:25.283227 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a5ce253bcce410b9517449f133d39e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:25 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:25.283938 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a5ce253bcce410b9517449f133d39e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:25 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:25.284902 6461 tablet_replica.cc:333] T 0a5ce253bcce410b9517449f133d39e8 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:25.285144 6461 raft_consensus.cc:2243] T 0a5ce253bcce410b9517449f133d39e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:25.285310 6461 raft_consensus.cc:2272] T 0a5ce253bcce410b9517449f133d39e8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:25.285830 6461 ts_tablet_manager.cc:1916] T 0a5ce253bcce410b9517449f133d39e8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:25.290218 7816 raft_consensus.cc:493] T 0f90406b20f54787bd27255d5ae81d1c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:25.290378 7816 raft_consensus.cc:515] T 0f90406b20f54787bd27255d5ae81d1c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:25.291121 7816 leader_election.cc:290] T 0f90406b20f54787bd27255d5ae81d1c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:25.293781 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f90406b20f54787bd27255d5ae81d1c" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:25.294420 5996 leader_election.cc:343] T 0f90406b20f54787bd27255d5ae81d1c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:25.294716 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_3d3143300d6d4c4a8aa6010b1dae8e31"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:25.295356 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d3143300d6d4c4a8aa6010b1dae8e31 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:25.299891 5803 master_service.cc:960] ReplaceTablet: received request to replace tablet 8e95ec2f36be418fa2f042cd14b7a8bd from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:25.306704 6461 ts_tablet_manager.cc:1929] T 0a5ce253bcce410b9517449f133d39e8 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:50:25.306826 6461 log.cc:1199] T 0a5ce253bcce410b9517449f133d39e8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/0a5ce253bcce410b9517449f133d39e8
I20260923 19:50:25.307152 6461 ts_tablet_manager.cc:1950] T 0a5ce253bcce410b9517449f133d39e8 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:25.307830 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5264e08e4d19494aae8757ffbfebbc33" } new_table_name: "default.Table_5572c14c35d14aa8bc14916e403dfe0f" modify_external_catalogs: true
I20260923 19:50:25.309487 6457 tablet_bootstrap.cc:492] T 4e69656e9fc941e19eb7de5c87bc9050 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:25.309682 6457 ts_tablet_manager.cc:1403] T 4e69656e9fc941e19eb7de5c87bc9050 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.081s user 0.005s sys 0.000s
I20260923 19:50:25.310887 6457 raft_consensus.cc:359] T 4e69656e9fc941e19eb7de5c87bc9050 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.312834 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 0a5ce253bcce410b9517449f133d39e8 (table default.Table_84d13e1ea6234e5ca45738376e83f537 [id=0d4f6a5bb30c4d2a937424cf0e651afd]) successfully deleted
I20260923 19:50:25.315003 6457 raft_consensus.cc:385] T 4e69656e9fc941e19eb7de5c87bc9050 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:25.316820 6457 raft_consensus.cc:740] T 4e69656e9fc941e19eb7de5c87bc9050 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:25.317425 6457 consensus_queue.cc:260] T 4e69656e9fc941e19eb7de5c87bc9050 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.320287 6457 ts_tablet_manager.cc:1434] T 4e69656e9fc941e19eb7de5c87bc9050 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20260923 19:50:25.320885 6457 tablet_bootstrap.cc:492] T 1cf016ff0bb8418d84358d17876338bf P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:25.323081 6457 tablet_bootstrap.cc:654] T 1cf016ff0bb8418d84358d17876338bf P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:25.324604 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f90406b20f54787bd27255d5ae81d1c" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:25.325105 5995 leader_election.cc:343] T 0f90406b20f54787bd27255d5ae81d1c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:25.329499 5995 leader_election.cc:304] T 0f90406b20f54787bd27255d5ae81d1c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:25.329785 7816 raft_consensus.cc:2749] T 0f90406b20f54787bd27255d5ae81d1c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:25.330396 6454 tablet_bootstrap.cc:654] T d39a64531dd24eb4aa1f7e0c418b985b P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:25.332543 6459 ts_tablet_manager.cc:1929] T 83dba06b0d0040889015fb052c642ec0 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:25.332762 6459 log.cc:1199] T 83dba06b0d0040889015fb052c642ec0 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/83dba06b0d0040889015fb052c642ec0
I20260923 19:50:25.333154 6459 ts_tablet_manager.cc:1950] T 83dba06b0d0040889015fb052c642ec0 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:25.333925 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1003) took 2878 ms. Trace:
I20260923 19:50:25.334076 6459 rpcz_store.cc:276] 0923 19:50:22.455269 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:22.480701 (+ 25432us) service_pool.cc:224] Handling call
0923 19:50:25.218143 (+2737442us) ts_tablet_manager.cc:1151] Deleting tablet 83dba06b0d0040889015fb052c642ec0
0923 19:50:25.218157 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.283245 (+ 65088us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:25.332472 (+ 49227us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:25.333907 (+ 1435us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2737162}
I20260923 19:50:25.338548 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1023) took 2222 ms. Trace:
I20260923 19:50:25.338708 6459 rpcz_store.cc:276] 0923 19:50:23.115807 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:23.115858 (+ 51us) service_pool.cc:224] Handling call
0923 19:50:25.338173 (+2222315us) ts_tablet_manager.cc:1151] Deleting tablet 7e8facf019054ac79fea193f44fc6742
0923 19:50:25.338184 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.338283 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2222164}
I20260923 19:50:25.339234 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1031) took 2168 ms. Trace:
I20260923 19:50:25.339407 7907 raft_consensus.cc:493] T e6e04d16675443fc923a5f8216e292b6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:25.339526 7907 raft_consensus.cc:515] T e6e04d16675443fc923a5f8216e292b6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.340147 7907 leader_election.cc:290] T e6e04d16675443fc923a5f8216e292b6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:25.341804 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 83dba06b0d0040889015fb052c642ec0 (table default.Table_cabd4e85a8824c7699003c51f4f0ead6 [id=33aab54b056646fe9324af773098823b]) successfully deleted
W20260923 19:50:25.341909 6139 leader_election.cc:343] T e6e04d16675443fc923a5f8216e292b6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: e6e04d16675443fc923a5f8216e292b6
W20260923 19:50:25.342082 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 7e8facf019054ac79fea193f44fc6742 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e8facf019054ac79fea193f44fc6742 already in progress: creating tablet
W20260923 19:50:25.343300 6137 leader_election.cc:343] T e6e04d16675443fc923a5f8216e292b6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: e6e04d16675443fc923a5f8216e292b6
I20260923 19:50:25.343426 6137 leader_election.cc:304] T e6e04d16675443fc923a5f8216e292b6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:25.343897 7907 raft_consensus.cc:2749] T e6e04d16675443fc923a5f8216e292b6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:25.330056 6458 ts_tablet_manager.cc:1929] T 92f94b93d1364bb1a2562eb577707cf1 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:25.344389 6458 log.cc:1199] T 92f94b93d1364bb1a2562eb577707cf1 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/92f94b93d1364bb1a2562eb577707cf1
I20260923 19:50:25.344849 6458 ts_tablet_manager.cc:1950] T 92f94b93d1364bb1a2562eb577707cf1 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:25.345734 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1099) took 1285 ms. Trace:
I20260923 19:50:25.348723 6458 rpcz_store.cc:276] 0923 19:50:24.060116 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:24.060153 (+ 37us) service_pool.cc:224] Handling call
0923 19:50:25.221751 (+1161598us) ts_tablet_manager.cc:1151] Deleting tablet 92f94b93d1364bb1a2562eb577707cf1
0923 19:50:25.221761 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.317700 (+ 95939us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:25.329998 (+ 12298us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:25.345713 (+ 15715us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1161476}
I20260923 19:50:25.339354 6459 rpcz_store.cc:276] 0923 19:50:23.171125 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:23.171338 (+ 213us) service_pool.cc:224] Handling call
0923 19:50:25.339141 (+2167803us) ts_tablet_manager.cc:1151] Deleting tablet 8c5ac79e5fa2438a87db948792d448b1
0923 19:50:25.339150 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.339221 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2167611}
I20260923 19:50:25.350495 5799 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 00eba27e9f2948e8a298c3fbca52a282
I20260923 19:50:25.350844 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 92f94b93d1364bb1a2562eb577707cf1 (table default.Table_da77a1d14aed4fba88200eb53fd16559 [id=54986bca912743be8c7e5bcb2627d151]) successfully deleted
I20260923 19:50:25.351079 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1032) took 2179 ms. Trace:
I20260923 19:50:25.351161 6459 rpcz_store.cc:276] 0923 19:50:23.171903 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:23.171962 (+ 59us) service_pool.cc:224] Handling call
0923 19:50:25.350940 (+2178978us) ts_tablet_manager.cc:1151] Deleting tablet c53b817e3ed7419b904a3c4b1c83e59f
0923 19:50:25.350953 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.351062 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2178832}
I20260923 19:50:25.351140 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_d83aab34c9cd4da3a293bc6bc2839ea4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:25.351507 6321 tablet_service.cc:1558] Processing DeleteTablet for tablet 00eba27e9f2948e8a298c3fbca52a282 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:25 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:25.351649 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d83aab34c9cd4da3a293bc6bc2839ea4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:25.352172 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 00eba27e9f2948e8a298c3fbca52a282 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:25 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:25.352295 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1033) took 2179 ms. Trace:
I20260923 19:50:25.352528 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1106) took 1234 ms. Trace:
W20260923 19:50:25.352766 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 00eba27e9f2948e8a298c3fbca52a282 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 00eba27e9f2948e8a298c3fbca52a282 already in progress: creating tablet
I20260923 19:50:25.352778 6459 rpcz_store.cc:276] 0923 19:50:23.172661 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:23.173032 (+ 371us) service_pool.cc:224] Handling call
0923 19:50:25.352172 (+2179140us) ts_tablet_manager.cc:1151] Deleting tablet a55b2ff045d648339d7e207f13e2fa27
0923 19:50:25.352184 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.352277 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2178975}
I20260923 19:50:25.353421 6459 tablet_replica.cc:333] T b18548ba557f448880c5e617fc03cbe0 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:25.353910 6459 raft_consensus.cc:2243] T b18548ba557f448880c5e617fc03cbe0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:25.352631 6458 rpcz_store.cc:276] 0923 19:50:24.118407 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:24.118461 (+ 54us) service_pool.cc:224] Handling call
0923 19:50:25.352386 (+1233925us) ts_tablet_manager.cc:1151] Deleting tablet 21bf33904ede470b80a074dc9a458baf
0923 19:50:25.352399 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.352506 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1233736}
I20260923 19:50:25.354441 6459 raft_consensus.cc:2272] T b18548ba557f448880c5e617fc03cbe0 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:25.354568 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet 00eba27e9f2948e8a298c3fbca52a282 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:25 UTC) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:25.354722 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 21bf33904ede470b80a074dc9a458baf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 21bf33904ede470b80a074dc9a458baf already in progress: creating tablet
I20260923 19:50:25.355098 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1107) took 1227 ms. Trace:
I20260923 19:50:25.355223 6458 rpcz_store.cc:276] 0923 19:50:24.127156 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:24.127204 (+ 48us) service_pool.cc:224] Handling call
0923 19:50:25.354956 (+1227752us) ts_tablet_manager.cc:1151] Deleting tablet ef0604c2a884465aab7bfe6a1d2d7da6
0923 19:50:25.354967 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.355079 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1227588}
I20260923 19:50:25.355409 6459 ts_tablet_manager.cc:1916] T b18548ba557f448880c5e617fc03cbe0 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:25.357326 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 8c5ac79e5fa2438a87db948792d448b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c5ac79e5fa2438a87db948792d448b1 already in progress: creating tablet
W20260923 19:50:25.357612 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet c53b817e3ed7419b904a3c4b1c83e59f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c53b817e3ed7419b904a3c4b1c83e59f already in progress: creating tablet
W20260923 19:50:25.357822 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet a55b2ff045d648339d7e207f13e2fa27 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a55b2ff045d648339d7e207f13e2fa27 already in progress: creating tablet
W20260923 19:50:25.359371 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet ef0604c2a884465aab7bfe6a1d2d7da6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef0604c2a884465aab7bfe6a1d2d7da6 already in progress: creating tablet
I20260923 19:50:25.359463 5799 master_service.cc:960] ReplaceTablet: received request to replace tablet b6ef90ddd7a34dfdb8309d0e1c3688e7 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:25.359956 5799 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_3e7a5e2b2469499ea5a8df240c5e0286" } new_table_name: "default.Table_94d5b95093b449e28be947e716590ef9" modify_external_catalogs: true
I20260923 19:50:25.360778 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1103) took 1253 ms. Trace:
I20260923 19:50:25.364320 6458 rpcz_store.cc:276] 0923 19:50:24.107545 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:24.107584 (+ 39us) service_pool.cc:224] Handling call
0923 19:50:25.360626 (+1253042us) ts_tablet_manager.cc:1151] Deleting tablet 9d5f5dcaf6f94fd1afa713d42c0ab037
0923 19:50:25.360640 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.360753 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1228783}
W20260923 19:50:25.364992 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 9d5f5dcaf6f94fd1afa713d42c0ab037 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d5f5dcaf6f94fd1afa713d42c0ab037 already in progress: creating tablet
I20260923 19:50:25.365489 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1104) took 1254 ms. Trace:
I20260923 19:50:25.365636 6458 rpcz_store.cc:276] 0923 19:50:24.110721 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:24.131885 (+ 21164us) service_pool.cc:224] Handling call
0923 19:50:25.365341 (+1233456us) ts_tablet_manager.cc:1151] Deleting tablet fc71e2911b9e4d1eb3fcebe7d1e4d96c
0923 19:50:25.365355 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.365470 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1233288}
W20260923 19:50:25.365803 5799 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 652921d75e174c3cad12c9439cfa100e has no consensus state
I20260923 19:50:25.366159 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_c270e17c5b9849d3bd1c560599c81f76"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:25.366664 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c270e17c5b9849d3bd1c560599c81f76 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:25.366950 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet fc71e2911b9e4d1eb3fcebe7d1e4d96c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc71e2911b9e4d1eb3fcebe7d1e4d96c already in progress: creating tablet
I20260923 19:50:25.367439 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1105) took 1256 ms. Trace:
I20260923 19:50:25.367575 6458 rpcz_store.cc:276] 0923 19:50:24.110817 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:24.110861 (+ 44us) service_pool.cc:224] Handling call
0923 19:50:25.367339 (+1256478us) ts_tablet_manager.cc:1151] Deleting tablet 992ffd38518347fd9b69cd2d9e99c28a
0923 19:50:25.367348 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.367424 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1223296}
W20260923 19:50:25.368001 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 992ffd38518347fd9b69cd2d9e99c28a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 992ffd38518347fd9b69cd2d9e99c28a already in progress: creating tablet
I20260923 19:50:25.368396 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1118) took 1088 ms. Trace:
I20260923 19:50:25.368502 6458 rpcz_store.cc:276] 0923 19:50:24.280086 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:24.280133 (+ 47us) service_pool.cc:224] Handling call
0923 19:50:25.368275 (+1088142us) ts_tablet_manager.cc:1151] Deleting tablet fb1ea962909b4e42a9c4fab048133077
0923 19:50:25.368285 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.368381 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1087937}
W20260923 19:50:25.368925 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet fb1ea962909b4e42a9c4fab048133077 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb1ea962909b4e42a9c4fab048133077 already in progress: creating tablet
W20260923 19:50:25.369589 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 37de46eabdd84065975a8e5a3c3758c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 37de46eabdd84065975a8e5a3c3758c4 already in progress: creating tablet
W20260923 19:50:25.370143 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 605093b0f8034a638b3df925ea31de34 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 605093b0f8034a638b3df925ea31de34 already in progress: creating tablet
W20260923 19:50:25.370762 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 524c11f83bc34c5fafd6c33d119ee926 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 524c11f83bc34c5fafd6c33d119ee926 already in progress: creating tablet
W20260923 19:50:25.371352 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 367a8b9a9b2b453e91082a8cc4f5f64c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 367a8b9a9b2b453e91082a8cc4f5f64c already in progress: creating tablet
I20260923 19:50:25.371660 6458 tablet_replica.cc:333] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:25.371888 6458 raft_consensus.cc:2243] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:25.373837 6458 raft_consensus.cc:2272] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:25.374001 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_b7454d124bc542788cdf915598bff4b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:25.376924 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b7454d124bc542788cdf915598bff4b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:25.377681 6458 ts_tablet_manager.cc:1916] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:25.384557 6198 raft_consensus.cc:3060] T 34d62ab3d4aa457f8fea283cd9248a41 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:25.386325 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_7e6c82f049e646f8b98cc2e169492b15"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:25.386893 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7e6c82f049e646f8b98cc2e169492b15 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:25.390005 7907 raft_consensus.cc:493] T 528fca12bfe04747830ad1d3bb323676 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:25.390138 7907 raft_consensus.cc:515] T 528fca12bfe04747830ad1d3bb323676 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.390730 7907 leader_election.cc:290] T 528fca12bfe04747830ad1d3bb323676 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:25.392423 6137 leader_election.cc:343] T 528fca12bfe04747830ad1d3bb323676 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 528fca12bfe04747830ad1d3bb323676
W20260923 19:50:25.393086 6139 leader_election.cc:343] T 528fca12bfe04747830ad1d3bb323676 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 528fca12bfe04747830ad1d3bb323676
I20260923 19:50:25.393180 6139 leader_election.cc:304] T 528fca12bfe04747830ad1d3bb323676 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:25.393590 7907 raft_consensus.cc:2749] T 528fca12bfe04747830ad1d3bb323676 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:25.394716 6454 tablet_bootstrap.cc:492] T d39a64531dd24eb4aa1f7e0c418b985b P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:25.394870 6454 ts_tablet_manager.cc:1403] T d39a64531dd24eb4aa1f7e0c418b985b P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.130s user 0.009s sys 0.000s
I20260923 19:50:25.395601 6454 raft_consensus.cc:359] T d39a64531dd24eb4aa1f7e0c418b985b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.395764 6454 raft_consensus.cc:385] T d39a64531dd24eb4aa1f7e0c418b985b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:25.395821 6454 raft_consensus.cc:740] T d39a64531dd24eb4aa1f7e0c418b985b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:25.395771 5799 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_dd8734e42a5d407782e8b34cad9c6e69" } new_table_name: "default.Table_1acb74d184f043509144aba8f9a78e6e" modify_external_catalogs: true
I20260923 19:50:25.396061 6454 consensus_queue.cc:260] T d39a64531dd24eb4aa1f7e0c418b985b P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.396540 6454 ts_tablet_manager.cc:1434] T d39a64531dd24eb4aa1f7e0c418b985b P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:50:25.396804 6454 tablet_bootstrap.cc:492] T e1de117713f34b51bbda0c712f0b837c P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:25.411780 6454 tablet_bootstrap.cc:654] T e1de117713f34b51bbda0c712f0b837c P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:25.413667 7907 raft_consensus.cc:493] T 0c537304c32c44adaa1e05de4496293f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:25.413815 7907 raft_consensus.cc:515] T 0c537304c32c44adaa1e05de4496293f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.414197 6456 tablet_bootstrap.cc:492] T 21bf33904ede470b80a074dc9a458baf P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:25.414336 6456 ts_tablet_manager.cc:1403] T 21bf33904ede470b80a074dc9a458baf P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.172s user 0.004s sys 0.002s
I20260923 19:50:25.414642 7907 leader_election.cc:290] T 0c537304c32c44adaa1e05de4496293f P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:25.415191 5800 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 401061423caf48639929bd8864c53218
I20260923 19:50:25.415162 6456 raft_consensus.cc:359] T 21bf33904ede470b80a074dc9a458baf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:25.415321 6456 raft_consensus.cc:385] T 21bf33904ede470b80a074dc9a458baf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:25.415374 6456 raft_consensus.cc:740] T 21bf33904ede470b80a074dc9a458baf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:25.415565 6456 consensus_queue.cc:260] T 21bf33904ede470b80a074dc9a458baf P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:25.415999 6456 ts_tablet_manager.cc:1434] T 21bf33904ede470b80a074dc9a458baf P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:50:25.415943 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_3a0ed1c1dbcc45ceb5ae6a4f0707048a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:25.416271 6456 tablet_bootstrap.cc:492] T f8052b05169b4673b387ac8b716ffc4e P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
W20260923 19:50:25.416458 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a0ed1c1dbcc45ceb5ae6a4f0707048a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:25.417552 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 8e95ec2f36be418fa2f042cd14b7a8bd
I20260923 19:50:25.417932 5803 catalog_manager.cc:6934] ReplaceTablet: tablet 8e95ec2f36be418fa2f042cd14b7a8bd deleted and replaced by tablet 4ef6cbeebfcd40d8a7186756c03ad86d
I20260923 19:50:25.418222 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_af899fa1ab4d4a31861ccaa8cc068e9c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:25.418682 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af899fa1ab4d4a31861ccaa8cc068e9c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:25.420367 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 401061423caf48639929bd8864c53218 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:25 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:25.420590 6035 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e95ec2f36be418fa2f042cd14b7a8bd with delete_type TABLET_DATA_DELETED (replaced by tablet 4ef6cbeebfcd40d8a7186756c03ad86d) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:25.421514 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 401061423caf48639929bd8864c53218 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 401061423caf48639929bd8864c53218 already in progress: creating tablet
W20260923 19:50:25.421782 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 8e95ec2f36be418fa2f042cd14b7a8bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8e95ec2f36be418fa2f042cd14b7a8bd already in progress: creating tablet
I20260923 19:50:25.422863 6321 tablet_service.cc:1558] Processing DeleteTablet for tablet 401061423caf48639929bd8864c53218 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:25 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:25.423044 6307 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e95ec2f36be418fa2f042cd14b7a8bd with delete_type TABLET_DATA_DELETED (replaced by tablet 4ef6cbeebfcd40d8a7186756c03ad86d) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:25.423744 6391 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
I20260923 19:50:25.426415 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet 401061423caf48639929bd8864c53218 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:25 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:25.426640 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e95ec2f36be418fa2f042cd14b7a8bd with delete_type TABLET_DATA_DELETED (replaced by tablet 4ef6cbeebfcd40d8a7186756c03ad86d) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:25.427167 6137 leader_election.cc:343] T 0c537304c32c44adaa1e05de4496293f P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 0c537304c32c44adaa1e05de4496293f
W20260923 19:50:25.429108 6139 leader_election.cc:343] T 0c537304c32c44adaa1e05de4496293f P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 0c537304c32c44adaa1e05de4496293f
I20260923 19:50:25.429219 6139 leader_election.cc:304] T 0c537304c32c44adaa1e05de4496293f P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:25.430109 7907 raft_consensus.cc:2749] T 0c537304c32c44adaa1e05de4496293f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:25.437081 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 9e341a8bf3324ac4811b90e6653cfd4c
I20260923 19:50:25.437580 5797 catalog_manager.cc:6934] ReplaceTablet: tablet 9e341a8bf3324ac4811b90e6653cfd4c deleted and replaced by tablet 8e024b37ac9649c680f02c9862fdc154
I20260923 19:50:25.437918 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_74b0524a0e6a4857b375240e40313049"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:25.438470 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_74b0524a0e6a4857b375240e40313049 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:25.439906 6307 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e341a8bf3324ac4811b90e6653cfd4c with delete_type TABLET_DATA_DELETED (replaced by tablet 8e024b37ac9649c680f02c9862fdc154) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:25.440160 6035 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e341a8bf3324ac4811b90e6653cfd4c with delete_type TABLET_DATA_DELETED (replaced by tablet 8e024b37ac9649c680f02c9862fdc154) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:25.441009 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 9e341a8bf3324ac4811b90e6653cfd4c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e341a8bf3324ac4811b90e6653cfd4c already in progress: creating tablet
I20260923 19:50:25.443086 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e341a8bf3324ac4811b90e6653cfd4c with delete_type TABLET_DATA_DELETED (replaced by tablet 8e024b37ac9649c680f02c9862fdc154) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:25.447880 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet a6f344e2095145b8a3670c99049030ef
I20260923 19:50:25.448753 7822 raft_consensus.cc:493] T c5cb76fa5e084604aa58bf888cfe4852 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:25.448928 6307 tablet_service.cc:1558] Processing DeleteTablet for tablet a6f344e2095145b8a3670c99049030ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:25 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:25.448945 7822 raft_consensus.cc:515] T c5cb76fa5e084604aa58bf888cfe4852 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:25.449723 7822 leader_election.cc:290] T c5cb76fa5e084604aa58bf888cfe4852 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:25.450526 6459 ts_tablet_manager.cc:1929] T b18548ba557f448880c5e617fc03cbe0 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:25.450439 6035 tablet_service.cc:1558] Processing DeleteTablet for tablet a6f344e2095145b8a3670c99049030ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:25 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:25.450644 6459 log.cc:1199] T b18548ba557f448880c5e617fc03cbe0 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/b18548ba557f448880c5e617fc03cbe0
I20260923 19:50:25.450663 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5cb76fa5e084604aa58bf888cfe4852" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:25.450960 6459 ts_tablet_manager.cc:1950] T b18548ba557f448880c5e617fc03cbe0 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:25.451260 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1034) took 2278 ms. Trace:
I20260923 19:50:25.451339 6459 rpcz_store.cc:276] 0923 19:50:23.173582 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:23.173804 (+ 222us) service_pool.cc:224] Handling call
0923 19:50:25.353367 (+2179563us) ts_tablet_manager.cc:1151] Deleting tablet b18548ba557f448880c5e617fc03cbe0
0923 19:50:25.353379 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.370788 (+ 17409us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:25.450462 (+ 79674us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:25.451246 (+ 784us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2179399}
W20260923 19:50:25.451440 6280 leader_election.cc:343] T c5cb76fa5e084604aa58bf888cfe4852 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:25.451648 6459 tablet_replica.cc:333] T b87872fb6cc0400c86eddffb29c898e8 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
W20260923 19:50:25.451601 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet a6f344e2095145b8a3670c99049030ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a6f344e2095145b8a3670c99049030ef already in progress: creating tablet
W20260923 19:50:25.451728 6279 leader_election.cc:343] T c5cb76fa5e084604aa58bf888cfe4852 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: c5cb76fa5e084604aa58bf888cfe4852
I20260923 19:50:25.451836 6459 raft_consensus.cc:2243] T b87872fb6cc0400c86eddffb29c898e8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:25.451808 6279 leader_election.cc:304] T c5cb76fa5e084604aa58bf888cfe4852 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:25.451972 6459 raft_consensus.cc:2272] T b87872fb6cc0400c86eddffb29c898e8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:25.452346 7822 raft_consensus.cc:2749] T c5cb76fa5e084604aa58bf888cfe4852 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:25.452482 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet a6f344e2095145b8a3670c99049030ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:25 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:25.452790 6456 tablet_bootstrap.cc:654] T f8052b05169b4673b387ac8b716ffc4e P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:25.452924 7822 raft_consensus.cc:493] T ba639d8c68cf49a49a5ec5729143cf6b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:25.453032 7822 raft_consensus.cc:515] T ba639d8c68cf49a49a5ec5729143cf6b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:25.453696 7822 leader_election.cc:290] T ba639d8c68cf49a49a5ec5729143cf6b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:25.454696 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba639d8c68cf49a49a5ec5729143cf6b" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:25.455168 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet b18548ba557f448880c5e617fc03cbe0 (table default.Table_b7610081818744a5b76680621ab7212d [id=8b14917d9dc6415dbb75917bccf09502]) successfully deleted
W20260923 19:50:25.455621 6280 leader_election.cc:343] T ba639d8c68cf49a49a5ec5729143cf6b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:25.455883 6279 leader_election.cc:343] T ba639d8c68cf49a49a5ec5729143cf6b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: ba639d8c68cf49a49a5ec5729143cf6b
I20260923 19:50:25.455960 6279 leader_election.cc:304] T ba639d8c68cf49a49a5ec5729143cf6b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:25.456545 7256 raft_consensus.cc:2749] T ba639d8c68cf49a49a5ec5729143cf6b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:25.452507 6459 ts_tablet_manager.cc:1916] T b87872fb6cc0400c86eddffb29c898e8 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:25.457795 5799 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 08d0508347964f0b8544e5ed5a2664f7 consensus state has no leader
I20260923 19:50:25.460345 6454 tablet_bootstrap.cc:492] T e1de117713f34b51bbda0c712f0b837c P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:25.460562 6454 ts_tablet_manager.cc:1403] T e1de117713f34b51bbda0c712f0b837c P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.064s user 0.002s sys 0.003s
I20260923 19:50:25.461472 6454 raft_consensus.cc:359] T e1de117713f34b51bbda0c712f0b837c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.461723 6454 raft_consensus.cc:385] T e1de117713f34b51bbda0c712f0b837c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:25.461817 6454 raft_consensus.cc:740] T e1de117713f34b51bbda0c712f0b837c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:25.462121 6454 consensus_queue.cc:260] T e1de117713f34b51bbda0c712f0b837c P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.462771 6454 ts_tablet_manager.cc:1434] T e1de117713f34b51bbda0c712f0b837c P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:25.463088 6454 tablet_bootstrap.cc:492] T 1c43641327d14a888a2815e49a2762c8 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:25.463501 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet b18ddbbf3ce84927bc330b8affc37bb8
I20260923 19:50:25.463973 5798 catalog_manager.cc:6934] ReplaceTablet: tablet b18ddbbf3ce84927bc330b8affc37bb8 deleted and replaced by tablet 79dba8873a0b44e29a1facac6993ab83
I20260923 19:50:25.464603 6307 tablet_service.cc:1558] Processing DeleteTablet for tablet b18ddbbf3ce84927bc330b8affc37bb8 with delete_type TABLET_DATA_DELETED (replaced by tablet 79dba8873a0b44e29a1facac6993ab83) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:25.465202 6035 tablet_service.cc:1558] Processing DeleteTablet for tablet b18ddbbf3ce84927bc330b8affc37bb8 with delete_type TABLET_DATA_DELETED (replaced by tablet 79dba8873a0b44e29a1facac6993ab83) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:25.465790 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet b18ddbbf3ce84927bc330b8affc37bb8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b18ddbbf3ce84927bc330b8affc37bb8 already in progress: creating tablet
I20260923 19:50:25.466765 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet b18ddbbf3ce84927bc330b8affc37bb8 with delete_type TABLET_DATA_DELETED (replaced by tablet 79dba8873a0b44e29a1facac6993ab83) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:25.467044 7816 raft_consensus.cc:493] T 195d4fe5f92e4e2c9330dce34c303723 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:25.467180 7816 raft_consensus.cc:515] T 195d4fe5f92e4e2c9330dce34c303723 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.467806 7816 leader_election.cc:290] T 195d4fe5f92e4e2c9330dce34c303723 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:25.468137 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195d4fe5f92e4e2c9330dce34c303723" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:25.468713 5995 leader_election.cc:343] T 195d4fe5f92e4e2c9330dce34c303723 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:25.468966 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195d4fe5f92e4e2c9330dce34c303723" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:25.469219 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_947cffda0c1f456ebfc9420e5b6e9865" } new_table_name: "default.Table_996e325c584342eeae95e30ad520d442" modify_external_catalogs: true
I20260923 19:50:25.469457 6456 tablet_bootstrap.cc:492] T f8052b05169b4673b387ac8b716ffc4e P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:25.469632 6456 ts_tablet_manager.cc:1403] T f8052b05169b4673b387ac8b716ffc4e P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.053s user 0.005s sys 0.000s
W20260923 19:50:25.470707 5996 leader_election.cc:343] T 195d4fe5f92e4e2c9330dce34c303723 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:25.470813 5996 leader_election.cc:304] T 195d4fe5f92e4e2c9330dce34c303723 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:25.471228 7816 raft_consensus.cc:2749] T 195d4fe5f92e4e2c9330dce34c303723 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:25.471138 6456 raft_consensus.cc:359] T f8052b05169b4673b387ac8b716ffc4e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:25.471342 6456 raft_consensus.cc:385] T f8052b05169b4673b387ac8b716ffc4e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:25.471393 6456 raft_consensus.cc:740] T f8052b05169b4673b387ac8b716ffc4e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:25.471743 6456 consensus_queue.cc:260] T f8052b05169b4673b387ac8b716ffc4e P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:25.478372 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_bfe6c835a29043e8bad71da711286f80"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:25.484345 6456 ts_tablet_manager.cc:1434] T f8052b05169b4673b387ac8b716ffc4e P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.015s user 0.000s sys 0.002s
W20260923 19:50:25.480681 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet df10596a5ce94240bd84af2504de105b consensus state has no leader
I20260923 19:50:25.486400 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_07770b1d25f549b5bda7cb16b2dde82c" } modify_external_catalogs: true
I20260923 19:50:25.490518 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_07770b1d25f549b5bda7cb16b2dde82c" } modify_external_catalogs: true
I20260923 19:50:25.486775 5797 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d50291ec9ea0471fa057aa648cf81187" } new_table_name: "default.Table_109f722faaec490ea2199f56c861a916" modify_external_catalogs: true
I20260923 19:50:25.488133 5802 catalog_manager.cc:5838] T 397ec5e49673406cb26a2efab0ad8401 P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } }
I20260923 19:50:25.493619 5802 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 397ec5e49673406cb26a2efab0ad8401 (table default.Table_92f3bea4e4164a738fb75f01e95cd776 [id=0b80967a8fb94518ad872fbce9bae934]). Expected version 1 got 0
I20260923 19:50:25.493968 5802 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet f1f1df47dc32413d9cc9456f4198dca5 (table default.Table_5c873b003c7b4b09ba69db7f039b2f98 [id=6d285eda96a948b2b14fa1ef456ca5b2]). Expected version 2 got 0
I20260923 19:50:25.494274 5802 catalog_manager.cc:5838] T 0e650824e4ae474787faeb6c22a4b43f P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } }
I20260923 19:50:25.494445 6456 tablet_bootstrap.cc:492] T 2852e91ccd0c44b3b16f8189e57575d7 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:25.494628 5802 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 0e650824e4ae474787faeb6c22a4b43f (table default.Table_5264e08e4d19494aae8757ffbfebbc33 [id=bf2950f7469241d390951965f4e98f23]). Expected version 2 got 0
W20260923 19:50:25.495203 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0e650824e4ae474787faeb6c22a4b43f consensus state has no leader
I20260923 19:50:25.496253 6456 tablet_bootstrap.cc:654] T 2852e91ccd0c44b3b16f8189e57575d7 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:25.500540 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bfe6c835a29043e8bad71da711286f80 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:25.502653 6454 tablet_bootstrap.cc:654] T 1c43641327d14a888a2815e49a2762c8 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:25.515027 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_4820a4a930d94d4d92963650458308ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:25.515681 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4820a4a930d94d4d92963650458308ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:25.518676 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet bec98cea4c254d5c9186acbbc7212159
I20260923 19:50:25.519850 6035 tablet_service.cc:1558] Processing DeleteTablet for tablet bec98cea4c254d5c9186acbbc7212159 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:25 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:25.520797 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet bec98cea4c254d5c9186acbbc7212159 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bec98cea4c254d5c9186acbbc7212159 already in progress: creating tablet
I20260923 19:50:25.521538 5805 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 1c43641327d14a888a2815e49a2762c8 (table default.Table_6a56e4926a7b43d29a2cc015f69e8684 [id=923a67e6f6534f4da28ce819cecd9171]). Expected version 2 got 0
I20260923 19:50:25.521803 5805 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 0f90406b20f54787bd27255d5ae81d1c (table default.Table_8aad9ce166cb40659479e35cbcbf1d88 [id=cec162ada3144aaba98196d363cf587d]). Expected version 1 got 0
I20260923 19:50:25.523463 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 1ea8f44ac03b4ad196725f871a615cdd
I20260923 19:50:25.524194 6307 tablet_service.cc:1558] Processing DeleteTablet for tablet bec98cea4c254d5c9186acbbc7212159 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:25 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:25.524231 6035 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ea8f44ac03b4ad196725f871a615cdd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:25 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:25.524459 6461 tablet_replica.cc:333] T 1ea8f44ac03b4ad196725f871a615cdd P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:25.524653 6461 raft_consensus.cc:2243] T 1ea8f44ac03b4ad196725f871a615cdd P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:25.524816 6461 raft_consensus.cc:2272] T 1ea8f44ac03b4ad196725f871a615cdd P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:25.524991 6307 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ea8f44ac03b4ad196725f871a615cdd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:25 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:25.525401 6461 ts_tablet_manager.cc:1916] T 1ea8f44ac03b4ad196725f871a615cdd P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:25.525331 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_4d3f70d60f474c138c2004b1131b8cb6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:25.525861 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d3f70d60f474c138c2004b1131b8cb6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:25.527140 5797 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5272f93fad4944679302f94257d422ed consensus state has no leader
I20260923 19:50:25.530747 5797 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 34d62ab3d4aa457f8fea283cd9248a41 (table default.Table_71d7f590efb94aae8c345f9d9a620fc1 [id=b4e8e3f2a48a4b5496f506080b415805]). Expected version 1 got 0
I20260923 19:50:25.532645 6457 tablet_bootstrap.cc:492] T 1cf016ff0bb8418d84358d17876338bf P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:25.532850 6457 ts_tablet_manager.cc:1403] T 1cf016ff0bb8418d84358d17876338bf P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.212s user 0.007s sys 0.000s
I20260923 19:50:25.533684 6457 raft_consensus.cc:359] T 1cf016ff0bb8418d84358d17876338bf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.533959 6457 raft_consensus.cc:385] T 1cf016ff0bb8418d84358d17876338bf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:25.534062 6457 raft_consensus.cc:740] T 1cf016ff0bb8418d84358d17876338bf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:25.534374 6457 consensus_queue.cc:260] T 1cf016ff0bb8418d84358d17876338bf P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.534513 6461 ts_tablet_manager.cc:1929] T 1ea8f44ac03b4ad196725f871a615cdd P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:25.537199 6461 log.cc:1199] T 1ea8f44ac03b4ad196725f871a615cdd P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/1ea8f44ac03b4ad196725f871a615cdd
I20260923 19:50:25.537791 6461 ts_tablet_manager.cc:1950] T 1ea8f44ac03b4ad196725f871a615cdd P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:25.537457 6457 ts_tablet_manager.cc:1434] T 1cf016ff0bb8418d84358d17876338bf P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260923 19:50:25.540952 6307 tablet_service.cc:1511] Processing CreateTablet for tablet 179a7b6f19f642d39769c561b3d0b1f5 (DEFAULT_TABLE table=default.Table_7a5e4088446642aea66feb7e9eb3a838 [id=3b5fa8a53acd4b608660b7387acfe52f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.541368 6307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 179a7b6f19f642d39769c561b3d0b1f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.544695 6028 tablet_service.cc:1511] Processing CreateTablet for tablet c1eabd3d87954a11884aeddd87d4d361 (DEFAULT_TABLE table=default.Table_a866cbd7e738424386654931f545b7ce [id=a253a7348a2a41ba95fbd5420096ae6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.545127 6040 tablet_service.cc:1511] Processing CreateTablet for tablet d5b7f569dcfc42ea95e6d276a6c04697 (DEFAULT_TABLE table=default.Table_1cb75514d89441e7ae379bc433c84806 [id=5206b4c5769740afbac8812fbe7ffa45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.545444 6035 tablet_service.cc:1511] Processing CreateTablet for tablet 179a7b6f19f642d39769c561b3d0b1f5 (DEFAULT_TABLE table=default.Table_7a5e4088446642aea66feb7e9eb3a838 [id=3b5fa8a53acd4b608660b7387acfe52f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.544695 6039 tablet_service.cc:1511] Processing CreateTablet for tablet 8eead6121971426797a0e7d7061c3005 (DEFAULT_TABLE table=default.Table_d6b2211da5d34c2aa2488f78bf0201ff [id=a2c2b243c14043819abfe390ada381dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.547269 6310 tablet_service.cc:1511] Processing CreateTablet for tablet d5b7f569dcfc42ea95e6d276a6c04697 (DEFAULT_TABLE table=default.Table_1cb75514d89441e7ae379bc433c84806 [id=5206b4c5769740afbac8812fbe7ffa45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.547447 6321 tablet_service.cc:1511] Processing CreateTablet for tablet c1eabd3d87954a11884aeddd87d4d361 (DEFAULT_TABLE table=default.Table_a866cbd7e738424386654931f545b7ce [id=a253a7348a2a41ba95fbd5420096ae6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.547612 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 4952cee21fe9402db99783e05ffaffd5 (DEFAULT_TABLE table=default.Table_4aca5f24bf294b299ec64c356296aa31 [id=5ca8217e977d4d99936ad04fd341dc74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.547689 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5b7f569dcfc42ea95e6d276a6c04697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.547935 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4952cee21fe9402db99783e05ffaffd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.548072 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1eabd3d87954a11884aeddd87d4d361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.548122 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1eabd3d87954a11884aeddd87d4d361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.548199 6317 tablet_service.cc:1511] Processing CreateTablet for tablet 8eead6121971426797a0e7d7061c3005 (DEFAULT_TABLE table=default.Table_d6b2211da5d34c2aa2488f78bf0201ff [id=a2c2b243c14043819abfe390ada381dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.548482 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eead6121971426797a0e7d7061c3005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.554721 5804 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_98fa8b434d3c43fe98c6a4bd5690233e" } modify_external_catalogs: true
I20260923 19:50:25.554924 5804 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_98fa8b434d3c43fe98c6a4bd5690233e" } modify_external_catalogs: true
I20260923 19:50:25.555199 6040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5b7f569dcfc42ea95e6d276a6c04697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.558442 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eead6121971426797a0e7d7061c3005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.564162 6458 ts_tablet_manager.cc:1929] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:50:25.564386 6458 log.cc:1199] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/0a5ce253bcce410b9517449f133d39e8
I20260923 19:50:25.564815 6458 ts_tablet_manager.cc:1950] T 0a5ce253bcce410b9517449f133d39e8 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:25.566181 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 0a5ce253bcce410b9517449f133d39e8 (table default.Table_84d13e1ea6234e5ca45738376e83f537 [id=0d4f6a5bb30c4d2a937424cf0e651afd]) successfully deleted
I20260923 19:50:25.567121 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 179a7b6f19f642d39769c561b3d0b1f5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:25.568048 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 00eba27e9f2948e8a298c3fbca52a282 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 00eba27e9f2948e8a298c3fbca52a282 already in progress: creating tablet
I20260923 19:50:25.568346 6456 tablet_bootstrap.cc:492] T 2852e91ccd0c44b3b16f8189e57575d7 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:25.568532 6456 ts_tablet_manager.cc:1403] T 2852e91ccd0c44b3b16f8189e57575d7 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.081s user 0.000s sys 0.006s
W20260923 19:50:25.568638 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 401061423caf48639929bd8864c53218 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 401061423caf48639929bd8864c53218 already in progress: creating tablet
W20260923 19:50:25.569190 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 8e95ec2f36be418fa2f042cd14b7a8bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8e95ec2f36be418fa2f042cd14b7a8bd already in progress: creating tablet
I20260923 19:50:25.569207 6456 raft_consensus.cc:359] T 2852e91ccd0c44b3b16f8189e57575d7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:25.569365 6456 raft_consensus.cc:385] T 2852e91ccd0c44b3b16f8189e57575d7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:25.569410 6456 raft_consensus.cc:740] T 2852e91ccd0c44b3b16f8189e57575d7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:25.570176 6456 consensus_queue.cc:260] T 2852e91ccd0c44b3b16f8189e57575d7 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
W20260923 19:50:25.571370 6280 consensus_peers.cc:597] T 0e650824e4ae474787faeb6c22a4b43f P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260923 19:50:25.572561 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 9e341a8bf3324ac4811b90e6653cfd4c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e341a8bf3324ac4811b90e6653cfd4c already in progress: creating tablet
I20260923 19:50:25.572815 6056 raft_consensus.cc:1275] T 0e650824e4ae474787faeb6c22a4b43f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Refusing update from remote peer 2bf41435f70447f19992d368ca6b46bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 19:50:25.573319 7822 consensus_queue.cc:1048] T 0e650824e4ae474787faeb6c22a4b43f P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260923 19:50:25.574961 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet a6f344e2095145b8a3670c99049030ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a6f344e2095145b8a3670c99049030ef already in progress: creating tablet
W20260923 19:50:25.580782 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet b18ddbbf3ce84927bc330b8affc37bb8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b18ddbbf3ce84927bc330b8affc37bb8 already in progress: creating tablet
W20260923 19:50:25.581559 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet bec98cea4c254d5c9186acbbc7212159 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bec98cea4c254d5c9186acbbc7212159 already in progress: creating tablet
W20260923 19:50:25.582171 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 1ea8f44ac03b4ad196725f871a615cdd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ea8f44ac03b4ad196725f871a615cdd already in progress: creating tablet
I20260923 19:50:25.588614 6457 tablet_bootstrap.cc:492] T 431ad4da27544d68aa5666293984a86a P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:25.590631 5802 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_1e9ebf5c3c644666a5b6c1966fde4ed5 [id=5f2289c487ba40b9b7954c9d56918687] alter complete (version 1)
I20260923 19:50:25.591817 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ea8f44ac03b4ad196725f871a615cdd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:25 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:25.570266 6183 tablet_service.cc:1558] Processing DeleteTablet for tablet bec98cea4c254d5c9186acbbc7212159 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:25 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:25.592376 6457 tablet_bootstrap.cc:654] T 431ad4da27544d68aa5666293984a86a P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:25.592948 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 179a7b6f19f642d39769c561b3d0b1f5 (DEFAULT_TABLE table=default.Table_7a5e4088446642aea66feb7e9eb3a838 [id=3b5fa8a53acd4b608660b7387acfe52f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.593343 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 179a7b6f19f642d39769c561b3d0b1f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.591455 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_cbdb3225a2c4411391fab85ddca7581a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:25.594558 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cbdb3225a2c4411391fab85ddca7581a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:25.591678 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 1ea8f44ac03b4ad196725f871a615cdd (table default.Table_1fc9244b78694fdc9006399969d4f536 [id=56a9dcfc6ce14302ad8b4418f0bbddee]) successfully deleted
I20260923 19:50:25.596834 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_55039e3011ca4782bd5f610f27ae4e16"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:25.597338 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55039e3011ca4782bd5f610f27ae4e16 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:25.598548 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_8a50df2ec8c1421794b661a73a368eab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:25.599006 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a50df2ec8c1421794b661a73a368eab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:25.600147 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b86593b9d27b4c5180563a796c645133" } new_table_name: "default.Table_1795108fe99e4c84a6562961ad00181d" modify_external_catalogs: true
I20260923 19:50:25.601293 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_10603cbcd11d4a48a3916fd7894dcf76"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:25.601727 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10603cbcd11d4a48a3916fd7894dcf76 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:25.604499 5805 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_71d7f590efb94aae8c345f9d9a620fc1 [id=b4e8e3f2a48a4b5496f506080b415805] alter complete (version 1)
I20260923 19:50:25.612329 7966 tablet.cc:1751] T 0e650824e4ae474787faeb6c22a4b43f P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260923 19:50:25.614455 6033 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ea8f44ac03b4ad196725f871a615cdd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:25 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:25.615281 6040 tablet_service.cc:1558] Processing DeleteTablet for tablet 373d6442546d41e2b5567dfc92ae07b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:25.617094 6035 tablet_service.cc:1558] Processing DeleteTablet for tablet 37769256de33432697e9d4fb235f473f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:17 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:25.617347 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 772ece5283a949408d849f6e56f5f17b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:25.613039 5805 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.5.143.193:35179 (request call id 199) took 942 ms (client timeout 1000 ms). Trace:
I20260923 19:50:25.617594 6039 tablet_service.cc:1558] Processing DeleteTablet for tablet 559f3e3016aa470f9732a727b4528586 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:25.618219 6461 tablet_replica.cc:333] T 373d6442546d41e2b5567dfc92ae07b1 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:25.618477 6461 raft_consensus.cc:2243] T 373d6442546d41e2b5567dfc92ae07b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:25.618690 6461 raft_consensus.cc:2272] T 373d6442546d41e2b5567dfc92ae07b1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:25.617427 5805 rpcz_store.cc:269] 0923 19:50:24.670714 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:24.880216 (+209502us) service_pool.cc:224] Handling call
0923 19:50:24.945691 (+ 65475us) spinlock_profiling.cc:243] Waited 64.8 ms on lock 0x616000022954. stack: 00007f7983c95366 00007f7983c95120 00007f7982c9f34d 00000000009a4cb4 00000000009a4c7d 00007f799320f65d 00007f799320f753 00007f798fd8cdb1 00007f7997b7bacd 00007f7997d05738 00007f798e6d91f6 00007f798e6d8f25 00007f798addf63e 00007f798adde51e 00007f798ade4758 00007f798ade50bf
0923 19:50:25.613015 (+667324us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0923 19:50:25.580171 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0923 19:50:25.580286 (+ 115us) write_op.cc:432] Acquiring schema lock in shared mode
0923 19:50:25.580291 (+ 5us) write_op.cc:435] Acquired schema lock
0923 19:50:25.580294 (+ 3us) tablet.cc:662] Decoding operations
0923 19:50:25.580388 (+ 94us) write_op.cc:620] Acquiring the partition lock for write op
0923 19:50:25.580400 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0923 19:50:25.580406 (+ 6us) tablet.cc:685] Acquiring locks for 1 operations
0923 19:50:25.580481 (+ 75us) tablet.cc:701] Row locks acquired
0923 19:50:25.580485 (+ 4us) write_op.cc:260] PREPARE: finished
0923 19:50:25.580520 (+ 35us) write_op.cc:270] Start()
0923 19:50:25.580606 (+ 86us) write_op.cc:276] Timestamp: P: 1790193025580484 usec, L: 0
0923 19:50:25.580610 (+ 4us) op_driver.cc:348] REPLICATION: starting
0923 19:50:25.580770 (+ 160us) log.cc:844] Serialized 356 byte log entry
0923 19:50:25.596456 (+ 15686us) op_driver.cc:464] REPLICATION: finished
0923 19:50:25.603904 (+ 7448us) write_op.cc:301] APPLY: starting
0923 19:50:25.603933 (+ 29us) tablet.cc:1394] starting BulkCheckPresence
0923 19:50:25.603976 (+ 43us) tablet.cc:1397] finished BulkCheckPresence
0923 19:50:25.604002 (+ 26us) tablet.cc:1399] starting ApplyRowOperation cycle
0923 19:50:25.604059 (+ 57us) tablet.cc:1410] finished ApplyRowOperation cycle
0923 19:50:25.604092 (+ 33us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0923 19:50:25.604100 (+ 8us) write_op.cc:312] APPLY: finished
0923 19:50:25.604187 (+ 87us) log.cc:844] Serialized 23 byte log entry
0923 19:50:25.604258 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0923 19:50:25.604298 (+ 40us) write_op.cc:454] Released schema lock
0923 19:50:25.604305 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":9,"spinlock_wait_cycles":149004160,"child_traces":[["op",{"apply.queue_time_us":7366,"apply.run_cpu_time_us":473,"apply.run_wall_time_us":474,"num_ops":1,"prepare.queue_time_us":56834,"raft.queue_time_us":6329,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"replication_time_us":15816}]]}
I20260923 19:50:25.619256 6461 ts_tablet_manager.cc:1916] T 373d6442546d41e2b5567dfc92ae07b1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:25.622318 5790 catalog_manager.cc:5030] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 1ea8f44ac03b4ad196725f871a615cdd because the tablet was not found. No further retry: Not found: Tablet not found: 1ea8f44ac03b4ad196725f871a615cdd
I20260923 19:50:25.626322 6181 tablet_service.cc:1511] Processing CreateTablet for tablet c1eabd3d87954a11884aeddd87d4d361 (DEFAULT_TABLE table=default.Table_a866cbd7e738424386654931f545b7ce [id=a253a7348a2a41ba95fbd5420096ae6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.626765 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1eabd3d87954a11884aeddd87d4d361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.631793 5797 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 34d62ab3d4aa457f8fea283cd9248a41 (table default.Table_71d7f590efb94aae8c345f9d9a620fc1 [id=b4e8e3f2a48a4b5496f506080b415805]). Expected version 1 got 0
I20260923 19:50:25.632031 5797 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet d39a64531dd24eb4aa1f7e0c418b985b (table default.Table_03f41ae74ce143c480c51cb8296efa58 [id=a56799b0709846cf8308d7d7b727427c]). Expected version 3 got 0
I20260923 19:50:25.615944 6456 ts_tablet_manager.cc:1434] T 2852e91ccd0c44b3b16f8189e57575d7 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.047s user 0.002s sys 0.000s
I20260923 19:50:25.635164 6457 tablet_bootstrap.cc:492] T 431ad4da27544d68aa5666293984a86a P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:25.635372 6457 ts_tablet_manager.cc:1403] T 431ad4da27544d68aa5666293984a86a P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.047s user 0.004s sys 0.000s
I20260923 19:50:25.636303 6456 tablet_bootstrap.cc:492] T 40adb472162042e48fdbb496b342996a P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:25.636296 6457 raft_consensus.cc:359] T 431ad4da27544d68aa5666293984a86a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.636557 6457 raft_consensus.cc:385] T 431ad4da27544d68aa5666293984a86a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:25.636668 6457 raft_consensus.cc:740] T 431ad4da27544d68aa5666293984a86a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:25.636965 6457 consensus_queue.cc:260] T 431ad4da27544d68aa5666293984a86a P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.637621 6457 ts_tablet_manager.cc:1434] T 431ad4da27544d68aa5666293984a86a P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:25.637738 5805 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_833ecfe514c54532bb2adee3323149cc" } modify_external_catalogs: true
I20260923 19:50:25.637929 5805 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_833ecfe514c54532bb2adee3323149cc" } modify_external_catalogs: true
I20260923 19:50:25.638705 6456 tablet_bootstrap.cc:654] T 40adb472162042e48fdbb496b342996a P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:25.640082 7822 raft_consensus.cc:493] T 21bf33904ede470b80a074dc9a458baf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:25.640209 7822 raft_consensus.cc:515] T 21bf33904ede470b80a074dc9a458baf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:25.640820 7822 leader_election.cc:290] T 21bf33904ede470b80a074dc9a458baf P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:25.642189 6179 tablet_service.cc:1511] Processing CreateTablet for tablet d5b7f569dcfc42ea95e6d276a6c04697 (DEFAULT_TABLE table=default.Table_1cb75514d89441e7ae379bc433c84806 [id=5206b4c5769740afbac8812fbe7ffa45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.642608 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5b7f569dcfc42ea95e6d276a6c04697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.645393 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_472f6ecd2ddf44129fec7370987e98e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:25.645869 6166 tablet_service.cc:1511] Processing CreateTablet for tablet 8eead6121971426797a0e7d7061c3005 (DEFAULT_TABLE table=default.Table_d6b2211da5d34c2aa2488f78bf0201ff [id=a2c2b243c14043819abfe390ada381dd]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:25.645963 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_472f6ecd2ddf44129fec7370987e98e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:25.646287 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eead6121971426797a0e7d7061c3005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.647895 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 4952cee21fe9402db99783e05ffaffd5 (DEFAULT_TABLE table=default.Table_4aca5f24bf294b299ec64c356296aa31 [id=5ca8217e977d4d99936ad04fd341dc74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.648229 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4952cee21fe9402db99783e05ffaffd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.649982 7967 tablet.cc:1751] T 0e650824e4ae474787faeb6c22a4b43f P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260923 19:50:25.653187 6177 tablet_service.cc:1558] Processing DeleteTablet for tablet e1de117713f34b51bbda0c712f0b837c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:05 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:25.657397 6457 tablet_bootstrap.cc:492] T 1985088eb56b40c1aeecc1ec7409bcdf P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:25.658725 6459 ts_tablet_manager.cc:1929] T b87872fb6cc0400c86eddffb29c898e8 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:25.658850 6459 log.cc:1199] T b87872fb6cc0400c86eddffb29c898e8 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/b87872fb6cc0400c86eddffb29c898e8
I20260923 19:50:25.659150 6459 ts_tablet_manager.cc:1950] T b87872fb6cc0400c86eddffb29c898e8 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
W20260923 19:50:25.661386 6279 leader_election.cc:343] T 21bf33904ede470b80a074dc9a458baf P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 21bf33904ede470b80a074dc9a458baf
I20260923 19:50:25.679344 6461 ts_tablet_manager.cc:1929] T 373d6442546d41e2b5567dfc92ae07b1 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:25.681624 7816 raft_consensus.cc:493] T 40adb472162042e48fdbb496b342996a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:25.685431 7816 raft_consensus.cc:515] T 40adb472162042e48fdbb496b342996a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:25.685487 6461 log.cc:1199] T 373d6442546d41e2b5567dfc92ae07b1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/373d6442546d41e2b5567dfc92ae07b1
I20260923 19:50:25.686167 7816 leader_election.cc:290] T 40adb472162042e48fdbb496b342996a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:25.686830 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40adb472162042e48fdbb496b342996a" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:25.687407 5996 leader_election.cc:343] T 40adb472162042e48fdbb496b342996a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:25.688844 6456 tablet_bootstrap.cc:492] T 40adb472162042e48fdbb496b342996a P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:25.689049 6456 ts_tablet_manager.cc:1403] T 40adb472162042e48fdbb496b342996a P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.053s user 0.004s sys 0.000s
I20260923 19:50:25.689992 7816 raft_consensus.cc:493] T 431ad4da27544d68aa5666293984a86a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:25.690129 7816 raft_consensus.cc:515] T 431ad4da27544d68aa5666293984a86a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.690800 6456 raft_consensus.cc:359] T 40adb472162042e48fdbb496b342996a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:25.690954 6456 raft_consensus.cc:385] T 40adb472162042e48fdbb496b342996a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:25.691006 6456 raft_consensus.cc:740] T 40adb472162042e48fdbb496b342996a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:25.691191 7816 leader_election.cc:290] T 431ad4da27544d68aa5666293984a86a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:25.691244 6456 consensus_queue.cc:260] T 40adb472162042e48fdbb496b342996a P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:25.692426 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431ad4da27544d68aa5666293984a86a" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:25.694428 6456 ts_tablet_manager.cc:1434] T 40adb472162042e48fdbb496b342996a P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
W20260923 19:50:25.694466 5996 leader_election.cc:343] T 431ad4da27544d68aa5666293984a86a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:25.698529 6457 tablet_bootstrap.cc:654] T 1985088eb56b40c1aeecc1ec7409bcdf P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:25.702035 6456 tablet_bootstrap.cc:492] T 2526884ab0ef404aaf93051cc842c695 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:25.703892 6456 tablet_bootstrap.cc:654] T 2526884ab0ef404aaf93051cc842c695 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:25.704221 6461 ts_tablet_manager.cc:1950] T 373d6442546d41e2b5567dfc92ae07b1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:25.570061 7955 tablet.cc:1751] T 34d62ab3d4aa457f8fea283cd9248a41 P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260923 19:50:25.706563 6202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431ad4da27544d68aa5666293984a86a" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:25.706645 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40adb472162042e48fdbb496b342996a" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:25.706779 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1028) took 2539 ms. Trace:
W20260923 19:50:25.707202 5995 leader_election.cc:343] T 40adb472162042e48fdbb496b342996a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:25.707389 5995 leader_election.cc:304] T 40adb472162042e48fdbb496b342996a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:25.707572 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21bf33904ede470b80a074dc9a458baf" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:25.707968 5995 leader_election.cc:343] T 431ad4da27544d68aa5666293984a86a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:25.708077 5995 leader_election.cc:304] T 431ad4da27544d68aa5666293984a86a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:25.590967 6454 tablet_bootstrap.cc:492] T 1c43641327d14a888a2815e49a2762c8 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:25.708472 7816 raft_consensus.cc:2749] T 40adb472162042e48fdbb496b342996a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:25.708684 7816 raft_consensus.cc:2749] T 431ad4da27544d68aa5666293984a86a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:25.708933 6454 ts_tablet_manager.cc:1403] T 1c43641327d14a888a2815e49a2762c8 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.246s user 0.003s sys 0.002s
I20260923 19:50:25.710839 7947 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 83e97b26500048d0b75350a21a8ff96b)
I20260923 19:50:25.711248 7947 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } }
I20260923 19:50:25.709674 6454 raft_consensus.cc:359] T 1c43641327d14a888a2815e49a2762c8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.713104 6454 raft_consensus.cc:385] T 1c43641327d14a888a2815e49a2762c8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:25.713167 6454 raft_consensus.cc:740] T 1c43641327d14a888a2815e49a2762c8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:25.713413 6454 consensus_queue.cc:260] T 1c43641327d14a888a2815e49a2762c8 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.713944 6454 ts_tablet_manager.cc:1434] T 1c43641327d14a888a2815e49a2762c8 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260923 19:50:25.714046 6461 tablet_replica.cc:333] T 37769256de33432697e9d4fb235f473f P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:25.714242 6461 raft_consensus.cc:2243] T 37769256de33432697e9d4fb235f473f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:25.714406 6461 raft_consensus.cc:2272] T 37769256de33432697e9d4fb235f473f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:25.708106 6280 leader_election.cc:343] T 21bf33904ede470b80a074dc9a458baf P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:25.714529 6280 leader_election.cc:304] T 21bf33904ede470b80a074dc9a458baf P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:25.714519 7911 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83e97b26500048d0b75350a21a8ff96b. Latest consensus state: current_term: 3 leader_uuid: "83e97b26500048d0b75350a21a8ff96b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } } }
I20260923 19:50:25.714771 7911 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [sys.catalog]: This master's current role is: FOLLOWER
I20260923 19:50:25.711347 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 232805e54a364d43ae295e93a226c1bb (DEFAULT_TABLE table=default.Table_3738a8a397604cfca0fe015c4efeefde [id=532b3b0aebf542f2afbf9b7de7a7bcd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.712908 6317 tablet_service.cc:1511] Processing CreateTablet for tablet be72a4922eb24bed80c7c2dae1b13cc1 (DEFAULT_TABLE table=default.Table_15ccf3f89ba546298c74fb37b949b192 [id=72db5fd0f88d4db3a63e7f72d4067bea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.715229 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 232805e54a364d43ae295e93a226c1bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.715397 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be72a4922eb24bed80c7c2dae1b13cc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.717826 7947 leader_election.cc:290] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83e97b26500048d0b75350a21a8ff96b (127.5.143.253:45285), 009ffee03a4d41db84df9f450aa84562 (127.5.143.252:45543)
I20260923 19:50:25.718166 7822 raft_consensus.cc:2749] T 21bf33904ede470b80a074dc9a458baf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:25.723210 6461 ts_tablet_manager.cc:1916] T 37769256de33432697e9d4fb235f473f P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:25.723749 6317 tablet_service.cc:1511] Processing CreateTablet for tablet a07de8cc9dd9404baaa4533a1ca02ae0 (DEFAULT_TABLE table=default.Table_1c62a72e74d344759378361cfe965e67 [id=0833a6f9afee4eaf95d38355a3096590]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.724124 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a07de8cc9dd9404baaa4533a1ca02ae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.726778 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 09792de9c452418781a4331ea1b0477c
I20260923 19:50:25.727577 6310 tablet_service.cc:1558] Processing DeleteTablet for tablet 09792de9c452418781a4331ea1b0477c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:25 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:25.727701 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_85cafca5571245479b8547e0b5a6cf47"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:25.728248 5792 catalog_manager.cc:5030] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 09792de9c452418781a4331ea1b0477c because the tablet was not found. No further retry: Not found: Tablet not found: 09792de9c452418781a4331ea1b0477c
W20260923 19:50:25.728420 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_85cafca5571245479b8547e0b5a6cf47 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:25.734763 5801 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 1cf016ff0bb8418d84358d17876338bf (table default.Table_527c2568db7446559d0c719602184b02 [id=9e398f48d86e4c5898cac7336d3c24bf]). Expected version 4 got 0
I20260923 19:50:25.735100 5801 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 195d4fe5f92e4e2c9330dce34c303723 (table default.Table_d42d1c583ed9482caaaf742a8a82f476 [id=57f2abae03734c489c96cda418f2bf54]). Expected version 2 got 0
I20260923 19:50:25.735710 5801 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet f1f1df47dc32413d9cc9456f4198dca5 (table default.Table_5c873b003c7b4b09ba69db7f039b2f98 [id=6d285eda96a948b2b14fa1ef456ca5b2]). Expected version 2 got 0
I20260923 19:50:25.736019 5801 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet f1c1d4f73488499a9e5add81e9d5e2d6 (table default.Table_7f7907c8e1bc4ad1ae68faf5f072b318 [id=80e3a84f7199464fa96426daeeeb84cd]). Expected version 2 got 0
I20260923 19:50:25.736276 5801 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 4e69656e9fc941e19eb7de5c87bc9050 (table default.Table_454977731aee4768be1b7437bb41c1ba [id=1337273e913b43e797c0fb356ca5085b]). Expected version 2 got 0
I20260923 19:50:25.736752 5801 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 664d849daee54b02b7b7e2bb340d92fa (table default.Table_5462319331504a0b829c0181aa5b0cd6 [id=3a747074a6a04ddbb009b135c67c25b0]). Expected version 1 got 0
I20260923 19:50:25.717955 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 232805e54a364d43ae295e93a226c1bb (DEFAULT_TABLE table=default.Table_3738a8a397604cfca0fe015c4efeefde [id=532b3b0aebf542f2afbf9b7de7a7bcd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.740401 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 232805e54a364d43ae295e93a226c1bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.743741 6307 tablet_service.cc:1511] Processing CreateTablet for tablet ff8e469f4cf24e1abaf6774a9c199c98 (DEFAULT_TABLE table=default.Table_fe0f6869307545d2807258b71107a778 [id=6cab12c5975d4e9e89110b041f53517f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.706940 6459 rpcz_store.cc:276] 0923 19:50:23.167448 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:23.167515 (+ 67us) service_pool.cc:224] Handling call
0923 19:50:25.451598 (+2284083us) ts_tablet_manager.cc:1151] Deleting tablet b87872fb6cc0400c86eddffb29c898e8
0923 19:50:25.451608 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.460856 (+ 9248us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:25.658664 (+197808us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:25.706722 (+ 48058us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2266401}
I20260923 19:50:25.744171 6307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff8e469f4cf24e1abaf6774a9c199c98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.744685 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1037) took 2397 ms. Trace:
I20260923 19:50:25.744789 6459 rpcz_store.cc:276] 0923 19:50:23.347105 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:23.347239 (+ 134us) service_pool.cc:224] Handling call
0923 19:50:25.744506 (+2397267us) ts_tablet_manager.cc:1151] Deleting tablet b0534795317747b28bef09df8a1c7244
0923 19:50:25.744522 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.744662 (+ 140us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2397075}
I20260923 19:50:25.745334 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1038) took 2398 ms. Trace:
I20260923 19:50:25.745400 6459 rpcz_store.cc:276] 0923 19:50:23.347195 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:23.347452 (+ 257us) service_pool.cc:224] Handling call
0923 19:50:25.745232 (+2397780us) ts_tablet_manager.cc:1151] Deleting tablet 4661da9259c74a4fbe3a00df5048658d
0923 19:50:25.745243 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.745319 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2397624}
I20260923 19:50:25.747581 6315 tablet_service.cc:1511] Processing CreateTablet for tablet 1e3030bdb15545eaa003f0dff21c70f3 (DEFAULT_TABLE table=default.Table_a3507ac7adf44658b5b94187850e14c1 [id=6c8d4c20466d4ef698a8f3c872912d9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.747684 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 2f45d03e655042d18dcbded39b3a8df6 (DEFAULT_TABLE table=default.Table_5678be025a834aa88d502c41b36d6d3e [id=59de67ad97e94f7a99239aa9c6648b2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.747988 6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e3030bdb15545eaa003f0dff21c70f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.748807 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f45d03e655042d18dcbded39b3a8df6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.751091 7429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50930 (request call id 0) took 9189 ms. Trace:
I20260923 19:50:25.754101 6459 tablet_replica.cc:333] T 85b7dcf131c54187a6e61f8503c797f8 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:25.755323 6106 heartbeater.cc:344] Connected to a master server at 127.5.143.254:37151
I20260923 19:50:25.757027 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 5c59e7d4b13643f29018fa8843f67d08 (DEFAULT_TABLE table=default.Table_039bbf0a88654c2f9e8834f0bf2d8180 [id=8aec1075b22d4cc682dc3be652a38d0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.757565 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c59e7d4b13643f29018fa8843f67d08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.765844 6307 tablet_service.cc:1511] Processing CreateTablet for tablet 48d751b68d03456fbef279a77f8f7b91 (DEFAULT_TABLE table=default.Table_955b9947ea484161a6d4c16106d7d7be [id=975cc0b3348443f1a25df980ef673b32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.766297 6307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48d751b68d03456fbef279a77f8f7b91. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:25.769376 5791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.143.252:45543, user_credentials={real_user=slave}} blocked reactor thread for 47822.2us
I20260923 19:50:25.771164 7971 catalog_manager.cc:818] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260923 19:50:25.776664 6454 tablet_bootstrap.cc:492] T a10d35bf564d45488524d3d21721f4e5 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:25.778301 6454 tablet_bootstrap.cc:654] T a10d35bf564d45488524d3d21721f4e5 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:25.780483 6179 tablet_service.cc:1511] Processing CreateTablet for tablet be72a4922eb24bed80c7c2dae1b13cc1 (DEFAULT_TABLE table=default.Table_15ccf3f89ba546298c74fb37b949b192 [id=72db5fd0f88d4db3a63e7f72d4067bea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.781801 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be72a4922eb24bed80c7c2dae1b13cc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.782202 6456 tablet_bootstrap.cc:492] T 2526884ab0ef404aaf93051cc842c695 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:25.782356 6456 ts_tablet_manager.cc:1403] T 2526884ab0ef404aaf93051cc842c695 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.088s user 0.003s sys 0.000s
I20260923 19:50:25.783061 6456 raft_consensus.cc:359] T 2526884ab0ef404aaf93051cc842c695 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:25.783236 6456 raft_consensus.cc:385] T 2526884ab0ef404aaf93051cc842c695 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:25.783306 6456 raft_consensus.cc:740] T 2526884ab0ef404aaf93051cc842c695 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:25.783883 6456 consensus_queue.cc:260] T 2526884ab0ef404aaf93051cc842c695 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:25.784524 6459 raft_consensus.cc:2243] T 85b7dcf131c54187a6e61f8503c797f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:25.788787 6317 tablet_service.cc:1511] Processing CreateTablet for tablet 361c9f55200b4d6db3fb04be061b0ee3 (DEFAULT_TABLE table=default.Table_9cf308a34d9d40728fc2e0535bd42fc2 [id=ba228790ed5e4fe9a89d748a522b3238]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.789206 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 361c9f55200b4d6db3fb04be061b0ee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.785604 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet 09792de9c452418781a4331ea1b0477c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:25 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:25.786753 6183 tablet_service.cc:1511] Processing CreateTablet for tablet a07de8cc9dd9404baaa4533a1ca02ae0 (DEFAULT_TABLE table=default.Table_1c62a72e74d344759378361cfe965e67 [id=0833a6f9afee4eaf95d38355a3096590]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.791481 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a07de8cc9dd9404baaa4533a1ca02ae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.796885 6310 tablet_service.cc:1511] Processing CreateTablet for tablet eb5e7e94bb414857999c69c4b0df671d (DEFAULT_TABLE table=default.Table_80caca78e1824947a667ade1a7ec3e71 [id=687d86d1977c4785a1f021439c59941f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.797330 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb5e7e94bb414857999c69c4b0df671d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.800055 6456 ts_tablet_manager.cc:1434] T 2526884ab0ef404aaf93051cc842c695 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
W20260923 19:50:25.801143 7957 log.cc:927] Time spent T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae: Append to log took a long time: real 0.092s user 0.001s sys 0.000s
I20260923 19:50:25.804145 6181 tablet_service.cc:1511] Processing CreateTablet for tablet ff8e469f4cf24e1abaf6774a9c199c98 (DEFAULT_TABLE table=default.Table_fe0f6869307545d2807258b71107a778 [id=6cab12c5975d4e9e89110b041f53517f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.804323 6461 ts_tablet_manager.cc:1929] T 37769256de33432697e9d4fb235f473f P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:25.804437 6461 log.cc:1199] T 37769256de33432697e9d4fb235f473f P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/37769256de33432697e9d4fb235f473f
I20260923 19:50:25.804950 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff8e469f4cf24e1abaf6774a9c199c98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.805496 6454 tablet_bootstrap.cc:492] T a10d35bf564d45488524d3d21721f4e5 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:25.806715 6315 tablet_service.cc:1511] Processing CreateTablet for tablet 5b875a66d9c0407585bb72a5b7b7df63 (DEFAULT_TABLE table=default.Table_c9caa816995b4d02b2b42ef1f29e41e1 [id=0cfdf5f8a7d54ce69a8eca5603a93ff8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.806907 6321 tablet_service.cc:1511] Processing CreateTablet for tablet e2f254605d744837a43b79c026a3c73f (DEFAULT_TABLE table=default.Table_3c3892a688cc4eb7b41d123435557716 [id=7a6d8b71dad743d5b2714e6baf9a9019]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.807068 6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b875a66d9c0407585bb72a5b7b7df63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.807250 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2f254605d744837a43b79c026a3c73f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.816048 6456 tablet_bootstrap.cc:492] T ea2ef507c6e24d369427048171dfec06 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:25.819036 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet b87872fb6cc0400c86eddffb29c898e8 (table default.Table_59a69335b281437498cea78a9cb3fadb [id=ac71e26491774bcd93d004a319b086c8]) successfully deleted
I20260923 19:50:25.820022 6315 tablet_service.cc:1511] Processing CreateTablet for tablet 09792de9c452418781a4331ea1b0477c (DEFAULT_TABLE table=default.Table_98fa8b434d3c43fe98c6a4bd5690233e [id=97a1570507ba47c287adcc315310fe18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.820497 6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09792de9c452418781a4331ea1b0477c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:25.820704 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet b0534795317747b28bef09df8a1c7244 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b0534795317747b28bef09df8a1c7244 already in progress: creating tablet
W20260923 19:50:25.821012 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 4661da9259c74a4fbe3a00df5048658d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4661da9259c74a4fbe3a00df5048658d already in progress: creating tablet
I20260923 19:50:25.827957 6321 tablet_service.cc:1511] Processing CreateTablet for tablet 4434c09950e74177ad0c4cc42f1dfbab (DEFAULT_TABLE table=default.Table_f2e2ed35560847c4b3b2fde259194e42 [id=39e41b4322294838a8bd8e84d0a5316c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.828440 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4434c09950e74177ad0c4cc42f1dfbab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.810073 6166 tablet_service.cc:1511] Processing CreateTablet for tablet 5c59e7d4b13643f29018fa8843f67d08 (DEFAULT_TABLE table=default.Table_039bbf0a88654c2f9e8834f0bf2d8180 [id=8aec1075b22d4cc682dc3be652a38d0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.833308 6454 ts_tablet_manager.cc:1403] T a10d35bf564d45488524d3d21721f4e5 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.057s user 0.003s sys 0.000s
I20260923 19:50:25.833737 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c59e7d4b13643f29018fa8843f67d08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.833997 6454 raft_consensus.cc:359] T a10d35bf564d45488524d3d21721f4e5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.837016 6317 tablet_service.cc:1511] Processing CreateTablet for tablet 8f80af68c91843928eedc386e6a5b967 (DEFAULT_TABLE table=default.Table_32b329b9fb0d4ea2a12965fdf2adfd24 [id=16b7e7794ca54bfca955d653a8ff0509]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.838471 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f80af68c91843928eedc386e6a5b967. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.815851 6177 tablet_service.cc:1511] Processing CreateTablet for tablet 1e3030bdb15545eaa003f0dff21c70f3 (DEFAULT_TABLE table=default.Table_a3507ac7adf44658b5b94187850e14c1 [id=6c8d4c20466d4ef698a8f3c872912d9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.841557 6454 raft_consensus.cc:385] T a10d35bf564d45488524d3d21721f4e5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:25.822192 6175 tablet_service.cc:1511] Processing CreateTablet for tablet 48d751b68d03456fbef279a77f8f7b91 (DEFAULT_TABLE table=default.Table_955b9947ea484161a6d4c16106d7d7be [id=975cc0b3348443f1a25df980ef673b32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.823190 7907 raft_consensus.cc:493] T fc151f4d78344efeada6d6e57af6eb9f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:25.842676 6307 tablet_service.cc:1511] Processing CreateTablet for tablet d0e3e3857c754e74aa58b68c00dba32c (DEFAULT_TABLE table=default.Table_977e0518381747fbb64340cdf61de5fb [id=4deff68409a441e8a627ad9e13823db2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.813031 6459 raft_consensus.cc:2272] T 85b7dcf131c54187a6e61f8503c797f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:25.842813 7907 raft_consensus.cc:515] T fc151f4d78344efeada6d6e57af6eb9f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.842994 6307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0e3e3857c754e74aa58b68c00dba32c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.843598 6459 ts_tablet_manager.cc:1916] T 85b7dcf131c54187a6e61f8503c797f8 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:25.818178 6174 tablet_service.cc:1511] Processing CreateTablet for tablet 2f45d03e655042d18dcbded39b3a8df6 (DEFAULT_TABLE table=default.Table_5678be025a834aa88d502c41b36d6d3e [id=59de67ad97e94f7a99239aa9c6648b2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.841836 6177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e3030bdb15545eaa003f0dff21c70f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.850054 6175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48d751b68d03456fbef279a77f8f7b91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.853363 7410 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" instance_seqno: 1790192997444991) as {username='slave'} at 127.5.143.195:53061; Asking this server to re-register.
I20260923 19:50:25.854046 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f45d03e655042d18dcbded39b3a8df6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.843616 7907 leader_election.cc:290] T fc151f4d78344efeada6d6e57af6eb9f P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:25.859124 6137 leader_election.cc:343] T fc151f4d78344efeada6d6e57af6eb9f P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: fc151f4d78344efeada6d6e57af6eb9f
W20260923 19:50:25.861269 6139 leader_election.cc:343] T fc151f4d78344efeada6d6e57af6eb9f P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: fc151f4d78344efeada6d6e57af6eb9f
I20260923 19:50:25.861378 6139 leader_election.cc:304] T fc151f4d78344efeada6d6e57af6eb9f P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:25.861677 6391 heartbeater.cc:461] Registering TS with master...
I20260923 19:50:25.861789 7907 raft_consensus.cc:2749] T fc151f4d78344efeada6d6e57af6eb9f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:25.864756 6307 tablet_service.cc:1511] Processing CreateTablet for tablet dbf9706e947a4c46aceeb47ce6e4e9b7 (DEFAULT_TABLE table=default.Table_e8762f65676a42ceb73097d69b5b7906 [id=0b2c82f07cbb4e3c9a64b8dc6a73f02a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.864913 6322 tablet_service.cc:1511] Processing CreateTablet for tablet 56c6a52d07f64219be50ef044b391a42 (DEFAULT_TABLE table=default.Table_20e0bdcca82249c2b0afd8e0e7b82207 [id=6e739712dc654bdc9a5f0cf36846aa9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.865425 6322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56c6a52d07f64219be50ef044b391a42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.867111 6307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbf9706e947a4c46aceeb47ce6e4e9b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.868903 6454 raft_consensus.cc:740] T a10d35bf564d45488524d3d21721f4e5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:25.869858 6198 raft_consensus.cc:3060] T 1c43641327d14a888a2815e49a2762c8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:25.870368 6456 tablet_bootstrap.cc:654] T ea2ef507c6e24d369427048171dfec06 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:25.872994 6454 consensus_queue.cc:260] T a10d35bf564d45488524d3d21721f4e5 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.874341 7410 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" instance_seqno: 1790192996360071) as {username='slave'} at 127.5.143.193:44673; Asking this server to re-register.
I20260923 19:50:25.881364 7411 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" instance_seqno: 1790192996897020) as {username='slave'} at 127.5.143.194:42739; Asking this server to re-register.
I20260923 19:50:25.881902 7405 ts_manager.cc:194] Registered new tserver with Master: 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:25.885429 6249 heartbeater.cc:461] Registering TS with master...
I20260923 19:50:25.876837 6106 heartbeater.cc:461] Registering TS with master...
I20260923 19:50:25.887660 6322 tablet_service.cc:1511] Processing CreateTablet for tablet 9b8768f07dc44bf39dbdf2e31e18f53d (DEFAULT_TABLE table=default.Table_0b43ff62cacf4c2abf3ed1bdc818625e [id=970a73d2e0f74239961513392dab1531]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.888018 6322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b8768f07dc44bf39dbdf2e31e18f53d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.888963 6461 ts_tablet_manager.cc:1950] T 37769256de33432697e9d4fb235f473f P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:25.889596 7405 ts_manager.cc:194] Registered new tserver with Master: e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:25.890245 6461 tablet_replica.cc:333] T 772ece5283a949408d849f6e56f5f17b P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:25.890425 6461 raft_consensus.cc:2243] T 772ece5283a949408d849f6e56f5f17b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:25.890558 6461 raft_consensus.cc:2272] T 772ece5283a949408d849f6e56f5f17b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:25.891031 6461 ts_tablet_manager.cc:1916] T 772ece5283a949408d849f6e56f5f17b P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:25.894351 6317 tablet_service.cc:1511] Processing CreateTablet for tablet 413952b3f6164ec8b48d713d2b552964 (DEFAULT_TABLE table=default.Table_89cc104e23284794a696a358f691e3bd [id=d8eec2835c6943989abfbd65112045d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.896924 7907 raft_consensus.cc:493] T 554655516bb547ad9c2aa1ee66dc8deb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:25.897075 7907 raft_consensus.cc:515] T 554655516bb547ad9c2aa1ee66dc8deb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:25.897727 7907 leader_election.cc:290] T 554655516bb547ad9c2aa1ee66dc8deb P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:25.898602 6139 leader_election.cc:343] T 554655516bb547ad9c2aa1ee66dc8deb P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 554655516bb547ad9c2aa1ee66dc8deb
W20260923 19:50:25.898723 6137 leader_election.cc:343] T 554655516bb547ad9c2aa1ee66dc8deb P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 554655516bb547ad9c2aa1ee66dc8deb
I20260923 19:50:25.898895 6137 leader_election.cc:304] T 554655516bb547ad9c2aa1ee66dc8deb P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:25.899360 7907 raft_consensus.cc:2749] T 554655516bb547ad9c2aa1ee66dc8deb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:25.899605 7955 tablet.cc:1751] T 1c43641327d14a888a2815e49a2762c8 P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:25.903893 5814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" candidate_term: 4 candidate_status { last_received { term: 3 index: 944 } } ignore_live_leader: false dest_uuid: "83e97b26500048d0b75350a21a8ff96b" is_pre_election: true
I20260923 19:50:25.894649 6315 tablet_service.cc:1511] Processing CreateTablet for tablet 70a6be02b3e842d8b89ad93524d5f059 (DEFAULT_TABLE table=default.Table_0795540c91fe4adba2e79f5f22689e50 [id=465e9b9462b347cfa4687144123ed0b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.894351 6321 tablet_service.cc:1511] Processing CreateTablet for tablet 52ff59ad89cf46a78852d50c09824d1b (DEFAULT_TABLE table=default.Table_80da016ec382404792b58b67eb9132c3 [id=1d23d99ca89e48a59f5f93413db60da6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.904441 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ff59ad89cf46a78852d50c09824d1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.904639 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 413952b3f6164ec8b48d713d2b552964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.906302 7822 raft_consensus.cc:493] T f8052b05169b4673b387ac8b716ffc4e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:25.906437 7822 raft_consensus.cc:515] T f8052b05169b4673b387ac8b716ffc4e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:25.906983 7822 leader_election.cc:290] T f8052b05169b4673b387ac8b716ffc4e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:25.907829 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8052b05169b4673b387ac8b716ffc4e" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:25.908416 6280 leader_election.cc:343] T f8052b05169b4673b387ac8b716ffc4e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:25.910105 6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70a6be02b3e842d8b89ad93524d5f059. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:25.911291 6280 consensus_peers.cc:597] T 397ec5e49673406cb26a2efab0ad8401 P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:25.897586 6456 tablet_bootstrap.cc:492] T ea2ef507c6e24d369427048171dfec06 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:25.914554 6456 ts_tablet_manager.cc:1403] T ea2ef507c6e24d369427048171dfec06 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.099s user 0.005s sys 0.000s
I20260923 19:50:25.915397 6456 raft_consensus.cc:359] T ea2ef507c6e24d369427048171dfec06 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:25.915622 6456 raft_consensus.cc:385] T ea2ef507c6e24d369427048171dfec06 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:25.915727 6456 raft_consensus.cc:740] T ea2ef507c6e24d369427048171dfec06 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:25.916199 6308 tablet_service.cc:1511] Processing CreateTablet for tablet e9258846e62d491dba04f30dc44f4e77 (DEFAULT_TABLE table=default.Table_743194c792634791a0ead89c8a687b50 [id=7590230f4dca4edc9d6321c82002e6f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.916288 6454 ts_tablet_manager.cc:1434] T a10d35bf564d45488524d3d21721f4e5 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.083s user 0.003s sys 0.000s
I20260923 19:50:25.916574 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9258846e62d491dba04f30dc44f4e77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.916484 6456 consensus_queue.cc:260] T ea2ef507c6e24d369427048171dfec06 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:25.924178 6456 ts_tablet_manager.cc:1434] T ea2ef507c6e24d369427048171dfec06 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
I20260923 19:50:25.924463 6456 tablet_bootstrap.cc:492] T 2e1c19a751904a6295897376e9c5ee56 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:25.926563 6456 tablet_bootstrap.cc:654] T 2e1c19a751904a6295897376e9c5ee56 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:25.928666 6454 tablet_bootstrap.cc:492] T 684eb2576b4b4730813b993e36b242df P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:25.930199 7411 ts_manager.cc:194] Registered new tserver with Master: 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:25.930493 6454 tablet_bootstrap.cc:654] T 684eb2576b4b4730813b993e36b242df P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:25.945111 6461 ts_tablet_manager.cc:1929] T 772ece5283a949408d849f6e56f5f17b P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:25.950217 6177 tablet_service.cc:1511] Processing CreateTablet for tablet a20cddf18e5944cdaf3d22e66653b81f (DEFAULT_TABLE table=default.Table_5b2c1127e8b54b4aa302b5e946dcd8fd [id=5a6cab2b7e994658994f8a05e16dbb56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.950816 6174 tablet_service.cc:1511] Processing CreateTablet for tablet eb5e7e94bb414857999c69c4b0df671d (DEFAULT_TABLE table=default.Table_80caca78e1824947a667ade1a7ec3e71 [id=687d86d1977c4785a1f021439c59941f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.951903 6168 tablet_service.cc:1511] Processing CreateTablet for tablet e2f254605d744837a43b79c026a3c73f (DEFAULT_TABLE table=default.Table_3c3892a688cc4eb7b41d123435557716 [id=7a6d8b71dad743d5b2714e6baf9a9019]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.952160 6170 tablet_service.cc:1511] Processing CreateTablet for tablet d0e3e3857c754e74aa58b68c00dba32c (DEFAULT_TABLE table=default.Table_977e0518381747fbb64340cdf61de5fb [id=4deff68409a441e8a627ad9e13823db2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.952222 6175 tablet_service.cc:1511] Processing CreateTablet for tablet 361c9f55200b4d6db3fb04be061b0ee3 (DEFAULT_TABLE table=default.Table_9cf308a34d9d40728fc2e0535bd42fc2 [id=ba228790ed5e4fe9a89d748a522b3238]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.952571 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 5b875a66d9c0407585bb72a5b7b7df63 (DEFAULT_TABLE table=default.Table_c9caa816995b4d02b2b42ef1f29e41e1 [id=0cfdf5f8a7d54ce69a8eca5603a93ff8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.953213 6180 tablet_service.cc:1511] Processing CreateTablet for tablet 09792de9c452418781a4331ea1b0477c (DEFAULT_TABLE table=default.Table_98fa8b434d3c43fe98c6a4bd5690233e [id=97a1570507ba47c287adcc315310fe18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.953523 6171 tablet_service.cc:1511] Processing CreateTablet for tablet 8f80af68c91843928eedc386e6a5b967 (DEFAULT_TABLE table=default.Table_32b329b9fb0d4ea2a12965fdf2adfd24 [id=16b7e7794ca54bfca955d653a8ff0509]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.953898 6165 tablet_service.cc:1511] Processing CreateTablet for tablet 4434c09950e74177ad0c4cc42f1dfbab (DEFAULT_TABLE table=default.Table_f2e2ed35560847c4b3b2fde259194e42 [id=39e41b4322294838a8bd8e84d0a5316c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.954281 6172 tablet_service.cc:1511] Processing CreateTablet for tablet 413952b3f6164ec8b48d713d2b552964 (DEFAULT_TABLE table=default.Table_89cc104e23284794a696a358f691e3bd [id=d8eec2835c6943989abfbd65112045d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.954764 6173 tablet_service.cc:1511] Processing CreateTablet for tablet dbf9706e947a4c46aceeb47ce6e4e9b7 (DEFAULT_TABLE table=default.Table_e8762f65676a42ceb73097d69b5b7906 [id=0b2c82f07cbb4e3c9a64b8dc6a73f02a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.955291 6182 tablet_service.cc:1511] Processing CreateTablet for tablet 56c6a52d07f64219be50ef044b391a42 (DEFAULT_TABLE table=default.Table_20e0bdcca82249c2b0afd8e0e7b82207 [id=6e739712dc654bdc9a5f0cf36846aa9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.956524 6164 tablet_service.cc:1511] Processing CreateTablet for tablet 9b8768f07dc44bf39dbdf2e31e18f53d (DEFAULT_TABLE table=default.Table_0b43ff62cacf4c2abf3ed1bdc818625e [id=970a73d2e0f74239961513392dab1531]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:25.963223 5792 catalog_manager.cc:5136] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): alter failed for tablet 98f61ace3a984938ace1fedbaa1dafa3 (table default.Table_c624a31c5179478cb6c54a36d7a36892 [id=26caa02bc37e471abdf29bbbb3acba69]),no further retry: Not found: Tablet not found: 98f61ace3a984938ace1fedbaa1dafa3
W20260923 19:50:25.964231 5700 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 44030.7us
W20260923 19:50:25.983184 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 95630644f0a242d8b8449f12bd6a3de5 consensus state has no leader
I20260923 19:50:25.990994 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet f994c5da7ed6483dacb47350531c0ea0
I20260923 19:50:25.992089 5802 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_6a56e4926a7b43d29a2cc015f69e8684 [id=923a67e6f6534f4da28ce819cecd9171] alter complete (version 2)
I20260923 19:50:25.991976 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b263b668ecaa431cb33df9f5f573f17e" } new_table_name: "default.Table_efcf236fb23d420db96e34f519589c4b" modify_external_catalogs: true
W20260923 19:50:25.992858 5802 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.5.143.195:53215 (request call id 162) took 971 ms (client timeout 1000 ms). Trace:
W20260923 19:50:25.992933 5802 rpcz_store.cc:269] 0923 19:50:25.021342 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:25.022821 (+ 1479us) service_pool.cc:224] Handling call
0923 19:50:25.992821 (+970000us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0923 19:50:25.500819 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0923 19:50:25.500897 (+ 78us) write_op.cc:432] Acquiring schema lock in shared mode
0923 19:50:25.500902 (+ 5us) write_op.cc:435] Acquired schema lock
0923 19:50:25.500904 (+ 2us) tablet.cc:662] Decoding operations
0923 19:50:25.500992 (+ 88us) write_op.cc:620] Acquiring the partition lock for write op
0923 19:50:25.501002 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0923 19:50:25.501007 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0923 19:50:25.501104 (+ 97us) tablet.cc:701] Row locks acquired
0923 19:50:25.501108 (+ 4us) write_op.cc:260] PREPARE: finished
0923 19:50:25.501140 (+ 32us) write_op.cc:270] Start()
0923 19:50:25.501169 (+ 29us) write_op.cc:276] Timestamp: P: 1790193025501112 usec, L: 0
0923 19:50:25.501172 (+ 3us) op_driver.cc:348] REPLICATION: starting
0923 19:50:25.501303 (+ 131us) log.cc:844] Serialized 913 byte log entry
0923 19:50:25.517021 (+ 15718us) op_driver.cc:464] REPLICATION: finished
0923 19:50:25.518098 (+ 1077us) write_op.cc:301] APPLY: starting
0923 19:50:25.518107 (+ 9us) tablet.cc:1394] starting BulkCheckPresence
0923 19:50:25.518141 (+ 34us) tablet.cc:1397] finished BulkCheckPresence
0923 19:50:25.518161 (+ 20us) tablet.cc:1399] starting ApplyRowOperation cycle
0923 19:50:25.518205 (+ 44us) tablet.cc:1410] finished ApplyRowOperation cycle
0923 19:50:25.518227 (+ 22us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0923 19:50:25.518233 (+ 6us) write_op.cc:312] APPLY: finished
0923 19:50:25.518274 (+ 41us) log.cc:844] Serialized 29 byte log entry
0923 19:50:25.518305 (+ 31us) write_op.cc:489] Releasing partition, row and schema locks
0923 19:50:25.518319 (+ 14us) write_op.cc:454] Released schema lock
0923 19:50:25.518323 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0923 19:50:25.538274 (+ 19951us) write_op.cc:489] Releasing partition, row and schema locks
0923 19:50:25.538284 (+ 10us) write_op.cc:454] Released schema lock
Related trace 'op':
0923 19:50:25.569614 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0923 19:50:25.569753 (+ 139us) write_op.cc:432] Acquiring schema lock in shared mode
0923 19:50:25.569757 (+ 4us) write_op.cc:435] Acquired schema lock
0923 19:50:25.569760 (+ 3us) tablet.cc:662] Decoding operations
0923 19:50:25.569867 (+ 107us) write_op.cc:620] Acquiring the partition lock for write op
0923 19:50:25.569915 (+ 48us) write_op.cc:641] Partition lock acquired for write op
0923 19:50:25.569920 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0923 19:50:25.576748 (+ 6828us) tablet.cc:701] Row locks acquired
0923 19:50:25.576752 (+ 4us) write_op.cc:260] PREPARE: finished
0923 19:50:25.576803 (+ 51us) write_op.cc:270] Start()
0923 19:50:25.576847 (+ 44us) write_op.cc:276] Timestamp: P: 1790193025576765 usec, L: 0
0923 19:50:25.576852 (+ 5us) op_driver.cc:348] REPLICATION: starting
0923 19:50:25.577064 (+ 212us) log.cc:844] Serialized 356 byte log entry
0923 19:50:25.589721 (+ 12657us) op_driver.cc:464] REPLICATION: finished
0923 19:50:25.589937 (+ 216us) write_op.cc:301] APPLY: starting
0923 19:50:25.589953 (+ 16us) tablet.cc:1394] starting BulkCheckPresence
0923 19:50:25.589996 (+ 43us) tablet.cc:1397] finished BulkCheckPresence
0923 19:50:25.590019 (+ 23us) tablet.cc:1399] starting ApplyRowOperation cycle
0923 19:50:25.590072 (+ 53us) tablet.cc:1410] finished ApplyRowOperation cycle
0923 19:50:25.590101 (+ 29us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0923 19:50:25.590108 (+ 7us) write_op.cc:312] APPLY: finished
0923 19:50:25.590184 (+ 76us) log.cc:844] Serialized 23 byte log entry
0923 19:50:25.590249 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0923 19:50:25.590265 (+ 16us) write_op.cc:454] Released schema lock
0923 19:50:25.590271 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0923 19:50:25.590347 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0923 19:50:25.590351 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0923 19:50:25.698905 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0923 19:50:25.698983 (+ 78us) write_op.cc:432] Acquiring schema lock in shared mode
0923 19:50:25.698987 (+ 4us) write_op.cc:435] Acquired schema lock
0923 19:50:25.698989 (+ 2us) tablet.cc:662] Decoding operations
0923 19:50:25.699083 (+ 94us) write_op.cc:620] Acquiring the partition lock for write op
0923 19:50:25.699090 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0923 19:50:25.699094 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0923 19:50:25.699137 (+ 43us) tablet.cc:701] Row locks acquired
0923 19:50:25.699139 (+ 2us) write_op.cc:260] PREPARE: finished
0923 19:50:25.699164 (+ 25us) write_op.cc:270] Start()
0923 19:50:25.699188 (+ 24us) write_op.cc:276] Timestamp: P: 1790193025699123 usec, L: 0
0923 19:50:25.699191 (+ 3us) op_driver.cc:348] REPLICATION: starting
0923 19:50:25.699327 (+ 136us) log.cc:844] Serialized 356 byte log entry
0923 19:50:25.988358 (+289031us) op_driver.cc:464] REPLICATION: finished
0923 19:50:25.989529 (+ 1171us) write_op.cc:301] APPLY: starting
0923 19:50:25.989540 (+ 11us) tablet.cc:1394] starting BulkCheckPresence
0923 19:50:25.989568 (+ 28us) tablet.cc:1397] finished BulkCheckPresence
0923 19:50:25.989589 (+ 21us) tablet.cc:1399] starting ApplyRowOperation cycle
0923 19:50:25.989640 (+ 51us) tablet.cc:1410] finished ApplyRowOperation cycle
0923 19:50:25.989664 (+ 24us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0923 19:50:25.989671 (+ 7us) write_op.cc:312] APPLY: finished
0923 19:50:25.989722 (+ 51us) log.cc:844] Serialized 23 byte log entry
0923 19:50:25.989759 (+ 37us) write_op.cc:489] Releasing partition, row and schema locks
0923 19:50:25.989770 (+ 11us) write_op.cc:454] Released schema lock
0923 19:50:25.989774 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0923 19:50:25.989864 (+ 90us) write_op.cc:489] Releasing partition, row and schema locks
0923 19:50:25.989867 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":1035,"apply.run_cpu_time_us":269,"apply.run_wall_time_us":269,"num_ops":2,"prepare.queue_time_us":5322,"prepare.run_cpu_time_us":651,"prepare.run_wall_time_us":37426,"raft.queue_time_us":41,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"replication_time_us":15835}],["op",{"apply.queue_time_us":161,"apply.run_cpu_time_us":400,"apply.run_wall_time_us":400,"num_ops":1,"prepare.queue_time_us":49088,"prepare.run_cpu_time_us":872,"prepare.run_wall_time_us":10175,"raft.queue_time_us":57,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":235,"replication_time_us":12837}],["op",{"apply.queue_time_us":1133,"apply.run_cpu_time_us":326,"apply.run_wall_time_us":326,"num_ops":1,"prepare.queue_time_us":90693,"prepare.run_cpu_time_us":464,"prepare.run_wall_time_us":463,"replication_time_us":289149,"spinlock_wait_cycles":16128}]]}
I20260923 19:50:25.994457 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_416deb1d1c5a42c9a6f56834e09561b8" } modify_external_catalogs: true
I20260923 19:50:25.994611 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_416deb1d1c5a42c9a6f56834e09561b8" } modify_external_catalogs: true
I20260923 19:50:25.996186 5797 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_34145a62b6df4ad88c33a268f9f59a62" } modify_external_catalogs: true
I20260923 19:50:25.996320 5797 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_34145a62b6df4ad88c33a268f9f59a62" } modify_external_catalogs: true
I20260923 19:50:25.998823 5800 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7acfabb21b234e30a1c4899081c86edc" } modify_external_catalogs: true
I20260923 19:50:25.999006 5800 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7acfabb21b234e30a1c4899081c86edc" } modify_external_catalogs: true
I20260923 19:50:25.991997 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_08afceb3d6d0424281def7649bc0a3e4" } new_table_name: "default.Table_020624cf3a194c669468a23b0137d1a6" modify_external_catalogs: true
I20260923 19:50:26.006023 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_7fbd7ade12984bd0aebf88ec53834f2a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:26.006633 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7fbd7ade12984bd0aebf88ec53834f2a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:26.011626 5796 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 1c43641327d14a888a2815e49a2762c8 (table default.Table_6a56e4926a7b43d29a2cc015f69e8684 [id=923a67e6f6534f4da28ce819cecd9171]). Expected version 2 got 0
I20260923 19:50:26.022094 5799 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f2b30e3d5f94427995273bb78cad8ded" } new_table_name: "default.Table_44eda82511a242b9b7f426d4a791bd41" modify_external_catalogs: true
I20260923 19:50:26.030833 5796 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet f1c1d4f73488499a9e5add81e9d5e2d6 (table default.Table_7f7907c8e1bc4ad1ae68faf5f072b318 [id=80e3a84f7199464fa96426daeeeb84cd]). Expected version 2 got 0
I20260923 19:50:26.031381 5796 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 40adb472162042e48fdbb496b342996a (table default.Table_9430735288754d599f68f15e1d52c0cf [id=8fe16214ad774a54982dbadeac1b4235]). Expected version 2 got 0
I20260923 19:50:26.034198 6177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a20cddf18e5944cdaf3d22e66653b81f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.035470 6171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f80af68c91843928eedc386e6a5b967. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.036509 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2f254605d744837a43b79c026a3c73f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.036757 6170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0e3e3857c754e74aa58b68c00dba32c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.036921 6165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4434c09950e74177ad0c4cc42f1dfbab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.037983 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbf9706e947a4c46aceeb47ce6e4e9b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.042026 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09792de9c452418781a4331ea1b0477c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:26.042570 5791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.143.252:45543, user_credentials={real_user=slave}} blocked reactor thread for 64484.7us
I20260923 19:50:26.046030 6172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 413952b3f6164ec8b48d713d2b552964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.047562 6459 ts_tablet_manager.cc:1929] T 85b7dcf131c54187a6e61f8503c797f8 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:50:26.047686 6459 log.cc:1199] T 85b7dcf131c54187a6e61f8503c797f8 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/85b7dcf131c54187a6e61f8503c797f8
I20260923 19:50:26.048053 6459 ts_tablet_manager.cc:1950] T 85b7dcf131c54187a6e61f8503c797f8 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:26.048393 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1035) took 2712 ms. Trace:
I20260923 19:50:26.048498 6459 rpcz_store.cc:276] 0923 19:50:23.335587 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:23.365081 (+ 29494us) service_pool.cc:224] Handling call
0923 19:50:25.754028 (+2388947us) ts_tablet_manager.cc:1151] Deleting tablet 85b7dcf131c54187a6e61f8503c797f8
0923 19:50:25.754043 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:25.954849 (+200806us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:26.047503 (+ 92654us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:26.048374 (+ 871us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2355938}
I20260923 19:50:26.049180 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1036) took 2702 ms. Trace:
I20260923 19:50:26.080919 6461 log.cc:1199] T 772ece5283a949408d849f6e56f5f17b P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/772ece5283a949408d849f6e56f5f17b
W20260923 19:50:25.952947 5995 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 244973us
I20260923 19:50:25.955082 7970 raft_consensus.cc:493] T 4e69656e9fc941e19eb7de5c87bc9050 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:26.082737 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 373d6442546d41e2b5567dfc92ae07b1 (table default.Table_1916c5305d984163ac72fcf98ce30e62 [id=666f42c33b8943a6a0362c47d38aa2b3]) successfully deleted
I20260923 19:50:26.082960 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 37769256de33432697e9d4fb235f473f (table default.Table_59a69335b281437498cea78a9cb3fadb [id=ac71e26491774bcd93d004a319b086c8]) successfully deleted
I20260923 19:50:26.083031 7970 raft_consensus.cc:515] T 4e69656e9fc941e19eb7de5c87bc9050 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:26.020318 7816 raft_consensus.cc:493] T f2799563250845b0b9d7d51b2367b16b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:26.083992 7816 raft_consensus.cc:515] T f2799563250845b0b9d7d51b2367b16b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:26.084558 7816 leader_election.cc:290] T f2799563250845b0b9d7d51b2367b16b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:26.085348 7816 raft_consensus.cc:493] T 89b950342b66486fa6ec0cdf03ad4881 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:26.085479 7816 raft_consensus.cc:515] T 89b950342b66486fa6ec0cdf03ad4881 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:26.086066 7816 leader_election.cc:290] T 89b950342b66486fa6ec0cdf03ad4881 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:25.952947 6457 tablet_bootstrap.cc:492] T 1985088eb56b40c1aeecc1ec7409bcdf P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:26.086275 6457 ts_tablet_manager.cc:1403] T 1985088eb56b40c1aeecc1ec7409bcdf P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.429s user 0.020s sys 0.040s
I20260923 19:50:26.087109 6457 raft_consensus.cc:359] T 1985088eb56b40c1aeecc1ec7409bcdf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:26.087266 6457 raft_consensus.cc:385] T 1985088eb56b40c1aeecc1ec7409bcdf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:26.087313 6457 raft_consensus.cc:740] T 1985088eb56b40c1aeecc1ec7409bcdf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:26.087399 6680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" candidate_term: 4 candidate_status { last_received { term: 3 index: 944 } } ignore_live_leader: false dest_uuid: "009ffee03a4d41db84df9f450aa84562" is_pre_election: true
I20260923 19:50:26.087517 6457 consensus_queue.cc:260] T 1985088eb56b40c1aeecc1ec7409bcdf P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:26.088034 6457 ts_tablet_manager.cc:1434] T 1985088eb56b40c1aeecc1ec7409bcdf P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:26.088337 6457 tablet_bootstrap.cc:492] T 9756a1f8e23a436bb7c19c8cba7bdc05 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:26.088243 7356 leader_election.cc:304] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3d628214a34b4fa3ca0c1abe422bae; no voters: 009ffee03a4d41db84df9f450aa84562, 83e97b26500048d0b75350a21a8ff96b
I20260923 19:50:26.089046 7947 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260923 19:50:26.089565 5801 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_5572c14c35d14aa8bc14916e403dfe0f [id=bf2950f7469241d390951965f4e98f23] alter complete (version 3)
I20260923 19:50:26.092728 6457 tablet_bootstrap.cc:654] T 9756a1f8e23a436bb7c19c8cba7bdc05 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:26.095149 7970 leader_election.cc:290] T 4e69656e9fc941e19eb7de5c87bc9050 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:25.940903 6310 tablet_service.cc:1511] Processing CreateTablet for tablet a1dfaa834dd64f259d80e2c82f814c78 (DEFAULT_TABLE table=default.Table_8cb2657c9ef4484d9d886f77c7527eda [id=0bb24c29f5a54b1bbeb82e1592079a81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.942039 6308 tablet_service.cc:1511] Processing CreateTablet for tablet a074daec0e474298bb8c313952a935bb (DEFAULT_TABLE table=default.Table_4f577cc850fd453ca04bab2db4388465 [id=1868b93b9ab8425baffbaaba3c2cc1b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.112552 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a074daec0e474298bb8c313952a935bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.112836 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1dfaa834dd64f259d80e2c82f814c78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.943670 6307 tablet_service.cc:1511] Processing CreateTablet for tablet 984f2fa07b30426ebf71b7165fdf0695 (DEFAULT_TABLE table=default.Table_3e51d8e802da43f19bedf3ef57864490 [id=b1197d7521f949499cd365617556a7e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.944820 6311 tablet_service.cc:1511] Processing CreateTablet for tablet a20cddf18e5944cdaf3d22e66653b81f (DEFAULT_TABLE table=default.Table_5b2c1127e8b54b4aa302b5e946dcd8fd [id=5a6cab2b7e994658994f8a05e16dbb56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.113338 6307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 984f2fa07b30426ebf71b7165fdf0695. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.113555 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a20cddf18e5944cdaf3d22e66653b81f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.963366 6317 tablet_service.cc:1511] Processing CreateTablet for tablet 27c93aa4a39d4abda132e022cd171cdc (DEFAULT_TABLE table=default.Table_48f506d658aa4b7e9ac358f7f73d3b83 [id=8ae5f06a147f409f88a7bbf3eb724eb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.114298 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27c93aa4a39d4abda132e022cd171cdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.963775 6316 tablet_service.cc:1511] Processing CreateTablet for tablet a1741bdfa9ca4544a1fad8d3688899af (DEFAULT_TABLE table=default.Table_7ac640f9ac474cf9bcf6d412e838998e [id=eb611bb527f94c4bb94a5391fae9773e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.118216 6316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1741bdfa9ca4544a1fad8d3688899af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.963593 6315 tablet_service.cc:1511] Processing CreateTablet for tablet bb13cbc143aa444e900d2b9a60a44062 (DEFAULT_TABLE table=default.Table_12be29ecddb1411893380f5d1d81bb57 [id=6397659847f84a0a98f78fa3b87a61f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:25.967904 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 4ed64fe66b4a4f6ca000feb9a89a6155 (DEFAULT_TABLE table=default.Table_8aec2b8ca8d846488ec51dd3691f5208 [id=42aec7fdc30e441286bb2db61f79d5a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.122291 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ed64fe66b4a4f6ca000feb9a89a6155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.992813 6306 tablet_service.cc:1558] Processing DeleteTablet for tablet f994c5da7ed6483dacb47350531c0ea0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:25 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:26.126348 6306 tablet_service.cc:1511] Processing CreateTablet for tablet 9559a768542b45fe969bf1d20d53266a (DEFAULT_TABLE table=default.Table_2491b66ec8974b4ba9fc7a96d4fd9cb5 [id=f32a701a1a7642cb91b3fbee2c9c0bad]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:26.126685 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet f994c5da7ed6483dacb47350531c0ea0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f994c5da7ed6483dacb47350531c0ea0 already in progress: creating tablet
I20260923 19:50:26.126744 6306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9559a768542b45fe969bf1d20d53266a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:25.994252 6320 tablet_service.cc:1558] Processing DeleteTablet for tablet d3f7b33bbf3f453e8e841ee5d99c5b31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:25.994386 6313 tablet_service.cc:1558] Processing DeleteTablet for tablet 64e8951eb899461aa9c0b36e3f7555e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:26.130203 6458 tablet_replica.cc:333] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:25.998624 6323 tablet_service.cc:1511] Processing CreateTablet for tablet 139c2fc3ab9c47a9b184e02424a88890 (DEFAULT_TABLE table=default.Table_6b1bf474d973437eabe2b92b3bc9e948 [id=759f0126c39f423b840c0f5bb4ad9675]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.130522 6458 raft_consensus.cc:2243] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:26.130616 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 139c2fc3ab9c47a9b184e02424a88890. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.130723 6458 raft_consensus.cc:2272] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:26.131407 6458 ts_tablet_manager.cc:1916] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:25.999220 6324 tablet_service.cc:1511] Processing CreateTablet for tablet b1eec74ca2b54d2cb47a8a13fb4b293a (DEFAULT_TABLE table=default.Table_71bc8c1e8c3a49888b937afd57ba8087 [id=fef1b685ee17471fa4d78086ee50315e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.133919 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1eec74ca2b54d2cb47a8a13fb4b293a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.003644 6319 tablet_service.cc:1511] Processing CreateTablet for tablet 668c41aba151431599f90421ce4ed498 (DEFAULT_TABLE table=default.Table_af92277fab3e4672b156efcbb1d09f0b [id=f51215dbbf5740cf980fb218496dc8c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.137022 6319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 668c41aba151431599f90421ce4ed498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.011050 6309 tablet_service.cc:1511] Processing CreateTablet for tablet ff4239dad2d5451aa3e541ba8b331db2 (DEFAULT_TABLE table=default.Table_45dc6c5ba67e4dedb020fe098d5f95e5 [id=7c1a18ac36b2489ba47a8d64a128c44a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.024959 6318 tablet_service.cc:1511] Processing CreateTablet for tablet 12b5d024bb6e4227b57884fc109a51d0 (DEFAULT_TABLE table=default.Table_b40d9e540b804d268db162e3c6166ff0 [id=ae5f3376006d467f84061e2aa25fd2cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.025463 6312 tablet_service.cc:1511] Processing CreateTablet for tablet 91008b47d8ad414cb03d6c956a4b53b0 (DEFAULT_TABLE table=default.Table_ca2186f8aabb45b296744c0f2eb8d87a [id=4625fee9f5f845b5bbdf5e746223c6be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.030377 6314 tablet_service.cc:1511] Processing CreateTablet for tablet 60090cc5be4c4acc9bbeca63c50c74e0 (DEFAULT_TABLE table=default.Table_6bd43076ac0a41129669ca864669d1dc [id=2f62b583f35948d6831bb12e63144602]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.142463 6309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff4239dad2d5451aa3e541ba8b331db2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.142715 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60090cc5be4c4acc9bbeca63c50c74e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.146036 6313 tablet_service.cc:1558] Processing DeleteTablet for tablet 2526884ab0ef404aaf93051cc842c695 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:26.146121 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91008b47d8ad414cb03d6c956a4b53b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.146186 6458 ts_tablet_manager.cc:1929] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:26.146281 6458 log.cc:1199] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/d3f7b33bbf3f453e8e841ee5d99c5b31
I20260923 19:50:26.146445 6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb13cbc143aa444e900d2b9a60a44062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.146651 6318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12b5d024bb6e4227b57884fc109a51d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.130203 6320 tablet_service.cc:1558] Processing DeleteTablet for tablet 2852e91ccd0c44b3b16f8189e57575d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:26.076710 6322 tablet_service.cc:1511] Processing CreateTablet for tablet 6e17edbff714455f8d0e78aa67a5d6d1 (DEFAULT_TABLE table=default.Table_65c94b4a142e435dbd490ba30c1613f6 [id=99a5831a9d1c40bda0026c53724733de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.088503 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e69656e9fc941e19eb7de5c87bc9050" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:26.088721 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2799563250845b0b9d7d51b2367b16b" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:26.095168 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b950342b66486fa6ec0cdf03ad4881" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:26.153149 5996 leader_election.cc:343] T 4e69656e9fc941e19eb7de5c87bc9050 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:26.153360 5996 leader_election.cc:343] T f2799563250845b0b9d7d51b2367b16b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:26.153478 5996 leader_election.cc:343] T 89b950342b66486fa6ec0cdf03ad4881 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:26.155807 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 232805e54a364d43ae295e93a226c1bb (DEFAULT_TABLE table=default.Table_3738a8a397604cfca0fe015c4efeefde [id=532b3b0aebf542f2afbf9b7de7a7bcd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.156229 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 232805e54a364d43ae295e93a226c1bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.155808 6039 tablet_service.cc:1511] Processing CreateTablet for tablet 4952cee21fe9402db99783e05ffaffd5 (DEFAULT_TABLE table=default.Table_4aca5f24bf294b299ec64c356296aa31 [id=5ca8217e977d4d99936ad04fd341dc74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.158277 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4952cee21fe9402db99783e05ffaffd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.161109 6322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e17edbff714455f8d0e78aa67a5d6d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.146651 6458 ts_tablet_manager.cc:1950] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
W20260923 19:50:26.172989 5789 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 18b4ed7ef6dc468096b92a1ffa64c7d9 (table default.Table_363237ea560c44c2937c3aa08e9799cb [id=6892d0c8f40b4015b756de3d181cacb7], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 18b4ed7ef6dc468096b92a1ffa64c7d9 consensus state has no leader
I20260923 19:50:26.175660 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet b483bc3a99864e6f96b12709e1a8681f
I20260923 19:50:26.176352 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 5ce73f31a1f64a24835a272fea8d65c4
I20260923 19:50:26.176939 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_004d451550a547c3b795d2d6b2d32234"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:26.177119 5798 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b7b81a79b9a24504adbefb5a52b17e4f" } modify_external_catalogs: true
I20260923 19:50:26.177258 5798 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b7b81a79b9a24504adbefb5a52b17e4f" } modify_external_catalogs: true
W20260923 19:50:26.177739 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_004d451550a547c3b795d2d6b2d32234 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:26.178413 5805 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e076b89526a24344bea591eccfdde1e9 consensus state has no leader
I20260923 19:50:26.178555 6461 ts_tablet_manager.cc:1950] T 772ece5283a949408d849f6e56f5f17b P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
W20260923 19:50:26.176192 5803 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 11e0f1c645184da19ce11927e1d562c3 consensus state has no leader
I20260923 19:50:26.179078 5803 master_service.cc:960] ReplaceTablet: received request to replace tablet c9fe3ffc092a476fa0632581efc2fd6d from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:26.179939 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_6bc6a20a521a49f29589c5744e98afb7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:26.175912 5804 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_608e79573af4498e8ba356c79ad07f01" } new_table_name: "default.Table_4b0326e156434960b6097eb4a4d9b5b7" modify_external_catalogs: true
I20260923 19:50:26.176020 5800 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet b6383a5aad8d48319557191354b21982
W20260923 19:50:26.183338 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6bc6a20a521a49f29589c5744e98afb7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:26.184660 6039 tablet_service.cc:1511] Processing CreateTablet for tablet be72a4922eb24bed80c7c2dae1b13cc1 (DEFAULT_TABLE table=default.Table_15ccf3f89ba546298c74fb37b949b192 [id=72db5fd0f88d4db3a63e7f72d4067bea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.184906 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_1379f8f7241b4c5ea7cfa490eb67f895"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:26.185108 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be72a4922eb24bed80c7c2dae1b13cc1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:26.185413 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1379f8f7241b4c5ea7cfa490eb67f895 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:26.189180 5799 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b1670d13d05c4c63874223d479e3e192 consensus state has no leader
I20260923 19:50:26.190681 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b7454d124bc542788cdf915598bff4b6" } new_table_name: "default.Table_b24ca62e52f347d3ac64861b0fe2df69" modify_external_catalogs: true
I20260923 19:50:26.191242 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_a1f26054fea64d8eb5fd4efcaa6dfe71"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:26.191388 6025 tablet_service.cc:1511] Processing CreateTablet for tablet 1e3030bdb15545eaa003f0dff21c70f3 (DEFAULT_TABLE table=default.Table_a3507ac7adf44658b5b94187850e14c1 [id=6c8d4c20466d4ef698a8f3c872912d9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.191671 6318 tablet_service.cc:1558] Processing DeleteTablet for tablet b483bc3a99864e6f96b12709e1a8681f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:25 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:26.191869 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e3030bdb15545eaa003f0dff21c70f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.191960 6323 tablet_service.cc:1558] Processing DeleteTablet for tablet f8052b05169b4673b387ac8b716ffc4e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:21 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:26.192082 6035 tablet_service.cc:1511] Processing CreateTablet for tablet a07de8cc9dd9404baaa4533a1ca02ae0 (DEFAULT_TABLE table=default.Table_1c62a72e74d344759378361cfe965e67 [id=0833a6f9afee4eaf95d38355a3096590]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.192234 6309 tablet_service.cc:1558] Processing DeleteTablet for tablet 21bf33904ede470b80a074dc9a458baf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:24 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:26.192444 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a07de8cc9dd9404baaa4533a1ca02ae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.193483 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_c2ddf35711544d0ba111ea8960ab6b2c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:26.193969 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2ddf35711544d0ba111ea8960ab6b2c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:26.198218 6028 tablet_service.cc:1558] Processing DeleteTablet for tablet 09792de9c452418781a4331ea1b0477c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:25 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:26.198971 6040 tablet_service.cc:1511] Processing CreateTablet for tablet 5c59e7d4b13643f29018fa8843f67d08 (DEFAULT_TABLE table=default.Table_039bbf0a88654c2f9e8834f0bf2d8180 [id=8aec1075b22d4cc682dc3be652a38d0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.199388 6040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c59e7d4b13643f29018fa8843f67d08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.199765 7970 raft_consensus.cc:493] T a263c0fc71424999b76ef01de9a51eda P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:26.199887 7970 raft_consensus.cc:515] T a263c0fc71424999b76ef01de9a51eda P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:26.200551 7970 leader_election.cc:290] T a263c0fc71424999b76ef01de9a51eda P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:26.200968 7970 raft_consensus.cc:493] T d2dd611746d741e88b6911bf5d51f3e5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:26.201082 7970 raft_consensus.cc:515] T d2dd611746d741e88b6911bf5d51f3e5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:26.201684 7970 leader_election.cc:290] T d2dd611746d741e88b6911bf5d51f3e5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:26.202139 6033 tablet_service.cc:1511] Processing CreateTablet for tablet ff8e469f4cf24e1abaf6774a9c199c98 (DEFAULT_TABLE table=default.Table_fe0f6869307545d2807258b71107a778 [id=6cab12c5975d4e9e89110b041f53517f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.202512 6033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff8e469f4cf24e1abaf6774a9c199c98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.202469 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a263c0fc71424999b76ef01de9a51eda" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:26.202832 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2dd611746d741e88b6911bf5d51f3e5" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:26.203370 5996 leader_election.cc:343] T a263c0fc71424999b76ef01de9a51eda P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:26.203672 5996 leader_election.cc:343] T d2dd611746d741e88b6911bf5d51f3e5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:26.205765 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1f26054fea64d8eb5fd4efcaa6dfe71 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:26.208415 6317 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ce73f31a1f64a24835a272fea8d65c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:25 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:26.210333 6032 tablet_service.cc:1511] Processing CreateTablet for tablet 2f45d03e655042d18dcbded39b3a8df6 (DEFAULT_TABLE table=default.Table_5678be025a834aa88d502c41b36d6d3e [id=59de67ad97e94f7a99239aa9c6648b2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.210794 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f45d03e655042d18dcbded39b3a8df6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.211336 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_e0736cdef737400fa4898092eeeb3e4b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:26.211791 6309 tablet_service.cc:1558] Processing DeleteTablet for tablet ba639d8c68cf49a49a5ec5729143cf6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:26.211835 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e0736cdef737400fa4898092eeeb3e4b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:26.212205 6317 tablet_service.cc:1558] Processing DeleteTablet for tablet ea2ef507c6e24d369427048171dfec06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:26.213018 6321 tablet_service.cc:1558] Processing DeleteTablet for tablet c5cb76fa5e084604aa58bf888cfe4852 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:26.218932 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 361c9f55200b4d6db3fb04be061b0ee3 (DEFAULT_TABLE table=default.Table_9cf308a34d9d40728fc2e0535bd42fc2 [id=ba228790ed5e4fe9a89d748a522b3238]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.222162 6458 tablet_replica.cc:333] T 64e8951eb899461aa9c0b36e3f7555e2 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:26.222374 6458 raft_consensus.cc:2243] T 64e8951eb899461aa9c0b36e3f7555e2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:26.222502 6458 raft_consensus.cc:2272] T 64e8951eb899461aa9c0b36e3f7555e2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:26.222705 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet d3f7b33bbf3f453e8e841ee5d99c5b31 (table default.Table_8e3f5612c14448349fdc0fddeaead3d0 [id=57c63647576148739ad66655548492ce]) successfully deleted
I20260923 19:50:26.222997 6458 ts_tablet_manager.cc:1916] T 64e8951eb899461aa9c0b36e3f7555e2 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:26.049685 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b8768f07dc44bf39dbdf2e31e18f53d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.177681 7980 raft_consensus.cc:493] T e1de117713f34b51bbda0c712f0b837c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:26.107947 6168 tablet_service.cc:1511] Processing CreateTablet for tablet e9258846e62d491dba04f30dc44f4e77 (DEFAULT_TABLE table=default.Table_743194c792634791a0ead89c8a687b50 [id=7590230f4dca4edc9d6321c82002e6f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.224905 7980 raft_consensus.cc:515] T e1de117713f34b51bbda0c712f0b837c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:26.225152 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9258846e62d491dba04f30dc44f4e77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.225657 7980 leader_election.cc:290] T e1de117713f34b51bbda0c712f0b837c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:26.226877 6137 leader_election.cc:343] T e1de117713f34b51bbda0c712f0b837c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: e1de117713f34b51bbda0c712f0b837c
I20260923 19:50:26.230234 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 361c9f55200b4d6db3fb04be061b0ee3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:26.230788 6139 leader_election.cc:343] T e1de117713f34b51bbda0c712f0b837c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: e1de117713f34b51bbda0c712f0b837c
I20260923 19:50:26.230923 6139 leader_election.cc:304] T e1de117713f34b51bbda0c712f0b837c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:26.231349 7980 raft_consensus.cc:2749] T e1de117713f34b51bbda0c712f0b837c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:26.231583 7980 raft_consensus.cc:493] T d39a64531dd24eb4aa1f7e0c418b985b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:26.231675 7980 raft_consensus.cc:515] T d39a64531dd24eb4aa1f7e0c418b985b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:26.223335 6033 tablet_service.cc:1511] Processing CreateTablet for tablet a20cddf18e5944cdaf3d22e66653b81f (DEFAULT_TABLE table=default.Table_5b2c1127e8b54b4aa302b5e946dcd8fd [id=5a6cab2b7e994658994f8a05e16dbb56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.232291 7980 leader_election.cc:290] T d39a64531dd24eb4aa1f7e0c418b985b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:26.232621 6033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a20cddf18e5944cdaf3d22e66653b81f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.232928 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d39a64531dd24eb4aa1f7e0c418b985b" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:26.234069 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d39a64531dd24eb4aa1f7e0c418b985b" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:26.234179 6025 tablet_service.cc:1511] Processing CreateTablet for tablet eb5e7e94bb414857999c69c4b0df671d (DEFAULT_TABLE table=default.Table_80caca78e1824947a667ade1a7ec3e71 [id=687d86d1977c4785a1f021439c59941f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.234565 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb5e7e94bb414857999c69c4b0df671d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.234620 6139 leader_election.cc:304] T d39a64531dd24eb4aa1f7e0c418b985b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:26.234990 7980 raft_consensus.cc:2749] T d39a64531dd24eb4aa1f7e0c418b985b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:26.238166 6032 tablet_service.cc:1511] Processing CreateTablet for tablet 48d751b68d03456fbef279a77f8f7b91 (DEFAULT_TABLE table=default.Table_955b9947ea484161a6d4c16106d7d7be [id=975cc0b3348443f1a25df980ef673b32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.238593 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48d751b68d03456fbef279a77f8f7b91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.198314 6173 tablet_service.cc:1511] Processing CreateTablet for tablet 70a6be02b3e842d8b89ad93524d5f059 (DEFAULT_TABLE table=default.Table_0795540c91fe4adba2e79f5f22689e50 [id=465e9b9462b347cfa4687144123ed0b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.244166 6182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56c6a52d07f64219be50ef044b391a42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.248378 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b875a66d9c0407585bb72a5b7b7df63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.204754 6454 tablet_bootstrap.cc:492] T 684eb2576b4b4730813b993e36b242df P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:26.249092 6454 ts_tablet_manager.cc:1403] T 684eb2576b4b4730813b993e36b242df P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.321s user 0.004s sys 0.007s
I20260923 19:50:26.249979 6454 raft_consensus.cc:359] T 684eb2576b4b4730813b993e36b242df P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:26.205334 6165 tablet_service.cc:1511] Processing CreateTablet for tablet a074daec0e474298bb8c313952a935bb (DEFAULT_TABLE table=default.Table_4f577cc850fd453ca04bab2db4388465 [id=1868b93b9ab8425baffbaaba3c2cc1b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.251375 6165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a074daec0e474298bb8c313952a935bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.208703 6181 tablet_service.cc:1511] Processing CreateTablet for tablet 984f2fa07b30426ebf71b7165fdf0695 (DEFAULT_TABLE table=default.Table_3e51d8e802da43f19bedf3ef57864490 [id=b1197d7521f949499cd365617556a7e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.251943 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 984f2fa07b30426ebf71b7165fdf0695. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.252612 6175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 361c9f55200b4d6db3fb04be061b0ee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.254452 7826 raft_consensus.cc:493] T 40adb472162042e48fdbb496b342996a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:26.254633 7826 raft_consensus.cc:515] T 40adb472162042e48fdbb496b342996a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:26.255352 7826 leader_election.cc:290] T 40adb472162042e48fdbb496b342996a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:26.255774 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40adb472162042e48fdbb496b342996a" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:26.256330 6280 leader_election.cc:343] T 40adb472162042e48fdbb496b342996a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:26.256423 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb5e7e94bb414857999c69c4b0df671d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.260041 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70a6be02b3e842d8b89ad93524d5f059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.210568 6172 tablet_service.cc:1511] Processing CreateTablet for tablet bb13cbc143aa444e900d2b9a60a44062 (DEFAULT_TABLE table=default.Table_12be29ecddb1411893380f5d1d81bb57 [id=6397659847f84a0a98f78fa3b87a61f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.217828 6180 tablet_service.cc:1511] Processing CreateTablet for tablet 27c93aa4a39d4abda132e022cd171cdc (DEFAULT_TABLE table=default.Table_48f506d658aa4b7e9ac358f7f73d3b83 [id=8ae5f06a147f409f88a7bbf3eb724eb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.273319 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 1e835fa95fa84b43be4c27b7e3e26af3
I20260923 19:50:26.273994 6172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb13cbc143aa444e900d2b9a60a44062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.274113 5803 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet c9fe3ffc092a476fa0632581efc2fd6d
I20260923 19:50:26.274950 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27c93aa4a39d4abda132e022cd171cdc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:26.274966 5800 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 989d9bcb223e40d0a286b0351cf9494f has no consensus state
I20260923 19:50:26.275110 6168 tablet_service.cc:1511] Processing CreateTablet for tablet 139c2fc3ab9c47a9b184e02424a88890 (DEFAULT_TABLE table=default.Table_6b1bf474d973437eabe2b92b3bc9e948 [id=759f0126c39f423b840c0f5bb4ad9675]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.275540 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 139c2fc3ab9c47a9b184e02424a88890. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.221411 6178 tablet_service.cc:1511] Processing CreateTablet for tablet a1741bdfa9ca4544a1fad8d3688899af (DEFAULT_TABLE table=default.Table_7ac640f9ac474cf9bcf6d412e838998e [id=eb611bb527f94c4bb94a5391fae9773e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.277827 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1741bdfa9ca4544a1fad8d3688899af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.279280 6164 tablet_service.cc:1511] Processing CreateTablet for tablet b1eec74ca2b54d2cb47a8a13fb4b293a (DEFAULT_TABLE table=default.Table_71bc8c1e8c3a49888b937afd57ba8087 [id=fef1b685ee17471fa4d78086ee50315e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.279613 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1eec74ca2b54d2cb47a8a13fb4b293a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.283466 6035 tablet_service.cc:1511] Processing CreateTablet for tablet 5b875a66d9c0407585bb72a5b7b7df63 (DEFAULT_TABLE table=default.Table_c9caa816995b4d02b2b42ef1f29e41e1 [id=0cfdf5f8a7d54ce69a8eca5603a93ff8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.283500 6030 tablet_service.cc:1511] Processing CreateTablet for tablet 09792de9c452418781a4331ea1b0477c (DEFAULT_TABLE table=default.Table_98fa8b434d3c43fe98c6a4bd5690233e [id=97a1570507ba47c287adcc315310fe18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.283968 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b875a66d9c0407585bb72a5b7b7df63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.284170 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09792de9c452418781a4331ea1b0477c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.285490 5798 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b2773a25e37d4447a06b7de13b4bb492" } modify_external_catalogs: true
I20260923 19:50:26.285724 5798 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b2773a25e37d4447a06b7de13b4bb492" } modify_external_catalogs: true
I20260923 19:50:26.286142 6164 tablet_service.cc:1511] Processing CreateTablet for tablet 668c41aba151431599f90421ce4ed498 (DEFAULT_TABLE table=default.Table_af92277fab3e4672b156efcbb1d09f0b [id=f51215dbbf5740cf980fb218496dc8c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.286242 6040 tablet_service.cc:1511] Processing CreateTablet for tablet e2f254605d744837a43b79c026a3c73f (DEFAULT_TABLE table=default.Table_3c3892a688cc4eb7b41d123435557716 [id=7a6d8b71dad743d5b2714e6baf9a9019]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.286582 6040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2f254605d744837a43b79c026a3c73f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.287572 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 12b5d024bb6e4227b57884fc109a51d0 (DEFAULT_TABLE table=default.Table_b40d9e540b804d268db162e3c6166ff0 [id=ae5f3376006d467f84061e2aa25fd2cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.288350 6031 tablet_service.cc:1511] Processing CreateTablet for tablet d0e3e3857c754e74aa58b68c00dba32c (DEFAULT_TABLE table=default.Table_977e0518381747fbb64340cdf61de5fb [id=4deff68409a441e8a627ad9e13823db2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.288393 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 8f80af68c91843928eedc386e6a5b967 (DEFAULT_TABLE table=default.Table_32b329b9fb0d4ea2a12965fdf2adfd24 [id=16b7e7794ca54bfca955d653a8ff0509]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.288733 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f80af68c91843928eedc386e6a5b967. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.288950 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0e3e3857c754e74aa58b68c00dba32c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.290234 6021 tablet_service.cc:1511] Processing CreateTablet for tablet 4434c09950e74177ad0c4cc42f1dfbab (DEFAULT_TABLE table=default.Table_f2e2ed35560847c4b3b2fde259194e42 [id=39e41b4322294838a8bd8e84d0a5316c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.290508 5803 catalog_manager.cc:6934] ReplaceTablet: tablet c9fe3ffc092a476fa0632581efc2fd6d deleted and replaced by tablet d8504451f57b47948a0e82e0d3a300bc
I20260923 19:50:26.290609 6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4434c09950e74177ad0c4cc42f1dfbab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.290933 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_40dd60ae71f44479bc10a5902a6caaf4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:26.291632 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_40dd60ae71f44479bc10a5902a6caaf4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:26.292870 5804 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 95d0a1cce0bc4c8db3e5e2b11545c0ab consensus state has no leader
I20260923 19:50:26.293802 6038 tablet_service.cc:1511] Processing CreateTablet for tablet 413952b3f6164ec8b48d713d2b552964 (DEFAULT_TABLE table=default.Table_89cc104e23284794a696a358f691e3bd [id=d8eec2835c6943989abfbd65112045d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.294077 6023 tablet_service.cc:1511] Processing CreateTablet for tablet 52ff59ad89cf46a78852d50c09824d1b (DEFAULT_TABLE table=default.Table_80da016ec382404792b58b67eb9132c3 [id=1d23d99ca89e48a59f5f93413db60da6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.294293 6038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 413952b3f6164ec8b48d713d2b552964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.294513 6037 tablet_service.cc:1511] Processing CreateTablet for tablet a1dfaa834dd64f259d80e2c82f814c78 (DEFAULT_TABLE table=default.Table_8cb2657c9ef4484d9d886f77c7527eda [id=0bb24c29f5a54b1bbeb82e1592079a81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.294804 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1dfaa834dd64f259d80e2c82f814c78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.296022 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2799563250845b0b9d7d51b2367b16b" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:26.296417 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b950342b66486fa6ec0cdf03ad4881" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:26.297616 6027 tablet_service.cc:1511] Processing CreateTablet for tablet dbf9706e947a4c46aceeb47ce6e4e9b7 (DEFAULT_TABLE table=default.Table_e8762f65676a42ceb73097d69b5b7906 [id=0b2c82f07cbb4e3c9a64b8dc6a73f02a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.297914 6023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ff59ad89cf46a78852d50c09824d1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.298092 6024 tablet_service.cc:1511] Processing CreateTablet for tablet 9b8768f07dc44bf39dbdf2e31e18f53d (DEFAULT_TABLE table=default.Table_0b43ff62cacf4c2abf3ed1bdc818625e [id=970a73d2e0f74239961513392dab1531]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.298382 6024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b8768f07dc44bf39dbdf2e31e18f53d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.301563 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 70a6be02b3e842d8b89ad93524d5f059 (DEFAULT_TABLE table=default.Table_0795540c91fe4adba2e79f5f22689e50 [id=465e9b9462b347cfa4687144123ed0b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.302139 6022 tablet_service.cc:1511] Processing CreateTablet for tablet e9258846e62d491dba04f30dc44f4e77 (DEFAULT_TABLE table=default.Table_743194c792634791a0ead89c8a687b50 [id=7590230f4dca4edc9d6321c82002e6f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.302578 6036 tablet_service.cc:1511] Processing CreateTablet for tablet a074daec0e474298bb8c313952a935bb (DEFAULT_TABLE table=default.Table_4f577cc850fd453ca04bab2db4388465 [id=1868b93b9ab8425baffbaaba3c2cc1b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.293802 6026 tablet_service.cc:1511] Processing CreateTablet for tablet 56c6a52d07f64219be50ef044b391a42 (DEFAULT_TABLE table=default.Table_20e0bdcca82249c2b0afd8e0e7b82207 [id=6e739712dc654bdc9a5f0cf36846aa9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.303975 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70a6be02b3e842d8b89ad93524d5f059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.304445 6176 tablet_service.cc:1511] Processing CreateTablet for tablet 91008b47d8ad414cb03d6c956a4b53b0 (DEFAULT_TABLE table=default.Table_ca2186f8aabb45b296744c0f2eb8d87a [id=4625fee9f5f845b5bbdf5e746223c6be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.306142 6454 raft_consensus.cc:385] T 684eb2576b4b4730813b993e36b242df P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:26.306234 6454 raft_consensus.cc:740] T 684eb2576b4b4730813b993e36b242df P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:26.306413 6176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91008b47d8ad414cb03d6c956a4b53b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.306502 6454 consensus_queue.cc:260] T 684eb2576b4b4730813b993e36b242df P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:26.308755 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9258846e62d491dba04f30dc44f4e77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.310029 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbf9706e947a4c46aceeb47ce6e4e9b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.310151 6458 ts_tablet_manager.cc:1929] T 64e8951eb899461aa9c0b36e3f7555e2 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:26.310287 6458 log.cc:1199] T 64e8951eb899461aa9c0b36e3f7555e2 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/64e8951eb899461aa9c0b36e3f7555e2
I20260923 19:50:26.310729 6458 ts_tablet_manager.cc:1950] T 64e8951eb899461aa9c0b36e3f7555e2 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:26.312203 6454 ts_tablet_manager.cc:1434] T 684eb2576b4b4730813b993e36b242df P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.063s user 0.001s sys 0.000s
I20260923 19:50:26.312530 6454 tablet_bootstrap.cc:492] T d35ff653bf8d41cfbcf83359402a8f6a P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:26.314070 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12b5d024bb6e4227b57884fc109a51d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.317274 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 668c41aba151431599f90421ce4ed498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.317338 6458 tablet_replica.cc:333] T 2526884ab0ef404aaf93051cc842c695 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:26.317575 6458 raft_consensus.cc:2243] T 2526884ab0ef404aaf93051cc842c695 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:26.317759 6458 raft_consensus.cc:2272] T 2526884ab0ef404aaf93051cc842c695 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:26.318203 6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56c6a52d07f64219be50ef044b391a42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.318357 6458 ts_tablet_manager.cc:1916] T 2526884ab0ef404aaf93051cc842c695 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:26.320652 6033 tablet_service.cc:1511] Processing CreateTablet for tablet 139c2fc3ab9c47a9b184e02424a88890 (DEFAULT_TABLE table=default.Table_6b1bf474d973437eabe2b92b3bc9e948 [id=759f0126c39f423b840c0f5bb4ad9675]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.321003 6033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 139c2fc3ab9c47a9b184e02424a88890. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.321599 6036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a074daec0e474298bb8c313952a935bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.324905 6456 tablet_bootstrap.cc:492] T 2e1c19a751904a6295897376e9c5ee56 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:26.325037 6456 ts_tablet_manager.cc:1403] T 2e1c19a751904a6295897376e9c5ee56 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.401s user 0.003s sys 0.004s
I20260923 19:50:26.325726 6456 raft_consensus.cc:359] T 2e1c19a751904a6295897376e9c5ee56 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:26.325940 6456 raft_consensus.cc:385] T 2e1c19a751904a6295897376e9c5ee56 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:26.325989 6456 raft_consensus.cc:740] T 2e1c19a751904a6295897376e9c5ee56 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:26.326188 6456 consensus_queue.cc:260] T 2e1c19a751904a6295897376e9c5ee56 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:26.326594 6177 tablet_service.cc:1511] Processing CreateTablet for tablet 60090cc5be4c4acc9bbeca63c50c74e0 (DEFAULT_TABLE table=default.Table_6bd43076ac0a41129669ca864669d1dc [id=2f62b583f35948d6831bb12e63144602]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.326982 6177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60090cc5be4c4acc9bbeca63c50c74e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.326946 6028 tablet_service.cc:1511] Processing CreateTablet for tablet ff4239dad2d5451aa3e541ba8b331db2 (DEFAULT_TABLE table=default.Table_45dc6c5ba67e4dedb020fe098d5f95e5 [id=7c1a18ac36b2489ba47a8d64a128c44a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.327263 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff4239dad2d5451aa3e541ba8b331db2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.328398 6029 tablet_service.cc:1511] Processing CreateTablet for tablet bb13cbc143aa444e900d2b9a60a44062 (DEFAULT_TABLE table=default.Table_12be29ecddb1411893380f5d1d81bb57 [id=6397659847f84a0a98f78fa3b87a61f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.328781 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb13cbc143aa444e900d2b9a60a44062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.330333 6176 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ce73f31a1f64a24835a272fea8d65c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:25 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:26.330721 6176 tablet_service.cc:1558] Processing DeleteTablet for tablet b483bc3a99864e6f96b12709e1a8681f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:25 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:26.331004 6176 tablet_service.cc:1558] Processing DeleteTablet for tablet a10d35bf564d45488524d3d21721f4e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:06 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:26.331286 6176 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e835fa95fa84b43be4c27b7e3e26af3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:26 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:26.331641 6176 tablet_service.cc:1558] Processing DeleteTablet for tablet c9fe3ffc092a476fa0632581efc2fd6d with delete_type TABLET_DATA_DELETED (replaced by tablet d8504451f57b47948a0e82e0d3a300bc) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:26.332480 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 85b7dcf131c54187a6e61f8503c797f8 (table default.Table_23c500b65dba4b6790b4349e5a5b0a07 [id=647997210f5349a68aa98d24e12a33cd]) successfully deleted
I20260923 19:50:26.333416 6200 raft_consensus.cc:3060] T d39a64531dd24eb4aa1f7e0c418b985b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:26.334741 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e69656e9fc941e19eb7de5c87bc9050" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:26.335677 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 64e8951eb899461aa9c0b36e3f7555e2 (table default.Table_562543b3ee364c59a1a2a7fd61331c74 [id=d1195b250ce24d589296d3a776339d7b]) successfully deleted
I20260923 19:50:26.336284 6322 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e835fa95fa84b43be4c27b7e3e26af3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:26 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:26.336463 6173 tablet_service.cc:1558] Processing DeleteTablet for tablet f994c5da7ed6483dacb47350531c0ea0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:25 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:26.341702 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_4c9e6740f40f4215b262e03b14ab9725"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:26.342212 6181 tablet_service.cc:1511] Processing CreateTablet for tablet 6e17edbff714455f8d0e78aa67a5d6d1 (DEFAULT_TABLE table=default.Table_65c94b4a142e435dbd490ba30c1613f6 [id=99a5831a9d1c40bda0026c53724733de]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:26.342308 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4c9e6740f40f4215b262e03b14ab9725 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:26.342602 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e17edbff714455f8d0e78aa67a5d6d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.343631 6456 ts_tablet_manager.cc:1434] T 2e1c19a751904a6295897376e9c5ee56 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20260923 19:50:26.343919 6456 tablet_bootstrap.cc:492] T 02fa9052a7054659baf9b07b770bb538 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:26.346195 6456 tablet_bootstrap.cc:654] T 02fa9052a7054659baf9b07b770bb538 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:26.350237 6458 ts_tablet_manager.cc:1929] T 2526884ab0ef404aaf93051cc842c695 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:26.350509 6458 log.cc:1199] T 2526884ab0ef404aaf93051cc842c695 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/2526884ab0ef404aaf93051cc842c695
I20260923 19:50:26.350984 6322 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e1c19a751904a6295897376e9c5ee56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:26.351337 6458 ts_tablet_manager.cc:1950] T 2526884ab0ef404aaf93051cc842c695 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:26.224530 6166 tablet_service.cc:1511] Processing CreateTablet for tablet 4ed64fe66b4a4f6ca000feb9a89a6155 (DEFAULT_TABLE table=default.Table_8aec2b8ca8d846488ec51dd3691f5208 [id=42aec7fdc30e441286bb2db61f79d5a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.352339 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ed64fe66b4a4f6ca000feb9a89a6155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.353224 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 2526884ab0ef404aaf93051cc842c695 (table default.Table_3690c4b8c8334a47930dd2af3aaa23ae [id=8b5af7ae4e48454e9204a5784912842d]) successfully deleted
I20260923 19:50:26.353416 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 772ece5283a949408d849f6e56f5f17b (table default.Table_f163b8d593ca45ecb37b794671a4bf8b [id=909921effa834834ae8eed17dfd21976]) successfully deleted
W20260923 19:50:26.353643 5790 catalog_manager.cc:5030] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 559f3e3016aa470f9732a727b4528586 because the tablet was not found. No further retry: Not found: Tablet not found: 559f3e3016aa470f9732a727b4528586
I20260923 19:50:26.353766 6458 tablet_replica.cc:333] T 2852e91ccd0c44b3b16f8189e57575d7 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:26.354043 6458 raft_consensus.cc:2243] T 2852e91ccd0c44b3b16f8189e57575d7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:26.354332 6458 raft_consensus.cc:2272] T 2852e91ccd0c44b3b16f8189e57575d7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:26.354554 6279 leader_election.cc:343] T f8052b05169b4673b387ac8b716ffc4e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: f8052b05169b4673b387ac8b716ffc4e
I20260923 19:50:26.354669 6279 leader_election.cc:304] T f8052b05169b4673b387ac8b716ffc4e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:26.355015 6458 ts_tablet_manager.cc:1916] T 2852e91ccd0c44b3b16f8189e57575d7 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:26.355094 7990 consensus_queue.cc:1048] T 397ec5e49673406cb26a2efab0ad8401 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:26.355736 7990 raft_consensus.cc:2749] T f8052b05169b4673b387ac8b716ffc4e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:26.356464 6454 tablet_bootstrap.cc:654] T d35ff653bf8d41cfbcf83359402a8f6a P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:26.366019 5790 catalog_manager.cc:5030] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 09792de9c452418781a4331ea1b0477c because the tablet was not found. No further retry: Not found: Tablet not found: 09792de9c452418781a4331ea1b0477c
I20260923 19:50:26.107136 6170 tablet_service.cc:1511] Processing CreateTablet for tablet a1dfaa834dd64f259d80e2c82f814c78 (DEFAULT_TABLE table=default.Table_8cb2657c9ef4484d9d886f77c7527eda [id=0bb24c29f5a54b1bbeb82e1592079a81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.358369 6165 tablet_service.cc:1511] Processing CreateTablet for tablet 9559a768542b45fe969bf1d20d53266a (DEFAULT_TABLE table=default.Table_2491b66ec8974b4ba9fc7a96d4fd9cb5 [id=f32a701a1a7642cb91b3fbee2c9c0bad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.365506 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2dd611746d741e88b6911bf5d51f3e5" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:26.366917 6170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1dfaa834dd64f259d80e2c82f814c78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.367990 6165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9559a768542b45fe969bf1d20d53266a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.138615 6179 tablet_service.cc:1511] Processing CreateTablet for tablet 52ff59ad89cf46a78852d50c09824d1b (DEFAULT_TABLE table=default.Table_80da016ec382404792b58b67eb9132c3 [id=1d23d99ca89e48a59f5f93413db60da6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.370332 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ff59ad89cf46a78852d50c09824d1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.365540 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a263c0fc71424999b76ef01de9a51eda" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:26.373402 7955 tablet.cc:1751] T d39a64531dd24eb4aa1f7e0c418b985b P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260923 19:50:26.376400 6039 tablet_service.cc:1511] Processing CreateTablet for tablet 60090cc5be4c4acc9bbeca63c50c74e0 (DEFAULT_TABLE table=default.Table_6bd43076ac0a41129669ca864669d1dc [id=2f62b583f35948d6831bb12e63144602]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.376786 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60090cc5be4c4acc9bbeca63c50c74e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.382448 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet 684eb2576b4b4730813b993e36b242df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:26.388165 6030 tablet_service.cc:1511] Processing CreateTablet for tablet 984f2fa07b30426ebf71b7165fdf0695 (DEFAULT_TABLE table=default.Table_3e51d8e802da43f19bedf3ef57864490 [id=b1197d7521f949499cd365617556a7e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.388639 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 984f2fa07b30426ebf71b7165fdf0695. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.391687 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 27c93aa4a39d4abda132e022cd171cdc (DEFAULT_TABLE table=default.Table_48f506d658aa4b7e9ac358f7f73d3b83 [id=8ae5f06a147f409f88a7bbf3eb724eb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.392072 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27c93aa4a39d4abda132e022cd171cdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.394299 6029 tablet_service.cc:1511] Processing CreateTablet for tablet a1741bdfa9ca4544a1fad8d3688899af (DEFAULT_TABLE table=default.Table_7ac640f9ac474cf9bcf6d412e838998e [id=eb611bb527f94c4bb94a5391fae9773e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.394726 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1741bdfa9ca4544a1fad8d3688899af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.384392 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_d80fb2325f854ac8a9afc787c585e370"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:26.396075 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d80fb2325f854ac8a9afc787c585e370 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:26.396708 6023 tablet_service.cc:1511] Processing CreateTablet for tablet 4ed64fe66b4a4f6ca000feb9a89a6155 (DEFAULT_TABLE table=default.Table_8aec2b8ca8d846488ec51dd3691f5208 [id=42aec7fdc30e441286bb2db61f79d5a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.397058 6023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ed64fe66b4a4f6ca000feb9a89a6155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.400820 6021 tablet_service.cc:1558] Processing DeleteTablet for tablet f994c5da7ed6483dacb47350531c0ea0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:25 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:26.049418 6459 rpcz_store.cc:276] 0923 19:50:23.346999 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:23.365623 (+ 18624us) service_pool.cc:224] Handling call
0923 19:50:26.048843 (+2683220us) ts_tablet_manager.cc:1151] Deleting tablet 78911eed02894176b689fd9ce681de71
0923 19:50:26.048857 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:26.049137 (+ 280us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2650114}
I20260923 19:50:26.401224 6021 tablet_service.cc:1511] Processing CreateTablet for tablet b1eec74ca2b54d2cb47a8a13fb4b293a (DEFAULT_TABLE table=default.Table_71bc8c1e8c3a49888b937afd57ba8087 [id=fef1b685ee17471fa4d78086ee50315e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.401644 6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1eec74ca2b54d2cb47a8a13fb4b293a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.401901 6025 tablet_service.cc:1511] Processing CreateTablet for tablet 668c41aba151431599f90421ce4ed498 (DEFAULT_TABLE table=default.Table_af92277fab3e4672b156efcbb1d09f0b [id=f51215dbbf5740cf980fb218496dc8c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.402305 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 668c41aba151431599f90421ce4ed498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.403625 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1043) took 2991 ms. Trace:
I20260923 19:50:26.413825 6459 rpcz_store.cc:276] 0923 19:50:23.412218 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:23.412278 (+ 60us) service_pool.cc:224] Handling call
0923 19:50:26.403475 (+2991197us) ts_tablet_manager.cc:1151] Deleting tablet e6ebb766244f40a28e5fd96ecbb3e4f6
0923 19:50:26.403488 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:26.403605 (+ 117us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2991007}
I20260923 19:50:26.414454 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet c9fe3ffc092a476fa0632581efc2fd6d with delete_type TABLET_DATA_DELETED (replaced by tablet d8504451f57b47948a0e82e0d3a300bc) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:26.407058 6168 tablet_service.cc:1511] Processing CreateTablet for tablet ff4239dad2d5451aa3e541ba8b331db2 (DEFAULT_TABLE table=default.Table_45dc6c5ba67e4dedb020fe098d5f95e5 [id=7c1a18ac36b2489ba47a8d64a128c44a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:26.417809 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 78911eed02894176b689fd9ce681de71 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78911eed02894176b689fd9ce681de71 already in progress: creating tablet
W20260923 19:50:26.418211 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet e6ebb766244f40a28e5fd96ecbb3e4f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6ebb766244f40a28e5fd96ecbb3e4f6 already in progress: creating tablet
I20260923 19:50:26.404981 6035 tablet_service.cc:1511] Processing CreateTablet for tablet 12b5d024bb6e4227b57884fc109a51d0 (DEFAULT_TABLE table=default.Table_b40d9e540b804d268db162e3c6166ff0 [id=ae5f3376006d467f84061e2aa25fd2cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.419057 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12b5d024bb6e4227b57884fc109a51d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.407833 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 91008b47d8ad414cb03d6c956a4b53b0 (DEFAULT_TABLE table=default.Table_ca2186f8aabb45b296744c0f2eb8d87a [id=4625fee9f5f845b5bbdf5e746223c6be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.419703 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91008b47d8ad414cb03d6c956a4b53b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.420836 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ce73f31a1f64a24835a272fea8d65c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:25 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:26.421412 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet b483bc3a99864e6f96b12709e1a8681f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:25 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:26.421864 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e835fa95fa84b43be4c27b7e3e26af3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:26 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:26.422385 6032 tablet_service.cc:1558] Processing DeleteTablet for tablet c9fe3ffc092a476fa0632581efc2fd6d with delete_type TABLET_DATA_DELETED (replaced by tablet d8504451f57b47948a0e82e0d3a300bc) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:26.426334 5995 leader_election.cc:343] T f2799563250845b0b9d7d51b2367b16b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:26.426586 5995 leader_election.cc:304] T f2799563250845b0b9d7d51b2367b16b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:26.426991 7985 raft_consensus.cc:2749] T f2799563250845b0b9d7d51b2367b16b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:26.427603 5995 leader_election.cc:343] T 89b950342b66486fa6ec0cdf03ad4881 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:26.428292 5995 leader_election.cc:304] T 89b950342b66486fa6ec0cdf03ad4881 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:26.428926 7985 raft_consensus.cc:2749] T 89b950342b66486fa6ec0cdf03ad4881 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:26.432734 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1039) took 3032 ms. Trace:
I20260923 19:50:26.432961 6459 rpcz_store.cc:276] 0923 19:50:23.399965 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:23.414008 (+ 14043us) service_pool.cc:224] Handling call
0923 19:50:26.415100 (+3001092us) ts_tablet_manager.cc:1151] Deleting tablet 78911eed02894176b689fd9ce681de71
0923 19:50:26.432595 (+ 17495us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:26.432711 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3000715}
I20260923 19:50:26.433494 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1062) took 2642 ms. Trace:
W20260923 19:50:26.433596 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 78911eed02894176b689fd9ce681de71 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78911eed02894176b689fd9ce681de71 already in progress: creating tablet
I20260923 19:50:26.438483 6457 tablet_bootstrap.cc:492] T 9756a1f8e23a436bb7c19c8cba7bdc05 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:26.438629 6457 ts_tablet_manager.cc:1403] T 9756a1f8e23a436bb7c19c8cba7bdc05 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.350s user 0.005s sys 0.006s
I20260923 19:50:26.439345 6457 raft_consensus.cc:359] T 9756a1f8e23a436bb7c19c8cba7bdc05 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:26.439508 6457 raft_consensus.cc:385] T 9756a1f8e23a436bb7c19c8cba7bdc05 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:26.439551 6457 raft_consensus.cc:740] T 9756a1f8e23a436bb7c19c8cba7bdc05 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:26.439718 6457 consensus_queue.cc:260] T 9756a1f8e23a436bb7c19c8cba7bdc05 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:26.440179 6457 ts_tablet_manager.cc:1434] T 9756a1f8e23a436bb7c19c8cba7bdc05 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260923 19:50:26.440485 6457 tablet_bootstrap.cc:492] T 14c917ac93fd436aa13fb0839fae883f P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:26.441810 6457 tablet_bootstrap.cc:654] T 14c917ac93fd436aa13fb0839fae883f P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:26.444800 6459 rpcz_store.cc:276] 0923 19:50:23.791277 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:23.792355 (+ 1078us) service_pool.cc:224] Handling call
0923 19:50:26.433393 (+2641038us) ts_tablet_manager.cc:1151] Deleting tablet 4f0de9a4b9164e05874d322a0b4a8e46
0923 19:50:26.433403 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:26.433478 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2607803}
I20260923 19:50:26.445317 6459 tablet_replica.cc:333] T c7369a5fc87f4b70bcfbe052ef021771 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
W20260923 19:50:26.445502 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 4f0de9a4b9164e05874d322a0b4a8e46 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f0de9a4b9164e05874d322a0b4a8e46 already in progress: creating tablet
I20260923 19:50:26.449635 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b1d58b8b9cff44cb9e744a5e5d9226d8" } new_table_name: "default.Table_2dd0d5ba241c477188fb511e355d29d5" modify_external_catalogs: true
I20260923 19:50:26.450089 5805 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5bdbdee3baac47d5866b840863e76535" } modify_external_catalogs: true
I20260923 19:50:26.450443 5805 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5bdbdee3baac47d5866b840863e76535" } modify_external_catalogs: true
I20260923 19:50:26.452021 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_dfc9cd82388c498dbce4dc8323ecae0f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:26.453480 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dfc9cd82388c498dbce4dc8323ecae0f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:26.455139 6458 ts_tablet_manager.cc:1929] T 2852e91ccd0c44b3b16f8189e57575d7 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:26.455691 5801 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_8ae3676f12e14ee5a82935897324e9d6" } new_table_name: "default.Table_0498a590805b4a21b29cded81e42d448" modify_external_catalogs: true
I20260923 19:50:26.433910 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff4239dad2d5451aa3e541ba8b331db2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.407996 6030 tablet_service.cc:1511] Processing CreateTablet for tablet 6e17edbff714455f8d0e78aa67a5d6d1 (DEFAULT_TABLE table=default.Table_65c94b4a142e435dbd490ba30c1613f6 [id=99a5831a9d1c40bda0026c53724733de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.409163 6040 tablet_service.cc:1511] Processing CreateTablet for tablet 9559a768542b45fe969bf1d20d53266a (DEFAULT_TABLE table=default.Table_2491b66ec8974b4ba9fc7a96d4fd9cb5 [id=f32a701a1a7642cb91b3fbee2c9c0bad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.412817 6024 tablet_service.cc:1558] Processing DeleteTablet for tablet a83726da349c4cd1852e956c8fa2cda5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:26.416008 6031 tablet_service.cc:1558] Processing DeleteTablet for tablet d2dd611746d741e88b6911bf5d51f3e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:26.417824 6036 tablet_service.cc:1558] Processing DeleteTablet for tablet 431ad4da27544d68aa5666293984a86a with delete_type TABLET_DATA_DELETED (replaced by tablet 68459111552949aab20982dd7c28f7d3) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:26.419341 7986 raft_consensus.cc:493] T 1cf016ff0bb8418d84358d17876338bf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:26.460111 7986 raft_consensus.cc:515] T 1cf016ff0bb8418d84358d17876338bf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:26.460762 7986 leader_election.cc:290] T 1cf016ff0bb8418d84358d17876338bf P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:26.462066 5995 leader_election.cc:343] T 4e69656e9fc941e19eb7de5c87bc9050 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:26.462307 5995 leader_election.cc:304] T 4e69656e9fc941e19eb7de5c87bc9050 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:26.462678 7986 raft_consensus.cc:2749] T 4e69656e9fc941e19eb7de5c87bc9050 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:26.463934 5995 leader_election.cc:343] T d2dd611746d741e88b6911bf5d51f3e5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:26.464114 5995 leader_election.cc:304] T d2dd611746d741e88b6911bf5d51f3e5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:26.464381 7986 raft_consensus.cc:2749] T d2dd611746d741e88b6911bf5d51f3e5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:26.464478 6040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9559a768542b45fe969bf1d20d53266a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:26.464792 5995 leader_election.cc:343] T a263c0fc71424999b76ef01de9a51eda P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:26.464929 5995 leader_election.cc:304] T a263c0fc71424999b76ef01de9a51eda P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:26.461839 6459 raft_consensus.cc:2243] T c7369a5fc87f4b70bcfbe052ef021771 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:26.465214 6459 raft_consensus.cc:2272] T c7369a5fc87f4b70bcfbe052ef021771 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:26.465205 7986 raft_consensus.cc:2749] T a263c0fc71424999b76ef01de9a51eda P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:26.465749 6459 ts_tablet_manager.cc:1916] T c7369a5fc87f4b70bcfbe052ef021771 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:26.466526 6054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40adb472162042e48fdbb496b342996a" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:26.466712 6054 raft_consensus.cc:2468] T 40adb472162042e48fdbb496b342996a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:26.467077 6461 tablet_replica.cc:333] T a83726da349c4cd1852e956c8fa2cda5 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:26.467280 6461 raft_consensus.cc:2243] T a83726da349c4cd1852e956c8fa2cda5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:26.467442 6461 raft_consensus.cc:2272] T a83726da349c4cd1852e956c8fa2cda5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:26.467962 6461 ts_tablet_manager.cc:1916] T a83726da349c4cd1852e956c8fa2cda5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:26.469118 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet f994c5da7ed6483dacb47350531c0ea0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f994c5da7ed6483dacb47350531c0ea0 already in progress: creating tablet
W20260923 19:50:26.471716 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 5ce73f31a1f64a24835a272fea8d65c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ce73f31a1f64a24835a272fea8d65c4 already in progress: creating tablet
W20260923 19:50:26.472115 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet b483bc3a99864e6f96b12709e1a8681f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b483bc3a99864e6f96b12709e1a8681f already in progress: creating tablet
W20260923 19:50:26.472486 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 1e835fa95fa84b43be4c27b7e3e26af3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e835fa95fa84b43be4c27b7e3e26af3 already in progress: creating tablet
W20260923 19:50:26.472841 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet c9fe3ffc092a476fa0632581efc2fd6d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c9fe3ffc092a476fa0632581efc2fd6d already in progress: creating tablet
I20260923 19:50:26.474493 6461 ts_tablet_manager.cc:1929] T a83726da349c4cd1852e956c8fa2cda5 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:26.474608 6461 log.cc:1199] T a83726da349c4cd1852e956c8fa2cda5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/a83726da349c4cd1852e956c8fa2cda5
I20260923 19:50:26.474879 6461 ts_tablet_manager.cc:1950] T a83726da349c4cd1852e956c8fa2cda5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:26.477567 6461 tablet_replica.cc:333] T d2dd611746d741e88b6911bf5d51f3e5 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:26.478206 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet a83726da349c4cd1852e956c8fa2cda5 (table default.Table_ab816e7937ae4627a7a13c8e091caf19 [id=114c61097627471983e4bec86709dc5e]) successfully deleted
I20260923 19:50:26.478652 6461 raft_consensus.cc:2243] T d2dd611746d741e88b6911bf5d51f3e5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:26.478868 6461 raft_consensus.cc:2272] T d2dd611746d741e88b6911bf5d51f3e5 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:26.479725 6461 ts_tablet_manager.cc:1916] T d2dd611746d741e88b6911bf5d51f3e5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:26.482131 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e17edbff714455f8d0e78aa67a5d6d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.459383 6456 tablet_bootstrap.cc:492] T 02fa9052a7054659baf9b07b770bb538 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:26.461413 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf016ff0bb8418d84358d17876338bf" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:26.484819 6456 ts_tablet_manager.cc:1403] T 02fa9052a7054659baf9b07b770bb538 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.141s user 0.032s sys 0.035s
I20260923 19:50:26.485630 6456 raft_consensus.cc:359] T 02fa9052a7054659baf9b07b770bb538 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:26.485689 5996 leader_election.cc:343] T 1cf016ff0bb8418d84358d17876338bf P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:26.485806 6456 raft_consensus.cc:385] T 02fa9052a7054659baf9b07b770bb538 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:26.485862 6456 raft_consensus.cc:740] T 02fa9052a7054659baf9b07b770bb538 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:26.486104 6456 consensus_queue.cc:260] T 02fa9052a7054659baf9b07b770bb538 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:26.486665 6456 ts_tablet_manager.cc:1434] T 02fa9052a7054659baf9b07b770bb538 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260923 19:50:26.486912 6456 tablet_bootstrap.cc:492] T 22c89609da884c47b1dbc1470b37efbe P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:26.488277 6456 tablet_bootstrap.cc:654] T 22c89609da884c47b1dbc1470b37efbe P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:26.489903 6458 log.cc:1199] T 2852e91ccd0c44b3b16f8189e57575d7 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/2852e91ccd0c44b3b16f8189e57575d7
I20260923 19:50:26.490505 6458 ts_tablet_manager.cc:1950] T 2852e91ccd0c44b3b16f8189e57575d7 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:26.490572 6456 tablet_bootstrap.cc:492] T 22c89609da884c47b1dbc1470b37efbe P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:26.490708 6456 ts_tablet_manager.cc:1403] T 22c89609da884c47b1dbc1470b37efbe P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260923 19:50:26.491310 6456 raft_consensus.cc:359] T 22c89609da884c47b1dbc1470b37efbe P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:26.491494 6456 raft_consensus.cc:385] T 22c89609da884c47b1dbc1470b37efbe P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:26.491479 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 2852e91ccd0c44b3b16f8189e57575d7 (table default.Table_63a3afc2f4ac454cb8bb6551ba17376c [id=5a6519f52d71406bac54e12459ef85a3]) successfully deleted
I20260923 19:50:26.491552 6456 raft_consensus.cc:740] T 22c89609da884c47b1dbc1470b37efbe P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:26.491726 6458 tablet_replica.cc:333] T f8052b05169b4673b387ac8b716ffc4e P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
W20260923 19:50:26.491823 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet b483bc3a99864e6f96b12709e1a8681f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b483bc3a99864e6f96b12709e1a8681f already in progress: creating tablet
I20260923 19:50:26.491919 6458 raft_consensus.cc:2243] T f8052b05169b4673b387ac8b716ffc4e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:26.492053 6458 raft_consensus.cc:2272] T f8052b05169b4673b387ac8b716ffc4e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:26.491993 6456 consensus_queue.cc:260] T 22c89609da884c47b1dbc1470b37efbe P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:26.492508 6456 ts_tablet_manager.cc:1434] T 22c89609da884c47b1dbc1470b37efbe P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:50:26.492596 6458 ts_tablet_manager.cc:1916] T f8052b05169b4673b387ac8b716ffc4e P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:26.492787 6456 tablet_bootstrap.cc:492] T cb11d6e082784ad98cfb5253dbb88707 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:26.493494 6454 tablet_bootstrap.cc:492] T d35ff653bf8d41cfbcf83359402a8f6a P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:26.493624 6454 ts_tablet_manager.cc:1403] T d35ff653bf8d41cfbcf83359402a8f6a P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.181s user 0.004s sys 0.002s
I20260923 19:50:26.494174 6456 tablet_bootstrap.cc:654] T cb11d6e082784ad98cfb5253dbb88707 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:26.494313 6454 raft_consensus.cc:359] T d35ff653bf8d41cfbcf83359402a8f6a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:26.494469 6454 raft_consensus.cc:385] T d35ff653bf8d41cfbcf83359402a8f6a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:26.494516 6454 raft_consensus.cc:740] T d35ff653bf8d41cfbcf83359402a8f6a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:26.494724 6454 consensus_queue.cc:260] T d35ff653bf8d41cfbcf83359402a8f6a P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:26.495290 6454 ts_tablet_manager.cc:1434] T d35ff653bf8d41cfbcf83359402a8f6a P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:50:26.495613 6461 ts_tablet_manager.cc:1929] T d2dd611746d741e88b6911bf5d51f3e5 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:26.496073 6461 log.cc:1199] T d2dd611746d741e88b6911bf5d51f3e5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/d2dd611746d741e88b6911bf5d51f3e5
I20260923 19:50:26.496635 6461 ts_tablet_manager.cc:1950] T d2dd611746d741e88b6911bf5d51f3e5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:26.497753 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet d2dd611746d741e88b6911bf5d51f3e5 (table default.Table_462ef67f5c8445bb919cdd9a35d15cff [id=bb4d2afeaf104e949d52cced351b3bea]) successfully deleted
I20260923 19:50:26.497828 6461 tablet_replica.cc:333] T 431ad4da27544d68aa5666293984a86a P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:26.498356 6461 raft_consensus.cc:2243] T 431ad4da27544d68aa5666293984a86a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:26.498800 6461 raft_consensus.cc:2272] T 431ad4da27544d68aa5666293984a86a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:26.498924 6458 ts_tablet_manager.cc:1929] T f8052b05169b4673b387ac8b716ffc4e P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:26.499092 6458 log.cc:1199] T f8052b05169b4673b387ac8b716ffc4e P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/f8052b05169b4673b387ac8b716ffc4e
I20260923 19:50:26.499351 6461 ts_tablet_manager.cc:1916] T 431ad4da27544d68aa5666293984a86a P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:26.499505 6458 ts_tablet_manager.cc:1950] T f8052b05169b4673b387ac8b716ffc4e P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:26.500571 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet f8052b05169b4673b387ac8b716ffc4e (table default.Table_a9e7f8c6300f47c7ba79e2dbe36d7849 [id=8bac5d4f5c9c41f7b121d81382633a49]) successfully deleted
I20260923 19:50:26.500923 6458 tablet_replica.cc:333] T 21bf33904ede470b80a074dc9a458baf P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:26.501137 6458 raft_consensus.cc:2243] T 21bf33904ede470b80a074dc9a458baf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:26.501331 6458 raft_consensus.cc:2272] T 21bf33904ede470b80a074dc9a458baf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:26.501860 6458 ts_tablet_manager.cc:1916] T 21bf33904ede470b80a074dc9a458baf P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:26.502350 6456 tablet_bootstrap.cc:492] T cb11d6e082784ad98cfb5253dbb88707 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:26.502475 6456 ts_tablet_manager.cc:1403] T cb11d6e082784ad98cfb5253dbb88707 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260923 19:50:26.503101 6456 raft_consensus.cc:359] T cb11d6e082784ad98cfb5253dbb88707 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:26.503263 6456 raft_consensus.cc:385] T cb11d6e082784ad98cfb5253dbb88707 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:26.503315 6456 raft_consensus.cc:740] T cb11d6e082784ad98cfb5253dbb88707 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:26.503531 6456 consensus_queue.cc:260] T cb11d6e082784ad98cfb5253dbb88707 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:26.503949 6456 ts_tablet_manager.cc:1434] T cb11d6e082784ad98cfb5253dbb88707 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260923 19:50:26.504202 6456 tablet_bootstrap.cc:492] T d04b3a9ade7a405bb619704095fac279 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:26.505483 6456 tablet_bootstrap.cc:654] T d04b3a9ade7a405bb619704095fac279 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:26.508458 6458 ts_tablet_manager.cc:1929] T 21bf33904ede470b80a074dc9a458baf P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:26.508658 6458 log.cc:1199] T 21bf33904ede470b80a074dc9a458baf P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/21bf33904ede470b80a074dc9a458baf
I20260923 19:50:26.509034 6458 ts_tablet_manager.cc:1950] T 21bf33904ede470b80a074dc9a458baf P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:26.510252 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 21bf33904ede470b80a074dc9a458baf (table default.Table_9f93fd5514734871bf6a205b82e6e8ef [id=29a9cb5a2b5e41f6a20555efb499eb00]) successfully deleted
W20260923 19:50:26.510977 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 5ce73f31a1f64a24835a272fea8d65c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ce73f31a1f64a24835a272fea8d65c4 already in progress: creating tablet
I20260923 19:50:26.511314 6458 tablet_replica.cc:333] T ba639d8c68cf49a49a5ec5729143cf6b P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:26.511570 6458 raft_consensus.cc:2243] T ba639d8c68cf49a49a5ec5729143cf6b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:26.511775 6458 raft_consensus.cc:2272] T ba639d8c68cf49a49a5ec5729143cf6b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:26.512321 6458 ts_tablet_manager.cc:1916] T ba639d8c68cf49a49a5ec5729143cf6b P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:26.512578 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf016ff0bb8418d84358d17876338bf" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:26.513199 5995 leader_election.cc:343] T 1cf016ff0bb8418d84358d17876338bf P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:26.513684 5995 leader_election.cc:304] T 1cf016ff0bb8418d84358d17876338bf P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:26.514076 7986 raft_consensus.cc:2749] T 1cf016ff0bb8418d84358d17876338bf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:26.512692 6461 ts_tablet_manager.cc:1929] T 431ad4da27544d68aa5666293984a86a P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:26.514693 6461 log.cc:1199] T 431ad4da27544d68aa5666293984a86a P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/431ad4da27544d68aa5666293984a86a
I20260923 19:50:26.515354 6461 ts_tablet_manager.cc:1950] T 431ad4da27544d68aa5666293984a86a P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:26.515471 6456 tablet_bootstrap.cc:492] T d04b3a9ade7a405bb619704095fac279 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:26.515601 6456 ts_tablet_manager.cc:1403] T d04b3a9ade7a405bb619704095fac279 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20260923 19:50:26.516208 6454 tablet_bootstrap.cc:492] T f1f1df47dc32413d9cc9456f4198dca5 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:26.516239 6456 raft_consensus.cc:359] T d04b3a9ade7a405bb619704095fac279 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:26.516470 6456 raft_consensus.cc:385] T d04b3a9ade7a405bb619704095fac279 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:26.516527 6456 raft_consensus.cc:740] T d04b3a9ade7a405bb619704095fac279 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:26.516718 6456 consensus_queue.cc:260] T d04b3a9ade7a405bb619704095fac279 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:26.517199 6456 ts_tablet_manager.cc:1434] T d04b3a9ade7a405bb619704095fac279 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:50:26.517478 6456 tablet_bootstrap.cc:492] T f2799563250845b0b9d7d51b2367b16b P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:26.518478 6454 tablet_bootstrap.cc:654] T f1f1df47dc32413d9cc9456f4198dca5 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:26.518839 6456 tablet_bootstrap.cc:654] T f2799563250845b0b9d7d51b2367b16b P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:26.524814 6458 ts_tablet_manager.cc:1929] T ba639d8c68cf49a49a5ec5729143cf6b P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:26.524940 6458 log.cc:1199] T ba639d8c68cf49a49a5ec5729143cf6b P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/ba639d8c68cf49a49a5ec5729143cf6b
I20260923 19:50:26.525197 6458 ts_tablet_manager.cc:1950] T ba639d8c68cf49a49a5ec5729143cf6b P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:26.526131 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 431ad4da27544d68aa5666293984a86a (table default.Table_e980698a75d14d24afdd616fa2118c72 [id=0fc34fcbffe446c693df52715ddbe9e8]) successfully deleted
I20260923 19:50:26.534667 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet ba639d8c68cf49a49a5ec5729143cf6b (table default.Table_53cf6ab2721c4d7baa36065c8d48ffc1 [id=d4cdad465f1a405e8723d0dcb01e0508]) successfully deleted
I20260923 19:50:26.535709 6458 tablet_replica.cc:333] T ea2ef507c6e24d369427048171dfec06 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:26.536008 6458 raft_consensus.cc:2243] T ea2ef507c6e24d369427048171dfec06 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:26.536203 6458 raft_consensus.cc:2272] T ea2ef507c6e24d369427048171dfec06 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:26.538156 6458 ts_tablet_manager.cc:1916] T ea2ef507c6e24d369427048171dfec06 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:26.551471 6454 tablet_bootstrap.cc:492] T f1f1df47dc32413d9cc9456f4198dca5 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:26.551815 6454 ts_tablet_manager.cc:1403] T f1f1df47dc32413d9cc9456f4198dca5 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.036s user 0.005s sys 0.003s
I20260923 19:50:26.552713 6458 ts_tablet_manager.cc:1929] T ea2ef507c6e24d369427048171dfec06 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:26.552838 6454 raft_consensus.cc:359] T f1f1df47dc32413d9cc9456f4198dca5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:26.553360 6454 raft_consensus.cc:385] T f1f1df47dc32413d9cc9456f4198dca5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:26.553597 6454 raft_consensus.cc:740] T f1f1df47dc32413d9cc9456f4198dca5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:26.553949 6454 consensus_queue.cc:260] T f1f1df47dc32413d9cc9456f4198dca5 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:26.554422 6458 log.cc:1199] T ea2ef507c6e24d369427048171dfec06 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/ea2ef507c6e24d369427048171dfec06
I20260923 19:50:26.554764 6454 ts_tablet_manager.cc:1434] T f1f1df47dc32413d9cc9456f4198dca5 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:50:26.555094 6458 ts_tablet_manager.cc:1950] T ea2ef507c6e24d369427048171dfec06 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:26.555146 6454 tablet_bootstrap.cc:492] T 670d9cb0e6e2414092f72ffd5e6b00ea P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:26.556808 6454 tablet_bootstrap.cc:654] T 670d9cb0e6e2414092f72ffd5e6b00ea P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:26.557056 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet ea2ef507c6e24d369427048171dfec06 (table default.Table_d115f4f641e04087a0ed990be1431c58 [id=4d76230d0f7b4e5b9964f5e68525d0aa]) successfully deleted
I20260923 19:50:26.568056 6457 tablet_bootstrap.cc:492] T 14c917ac93fd436aa13fb0839fae883f P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:26.568282 6457 ts_tablet_manager.cc:1403] T 14c917ac93fd436aa13fb0839fae883f P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.128s user 0.003s sys 0.003s
I20260923 19:50:26.569173 6457 raft_consensus.cc:359] T 14c917ac93fd436aa13fb0839fae883f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:26.569413 6457 raft_consensus.cc:385] T 14c917ac93fd436aa13fb0839fae883f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:26.569507 6457 raft_consensus.cc:740] T 14c917ac93fd436aa13fb0839fae883f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
W20260923 19:50:26.569971 6279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.143.193:39887, user_credentials={real_user=slave}} blocked reactor thread for 182449us
I20260923 19:50:26.572093 6279 leader_election.cc:304] T 40adb472162042e48fdbb496b342996a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:26.572742 7822 raft_consensus.cc:2804] T 40adb472162042e48fdbb496b342996a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:26.572824 7822 raft_consensus.cc:493] T 40adb472162042e48fdbb496b342996a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:26.572887 7822 raft_consensus.cc:3060] T 40adb472162042e48fdbb496b342996a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:26.574860 6454 tablet_bootstrap.cc:492] T 670d9cb0e6e2414092f72ffd5e6b00ea P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:26.575021 6454 ts_tablet_manager.cc:1403] T 670d9cb0e6e2414092f72ffd5e6b00ea P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.001s
I20260923 19:50:26.575760 6454 raft_consensus.cc:359] T 670d9cb0e6e2414092f72ffd5e6b00ea P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:26.575913 6454 raft_consensus.cc:385] T 670d9cb0e6e2414092f72ffd5e6b00ea P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:26.575810 7822 raft_consensus.cc:515] T 40adb472162042e48fdbb496b342996a P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:26.575961 6454 raft_consensus.cc:740] T 670d9cb0e6e2414092f72ffd5e6b00ea P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:26.576169 6454 consensus_queue.cc:260] T 670d9cb0e6e2414092f72ffd5e6b00ea P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:26.576615 7822 leader_election.cc:290] T 40adb472162042e48fdbb496b342996a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:26.576683 6454 ts_tablet_manager.cc:1434] T 670d9cb0e6e2414092f72ffd5e6b00ea P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:50:26.577013 6454 tablet_bootstrap.cc:492] T 9c4a200d16464676976694656cbe28e2 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:26.578598 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40adb472162042e48fdbb496b342996a" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:26.578804 6059 raft_consensus.cc:3060] T 40adb472162042e48fdbb496b342996a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:26.578940 6454 tablet_bootstrap.cc:654] T 9c4a200d16464676976694656cbe28e2 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:26.584259 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40adb472162042e48fdbb496b342996a" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
W20260923 19:50:26.584828 6280 leader_election.cc:343] T 40adb472162042e48fdbb496b342996a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:26.586052 6059 raft_consensus.cc:2468] T 40adb472162042e48fdbb496b342996a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:26.587620 6279 leader_election.cc:304] T 40adb472162042e48fdbb496b342996a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:26.588585 7993 raft_consensus.cc:2804] T 40adb472162042e48fdbb496b342996a P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:26.588881 7993 raft_consensus.cc:697] T 40adb472162042e48fdbb496b342996a P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:26.590133 7993 consensus_queue.cc:237] T 40adb472162042e48fdbb496b342996a P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:26.606163 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet d35d749868aa488b99374483df2c5678
I20260923 19:50:26.612013 6454 tablet_bootstrap.cc:492] T 9c4a200d16464676976694656cbe28e2 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:26.612252 6454 ts_tablet_manager.cc:1403] T 9c4a200d16464676976694656cbe28e2 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.035s user 0.011s sys 0.001s
I20260923 19:50:26.613019 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet d35d749868aa488b99374483df2c5678 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:26 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:26.613304 6454 raft_consensus.cc:359] T 9c4a200d16464676976694656cbe28e2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:26.613504 6454 raft_consensus.cc:385] T 9c4a200d16464676976694656cbe28e2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:26.613561 6454 raft_consensus.cc:740] T 9c4a200d16464676976694656cbe28e2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:26.613579 5797 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_4aca5f24bf294b299ec64c356296aa31" } modify_external_catalogs: true
I20260923 19:50:26.613862 6454 consensus_queue.cc:260] T 9c4a200d16464676976694656cbe28e2 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:26.615120 6322 tablet_service.cc:1558] Processing DeleteTablet for tablet 02fa9052a7054659baf9b07b770bb538 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:26.615033 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet d35d749868aa488b99374483df2c5678 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:26 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:26.615607 6454 ts_tablet_manager.cc:1434] T 9c4a200d16464676976694656cbe28e2 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260923 19:50:26.615664 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_560f8aaa0ed44c7086f8132a88650cc8" } new_table_name: "default.Table_36612114cd674f02b0054d4770c0949e" modify_external_catalogs: true
I20260923 19:50:26.615983 6454 tablet_bootstrap.cc:492] T 92f94b93d1364bb1a2562eb577707cf1 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:26.615981 6458 tablet_replica.cc:333] T c5cb76fa5e084604aa58bf888cfe4852 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:26.616184 6458 raft_consensus.cc:2243] T c5cb76fa5e084604aa58bf888cfe4852 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:26.616346 6458 raft_consensus.cc:2272] T c5cb76fa5e084604aa58bf888cfe4852 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:26.618139 6454 tablet_bootstrap.cc:654] T 92f94b93d1364bb1a2562eb577707cf1 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:26.620838 5796 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_6675fe8cb9db43518eac9103c2c60ba1" } new_table_name: "default.Table_3651a7b72eeb4da29ca25b42ceb82fc5" modify_external_catalogs: true
I20260923 19:50:26.621294 7990 raft_consensus.cc:493] T 02fa9052a7054659baf9b07b770bb538 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:26.621448 7990 raft_consensus.cc:515] T 02fa9052a7054659baf9b07b770bb538 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:26.622273 7990 leader_election.cc:290] T 02fa9052a7054659baf9b07b770bb538 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:26.623404 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet d35d749868aa488b99374483df2c5678 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:26 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:26.624342 5799 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5678be025a834aa88d502c41b36d6d3e" } modify_external_catalogs: true
I20260923 19:50:26.624571 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 6cf5a8a047d547b58e08e50e9066018e
W20260923 19:50:26.625451 5800 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e8b0d0a8e4e54ec195893127f7a76bed consensus state has no leader
I20260923 19:50:26.625901 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_6fc69ab2bb434352a8fcbc74f9c5e834"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:26.626821 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet 6cf5a8a047d547b58e08e50e9066018e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:26 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:26.626971 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fa9052a7054659baf9b07b770bb538" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:26.627466 5805 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet f1f1df47dc32413d9cc9456f4198dca5 (table default.Table_5c873b003c7b4b09ba69db7f039b2f98 [id=6d285eda96a948b2b14fa1ef456ca5b2]). Expected version 2 got 0
I20260923 19:50:26.627640 5805 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 9c4a200d16464676976694656cbe28e2 (table default.Table_1e9ebf5c3c644666a5b6c1966fde4ed5 [id=5f2289c487ba40b9b7954c9d56918687]). Expected version 1 got 0
W20260923 19:50:26.628496 6280 leader_election.cc:343] T 02fa9052a7054659baf9b07b770bb538 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:26.628793 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet d35d749868aa488b99374483df2c5678 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d35d749868aa488b99374483df2c5678 already in progress: creating tablet
I20260923 19:50:26.628855 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet 6cf5a8a047d547b58e08e50e9066018e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:26 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:26.629823 7980 raft_consensus.cc:493] T a10d35bf564d45488524d3d21721f4e5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:26.629814 5804 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_af92277fab3e4672b156efcbb1d09f0b" } new_table_name: "default.Table_5b110a5bc3364f3f87b7ebbd0425f47b" modify_external_catalogs: true
I20260923 19:50:26.624562 5799 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_5678be025a834aa88d502c41b36d6d3e" } modify_external_catalogs: true
I20260923 19:50:26.629967 6165 tablet_service.cc:1558] Processing DeleteTablet for tablet 670d9cb0e6e2414092f72ffd5e6b00ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:26.629992 7980 raft_consensus.cc:515] T a10d35bf564d45488524d3d21721f4e5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:26.630290 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 6cf5a8a047d547b58e08e50e9066018e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6cf5a8a047d547b58e08e50e9066018e already in progress: creating tablet
I20260923 19:50:26.630460 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet 6cf5a8a047d547b58e08e50e9066018e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:26 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:26.630715 7980 leader_election.cc:290] T a10d35bf564d45488524d3d21721f4e5 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:26.613809 5797 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_4aca5f24bf294b299ec64c356296aa31" } modify_external_catalogs: true
I20260923 19:50:26.630882 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_b092625690f34a428ea3f3ac1de4b634"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:26.631379 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b092625690f34a428ea3f3ac1de4b634 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:26.631945 6139 leader_election.cc:343] T a10d35bf564d45488524d3d21721f4e5 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: a10d35bf564d45488524d3d21721f4e5
W20260923 19:50:26.632097 5801 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e2080ba1b62647c9a0d90e92982b7da9 consensus state has no leader
W20260923 19:50:26.632503 6137 leader_election.cc:343] T a10d35bf564d45488524d3d21721f4e5 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: a10d35bf564d45488524d3d21721f4e5
I20260923 19:50:26.632484 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_4852b972dc1c4e23aa9be5e1af56e3ae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:26.632596 6137 leader_election.cc:304] T a10d35bf564d45488524d3d21721f4e5 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:26.632985 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4852b972dc1c4e23aa9be5e1af56e3ae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:26.633960 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6fc69ab2bb434352a8fcbc74f9c5e834 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:26.633996 7980 raft_consensus.cc:2749] T a10d35bf564d45488524d3d21721f4e5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:26.635950 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b7de91eb86a441d0b48afb32ddbe99ca" } modify_external_catalogs: true
I20260923 19:50:26.636214 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_b7de91eb86a441d0b48afb32ddbe99ca" } modify_external_catalogs: true
I20260923 19:50:26.637270 6458 ts_tablet_manager.cc:1916] T c5cb76fa5e084604aa58bf888cfe4852 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:26.638989 5700 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 58897.6us
W20260923 19:50:26.637758 6279 leader_election.cc:343] T 02fa9052a7054659baf9b07b770bb538 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 02fa9052a7054659baf9b07b770bb538
I20260923 19:50:26.644980 6279 leader_election.cc:304] T 02fa9052a7054659baf9b07b770bb538 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:26.645799 7822 raft_consensus.cc:2749] T 02fa9052a7054659baf9b07b770bb538 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:26.569768 6457 consensus_queue.cc:260] T 14c917ac93fd436aa13fb0839fae883f P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:26.655093 6457 ts_tablet_manager.cc:1434] T 14c917ac93fd436aa13fb0839fae883f P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.087s user 0.003s sys 0.000s
W20260923 19:50:26.658367 5803 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 60b1f8ceb7d74156926ed601b5a1be62 consensus state has no leader
I20260923 19:50:26.658928 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_4184b49cb50842f3bef045f918a6d9ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:26.660192 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4184b49cb50842f3bef045f918a6d9ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:26.661566 5796 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f0915e6df24f42b3b8b1a558b7ebc7ff consensus state has no leader
W20260923 19:50:26.662978 5804 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 668c41aba151431599f90421ce4ed498 consensus state has no leader
I20260923 19:50:26.663636 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_1f8e940ac02f48ba9e237174993f1d39"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:26.664371 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f8e940ac02f48ba9e237174993f1d39 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:26.681380 5801 master_service.cc:960] ReplaceTablet: received request to replace tablet 9c4a200d16464676976694656cbe28e2 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:26.701099 7986 raft_consensus.cc:493] T 1985088eb56b40c1aeecc1ec7409bcdf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:26.701377 6454 tablet_bootstrap.cc:492] T 92f94b93d1364bb1a2562eb577707cf1 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:26.701259 7986 raft_consensus.cc:515] T 1985088eb56b40c1aeecc1ec7409bcdf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:26.701515 6454 ts_tablet_manager.cc:1403] T 92f94b93d1364bb1a2562eb577707cf1 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.086s user 0.001s sys 0.010s
I20260923 19:50:26.701956 7986 leader_election.cc:290] T 1985088eb56b40c1aeecc1ec7409bcdf P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:26.702373 6454 raft_consensus.cc:359] T 92f94b93d1364bb1a2562eb577707cf1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:26.702534 6454 raft_consensus.cc:385] T 92f94b93d1364bb1a2562eb577707cf1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:26.702487 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1985088eb56b40c1aeecc1ec7409bcdf" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:26.702582 6454 raft_consensus.cc:740] T 92f94b93d1364bb1a2562eb577707cf1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:26.702630 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1985088eb56b40c1aeecc1ec7409bcdf" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:26.702793 6454 consensus_queue.cc:260] T 92f94b93d1364bb1a2562eb577707cf1 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
W20260923 19:50:26.703034 5996 leader_election.cc:343] T 1985088eb56b40c1aeecc1ec7409bcdf P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:26.703155 5995 leader_election.cc:343] T 1985088eb56b40c1aeecc1ec7409bcdf P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:26.703251 5995 leader_election.cc:304] T 1985088eb56b40c1aeecc1ec7409bcdf P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:26.703337 6454 ts_tablet_manager.cc:1434] T 92f94b93d1364bb1a2562eb577707cf1 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:26.703742 7985 raft_consensus.cc:2749] T 1985088eb56b40c1aeecc1ec7409bcdf P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:26.703894 7985 raft_consensus.cc:493] T 9756a1f8e23a436bb7c19c8cba7bdc05 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:26.703985 6454 tablet_bootstrap.cc:492] T 64e8951eb899461aa9c0b36e3f7555e2 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:26.703994 7985 raft_consensus.cc:515] T 9756a1f8e23a436bb7c19c8cba7bdc05 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:26.704566 7985 leader_election.cc:290] T 9756a1f8e23a436bb7c19c8cba7bdc05 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:26.705804 6454 tablet_bootstrap.cc:654] T 64e8951eb899461aa9c0b36e3f7555e2 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:26.706378 7980 raft_consensus.cc:493] T d35ff653bf8d41cfbcf83359402a8f6a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:26.706497 7980 raft_consensus.cc:515] T d35ff653bf8d41cfbcf83359402a8f6a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:26.707062 7980 leader_election.cc:290] T d35ff653bf8d41cfbcf83359402a8f6a P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:26.707685 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9756a1f8e23a436bb7c19c8cba7bdc05" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:26.707656 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d35ff653bf8d41cfbcf83359402a8f6a" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:26.708117 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9756a1f8e23a436bb7c19c8cba7bdc05" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:26.708287 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d35ff653bf8d41cfbcf83359402a8f6a" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:26.708659 5996 leader_election.cc:343] T 9756a1f8e23a436bb7c19c8cba7bdc05 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:26.709002 6137 leader_election.cc:304] T d35ff653bf8d41cfbcf83359402a8f6a P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:26.709571 7980 raft_consensus.cc:2749] T d35ff653bf8d41cfbcf83359402a8f6a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:26.709913 5995 leader_election.cc:343] T 9756a1f8e23a436bb7c19c8cba7bdc05 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:26.710014 5995 leader_election.cc:304] T 9756a1f8e23a436bb7c19c8cba7bdc05 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:26.710433 7986 raft_consensus.cc:2749] T 9756a1f8e23a436bb7c19c8cba7bdc05 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:26.717551 6168 tablet_service.cc:1558] Processing DeleteTablet for tablet 92f94b93d1364bb1a2562eb577707cf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:26.723845 5801 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 9c4a200d16464676976694656cbe28e2
I20260923 19:50:26.724411 5798 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 1985088eb56b40c1aeecc1ec7409bcdf (table default.Table_097795475d8a46e582c0d71ee25ea439 [id=e33a2afc0ace49b5926b11b2fd64c737]). Expected version 2 got 0
I20260923 19:50:26.724457 5801 catalog_manager.cc:6934] ReplaceTablet: tablet 9c4a200d16464676976694656cbe28e2 deleted and replaced by tablet 2d1ed91cfd5f4d1eb1ea75fa6183141a
I20260923 19:50:26.725548 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c4a200d16464676976694656cbe28e2 with delete_type TABLET_DATA_DELETED (replaced by tablet 2d1ed91cfd5f4d1eb1ea75fa6183141a) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:26.725893 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c4a200d16464676976694656cbe28e2 with delete_type TABLET_DATA_DELETED (replaced by tablet 2d1ed91cfd5f4d1eb1ea75fa6183141a) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:26.726033 6461 tablet_replica.cc:333] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:26.725816 5804 catalog_manager.cc:5838] T 40adb472162042e48fdbb496b342996a P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } }
I20260923 19:50:26.726243 6461 raft_consensus.cc:2243] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:26.726259 5804 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 40adb472162042e48fdbb496b342996a (table default.Table_9430735288754d599f68f15e1d52c0cf [id=8fe16214ad774a54982dbadeac1b4235]). Expected version 2 got 0
I20260923 19:50:26.726621 6461 raft_consensus.cc:2272] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:26.727198 6461 ts_tablet_manager.cc:1916] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:26.728819 6168 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c4a200d16464676976694656cbe28e2 with delete_type TABLET_DATA_DELETED (replaced by tablet 2d1ed91cfd5f4d1eb1ea75fa6183141a) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:26.730119 6457 tablet_bootstrap.cc:492] T 12bda2ae961446bea2f34e792f4f1706 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:26.731935 6457 tablet_bootstrap.cc:654] T 12bda2ae961446bea2f34e792f4f1706 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:26.732133 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet 431ad4da27544d68aa5666293984a86a with delete_type TABLET_DATA_DELETED (replaced by tablet 68459111552949aab20982dd7c28f7d3) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:26.736259 6459 ts_tablet_manager.cc:1929] T c7369a5fc87f4b70bcfbe052ef021771 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:26.738040 6311 tablet_service.cc:1511] Processing CreateTablet for tablet b204a24bc3f0453ba19dad8642bbc770 (DEFAULT_TABLE table=default.Table_10603cbcd11d4a48a3916fd7894dcf76 [id=413258d2d824494ea629b6e922ac83de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.738622 6034 tablet_service.cc:1511] Processing CreateTablet for tablet b204a24bc3f0453ba19dad8642bbc770 (DEFAULT_TABLE table=default.Table_10603cbcd11d4a48a3916fd7894dcf76 [id=413258d2d824494ea629b6e922ac83de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.739075 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b204a24bc3f0453ba19dad8642bbc770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.739283 5799 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 2f45d03e655042d18dcbded39b3a8df6
I20260923 19:50:26.740310 6030 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f45d03e655042d18dcbded39b3a8df6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:26 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:26.742139 6025 tablet_service.cc:1511] Processing CreateTablet for tablet 1aa4a114f1e7438090ac458ce9d0d5ac (DEFAULT_TABLE table=default.Table_cbdb3225a2c4411391fab85ddca7581a [id=49cbffb9bcc64eba817e98970f188c92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.742527 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aa4a114f1e7438090ac458ce9d0d5ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.744314 6461 ts_tablet_manager.cc:1929] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:50:26.744432 6461 log.cc:1199] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/9c4a200d16464676976694656cbe28e2
I20260923 19:50:26.744782 6461 ts_tablet_manager.cc:1950] T 9c4a200d16464676976694656cbe28e2 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:26.746421 6030 tablet_service.cc:1511] Processing CreateTablet for tablet a67302ac60284fb2bdf86aeb4ad47253 (DEFAULT_TABLE table=default.Table_8a50df2ec8c1421794b661a73a368eab [id=476c6c21df4345f4bd418112a8d747c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.746829 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a67302ac60284fb2bdf86aeb4ad47253. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.747073 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b204a24bc3f0453ba19dad8642bbc770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.750058 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 53018993d4f347b3b56f6ac152a97729 (DEFAULT_TABLE table=default.Table_4820a4a930d94d4d92963650458308ed [id=83de2ce29c2c4f6ab65e1e0370ff1bf3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.750332 6037 tablet_service.cc:1511] Processing CreateTablet for tablet fc18720fc99146eab1772c2c82b732c9 (DEFAULT_TABLE table=default.Table_bfe6c835a29043e8bad71da711286f80 [id=07156f9a5f2c4743bb352a09d0dedc7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.750517 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53018993d4f347b3b56f6ac152a97729. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.750058 6040 tablet_service.cc:1511] Processing CreateTablet for tablet a3a38b984d654b1b8ff2cfbfa7f989ec (DEFAULT_TABLE table=default.Table_4d3f70d60f474c138c2004b1131b8cb6 [id=f6773dc035784918b601fa760aadcd5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.750981 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc18720fc99146eab1772c2c82b732c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.751515 6322 tablet_service.cc:1511] Processing CreateTablet for tablet 1aa4a114f1e7438090ac458ce9d0d5ac (DEFAULT_TABLE table=default.Table_cbdb3225a2c4411391fab85ddca7581a [id=49cbffb9bcc64eba817e98970f188c92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.751737 6306 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f45d03e655042d18dcbded39b3a8df6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:26 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:26.751909 6312 tablet_service.cc:1511] Processing CreateTablet for tablet 53018993d4f347b3b56f6ac152a97729 (DEFAULT_TABLE table=default.Table_4820a4a930d94d4d92963650458308ed [id=83de2ce29c2c4f6ab65e1e0370ff1bf3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.752087 6315 tablet_service.cc:1511] Processing CreateTablet for tablet a67302ac60284fb2bdf86aeb4ad47253 (DEFAULT_TABLE table=default.Table_8a50df2ec8c1421794b661a73a368eab [id=476c6c21df4345f4bd418112a8d747c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.752444 6314 tablet_service.cc:1511] Processing CreateTablet for tablet a3a38b984d654b1b8ff2cfbfa7f989ec (DEFAULT_TABLE table=default.Table_4d3f70d60f474c138c2004b1131b8cb6 [id=f6773dc035784918b601fa760aadcd5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.753271 6040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3a38b984d654b1b8ff2cfbfa7f989ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.760921 6306 tablet_service.cc:1511] Processing CreateTablet for tablet 6fb7c59b20b84c298a2de1ad904c5555 (DEFAULT_TABLE table=default.Table_d83aab34c9cd4da3a293bc6bc2839ea4 [id=616d7952bbb54bb9b4f0327c0234f5f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.761575 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 9c4a200d16464676976694656cbe28e2 (table default.Table_1e9ebf5c3c644666a5b6c1966fde4ed5 [id=5f2289c487ba40b9b7954c9d56918687]) successfully deleted
I20260923 19:50:26.762658 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 6fb7c59b20b84c298a2de1ad904c5555 (DEFAULT_TABLE table=default.Table_d83aab34c9cd4da3a293bc6bc2839ea4 [id=616d7952bbb54bb9b4f0327c0234f5f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.763193 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fb7c59b20b84c298a2de1ad904c5555. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:26.767541 5790 catalog_manager.cc:5030] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 431ad4da27544d68aa5666293984a86a because the tablet was not found. No further retry: Not found: Tablet not found: 431ad4da27544d68aa5666293984a86a
W20260923 19:50:26.768123 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 2f45d03e655042d18dcbded39b3a8df6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f45d03e655042d18dcbded39b3a8df6 already in progress: creating tablet
I20260923 19:50:26.768555 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 6d5a4f5e67cc42f7981eb1f954b2a56b (DEFAULT_TABLE table=default.Table_3d3143300d6d4c4a8aa6010b1dae8e31 [id=693cec5e53e14741b659ca0f95bd09c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.776255 5803 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 397ec5e49673406cb26a2efab0ad8401 (table default.Table_92f3bea4e4164a738fb75f01e95cd776 [id=0b80967a8fb94518ad872fbce9bae934]). Expected version 1 got 0
I20260923 19:50:26.776749 7826 raft_consensus.cc:493] T d04b3a9ade7a405bb619704095fac279 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:26.777053 7826 raft_consensus.cc:515] T d04b3a9ade7a405bb619704095fac279 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:26.777575 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 4952cee21fe9402db99783e05ffaffd5
I20260923 19:50:26.778066 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet a0743d5ac2264af6b045af0474cbf58c
I20260923 19:50:26.778196 7826 leader_election.cc:290] T d04b3a9ade7a405bb619704095fac279 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:26.779343 6319 tablet_service.cc:1511] Processing CreateTablet for tablet fc18720fc99146eab1772c2c82b732c9 (DEFAULT_TABLE table=default.Table_bfe6c835a29043e8bad71da711286f80 [id=07156f9a5f2c4743bb352a09d0dedc7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.780597 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet 22c89609da884c47b1dbc1470b37efbe with delete_type TABLET_DATA_DELETED (replaced by tablet 295502f94faf4d4880e9516aa8d9cb79) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:26.780786 6321 tablet_service.cc:1558] Processing DeleteTablet for tablet cb11d6e082784ad98cfb5253dbb88707 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:26.780977 6317 tablet_service.cc:1558] Processing DeleteTablet for tablet 4952cee21fe9402db99783e05ffaffd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:26 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:26.781103 6321 tablet_service.cc:1558] Processing DeleteTablet for tablet a0743d5ac2264af6b045af0474cbf58c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:26 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:26.781258 6324 tablet_service.cc:1558] Processing DeleteTablet for tablet d04b3a9ade7a405bb619704095fac279 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:07 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:26.782423 6035 tablet_service.cc:1558] Processing DeleteTablet for tablet 4952cee21fe9402db99783e05ffaffd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:26 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:26.782641 6029 tablet_service.cc:1558] Processing DeleteTablet for tablet 14c917ac93fd436aa13fb0839fae883f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:26.782778 6036 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c4a200d16464676976694656cbe28e2 with delete_type TABLET_DATA_DELETED (replaced by tablet 2d1ed91cfd5f4d1eb1ea75fa6183141a) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:26.782959 6037 tablet_service.cc:1558] Processing DeleteTablet for tablet a0743d5ac2264af6b045af0474cbf58c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:26 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:26.783424 6461 tablet_replica.cc:333] T 14c917ac93fd436aa13fb0839fae883f P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
W20260923 19:50:26.783439 6279 leader_election.cc:343] T d04b3a9ade7a405bb619704095fac279 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: d04b3a9ade7a405bb619704095fac279
I20260923 19:50:26.783671 6461 raft_consensus.cc:2243] T 14c917ac93fd436aa13fb0839fae883f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:26.783874 6461 raft_consensus.cc:2272] T 14c917ac93fd436aa13fb0839fae883f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:26.784152 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 4952cee21fe9402db99783e05ffaffd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4952cee21fe9402db99783e05ffaffd5 already in progress: creating tablet
I20260923 19:50:26.784996 5803 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 397ec5e49673406cb26a2efab0ad8401 (table default.Table_92f3bea4e4164a738fb75f01e95cd776 [id=0b80967a8fb94518ad872fbce9bae934]). Expected version 1 got 0
I20260923 19:50:26.785044 6322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aa4a114f1e7438090ac458ce9d0d5ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.786149 6324 tablet_service.cc:1511] Processing CreateTablet for tablet 45b7efa256fb4b3bb6244282fef04ada (DEFAULT_TABLE table=default.Table_ac308acb0a664980af2a809547a864e4 [id=16973eb008324d41a4f9f65644993262]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.788964 6321 tablet_service.cc:1511] Processing CreateTablet for tablet ec9df54b437d41878b17c911b97a277f (DEFAULT_TABLE table=default.Table_c774692bc686484c8f63d686c3d61dda [id=867fade9d5fa49e3925d7e253bcfe3d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.790871 6037 tablet_service.cc:1511] Processing CreateTablet for tablet ec9df54b437d41878b17c911b97a277f (DEFAULT_TABLE table=default.Table_c774692bc686484c8f63d686c3d61dda [id=867fade9d5fa49e3925d7e253bcfe3d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.791268 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec9df54b437d41878b17c911b97a277f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.791635 6317 tablet_service.cc:1511] Processing CreateTablet for tablet 80e0c5aa8e664806abe9288497f9fa28 (DEFAULT_TABLE table=default.Table_b2e5975cbc3e4d9fba8a7ee0743ed5ef [id=c415f3a0c64349d4affc1b7be72c958b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.793449 6036 tablet_service.cc:1511] Processing CreateTablet for tablet 80e0c5aa8e664806abe9288497f9fa28 (DEFAULT_TABLE table=default.Table_b2e5975cbc3e4d9fba8a7ee0743ed5ef [id=c415f3a0c64349d4affc1b7be72c958b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.793807 6036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80e0c5aa8e664806abe9288497f9fa28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.794173 6309 tablet_service.cc:1511] Processing CreateTablet for tablet 5f53f65805c54ec88cdedff8f2298d0d (DEFAULT_TABLE table=default.Table_c47cec6c0da648918c78ebc636858eaa [id=12c2eb8b537046ae80dfbf2fc55e0482]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.794826 6461 ts_tablet_manager.cc:1916] T 14c917ac93fd436aa13fb0839fae883f P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:26.796301 6323 tablet_service.cc:1511] Processing CreateTablet for tablet 93457987550b4dd3bc9ef5735819a78a (DEFAULT_TABLE table=default.Table_c5386174bc9d489cbdf01f26dbc11740 [id=7e36afc2a64c4b5484133d4d096a0339]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.797473 6035 tablet_service.cc:1511] Processing CreateTablet for tablet 93457987550b4dd3bc9ef5735819a78a (DEFAULT_TABLE table=default.Table_c5386174bc9d489cbdf01f26dbc11740 [id=7e36afc2a64c4b5484133d4d096a0339]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.797832 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93457987550b4dd3bc9ef5735819a78a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.798077 6318 tablet_service.cc:1511] Processing CreateTablet for tablet adec88379d4a4011a39e1e9d370c6d66 (DEFAULT_TABLE table=default.Table_45980990efcf47dd845c1fa3f56fd91f [id=6773ca9bf93744909cc14de3a3a9c3d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.798200 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 5f53f65805c54ec88cdedff8f2298d0d (DEFAULT_TABLE table=default.Table_c47cec6c0da648918c78ebc636858eaa [id=12c2eb8b537046ae80dfbf2fc55e0482]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.799860 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 5fd974c35ef144789941ee65c682ee69 (DEFAULT_TABLE table=default.Table_fbc2e2a092eb47cda059f7093be1c090 [id=adedafae354a41c4a6bb65ef6e880a16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.800379 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45b7efa256fb4b3bb6244282fef04ada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.802179 6031 tablet_service.cc:1511] Processing CreateTablet for tablet adec88379d4a4011a39e1e9d370c6d66 (DEFAULT_TABLE table=default.Table_45980990efcf47dd845c1fa3f56fd91f [id=6773ca9bf93744909cc14de3a3a9c3d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.802546 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adec88379d4a4011a39e1e9d370c6d66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.806339 6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a67302ac60284fb2bdf86aeb4ad47253. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.806551 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f53f65805c54ec88cdedff8f2298d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.810151 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3a38b984d654b1b8ff2cfbfa7f989ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.810249 6024 tablet_service.cc:1511] Processing CreateTablet for tablet 5fd974c35ef144789941ee65c682ee69 (DEFAULT_TABLE table=default.Table_fbc2e2a092eb47cda059f7093be1c090 [id=adedafae354a41c4a6bb65ef6e880a16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.810626 6024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd974c35ef144789941ee65c682ee69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.813992 6039 tablet_service.cc:1511] Processing CreateTablet for tablet 20d299b0112b4eb4ae1b8cb266c69a11 (DEFAULT_TABLE table=default.Table_d1fd0fa46a214d4895291f81394e7023 [id=17a0b4862d834e8890a0467f80e6b753]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.814258 6320 tablet_service.cc:1511] Processing CreateTablet for tablet 20d299b0112b4eb4ae1b8cb266c69a11 (DEFAULT_TABLE table=default.Table_d1fd0fa46a214d4895291f81394e7023 [id=17a0b4862d834e8890a0467f80e6b753]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.814643 6320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20d299b0112b4eb4ae1b8cb266c69a11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.814963 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20d299b0112b4eb4ae1b8cb266c69a11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.816648 6027 tablet_service.cc:1511] Processing CreateTablet for tablet 989d9bcb223e40d0a286b0351cf9494f (DEFAULT_TABLE table=default.Table_b24ca62e52f347d3ac64861b0fe2df69 [id=8b87c8549632415c997667d8d4b45ff9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.817004 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 989d9bcb223e40d0a286b0351cf9494f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.817553 6023 tablet_service.cc:1511] Processing CreateTablet for tablet 8e024b37ac9649c680f02c9862fdc154 (DEFAULT_TABLE table=default.Table_f6c8d3b2c3bc4486a54aecf1753705b5 [id=6b3a64b93a094342991c3a1ea783396b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.817919 6023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e024b37ac9649c680f02c9862fdc154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.818192 6313 tablet_service.cc:1511] Processing CreateTablet for tablet 989d9bcb223e40d0a286b0351cf9494f (DEFAULT_TABLE table=default.Table_b24ca62e52f347d3ac64861b0fe2df69 [id=8b87c8549632415c997667d8d4b45ff9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.818590 6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 989d9bcb223e40d0a286b0351cf9494f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.819278 6308 tablet_service.cc:1511] Processing CreateTablet for tablet 8e024b37ac9649c680f02c9862fdc154 (DEFAULT_TABLE table=default.Table_f6c8d3b2c3bc4486a54aecf1753705b5 [id=6b3a64b93a094342991c3a1ea783396b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.819578 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e024b37ac9649c680f02c9862fdc154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.822243 6306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fb7c59b20b84c298a2de1ad904c5555. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.830539 6459 log.cc:1199] T c7369a5fc87f4b70bcfbe052ef021771 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/c7369a5fc87f4b70bcfbe052ef021771
I20260923 19:50:26.746701 6165 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f45d03e655042d18dcbded39b3a8df6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:26 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:26.746814 6166 tablet_service.cc:1511] Processing CreateTablet for tablet 1aa4a114f1e7438090ac458ce9d0d5ac (DEFAULT_TABLE table=default.Table_cbdb3225a2c4411391fab85ddca7581a [id=49cbffb9bcc64eba817e98970f188c92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.746994 6181 tablet_service.cc:1511] Processing CreateTablet for tablet a67302ac60284fb2bdf86aeb4ad47253 (DEFAULT_TABLE table=default.Table_8a50df2ec8c1421794b661a73a368eab [id=476c6c21df4345f4bd418112a8d747c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.831036 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aa4a114f1e7438090ac458ce9d0d5ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.831068 6182 tablet_service.cc:1511] Processing CreateTablet for tablet 5fd974c35ef144789941ee65c682ee69 (DEFAULT_TABLE table=default.Table_fbc2e2a092eb47cda059f7093be1c090 [id=adedafae354a41c4a6bb65ef6e880a16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.831687 6175 tablet_service.cc:1511] Processing CreateTablet for tablet 989d9bcb223e40d0a286b0351cf9494f (DEFAULT_TABLE table=default.Table_b24ca62e52f347d3ac64861b0fe2df69 [id=8b87c8549632415c997667d8d4b45ff9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.831874 6165 tablet_service.cc:1511] Processing CreateTablet for tablet 20d299b0112b4eb4ae1b8cb266c69a11 (DEFAULT_TABLE table=default.Table_d1fd0fa46a214d4895291f81394e7023 [id=17a0b4862d834e8890a0467f80e6b753]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.832149 6169 tablet_service.cc:1511] Processing CreateTablet for tablet 8e024b37ac9649c680f02c9862fdc154 (DEFAULT_TABLE table=default.Table_f6c8d3b2c3bc4486a54aecf1753705b5 [id=6b3a64b93a094342991c3a1ea783396b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.834183 6182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd974c35ef144789941ee65c682ee69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.836022 6308 tablet_service.cc:1511] Processing CreateTablet for tablet fcd4f447ff1a4adc8912b707169b20ea (DEFAULT_TABLE table=default.Table_55039e3011ca4782bd5f610f27ae4e16 [id=d20993e4ce9b4f6b8d43e5ca470e6c95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.836428 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcd4f447ff1a4adc8912b707169b20ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.838158 6175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 989d9bcb223e40d0a286b0351cf9494f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.838383 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e024b37ac9649c680f02c9862fdc154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.838654 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a67302ac60284fb2bdf86aeb4ad47253. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.838810 6165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20d299b0112b4eb4ae1b8cb266c69a11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.747116 6179 tablet_service.cc:1511] Processing CreateTablet for tablet a3a38b984d654b1b8ff2cfbfa7f989ec (DEFAULT_TABLE table=default.Table_4d3f70d60f474c138c2004b1131b8cb6 [id=f6773dc035784918b601fa760aadcd5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.754355 6168 tablet_service.cc:1511] Processing CreateTablet for tablet b204a24bc3f0453ba19dad8642bbc770 (DEFAULT_TABLE table=default.Table_10603cbcd11d4a48a3916fd7894dcf76 [id=413258d2d824494ea629b6e922ac83de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.758430 6197 raft_consensus.cc:3060] T f1f1df47dc32413d9cc9456f4198dca5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:26.846379 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3a38b984d654b1b8ff2cfbfa7f989ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.758733 6199 raft_consensus.cc:3060] T d35ff653bf8d41cfbcf83359402a8f6a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:26.759056 6170 tablet_service.cc:1511] Processing CreateTablet for tablet 53018993d4f347b3b56f6ac152a97729 (DEFAULT_TABLE table=default.Table_4820a4a930d94d4d92963650458308ed [id=83de2ce29c2c4f6ab65e1e0370ff1bf3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.850281 6170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53018993d4f347b3b56f6ac152a97729. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.760618 7980 raft_consensus.cc:493] T 9c4a200d16464676976694656cbe28e2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:26.760948 6178 tablet_service.cc:1511] Processing CreateTablet for tablet fc18720fc99146eab1772c2c82b732c9 (DEFAULT_TABLE table=default.Table_bfe6c835a29043e8bad71da711286f80 [id=07156f9a5f2c4743bb352a09d0dedc7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.761620 6172 tablet_service.cc:1511] Processing CreateTablet for tablet 6fb7c59b20b84c298a2de1ad904c5555 (DEFAULT_TABLE table=default.Table_d83aab34c9cd4da3a293bc6bc2839ea4 [id=616d7952bbb54bb9b4f0327c0234f5f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.767604 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 6d5a4f5e67cc42f7981eb1f954b2a56b (DEFAULT_TABLE table=default.Table_3d3143300d6d4c4a8aa6010b1dae8e31 [id=693cec5e53e14741b659ca0f95bd09c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.853899 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b204a24bc3f0453ba19dad8642bbc770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.853813 7980 raft_consensus.cc:515] T 9c4a200d16464676976694656cbe28e2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:26.778927 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d04b3a9ade7a405bb619704095fac279" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:26.854075 6172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fb7c59b20b84c298a2de1ad904c5555. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.779287 6164 tablet_service.cc:1558] Processing DeleteTablet for tablet a0743d5ac2264af6b045af0474cbf58c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:26 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:26.854307 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d5a4f5e67cc42f7981eb1f954b2a56b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.779722 6177 tablet_service.cc:1558] Processing DeleteTablet for tablet 4952cee21fe9402db99783e05ffaffd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:26 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:26.787218 6180 tablet_service.cc:1511] Processing CreateTablet for tablet 45b7efa256fb4b3bb6244282fef04ada (DEFAULT_TABLE table=default.Table_ac308acb0a664980af2a809547a864e4 [id=16973eb008324d41a4f9f65644993262]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.854487 7980 leader_election.cc:290] T 9c4a200d16464676976694656cbe28e2 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:26.854641 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45b7efa256fb4b3bb6244282fef04ada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.794937 6173 tablet_service.cc:1511] Processing CreateTablet for tablet ec9df54b437d41878b17c911b97a277f (DEFAULT_TABLE table=default.Table_c774692bc686484c8f63d686c3d61dda [id=867fade9d5fa49e3925d7e253bcfe3d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.858036 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc18720fc99146eab1772c2c82b732c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.795257 6176 tablet_service.cc:1511] Processing CreateTablet for tablet 80e0c5aa8e664806abe9288497f9fa28 (DEFAULT_TABLE table=default.Table_b2e5975cbc3e4d9fba8a7ee0743ed5ef [id=c415f3a0c64349d4affc1b7be72c958b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.858368 6176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80e0c5aa8e664806abe9288497f9fa28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.795743 6174 tablet_service.cc:1511] Processing CreateTablet for tablet 5f53f65805c54ec88cdedff8f2298d0d (DEFAULT_TABLE table=default.Table_c47cec6c0da648918c78ebc636858eaa [id=12c2eb8b537046ae80dfbf2fc55e0482]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.796829 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 93457987550b4dd3bc9ef5735819a78a (DEFAULT_TABLE table=default.Table_c5386174bc9d489cbdf01f26dbc11740 [id=7e36afc2a64c4b5484133d4d096a0339]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.799467 6171 tablet_service.cc:1511] Processing CreateTablet for tablet adec88379d4a4011a39e1e9d370c6d66 (DEFAULT_TABLE table=default.Table_45980990efcf47dd845c1fa3f56fd91f [id=6773ca9bf93744909cc14de3a3a9c3d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.861461 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4a200d16464676976694656cbe28e2" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:26.861894 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f53f65805c54ec88cdedff8f2298d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.862264 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec9df54b437d41878b17c911b97a277f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.866104 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93457987550b4dd3bc9ef5735819a78a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.870743 6171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adec88379d4a4011a39e1e9d370c6d66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.872255 6024 tablet_service.cc:1511] Processing CreateTablet for tablet f7926ea98702429eb5248c93b17431ac (DEFAULT_TABLE table=default.Table_74b0524a0e6a4857b375240e40313049 [id=23f24fab80f34dc396470ac14c51a533]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.872649 6024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7926ea98702429eb5248c93b17431ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.885076 6459 ts_tablet_manager.cc:1950] T c7369a5fc87f4b70bcfbe052ef021771 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:26.886597 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1063) took 3093 ms. Trace:
I20260923 19:50:26.887459 6457 tablet_bootstrap.cc:492] T 12bda2ae961446bea2f34e792f4f1706 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:26.887713 6457 ts_tablet_manager.cc:1403] T 12bda2ae961446bea2f34e792f4f1706 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.158s user 0.002s sys 0.002s
I20260923 19:50:26.890641 6306 tablet_service.cc:1511] Processing CreateTablet for tablet f7926ea98702429eb5248c93b17431ac (DEFAULT_TABLE table=default.Table_74b0524a0e6a4857b375240e40313049 [id=23f24fab80f34dc396470ac14c51a533]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.890618 6457 raft_consensus.cc:359] T 12bda2ae961446bea2f34e792f4f1706 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:26.891185 6306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7926ea98702429eb5248c93b17431ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.891129 6170 tablet_service.cc:1511] Processing CreateTablet for tablet f7926ea98702429eb5248c93b17431ac (DEFAULT_TABLE table=default.Table_74b0524a0e6a4857b375240e40313049 [id=23f24fab80f34dc396470ac14c51a533]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.893182 6170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7926ea98702429eb5248c93b17431ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.893770 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d5a4f5e67cc42f7981eb1f954b2a56b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:26.896868 6137 leader_election.cc:343] T 9c4a200d16464676976694656cbe28e2 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 9c4a200d16464676976694656cbe28e2
I20260923 19:50:26.897002 6137 leader_election.cc:304] T 9c4a200d16464676976694656cbe28e2 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:26.897480 6457 raft_consensus.cc:385] T 12bda2ae961446bea2f34e792f4f1706 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:26.897568 6456 tablet_bootstrap.cc:492] T f2799563250845b0b9d7d51b2367b16b P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:26.897558 6457 raft_consensus.cc:740] T 12bda2ae961446bea2f34e792f4f1706 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:26.897689 6456 ts_tablet_manager.cc:1403] T f2799563250845b0b9d7d51b2367b16b P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.380s user 0.017s sys 0.025s
I20260923 19:50:26.897843 6319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc18720fc99146eab1772c2c82b732c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.898036 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec9df54b437d41878b17c911b97a277f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.898206 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80e0c5aa8e664806abe9288497f9fa28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.898419 6309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f53f65805c54ec88cdedff8f2298d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.898522 6456 raft_consensus.cc:359] T f2799563250845b0b9d7d51b2367b16b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:26.898700 6456 raft_consensus.cc:385] T f2799563250845b0b9d7d51b2367b16b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:26.898751 6456 raft_consensus.cc:740] T f2799563250845b0b9d7d51b2367b16b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:26.898954 6456 consensus_queue.cc:260] T f2799563250845b0b9d7d51b2367b16b P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:26.899931 6456 ts_tablet_manager.cc:1434] T f2799563250845b0b9d7d51b2367b16b P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260923 19:50:26.900151 8016 raft_consensus.cc:2749] T 9c4a200d16464676976694656cbe28e2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:26.901522 6454 tablet_bootstrap.cc:492] T 64e8951eb899461aa9c0b36e3f7555e2 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:26.901635 6454 ts_tablet_manager.cc:1403] T 64e8951eb899461aa9c0b36e3f7555e2 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.198s user 0.008s sys 0.006s
I20260923 19:50:26.901983 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53018993d4f347b3b56f6ac152a97729. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.902302 6318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adec88379d4a4011a39e1e9d370c6d66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.902356 6454 raft_consensus.cc:359] T 64e8951eb899461aa9c0b36e3f7555e2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:26.902509 6454 raft_consensus.cc:385] T 64e8951eb899461aa9c0b36e3f7555e2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:26.902554 6454 raft_consensus.cc:740] T 64e8951eb899461aa9c0b36e3f7555e2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:26.902726 6454 consensus_queue.cc:260] T 64e8951eb899461aa9c0b36e3f7555e2 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:26.903201 6454 ts_tablet_manager.cc:1434] T 64e8951eb899461aa9c0b36e3f7555e2 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:50:26.906008 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93457987550b4dd3bc9ef5735819a78a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.906220 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd974c35ef144789941ee65c682ee69. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:26.790401 5700 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 48564.1us
I20260923 19:50:26.892784 6459 rpcz_store.cc:276] 0923 19:50:23.792814 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:23.825449 (+ 32635us) service_pool.cc:224] Handling call
0923 19:50:26.445267 (+2619818us) ts_tablet_manager.cc:1151] Deleting tablet c7369a5fc87f4b70bcfbe052ef021771
0923 19:50:26.445278 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:26.671301 (+226023us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:26.736184 (+ 64883us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:26.886575 (+150391us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3618,"tablet-delete.queue_time_us":2619504}
I20260923 19:50:26.911737 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1065) took 3051 ms. Trace:
I20260923 19:50:26.911938 6459 rpcz_store.cc:276] 0923 19:50:23.860016 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:23.860091 (+ 75us) service_pool.cc:224] Handling call
0923 19:50:26.911556 (+3051465us) ts_tablet_manager.cc:1151] Deleting tablet 9e20d623668646c688fbd82d2cbc7138
0923 19:50:26.911574 (+ 18us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:26.911715 (+ 141us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3051241}
I20260923 19:50:26.912482 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1066) took 3050 ms. Trace:
I20260923 19:50:26.912611 6459 rpcz_store.cc:276] 0923 19:50:23.862403 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:23.862458 (+ 55us) service_pool.cc:224] Handling call
0923 19:50:26.912299 (+3049841us) ts_tablet_manager.cc:1151] Deleting tablet 2dbb1973dbcd46f5a796fb8a0a24f88f
0923 19:50:26.912307 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:26.912467 (+ 160us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3049675}
I20260923 19:50:26.912985 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1069) took 3035 ms. Trace:
I20260923 19:50:26.913116 6459 rpcz_store.cc:276] 0923 19:50:23.877864 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:23.879521 (+ 1657us) service_pool.cc:224] Handling call
0923 19:50:26.912881 (+3033360us) ts_tablet_manager.cc:1151] Deleting tablet a820bf5854324639b98c984ac583a4d7
0923 19:50:26.912890 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:26.912969 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3033154}
I20260923 19:50:26.913679 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1068) took 3038 ms. Trace:
I20260923 19:50:26.913827 6459 rpcz_store.cc:276] 0923 19:50:23.875113 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:23.879767 (+ 4654us) service_pool.cc:224] Handling call
0923 19:50:26.913395 (+3033628us) ts_tablet_manager.cc:1151] Deleting tablet a83726da349c4cd1852e956c8fa2cda5
0923 19:50:26.913564 (+ 169us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:26.913660 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3033490}
I20260923 19:50:26.914194 6459 tablet_replica.cc:333] T 1b1d9413e1e24547b491a160d851377b P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:26.914434 6459 raft_consensus.cc:2243] T 1b1d9413e1e24547b491a160d851377b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:26.915022 6459 raft_consensus.cc:2272] T 1b1d9413e1e24547b491a160d851377b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:26.915719 8015 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 83e97b26500048d0b75350a21a8ff96b)
I20260923 19:50:26.915946 8015 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } }
I20260923 19:50:26.916734 8015 leader_election.cc:290] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83e97b26500048d0b75350a21a8ff96b (127.5.143.253:45285), 009ffee03a4d41db84df9f450aa84562 (127.5.143.252:45543)
I20260923 19:50:26.919226 6040 tablet_service.cc:1511] Processing CreateTablet for tablet 45b7efa256fb4b3bb6244282fef04ada (DEFAULT_TABLE table=default.Table_ac308acb0a664980af2a809547a864e4 [id=16973eb008324d41a4f9f65644993262]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.919720 6040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45b7efa256fb4b3bb6244282fef04ada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.920984 6454 tablet_bootstrap.cc:492] T f1c1d4f73488499a9e5add81e9d5e2d6 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:26.922837 6454 tablet_bootstrap.cc:654] T f1c1d4f73488499a9e5add81e9d5e2d6 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:26.923592 6679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" candidate_term: 4 candidate_status { last_received { term: 3 index: 944 } } ignore_live_leader: false dest_uuid: "009ffee03a4d41db84df9f450aa84562" is_pre_election: true
I20260923 19:50:26.924062 6457 consensus_queue.cc:260] T 12bda2ae961446bea2f34e792f4f1706 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:26.924364 6037 tablet_service.cc:1511] Processing CreateTablet for tablet fcd4f447ff1a4adc8912b707169b20ea (DEFAULT_TABLE table=default.Table_55039e3011ca4782bd5f610f27ae4e16 [id=d20993e4ce9b4f6b8d43e5ca470e6c95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.924928 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 6d5a4f5e67cc42f7981eb1f954b2a56b (DEFAULT_TABLE table=default.Table_3d3143300d6d4c4a8aa6010b1dae8e31 [id=693cec5e53e14741b659ca0f95bd09c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.926433 6030 tablet_service.cc:1558] Processing DeleteTablet for tablet 9756a1f8e23a436bb7c19c8cba7bdc05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:56924
W20260923 19:50:26.926699 6280 leader_election.cc:343] T d04b3a9ade7a405bb619704095fac279 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:26.926854 6280 leader_election.cc:304] T d04b3a9ade7a405bb619704095fac279 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:26.927603 7822 raft_consensus.cc:2749] T d04b3a9ade7a405bb619704095fac279 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:26.928370 6174 tablet_service.cc:1511] Processing CreateTablet for tablet fcd4f447ff1a4adc8912b707169b20ea (DEFAULT_TABLE table=default.Table_55039e3011ca4782bd5f610f27ae4e16 [id=d20993e4ce9b4f6b8d43e5ca470e6c95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.928746 6457 ts_tablet_manager.cc:1434] T 12bda2ae961446bea2f34e792f4f1706 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.041s user 0.001s sys 0.001s
I20260923 19:50:26.928866 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcd4f447ff1a4adc8912b707169b20ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:26.929291 6159 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:60136 (request call id 176) took 1281 ms. Trace:
I20260923 19:50:26.929373 6159 rpcz_store.cc:276] 0923 19:50:25.647545 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:25.648250 (+ 705us) service_pool.cc:224] Handling call
0923 19:50:26.929267 (+1281017us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260923 19:50:26.931383 6458 ts_tablet_manager.cc:1929] T c5cb76fa5e084604aa58bf888cfe4852 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:26.931545 6458 log.cc:1199] T c5cb76fa5e084604aa58bf888cfe4852 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/c5cb76fa5e084604aa58bf888cfe4852
I20260923 19:50:26.806949 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_457fa8ba5f1949e7848c379d53d2766c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:26.937126 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_457fa8ba5f1949e7848c379d53d2766c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:26.937229 6456 tablet_bootstrap.cc:492] T ba0453ef529344dfbab1130daa985fef P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:26.824091 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d1fd0fa46a214d4895291f81394e7023" } modify_external_catalogs: true
I20260923 19:50:26.937968 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d1fd0fa46a214d4895291f81394e7023" } modify_external_catalogs: true
I20260923 19:50:26.824894 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_830b1cf0708140b1b9c6e118deee0df6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:26.939350 6456 tablet_bootstrap.cc:654] T ba0453ef529344dfbab1130daa985fef P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:26.939464 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_830b1cf0708140b1b9c6e118deee0df6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:26.825424 5799 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_04b0ab0ec24340b99b95fb612c1777d3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:26.940783 5799 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_04b0ab0ec24340b99b95fb612c1777d3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:26.941010 6457 tablet_bootstrap.cc:492] T f28da30d48454ffd9626df789a2f2063 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:26.828621 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_be41f102974644f7b7a95b121e9256bb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:26.829432 5796 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_63c5836d0ca149f3b6b24a23873e0ecc" } new_table_name: "default.Table_4e7d9fba36744af8aabf299fb3a4a086" modify_external_catalogs: true
W20260923 19:50:26.941989 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_be41f102974644f7b7a95b121e9256bb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:26.829663 5801 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_020624cf3a194c669468a23b0137d1a6" } modify_external_catalogs: true
I20260923 19:50:26.942662 5801 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_020624cf3a194c669468a23b0137d1a6" } modify_external_catalogs: true
I20260923 19:50:26.831573 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_5fee98fd4cb34aa0884ba94908c94cd7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:26.944689 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5fee98fd4cb34aa0884ba94908c94cd7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:26.836180 5805 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7e5734fc77194af188bb85d254676e98" } new_table_name: "default.Table_d6a453784ebd47b9b8c169ab766d6c23" modify_external_catalogs: true
I20260923 19:50:26.922673 5814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" candidate_term: 4 candidate_status { last_received { term: 3 index: 944 } } ignore_live_leader: false dest_uuid: "83e97b26500048d0b75350a21a8ff96b" is_pre_election: true
I20260923 19:50:26.924436 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet c7369a5fc87f4b70bcfbe052ef021771 (table default.Table_295f07d1ca7345d5a18a80da04089ca2 [id=26fc3d5dd42441098cdd17a5d73d219d]) successfully deleted
W20260923 19:50:26.948266 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 9e20d623668646c688fbd82d2cbc7138 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e20d623668646c688fbd82d2cbc7138 already in progress: creating tablet
W20260923 19:50:26.948493 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 2dbb1973dbcd46f5a796fb8a0a24f88f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2dbb1973dbcd46f5a796fb8a0a24f88f already in progress: creating tablet
W20260923 19:50:26.948675 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet a820bf5854324639b98c984ac583a4d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a820bf5854324639b98c984ac583a4d7 already in progress: creating tablet
W20260923 19:50:26.948855 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet a83726da349c4cd1852e956c8fa2cda5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a83726da349c4cd1852e956c8fa2cda5 already in progress: creating tablet
I20260923 19:50:26.951418 5803 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 12bda2ae961446bea2f34e792f4f1706 (table default.Table_89c60db74742422086b6dcf76932a865 [id=2d69a962a7234afeb8366c66555b91e1]). Expected version 3 got 0
I20260923 19:50:26.951514 7980 raft_consensus.cc:493] T f1f1df47dc32413d9cc9456f4198dca5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bf41435f70447f19992d368ca6b46bd)
I20260923 19:50:26.951663 7980 raft_consensus.cc:515] T f1f1df47dc32413d9cc9456f4198dca5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:26.952171 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_8daeeb8f17384fc284bad32f5d6bdfa8" } new_table_name: "default.Table_747f4576fde9435dbb4e3de61fb03534" modify_external_catalogs: true
I20260923 19:50:26.952615 7980 leader_election.cc:290] T f1f1df47dc32413d9cc9456f4198dca5 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:26.953213 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f1df47dc32413d9cc9456f4198dca5" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:26.961619 7356 leader_election.cc:304] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3d628214a34b4fa3ca0c1abe422bae; no voters: 009ffee03a4d41db84df9f450aa84562, 83e97b26500048d0b75350a21a8ff96b
I20260923 19:50:26.962682 6056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f1df47dc32413d9cc9456f4198dca5" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:26.963613 6137 leader_election.cc:304] T f1f1df47dc32413d9cc9456f4198dca5 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:26.963953 7980 raft_consensus.cc:2749] T f1f1df47dc32413d9cc9456f4198dca5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 19:50:26.964820 8015 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260923 19:50:26.967375 6030 tablet_service.cc:1511] Processing CreateTablet for tablet 79dba8873a0b44e29a1facac6993ab83 (DEFAULT_TABLE table=default.Table_acafa9eab1a2413fb05d955b844452ea [id=f04b384fbad343e5bee580b78bd717c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:26.969358 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 20d299b0112b4eb4ae1b8cb266c69a11
I20260923 19:50:26.971593 5802 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet f2799563250845b0b9d7d51b2367b16b (table default.Table_bc33f65d5674483c9854966514392420 [id=b6e6ca970bea466f80938e694f770e67]). Expected version 1 got 0
I20260923 19:50:26.974352 6456 tablet_bootstrap.cc:492] T ba0453ef529344dfbab1130daa985fef P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:26.974503 6456 ts_tablet_manager.cc:1403] T ba0453ef529344dfbab1130daa985fef P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.000s
I20260923 19:50:26.974920 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet 20d299b0112b4eb4ae1b8cb266c69a11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:26 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:26.975711 6024 tablet_service.cc:1558] Processing DeleteTablet for tablet 20d299b0112b4eb4ae1b8cb266c69a11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:26 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:26.975226 6456 raft_consensus.cc:359] T ba0453ef529344dfbab1130daa985fef P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:26.975996 5802 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 12bda2ae961446bea2f34e792f4f1706 (table default.Table_89c60db74742422086b6dcf76932a865 [id=2d69a962a7234afeb8366c66555b91e1]). Expected version 3 got 0
I20260923 19:50:26.976089 6456 raft_consensus.cc:385] T ba0453ef529344dfbab1130daa985fef P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:26.976171 6456 raft_consensus.cc:740] T ba0453ef529344dfbab1130daa985fef P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:26.976377 6456 consensus_queue.cc:260] T ba0453ef529344dfbab1130daa985fef P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:26.976900 6456 ts_tablet_manager.cc:1434] T ba0453ef529344dfbab1130daa985fef P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:26.979041 5802 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet f1f1df47dc32413d9cc9456f4198dca5 (table default.Table_5c873b003c7b4b09ba69db7f039b2f98 [id=6d285eda96a948b2b14fa1ef456ca5b2]). Expected version 2 got 0
I20260923 19:50:26.982149 6456 tablet_bootstrap.cc:492] T 688bb1055ba94c2996cdfea6dea76416 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:26.984005 6456 tablet_bootstrap.cc:654] T 688bb1055ba94c2996cdfea6dea76416 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:26.985952 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_2a3fec3aaca84ecbac231d0c5d5be419" } new_table_name: "default.Table_52abb1a930aa442b9fb361345d7da76f" modify_external_catalogs: true
I20260923 19:50:26.986542 6458 ts_tablet_manager.cc:1950] T c5cb76fa5e084604aa58bf888cfe4852 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:26.987610 5799 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_e8762f65676a42ceb73097d69b5b7906" } new_table_name: "default.Table_29b635ebd4fb4e559a7f0635e67ca8b2" modify_external_catalogs: true
I20260923 19:50:26.990000 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_564b5ac3637c4a75aee56960a3e1fe03"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:26.990471 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_564b5ac3637c4a75aee56960a3e1fe03 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:26.993157 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_bd5cff276b1e441088052e4e8264430c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:26.993822 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd5cff276b1e441088052e4e8264430c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:26.995935 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_e1580fe44b374656b6657f26f1927b29"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:26.996398 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e1580fe44b374656b6657f26f1927b29 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:26.997495 5796 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f4780edf9b934c509bea9acd7290da6d consensus state has no leader
I20260923 19:50:26.998222 5796 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_b0623fc8e1dd40bcbd5dc4850272935b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:26.998430 5801 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 11e0f1c645184da19ce11927e1d562c3
W20260923 19:50:26.998647 5796 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b0623fc8e1dd40bcbd5dc4850272935b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:26.999191 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_e773814b4bc24001813b9088825f6247"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:26.999585 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e773814b4bc24001813b9088825f6247 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:27.000977 5800 master_service.cc:960] ReplaceTablet: received request to replace tablet 13b21aadd7464b1aa2afe7a1ebc9e77f from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:27.001555 5800 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_3974c6faa5a94a44a6c15aae07db7da2" } modify_external_catalogs: true
I20260923 19:50:27.001680 5800 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_3974c6faa5a94a44a6c15aae07db7da2" } modify_external_catalogs: true
I20260923 19:50:27.007051 6040 tablet_service.cc:1558] Processing DeleteTablet for tablet 11e0f1c645184da19ce11927e1d562c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:26 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:27.008189 6171 tablet_service.cc:1558] Processing DeleteTablet for tablet 11e0f1c645184da19ce11927e1d562c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:26 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:27.008968 6459 ts_tablet_manager.cc:1916] T 1b1d9413e1e24547b491a160d851377b P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:27.011950 6458 tablet_replica.cc:333] T 2e1c19a751904a6295897376e9c5ee56 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:27.012508 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79dba8873a0b44e29a1facac6993ab83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.016542 6171 tablet_service.cc:1558] Processing DeleteTablet for tablet 64e8951eb899461aa9c0b36e3f7555e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:27.017908 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet c5cb76fa5e084604aa58bf888cfe4852 (table default.Table_1a74b652ec7a4165b28643c452000d6d [id=74399f12686743ebbd14943c316be210]) successfully deleted
W20260923 19:50:27.018175 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 1e835fa95fa84b43be4c27b7e3e26af3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e835fa95fa84b43be4c27b7e3e26af3 already in progress: creating tablet
I20260923 19:50:27.018688 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7d891deab94f4132b4358c6e4dfd54af" } modify_external_catalogs: true
I20260923 19:50:27.018918 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_7d891deab94f4132b4358c6e4dfd54af" } modify_external_catalogs: true
I20260923 19:50:27.019623 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d5a4f5e67cc42f7981eb1f954b2a56b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.020804 6174 tablet_service.cc:1558] Processing DeleteTablet for tablet 20d299b0112b4eb4ae1b8cb266c69a11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:26 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:27.022332 6170 tablet_service.cc:1511] Processing CreateTablet for tablet 79dba8873a0b44e29a1facac6993ab83 (DEFAULT_TABLE table=default.Table_acafa9eab1a2413fb05d955b844452ea [id=f04b384fbad343e5bee580b78bd717c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.023725 6461 ts_tablet_manager.cc:1929] T 14c917ac93fd436aa13fb0839fae883f P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:27.024186 6461 log.cc:1199] T 14c917ac93fd436aa13fb0839fae883f P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/14c917ac93fd436aa13fb0839fae883f
I20260923 19:50:27.024925 6461 ts_tablet_manager.cc:1950] T 14c917ac93fd436aa13fb0839fae883f P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:27.017544 7993 raft_consensus.cc:493] T 22c89609da884c47b1dbc1470b37efbe P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:27.025533 6458 raft_consensus.cc:2243] T 2e1c19a751904a6295897376e9c5ee56 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:27.025476 7993 raft_consensus.cc:515] T 22c89609da884c47b1dbc1470b37efbe P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.025694 6458 raft_consensus.cc:2272] T 2e1c19a751904a6295897376e9c5ee56 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:27.026175 7993 leader_election.cc:290] T 22c89609da884c47b1dbc1470b37efbe P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:27.026281 6458 ts_tablet_manager.cc:1916] T 2e1c19a751904a6295897376e9c5ee56 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:27.017710 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet 11e0f1c645184da19ce11927e1d562c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:26 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:27.027114 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 79dba8873a0b44e29a1facac6993ab83 (DEFAULT_TABLE table=default.Table_acafa9eab1a2413fb05d955b844452ea [id=f04b384fbad343e5bee580b78bd717c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.027450 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79dba8873a0b44e29a1facac6993ab83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.027830 7971 catalog_manager.cc:1308] Loaded cluster ID: bb53aae1ed8841f4b400598d36bb10de
I20260923 19:50:27.027930 7971 catalog_manager.cc:1601] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae: loading cluster ID for follower catalog manager: success
I20260923 19:50:27.031172 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 4ef6cbeebfcd40d8a7186756c03ad86d (DEFAULT_TABLE table=default.Table_d8f23c4ba0fb4170819c9cc0f6041519 [id=6b3219959dad474a8575e0c429d4bcf3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.031565 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ef6cbeebfcd40d8a7186756c03ad86d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.034235 6170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79dba8873a0b44e29a1facac6993ab83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.034217 6323 tablet_service.cc:1511] Processing CreateTablet for tablet 52d9d56992d049d5ad5542671bf4eee6 (DEFAULT_TABLE table=default.Table_472f6ecd2ddf44129fec7370987e98e6 [id=b5a260d400194930b02fc3fe8fb659cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.034551 6323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52d9d56992d049d5ad5542671bf4eee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.036370 7980 raft_consensus.cc:493] T 684eb2576b4b4730813b993e36b242df P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:27.036514 7980 raft_consensus.cc:515] T 684eb2576b4b4730813b993e36b242df P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:27.037092 7980 leader_election.cc:290] T 684eb2576b4b4730813b993e36b242df P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:27.038270 6137 leader_election.cc:343] T 684eb2576b4b4730813b993e36b242df P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 684eb2576b4b4730813b993e36b242df
W20260923 19:50:27.038602 6139 leader_election.cc:343] T 684eb2576b4b4730813b993e36b242df P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 684eb2576b4b4730813b993e36b242df
I20260923 19:50:27.038692 6139 leader_election.cc:304] T 684eb2576b4b4730813b993e36b242df P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:27.039048 7980 raft_consensus.cc:2749] T 684eb2576b4b4730813b993e36b242df P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:27.040377 6321 tablet_service.cc:1511] Processing CreateTablet for tablet 48d22419a02540bcb6ab7e3df4320bf5 (DEFAULT_TABLE table=default.Table_545540fd5e8f40c9ae3b3c88ff3d97fb [id=281dc22099ef4201ba1c200a9e689afe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.040719 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48d22419a02540bcb6ab7e3df4320bf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.042143 6318 tablet_service.cc:1511] Processing CreateTablet for tablet 2063f9afc0f540c984ce8ca07d30da31 (DEFAULT_TABLE table=default.Table_c2e466fad3084816b9e54b62b4c465d7 [id=38a84b4fad4f463fb4251515efd61728]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.042457 6318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2063f9afc0f540c984ce8ca07d30da31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.043547 6456 tablet_bootstrap.cc:492] T 688bb1055ba94c2996cdfea6dea76416 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:27.043668 6456 ts_tablet_manager.cc:1403] T 688bb1055ba94c2996cdfea6dea76416 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.062s user 0.002s sys 0.002s
I20260923 19:50:27.044376 6456 raft_consensus.cc:359] T 688bb1055ba94c2996cdfea6dea76416 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:27.044543 6456 raft_consensus.cc:385] T 688bb1055ba94c2996cdfea6dea76416 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:27.044595 6456 raft_consensus.cc:740] T 688bb1055ba94c2996cdfea6dea76416 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:27.027015 6030 tablet_service.cc:1511] Processing CreateTablet for tablet 4ef6cbeebfcd40d8a7186756c03ad86d (DEFAULT_TABLE table=default.Table_d8f23c4ba0fb4170819c9cc0f6041519 [id=6b3219959dad474a8575e0c429d4bcf3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.044827 6456 consensus_queue.cc:260] T 688bb1055ba94c2996cdfea6dea76416 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:27.045192 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ef6cbeebfcd40d8a7186756c03ad86d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.045293 6456 ts_tablet_manager.cc:1434] T 688bb1055ba94c2996cdfea6dea76416 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:50:27.045547 6456 tablet_bootstrap.cc:492] T f4313a4d8a9c411fad593b05ad655fc4 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:27.046149 6025 tablet_service.cc:1511] Processing CreateTablet for tablet 11466edd0c614da2be3fe732582811b1 (DEFAULT_TABLE table=default.Table_c270e17c5b9849d3bd1c560599c81f76 [id=a4bbdbad45424a188ce7b78639147f6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.046475 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11466edd0c614da2be3fe732582811b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.047043 6456 tablet_bootstrap.cc:654] T f4313a4d8a9c411fad593b05ad655fc4 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:27.024293 6457 tablet_bootstrap.cc:654] T f28da30d48454ffd9626df789a2f2063 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:27.034307 6024 tablet_service.cc:1511] Processing CreateTablet for tablet 2063f9afc0f540c984ce8ca07d30da31 (DEFAULT_TABLE table=default.Table_c2e466fad3084816b9e54b62b4c465d7 [id=38a84b4fad4f463fb4251515efd61728]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.050158 6024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2063f9afc0f540c984ce8ca07d30da31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.043329 6039 tablet_service.cc:1511] Processing CreateTablet for tablet 652921d75e174c3cad12c9439cfa100e (DEFAULT_TABLE table=default.Table_94d5b95093b449e28be947e716590ef9 [id=bbacc5ba806541f991176d856ea6e677]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.054174 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 652921d75e174c3cad12c9439cfa100e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.056005 6319 tablet_service.cc:1511] Processing CreateTablet for tablet 11466edd0c614da2be3fe732582811b1 (DEFAULT_TABLE table=default.Table_c270e17c5b9849d3bd1c560599c81f76 [id=a4bbdbad45424a188ce7b78639147f6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.056389 6319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11466edd0c614da2be3fe732582811b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.056712 6035 tablet_service.cc:1511] Processing CreateTablet for tablet 8cc3efb4a4774f3ea420b06b5d820186 (DEFAULT_TABLE table=default.Table_dee6df557cd543ed83b05c9909e560ba [id=2bca7844d1a041b8a70271f2769e0b54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.057024 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cc3efb4a4774f3ea420b06b5d820186. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.058125 6309 tablet_service.cc:1511] Processing CreateTablet for tablet 652921d75e174c3cad12c9439cfa100e (DEFAULT_TABLE table=default.Table_94d5b95093b449e28be947e716590ef9 [id=bbacc5ba806541f991176d856ea6e677]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.058441 6309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 652921d75e174c3cad12c9439cfa100e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.062166 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 8cc3efb4a4774f3ea420b06b5d820186 (DEFAULT_TABLE table=default.Table_dee6df557cd543ed83b05c9909e560ba [id=2bca7844d1a041b8a70271f2769e0b54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.062516 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cc3efb4a4774f3ea420b06b5d820186. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.063030 6024 tablet_service.cc:1511] Processing CreateTablet for tablet 1622093dfcd44589a7336203aac5ba37 (DEFAULT_TABLE table=default.Table_3a0ed1c1dbcc45ceb5ae6a4f0707048a [id=35db40b06ae74e4d9b8a79e18c918660]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.063341 6024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1622093dfcd44589a7336203aac5ba37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.064970 6036 tablet_service.cc:1511] Processing CreateTablet for tablet eef9fc0c57454c5d8422be63988890dd (DEFAULT_TABLE table=default.Table_af899fa1ab4d4a31861ccaa8cc068e9c [id=86da8fa02f3e4889a8590216afc999f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.065174 6039 tablet_service.cc:1511] Processing CreateTablet for tablet 6b3f1b2de5c943919413e981445bc049 (DEFAULT_TABLE table=default.Table_8c85b08bc85b4ed391b499a1b1871883 [id=3a997facccda46faad3ec9f85790cfa2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.065292 6036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eef9fc0c57454c5d8422be63988890dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.065444 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b3f1b2de5c943919413e981445bc049. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.066196 6027 tablet_service.cc:1511] Processing CreateTablet for tablet 5c9514e21811404b9bddba676d3dc179 (DEFAULT_TABLE table=default.Table_c54bb8999915481194627164d640f4d7 [id=2339bee40b9148c8a02c7e01fe50117f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.066471 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c9514e21811404b9bddba676d3dc179. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.070138 6023 tablet_service.cc:1511] Processing CreateTablet for tablet 4a127d1d027e465486355358f6103938 (DEFAULT_TABLE table=default.Table_3e40d347b8bd45bcb5ce43a795e909c6 [id=294280483112471aa36f3ce7a6a5367d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.070477 6023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a127d1d027e465486355358f6103938. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.074144 6031 tablet_service.cc:1511] Processing CreateTablet for tablet 31a95b4b69044586816e9fc88a2f55ab (DEFAULT_TABLE table=default.Table_a0ad9f8fcb0b4e6ca0b5b311d2e2c3d2 [id=51b6be19d1474b7f9c53377055fc1479]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.074481 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31a95b4b69044586816e9fc88a2f55ab. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:27.075817 6279 leader_election.cc:343] T 22c89609da884c47b1dbc1470b37efbe P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 22c89609da884c47b1dbc1470b37efbe
I20260923 19:50:27.078115 6029 tablet_service.cc:1511] Processing CreateTablet for tablet 5d780efe1b4343478002127bf789e162 (DEFAULT_TABLE table=default.Table_7e6c82f049e646f8b98cc2e169492b15 [id=6faaa56e5ea5438fb59627a706827976]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.078471 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d780efe1b4343478002127bf789e162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.081845 7986 raft_consensus.cc:493] T cf64073cdde748bc8ed3ce7580a71160 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:27.081987 7986 raft_consensus.cc:515] T cf64073cdde748bc8ed3ce7580a71160 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:27.082180 6021 tablet_service.cc:1511] Processing CreateTablet for tablet 6b6333cdd2244cb8b44cb6d59e22dd4a (DEFAULT_TABLE table=default.Table_ffcdb975fa2d4b6494baea2e3c84a99e [id=e40397fbfe3c44209f8c6591a52f0744]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.082494 6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b6333cdd2244cb8b44cb6d59e22dd4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.082644 7986 leader_election.cc:290] T cf64073cdde748bc8ed3ce7580a71160 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:27.083468 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf64073cdde748bc8ed3ce7580a71160" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:27.084372 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf64073cdde748bc8ed3ce7580a71160" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:27.085212 5996 leader_election.cc:343] T cf64073cdde748bc8ed3ce7580a71160 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:27.085417 5995 leader_election.cc:343] T cf64073cdde748bc8ed3ce7580a71160 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:27.085506 5995 leader_election.cc:304] T cf64073cdde748bc8ed3ce7580a71160 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:27.085896 7986 raft_consensus.cc:2749] T cf64073cdde748bc8ed3ce7580a71160 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:27.087044 6308 tablet_service.cc:1511] Processing CreateTablet for tablet 1622093dfcd44589a7336203aac5ba37 (DEFAULT_TABLE table=default.Table_3a0ed1c1dbcc45ceb5ae6a4f0707048a [id=35db40b06ae74e4d9b8a79e18c918660]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.087314 6315 tablet_service.cc:1511] Processing CreateTablet for tablet 5c9514e21811404b9bddba676d3dc179 (DEFAULT_TABLE table=default.Table_c54bb8999915481194627164d640f4d7 [id=2339bee40b9148c8a02c7e01fe50117f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.087433 6308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1622093dfcd44589a7336203aac5ba37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.087604 6315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c9514e21811404b9bddba676d3dc179. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.090166 6313 tablet_service.cc:1511] Processing CreateTablet for tablet 6b6333cdd2244cb8b44cb6d59e22dd4a (DEFAULT_TABLE table=default.Table_ffcdb975fa2d4b6494baea2e3c84a99e [id=e40397fbfe3c44209f8c6591a52f0744]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.090502 6313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b6333cdd2244cb8b44cb6d59e22dd4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.094367 6314 tablet_service.cc:1511] Processing CreateTablet for tablet eef9fc0c57454c5d8422be63988890dd (DEFAULT_TABLE table=default.Table_af899fa1ab4d4a31861ccaa8cc068e9c [id=86da8fa02f3e4889a8590216afc999f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.094869 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eef9fc0c57454c5d8422be63988890dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.096203 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 14c917ac93fd436aa13fb0839fae883f (table default.Table_72a581bef73d4b24868e54dc6e544838 [id=f74ac9337bca41168a71a13e62116a09]) successfully deleted
I20260923 19:50:27.097285 6454 tablet_bootstrap.cc:492] T f1c1d4f73488499a9e5add81e9d5e2d6 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:27.097440 6454 ts_tablet_manager.cc:1403] T f1c1d4f73488499a9e5add81e9d5e2d6 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.177s user 0.005s sys 0.003s
I20260923 19:50:27.098510 6324 tablet_service.cc:1511] Processing CreateTablet for tablet 6b3f1b2de5c943919413e981445bc049 (DEFAULT_TABLE table=default.Table_8c85b08bc85b4ed391b499a1b1871883 [id=3a997facccda46faad3ec9f85790cfa2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.098829 6324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b3f1b2de5c943919413e981445bc049. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.103030 6322 tablet_service.cc:1511] Processing CreateTablet for tablet 5d780efe1b4343478002127bf789e162 (DEFAULT_TABLE table=default.Table_7e6c82f049e646f8b98cc2e169492b15 [id=6faaa56e5ea5438fb59627a706827976]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.103361 6322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d780efe1b4343478002127bf789e162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.106609 6317 tablet_service.cc:1511] Processing CreateTablet for tablet 31a95b4b69044586816e9fc88a2f55ab (DEFAULT_TABLE table=default.Table_a0ad9f8fcb0b4e6ca0b5b311d2e2c3d2 [id=51b6be19d1474b7f9c53377055fc1479]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.106957 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31a95b4b69044586816e9fc88a2f55ab. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:27.109462 5799 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dbf9706e947a4c46aceeb47ce6e4e9b7 consensus state has no leader
I20260923 19:50:27.111209 5796 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_2dd0d5ba241c477188fb511e355d29d5" } modify_external_catalogs: true
I20260923 19:50:27.111402 5796 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_2dd0d5ba241c477188fb511e355d29d5" } modify_external_catalogs: true
I20260923 19:50:27.111471 5799 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet f1f1df47dc32413d9cc9456f4198dca5 (table default.Table_5c873b003c7b4b09ba69db7f039b2f98 [id=6d285eda96a948b2b14fa1ef456ca5b2]). Expected version 2 got 0
I20260923 19:50:27.111956 6312 tablet_service.cc:1511] Processing CreateTablet for tablet 4a127d1d027e465486355358f6103938 (DEFAULT_TABLE table=default.Table_3e40d347b8bd45bcb5ce43a795e909c6 [id=294280483112471aa36f3ce7a6a5367d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.112329 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a127d1d027e465486355358f6103938. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:27.112741 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a6da9b3eea4547c9bb80b08bd26c5dc2 consensus state has no leader
I20260923 19:50:27.112903 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 85d35ebef3c24a2e89233dd900b63513
I20260923 19:50:27.113498 5800 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet f5f285e125dc445197a59e02e199a606
I20260923 19:50:27.116561 6036 tablet_service.cc:1558] Processing DeleteTablet for tablet 85d35ebef3c24a2e89233dd900b63513 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:27 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:27.116829 6021 tablet_service.cc:1558] Processing DeleteTablet for tablet f5f285e125dc445197a59e02e199a606 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:27 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:27.131103 6454 raft_consensus.cc:359] T f1c1d4f73488499a9e5add81e9d5e2d6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.131287 6454 raft_consensus.cc:385] T f1c1d4f73488499a9e5add81e9d5e2d6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:27.131336 6454 raft_consensus.cc:740] T f1c1d4f73488499a9e5add81e9d5e2d6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:27.131531 6454 consensus_queue.cc:260] T f1c1d4f73488499a9e5add81e9d5e2d6 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.134274 6454 ts_tablet_manager.cc:1434] T f1c1d4f73488499a9e5add81e9d5e2d6 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.037s user 0.003s sys 0.000s
I20260923 19:50:27.134572 6454 tablet_bootstrap.cc:492] T 397ec5e49673406cb26a2efab0ad8401 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:27.134879 6457 tablet_bootstrap.cc:492] T f28da30d48454ffd9626df789a2f2063 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:27.135004 6457 ts_tablet_manager.cc:1403] T f28da30d48454ffd9626df789a2f2063 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.194s user 0.003s sys 0.004s
I20260923 19:50:27.135058 7980 raft_consensus.cc:493] T 92f94b93d1364bb1a2562eb577707cf1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:27.135224 7980 raft_consensus.cc:515] T 92f94b93d1364bb1a2562eb577707cf1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.135881 7980 leader_election.cc:290] T 92f94b93d1364bb1a2562eb577707cf1 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:27.135812 8033 tablet.cc:1751] T f1f1df47dc32413d9cc9456f4198dca5 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:27.135828 6457 raft_consensus.cc:359] T f28da30d48454ffd9626df789a2f2063 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:27.136005 6457 raft_consensus.cc:385] T f28da30d48454ffd9626df789a2f2063 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:27.136059 6457 raft_consensus.cc:740] T f28da30d48454ffd9626df789a2f2063 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:27.136649 6170 tablet_service.cc:1511] Processing CreateTablet for tablet 4ef6cbeebfcd40d8a7186756c03ad86d (DEFAULT_TABLE table=default.Table_d8f23c4ba0fb4170819c9cc0f6041519 [id=6b3219959dad474a8575e0c429d4bcf3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.136257 6457 consensus_queue.cc:260] T f28da30d48454ffd9626df789a2f2063 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:27.136873 6174 tablet_service.cc:1511] Processing CreateTablet for tablet 52d9d56992d049d5ad5542671bf4eee6 (DEFAULT_TABLE table=default.Table_472f6ecd2ddf44129fec7370987e98e6 [id=b5a260d400194930b02fc3fe8fb659cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.137418 6171 tablet_service.cc:1511] Processing CreateTablet for tablet 48d22419a02540bcb6ab7e3df4320bf5 (DEFAULT_TABLE table=default.Table_545540fd5e8f40c9ae3b3c88ff3d97fb [id=281dc22099ef4201ba1c200a9e689afe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.138149 6454 tablet_bootstrap.cc:654] T 397ec5e49673406cb26a2efab0ad8401 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:27.139321 6139 leader_election.cc:343] T 92f94b93d1364bb1a2562eb577707cf1 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 92f94b93d1364bb1a2562eb577707cf1
I20260923 19:50:27.140908 6457 ts_tablet_manager.cc:1434] T f28da30d48454ffd9626df789a2f2063 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260923 19:50:27.141700 6457 tablet_bootstrap.cc:492] T d5d3f96ebf1c4d05aceb06ef53737e4f P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:27.142594 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c89609da884c47b1dbc1470b37efbe" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:27.143177 6197 raft_consensus.cc:3060] T f1c1d4f73488499a9e5add81e9d5e2d6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:27.136873 6173 tablet_service.cc:1511] Processing CreateTablet for tablet 2063f9afc0f540c984ce8ca07d30da31 (DEFAULT_TABLE table=default.Table_c2e466fad3084816b9e54b62b4c465d7 [id=38a84b4fad4f463fb4251515efd61728]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:27.146730 6280 leader_election.cc:343] T 22c89609da884c47b1dbc1470b37efbe P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:27.146876 6280 leader_election.cc:304] T 22c89609da884c47b1dbc1470b37efbe P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:27.147361 7822 raft_consensus.cc:2749] T 22c89609da884c47b1dbc1470b37efbe P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:27.147886 6456 tablet_bootstrap.cc:492] T f4313a4d8a9c411fad593b05ad655fc4 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:27.148011 6456 ts_tablet_manager.cc:1403] T f4313a4d8a9c411fad593b05ad655fc4 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.103s user 0.002s sys 0.000s
W20260923 19:50:27.147918 6137 leader_election.cc:343] T 92f94b93d1364bb1a2562eb577707cf1 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 92f94b93d1364bb1a2562eb577707cf1
I20260923 19:50:27.148782 6456 raft_consensus.cc:359] T f4313a4d8a9c411fad593b05ad655fc4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.148949 6456 raft_consensus.cc:385] T f4313a4d8a9c411fad593b05ad655fc4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:27.148999 6456 raft_consensus.cc:740] T f4313a4d8a9c411fad593b05ad655fc4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:27.148638 6137 leader_election.cc:304] T 92f94b93d1364bb1a2562eb577707cf1 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:27.149864 7980 raft_consensus.cc:2749] T 92f94b93d1364bb1a2562eb577707cf1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:27.150498 6180 tablet_service.cc:1511] Processing CreateTablet for tablet 652921d75e174c3cad12c9439cfa100e (DEFAULT_TABLE table=default.Table_94d5b95093b449e28be947e716590ef9 [id=bbacc5ba806541f991176d856ea6e677]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.151399 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 8cc3efb4a4774f3ea420b06b5d820186 (DEFAULT_TABLE table=default.Table_dee6df557cd543ed83b05c9909e560ba [id=2bca7844d1a041b8a70271f2769e0b54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.151434 6456 consensus_queue.cc:260] T f4313a4d8a9c411fad593b05ad655fc4 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.152002 6456 ts_tablet_manager.cc:1434] T f4313a4d8a9c411fad593b05ad655fc4 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260923 19:50:27.152618 6456 tablet_bootstrap.cc:492] T f8007918eca14c81947e5999fe13a705 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:27.152736 6176 tablet_service.cc:1511] Processing CreateTablet for tablet 31a95b4b69044586816e9fc88a2f55ab (DEFAULT_TABLE table=default.Table_a0ad9f8fcb0b4e6ca0b5b311d2e2c3d2 [id=51b6be19d1474b7f9c53377055fc1479]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.153273 6179 tablet_service.cc:1511] Processing CreateTablet for tablet 4a127d1d027e465486355358f6103938 (DEFAULT_TABLE table=default.Table_3e40d347b8bd45bcb5ce43a795e909c6 [id=294280483112471aa36f3ce7a6a5367d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.153568 6172 tablet_service.cc:1511] Processing CreateTablet for tablet 5d780efe1b4343478002127bf789e162 (DEFAULT_TABLE table=default.Table_7e6c82f049e646f8b98cc2e169492b15 [id=6faaa56e5ea5438fb59627a706827976]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.150497 6166 tablet_service.cc:1511] Processing CreateTablet for tablet 11466edd0c614da2be3fe732582811b1 (DEFAULT_TABLE table=default.Table_c270e17c5b9849d3bd1c560599c81f76 [id=a4bbdbad45424a188ce7b78639147f6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.154696 6182 tablet_service.cc:1511] Processing CreateTablet for tablet 1622093dfcd44589a7336203aac5ba37 (DEFAULT_TABLE table=default.Table_3a0ed1c1dbcc45ceb5ae6a4f0707048a [id=35db40b06ae74e4d9b8a79e18c918660]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.155314 6181 tablet_service.cc:1511] Processing CreateTablet for tablet 6b3f1b2de5c943919413e981445bc049 (DEFAULT_TABLE table=default.Table_8c85b08bc85b4ed391b499a1b1871883 [id=3a997facccda46faad3ec9f85790cfa2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.156329 6322 tablet_service.cc:1558] Processing DeleteTablet for tablet f5f285e125dc445197a59e02e199a606 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:27 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:27.157611 6306 tablet_service.cc:1558] Processing DeleteTablet for tablet 85d35ebef3c24a2e89233dd900b63513 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:27 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:27.158692 6454 tablet_bootstrap.cc:492] T 397ec5e49673406cb26a2efab0ad8401 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:27.158821 6454 ts_tablet_manager.cc:1403] T 397ec5e49673406cb26a2efab0ad8401 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.004s
I20260923 19:50:27.159584 6454 raft_consensus.cc:359] T 397ec5e49673406cb26a2efab0ad8401 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.159755 6454 raft_consensus.cc:385] T 397ec5e49673406cb26a2efab0ad8401 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:27.159812 6454 raft_consensus.cc:740] T 397ec5e49673406cb26a2efab0ad8401 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:27.160000 6454 consensus_queue.cc:260] T 397ec5e49673406cb26a2efab0ad8401 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.160712 6454 ts_tablet_manager.cc:1434] T 397ec5e49673406cb26a2efab0ad8401 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:27.161015 6454 tablet_bootstrap.cc:492] T 21bf33904ede470b80a074dc9a458baf P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:27.166952 6454 tablet_bootstrap.cc:654] T 21bf33904ede470b80a074dc9a458baf P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:27.167608 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 48d22419a02540bcb6ab7e3df4320bf5 (DEFAULT_TABLE table=default.Table_545540fd5e8f40c9ae3b3c88ff3d97fb [id=281dc22099ef4201ba1c200a9e689afe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.170115 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48d22419a02540bcb6ab7e3df4320bf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.172608 6456 tablet_bootstrap.cc:654] T f8007918eca14c81947e5999fe13a705 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:27.173679 5803 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7fc282f278f343a5befc7be8484be46d consensus state has no leader
I20260923 19:50:27.174212 5800 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet f1c1d4f73488499a9e5add81e9d5e2d6 (table default.Table_7f7907c8e1bc4ad1ae68faf5f072b318 [id=80e3a84f7199464fa96426daeeeb84cd]). Expected version 2 got 0
I20260923 19:50:27.175698 6170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ef6cbeebfcd40d8a7186756c03ad86d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.175920 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cc3efb4a4774f3ea420b06b5d820186. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.176066 6171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48d22419a02540bcb6ab7e3df4320bf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.176226 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11466edd0c614da2be3fe732582811b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.177222 6182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1622093dfcd44589a7336203aac5ba37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.180243 6176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31a95b4b69044586816e9fc88a2f55ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.180627 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52d9d56992d049d5ad5542671bf4eee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.182523 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b3f1b2de5c943919413e981445bc049. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.184877 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2063f9afc0f540c984ce8ca07d30da31. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:27.185752 5789 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet e076b89526a24344bea591eccfdde1e9 (table default.Table_efcf236fb23d420db96e34f519589c4b [id=9a8d3decee6c4df49f5cf778e0a66777], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet e076b89526a24344bea591eccfdde1e9 consensus state has no leader
I20260923 19:50:27.186019 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 652921d75e174c3cad12c9439cfa100e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.188760 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a127d1d027e465486355358f6103938. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.191905 6172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d780efe1b4343478002127bf789e162. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:27.161731 5790 catalog_manager.cc:5030] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 9c4a200d16464676976694656cbe28e2 because the tablet was not found. No further retry: Not found: Tablet not found: 9c4a200d16464676976694656cbe28e2
I20260923 19:50:27.203464 7971 catalog_manager.cc:1623] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae: acquiring CA information for follower catalog manager: success
I20260923 19:50:27.204278 5800 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d6a453784ebd47b9b8c169ab766d6c23" } modify_external_catalogs: true
I20260923 19:50:27.204483 5800 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d6a453784ebd47b9b8c169ab766d6c23" } modify_external_catalogs: true
I20260923 19:50:27.205711 6174 tablet_service.cc:1511] Processing CreateTablet for tablet 5c9514e21811404b9bddba676d3dc179 (DEFAULT_TABLE table=default.Table_c54bb8999915481194627164d640f4d7 [id=2339bee40b9148c8a02c7e01fe50117f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.206146 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c9514e21811404b9bddba676d3dc179. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.208106 6181 tablet_service.cc:1558] Processing DeleteTablet for tablet f5f285e125dc445197a59e02e199a606 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:27 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:27.209208 5802 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_6d4436d2f89b4e74b85c8b13a581843e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:27.209800 5802 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d4436d2f89b4e74b85c8b13a581843e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:27.210620 6457 tablet_bootstrap.cc:654] T d5d3f96ebf1c4d05aceb06ef53737e4f P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:27.211133 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_cb7602c69419443490c9e41050e22b2c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:27.211231 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_b2ca67b2177c4c03a924e9b0a4b46742"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:27.211553 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb7602c69419443490c9e41050e22b2c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:27.211639 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2ca67b2177c4c03a924e9b0a4b46742 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:27.212852 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_6b1bf474d973437eabe2b92b3bc9e948" } new_table_name: "default.Table_7a513b99f44e44a181fd2a1565271d02" modify_external_catalogs: true
I20260923 19:50:27.212921 6171 tablet_service.cc:1511] Processing CreateTablet for tablet eef9fc0c57454c5d8422be63988890dd (DEFAULT_TABLE table=default.Table_af899fa1ab4d4a31861ccaa8cc068e9c [id=86da8fa02f3e4889a8590216afc999f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.212986 5797 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_1ddcefc310ff4feca41bc3475393eac1" } new_table_name: "default.Table_387e5c8e8f514e87b2cda9b9f89610f4" modify_external_catalogs: true
I20260923 19:50:27.213299 6171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eef9fc0c57454c5d8422be63988890dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.214877 5799 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_cefeef04a4b942298f483f3a6c87dbb7" } modify_external_catalogs: true
I20260923 19:50:27.215016 5799 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_cefeef04a4b942298f483f3a6c87dbb7" } modify_external_catalogs: true
I20260923 19:50:27.214908 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_cb7681f47cb44025a62096e5b8e95087"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:27.215616 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb7681f47cb44025a62096e5b8e95087 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:27.218483 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcd4f447ff1a4adc8912b707169b20ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.222574 6173 tablet_service.cc:1558] Processing DeleteTablet for tablet 85d35ebef3c24a2e89233dd900b63513 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:27 UTC) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:27.223781 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet a0743d5ac2264af6b045af0474cbf58c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0743d5ac2264af6b045af0474cbf58c already in progress: creating tablet
I20260923 19:50:27.226478 6040 tablet_service.cc:1511] Processing CreateTablet for tablet 52d9d56992d049d5ad5542671bf4eee6 (DEFAULT_TABLE table=default.Table_472f6ecd2ddf44129fec7370987e98e6 [id=b5a260d400194930b02fc3fe8fb659cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.229962 8041 tablet.cc:1751] T f1f1df47dc32413d9cc9456f4198dca5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:27.233606 6180 tablet_service.cc:1511] Processing CreateTablet for tablet 6b6333cdd2244cb8b44cb6d59e22dd4a (DEFAULT_TABLE table=default.Table_ffcdb975fa2d4b6494baea2e3c84a99e [id=e40397fbfe3c44209f8c6591a52f0744]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.234817 6461 tablet_replica.cc:333] T 9756a1f8e23a436bb7c19c8cba7bdc05 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:27.235528 6461 raft_consensus.cc:2243] T 9756a1f8e23a436bb7c19c8cba7bdc05 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:27.235685 6461 raft_consensus.cc:2272] T 9756a1f8e23a436bb7c19c8cba7bdc05 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:27.235059 6040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52d9d56992d049d5ad5542671bf4eee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.236233 6461 ts_tablet_manager.cc:1916] T 9756a1f8e23a436bb7c19c8cba7bdc05 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:27.238195 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b6333cdd2244cb8b44cb6d59e22dd4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.251785 6459 ts_tablet_manager.cc:1929] T 1b1d9413e1e24547b491a160d851377b P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:27.258433 8033 tablet.cc:1751] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:27.277146 6459 log.cc:1199] T 1b1d9413e1e24547b491a160d851377b P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/1b1d9413e1e24547b491a160d851377b
I20260923 19:50:27.287670 7986 raft_consensus.cc:493] T f28da30d48454ffd9626df789a2f2063 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:27.287750 6456 tablet_bootstrap.cc:492] T f8007918eca14c81947e5999fe13a705 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:27.287881 6456 ts_tablet_manager.cc:1403] T f8007918eca14c81947e5999fe13a705 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.135s user 0.005s sys 0.005s
I20260923 19:50:27.287829 7986 raft_consensus.cc:515] T f28da30d48454ffd9626df789a2f2063 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:27.288448 7986 leader_election.cc:290] T f28da30d48454ffd9626df789a2f2063 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:27.288642 6456 raft_consensus.cc:359] T f8007918eca14c81947e5999fe13a705 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.291656 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28da30d48454ffd9626df789a2f2063" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:27.295392 6456 raft_consensus.cc:385] T f8007918eca14c81947e5999fe13a705 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:27.295527 6456 raft_consensus.cc:740] T f8007918eca14c81947e5999fe13a705 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:27.295900 6456 consensus_queue.cc:260] T f8007918eca14c81947e5999fe13a705 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
W20260923 19:50:27.296161 5996 leader_election.cc:343] T f28da30d48454ffd9626df789a2f2063 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:27.296663 6456 ts_tablet_manager.cc:1434] T f8007918eca14c81947e5999fe13a705 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260923 19:50:27.297045 6456 tablet_bootstrap.cc:492] T 8d20b59aa99f49f0b2f4d7dd861470f8 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:27.302374 6456 tablet_bootstrap.cc:654] T 8d20b59aa99f49f0b2f4d7dd861470f8 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:27.305029 7971 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260923 19:50:27.292407 7822 raft_consensus.cc:493] T 688bb1055ba94c2996cdfea6dea76416 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:27.310511 7822 raft_consensus.cc:515] T 688bb1055ba94c2996cdfea6dea76416 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:27.311905 7822 leader_election.cc:290] T 688bb1055ba94c2996cdfea6dea76416 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
W20260923 19:50:27.325662 6279 leader_election.cc:343] T 688bb1055ba94c2996cdfea6dea76416 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 688bb1055ba94c2996cdfea6dea76416
I20260923 19:50:27.337352 8041 tablet.cc:1751] T 26031fe469d046518cdd0f1e955e19d1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:27.353116 6456 tablet_bootstrap.cc:492] T 8d20b59aa99f49f0b2f4d7dd861470f8 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:27.353278 6456 ts_tablet_manager.cc:1403] T 8d20b59aa99f49f0b2f4d7dd861470f8 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.056s user 0.003s sys 0.000s
I20260923 19:50:27.354023 6456 raft_consensus.cc:359] T 8d20b59aa99f49f0b2f4d7dd861470f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.354200 6456 raft_consensus.cc:385] T 8d20b59aa99f49f0b2f4d7dd861470f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:27.354255 6456 raft_consensus.cc:740] T 8d20b59aa99f49f0b2f4d7dd861470f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:27.354462 6456 consensus_queue.cc:260] T 8d20b59aa99f49f0b2f4d7dd861470f8 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.354936 6456 ts_tablet_manager.cc:1434] T 8d20b59aa99f49f0b2f4d7dd861470f8 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:27.355221 6456 tablet_bootstrap.cc:492] T a263c0fc71424999b76ef01de9a51eda P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:27.358836 5802 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet f1f1df47dc32413d9cc9456f4198dca5 (table default.Table_5c873b003c7b4b09ba69db7f039b2f98 [id=6d285eda96a948b2b14fa1ef456ca5b2]). Expected version 2 got 0
I20260923 19:50:27.360013 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_ea8e40f321be4c45a3c164ebe2ea00ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:27.360898 5797 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0c2890033a1f4204b954911dd8fe3dfb consensus state has no leader
I20260923 19:50:27.361140 5797 master_service.cc:960] ReplaceTablet: received request to replace tablet 85b7dcf131c54187a6e61f8503c797f8 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:27.361692 5797 master_service.cc:960] ReplaceTablet: received request to replace tablet db943a36b2fe4ca9813e08ddb38ce7f6 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:27.363054 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_00a26bd9f7b342d5af560a7a0c14d3da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:27.363480 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 139c2fc3ab9c47a9b184e02424a88890 consensus state has no leader
W20260923 19:50:27.363523 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_00a26bd9f7b342d5af560a7a0c14d3da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:27.363824 5798 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_23bee5e3273a448bac30904cc004d63a" } new_table_name: "default.Table_1713583a5b0f4812b5a3f23eecca4a4f" modify_external_catalogs: true
I20260923 19:50:27.365695 6317 tablet_service.cc:1511] Processing CreateTablet for tablet 4e288e1ed48841fcb2b8b66cc3ebbfdb (DEFAULT_TABLE table=default.Table_04b0ab0ec24340b99b95fb612c1777d3 [id=abdec369157f42a48c6a4e8a75ef8623]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.366153 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e288e1ed48841fcb2b8b66cc3ebbfdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.367218 5800 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 26031fe469d046518cdd0f1e955e19d1
I20260923 19:50:27.368012 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_1acd164e2b1143a0abc77f70a0178d34" } new_table_name: "default.Table_0945bbab78e34cb6ba1282e53d8d4d98" modify_external_catalogs: true
I20260923 19:50:27.369160 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 4794444caf0d4addb2ec1ca472dfd4cf (DEFAULT_TABLE table=default.Table_be41f102974644f7b7a95b121e9256bb [id=3934a716d6564029b9d309b31d453f0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.369515 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4794444caf0d4addb2ec1ca472dfd4cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.370175 5801 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet f28da30d48454ffd9626df789a2f2063 (table default.Table_4c7beeb130604565858c166a2b4c4c53 [id=e319867d5e9c46c79d9f5a564faec3e9]). Expected version 1 got 0
I20260923 19:50:27.371117 5801 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f4e94b13deef43fb9382f2eccb648126" } modify_external_catalogs: true
I20260923 19:50:27.371265 5801 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f4e94b13deef43fb9382f2eccb648126" } modify_external_catalogs: true
W20260923 19:50:27.373648 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea8e40f321be4c45a3c164ebe2ea00ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:27.375875 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 5c59810dd9624169bc238b294528714d (DEFAULT_TABLE table=default.Table_1f8e940ac02f48ba9e237174993f1d39 [id=d05fb33b89014bd1857f7e1ec0fd320b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.375946 6318 tablet_service.cc:1511] Processing CreateTablet for tablet f2fdbf6a44a14af6b81148739da031e0 (DEFAULT_TABLE table=default.Table_6fc69ab2bb434352a8fcbc74f9c5e834 [id=9ac38a08779742eab20f3f7e23f714f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.376219 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c59810dd9624169bc238b294528714d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.376338 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 26031fe469d046518cdd0f1e955e19d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:27 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:27.376729 6319 tablet_service.cc:1511] Processing CreateTablet for tablet f6103c44f565461cbcdcadbc0ebe8afe (DEFAULT_TABLE table=default.Table_dfc9cd82388c498dbce4dc8323ecae0f [id=565c9995f5ff4663b7af8b0380c1d70f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.377146 6309 tablet_service.cc:1511] Processing CreateTablet for tablet dcfdc9d49ef6431ca8cc94871804db54 (DEFAULT_TABLE table=default.Table_40dd60ae71f44479bc10a5902a6caaf4 [id=47dc6f9db7ca4dbfa3a0c9bd3dd3bf61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.377420 6318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2fdbf6a44a14af6b81148739da031e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.378217 6319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6103c44f565461cbcdcadbc0ebe8afe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.382125 6314 tablet_service.cc:1511] Processing CreateTablet for tablet 12fb5f38a53c434181706464612098c7 (DEFAULT_TABLE table=default.Table_a1f26054fea64d8eb5fd4efcaa6dfe71 [id=68e916f0d67845fb9171ae6e0fa3766b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.382216 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 99eaafaaaf3b49889a13b15874e5ec01 (DEFAULT_TABLE table=default.Table_6bc6a20a521a49f29589c5744e98afb7 [id=f4deac5b46804d86bbf7533762469057]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.381836 6321 tablet_service.cc:1511] Processing CreateTablet for tablet 87ef913b03c64e34a8798b060b4dd5e6 (DEFAULT_TABLE table=default.Table_4852b972dc1c4e23aa9be5e1af56e3ae [id=eaac0b0968004e4ebc8e1c293eba301a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.382964 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99eaafaaaf3b49889a13b15874e5ec01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.383599 6309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcfdc9d49ef6431ca8cc94871804db54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.385272 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ef913b03c64e34a8798b060b4dd5e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.386049 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12fb5f38a53c434181706464612098c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.386710 5804 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ceb8ad1770064991add54f6cc371d9fc" } modify_external_catalogs: true
I20260923 19:50:27.386860 5804 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_ceb8ad1770064991add54f6cc371d9fc" } modify_external_catalogs: true
I20260923 19:50:27.389688 6025 tablet_service.cc:1511] Processing CreateTablet for tablet f2fdbf6a44a14af6b81148739da031e0 (DEFAULT_TABLE table=default.Table_6fc69ab2bb434352a8fcbc74f9c5e834 [id=9ac38a08779742eab20f3f7e23f714f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.390889 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 907bfabdc1f948d4872363b44bea154a (DEFAULT_TABLE table=default.Table_004d451550a547c3b795d2d6b2d32234 [id=9ebc65fc6d9e4f2a83ba24a53fd6b904]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.391196 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 907bfabdc1f948d4872363b44bea154a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.391682 6021 tablet_service.cc:1558] Processing DeleteTablet for tablet 26031fe469d046518cdd0f1e955e19d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:27 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:27.392017 6036 tablet_service.cc:1511] Processing CreateTablet for tablet 87ef913b03c64e34a8798b060b4dd5e6 (DEFAULT_TABLE table=default.Table_4852b972dc1c4e23aa9be5e1af56e3ae [id=eaac0b0968004e4ebc8e1c293eba301a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.392462 6023 tablet_service.cc:1511] Processing CreateTablet for tablet f6103c44f565461cbcdcadbc0ebe8afe (DEFAULT_TABLE table=default.Table_dfc9cd82388c498dbce4dc8323ecae0f [id=565c9995f5ff4663b7af8b0380c1d70f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.392815 6029 tablet_service.cc:1511] Processing CreateTablet for tablet dcfdc9d49ef6431ca8cc94871804db54 (DEFAULT_TABLE table=default.Table_40dd60ae71f44479bc10a5902a6caaf4 [id=47dc6f9db7ca4dbfa3a0c9bd3dd3bf61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.393181 6031 tablet_service.cc:1511] Processing CreateTablet for tablet 12fb5f38a53c434181706464612098c7 (DEFAULT_TABLE table=default.Table_a1f26054fea64d8eb5fd4efcaa6dfe71 [id=68e916f0d67845fb9171ae6e0fa3766b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.393839 6037 tablet_service.cc:1511] Processing CreateTablet for tablet 15808aeaa3824f36b846fb029bfd3c0d (DEFAULT_TABLE table=default.Table_5fee98fd4cb34aa0884ba94908c94cd7 [id=6f5c84e854174996a02b180c24bf2fc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.397090 7986 raft_consensus.cc:493] T 8d20b59aa99f49f0b2f4d7dd861470f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:27.398053 7986 raft_consensus.cc:515] T 8d20b59aa99f49f0b2f4d7dd861470f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.398662 7986 leader_election.cc:290] T 8d20b59aa99f49f0b2f4d7dd861470f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:27.398797 5802 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet f1c1d4f73488499a9e5add81e9d5e2d6 (table default.Table_7f7907c8e1bc4ad1ae68faf5f072b318 [id=80e3a84f7199464fa96426daeeeb84cd]). Expected version 2 got 0
I20260923 19:50:27.398988 5802 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 397ec5e49673406cb26a2efab0ad8401 (table default.Table_92f3bea4e4164a738fb75f01e95cd776 [id=0b80967a8fb94518ad872fbce9bae934]). Expected version 1 got 0
I20260923 19:50:27.401314 6030 tablet_service.cc:1511] Processing CreateTablet for tablet 99eaafaaaf3b49889a13b15874e5ec01 (DEFAULT_TABLE table=default.Table_6bc6a20a521a49f29589c5744e98afb7 [id=f4deac5b46804d86bbf7533762469057]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.402149 6024 tablet_service.cc:1511] Processing CreateTablet for tablet 5c59810dd9624169bc238b294528714d (DEFAULT_TABLE table=default.Table_1f8e940ac02f48ba9e237174993f1d39 [id=d05fb33b89014bd1857f7e1ec0fd320b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.404176 6035 tablet_service.cc:1511] Processing CreateTablet for tablet 8cc885d26d974b81a42f03e07c4124eb (DEFAULT_TABLE table=default.Table_1379f8f7241b4c5ea7cfa490eb67f895 [id=e32925c35de7401a9d7c93525afdd005]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.406021 6021 tablet_service.cc:1511] Processing CreateTablet for tablet 907bfabdc1f948d4872363b44bea154a (DEFAULT_TABLE table=default.Table_004d451550a547c3b795d2d6b2d32234 [id=9ebc65fc6d9e4f2a83ba24a53fd6b904]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.409473 6027 tablet_service.cc:1511] Processing CreateTablet for tablet b4f6b19ec93b4342885f27fc24ea7b18 (DEFAULT_TABLE table=default.Table_4184b49cb50842f3bef045f918a6d9ec [id=adf2280ef413437db6ed4e2bda4542ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.410210 5802 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet f28da30d48454ffd9626df789a2f2063 (table default.Table_4c7beeb130604565858c166a2b4c4c53 [id=e319867d5e9c46c79d9f5a564faec3e9]). Expected version 1 got 0
I20260923 19:50:27.410447 6039 tablet_service.cc:1511] Processing CreateTablet for tablet 4794444caf0d4addb2ec1ca472dfd4cf (DEFAULT_TABLE table=default.Table_be41f102974644f7b7a95b121e9256bb [id=3934a716d6564029b9d309b31d453f0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.411010 6026 tablet_service.cc:1511] Processing CreateTablet for tablet 8e1cb59cd87a4f33b620a12afd91f1f6 (DEFAULT_TABLE table=default.Table_b092625690f34a428ea3f3ac1de4b634 [id=65cec611bdc745a59ab667c6185a79cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.412272 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d20b59aa99f49f0b2f4d7dd861470f8" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:27.412272 6310 tablet_service.cc:1511] Processing CreateTablet for tablet 8e1cb59cd87a4f33b620a12afd91f1f6 (DEFAULT_TABLE table=default.Table_b092625690f34a428ea3f3ac1de4b634 [id=65cec611bdc745a59ab667c6185a79cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.412499 6340 raft_consensus.cc:2468] T 8d20b59aa99f49f0b2f4d7dd861470f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 0.
I20260923 19:50:27.412781 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e1cb59cd87a4f33b620a12afd91f1f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.412858 6318 tablet_service.cc:1511] Processing CreateTablet for tablet b4f6b19ec93b4342885f27fc24ea7b18 (DEFAULT_TABLE table=default.Table_4184b49cb50842f3bef045f918a6d9ec [id=adf2280ef413437db6ed4e2bda4542ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.413159 6318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4f6b19ec93b4342885f27fc24ea7b18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.413753 5996 leader_election.cc:304] T 8d20b59aa99f49f0b2f4d7dd861470f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:27.414110 7986 raft_consensus.cc:2804] T 8d20b59aa99f49f0b2f4d7dd861470f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:27.414183 7986 raft_consensus.cc:493] T 8d20b59aa99f49f0b2f4d7dd861470f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:27.414242 7986 raft_consensus.cc:3060] T 8d20b59aa99f49f0b2f4d7dd861470f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:27.414712 6022 tablet_service.cc:1511] Processing CreateTablet for tablet d8504451f57b47948a0e82e0d3a300bc (DEFAULT_TABLE table=default.Table_d754487fb38a4e219f51df72bb4c51a2 [id=3baed95ef2834115ad27368073a0a7cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.417678 7986 raft_consensus.cc:515] T 8d20b59aa99f49f0b2f4d7dd861470f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.418911 7986 leader_election.cc:290] T 8d20b59aa99f49f0b2f4d7dd861470f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:27.419692 6033 tablet_service.cc:1511] Processing CreateTablet for tablet 2876a0d5d47b47c1ab916c490a8e742b (DEFAULT_TABLE table=default.Table_c2ddf35711544d0ba111ea8960ab6b2c [id=53cf9aabd5c2436a983c70412ec85e84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.356921 6456 tablet_bootstrap.cc:654] T a263c0fc71424999b76ef01de9a51eda P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:27.421960 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d20b59aa99f49f0b2f4d7dd861470f8" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:27.422125 6340 raft_consensus.cc:3060] T 8d20b59aa99f49f0b2f4d7dd861470f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:27.422533 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 736e950d491d4d14876a83adf235291e (DEFAULT_TABLE table=default.Table_4c9e6740f40f4215b262e03b14ab9725 [id=66592d16fe6a451e893069adfab2ac44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.422618 6321 tablet_service.cc:1511] Processing CreateTablet for tablet d8504451f57b47948a0e82e0d3a300bc (DEFAULT_TABLE table=default.Table_d754487fb38a4e219f51df72bb4c51a2 [id=3baed95ef2834115ad27368073a0a7cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.422850 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 736e950d491d4d14876a83adf235291e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.423051 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8504451f57b47948a0e82e0d3a300bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.424993 6340 raft_consensus.cc:2468] T 8d20b59aa99f49f0b2f4d7dd861470f8 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 1.
I20260923 19:50:27.427472 5996 leader_election.cc:304] T 8d20b59aa99f49f0b2f4d7dd861470f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:27.427657 6309 tablet_service.cc:1511] Processing CreateTablet for tablet 2876a0d5d47b47c1ab916c490a8e742b (DEFAULT_TABLE table=default.Table_c2ddf35711544d0ba111ea8960ab6b2c [id=53cf9aabd5c2436a983c70412ec85e84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.427814 7986 raft_consensus.cc:2804] T 8d20b59aa99f49f0b2f4d7dd861470f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:27.428061 6309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2876a0d5d47b47c1ab916c490a8e742b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.430959 6038 tablet_service.cc:1511] Processing CreateTablet for tablet 736e950d491d4d14876a83adf235291e (DEFAULT_TABLE table=default.Table_4c9e6740f40f4215b262e03b14ab9725 [id=66592d16fe6a451e893069adfab2ac44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.432749 6318 tablet_service.cc:1511] Processing CreateTablet for tablet a104e29d88d5447791083d6333c619c4 (DEFAULT_TABLE table=default.Table_7fbd7ade12984bd0aebf88ec53834f2a [id=ddc45ceb16a44f9cba255dcac352a225]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.433132 6318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a104e29d88d5447791083d6333c619c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.434571 6456 tablet_bootstrap.cc:492] T a263c0fc71424999b76ef01de9a51eda P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:27.434757 6456 ts_tablet_manager.cc:1403] T a263c0fc71424999b76ef01de9a51eda P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.080s user 0.003s sys 0.000s
I20260923 19:50:27.435679 6456 raft_consensus.cc:359] T a263c0fc71424999b76ef01de9a51eda P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.435931 6456 raft_consensus.cc:385] T a263c0fc71424999b76ef01de9a51eda P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:27.436025 6456 raft_consensus.cc:740] T a263c0fc71424999b76ef01de9a51eda P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:27.436256 6456 consensus_queue.cc:260] T a263c0fc71424999b76ef01de9a51eda P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.436832 6456 ts_tablet_manager.cc:1434] T a263c0fc71424999b76ef01de9a51eda P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:50:27.437125 6456 tablet_bootstrap.cc:492] T 3c713a0973dc45debf61c228a4bf13bf P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:27.438108 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 8cc885d26d974b81a42f03e07c4124eb (DEFAULT_TABLE table=default.Table_1379f8f7241b4c5ea7cfa490eb67f895 [id=e32925c35de7401a9d7c93525afdd005]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.438504 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cc885d26d974b81a42f03e07c4124eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.438442 6032 tablet_service.cc:1511] Processing CreateTablet for tablet a104e29d88d5447791083d6333c619c4 (DEFAULT_TABLE table=default.Table_7fbd7ade12984bd0aebf88ec53834f2a [id=ddc45ceb16a44f9cba255dcac352a225]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.438740 6456 tablet_bootstrap.cc:654] T 3c713a0973dc45debf61c228a4bf13bf P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:27.446954 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 4e288e1ed48841fcb2b8b66cc3ebbfdb (DEFAULT_TABLE table=default.Table_04b0ab0ec24340b99b95fb612c1777d3 [id=abdec369157f42a48c6a4e8a75ef8623]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.447669 6312 tablet_service.cc:1511] Processing CreateTablet for tablet 15808aeaa3824f36b846fb029bfd3c0d (DEFAULT_TABLE table=default.Table_5fee98fd4cb34aa0884ba94908c94cd7 [id=6f5c84e854174996a02b180c24bf2fc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.448144 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15808aeaa3824f36b846fb029bfd3c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.448468 6321 tablet_service.cc:1511] Processing CreateTablet for tablet 9528fc50153c4201b2104d27fcbec30f (DEFAULT_TABLE table=default.Table_e0736cdef737400fa4898092eeeb3e4b [id=db9eae431a8a4855a5466e6ddb50749f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.448849 6321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9528fc50153c4201b2104d27fcbec30f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.450425 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 29addbd80f5a4794a487395d9211c489 (DEFAULT_TABLE table=default.Table_457fa8ba5f1949e7848c379d53d2766c [id=38b85a886c1346a98f4baf19821bdbc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.451578 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29addbd80f5a4794a487395d9211c489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.454849 6310 tablet_service.cc:1511] Processing CreateTablet for tablet c71f3bc197f7415aa435267fa6b24746 (DEFAULT_TABLE table=default.Table_85cafca5571245479b8547e0b5a6cf47 [id=743db923b9b44098bc29f8bc32e9b19e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.456513 6319 tablet_service.cc:1511] Processing CreateTablet for tablet 7022dcff773b4caaba5a6b814d43f549 (DEFAULT_TABLE table=default.Table_d80fb2325f854ac8a9afc787c585e370 [id=c9088b12d9e14d10a6da3d5d8d0e25bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.459815 6456 tablet_bootstrap.cc:492] T 3c713a0973dc45debf61c228a4bf13bf P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:27.460011 6456 ts_tablet_manager.cc:1403] T 3c713a0973dc45debf61c228a4bf13bf P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.000s
I20260923 19:50:27.460808 6456 raft_consensus.cc:359] T 3c713a0973dc45debf61c228a4bf13bf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.461019 6456 raft_consensus.cc:385] T 3c713a0973dc45debf61c228a4bf13bf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:27.461109 6456 raft_consensus.cc:740] T 3c713a0973dc45debf61c228a4bf13bf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:27.461347 6456 consensus_queue.cc:260] T 3c713a0973dc45debf61c228a4bf13bf P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.462709 6456 ts_tablet_manager.cc:1434] T 3c713a0973dc45debf61c228a4bf13bf P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260923 19:50:27.465304 6310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c71f3bc197f7415aa435267fa6b24746. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.468755 6317 tablet_service.cc:1511] Processing CreateTablet for tablet 2d1ed91cfd5f4d1eb1ea75fa6183141a (DEFAULT_TABLE table=default.Table_1e9ebf5c3c644666a5b6c1966fde4ed5 [id=5f2289c487ba40b9b7954c9d56918687]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.469676 6319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7022dcff773b4caaba5a6b814d43f549. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.473110 6314 tablet_service.cc:1511] Processing CreateTablet for tablet ef8849c36a5d4810aac0eec98d821e1c (DEFAULT_TABLE table=default.Table_830b1cf0708140b1b9c6e118deee0df6 [id=bfd016799ea548a19d82ebdcaec600b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.473397 6457 tablet_bootstrap.cc:492] T d5d3f96ebf1c4d05aceb06ef53737e4f P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:27.473529 6457 ts_tablet_manager.cc:1403] T d5d3f96ebf1c4d05aceb06ef53737e4f P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.332s user 0.003s sys 0.003s
I20260923 19:50:27.473588 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef8849c36a5d4810aac0eec98d821e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.474278 6457 raft_consensus.cc:359] T d5d3f96ebf1c4d05aceb06ef53737e4f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:27.474429 6457 raft_consensus.cc:385] T d5d3f96ebf1c4d05aceb06ef53737e4f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:27.474476 6457 raft_consensus.cc:740] T d5d3f96ebf1c4d05aceb06ef53737e4f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:27.474678 6457 consensus_queue.cc:260] T d5d3f96ebf1c4d05aceb06ef53737e4f P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:27.271944 8046 tablet.cc:1751] T f1f1df47dc32413d9cc9456f4198dca5 P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:27.283784 8047 tablet.cc:1751] T 26031fe469d046518cdd0f1e955e19d1 P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:27.294041 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28da30d48454ffd9626df789a2f2063" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:27.300041 7980 raft_consensus.cc:493] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260923 19:50:27.476087 5995 leader_election.cc:343] T f28da30d48454ffd9626df789a2f2063 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:27.476197 5995 leader_election.cc:304] T f28da30d48454ffd9626df789a2f2063 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:27.476140 7980 raft_consensus.cc:515] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:27.476892 7980 leader_election.cc:290] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:27.477043 7980 raft_consensus.cc:493] T 86388fa08c454da9ad2ca0124dcba10b P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bf41435f70447f19992d368ca6b46bd)
I20260923 19:50:27.477175 7980 raft_consensus.cc:515] T 86388fa08c454da9ad2ca0124dcba10b P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:27.477810 7980 leader_election.cc:290] T 86388fa08c454da9ad2ca0124dcba10b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:27.483023 6459 ts_tablet_manager.cc:1950] T 1b1d9413e1e24547b491a160d851377b P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:27.483311 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1072) took 3600 ms. Trace:
I20260923 19:50:27.483385 6459 rpcz_store.cc:276] 0923 19:50:23.883020 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:23.883073 (+ 53us) service_pool.cc:224] Handling call
0923 19:50:26.914154 (+3031081us) ts_tablet_manager.cc:1151] Deleting tablet 1b1d9413e1e24547b491a160d851377b
0923 19:50:26.914162 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:27.215557 (+301395us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:27.251717 (+ 36160us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:27.483296 (+231579us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3030889}
I20260923 19:50:27.483723 6459 tablet_replica.cc:333] T b9c187ee1fa8438397c83bc2c2b16925 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:27.483883 6459 raft_consensus.cc:2243] T b9c187ee1fa8438397c83bc2c2b16925 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:27.484019 6459 raft_consensus.cc:2272] T b9c187ee1fa8438397c83bc2c2b16925 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:27.484485 6459 ts_tablet_manager.cc:1916] T b9c187ee1fa8438397c83bc2c2b16925 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:27.485538 8056 raft_consensus.cc:2749] T f28da30d48454ffd9626df789a2f2063 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:27.487097 6137 leader_election.cc:343] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: f74e7cb3e5f54dfdb2280c795ce2ce53
W20260923 19:50:27.487295 6137 leader_election.cc:343] T 86388fa08c454da9ad2ca0124dcba10b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 86388fa08c454da9ad2ca0124dcba10b
W20260923 19:50:27.487320 6139 leader_election.cc:343] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: f74e7cb3e5f54dfdb2280c795ce2ce53
I20260923 19:50:27.487461 6458 ts_tablet_manager.cc:1929] T 2e1c19a751904a6295897376e9c5ee56 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:27.487457 6139 leader_election.cc:304] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:27.487563 6458 log.cc:1199] T 2e1c19a751904a6295897376e9c5ee56 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/2e1c19a751904a6295897376e9c5ee56
I20260923 19:50:27.487879 6458 ts_tablet_manager.cc:1950] T 2e1c19a751904a6295897376e9c5ee56 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
W20260923 19:50:27.487881 6139 leader_election.cc:343] T 86388fa08c454da9ad2ca0124dcba10b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 86388fa08c454da9ad2ca0124dcba10b
I20260923 19:50:27.488003 6139 leader_election.cc:304] T 86388fa08c454da9ad2ca0124dcba10b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:27.300467 6454 tablet_bootstrap.cc:492] T 21bf33904ede470b80a074dc9a458baf P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:27.488431 6454 ts_tablet_manager.cc:1403] T 21bf33904ede470b80a074dc9a458baf P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.327s user 0.002s sys 0.010s
I20260923 19:50:27.338860 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688bb1055ba94c2996cdfea6dea76416" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:27.342219 8019 raft_consensus.cc:493] T 670d9cb0e6e2414092f72ffd5e6b00ea P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:27.374543 6174 tablet_service.cc:1511] Processing CreateTablet for tablet 4e288e1ed48841fcb2b8b66cc3ebbfdb (DEFAULT_TABLE table=default.Table_04b0ab0ec24340b99b95fb612c1777d3 [id=abdec369157f42a48c6a4e8a75ef8623]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.488865 6174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e288e1ed48841fcb2b8b66cc3ebbfdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.488678 8019 raft_consensus.cc:515] T 670d9cb0e6e2414092f72ffd5e6b00ea P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.489190 6454 raft_consensus.cc:359] T 21bf33904ede470b80a074dc9a458baf P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.489333 6454 raft_consensus.cc:385] T 21bf33904ede470b80a074dc9a458baf P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:27.489404 6454 raft_consensus.cc:740] T 21bf33904ede470b80a074dc9a458baf P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:27.489585 6454 consensus_queue.cc:260] T 21bf33904ede470b80a074dc9a458baf P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.489699 8019 leader_election.cc:290] T 670d9cb0e6e2414092f72ffd5e6b00ea P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:27.374606 6167 tablet_service.cc:1511] Processing CreateTablet for tablet 5c59810dd9624169bc238b294528714d (DEFAULT_TABLE table=default.Table_1f8e940ac02f48ba9e237174993f1d39 [id=d05fb33b89014bd1857f7e1ec0fd320b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.489913 8019 raft_consensus.cc:2749] T f74e7cb3e5f54dfdb2280c795ce2ce53 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:27.490069 8019 raft_consensus.cc:2749] T 86388fa08c454da9ad2ca0124dcba10b P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 19:50:27.490115 6167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c59810dd9624169bc238b294528714d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.490907 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1204) took 1140 ms. Trace:
W20260923 19:50:27.491042 6139 leader_election.cc:343] T 670d9cb0e6e2414092f72ffd5e6b00ea P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 670d9cb0e6e2414092f72ffd5e6b00ea
I20260923 19:50:27.374869 6171 tablet_service.cc:1511] Processing CreateTablet for tablet 4794444caf0d4addb2ec1ca472dfd4cf (DEFAULT_TABLE table=default.Table_be41f102974644f7b7a95b121e9256bb [id=3934a716d6564029b9d309b31d453f0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.494166 6171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4794444caf0d4addb2ec1ca472dfd4cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.375041 6170 tablet_service.cc:1558] Processing DeleteTablet for tablet 26031fe469d046518cdd0f1e955e19d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:27 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:27.498215 6170 tablet_service.cc:1511] Processing CreateTablet for tablet 9528fc50153c4201b2104d27fcbec30f (DEFAULT_TABLE table=default.Table_e0736cdef737400fa4898092eeeb3e4b [id=db9eae431a8a4855a5466e6ddb50749f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.498603 6170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9528fc50153c4201b2104d27fcbec30f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.375255 6172 tablet_service.cc:1511] Processing CreateTablet for tablet f2fdbf6a44a14af6b81148739da031e0 (DEFAULT_TABLE table=default.Table_6fc69ab2bb434352a8fcbc74f9c5e834 [id=9ac38a08779742eab20f3f7e23f714f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.502184 6172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2fdbf6a44a14af6b81148739da031e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.375296 6173 tablet_service.cc:1511] Processing CreateTablet for tablet f6103c44f565461cbcdcadbc0ebe8afe (DEFAULT_TABLE table=default.Table_dfc9cd82388c498dbce4dc8323ecae0f [id=565c9995f5ff4663b7af8b0380c1d70f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.506125 6173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6103c44f565461cbcdcadbc0ebe8afe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.375589 6176 tablet_service.cc:1511] Processing CreateTablet for tablet 87ef913b03c64e34a8798b060b4dd5e6 (DEFAULT_TABLE table=default.Table_4852b972dc1c4e23aa9be5e1af56e3ae [id=eaac0b0968004e4ebc8e1c293eba301a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.509351 6176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ef913b03c64e34a8798b060b4dd5e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.401090 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d20b59aa99f49f0b2f4d7dd861470f8" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:27.401784 6180 tablet_service.cc:1511] Processing CreateTablet for tablet 15808aeaa3824f36b846fb029bfd3c0d (DEFAULT_TABLE table=default.Table_5fee98fd4cb34aa0884ba94908c94cd7 [id=6f5c84e854174996a02b180c24bf2fc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.401101 6181 tablet_service.cc:1511] Processing CreateTablet for tablet 99eaafaaaf3b49889a13b15874e5ec01 (DEFAULT_TABLE table=default.Table_6bc6a20a521a49f29589c5744e98afb7 [id=f4deac5b46804d86bbf7533762469057]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.512727 6180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15808aeaa3824f36b846fb029bfd3c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.512913 6181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99eaafaaaf3b49889a13b15874e5ec01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.402575 6179 tablet_service.cc:1511] Processing CreateTablet for tablet 12fb5f38a53c434181706464612098c7 (DEFAULT_TABLE table=default.Table_a1f26054fea64d8eb5fd4efcaa6dfe71 [id=68e916f0d67845fb9171ae6e0fa3766b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.513240 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12fb5f38a53c434181706464612098c7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:27.513605 6137 leader_election.cc:343] T 670d9cb0e6e2414092f72ffd5e6b00ea P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 670d9cb0e6e2414092f72ffd5e6b00ea
I20260923 19:50:27.513716 6137 leader_election.cc:304] T 670d9cb0e6e2414092f72ffd5e6b00ea P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:27.516866 8056 raft_consensus.cc:493] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:27.517012 8056 raft_consensus.cc:515] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.517625 8056 leader_election.cc:290] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:27.402874 6166 tablet_service.cc:1511] Processing CreateTablet for tablet dcfdc9d49ef6431ca8cc94871804db54 (DEFAULT_TABLE table=default.Table_40dd60ae71f44479bc10a5902a6caaf4 [id=47dc6f9db7ca4dbfa3a0c9bd3dd3bf61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.403151 6182 tablet_service.cc:1511] Processing CreateTablet for tablet 907bfabdc1f948d4872363b44bea154a (DEFAULT_TABLE table=default.Table_004d451550a547c3b795d2d6b2d32234 [id=9ebc65fc6d9e4f2a83ba24a53fd6b904]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.404800 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 8cc885d26d974b81a42f03e07c4124eb (DEFAULT_TABLE table=default.Table_1379f8f7241b4c5ea7cfa490eb67f895 [id=e32925c35de7401a9d7c93525afdd005]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.410072 6178 tablet_service.cc:1511] Processing CreateTablet for tablet b4f6b19ec93b4342885f27fc24ea7b18 (DEFAULT_TABLE table=default.Table_4184b49cb50842f3bef045f918a6d9ec [id=adf2280ef413437db6ed4e2bda4542ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.411590 6168 tablet_service.cc:1511] Processing CreateTablet for tablet 8e1cb59cd87a4f33b620a12afd91f1f6 (DEFAULT_TABLE table=default.Table_b092625690f34a428ea3f3ac1de4b634 [id=65cec611bdc745a59ab667c6185a79cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.415437 6177 tablet_service.cc:1511] Processing CreateTablet for tablet d8504451f57b47948a0e82e0d3a300bc (DEFAULT_TABLE table=default.Table_d754487fb38a4e219f51df72bb4c51a2 [id=3baed95ef2834115ad27368073a0a7cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.522017 6036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ef913b03c64e34a8798b060b4dd5e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.418653 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d20b59aa99f49f0b2f4d7dd861470f8" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:27.522208 6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99eaafaaaf3b49889a13b15874e5ec01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.420421 6164 tablet_service.cc:1511] Processing CreateTablet for tablet 2876a0d5d47b47c1ab916c490a8e742b (DEFAULT_TABLE table=default.Table_c2ddf35711544d0ba111ea8960ab6b2c [id=53cf9aabd5c2436a983c70412ec85e84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.522404 6023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6103c44f565461cbcdcadbc0ebe8afe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.431663 6175 tablet_service.cc:1511] Processing CreateTablet for tablet 736e950d491d4d14876a83adf235291e (DEFAULT_TABLE table=default.Table_4c9e6740f40f4215b262e03b14ab9725 [id=66592d16fe6a451e893069adfab2ac44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.440074 6169 tablet_service.cc:1511] Processing CreateTablet for tablet a104e29d88d5447791083d6333c619c4 (DEFAULT_TABLE table=default.Table_7fbd7ade12984bd0aebf88ec53834f2a [id=ddc45ceb16a44f9cba255dcac352a225]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.522584 6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a104e29d88d5447791083d6333c619c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.522768 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8504451f57b47948a0e82e0d3a300bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.447535 6165 tablet_service.cc:1511] Processing CreateTablet for tablet 29addbd80f5a4794a487395d9211c489 (DEFAULT_TABLE table=default.Table_457fa8ba5f1949e7848c379d53d2766c [id=38b85a886c1346a98f4baf19821bdbc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.522933 6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 907bfabdc1f948d4872363b44bea154a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.523300 6028 tablet_service.cc:1511] Processing CreateTablet for tablet 9528fc50153c4201b2104d27fcbec30f (DEFAULT_TABLE table=default.Table_e0736cdef737400fa4898092eeeb3e4b [id=db9eae431a8a4855a5466e6ddb50749f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.525302 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4794444caf0d4addb2ec1ca472dfd4cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.525529 6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2fdbf6a44a14af6b81148739da031e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.526214 8059 raft_consensus.cc:2749] T 670d9cb0e6e2414092f72ffd5e6b00ea P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:27.526867 6454 ts_tablet_manager.cc:1434] T 21bf33904ede470b80a074dc9a458baf P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.038s user 0.001s sys 0.006s
I20260923 19:50:27.529960 6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12fb5f38a53c434181706464612098c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.530167 6033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2876a0d5d47b47c1ab916c490a8e742b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.530566 6454 tablet_bootstrap.cc:492] T f8052b05169b4673b387ac8b716ffc4e P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:27.533986 6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcfdc9d49ef6431ca8cc94871804db54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.534178 6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e1cb59cd87a4f33b620a12afd91f1f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.537994 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cc885d26d974b81a42f03e07c4124eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.538579 6038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 736e950d491d4d14876a83adf235291e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.542140 6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4f6b19ec93b4342885f27fc24ea7b18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.545982 6024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c59810dd9624169bc238b294528714d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.548961 6037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15808aeaa3824f36b846fb029bfd3c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.549458 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e288e1ed48841fcb2b8b66cc3ebbfdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.549702 6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9528fc50153c4201b2104d27fcbec30f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.553254 6170 tablet_service.cc:1511] Processing CreateTablet for tablet c71f3bc197f7415aa435267fa6b24746 (DEFAULT_TABLE table=default.Table_85cafca5571245479b8547e0b5a6cf47 [id=743db923b9b44098bc29f8bc32e9b19e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.522226 6040 tablet_service.cc:1511] Processing CreateTablet for tablet 29addbd80f5a4794a487395d9211c489 (DEFAULT_TABLE table=default.Table_457fa8ba5f1949e7848c379d53d2766c [id=38b85a886c1346a98f4baf19821bdbc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.564886 6182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 907bfabdc1f948d4872363b44bea154a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.565099 6177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8504451f57b47948a0e82e0d3a300bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.565271 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4f6b19ec93b4342885f27fc24ea7b18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.565440 6165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29addbd80f5a4794a487395d9211c489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.565613 6164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2876a0d5d47b47c1ab916c490a8e742b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.565860 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcfdc9d49ef6431ca8cc94871804db54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.569675 6179 tablet_service.cc:1511] Processing CreateTablet for tablet 7022dcff773b4caaba5a6b814d43f549 (DEFAULT_TABLE table=default.Table_d80fb2325f854ac8a9afc787c585e370 [id=c9088b12d9e14d10a6da3d5d8d0e25bc]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:27.570236 5995 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 94157us
I20260923 19:50:27.571036 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bbd8fcc5ea1431ab9e4fadb7d52269e" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:27.571636 6022 tablet_service.cc:1511] Processing CreateTablet for tablet c71f3bc197f7415aa435267fa6b24746 (DEFAULT_TABLE table=default.Table_85cafca5571245479b8547e0b5a6cf47 [id=743db923b9b44098bc29f8bc32e9b19e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:27.572822 5995 leader_election.cc:343] T 8d20b59aa99f49f0b2f4d7dd861470f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:27.573319 5995 leader_election.cc:343] T 8d20b59aa99f49f0b2f4d7dd861470f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:27.573724 5995 leader_election.cc:343] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:27.578106 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c71f3bc197f7415aa435267fa6b24746. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.578367 6039 tablet_service.cc:1511] Processing CreateTablet for tablet 7022dcff773b4caaba5a6b814d43f549 (DEFAULT_TABLE table=default.Table_d80fb2325f854ac8a9afc787c585e370 [id=c9088b12d9e14d10a6da3d5d8d0e25bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.578768 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7022dcff773b4caaba5a6b814d43f549. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.579349 6023 tablet_service.cc:1511] Processing CreateTablet for tablet 2d1ed91cfd5f4d1eb1ea75fa6183141a (DEFAULT_TABLE table=default.Table_1e9ebf5c3c644666a5b6c1966fde4ed5 [id=5f2289c487ba40b9b7954c9d56918687]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.579728 6023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d1ed91cfd5f4d1eb1ea75fa6183141a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.581270 6035 tablet_service.cc:1511] Processing CreateTablet for tablet ef8849c36a5d4810aac0eec98d821e1c (DEFAULT_TABLE table=default.Table_830b1cf0708140b1b9c6e118deee0df6 [id=bfd016799ea548a19d82ebdcaec600b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.581676 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef8849c36a5d4810aac0eec98d821e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.583992 6040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29addbd80f5a4794a487395d9211c489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.568678 6172 tablet_service.cc:1511] Processing CreateTablet for tablet 2d1ed91cfd5f4d1eb1ea75fa6183141a (DEFAULT_TABLE table=default.Table_1e9ebf5c3c644666a5b6c1966fde4ed5 [id=5f2289c487ba40b9b7954c9d56918687]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.604954 6457 ts_tablet_manager.cc:1434] T d5d3f96ebf1c4d05aceb06ef53737e4f P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.131s user 0.002s sys 0.000s
I20260923 19:50:27.605365 6457 tablet_bootstrap.cc:492] T 4c6f9953649a43aa9a0edd78b7bd47a4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:27.606063 6454 tablet_bootstrap.cc:654] T f8052b05169b4673b387ac8b716ffc4e P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:27.618708 7986 raft_consensus.cc:697] T 8d20b59aa99f49f0b2f4d7dd861470f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Becoming Leader. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Running, Role: LEADER
I20260923 19:50:27.621346 7986 consensus_queue.cc:237] T 8d20b59aa99f49f0b2f4d7dd861470f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.659247 6457 tablet_bootstrap.cc:654] T 4c6f9953649a43aa9a0edd78b7bd47a4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:27.491283 8049 raft_consensus.cc:493] T cb11d6e082784ad98cfb5253dbb88707 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:27.660439 8049 raft_consensus.cc:515] T cb11d6e082784ad98cfb5253dbb88707 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.661152 8049 leader_election.cc:290] T cb11d6e082784ad98cfb5253dbb88707 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:27.491721 6280 leader_election.cc:343] T 688bb1055ba94c2996cdfea6dea76416 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:27.661341 6280 leader_election.cc:304] T 688bb1055ba94c2996cdfea6dea76416 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:27.661433 6461 ts_tablet_manager.cc:1929] T 9756a1f8e23a436bb7c19c8cba7bdc05 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:27.661537 6461 log.cc:1199] T 9756a1f8e23a436bb7c19c8cba7bdc05 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/9756a1f8e23a436bb7c19c8cba7bdc05
W20260923 19:50:27.661604 6280 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.194:35295, user_credentials={real_user=slave}} blocked reactor thread for 169887us
I20260923 19:50:27.661845 6461 ts_tablet_manager.cc:1950] T 9756a1f8e23a436bb7c19c8cba7bdc05 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:27.497725 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d1ed91cfd5f4d1eb1ea75fa6183141a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.663051 6461 tablet_replica.cc:333] T 85d35ebef3c24a2e89233dd900b63513 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:27.663260 6461 raft_consensus.cc:2243] T 85d35ebef3c24a2e89233dd900b63513 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:27.663575 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 9756a1f8e23a436bb7c19c8cba7bdc05 (table default.Table_5d0c2a71e15a41e9a3200d2f16a36e16 [id=b76b9d93e83c4d80aba61d3aebcca78d]) successfully deleted
W20260923 19:50:27.663971 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 20d299b0112b4eb4ae1b8cb266c69a11 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20d299b0112b4eb4ae1b8cb266c69a11 already in progress: creating tablet
W20260923 19:50:27.664355 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 11e0f1c645184da19ce11927e1d562c3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11e0f1c645184da19ce11927e1d562c3 already in progress: creating tablet
I20260923 19:50:27.666217 7826 raft_consensus.cc:2749] T 688bb1055ba94c2996cdfea6dea76416 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:27.666348 7826 raft_consensus.cc:493] T f4313a4d8a9c411fad593b05ad655fc4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:27.666442 7826 raft_consensus.cc:515] T f4313a4d8a9c411fad593b05ad655fc4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.666913 7826 leader_election.cc:290] T f4313a4d8a9c411fad593b05ad655fc4 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:27.668092 6279 leader_election.cc:343] T cb11d6e082784ad98cfb5253dbb88707 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: cb11d6e082784ad98cfb5253dbb88707
I20260923 19:50:27.670325 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4313a4d8a9c411fad593b05ad655fc4" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:27.670325 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb11d6e082784ad98cfb5253dbb88707" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:27.671285 6280 leader_election.cc:343] T f4313a4d8a9c411fad593b05ad655fc4 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:27.671489 6280 leader_election.cc:343] T cb11d6e082784ad98cfb5253dbb88707 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:27.671569 6280 leader_election.cc:304] T cb11d6e082784ad98cfb5253dbb88707 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:27.672083 6177 tablet_service.cc:1511] Processing CreateTablet for tablet ef8849c36a5d4810aac0eec98d821e1c (DEFAULT_TABLE table=default.Table_830b1cf0708140b1b9c6e118deee0df6 [id=bfd016799ea548a19d82ebdcaec600b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:27.672638 8049 raft_consensus.cc:2749] T cb11d6e082784ad98cfb5253dbb88707 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:27.672703 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 1b1d9413e1e24547b491a160d851377b (table default.Table_f1842456992c4765924d809a3a062c07 [id=361a67b795ad41bb829dffbf0cc7dcc5]) successfully deleted
I20260923 19:50:27.673749 8055 raft_consensus.cc:493] T 21bf33904ede470b80a074dc9a458baf P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:27.673941 8055 raft_consensus.cc:515] T 21bf33904ede470b80a074dc9a458baf P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
W20260923 19:50:27.674182 6279 leader_election.cc:343] T f4313a4d8a9c411fad593b05ad655fc4 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: f4313a4d8a9c411fad593b05ad655fc4
I20260923 19:50:27.674270 6279 leader_election.cc:304] T f4313a4d8a9c411fad593b05ad655fc4 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:27.674798 7826 raft_consensus.cc:2749] T f4313a4d8a9c411fad593b05ad655fc4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:27.498072 6456 tablet_bootstrap.cc:492] T ce6b86f947ce420994eaa5ff39ad9c87 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:27.574555 8050 consensus_queue.cc:1048] T 40adb472162042e48fdbb496b342996a P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:27.677265 5802 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_5c873b003c7b4b09ba69db7f039b2f98 [id=6d285eda96a948b2b14fa1ef456ca5b2] alter complete (version 2)
W20260923 19:50:27.680419 6280 consensus_peers.cc:597] T 40adb472162042e48fdbb496b342996a P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260923 19:50:27.682395 6137 leader_election.cc:343] T 21bf33904ede470b80a074dc9a458baf P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 21bf33904ede470b80a074dc9a458baf
I20260923 19:50:27.684824 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bbd8fcc5ea1431ab9e4fadb7d52269e" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:27.685802 6139 leader_election.cc:343] T 21bf33904ede470b80a074dc9a458baf P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 21bf33904ede470b80a074dc9a458baf
I20260923 19:50:27.685858 6457 tablet_bootstrap.cc:492] T 4c6f9953649a43aa9a0edd78b7bd47a4 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:27.685930 6139 leader_election.cc:304] T 21bf33904ede470b80a074dc9a458baf P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:27.686021 6457 ts_tablet_manager.cc:1403] T 4c6f9953649a43aa9a0edd78b7bd47a4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.081s user 0.001s sys 0.002s
I20260923 19:50:27.686194 7980 raft_consensus.cc:2749] T 21bf33904ede470b80a074dc9a458baf P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:27.686769 5996 leader_election.cc:343] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:27.686892 5996 leader_election.cc:304] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:27.687085 8053 raft_consensus.cc:2749] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:27.690291 6456 tablet_bootstrap.cc:654] T ce6b86f947ce420994eaa5ff39ad9c87 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:27.663425 6461 raft_consensus.cc:2272] T 85d35ebef3c24a2e89233dd900b63513 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:27.691409 6461 ts_tablet_manager.cc:1916] T 85d35ebef3c24a2e89233dd900b63513 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:27.692454 6454 tablet_bootstrap.cc:492] T f8052b05169b4673b387ac8b716ffc4e P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:27.692799 6454 ts_tablet_manager.cc:1403] T f8052b05169b4673b387ac8b716ffc4e P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.162s user 0.004s sys 0.017s
I20260923 19:50:27.693292 6457 raft_consensus.cc:359] T 4c6f9953649a43aa9a0edd78b7bd47a4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:27.694068 6457 raft_consensus.cc:385] T 4c6f9953649a43aa9a0edd78b7bd47a4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:27.694516 6457 raft_consensus.cc:740] T 4c6f9953649a43aa9a0edd78b7bd47a4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:27.660354 6458 rpcz_store.cc:276] 0923 19:50:26.350660 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:26.350743 (+ 83us) service_pool.cc:224] Handling call
0923 19:50:27.011878 (+661135us) ts_tablet_manager.cc:1151] Deleting tablet 2e1c19a751904a6295897376e9c5ee56
0923 19:50:27.011885 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:27.229008 (+217123us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:27.487409 (+258401us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:27.490882 (+ 3473us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":660676}
I20260923 19:50:27.696429 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 2e1c19a751904a6295897376e9c5ee56 (table default.Table_4761dd5028c84fd1beaa780170cbec4e [id=1b8502abd3df41d29e789b845fb0e984]) successfully deleted
I20260923 19:50:27.684785 8055 leader_election.cc:290] T 21bf33904ede470b80a074dc9a458baf P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:27.696642 6457 consensus_queue.cc:260] T 4c6f9953649a43aa9a0edd78b7bd47a4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:27.699856 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1203) took 1363 ms. Trace:
I20260923 19:50:27.700371 6458 rpcz_store.cc:276] 0923 19:50:26.336324 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:26.414366 (+ 78042us) service_pool.cc:224] Handling call
0923 19:50:27.696865 (+1282499us) ts_tablet_manager.cc:1151] Deleting tablet c9fe3ffc092a476fa0632581efc2fd6d
0923 19:50:27.699150 (+ 2285us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:27.699708 (+ 558us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1281416}
W20260923 19:50:27.702243 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet c9fe3ffc092a476fa0632581efc2fd6d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c9fe3ffc092a476fa0632581efc2fd6d already in progress: creating tablet
I20260923 19:50:27.703514 6458 tablet_replica.cc:333] T 02fa9052a7054659baf9b07b770bb538 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:27.705222 6458 raft_consensus.cc:2243] T 02fa9052a7054659baf9b07b770bb538 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:27.706185 6457 ts_tablet_manager.cc:1434] T 4c6f9953649a43aa9a0edd78b7bd47a4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.020s user 0.000s sys 0.003s
I20260923 19:50:27.706519 6457 tablet_bootstrap.cc:492] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:27.707639 6458 raft_consensus.cc:2272] T 02fa9052a7054659baf9b07b770bb538 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:27.708381 6457 tablet_bootstrap.cc:654] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:27.710193 6456 tablet_bootstrap.cc:492] T ce6b86f947ce420994eaa5ff39ad9c87 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:27.710582 6456 ts_tablet_manager.cc:1403] T ce6b86f947ce420994eaa5ff39ad9c87 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.213s user 0.005s sys 0.000s
I20260923 19:50:27.712538 6456 raft_consensus.cc:359] T ce6b86f947ce420994eaa5ff39ad9c87 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.713019 6456 raft_consensus.cc:385] T ce6b86f947ce420994eaa5ff39ad9c87 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:27.713245 6456 raft_consensus.cc:740] T ce6b86f947ce420994eaa5ff39ad9c87 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:27.714107 6456 consensus_queue.cc:260] T ce6b86f947ce420994eaa5ff39ad9c87 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.722386 6458 ts_tablet_manager.cc:1916] T 02fa9052a7054659baf9b07b770bb538 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:27.724283 6456 ts_tablet_manager.cc:1434] T ce6b86f947ce420994eaa5ff39ad9c87 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.013s user 0.003s sys 0.000s
I20260923 19:50:27.730161 6456 tablet_bootstrap.cc:492] T 9ee02922d2be45f5a1473a53a6f253c4 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:27.719967 6454 raft_consensus.cc:359] T f8052b05169b4673b387ac8b716ffc4e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.745296 6454 raft_consensus.cc:385] T f8052b05169b4673b387ac8b716ffc4e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:27.745510 6454 raft_consensus.cc:740] T f8052b05169b4673b387ac8b716ffc4e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:27.752121 7993 raft_consensus.cc:493] T ba0453ef529344dfbab1130daa985fef P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:27.752292 7993 raft_consensus.cc:515] T ba0453ef529344dfbab1130daa985fef P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.752964 7993 leader_election.cc:290] T ba0453ef529344dfbab1130daa985fef P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:27.753755 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba0453ef529344dfbab1130daa985fef" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:27.754830 6280 leader_election.cc:343] T ba0453ef529344dfbab1130daa985fef P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:27.757040 6456 tablet_bootstrap.cc:654] T 9ee02922d2be45f5a1473a53a6f253c4 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:27.781095 8055 raft_consensus.cc:493] T 64e8951eb899461aa9c0b36e3f7555e2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:27.781399 8055 raft_consensus.cc:515] T 64e8951eb899461aa9c0b36e3f7555e2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
W20260923 19:50:27.783707 6139 leader_election.cc:343] T 64e8951eb899461aa9c0b36e3f7555e2 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 64e8951eb899461aa9c0b36e3f7555e2
W20260923 19:50:27.784014 6137 leader_election.cc:343] T 64e8951eb899461aa9c0b36e3f7555e2 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 64e8951eb899461aa9c0b36e3f7555e2
I20260923 19:50:27.784121 6137 leader_election.cc:304] T 64e8951eb899461aa9c0b36e3f7555e2 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:27.784359 7980 raft_consensus.cc:2749] T 64e8951eb899461aa9c0b36e3f7555e2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:27.784848 6454 consensus_queue.cc:260] T f8052b05169b4673b387ac8b716ffc4e P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.786182 6454 ts_tablet_manager.cc:1434] T f8052b05169b4673b387ac8b716ffc4e P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.093s user 0.005s sys 0.000s
I20260923 19:50:27.793051 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet e8b0d0a8e4e54ec195893127f7a76bed
I20260923 19:50:27.793195 5804 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet fb44c10b4f6148738306c617aac88b43
I20260923 19:50:27.793816 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_d6eda42a46db42cf8948594954f698d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:27.793910 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_fe7a9dce52984e97bc233025d7356af7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:27.794391 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fe7a9dce52984e97bc233025d7356af7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:27.794559 5800 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d4bb6958a8a0410fbac59e0ff39539ad consensus state has no leader
I20260923 19:50:27.794863 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_3080c3aa85fa47f484f69a81a8791a7b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:27.795256 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3080c3aa85fa47f484f69a81a8791a7b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:27.795642 5798 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5ccef781d8a84ff298051f5da709fe85 consensus state has no leader
I20260923 19:50:27.795957 5798 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_f05afdc95cc341428732a9bcb92c74a1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:27.796226 5799 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 039419cd51504cf2af724d92cbaa8858
I20260923 19:50:27.797030 5799 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_64a90e659c564472a7b8ff265be1cea8" } new_table_name: "default.Table_3c68f51c0ad64b99ab908a3648950354" modify_external_catalogs: true
I20260923 19:50:27.796882 5801 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet d525bdd4c25843c988865553bd2b3066
I20260923 19:50:27.797542 6317 tablet_service.cc:1558] Processing DeleteTablet for tablet fb44c10b4f6148738306c617aac88b43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:27 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:27.797778 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet d525bdd4c25843c988865553bd2b3066 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:27 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:27.798166 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6eda42a46db42cf8948594954f698d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:27.798261 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_11dfed549adc4c229e01f95bf9ba637a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:27.798713 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11dfed549adc4c229e01f95bf9ba637a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:27.799865 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet db943a36b2fe4ca9813e08ddb38ce7f6
I20260923 19:50:27.800181 6309 tablet_service.cc:1558] Processing DeleteTablet for tablet 039419cd51504cf2af724d92cbaa8858 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:27 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:27.800422 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet e8b0d0a8e4e54ec195893127f7a76bed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:27 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:27.800665 5797 catalog_manager.cc:6934] ReplaceTablet: tablet db943a36b2fe4ca9813e08ddb38ce7f6 deleted and replaced by tablet eda5696cef1b4934a62e41cdc47edb3e
I20260923 19:50:27.800976 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_4c4edf078b36450b8f188f6b0b32b99c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:27.801739 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet db943a36b2fe4ca9813e08ddb38ce7f6 with delete_type TABLET_DATA_DELETED (replaced by tablet eda5696cef1b4934a62e41cdc47edb3e) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:27.784365 8055 leader_election.cc:290] T 64e8951eb899461aa9c0b36e3f7555e2 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:27.804847 5802 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 8d20b59aa99f49f0b2f4d7dd861470f8 (table default.Table_3a666373aff54c2d8256d8fc785cfcc1 [id=57da80bd083d4763a5523608ea26f2bb]). Expected version 1 got 0
I20260923 19:50:27.801110 5796 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet f1c1d4f73488499a9e5add81e9d5e2d6 (table default.Table_7f7907c8e1bc4ad1ae68faf5f072b318 [id=80e3a84f7199464fa96426daeeeb84cd]). Expected version 2 got 0
I20260923 19:50:27.807071 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_4820a4a930d94d4d92963650458308ed" } new_table_name: "default.Table_baea011e68b44786a39ea72afa77b38b" modify_external_catalogs: true
I20260923 19:50:27.809080 5796 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_d087f441e7bb49f7a030bbbb241f7359" } new_table_name: "default.Table_42f3b80d00f8483981ff418ea28fa685" modify_external_catalogs: true
I20260923 19:50:27.809719 6454 tablet_bootstrap.cc:492] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:27.810173 6176 tablet_service.cc:1558] Processing DeleteTablet for tablet e8b0d0a8e4e54ec195893127f7a76bed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:27 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:27.810690 6176 tablet_service.cc:1558] Processing DeleteTablet for tablet fb44c10b4f6148738306c617aac88b43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:27 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:27.811194 6176 tablet_service.cc:1558] Processing DeleteTablet for tablet 039419cd51504cf2af724d92cbaa8858 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:27 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:27.811770 6176 tablet_service.cc:1558] Processing DeleteTablet for tablet d525bdd4c25843c988865553bd2b3066 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:27 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:27.812647 6176 tablet_service.cc:1558] Processing DeleteTablet for tablet db943a36b2fe4ca9813e08ddb38ce7f6 with delete_type TABLET_DATA_DELETED (replaced by tablet eda5696cef1b4934a62e41cdc47edb3e) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:27.814024 6168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e1cb59cd87a4f33b620a12afd91f1f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.817435 6459 ts_tablet_manager.cc:1929] T b9c187ee1fa8438397c83bc2c2b16925 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:27.819098 6172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d1ed91cfd5f4d1eb1ea75fa6183141a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.821563 6311 tablet_service.cc:1558] Processing DeleteTablet for tablet ba0453ef529344dfbab1130daa985fef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:27.819136 6459 log.cc:1199] T b9c187ee1fa8438397c83bc2c2b16925 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/b9c187ee1fa8438397c83bc2c2b16925
I20260923 19:50:27.822233 6459 ts_tablet_manager.cc:1950] T b9c187ee1fa8438397c83bc2c2b16925 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
W20260923 19:50:27.801422 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4c4edf078b36450b8f188f6b0b32b99c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:27.824352 6317 tablet_service.cc:1558] Processing DeleteTablet for tablet f4313a4d8a9c411fad593b05ad655fc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:27.824604 6309 tablet_service.cc:1558] Processing DeleteTablet for tablet f8007918eca14c81947e5999fe13a705 with delete_type TABLET_DATA_DELETED (replaced by tablet 75958985ee414a5a9907ec0c7dece252) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:27.824769 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 688bb1055ba94c2996cdfea6dea76416 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:27.825138 6177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef8849c36a5d4810aac0eec98d821e1c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:27.801678 5798 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f05afdc95cc341428732a9bcb92c74a1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:27.831977 5802 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet a263c0fc71424999b76ef01de9a51eda (table default.Table_634d169330774b228dacd2343d35d4e9 [id=59963339362940748a99a3ff36c31bbd]). Expected version 1 got 0
I20260923 19:50:27.832778 6179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7022dcff773b4caaba5a6b814d43f549. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.833112 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet ce6b86f947ce420994eaa5ff39ad9c87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:27.833456 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cc885d26d974b81a42f03e07c4124eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.836983 6170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c71f3bc197f7415aa435267fa6b24746. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.837025 8069 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 83e97b26500048d0b75350a21a8ff96b)
I20260923 19:50:27.837189 8069 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } }
I20260923 19:50:27.840566 5814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" candidate_term: 4 candidate_status { last_received { term: 3 index: 944 } } ignore_live_leader: false dest_uuid: "83e97b26500048d0b75350a21a8ff96b" is_pre_election: true
I20260923 19:50:27.846266 8069 leader_election.cc:290] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83e97b26500048d0b75350a21a8ff96b (127.5.143.253:45285), 009ffee03a4d41db84df9f450aa84562 (127.5.143.252:45543)
I20260923 19:50:27.846581 6679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" candidate_term: 4 candidate_status { last_received { term: 3 index: 944 } } ignore_live_leader: false dest_uuid: "009ffee03a4d41db84df9f450aa84562" is_pre_election: true
I20260923 19:50:27.847292 7356 leader_election.cc:304] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3d628214a34b4fa3ca0c1abe422bae; no voters: 009ffee03a4d41db84df9f450aa84562, 83e97b26500048d0b75350a21a8ff96b
I20260923 19:50:27.848132 8069 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260923 19:50:27.848141 7986 raft_consensus.cc:493] T d5d3f96ebf1c4d05aceb06ef53737e4f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:27.848269 7986 raft_consensus.cc:515] T d5d3f96ebf1c4d05aceb06ef53737e4f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:27.849357 7986 leader_election.cc:290] T d5d3f96ebf1c4d05aceb06ef53737e4f P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:27.849574 6175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 736e950d491d4d14876a83adf235291e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.849493 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d3f96ebf1c4d05aceb06ef53737e4f" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:27.850075 5996 leader_election.cc:343] T d5d3f96ebf1c4d05aceb06ef53737e4f P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:27.850430 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a104e29d88d5447791083d6333c619c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:27.851984 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1073) took 3968 ms. Trace:
I20260923 19:50:27.852090 6459 rpcz_store.cc:276] 0923 19:50:23.883153 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:23.883301 (+ 148us) service_pool.cc:224] Handling call
0923 19:50:27.483683 (+3600382us) ts_tablet_manager.cc:1151] Deleting tablet b9c187ee1fa8438397c83bc2c2b16925
0923 19:50:27.483692 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:27.655444 (+171752us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:27.817396 (+161952us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:27.851968 (+ 34572us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3600226}
I20260923 19:50:27.852229 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c713a0973dc45debf61c228a4bf13bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:27.852425 6459 tablet_replica.cc:333] T f7cf45d4c4d3480288698682c1c85869 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:27.852610 6459 raft_consensus.cc:2243] T f7cf45d4c4d3480288698682c1c85869 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:27.852758 6459 raft_consensus.cc:2272] T f7cf45d4c4d3480288698682c1c85869 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:27.853258 6459 ts_tablet_manager.cc:1916] T f7cf45d4c4d3480288698682c1c85869 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:27.853633 8053 raft_consensus.cc:493] T 12bda2ae961446bea2f34e792f4f1706 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:27.853751 8053 raft_consensus.cc:515] T 12bda2ae961446bea2f34e792f4f1706 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:27.854334 8053 leader_election.cc:290] T 12bda2ae961446bea2f34e792f4f1706 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:27.855218 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bda2ae961446bea2f34e792f4f1706" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:27.855774 5996 leader_election.cc:343] T 12bda2ae961446bea2f34e792f4f1706 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:27.857775 6454 tablet_bootstrap.cc:654] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:27.858232 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d3f96ebf1c4d05aceb06ef53737e4f" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:27.861173 6459 ts_tablet_manager.cc:1929] T f7cf45d4c4d3480288698682c1c85869 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:27.861276 6459 log.cc:1199] T f7cf45d4c4d3480288698682c1c85869 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/f7cf45d4c4d3480288698682c1c85869
I20260923 19:50:27.861549 6459 ts_tablet_manager.cc:1950] T f7cf45d4c4d3480288698682c1c85869 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:27.861831 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1071) took 3978 ms. Trace:
I20260923 19:50:27.861966 6459 rpcz_store.cc:276] 0923 19:50:23.882920 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:23.883382 (+ 462us) service_pool.cc:224] Handling call
0923 19:50:27.852374 (+3968992us) ts_tablet_manager.cc:1151] Deleting tablet f7cf45d4c4d3480288698682c1c85869
0923 19:50:27.852386 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:27.858420 (+ 6034us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:27.861133 (+ 2713us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:27.861819 (+ 686us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3968769}
I20260923 19:50:27.862316 6459 tablet_replica.cc:333] T 86388fa08c454da9ad2ca0124dcba10b P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:27.862519 6459 raft_consensus.cc:2243] T 86388fa08c454da9ad2ca0124dcba10b P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:27.862699 6459 raft_consensus.cc:2272] T 86388fa08c454da9ad2ca0124dcba10b P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:27.863219 6459 ts_tablet_manager.cc:1916] T 86388fa08c454da9ad2ca0124dcba10b P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:27.864576 6456 tablet_bootstrap.cc:492] T 9ee02922d2be45f5a1473a53a6f253c4 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:27.864641 6458 ts_tablet_manager.cc:1929] T 02fa9052a7054659baf9b07b770bb538 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:27.864712 6456 ts_tablet_manager.cc:1403] T 9ee02922d2be45f5a1473a53a6f253c4 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.135s user 0.005s sys 0.000s
I20260923 19:50:27.865406 6456 raft_consensus.cc:359] T 9ee02922d2be45f5a1473a53a6f253c4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.865566 6456 raft_consensus.cc:385] T 9ee02922d2be45f5a1473a53a6f253c4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:27.865620 6456 raft_consensus.cc:740] T 9ee02922d2be45f5a1473a53a6f253c4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:27.865834 6456 consensus_queue.cc:260] T 9ee02922d2be45f5a1473a53a6f253c4 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.866329 6456 ts_tablet_manager.cc:1434] T 9ee02922d2be45f5a1473a53a6f253c4 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:27.866875 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet b9c187ee1fa8438397c83bc2c2b16925 (table default.Table_76a4d42c4ee8417fa82124f036ec71de [id=220774101a2442309f08c3d6f8713956]) successfully deleted
I20260923 19:50:27.867187 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet f7cf45d4c4d3480288698682c1c85869 (table default.Table_4cb745719e44465b8bdd1ed8a1e04b8e [id=e107798635ee473eb50362535f76985d]) successfully deleted
I20260923 19:50:27.869340 6456 tablet_bootstrap.cc:492] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:27.871019 6456 tablet_bootstrap.cc:654] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:27.866005 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_3651a7b72eeb4da29ca25b42ceb82fc5" } modify_external_catalogs: true
I20260923 19:50:27.871513 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_3651a7b72eeb4da29ca25b42ceb82fc5" } modify_external_catalogs: true
I20260923 19:50:27.864732 6458 log.cc:1199] T 02fa9052a7054659baf9b07b770bb538 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/02fa9052a7054659baf9b07b770bb538
I20260923 19:50:27.878775 6458 ts_tablet_manager.cc:1950] T 02fa9052a7054659baf9b07b770bb538 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:27.883935 7993 raft_consensus.cc:493] T 3c713a0973dc45debf61c228a4bf13bf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:27.884071 7993 raft_consensus.cc:515] T 3c713a0973dc45debf61c228a4bf13bf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.884323 6170 tablet_service.cc:1558] Processing DeleteTablet for tablet f8052b05169b4673b387ac8b716ffc4e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:21 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:27.884668 7993 leader_election.cc:290] T 3c713a0973dc45debf61c228a4bf13bf P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:27.884907 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1206) took 1269 ms. Trace:
I20260923 19:50:27.884992 6458 rpcz_store.cc:276] 0923 19:50:26.615044 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:26.615090 (+ 46us) service_pool.cc:224] Handling call
0923 19:50:27.703083 (+1087993us) ts_tablet_manager.cc:1151] Deleting tablet 02fa9052a7054659baf9b07b770bb538
0923 19:50:27.703277 (+ 194us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:27.775114 (+ 71837us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:27.864594 (+ 89480us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:27.884888 (+ 20294us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1087629}
I20260923 19:50:27.885408 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 02fa9052a7054659baf9b07b770bb538 (table default.Table_5812b40db6ab4814a5c5b3c869967f58 [id=df481a17409f4078a57a0aef11bef720]) successfully deleted
I20260923 19:50:27.885546 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c713a0973dc45debf61c228a4bf13bf" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:27.886377 6280 leader_election.cc:343] T 3c713a0973dc45debf61c228a4bf13bf P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:27.893332 5803 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 53018993d4f347b3b56f6ac152a97729 consensus state has no leader
I20260923 19:50:27.893895 5797 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_cc6a33a0b6804847b00e08408245d538"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:27.895398 6454 tablet_bootstrap.cc:492] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:27.895515 6454 ts_tablet_manager.cc:1403] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.086s user 0.004s sys 0.000s
I20260923 19:50:27.895663 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_ee26b17f99ee47f0bce353e82d693ffd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:27.896056 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee26b17f99ee47f0bce353e82d693ffd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:27.896157 6454 raft_consensus.cc:359] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.896311 6454 raft_consensus.cc:385] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:27.896354 6454 raft_consensus.cc:740] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:27.896548 6454 consensus_queue.cc:260] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
W20260923 19:50:27.896733 5797 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc6a33a0b6804847b00e08408245d538 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:27.897131 6454 ts_tablet_manager.cc:1434] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:50:27.897433 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1205) took 1282 ms. Trace:
W20260923 19:50:27.897571 5796 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 690cf009543d40ba94cdde54274703d2 consensus state has no leader
I20260923 19:50:27.897511 6458 rpcz_store.cc:276] 0923 19:50:26.614917 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:26.614972 (+ 55us) service_pool.cc:224] Handling call
0923 19:50:27.897288 (+1282316us) ts_tablet_manager.cc:1151] Deleting tablet d35d749868aa488b99374483df2c5678
0923 19:50:27.897300 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:27.897412 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1281934}
I20260923 19:50:27.897787 5796 master_service.cc:960] ReplaceTablet: received request to replace tablet 25117ec346224a85942d0106b4962a88 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:27.898051 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1207) took 1272 ms. Trace:
I20260923 19:50:27.898114 6458 rpcz_store.cc:276] 0923 19:50:26.625306 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:26.626757 (+ 1451us) service_pool.cc:224] Handling call
0923 19:50:27.897943 (+1271186us) ts_tablet_manager.cc:1151] Deleting tablet 6cf5a8a047d547b58e08e50e9066018e
0923 19:50:27.897951 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:27.898035 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1270848}
I20260923 19:50:27.898429 8050 raft_consensus.cc:493] T f2799563250845b0b9d7d51b2367b16b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:27.898541 8050 raft_consensus.cc:515] T f2799563250845b0b9d7d51b2367b16b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.899135 8050 leader_election.cc:290] T f2799563250845b0b9d7d51b2367b16b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:27.899818 6458 tablet_replica.cc:333] T 9c4a200d16464676976694656cbe28e2 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
W20260923 19:50:27.899923 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet d35d749868aa488b99374483df2c5678 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d35d749868aa488b99374483df2c5678 already in progress: creating tablet
I20260923 19:50:27.900007 6458 raft_consensus.cc:2243] T 9c4a200d16464676976694656cbe28e2 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
W20260923 19:50:27.900111 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 6cf5a8a047d547b58e08e50e9066018e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6cf5a8a047d547b58e08e50e9066018e already in progress: creating tablet
I20260923 19:50:27.900172 6458 raft_consensus.cc:2272] T 9c4a200d16464676976694656cbe28e2 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:27.900652 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ee02922d2be45f5a1473a53a6f253c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:27.900756 6458 ts_tablet_manager.cc:1916] T 9c4a200d16464676976694656cbe28e2 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:25.751466 7429 rpcz_store.cc:276] 0923 19:50:16.561371 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:16.561442 (+ 71us) service_pool.cc:224] Handling call
0923 19:50:24.793941 (+8232499us) raft_consensus.cc:1471] Updating replica for 419 ops
0923 19:50:24.818980 (+ 25039us) raft_consensus.cc:1534] Early marking committed up to index 0
0923 19:50:24.818993 (+ 13us) raft_consensus.cc:1539] Triggering prepare for 419 ops
0923 19:50:24.819877 (+ 884us) write_op.cc:270] Start()
0923 19:50:24.819955 (+ 78us) write_op.cc:276] Timestamp: P: 1790193007681020 usec, L: 0
0923 19:50:24.954708 (+134753us) write_op.cc:270] Start()
0923 19:50:24.954757 (+ 49us) write_op.cc:276] Timestamp: P: 1790193007683489 usec, L: 0
0923 19:50:24.955032 (+ 275us) write_op.cc:270] Start()
0923 19:50:24.955073 (+ 41us) write_op.cc:276] Timestamp: P: 1790193007685810 usec, L: 0
0923 19:50:24.955291 (+ 218us) write_op.cc:270] Start()
0923 19:50:24.955317 (+ 26us) write_op.cc:276] Timestamp: P: 1790193007688427 usec, L: 0
0923 19:50:24.955568 (+ 251us) write_op.cc:270] Start()
0923 19:50:24.955595 (+ 27us) write_op.cc:276] Timestamp: P: 1790193007721657 usec, L: 0
0923 19:50:24.955723 (+ 128us) write_op.cc:270] Start()
0923 19:50:24.955740 (+ 17us) write_op.cc:276] Timestamp: P: 1790193007729120 usec, L: 0
0923 19:50:24.955853 (+ 113us) write_op.cc:270] Start()
0923 19:50:24.955903 (+ 50us) write_op.cc:276] Timestamp: P: 1790193007752500 usec, L: 0
0923 19:50:24.956063 (+ 160us) write_op.cc:270] Start()
0923 19:50:24.956085 (+ 22us) write_op.cc:276] Timestamp: P: 1790193007776754 usec, L: 0
0923 19:50:24.956245 (+ 160us) write_op.cc:270] Start()
0923 19:50:24.956266 (+ 21us) write_op.cc:276] Timestamp: P: 1790193007778533 usec, L: 0
0923 19:50:24.956421 (+ 155us) write_op.cc:270] Start()
0923 19:50:24.956456 (+ 35us) write_op.cc:276] Timestamp: P: 1790193007787243 usec, L: 0
0923 19:50:24.956646 (+ 190us) write_op.cc:270] Start()
0923 19:50:24.956669 (+ 23us) write_op.cc:276] Timestamp: P: 1790193007796144 usec, L: 0
0923 19:50:24.956832 (+ 163us) write_op.cc:270] Start()
0923 19:50:24.956853 (+ 21us) write_op.cc:276] Timestamp: P: 1790193007825368 usec, L: 0
0923 19:50:24.958282 (+ 1429us) write_op.cc:270] Start()
0923 19:50:24.958311 (+ 29us) write_op.cc:276] Timestamp: P: 1790193007871859 usec, L: 0
0923 19:50:24.958492 (+ 181us) write_op.cc:270] Start()
0923 19:50:24.958517 (+ 25us) write_op.cc:276] Timestamp: P: 1790193007872597 usec, L: 0
0923 19:50:24.958671 (+ 154us) write_op.cc:270] Start()
0923 19:50:24.958698 (+ 27us) write_op.cc:276] Timestamp: P: 1790193007880714 usec, L: 0
0923 19:50:24.958842 (+ 144us) write_op.cc:270] Start()
0923 19:50:24.958863 (+ 21us) write_op.cc:276] Timestamp: P: 1790193007886664 usec, L: 0
0923 19:50:24.959046 (+ 183us) write_op.cc:270] Start()
0923 19:50:24.959077 (+ 31us) write_op.cc:276] Timestamp: P: 1790193007898521 usec, L: 0
0923 19:50:24.959239 (+ 162us) write_op.cc:270] Start()
0923 19:50:24.959266 (+ 27us) write_op.cc:276] Timestamp: P: 1790193007899108 usec, L: 0
0923 19:50:24.959417 (+ 151us) write_op.cc:270] Start()
0923 19:50:24.959440 (+ 23us) write_op.cc:276] Timestamp: P: 1790193007899688 usec, L: 0
0923 19:50:24.959600 (+ 160us) write_op.cc:270] Start()
0923 19:50:24.959622 (+ 22us) write_op.cc:276] Timestamp: P: 1790193007904239 usec, L: 0
0923 19:50:24.959785 (+ 163us) write_op.cc:270] Start()
0923 19:50:24.959807 (+ 22us) write_op.cc:276] Timestamp: P: 1790193007907661 usec, L: 0
0923 19:50:24.959979 (+ 172us) write_op.cc:270] Start()
0923 19:50:24.960003 (+ 24us) write_op.cc:276] Timestamp: P: 1790193007909981 usec, L: 0
0923 19:50:24.960159 (+ 156us) write_op.cc:270] Start()
0923 19:50:24.960181 (+ 22us) write_op.cc:276] Timestamp: P: 1790193007911983 usec, L: 0
0923 19:50:24.960315 (+ 134us) write_op.cc:270] Start()
0923 19:50:24.960340 (+ 25us) write_op.cc:276] Timestamp: P: 1790193007914784 usec, L: 0
0923 19:50:24.960571 (+ 231us) write_op.cc:270] Start()
0923 19:50:24.960596 (+ 25us) write_op.cc:276] Timestamp: P: 1790193007922297 usec, L: 0
0923 19:50:24.960746 (+ 150us) write_op.cc:270] Start()
0923 19:50:24.960767 (+ 21us) write_op.cc:276] Timestamp: P: 1790193007925183 usec, L: 0
0923 19:50:24.960947 (+ 180us) write_op.cc:270] Start()
0923 19:50:24.960967 (+ 20us) write_op.cc:276] Timestamp: P: 1790193007946132 usec, L: 0
0923 19:50:24.961491 (+ 524us) write_op.cc:270] Start()
0923 19:50:24.961561 (+ 70us) write_op.cc:276] Timestamp: P: 1790193008115316 usec, L: 0
0923 19:50:24.962036 (+ 475us) write_op.cc:270] Start()
0923 19:50:24.962063 (+ 27us) write_op.cc:276] Timestamp: P: 1790193008286385 usec, L: 0
0923 19:50:24.962248 (+ 185us) write_op.cc:270] Start()
0923 19:50:24.962271 (+ 23us) write_op.cc:276] Timestamp: P: 1790193008287700 usec, L: 0
0923 19:50:24.962472 (+ 201us) write_op.cc:270] Start()
0923 19:50:24.962496 (+ 24us) write_op.cc:276] Timestamp: P: 1790193008306296 usec, L: 0
0923 19:50:24.962639 (+ 143us) write_op.cc:270] Start()
0923 19:50:24.962661 (+ 22us) write_op.cc:276] Timestamp: P: 1790193008342364 usec, L: 0
0923 19:50:24.962806 (+ 145us) write_op.cc:270] Start()
0923 19:50:24.962825 (+ 19us) write_op.cc:276] Timestamp: P: 1790193008376114 usec, L: 0
0923 19:50:24.962948 (+ 123us) write_op.cc:270] Start()
0923 19:50:24.962970 (+ 22us) write_op.cc:276] Timestamp: P: 1790193008389782 usec, L: 0
0923 19:50:24.963113 (+ 143us) write_op.cc:270] Start()
0923 19:50:24.963135 (+ 22us) write_op.cc:276] Timestamp: P: 1790193008409049 usec, L: 0
0923 19:50:24.963292 (+ 157us) write_op.cc:270] Start()
0923 19:50:24.963311 (+ 19us) write_op.cc:276] Timestamp: P: 1790193008419240 usec, L: 0
0923 19:50:24.963435 (+ 124us) write_op.cc:270] Start()
0923 19:50:24.963466 (+ 31us) write_op.cc:276] Timestamp: P: 1790193008477005 usec, L: 0
0923 19:50:24.963620 (+ 154us) write_op.cc:270] Start()
0923 19:50:24.963642 (+ 22us) write_op.cc:276] Timestamp: P: 1790193008501778 usec, L: 0
0923 19:50:24.963796 (+ 154us) write_op.cc:270] Start()
0923 19:50:24.963820 (+ 24us) write_op.cc:276] Timestamp: P: 1790193008522345 usec, L: 0
0923 19:50:24.963973 (+ 153us) write_op.cc:270] Start()
0923 19:50:24.963999 (+ 26us) write_op.cc:276] Timestamp: P: 1790193008565773 usec, L: 0
0923 19:50:24.964189 (+ 190us) write_op.cc:270] Start()
0923 19:50:24.964219 (+ 30us) write_op.cc:276] Timestamp: P: 1790193008688659 usec, L: 0
0923 19:50:24.964384 (+ 165us) write_op.cc:270] Start()
0923 19:50:24.964408 (+ 24us) write_op.cc:276] Timestamp: P: 1790193008701570 usec, L: 0
0923 19:50:24.964562 (+ 154us) write_op.cc:270] Start()
0923 19:50:24.964585 (+ 23us) write_op.cc:276] Timestamp: P: 1790193008702604 usec, L: 0
0923 19:50:24.964742 (+ 157us) write_op.cc:270] Start()
0923 19:50:24.964765 (+ 23us) write_op.cc:276] Timestamp: P: 1790193008717489 usec, L: 0
0923 19:50:24.964904 (+ 139us) write_op.cc:270] Start()
0923 19:50:24.964924 (+ 20us) write_op.cc:276] Timestamp: P: 1790193008727065 usec, L: 0
0923 19:50:24.965088 (+ 164us) write_op.cc:270] Start()
0923 19:50:24.965111 (+ 23us) write_op.cc:276] Timestamp: P: 1790193008728066 usec, L: 0
0923 19:50:24.965260 (+ 149us) write_op.cc:270] Start()
0923 19:50:24.965282 (+ 22us) write_op.cc:276] Timestamp: P: 1790193008728975 usec, L: 0
0923 19:50:24.965411 (+ 129us) write_op.cc:270] Start()
0923 19:50:24.965432 (+ 21us) write_op.cc:276] Timestamp: P: 1790193008729754 usec, L: 0
0923 19:50:24.965590 (+ 158us) write_op.cc:270] Start()
0923 19:50:24.965616 (+ 26us) write_op.cc:276] Timestamp: P: 1790193008730974 usec, L: 0
0923 19:50:24.965864 (+ 248us) write_op.cc:270] Start()
0923 19:50:24.965927 (+ 63us) write_op.cc:276] Timestamp: P: 1790193008755480 usec, L: 0
0923 19:50:24.966759 (+ 832us) write_op.cc:270] Start()
0923 19:50:24.966787 (+ 28us) write_op.cc:276] Timestamp: P: 1790193008797902 usec, L: 0
0923 19:50:24.966956 (+ 169us) write_op.cc:270] Start()
0923 19:50:24.966979 (+ 23us) write_op.cc:276] Timestamp: P: 1790193008798650 usec, L: 0
0923 19:50:24.967281 (+ 302us) write_op.cc:270] Start()
0923 19:50:24.967305 (+ 24us) write_op.cc:276] Timestamp: P: 1790193008799240 usec, L: 0
0923 19:50:24.967625 (+ 320us) write_op.cc:270] Start()
0923 19:50:24.967650 (+ 25us) write_op.cc:276] Timestamp: P: 1790193008799858 usec, L: 0
0923 19:50:24.967812 (+ 162us) write_op.cc:270] Start()
0923 19:50:24.967835 (+ 23us) write_op.cc:276] Timestamp: P: 1790193008800442 usec, L: 0
0923 19:50:24.967974 (+ 139us) write_op.cc:270] Start()
0923 19:50:24.967996 (+ 22us) write_op.cc:276] Timestamp: P: 1790193008801067 usec, L: 0
0923 19:50:24.968195 (+ 199us) write_op.cc:270] Start()
0923 19:50:24.968218 (+ 23us) write_op.cc:276] Timestamp: P: 1790193008804930 usec, L: 0
0923 19:50:24.968381 (+ 163us) write_op.cc:270] Start()
0923 19:50:24.968403 (+ 22us) write_op.cc:276] Timestamp: P: 1790193008822441 usec, L: 0
0923 19:50:24.968609 (+ 206us) write_op.cc:270] Start()
0923 19:50:24.968640 (+ 31us) write_op.cc:276] Timestamp: P: 1790193008835476 usec, L: 0
0923 19:50:24.968832 (+ 192us) write_op.cc:270] Start()
0923 19:50:24.968889 (+ 57us) write_op.cc:276] Timestamp: P: 1790193008843207 usec, L: 0
0923 19:50:24.969111 (+ 222us) write_op.cc:270] Start()
0923 19:50:24.969139 (+ 28us) write_op.cc:276] Timestamp: P: 1790193008847258 usec, L: 0
0923 19:50:24.969322 (+ 183us) write_op.cc:270] Start()
0923 19:50:24.969349 (+ 27us) write_op.cc:276] Timestamp: P: 1790193008848256 usec, L: 0
0923 19:50:24.969548 (+ 199us) write_op.cc:270] Start()
0923 19:50:24.969575 (+ 27us) write_op.cc:276] Timestamp: P: 1790193008848975 usec, L: 0
0923 19:50:24.969743 (+ 168us) write_op.cc:270] Start()
0923 19:50:24.969770 (+ 27us) write_op.cc:276] Timestamp: P: 1790193008854080 usec, L: 0
0923 19:50:24.970002 (+ 232us) write_op.cc:270] Start()
0923 19:50:24.970045 (+ 43us) write_op.cc:276] Timestamp: P: 1790193008865129 usec, L: 0
0923 19:50:24.970214 (+ 169us) write_op.cc:270] Start()
0923 19:50:24.970245 (+ 31us) write_op.cc:276] Timestamp: P: 1790193008874534 usec, L: 0
0923 19:50:24.970394 (+ 149us) write_op.cc:270] Start()
0923 19:50:24.970415 (+ 21us) write_op.cc:276] Timestamp: P: 1790193008914588 usec, L: 0
0923 19:50:24.970580 (+ 165us) write_op.cc:270] Start()
0923 19:50:24.970606 (+ 26us) write_op.cc:276] Timestamp: P: 1790193008946049 usec, L: 0
0923 19:50:24.970766 (+ 160us) write_op.cc:270] Start()
0923 19:50:24.970792 (+ 26us) write_op.cc:276] Timestamp: P: 1790193008946733 usec, L: 0
0923 19:50:24.970944 (+ 152us) write_op.cc:270] Start()
0923 19:50:24.970967 (+ 23us) write_op.cc:276] Timestamp: P: 1790193008950933 usec, L: 0
0923 19:50:24.971153 (+ 186us) write_op.cc:270] Start()
0923 19:50:24.971180 (+ 27us) write_op.cc:276] Timestamp: P: 1790193008952547 usec, L: 0
0923 19:50:24.971323 (+ 143us) write_op.cc:270] Start()
0923 19:50:24.971346 (+ 23us) write_op.cc:276] Timestamp: P: 1790193008960138 usec, L: 0
0923 19:50:24.971512 (+ 166us) write_op.cc:270] Start()
0923 19:50:24.971534 (+ 22us) write_op.cc:276] Timestamp: P: 1790193008964460 usec, L: 0
0923 19:50:24.971680 (+ 146us) write_op.cc:270] Start()
0923 19:50:24.971700 (+ 20us) write_op.cc:276] Timestamp: P: 1790193008971167 usec, L: 0
0923 19:50:24.971825 (+ 125us) write_op.cc:270] Start()
0923 19:50:24.971845 (+ 20us) write_op.cc:276] Timestamp: P: 1790193009028353 usec, L: 0
0923 19:50:24.972032 (+ 187us) write_op.cc:270] Start()
0923 19:50:24.972058 (+ 26us) write_op.cc:276] Timestamp: P: 1790193009078540 usec, L: 0
0923 19:50:24.972219 (+ 161us) write_op.cc:270] Start()
0923 19:50:24.972239 (+ 20us) write_op.cc:276] Timestamp: P: 1790193009099133 usec, L: 0
0923 19:50:24.972400 (+ 161us) write_op.cc:270] Start()
0923 19:50:24.972424 (+ 24us) write_op.cc:276] Timestamp: P: 1790193009103075 usec, L: 0
0923 19:50:24.972572 (+ 148us) write_op.cc:270] Start()
0923 19:50:24.972644 (+ 72us) write_op.cc:276] Timestamp: P: 1790193009103714 usec, L: 0
0923 19:50:24.972804 (+ 160us) write_op.cc:270] Start()
0923 19:50:24.972824 (+ 20us) write_op.cc:276] Timestamp: P: 1790193009106917 usec, L: 0
0923 19:50:24.972953 (+ 129us) write_op.cc:270] Start()
0923 19:50:24.972971 (+ 18us) write_op.cc:276] Timestamp: P: 1790193009108080 usec, L: 0
0923 19:50:24.973125 (+ 154us) write_op.cc:270] Start()
0923 19:50:24.973148 (+ 23us) write_op.cc:276] Timestamp: P: 1790193009128958 usec, L: 0
0923 19:50:24.973285 (+ 137us) write_op.cc:270] Start()
0923 19:50:24.973306 (+ 21us) write_op.cc:276] Timestamp: P: 1790193009138966 usec, L: 0
0923 19:50:24.973459 (+ 153us) write_op.cc:270] Start()
0923 19:50:24.973482 (+ 23us) write_op.cc:276] Timestamp: P: 1790193009269256 usec, L: 0
0923 19:50:24.973627 (+ 145us) write_op.cc:270] Start()
0923 19:50:24.973648 (+ 21us) write_op.cc:276] Timestamp: P: 1790193009310289 usec, L: 0
0923 19:50:24.973801 (+ 153us) write_op.cc:270] Start()
0923 19:50:24.973824 (+ 23us) write_op.cc:276] Timestamp: P: 1790193009328576 usec, L: 0
0923 19:50:24.973996 (+ 172us) write_op.cc:270] Start()
0923 19:50:24.974026 (+ 30us) write_op.cc:276] Timestamp: P: 1790193009348293 usec, L: 0
0923 19:50:24.974213 (+ 187us) write_op.cc:270] Start()
0923 19:50:24.974241 (+ 28us) write_op.cc:276] Timestamp: P: 1790193009368997 usec, L: 0
0923 19:50:24.974417 (+ 176us) write_op.cc:270] Start()
0923 19:50:24.974457 (+ 40us) write_op.cc:276] Timestamp: P: 1790193009377837 usec, L: 0
0923 19:50:24.974675 (+ 218us) write_op.cc:270] Start()
0923 19:50:24.974703 (+ 28us) write_op.cc:276] Timestamp: P: 1790193009394835 usec, L: 0
0923 19:50:24.974881 (+ 178us) write_op.cc:270] Start()
0923 19:50:24.974907 (+ 26us) write_op.cc:276] Timestamp: P: 1790193009419921 usec, L: 0
0923 19:50:24.975095 (+ 188us) write_op.cc:270] Start()
0923 19:50:24.975125 (+ 30us) write_op.cc:276] Timestamp: P: 1790193009457570 usec, L: 0
0923 19:50:24.975292 (+ 167us) write_op.cc:270] Start()
0923 19:50:24.975319 (+ 27us) write_op.cc:276] Timestamp: P: 1790193009464696 usec, L: 0
0923 19:50:24.975488 (+ 169us) write_op.cc:270] Start()
0923 19:50:24.975510 (+ 22us) write_op.cc:276] Timestamp: P: 1790193009496590 usec, L: 0
0923 19:50:24.975686 (+ 176us) write_op.cc:270] Start()
0923 19:50:24.975712 (+ 26us) write_op.cc:276] Timestamp: P: 1790193009497231 usec, L: 0
0923 19:50:24.975921 (+ 209us) write_op.cc:270] Start()
0923 19:50:24.975949 (+ 28us) write_op.cc:276] Timestamp: P: 1790193009498610 usec, L: 0
0923 19:50:24.976132 (+ 183us) write_op.cc:270] Start()
0923 19:50:24.976153 (+ 21us) write_op.cc:276] Timestamp: P: 1790193009499289 usec, L: 0
0923 19:50:24.976311 (+ 158us) write_op.cc:270] Start()
0923 19:50:24.976343 (+ 32us) write_op.cc:276] Timestamp: P: 1790193009515544 usec, L: 0
0923 19:50:24.976466 (+ 123us) write_op.cc:270] Start()
0923 19:50:24.976484 (+ 18us) write_op.cc:276] Timestamp: P: 1790193009524610 usec, L: 0
0923 19:50:24.976616 (+ 132us) write_op.cc:270] Start()
0923 19:50:24.976635 (+ 19us) write_op.cc:276] Timestamp: P: 1790193009531618 usec, L: 0
0923 19:50:24.976784 (+ 149us) write_op.cc:270] Start()
0923 19:50:24.976811 (+ 27us) write_op.cc:276] Timestamp: P: 1790193009560181 usec, L: 0
0923 19:50:24.976959 (+ 148us) write_op.cc:270] Start()
0923 19:50:24.976978 (+ 19us) write_op.cc:276] Timestamp: P: 1790193009568266 usec, L: 0
0923 19:50:24.977157 (+ 179us) write_op.cc:270] Start()
0923 19:50:24.977181 (+ 24us) write_op.cc:276] Timestamp: P: 1790193009578119 usec, L: 0
0923 19:50:24.977320 (+ 139us) write_op.cc:270] Start()
0923 19:50:24.977342 (+ 22us) write_op.cc:276] Timestamp: P: 1790193009603756 usec, L: 0
0923 19:50:24.977477 (+ 135us) write_op.cc:270] Start()
0923 19:50:24.977498 (+ 21us) write_op.cc:276] Timestamp: P: 1790193009618858 usec, L: 0
0923 19:50:24.977648 (+ 150us) write_op.cc:270] Start()
0923 19:50:24.977669 (+ 21us) write_op.cc:276] Timestamp: P: 1790193009658743 usec, L: 0
0923 19:50:24.977804 (+ 135us) write_op.cc:270] Start()
0923 19:50:24.978590 (+ 786us) write_op.cc:276] Timestamp: P: 1790193009660222 usec, L: 0
0923 19:50:25.056243 (+ 77653us) write_op.cc:270] Start()
0923 19:50:25.056287 (+ 44us) write_op.cc:276] Timestamp: P: 1790193009729996 usec, L: 0
0923 19:50:25.064321 (+ 8034us) write_op.cc:270] Start()
0923 19:50:25.064365 (+ 44us) write_op.cc:276] Timestamp: P: 1790193009734437 usec, L: 0
0923 19:50:25.064568 (+ 203us) write_op.cc:270] Start()
0923 19:50:25.064596 (+ 28us) write_op.cc:276] Timestamp: P: 1790193009739617 usec, L: 0
0923 19:50:25.064754 (+ 158us) write_op.cc:270] Start()
0923 19:50:25.064777 (+ 23us) write_op.cc:276] Timestamp: P: 1790193009745760 usec, L: 0
0923 19:50:25.064940 (+ 163us) write_op.cc:270] Start()
0923 19:50:25.064961 (+ 21us) write_op.cc:276] Timestamp: P: 1790193009762768 usec, L: 0
0923 19:50:25.065099 (+ 138us) write_op.cc:270] Start()
0923 19:50:25.065122 (+ 23us) write_op.cc:276] Timestamp: P: 1790193009769641 usec, L: 0
0923 19:50:25.067245 (+ 2123us) write_op.cc:270] Start()
0923 19:50:25.067271 (+ 26us) write_op.cc:276] Timestamp: P: 1790193009777197 usec, L: 0
0923 19:50:25.067424 (+ 153us) write_op.cc:270] Start()
0923 19:50:25.067445 (+ 21us) write_op.cc:276] Timestamp: P: 1790193009777774 usec, L: 0
0923 19:50:25.067576 (+ 131us) write_op.cc:270] Start()
0923 19:50:25.067594 (+ 18us) write_op.cc:276] Timestamp: P: 1790193009780951 usec, L: 0
0923 19:50:25.067714 (+ 120us) write_op.cc:270] Start()
0923 19:50:25.067732 (+ 18us) write_op.cc:276] Timestamp: P: 1790193009786943 usec, L: 0
0923 19:50:25.067957 (+ 225us) write_op.cc:270] Start()
0923 19:50:25.067981 (+ 24us) write_op.cc:276] Timestamp: P: 1790193009791977 usec, L: 0
0923 19:50:25.068131 (+ 150us) write_op.cc:270] Start()
0923 19:50:25.068154 (+ 23us) write_op.cc:276] Timestamp: P: 1790193009794082 usec, L: 0
0923 19:50:25.068299 (+ 145us) write_op.cc:270] Start()
0923 19:50:25.068320 (+ 21us) write_op.cc:276] Timestamp: P: 1790193009796338 usec, L: 0
0923 19:50:25.068460 (+ 140us) write_op.cc:270] Start()
0923 19:50:25.068481 (+ 21us) write_op.cc:276] Timestamp: P: 1790193009798720 usec, L: 0
0923 19:50:25.068620 (+ 139us) write_op.cc:270] Start()
0923 19:50:25.068640 (+ 20us) write_op.cc:276] Timestamp: P: 1790193009801487 usec, L: 0
0923 19:50:25.068775 (+ 135us) write_op.cc:270] Start()
0923 19:50:25.068796 (+ 21us) write_op.cc:276] Timestamp: P: 1790193009803646 usec, L: 0
0923 19:50:25.080536 (+ 11740us) write_op.cc:270] Start()
0923 19:50:25.080574 (+ 38us) write_op.cc:276] Timestamp: P: 1790193009814304 usec, L: 0
0923 19:50:25.080760 (+ 186us) write_op.cc:270] Start()
0923 19:50:25.080784 (+ 24us) write_op.cc:276] Timestamp: P: 1790193009859747 usec, L: 0
0923 19:50:25.080984 (+ 200us) write_op.cc:270] Start()
0923 19:50:25.081005 (+ 21us) write_op.cc:276] Timestamp: P: 1790193009860427 usec, L: 0
0923 19:50:25.081183 (+ 178us) write_op.cc:270] Start()
0923 19:50:25.081204 (+ 21us) write_op.cc:276] Timestamp: P: 1790193009989501 usec, L: 0
0923 19:50:25.081336 (+ 132us) write_op.cc:270] Start()
0923 19:50:25.081356 (+ 20us) write_op.cc:276] Timestamp: P: 1790193010006517 usec, L: 0
0923 19:50:25.081505 (+ 149us) write_op.cc:270] Start()
0923 19:50:25.081524 (+ 19us) write_op.cc:276] Timestamp: P: 1790193010011756 usec, L: 0
0923 19:50:25.081652 (+ 128us) write_op.cc:270] Start()
0923 19:50:25.082822 (+ 1170us) write_op.cc:276] Timestamp: P: 1790193010018500 usec, L: 0
0923 19:50:25.083042 (+ 220us) write_op.cc:270] Start()
0923 19:50:25.083098 (+ 56us) write_op.cc:276] Timestamp: P: 1790193010019431 usec, L: 0
0923 19:50:25.083272 (+ 174us) write_op.cc:270] Start()
0923 19:50:25.083297 (+ 25us) write_op.cc:276] Timestamp: P: 1790193010020264 usec, L: 0
0923 19:50:25.083451 (+ 154us) write_op.cc:270] Start()
0923 19:50:25.083474 (+ 23us) write_op.cc:276] Timestamp: P: 1790193010021056 usec, L: 0
0923 19:50:25.083621 (+ 147us) write_op.cc:270] Start()
0923 19:50:25.083645 (+ 24us) write_op.cc:276] Timestamp: P: 1790193010062495 usec, L: 0
0923 19:50:25.083778 (+ 133us) write_op.cc:270] Start()
0923 19:50:25.083802 (+ 24us) write_op.cc:276] Timestamp: P: 1790193010074270 usec, L: 0
0923 19:50:25.083991 (+ 189us) write_op.cc:270] Start()
0923 19:50:25.084012 (+ 21us) write_op.cc:276] Timestamp: P: 1790193010080606 usec, L: 0
0923 19:50:25.084150 (+ 138us) write_op.cc:270] Start()
0923 19:50:25.084172 (+ 22us) write_op.cc:276] Timestamp: P: 1790193010090091 usec, L: 0
0923 19:50:25.084350 (+ 178us) write_op.cc:270] Start()
0923 19:50:25.084371 (+ 21us) write_op.cc:276] Timestamp: P: 1790193010111805 usec, L: 0
0923 19:50:25.084496 (+ 125us) write_op.cc:270] Start()
0923 19:50:25.084516 (+ 20us) write_op.cc:276] Timestamp: P: 1790193010135040 usec, L: 0
0923 19:50:25.089453 (+ 4937us) write_op.cc:270] Start()
0923 19:50:25.089485 (+ 32us) write_op.cc:276] Timestamp: P: 1790193010158035 usec, L: 0
0923 19:50:25.089646 (+ 161us) write_op.cc:270] Start()
0923 19:50:25.089669 (+ 23us) write_op.cc:276] Timestamp: P: 1790193010164930 usec, L: 0
0923 19:50:25.089801 (+ 132us) write_op.cc:270] Start()
0923 19:50:25.089821 (+ 20us) write_op.cc:276] Timestamp: P: 1790193010187524 usec, L: 0
0923 19:50:25.090012 (+ 191us) write_op.cc:270] Start()
0923 19:50:25.090039 (+ 27us) write_op.cc:276] Timestamp: P: 1790193010211157 usec, L: 0
0923 19:50:25.090188 (+ 149us) write_op.cc:270] Start()
0923 19:50:25.090208 (+ 20us) write_op.cc:276] Timestamp: P: 1790193010233032 usec, L: 0
0923 19:50:25.090329 (+ 121us) write_op.cc:270] Start()
0923 19:50:25.090349 (+ 20us) write_op.cc:276] Timestamp: P: 1790193010258950 usec, L: 0
0923 19:50:25.090490 (+ 141us) write_op.cc:270] Start()
0923 19:50:25.090511 (+ 21us) write_op.cc:276] Timestamp: P: 1790193010272022 usec, L: 0
0923 19:50:25.090636 (+ 125us) write_op.cc:270] Start()
0923 19:50:25.090654 (+ 18us) write_op.cc:276] Timestamp: P: 1790193010296135 usec, L: 0
0923 19:50:25.090776 (+ 122us) write_op.cc:270] Start()
0923 19:50:25.090794 (+ 18us) write_op.cc:276] Timestamp: P: 1790193010316798 usec, L: 0
0923 19:50:25.090942 (+ 148us) write_op.cc:270] Start()
0923 19:50:25.090968 (+ 26us) write_op.cc:276] Timestamp: P: 1790193010345178 usec, L: 0
0923 19:50:25.091105 (+ 137us) write_op.cc:270] Start()
0923 19:50:25.091124 (+ 19us) write_op.cc:276] Timestamp: P: 1790193010363744 usec, L: 0
0923 19:50:25.091266 (+ 142us) write_op.cc:270] Start()
0923 19:50:25.091289 (+ 23us) write_op.cc:276] Timestamp: P: 1790193010376013 usec, L: 0
0923 19:50:25.091439 (+ 150us) write_op.cc:270] Start()
0923 19:50:25.091460 (+ 21us) write_op.cc:276] Timestamp: P: 1790193010396993 usec, L: 0
0923 19:50:25.091588 (+ 128us) write_op.cc:270] Start()
0923 19:50:25.091607 (+ 19us) write_op.cc:276] Timestamp: P: 1790193010419346 usec, L: 0
0923 19:50:25.091771 (+ 164us) write_op.cc:270] Start()
0923 19:50:25.091791 (+ 20us) write_op.cc:276] Timestamp: P: 1790193010435159 usec, L: 0
0923 19:50:25.107066 (+ 15275us) write_op.cc:270] Start()
0923 19:50:25.107107 (+ 41us) write_op.cc:276] Timestamp: P: 1790193010457297 usec, L: 0
0923 19:50:25.107309 (+ 202us) write_op.cc:270] Start()
0923 19:50:25.107332 (+ 23us) write_op.cc:276] Timestamp: P: 1790193010471335 usec, L: 0
0923 19:50:25.109400 (+ 2068us) write_op.cc:270] Start()
0923 19:50:25.109431 (+ 31us) write_op.cc:276] Timestamp: P: 1790193010506201 usec, L: 0
0923 19:50:25.109584 (+ 153us) write_op.cc:270] Start()
0923 19:50:25.109612 (+ 28us) write_op.cc:276] Timestamp: P: 1790193010524390 usec, L: 0
0923 19:50:25.130718 (+ 21106us) write_op.cc:270] Start()
0923 19:50:25.130762 (+ 44us) write_op.cc:276] Timestamp: P: 1790193010534194 usec, L: 0
0923 19:50:25.130997 (+ 235us) write_op.cc:270] Start()
0923 19:50:25.131023 (+ 26us) write_op.cc:276] Timestamp: P: 1790193010553591 usec, L: 0
0923 19:50:25.131175 (+ 152us) write_op.cc:270] Start()
0923 19:50:25.131196 (+ 21us) write_op.cc:276] Timestamp: P: 1790193010567001 usec, L: 0
0923 19:50:25.131317 (+ 121us) write_op.cc:270] Start()
0923 19:50:25.131339 (+ 22us) write_op.cc:276] Timestamp: P: 1790193010588986 usec, L: 0
0923 19:50:25.131597 (+ 258us) write_op.cc:270] Start()
0923 19:50:25.131624 (+ 27us) write_op.cc:276] Timestamp: P: 1790193010690549 usec, L: 0
0923 19:50:25.131802 (+ 178us) write_op.cc:270] Start()
0923 19:50:25.131822 (+ 20us) write_op.cc:276] Timestamp: P: 1790193010721396 usec, L: 0
0923 19:50:25.131962 (+ 140us) write_op.cc:270] Start()
0923 19:50:25.131982 (+ 20us) write_op.cc:276] Timestamp: P: 1790193010803161 usec, L: 0
0923 19:50:25.132104 (+ 122us) write_op.cc:270] Start()
0923 19:50:25.132122 (+ 18us) write_op.cc:276] Timestamp: P: 1790193010821262 usec, L: 0
0923 19:50:25.132268 (+ 146us) write_op.cc:270] Start()
0923 19:50:25.132329 (+ 61us) write_op.cc:276] Timestamp: P: 1790193010841968 usec, L: 0
0923 19:50:25.132552 (+ 223us) write_op.cc:270] Start()
0923 19:50:25.132574 (+ 22us) write_op.cc:276] Timestamp: P: 1790193010853483 usec, L: 0
0923 19:50:25.132693 (+ 119us) write_op.cc:270] Start()
0923 19:50:25.132713 (+ 20us) write_op.cc:276] Timestamp: P: 1790193010892373 usec, L: 0
0923 19:50:25.132867 (+ 154us) write_op.cc:270] Start()
0923 19:50:25.132885 (+ 18us) write_op.cc:276] Timestamp: P: 1790193010922787 usec, L: 0
0923 19:50:25.194227 (+ 61342us) write_op.cc:270] Start()
0923 19:50:25.194267 (+ 40us) write_op.cc:276] Timestamp: P: 1790193010938414 usec, L: 0
0923 19:50:25.194418 (+ 151us) write_op.cc:270] Start()
0923 19:50:25.194435 (+ 17us) write_op.cc:276] Timestamp: P: 1790193010959451 usec, L: 0
0923 19:50:25.194554 (+ 119us) write_op.cc:270] Start()
0923 19:50:25.194570 (+ 16us) write_op.cc:276] Timestamp: P: 1790193010994202 usec, L: 0
0923 19:50:25.194663 (+ 93us) write_op.cc:270] Start()
0923 19:50:25.194686 (+ 23us) write_op.cc:276] Timestamp: P: 1790193011035891 usec, L: 0
0923 19:50:25.194780 (+ 94us) write_op.cc:270] Start()
0923 19:50:25.194794 (+ 14us) write_op.cc:276] Timestamp: P: 1790193011052498 usec, L: 0
0923 19:50:25.194886 (+ 92us) write_op.cc:270] Start()
0923 19:50:25.194903 (+ 17us) write_op.cc:276] Timestamp: P: 1790193011079128 usec, L: 0
0923 19:50:25.195029 (+ 126us) write_op.cc:270] Start()
0923 19:50:25.195063 (+ 34us) write_op.cc:276] Timestamp: P: 1790193011091729 usec, L: 0
0923 19:50:25.195285 (+ 222us) write_op.cc:270] Start()
0923 19:50:25.195312 (+ 27us) write_op.cc:276] Timestamp: P: 1790193011120030 usec, L: 0
0923 19:50:25.195871 (+ 559us) write_op.cc:270] Start()
0923 19:50:25.195892 (+ 21us) write_op.cc:276] Timestamp: P: 1790193011143654 usec, L: 0
0923 19:50:25.196014 (+ 122us) write_op.cc:270] Start()
0923 19:50:25.196045 (+ 31us) write_op.cc:276] Timestamp: P: 1790193011182379 usec, L: 0
0923 19:50:25.196182 (+ 137us) write_op.cc:270] Start()
0923 19:50:25.196203 (+ 21us) write_op.cc:276] Timestamp: P: 1790193011207411 usec, L: 0
0923 19:50:25.196333 (+ 130us) write_op.cc:270] Start()
0923 19:50:25.196350 (+ 17us) write_op.cc:276] Timestamp: P: 1790193011209591 usec, L: 0
0923 19:50:25.196475 (+ 125us) write_op.cc:270] Start()
0923 19:50:25.196496 (+ 21us) write_op.cc:276] Timestamp: P: 1790193011210749 usec, L: 0
0923 19:50:25.196627 (+ 131us) write_op.cc:270] Start()
0923 19:50:25.196646 (+ 19us) write_op.cc:276] Timestamp: P: 1790193011281742 usec, L: 0
0923 19:50:25.196766 (+ 120us) write_op.cc:270] Start()
0923 19:50:25.196787 (+ 21us) write_op.cc:276] Timestamp: P: 1790193011309531 usec, L: 0
0923 19:50:25.196944 (+ 157us) write_op.cc:270] Start()
0923 19:50:25.196984 (+ 40us) write_op.cc:276] Timestamp: P: 1790193011312306 usec, L: 0
0923 19:50:25.197134 (+ 150us) write_op.cc:270] Start()
0923 19:50:25.197156 (+ 22us) write_op.cc:276] Timestamp: P: 1790193011374844 usec, L: 0
0923 19:50:25.197269 (+ 113us) write_op.cc:270] Start()
0923 19:50:25.197288 (+ 19us) write_op.cc:276] Timestamp: P: 1790193011402803 usec, L: 0
0923 19:50:25.197434 (+ 146us) write_op.cc:270] Start()
0923 19:50:25.197456 (+ 22us) write_op.cc:276] Timestamp: P: 1790193011423358 usec, L: 0
0923 19:50:25.197660 (+ 204us) write_op.cc:270] Start()
0923 19:50:25.197683 (+ 23us) write_op.cc:276] Timestamp: P: 1790193011443032 usec, L: 0
0923 19:50:25.197828 (+ 145us) write_op.cc:270] Start()
0923 19:50:25.197847 (+ 19us) write_op.cc:276] Timestamp: P: 1790193011479516 usec, L: 0
0923 19:50:25.258249 (+ 60402us) write_op.cc:270] Start()
0923 19:50:25.258302 (+ 53us) write_op.cc:276] Timestamp: P: 1790193011495277 usec, L: 0
0923 19:50:25.258476 (+ 174us) write_op.cc:270] Start()
0923 19:50:25.258500 (+ 24us) write_op.cc:276] Timestamp: P: 1790193011496224 usec, L: 0
0923 19:50:25.258643 (+ 143us) write_op.cc:270] Start()
0923 19:50:25.258662 (+ 19us) write_op.cc:276] Timestamp: P: 1790193011501775 usec, L: 0
0923 19:50:25.258785 (+ 123us) write_op.cc:270] Start()
0923 19:50:25.258803 (+ 18us) write_op.cc:276] Timestamp: P: 1790193011502497 usec, L: 0
0923 19:50:25.258949 (+ 146us) write_op.cc:270] Start()
0923 19:50:25.258970 (+ 21us) write_op.cc:276] Timestamp: P: 1790193011503143 usec, L: 0
0923 19:50:25.259093 (+ 123us) write_op.cc:270] Start()
0923 19:50:25.259112 (+ 19us) write_op.cc:276] Timestamp: P: 1790193
I20260923 19:50:27.906603 6459 ts_tablet_manager.cc:1929] T 86388fa08c454da9ad2ca0124dcba10b P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:27.906726 6459 log.cc:1199] T 86388fa08c454da9ad2ca0124dcba10b P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/86388fa08c454da9ad2ca0124dcba10b
I20260923 19:50:27.907114 6459 ts_tablet_manager.cc:1950] T 86388fa08c454da9ad2ca0124dcba10b P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
W20260923 19:50:27.907599 5799 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5e1acdba2fb44609a0ac0cd296e95c44 consensus state has no leader
W20260923 19:50:27.911939 6279 leader_election.cc:343] T ba0453ef529344dfbab1130daa985fef P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: ba0453ef529344dfbab1130daa985fef
I20260923 19:50:27.912034 6456 tablet_bootstrap.cc:492] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:27.912058 6279 leader_election.cc:304] T ba0453ef529344dfbab1130daa985fef P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:27.912137 6456 ts_tablet_manager.cc:1403] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.043s user 0.004s sys 0.000s
I20260923 19:50:27.912113 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet fb44c10b4f6148738306c617aac88b43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:27 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:27.912313 6022 tablet_service.cc:1558] Processing DeleteTablet for tablet 039419cd51504cf2af724d92cbaa8858 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:27 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:27.912520 6035 tablet_service.cc:1558] Processing DeleteTablet for tablet d525bdd4c25843c988865553bd2b3066 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:27 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:27.912667 6040 tablet_service.cc:1558] Processing DeleteTablet for tablet db943a36b2fe4ca9813e08ddb38ce7f6 with delete_type TABLET_DATA_DELETED (replaced by tablet eda5696cef1b4934a62e41cdc47edb3e) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:27.912752 7993 raft_consensus.cc:2749] T ba0453ef529344dfbab1130daa985fef P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:27.912667 6039 tablet_service.cc:1558] Processing DeleteTablet for tablet e8b0d0a8e4e54ec195893127f7a76bed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:27 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:27.913554 6456 raft_consensus.cc:359] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.913707 6456 raft_consensus.cc:385] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:27.913757 6456 raft_consensus.cc:740] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:27.914080 6456 consensus_queue.cc:260] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.914587 6456 ts_tablet_manager.cc:1434] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:27.914825 6456 tablet_bootstrap.cc:492] T 85f5ba9097674f9d889e178eaea4f0d7 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:27.916288 5805 catalog_manager.cc:5838] T 8d20b59aa99f49f0b2f4d7dd861470f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193). New cstate: current_term: 1 leader_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:27.919759 5805 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 8d20b59aa99f49f0b2f4d7dd861470f8 (table default.Table_3a666373aff54c2d8256d8fc785cfcc1 [id=57da80bd083d4763a5523608ea26f2bb]). Expected version 1 got 0
I20260923 19:50:27.920060 5805 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 40adb472162042e48fdbb496b342996a (table default.Table_9430735288754d599f68f15e1d52c0cf [id=8fe16214ad774a54982dbadeac1b4235]). Expected version 2 got 0
I20260923 19:50:27.930598 6456 tablet_bootstrap.cc:654] T 85f5ba9097674f9d889e178eaea4f0d7 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:27.935770 6457 tablet_bootstrap.cc:492] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:27.936025 6457 ts_tablet_manager.cc:1403] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.230s user 0.013s sys 0.017s
I20260923 19:50:27.936946 6457 raft_consensus.cc:359] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:27.937191 6457 raft_consensus.cc:385] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:27.937287 6457 raft_consensus.cc:740] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:27.937541 6457 consensus_queue.cc:260] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:27.938177 6457 ts_tablet_manager.cc:1434] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:27.938673 6456 tablet_bootstrap.cc:492] T 85f5ba9097674f9d889e178eaea4f0d7 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:27.938800 6456 ts_tablet_manager.cc:1403] T 85f5ba9097674f9d889e178eaea4f0d7 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.000s
I20260923 19:50:27.939960 6461 ts_tablet_manager.cc:1929] T 85d35ebef3c24a2e89233dd900b63513 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260923 19:50:27.940052 6461 log.cc:1199] T 85d35ebef3c24a2e89233dd900b63513 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/85d35ebef3c24a2e89233dd900b63513
I20260923 19:50:27.940188 6456 raft_consensus.cc:359] T 85f5ba9097674f9d889e178eaea4f0d7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.940341 6456 raft_consensus.cc:385] T 85f5ba9097674f9d889e178eaea4f0d7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:27.940383 6461 ts_tablet_manager.cc:1950] T 85d35ebef3c24a2e89233dd900b63513 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:27.940404 6456 raft_consensus.cc:740] T 85f5ba9097674f9d889e178eaea4f0d7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:27.940634 6456 consensus_queue.cc:260] T 85f5ba9097674f9d889e178eaea4f0d7 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.941083 6456 ts_tablet_manager.cc:1434] T 85f5ba9097674f9d889e178eaea4f0d7 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:50:27.941210 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2799563250845b0b9d7d51b2367b16b" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:27.941360 6456 tablet_bootstrap.cc:492] T cf64073cdde748bc8ed3ce7580a71160 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:27.941371 6060 raft_consensus.cc:2468] T f2799563250845b0b9d7d51b2367b16b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:27.943015 6456 tablet_bootstrap.cc:654] T cf64073cdde748bc8ed3ce7580a71160 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:27.944126 5995 leader_election.cc:343] T d5d3f96ebf1c4d05aceb06ef53737e4f P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:27.944248 5995 leader_election.cc:304] T d5d3f96ebf1c4d05aceb06ef53737e4f P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:27.944458 7986 raft_consensus.cc:2749] T d5d3f96ebf1c4d05aceb06ef53737e4f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:27.948213 6457 tablet_bootstrap.cc:492] T 146a402ff29a4e0b834a9f270d61e21c P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:27.949805 6457 tablet_bootstrap.cc:654] T 146a402ff29a4e0b834a9f270d61e21c P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:27.954167 6456 tablet_bootstrap.cc:492] T cf64073cdde748bc8ed3ce7580a71160 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:27.954316 6456 ts_tablet_manager.cc:1403] T cf64073cdde748bc8ed3ce7580a71160 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.001s
I20260923 19:50:27.955129 6456 raft_consensus.cc:359] T cf64073cdde748bc8ed3ce7580a71160 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:27.955336 6456 raft_consensus.cc:385] T cf64073cdde748bc8ed3ce7580a71160 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:27.955416 6456 raft_consensus.cc:740] T cf64073cdde748bc8ed3ce7580a71160 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:27.955660 6456 consensus_queue.cc:260] T cf64073cdde748bc8ed3ce7580a71160 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:27.956243 6456 ts_tablet_manager.cc:1434] T cf64073cdde748bc8ed3ce7580a71160 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:50:27.956559 6456 tablet_bootstrap.cc:492] T 373d6442546d41e2b5567dfc92ae07b1 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:27.960448 6456 tablet_bootstrap.cc:654] T 373d6442546d41e2b5567dfc92ae07b1 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:27.976526 6456 tablet_bootstrap.cc:492] T 373d6442546d41e2b5567dfc92ae07b1 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:27.976678 6456 ts_tablet_manager.cc:1403] T 373d6442546d41e2b5567dfc92ae07b1 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.002s
I20260923 19:50:27.978946 6456 raft_consensus.cc:359] T 373d6442546d41e2b5567dfc92ae07b1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.979113 6456 raft_consensus.cc:385] T 373d6442546d41e2b5567dfc92ae07b1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:27.979161 6456 raft_consensus.cc:740] T 373d6442546d41e2b5567dfc92ae07b1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:27.979327 6456 consensus_queue.cc:260] T 373d6442546d41e2b5567dfc92ae07b1 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:27.979745 6456 ts_tablet_manager.cc:1434] T 373d6442546d41e2b5567dfc92ae07b1 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20260923 19:50:27.979986 6456 tablet_bootstrap.cc:492] T 0f90406b20f54787bd27255d5ae81d1c P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:27.980242 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 85d35ebef3c24a2e89233dd900b63513 (table default.Table_7d891deab94f4132b4358c6e4dfd54af [id=da91b06e11c64bb0aaec37a0188b5586]) successfully deleted
W20260923 19:50:27.984628 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet f5f285e125dc445197a59e02e199a606 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5f285e125dc445197a59e02e199a606 already in progress: creating tablet
I20260923 19:50:27.984723 6461 tablet_replica.cc:333] T 26031fe469d046518cdd0f1e955e19d1 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:27.984946 6461 raft_consensus.cc:2243] T 26031fe469d046518cdd0f1e955e19d1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:27.985134 6461 raft_consensus.cc:2272] T 26031fe469d046518cdd0f1e955e19d1 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:27.987320 6456 tablet_bootstrap.cc:654] T 0f90406b20f54787bd27255d5ae81d1c P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:27.989748 7594 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "83e97b26500048d0b75350a21a8ff96b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } } }
I20260923 19:50:27.990096 7594 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b [sys.catalog]: This master's current role is: LEADER
I20260923 19:50:27.991106 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bda2ae961446bea2f34e792f4f1706" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:27.991837 6454 tablet_bootstrap.cc:492] T c5cb76fa5e084604aa58bf888cfe4852 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
W20260923 19:50:27.992026 5995 leader_election.cc:343] T 12bda2ae961446bea2f34e792f4f1706 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:27.992167 5995 leader_election.cc:304] T 12bda2ae961446bea2f34e792f4f1706 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:27.992430 7986 raft_consensus.cc:2749] T 12bda2ae961446bea2f34e792f4f1706 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:27.993472 6454 tablet_bootstrap.cc:654] T c5cb76fa5e084604aa58bf888cfe4852 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:27.994822 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_6a0c7f6b4cd74190b8ef9422a9e568b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:27.994946 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2799563250845b0b9d7d51b2367b16b" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:27.995370 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a0c7f6b4cd74190b8ef9422a9e568b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:27.995410 6280 leader_election.cc:343] T f2799563250845b0b9d7d51b2367b16b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:27.996109 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1074) took 4102 ms. Trace:
I20260923 19:50:27.996186 6459 rpcz_store.cc:276] 0923 19:50:23.893727 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:23.897809 (+ 4082us) service_pool.cc:224] Handling call
0923 19:50:27.862277 (+3964468us) ts_tablet_manager.cc:1151] Deleting tablet 86388fa08c454da9ad2ca0124dcba10b
0923 19:50:27.862286 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:27.874852 (+ 12566us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:27.906543 (+ 31691us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:27.996093 (+ 89550us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3931641}
I20260923 19:50:27.997787 6461 ts_tablet_manager.cc:1916] T 26031fe469d046518cdd0f1e955e19d1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:27.998355 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1080) took 4037 ms. Trace:
I20260923 19:50:27.998427 6459 rpcz_store.cc:276] 0923 19:50:23.961060 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:23.962248 (+ 1188us) service_pool.cc:224] Handling call
0923 19:50:27.996450 (+4034202us) ts_tablet_manager.cc:1151] Deleting tablet 7bd0ccf56ee9498f9fa42c5a03a931b6
0923 19:50:27.998239 (+ 1789us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:27.998337 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4033991}
I20260923 19:50:28.001511 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_1713583a5b0f4812b5a3f23eecca4a4f" } new_table_name: "default.Table_25e9e9791fc94c6d84574e2c38243187" modify_external_catalogs: true
I20260923 19:50:28.001894 5801 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_004d451550a547c3b795d2d6b2d32234" } modify_external_catalogs: true
I20260923 19:50:28.002038 5801 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_004d451550a547c3b795d2d6b2d32234" } modify_external_catalogs: true
I20260923 19:50:28.002743 5798 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_e74d28acc2834aac812c922e8308ff53" } modify_external_catalogs: true
I20260923 19:50:28.002856 5798 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_e74d28acc2834aac812c922e8308ff53" } modify_external_catalogs: true
W20260923 19:50:28.006873 6279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.143.193:39887, user_credentials={real_user=slave}} blocked reactor thread for 94290.8us
W20260923 19:50:28.008229 6279 leader_election.cc:343] T 3c713a0973dc45debf61c228a4bf13bf P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 3c713a0973dc45debf61c228a4bf13bf
I20260923 19:50:28.008440 6279 leader_election.cc:304] T 3c713a0973dc45debf61c228a4bf13bf P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:28.008689 7993 raft_consensus.cc:2749] T 3c713a0973dc45debf61c228a4bf13bf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:28.009253 6459 tablet_replica.cc:333] T 3d74560614b744188e759b981ad89a7d P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:28.009470 6459 raft_consensus.cc:2243] T 3d74560614b744188e759b981ad89a7d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:28.009618 6459 raft_consensus.cc:2272] T 3d74560614b744188e759b981ad89a7d P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:28.010301 6279 leader_election.cc:304] T f2799563250845b0b9d7d51b2367b16b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:28.010409 6459 ts_tablet_manager.cc:1916] T 3d74560614b744188e759b981ad89a7d P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:28.010563 7993 raft_consensus.cc:2804] T f2799563250845b0b9d7d51b2367b16b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:28.010627 7993 raft_consensus.cc:493] T f2799563250845b0b9d7d51b2367b16b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:28.010679 7993 raft_consensus.cc:3060] T f2799563250845b0b9d7d51b2367b16b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:28.013842 7993 raft_consensus.cc:515] T f2799563250845b0b9d7d51b2367b16b P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.014456 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet f0915e6df24f42b3b8b1a558b7ebc7ff
I20260923 19:50:28.014909 7993 leader_election.cc:290] T f2799563250845b0b9d7d51b2367b16b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:28.017153 5802 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_1e9ebf5c3c644666a5b6c1966fde4ed5" } modify_external_catalogs: true
I20260923 19:50:28.017293 5802 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_1e9ebf5c3c644666a5b6c1966fde4ed5" } modify_external_catalogs: true
I20260923 19:50:28.018288 6459 ts_tablet_manager.cc:1929] T 3d74560614b744188e759b981ad89a7d P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:28.018481 6459 log.cc:1199] T 3d74560614b744188e759b981ad89a7d P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/3d74560614b744188e759b981ad89a7d
I20260923 19:50:28.018657 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet f0915e6df24f42b3b8b1a558b7ebc7ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:27 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:28.018807 6459 ts_tablet_manager.cc:1950] T 3d74560614b744188e759b981ad89a7d P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:28.019336 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2799563250845b0b9d7d51b2367b16b" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
W20260923 19:50:28.020061 6280 leader_election.cc:343] T f2799563250845b0b9d7d51b2367b16b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:28.020745 6039 tablet_service.cc:1558] Processing DeleteTablet for tablet f0915e6df24f42b3b8b1a558b7ebc7ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:27 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:28.021432 6456 tablet_bootstrap.cc:492] T 0f90406b20f54787bd27255d5ae81d1c P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:28.021564 6456 ts_tablet_manager.cc:1403] T 0f90406b20f54787bd27255d5ae81d1c P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.042s user 0.000s sys 0.004s
I20260923 19:50:28.022228 6456 raft_consensus.cc:359] T 0f90406b20f54787bd27255d5ae81d1c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.025086 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1082) took 4036 ms. Trace:
I20260923 19:50:28.025223 6459 rpcz_store.cc:276] 0923 19:50:23.982644 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:23.982693 (+ 49us) service_pool.cc:224] Handling call
0923 19:50:27.998653 (+4015960us) ts_tablet_manager.cc:1151] Deleting tablet 3d74560614b744188e759b981ad89a7d
0923 19:50:28.009186 (+ 10533us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.015233 (+ 6047us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.018235 (+ 3002us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.019087 (+ 852us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4015756}
I20260923 19:50:28.025743 6459 tablet_replica.cc:333] T 658253ff3d014361803e1aeda978e59a P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:28.026002 6459 raft_consensus.cc:2243] T 658253ff3d014361803e1aeda978e59a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:28.026194 6459 raft_consensus.cc:2272] T 658253ff3d014361803e1aeda978e59a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:28.026418 5791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.143.252:45543, user_credentials={real_user=slave}} blocked reactor thread for 45494.1us
I20260923 19:50:28.026746 6459 ts_tablet_manager.cc:1916] T 658253ff3d014361803e1aeda978e59a P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:28.027786 6178 tablet_service.cc:1558] Processing DeleteTablet for tablet f0915e6df24f42b3b8b1a558b7ebc7ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:27 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:28.027904 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 86388fa08c454da9ad2ca0124dcba10b (table default.Table_4803d401dac84700919d6879b552cd8d [id=2973ea17373f4ec181b54ab66028a774]) successfully deleted
W20260923 19:50:28.028122 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 7bd0ccf56ee9498f9fa42c5a03a931b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7bd0ccf56ee9498f9fa42c5a03a931b6 already in progress: creating tablet
I20260923 19:50:28.027788 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet d3f7b33bbf3f453e8e841ee5d99c5b31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:28.028674 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 3d74560614b744188e759b981ad89a7d (table default.Table_ca447ba1a2d04e7ab8954432c4a42c97 [id=7a040306f6064b3d8d10bdb87ab32247]) successfully deleted
I20260923 19:50:28.028865 6456 raft_consensus.cc:385] T 0f90406b20f54787bd27255d5ae81d1c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:28.028954 6456 raft_consensus.cc:740] T 0f90406b20f54787bd27255d5ae81d1c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:28.029168 6456 consensus_queue.cc:260] T 0f90406b20f54787bd27255d5ae81d1c P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.029675 6456 ts_tablet_manager.cc:1434] T 0f90406b20f54787bd27255d5ae81d1c P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260923 19:50:28.029984 6456 tablet_bootstrap.cc:492] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:28.030647 8055 raft_consensus.cc:493] T 0a5ce253bcce410b9517449f133d39e8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bf41435f70447f19992d368ca6b46bd)
I20260923 19:50:28.030781 8055 raft_consensus.cc:515] T 0a5ce253bcce410b9517449f133d39e8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.031440 8055 leader_election.cc:290] T 0a5ce253bcce410b9517449f133d39e8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:28.032058 6456 tablet_bootstrap.cc:654] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:28.032438 6139 leader_election.cc:343] T 0a5ce253bcce410b9517449f133d39e8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 0a5ce253bcce410b9517449f133d39e8
W20260923 19:50:28.033130 6137 leader_election.cc:343] T 0a5ce253bcce410b9517449f133d39e8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 0a5ce253bcce410b9517449f133d39e8
I20260923 19:50:28.033255 6137 leader_election.cc:304] T 0a5ce253bcce410b9517449f133d39e8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:28.033655 7980 raft_consensus.cc:2749] T 0a5ce253bcce410b9517449f133d39e8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 19:50:28.038872 6054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2799563250845b0b9d7d51b2367b16b" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:28.039072 6054 raft_consensus.cc:3060] T f2799563250845b0b9d7d51b2367b16b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:28.039633 6457 tablet_bootstrap.cc:492] T 146a402ff29a4e0b834a9f270d61e21c P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:28.039589 8049 raft_consensus.cc:493] T 373d6442546d41e2b5567dfc92ae07b1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.039762 6457 ts_tablet_manager.cc:1403] T 146a402ff29a4e0b834a9f270d61e21c P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.092s user 0.001s sys 0.009s
I20260923 19:50:28.039749 8049 raft_consensus.cc:515] T 373d6442546d41e2b5567dfc92ae07b1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.040652 6457 raft_consensus.cc:359] T 146a402ff29a4e0b834a9f270d61e21c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.040788 6457 raft_consensus.cc:385] T 146a402ff29a4e0b834a9f270d61e21c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:28.040833 6457 raft_consensus.cc:740] T 146a402ff29a4e0b834a9f270d61e21c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:28.041075 8049 leader_election.cc:290] T 373d6442546d41e2b5567dfc92ae07b1 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:28.041199 6457 consensus_queue.cc:260] T 146a402ff29a4e0b834a9f270d61e21c P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.041843 6054 raft_consensus.cc:2468] T f2799563250845b0b9d7d51b2367b16b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:28.042156 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373d6442546d41e2b5567dfc92ae07b1" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:28.042949 6280 leader_election.cc:343] T 373d6442546d41e2b5567dfc92ae07b1 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:28.044101 6457 ts_tablet_manager.cc:1434] T 146a402ff29a4e0b834a9f270d61e21c P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260923 19:50:28.044411 6457 tablet_bootstrap.cc:492] T 8b8a973b247343008a29d67dfa712a0b P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:28.044721 6454 tablet_bootstrap.cc:492] T c5cb76fa5e084604aa58bf888cfe4852 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:28.044860 6454 ts_tablet_manager.cc:1403] T c5cb76fa5e084604aa58bf888cfe4852 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.053s user 0.002s sys 0.000s
I20260923 19:50:28.046172 6457 tablet_bootstrap.cc:654] T 8b8a973b247343008a29d67dfa712a0b P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:28.047374 6279 leader_election.cc:304] T f2799563250845b0b9d7d51b2367b16b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
W20260923 19:50:28.052265 6279 leader_election.cc:343] T 373d6442546d41e2b5567dfc92ae07b1 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 373d6442546d41e2b5567dfc92ae07b1
I20260923 19:50:28.052601 5797 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_03b07fc0700f4beaa669406e95bdba50" } modify_external_catalogs: true
I20260923 19:50:28.052774 5797 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_03b07fc0700f4beaa669406e95bdba50" } modify_external_catalogs: true
I20260923 19:50:28.052474 6279 leader_election.cc:304] T 373d6442546d41e2b5567dfc92ae07b1 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:28.054517 5803 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_cb7602c69419443490c9e41050e22b2c" } new_table_name: "default.Table_7a817dc7d005417a847ee0402080fe76" modify_external_catalogs: true
I20260923 19:50:28.054924 8055 raft_consensus.cc:493] T 397ec5e49673406cb26a2efab0ad8401 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.055068 8055 raft_consensus.cc:515] T 397ec5e49673406cb26a2efab0ad8401 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
W20260923 19:50:28.055738 5800 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5ccef781d8a84ff298051f5da709fe85 consensus state has no leader
I20260923 19:50:28.055725 7993 raft_consensus.cc:2804] T f2799563250845b0b9d7d51b2367b16b P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:28.055841 7993 raft_consensus.cc:697] T f2799563250845b0b9d7d51b2367b16b P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:28.056075 7993 consensus_queue.cc:237] T f2799563250845b0b9d7d51b2367b16b P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.056111 5800 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_8038669b54be49eeb28df9b063c7af2f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:28.056582 5800 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8038669b54be49eeb28df9b063c7af2f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:28.056782 7826 raft_consensus.cc:2749] T 373d6442546d41e2b5567dfc92ae07b1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:28.059487 8055 leader_election.cc:290] T 397ec5e49673406cb26a2efab0ad8401 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:28.060076 6454 raft_consensus.cc:359] T c5cb76fa5e084604aa58bf888cfe4852 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.060221 6454 raft_consensus.cc:385] T c5cb76fa5e084604aa58bf888cfe4852 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:28.060262 6454 raft_consensus.cc:740] T c5cb76fa5e084604aa58bf888cfe4852 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:28.060474 6454 consensus_queue.cc:260] T c5cb76fa5e084604aa58bf888cfe4852 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.060612 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec5e49673406cb26a2efab0ad8401" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:28.061075 6454 ts_tablet_manager.cc:1434] T c5cb76fa5e084604aa58bf888cfe4852 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260923 19:50:28.064414 5801 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 907bfabdc1f948d4872363b44bea154a
I20260923 19:50:28.065086 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 907bfabdc1f948d4872363b44bea154a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:28 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:28.065822 6039 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c6f9953649a43aa9a0edd78b7bd47a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:28.066025 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397ec5e49673406cb26a2efab0ad8401" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:28.066187 6039 tablet_service.cc:1558] Processing DeleteTablet for tablet d5d3f96ebf1c4d05aceb06ef53737e4f with delete_type TABLET_DATA_DELETED (replaced by tablet 7595c09be8784a948027dd923c4b023e) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:28.066466 6039 tablet_service.cc:1558] Processing DeleteTablet for tablet 907bfabdc1f948d4872363b44bea154a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:28 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:28.066782 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet 907bfabdc1f948d4872363b44bea154a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:28 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:28.067749 6454 tablet_bootstrap.cc:492] T 0e650824e4ae474787faeb6c22a4b43f P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:28.069119 6454 tablet_bootstrap.cc:654] T 0e650824e4ae474787faeb6c22a4b43f P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:28.069681 6137 leader_election.cc:304] T 397ec5e49673406cb26a2efab0ad8401 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:28.069947 8055 raft_consensus.cc:2749] T 397ec5e49673406cb26a2efab0ad8401 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:28.074124 5805 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 40adb472162042e48fdbb496b342996a (table default.Table_9430735288754d599f68f15e1d52c0cf [id=8fe16214ad774a54982dbadeac1b4235]). Expected version 2 got 0
I20260923 19:50:28.074623 6457 tablet_bootstrap.cc:492] T 8b8a973b247343008a29d67dfa712a0b P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:28.074851 6457 ts_tablet_manager.cc:1403] T 8b8a973b247343008a29d67dfa712a0b P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.002s
I20260923 19:50:28.075865 6457 raft_consensus.cc:359] T 8b8a973b247343008a29d67dfa712a0b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.076164 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet c5cb76fa5e084604aa58bf888cfe4852 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:28.076284 6199 raft_consensus.cc:3060] T 397ec5e49673406cb26a2efab0ad8401 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:28.076749 6039 tablet_service.cc:1558] Processing DeleteTablet for tablet 146a402ff29a4e0b834a9f270d61e21c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:28.077077 6457 raft_consensus.cc:385] T 8b8a973b247343008a29d67dfa712a0b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:28.077178 6457 raft_consensus.cc:740] T 8b8a973b247343008a29d67dfa712a0b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:28.077419 6457 consensus_queue.cc:260] T 8b8a973b247343008a29d67dfa712a0b P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.079551 6040 tablet_service.cc:1558] Processing DeleteTablet for tablet b6ef90ddd7a34dfdb8309d0e1c3688e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:28.082998 6457 ts_tablet_manager.cc:1434] T 8b8a973b247343008a29d67dfa712a0b P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260923 19:50:28.083057 6459 ts_tablet_manager.cc:1929] T 658253ff3d014361803e1aeda978e59a P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:28.083160 6459 log.cc:1199] T 658253ff3d014361803e1aeda978e59a P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/658253ff3d014361803e1aeda978e59a
I20260923 19:50:28.083470 6459 ts_tablet_manager.cc:1950] T 658253ff3d014361803e1aeda978e59a P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:28.084205 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1083) took 4097 ms. Trace:
I20260923 19:50:28.084287 6459 rpcz_store.cc:276] 0923 19:50:23.986546 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:23.986605 (+ 59us) service_pool.cc:224] Handling call
0923 19:50:28.025695 (+4039090us) ts_tablet_manager.cc:1151] Deleting tablet 658253ff3d014361803e1aeda978e59a
0923 19:50:28.025706 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.067282 (+ 41576us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.082998 (+ 15716us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.084184 (+ 1186us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4038877}
I20260923 19:50:28.084605 6459 tablet_replica.cc:333] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:28.084770 6459 raft_consensus.cc:2243] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:28.084895 6459 raft_consensus.cc:2272] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:28.085376 6459 ts_tablet_manager.cc:1916] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:28.085706 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 658253ff3d014361803e1aeda978e59a (table default.Table_493eae9e089b423ca42a863b541f4ec4 [id=374e9291e4564d47a5a9bab50f013952]) successfully deleted
W20260923 19:50:28.086522 6108 tablet.cc:2433] T 146a402ff29a4e0b834a9f270d61e21c P e546f660e7e541d1aa9ae38e5ee5b9c0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:50:28.090755 6457 tablet_bootstrap.cc:492] T 839bcf991b754f9e95a1dd6c4f826e71 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:28.092474 5797 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 9968ab539c9149e98aa5326c208ce140
W20260923 19:50:28.093204 5803 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 001523cd54e842fd926f48419e46c435 has no consensus state
I20260923 19:50:28.094192 6040 tablet_service.cc:1558] Processing DeleteTablet for tablet 9968ab539c9149e98aa5326c208ce140 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:28 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:28.094369 6457 tablet_bootstrap.cc:654] T 839bcf991b754f9e95a1dd6c4f826e71 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:28.095474 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 9968ab539c9149e98aa5326c208ce140 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:28 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:28.095640 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet 9968ab539c9149e98aa5326c208ce140 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:28 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:28.101572 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_ed22033b8aa14771a6556e39f1edfe4b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:28.102324 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed22033b8aa14771a6556e39f1edfe4b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:28.103749 5797 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_4184b49cb50842f3bef045f918a6d9ec" } new_table_name: "default.Table_ec7c5197e3184bf29b9ca1f6e8eeac0f" modify_external_catalogs: true
I20260923 19:50:28.103878 7993 raft_consensus.cc:493] T 85f5ba9097674f9d889e178eaea4f0d7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.104007 7993 raft_consensus.cc:515] T 85f5ba9097674f9d889e178eaea4f0d7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.104310 5801 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_2dc82647d3b74ebb9d0c0c87c981535c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:28.104347 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_f61890549c354792ac2571c3d169f4c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:28.104744 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f61890549c354792ac2571c3d169f4c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:28.104749 5801 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2dc82647d3b74ebb9d0c0c87c981535c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:28.107038 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_0eb28975495e4bedaf7c538454e525f6" } new_table_name: "default.Table_2bf96f2a45e54e94b4cd9d8493636030" modify_external_catalogs: true
I20260923 19:50:28.108646 7993 leader_election.cc:290] T 85f5ba9097674f9d889e178eaea4f0d7 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:28.110555 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f5ba9097674f9d889e178eaea4f0d7" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:28.111783 6461 ts_tablet_manager.cc:1929] T 26031fe469d046518cdd0f1e955e19d1 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260923 19:50:28.111883 6461 log.cc:1199] T 26031fe469d046518cdd0f1e955e19d1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/26031fe469d046518cdd0f1e955e19d1
W20260923 19:50:28.114033 6280 leader_election.cc:343] T 85f5ba9097674f9d889e178eaea4f0d7 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:28.116143 6454 tablet_bootstrap.cc:492] T 0e650824e4ae474787faeb6c22a4b43f P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:28.116276 6454 ts_tablet_manager.cc:1403] T 0e650824e4ae474787faeb6c22a4b43f P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.049s user 0.002s sys 0.001s
I20260923 19:50:28.116925 6454 raft_consensus.cc:359] T 0e650824e4ae474787faeb6c22a4b43f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.117144 6454 raft_consensus.cc:385] T 0e650824e4ae474787faeb6c22a4b43f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:28.117223 6454 raft_consensus.cc:740] T 0e650824e4ae474787faeb6c22a4b43f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:28.117451 6454 consensus_queue.cc:260] T 0e650824e4ae474787faeb6c22a4b43f P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.118047 6454 ts_tablet_manager.cc:1434] T 0e650824e4ae474787faeb6c22a4b43f P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:28.118357 5695 master-stress-test.cc:579] Killing test thread 1/25
I20260923 19:50:28.121701 5695 master-stress-test.cc:581] Killed test thread 1/25
I20260923 19:50:28.121809 5695 master-stress-test.cc:579] Killing test thread 2/25
I20260923 19:50:28.122735 6454 tablet_bootstrap.cc:492] T ba639d8c68cf49a49a5ec5729143cf6b P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:28.124298 6454 tablet_bootstrap.cc:654] T ba639d8c68cf49a49a5ec5729143cf6b P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:28.126209 5805 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_c226d135e45747ee938348bb6951dc4b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:28.127229 5805 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c226d135e45747ee938348bb6951dc4b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:28.130270 7986 raft_consensus.cc:493] T 4c6f9953649a43aa9a0edd78b7bd47a4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.130406 7986 raft_consensus.cc:515] T 4c6f9953649a43aa9a0edd78b7bd47a4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.130981 7986 leader_election.cc:290] T 4c6f9953649a43aa9a0edd78b7bd47a4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:28.134876 6461 ts_tablet_manager.cc:1950] T 26031fe469d046518cdd0f1e955e19d1 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:28.135282 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f9953649a43aa9a0edd78b7bd47a4" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:28.135689 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6f9953649a43aa9a0edd78b7bd47a4" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:28.135713 5803 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_c88a994ba635433bb4174e090650a738"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 19:50:28.136206 5803 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c88a994ba635433bb4174e090650a738 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260923 19:50:28.136336 5996 leader_election.cc:343] T 4c6f9953649a43aa9a0edd78b7bd47a4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:28.136547 5995 leader_election.cc:343] T 4c6f9953649a43aa9a0edd78b7bd47a4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:28.136646 5995 leader_election.cc:304] T 4c6f9953649a43aa9a0edd78b7bd47a4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:28.136897 7986 raft_consensus.cc:2749] T 4c6f9953649a43aa9a0edd78b7bd47a4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:28.137045 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 26031fe469d046518cdd0f1e955e19d1 (table default.Table_d6a453784ebd47b9b8c169ab766d6c23 [id=82cba3f0e2f64118a0747fe6ff9bc796]) successfully deleted
I20260923 19:50:28.138294 6454 tablet_bootstrap.cc:492] T ba639d8c68cf49a49a5ec5729143cf6b P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:28.138444 6454 ts_tablet_manager.cc:1403] T ba639d8c68cf49a49a5ec5729143cf6b P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.001s
I20260923 19:50:28.139190 6454 raft_consensus.cc:359] T ba639d8c68cf49a49a5ec5729143cf6b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.139356 6454 raft_consensus.cc:385] T ba639d8c68cf49a49a5ec5729143cf6b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:28.139423 6454 raft_consensus.cc:740] T ba639d8c68cf49a49a5ec5729143cf6b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
W20260923 19:50:28.139998 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet fb44c10b4f6148738306c617aac88b43 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb44c10b4f6148738306c617aac88b43 already in progress: creating tablet
W20260923 19:50:28.140264 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 039419cd51504cf2af724d92cbaa8858 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 039419cd51504cf2af724d92cbaa8858 already in progress: creating tablet
I20260923 19:50:28.141074 6457 tablet_bootstrap.cc:492] T 839bcf991b754f9e95a1dd6c4f826e71 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:28.141247 6457 ts_tablet_manager.cc:1403] T 839bcf991b754f9e95a1dd6c4f826e71 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.051s user 0.002s sys 0.002s
I20260923 19:50:28.142043 6457 raft_consensus.cc:359] T 839bcf991b754f9e95a1dd6c4f826e71 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.142264 6457 raft_consensus.cc:385] T 839bcf991b754f9e95a1dd6c4f826e71 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:28.142367 6457 raft_consensus.cc:740] T 839bcf991b754f9e95a1dd6c4f826e71 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:28.142664 6457 consensus_queue.cc:260] T 839bcf991b754f9e95a1dd6c4f826e71 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.144505 6459 ts_tablet_manager.cc:1929] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:28.148607 6457 ts_tablet_manager.cc:1434] T 839bcf991b754f9e95a1dd6c4f826e71 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260923 19:50:28.152552 6459 log.cc:1199] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/c012b2a92dc14f2ab5d9f4fe8a6a7779
I20260923 19:50:28.154381 6457 tablet_bootstrap.cc:492] T 18a31ed6bea444e7888f374927f90a60 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:28.156031 6457 tablet_bootstrap.cc:654] T 18a31ed6bea444e7888f374927f90a60 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:28.156602 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet d525bdd4c25843c988865553bd2b3066 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d525bdd4c25843c988865553bd2b3066 already in progress: creating tablet
W20260923 19:50:28.156901 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet db943a36b2fe4ca9813e08ddb38ce7f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db943a36b2fe4ca9813e08ddb38ce7f6 already in progress: creating tablet
W20260923 19:50:28.157131 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet e8b0d0a8e4e54ec195893127f7a76bed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e8b0d0a8e4e54ec195893127f7a76bed already in progress: creating tablet
W20260923 19:50:28.157325 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet f0915e6df24f42b3b8b1a558b7ebc7ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0915e6df24f42b3b8b1a558b7ebc7ff already in progress: creating tablet
I20260923 19:50:28.158238 6459 ts_tablet_manager.cc:1950] T c012b2a92dc14f2ab5d9f4fe8a6a7779 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:28.159879 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1081) took 4177 ms. Trace:
I20260923 19:50:28.162454 6459 rpcz_store.cc:276] 0923 19:50:23.982533 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:24.012705 (+ 30172us) service_pool.cc:224] Handling call
0923 19:50:28.084561 (+4071856us) ts_tablet_manager.cc:1151] Deleting tablet c012b2a92dc14f2ab5d9f4fe8a6a7779
0923 19:50:28.084570 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.120051 (+ 35481us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.144453 (+ 24402us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.159859 (+ 15406us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4071577}
I20260923 19:50:28.163301 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1087) took 4064 ms. Trace:
I20260923 19:50:28.163311 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet c012b2a92dc14f2ab5d9f4fe8a6a7779 (table default.Table_036d9052e0264e978bf3e3698ca8c08b [id=b2fef7fe862a41e493f5e1646b41bd5f]) successfully deleted
I20260923 19:50:28.163785 6459 rpcz_store.cc:276] 0923 19:50:24.099058 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:24.099113 (+ 55us) service_pool.cc:224] Handling call
0923 19:50:28.163166 (+4064053us) ts_tablet_manager.cc:1151] Deleting tablet 9d5f5dcaf6f94fd1afa713d42c0ab037
0923 19:50:28.163178 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.163282 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4063842}
I20260923 19:50:28.164397 6459 tablet_replica.cc:333] T 7af330ae1aaa48209f2bd1880bcfebb1 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:28.164404 6458 ts_tablet_manager.cc:1929] T 9c4a200d16464676976694656cbe28e2 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:50:28.164659 6458 log.cc:1199] T 9c4a200d16464676976694656cbe28e2 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/9c4a200d16464676976694656cbe28e2
I20260923 19:50:28.164988 6459 raft_consensus.cc:2243] T 7af330ae1aaa48209f2bd1880bcfebb1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:28.157198 6461 tablet_replica.cc:333] T 4c6f9953649a43aa9a0edd78b7bd47a4 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
W20260923 19:50:28.165131 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 9d5f5dcaf6f94fd1afa713d42c0ab037 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d5f5dcaf6f94fd1afa713d42c0ab037 already in progress: creating tablet
I20260923 19:50:28.165277 6461 raft_consensus.cc:2243] T 4c6f9953649a43aa9a0edd78b7bd47a4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:28.165457 6461 raft_consensus.cc:2272] T 4c6f9953649a43aa9a0edd78b7bd47a4 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:28.165458 6459 raft_consensus.cc:2272] T 7af330ae1aaa48209f2bd1880bcfebb1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:28.157370 6454 consensus_queue.cc:260] T ba639d8c68cf49a49a5ec5729143cf6b P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.165782 6458 ts_tablet_manager.cc:1950] T 9c4a200d16464676976694656cbe28e2 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:28.166186 6461 ts_tablet_manager.cc:1916] T 4c6f9953649a43aa9a0edd78b7bd47a4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:28.166806 6454 ts_tablet_manager.cc:1434] T ba639d8c68cf49a49a5ec5729143cf6b P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.028s user 0.002s sys 0.000s
I20260923 19:50:28.167078 6454 tablet_bootstrap.cc:492] T 2852e91ccd0c44b3b16f8189e57575d7 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:28.178233 6459 ts_tablet_manager.cc:1916] T 7af330ae1aaa48209f2bd1880bcfebb1 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:28.178651 6279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.5.143.193:39887, user_credentials={real_user=slave}} blocked reactor thread for 79270.7us
I20260923 19:50:28.178300 6454 tablet_bootstrap.cc:654] T 2852e91ccd0c44b3b16f8189e57575d7 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:28.185200 6393 tablet.cc:2433] T 0f90406b20f54787bd27255d5ae81d1c P 2bf41435f70447f19992d368ca6b46bd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:50:28.189328 6454 tablet_bootstrap.cc:492] T 2852e91ccd0c44b3b16f8189e57575d7 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:28.189484 6454 ts_tablet_manager.cc:1403] T 2852e91ccd0c44b3b16f8189e57575d7 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.000s
I20260923 19:50:28.193251 7986 raft_consensus.cc:493] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.195956 7986 raft_consensus.cc:515] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.196717 7986 leader_election.cc:290] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:28.198101 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ef90ddd7a34dfdb8309d0e1c3688e7" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:28.198688 5995 leader_election.cc:343] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:28.190224 6454 raft_consensus.cc:359] T 2852e91ccd0c44b3b16f8189e57575d7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.199069 6454 raft_consensus.cc:385] T 2852e91ccd0c44b3b16f8189e57575d7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:28.199149 6454 raft_consensus.cc:740] T 2852e91ccd0c44b3b16f8189e57575d7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
W20260923 19:50:28.200955 5790 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 001523cd54e842fd926f48419e46c435 (table default.Table_7a817dc7d005417a847ee0402080fe76 [id=d61abaee27364bb2bfcf45b160b9ffd1], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 001523cd54e842fd926f48419e46c435 has no consensus state
I20260923 19:50:28.207891 6461 ts_tablet_manager.cc:1929] T 4c6f9953649a43aa9a0edd78b7bd47a4 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:28.208022 6461 log.cc:1199] T 4c6f9953649a43aa9a0edd78b7bd47a4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/4c6f9953649a43aa9a0edd78b7bd47a4
I20260923 19:50:28.208331 6461 ts_tablet_manager.cc:1950] T 4c6f9953649a43aa9a0edd78b7bd47a4 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:28.210923 6454 consensus_queue.cc:260] T 2852e91ccd0c44b3b16f8189e57575d7 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
W20260923 19:50:28.213086 5797 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b4f6b19ec93b4342885f27fc24ea7b18 consensus state has no leader
I20260923 19:50:28.213548 5800 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59912:
table { table_name: "default.Table_f6755f452e8d41c4b9d64c3ee2735188" } new_table_name: "default.Table_3dfc627cb077492dadef1e21d7613ebc" modify_external_catalogs: true
I20260923 19:50:28.214716 6454 ts_tablet_manager.cc:1434] T 2852e91ccd0c44b3b16f8189e57575d7 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.025s user 0.002s sys 0.000s
I20260923 19:50:28.214984 6454 tablet_bootstrap.cc:492] T 40adb472162042e48fdbb496b342996a P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:28.215538 5804 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59912:
name: "default.Table_635e873370874d5286a4991d32624567"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 19:50:28.215858 5797 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 397ec5e49673406cb26a2efab0ad8401 (table default.Table_92f3bea4e4164a738fb75f01e95cd776 [id=0b80967a8fb94518ad872fbce9bae934]). Expected version 1 got 0
W20260923 19:50:28.216035 5804 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_635e873370874d5286a4991d32624567 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 19:50:28.217098 6454 tablet_bootstrap.cc:654] T 40adb472162042e48fdbb496b342996a P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:28.219692 7986 raft_consensus.cc:493] T a6da9b3eea4547c9bb80b08bd26c5dc2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.219866 7986 raft_consensus.cc:515] T a6da9b3eea4547c9bb80b08bd26c5dc2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.220479 7986 leader_election.cc:290] T a6da9b3eea4547c9bb80b08bd26c5dc2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:28.221807 6255 tablet.cc:2433] T 0e650824e4ae474787faeb6c22a4b43f P 61022dd7f2f14dc19aebe3af5f08f430: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 19:50:28.224014 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6da9b3eea4547c9bb80b08bd26c5dc2" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:28.226552 5805 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 397ec5e49673406cb26a2efab0ad8401 (table default.Table_92f3bea4e4164a738fb75f01e95cd776 [id=0b80967a8fb94518ad872fbce9bae934]). Expected version 1 got 0
I20260923 19:50:28.226737 5805 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 0e650824e4ae474787faeb6c22a4b43f (table default.Table_5572c14c35d14aa8bc14916e403dfe0f [id=bf2950f7469241d390951965f4e98f23]). Expected version 3 got 0
W20260923 19:50:28.224481 5995 leader_election.cc:343] T a6da9b3eea4547c9bb80b08bd26c5dc2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:28.227164 6279 leader_election.cc:343] T 85f5ba9097674f9d889e178eaea4f0d7 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 85f5ba9097674f9d889e178eaea4f0d7
I20260923 19:50:28.228220 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet 2852e91ccd0c44b3b16f8189e57575d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:28.228452 6178 tablet_service.cc:1558] Processing DeleteTablet for tablet ba639d8c68cf49a49a5ec5729143cf6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:28.229327 6279 leader_election.cc:304] T 85f5ba9097674f9d889e178eaea4f0d7 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:28.230465 7993 raft_consensus.cc:2749] T 85f5ba9097674f9d889e178eaea4f0d7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:28.232537 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 4c6f9953649a43aa9a0edd78b7bd47a4 (table default.Table_dc4eebd8c2d34e1b988008ab9b783cff [id=dda3ef495bce4b87bf1429ed45b3e194]) successfully deleted
I20260923 19:50:28.232846 6461 tablet_replica.cc:333] T d5d3f96ebf1c4d05aceb06ef53737e4f P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:28.236559 6340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ef90ddd7a34dfdb8309d0e1c3688e7" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:28.236559 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6da9b3eea4547c9bb80b08bd26c5dc2" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:28.237777 5996 leader_election.cc:343] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:28.237970 5996 leader_election.cc:304] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:28.238308 8053 raft_consensus.cc:2749] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:28.238469 5996 leader_election.cc:343] T a6da9b3eea4547c9bb80b08bd26c5dc2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:28.238577 5996 leader_election.cc:304] T a6da9b3eea4547c9bb80b08bd26c5dc2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:28.239017 8053 raft_consensus.cc:2749] T a6da9b3eea4547c9bb80b08bd26c5dc2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:28.240068 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1208) took 1514 ms. Trace:
I20260923 19:50:28.246114 8097 tablet.cc:1751] T 40adb472162042e48fdbb496b342996a P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:28.246609 6459 ts_tablet_manager.cc:1929] T 7af330ae1aaa48209f2bd1880bcfebb1 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:28.253041 6459 log.cc:1199] T 7af330ae1aaa48209f2bd1880bcfebb1 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/7af330ae1aaa48209f2bd1880bcfebb1
I20260923 19:50:28.254833 6459 ts_tablet_manager.cc:1950] T 7af330ae1aaa48209f2bd1880bcfebb1 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:28.255599 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1090) took 4140 ms. Trace:
I20260923 19:50:28.255537 6458 rpcz_store.cc:276] 0923 19:50:26.725374 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:26.725794 (+ 420us) service_pool.cc:224] Handling call
0923 19:50:27.899777 (+1173983us) ts_tablet_manager.cc:1151] Deleting tablet 9c4a200d16464676976694656cbe28e2
0923 19:50:27.899785 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:27.903951 (+ 4166us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.164322 (+260371us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.240044 (+ 75722us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1173750}
I20260923 19:50:28.256330 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 9c4a200d16464676976694656cbe28e2 (table default.Table_1e9ebf5c3c644666a5b6c1966fde4ed5 [id=5f2289c487ba40b9b7954c9d56918687]) successfully deleted
I20260923 19:50:28.256916 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1211) took 1505 ms. Trace:
I20260923 19:50:28.257081 6458 rpcz_store.cc:276] 0923 19:50:26.751298 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:26.751694 (+ 396us) service_pool.cc:224] Handling call
0923 19:50:28.256758 (+1505064us) ts_tablet_manager.cc:1151] Deleting tablet 2f45d03e655042d18dcbded39b3a8df6
0923 19:50:28.256773 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.256896 (+ 123us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1504890}
W20260923 19:50:28.257910 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 2f45d03e655042d18dcbded39b3a8df6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f45d03e655042d18dcbded39b3a8df6 already in progress: creating tablet
I20260923 19:50:28.258322 6458 tablet_replica.cc:333] T 22c89609da884c47b1dbc1470b37efbe P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:28.258307 6459 rpcz_store.cc:276] 0923 19:50:24.114904 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:24.114968 (+ 64us) service_pool.cc:224] Handling call
0923 19:50:28.164344 (+4049376us) ts_tablet_manager.cc:1151] Deleting tablet 7af330ae1aaa48209f2bd1880bcfebb1
0923 19:50:28.164354 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.184761 (+ 20407us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.246513 (+ 61752us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.255584 (+ 9071us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4049190}
I20260923 19:50:28.258704 6458 raft_consensus.cc:2243] T 22c89609da884c47b1dbc1470b37efbe P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:28.258946 6458 raft_consensus.cc:2272] T 22c89609da884c47b1dbc1470b37efbe P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:28.259151 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 7af330ae1aaa48209f2bd1880bcfebb1 (table default.Table_cd491412a6264b6aba16b6648a128b0f [id=fda97d4d322f453296d283fffa052c35]) successfully deleted
I20260923 19:50:28.259198 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1088) took 4144 ms. Trace:
I20260923 19:50:28.259285 6459 rpcz_store.cc:276] 0923 19:50:24.114681 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:24.115293 (+ 612us) service_pool.cc:224] Handling call
0923 19:50:28.259062 (+4143769us) ts_tablet_manager.cc:1151] Deleting tablet fc71e2911b9e4d1eb3fcebe7d1e4d96c
0923 19:50:28.259084 (+ 22us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.259180 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4143602}
I20260923 19:50:28.260051 6458 ts_tablet_manager.cc:1916] T 22c89609da884c47b1dbc1470b37efbe P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:28.266825 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1089) took 4152 ms. Trace:
W20260923 19:50:28.266873 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet fc71e2911b9e4d1eb3fcebe7d1e4d96c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc71e2911b9e4d1eb3fcebe7d1e4d96c already in progress: creating tablet
I20260923 19:50:28.267472 6459 rpcz_store.cc:276] 0923 19:50:24.114781 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:24.116533 (+ 1752us) service_pool.cc:224] Handling call
0923 19:50:28.266708 (+4150175us) ts_tablet_manager.cc:1151] Deleting tablet 992ffd38518347fd9b69cd2d9e99c28a
0923 19:50:28.266719 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.266809 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4149918}
I20260923 19:50:28.267797 6459 tablet_replica.cc:333] T 21bf33904ede470b80a074dc9a458baf P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
W20260923 19:50:28.267879 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 992ffd38518347fd9b69cd2d9e99c28a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 992ffd38518347fd9b69cd2d9e99c28a already in progress: creating tablet
I20260923 19:50:28.268002 6459 raft_consensus.cc:2243] T 21bf33904ede470b80a074dc9a458baf P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:28.267143 6454 tablet_bootstrap.cc:492] T 40adb472162042e48fdbb496b342996a P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:28.269915 6459 raft_consensus.cc:2272] T 21bf33904ede470b80a074dc9a458baf P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:28.270200 6454 ts_tablet_manager.cc:1403] T 40adb472162042e48fdbb496b342996a P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.055s user 0.004s sys 0.000s
I20260923 19:50:28.270478 6459 ts_tablet_manager.cc:1916] T 21bf33904ede470b80a074dc9a458baf P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:28.270912 6454 raft_consensus.cc:359] T 40adb472162042e48fdbb496b342996a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.271113 6454 raft_consensus.cc:385] T 40adb472162042e48fdbb496b342996a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:28.271174 6454 raft_consensus.cc:740] T 40adb472162042e48fdbb496b342996a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:28.271370 6454 consensus_queue.cc:260] T 40adb472162042e48fdbb496b342996a P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.245545 8095 tablet.cc:1751] T 40adb472162042e48fdbb496b342996a P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:28.233045 6461 raft_consensus.cc:2243] T d5d3f96ebf1c4d05aceb06ef53737e4f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:28.250676 6040 tablet_service.cc:1558] Processing DeleteTablet for tablet 839bcf991b754f9e95a1dd6c4f826e71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:28.278174 6461 raft_consensus.cc:2272] T d5d3f96ebf1c4d05aceb06ef53737e4f P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:28.278846 6461 ts_tablet_manager.cc:1916] T d5d3f96ebf1c4d05aceb06ef53737e4f P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:28.279116 8103 tablet.cc:1751] T ad29d22a82434023991ffcacf7f9bee5 P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:28.281494 8104 tablet.cc:1751] T ad29d22a82434023991ffcacf7f9bee5 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:28.286623 8053 raft_consensus.cc:493] T 839bcf991b754f9e95a1dd6c4f826e71 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.286758 8053 raft_consensus.cc:515] T 839bcf991b754f9e95a1dd6c4f826e71 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.287405 8053 leader_election.cc:290] T 839bcf991b754f9e95a1dd6c4f826e71 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:28.287700 6457 tablet_bootstrap.cc:492] T 18a31ed6bea444e7888f374927f90a60 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:28.287834 6457 ts_tablet_manager.cc:1403] T 18a31ed6bea444e7888f374927f90a60 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.134s user 0.008s sys 0.002s
I20260923 19:50:28.288290 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839bcf991b754f9e95a1dd6c4f826e71" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:28.288339 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839bcf991b754f9e95a1dd6c4f826e71" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:28.288899 5996 leader_election.cc:343] T 839bcf991b754f9e95a1dd6c4f826e71 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:28.289151 5995 leader_election.cc:343] T 839bcf991b754f9e95a1dd6c4f826e71 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:28.289243 5995 leader_election.cc:304] T 839bcf991b754f9e95a1dd6c4f826e71 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:28.289680 8053 raft_consensus.cc:2749] T 839bcf991b754f9e95a1dd6c4f826e71 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:28.290201 8102 tablet.cc:1751] T ad29d22a82434023991ffcacf7f9bee5 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:28.291965 8049 raft_consensus.cc:493] T f8007918eca14c81947e5999fe13a705 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.292203 8049 raft_consensus.cc:515] T f8007918eca14c81947e5999fe13a705 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.293268 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8007918eca14c81947e5999fe13a705" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:28.293330 8049 leader_election.cc:290] T f8007918eca14c81947e5999fe13a705 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:28.293751 6280 leader_election.cc:343] T f8007918eca14c81947e5999fe13a705 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:28.294755 6279 leader_election.cc:343] T f8007918eca14c81947e5999fe13a705 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: f8007918eca14c81947e5999fe13a705
I20260923 19:50:28.294899 6279 leader_election.cc:304] T f8007918eca14c81947e5999fe13a705 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:28.295280 8049 raft_consensus.cc:2749] T f8007918eca14c81947e5999fe13a705 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:28.298358 5695 master-stress-test.cc:581] Killed test thread 2/25
I20260923 19:50:28.298465 5695 master-stress-test.cc:579] Killing test thread 3/25
I20260923 19:50:28.298537 5695 master-stress-test.cc:581] Killed test thread 3/25
I20260923 19:50:28.298604 5695 master-stress-test.cc:579] Killing test thread 4/25
I20260923 19:50:28.306116 7980 raft_consensus.cc:493] T 40adb472162042e48fdbb496b342996a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.306264 7980 raft_consensus.cc:515] T 40adb472162042e48fdbb496b342996a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.306457 6454 ts_tablet_manager.cc:1434] T 40adb472162042e48fdbb496b342996a P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.036s user 0.001s sys 0.000s
I20260923 19:50:28.306733 6454 tablet_bootstrap.cc:492] T 2526884ab0ef404aaf93051cc842c695 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:28.307001 7980 leader_election.cc:290] T 40adb472162042e48fdbb496b342996a P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:28.307624 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40adb472162042e48fdbb496b342996a" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:28.308399 6454 tablet_bootstrap.cc:654] T 2526884ab0ef404aaf93051cc842c695 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:28.308730 6056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40adb472162042e48fdbb496b342996a" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:28.309475 6137 leader_election.cc:304] T 40adb472162042e48fdbb496b342996a P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:28.309962 7980 raft_consensus.cc:2749] T 40adb472162042e48fdbb496b342996a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:28.313334 8049 raft_consensus.cc:493] T 9ee02922d2be45f5a1473a53a6f253c4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.313609 8049 raft_consensus.cc:515] T 9ee02922d2be45f5a1473a53a6f253c4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.314853 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee02922d2be45f5a1473a53a6f253c4" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:28.314975 8049 leader_election.cc:290] T 9ee02922d2be45f5a1473a53a6f253c4 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:28.315448 6280 leader_election.cc:343] T 9ee02922d2be45f5a1473a53a6f253c4 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:28.318554 6279 leader_election.cc:343] T 9ee02922d2be45f5a1473a53a6f253c4 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 9ee02922d2be45f5a1473a53a6f253c4
I20260923 19:50:28.318707 6279 leader_election.cc:304] T 9ee02922d2be45f5a1473a53a6f253c4 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:28.319092 8049 raft_consensus.cc:2749] T 9ee02922d2be45f5a1473a53a6f253c4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:28.321127 7986 raft_consensus.cc:493] T 664d849daee54b02b7b7e2bb340d92fa P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.321264 7986 raft_consensus.cc:515] T 664d849daee54b02b7b7e2bb340d92fa P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.289781 6457 raft_consensus.cc:359] T 18a31ed6bea444e7888f374927f90a60 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.321727 6457 raft_consensus.cc:385] T 18a31ed6bea444e7888f374927f90a60 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:28.321849 6457 raft_consensus.cc:740] T 18a31ed6bea444e7888f374927f90a60 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:28.322163 6457 consensus_queue.cc:260] T 18a31ed6bea444e7888f374927f90a60 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.322254 5805 master_service.cc:960] ReplaceTablet: received request to replace tablet d35ff653bf8d41cfbcf83359402a8f6a from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:28.322371 7986 leader_election.cc:290] T 664d849daee54b02b7b7e2bb340d92fa P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:28.322489 6459 ts_tablet_manager.cc:1929] T 21bf33904ede470b80a074dc9a458baf P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:28.322896 6457 ts_tablet_manager.cc:1434] T 18a31ed6bea444e7888f374927f90a60 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.035s user 0.002s sys 0.000s
I20260923 19:50:28.323559 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664d849daee54b02b7b7e2bb340d92fa" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:28.327236 5695 master-stress-test.cc:581] Killed test thread 4/25
I20260923 19:50:28.327344 5695 master-stress-test.cc:579] Killing test thread 5/25
I20260923 19:50:28.327436 5695 master-stress-test.cc:581] Killed test thread 5/25
I20260923 19:50:28.327523 5695 master-stress-test.cc:579] Killing test thread 6/25
I20260923 19:50:28.327580 5695 master-stress-test.cc:581] Killed test thread 6/25
I20260923 19:50:28.327646 5695 master-stress-test.cc:579] Killing test thread 7/25
I20260923 19:50:28.327713 5695 master-stress-test.cc:581] Killed test thread 7/25
I20260923 19:50:28.327780 5695 master-stress-test.cc:579] Killing test thread 8/25
I20260923 19:50:28.327858 5695 master-stress-test.cc:581] Killed test thread 8/25
I20260923 19:50:28.327921 5695 master-stress-test.cc:579] Killing test thread 9/25
I20260923 19:50:28.327986 5695 master-stress-test.cc:581] Killed test thread 9/25
I20260923 19:50:28.328048 5695 master-stress-test.cc:579] Killing test thread 10/25
I20260923 19:50:28.327996 6459 log.cc:1199] T 21bf33904ede470b80a074dc9a458baf P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/21bf33904ede470b80a074dc9a458baf
I20260923 19:50:28.328112 5695 master-stress-test.cc:581] Killed test thread 10/25
I20260923 19:50:28.328166 5695 master-stress-test.cc:579] Killing test thread 11/25
I20260923 19:50:28.328227 5695 master-stress-test.cc:581] Killed test thread 11/25
I20260923 19:50:28.328289 5695 master-stress-test.cc:579] Killing test thread 12/25
I20260923 19:50:28.328351 5695 master-stress-test.cc:581] Killed test thread 12/25
I20260923 19:50:28.328413 5695 master-stress-test.cc:579] Killing test thread 13/25
I20260923 19:50:28.328483 5695 master-stress-test.cc:581] Killed test thread 13/25
I20260923 19:50:28.328547 5695 master-stress-test.cc:579] Killing test thread 14/25
I20260923 19:50:28.328608 5695 master-stress-test.cc:581] Killed test thread 14/25
I20260923 19:50:28.328686 5695 master-stress-test.cc:579] Killing test thread 15/25
I20260923 19:50:28.328752 5695 master-stress-test.cc:581] Killed test thread 15/25
I20260923 19:50:28.328814 5695 master-stress-test.cc:579] Killing test thread 16/25
W20260923 19:50:28.325794 5996 leader_election.cc:343] T 664d849daee54b02b7b7e2bb340d92fa P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:28.329015 6459 ts_tablet_manager.cc:1950] T 21bf33904ede470b80a074dc9a458baf P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:28.326030 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664d849daee54b02b7b7e2bb340d92fa" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:28.329331 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1091) took 4209 ms. Trace:
I20260923 19:50:28.326583 7980 raft_consensus.cc:493] T 0e650824e4ae474787faeb6c22a4b43f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.329409 6459 rpcz_store.cc:276] 0923 19:50:24.119999 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:24.120095 (+ 96us) service_pool.cc:224] Handling call
0923 19:50:28.267753 (+4147658us) ts_tablet_manager.cc:1151] Deleting tablet 21bf33904ede470b80a074dc9a458baf
0923 19:50:28.267764 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.319444 (+ 51680us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.322437 (+ 2993us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.329314 (+ 6877us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4147446}
I20260923 19:50:28.329537 7980 raft_consensus.cc:515] T 0e650824e4ae474787faeb6c22a4b43f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.329824 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1092) took 4200 ms. Trace:
I20260923 19:50:28.329912 6459 rpcz_store.cc:276] 0923 19:50:24.129404 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:24.132609 (+ 3205us) service_pool.cc:224] Handling call
0923 19:50:28.329724 (+4197115us) ts_tablet_manager.cc:1151] Deleting tablet ef0604c2a884465aab7bfe6a1d2d7da6
0923 19:50:28.329733 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.329810 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4196890}
I20260923 19:50:28.330001 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 21bf33904ede470b80a074dc9a458baf (table default.Table_9f93fd5514734871bf6a205b82e6e8ef [id=29a9cb5a2b5e41f6a20555efb499eb00]) successfully deleted
I20260923 19:50:28.330215 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1102) took 4076 ms. Trace:
W20260923 19:50:28.330294 5995 leader_election.cc:343] T 664d849daee54b02b7b7e2bb340d92fa P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:28.330284 6459 rpcz_store.cc:276] 0923 19:50:24.253488 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:24.253541 (+ 53us) service_pool.cc:224] Handling call
0923 19:50:28.330126 (+4076585us) ts_tablet_manager.cc:1151] Deleting tablet fb1ea962909b4e42a9c4fab048133077
0923 19:50:28.330134 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.330201 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4076390}
I20260923 19:50:28.330382 5995 leader_election.cc:304] T 664d849daee54b02b7b7e2bb340d92fa P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:28.330736 8055 raft_consensus.cc:493] T c031d99a6f9844c29664236662e8d5f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.330852 8055 raft_consensus.cc:515] T c031d99a6f9844c29664236662e8d5f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.331359 7980 leader_election.cc:290] T 0e650824e4ae474787faeb6c22a4b43f P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:28.331677 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet ef0604c2a884465aab7bfe6a1d2d7da6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef0604c2a884465aab7bfe6a1d2d7da6 already in progress: creating tablet
W20260923 19:50:28.331876 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet fb1ea962909b4e42a9c4fab048133077 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb1ea962909b4e42a9c4fab048133077 already in progress: creating tablet
I20260923 19:50:28.331357 8055 leader_election.cc:290] T c031d99a6f9844c29664236662e8d5f8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:28.332185 7986 raft_consensus.cc:2749] T 664d849daee54b02b7b7e2bb340d92fa P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:28.332721 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e650824e4ae474787faeb6c22a4b43f" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:28.333411 6139 leader_election.cc:343] T c031d99a6f9844c29664236662e8d5f8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: c031d99a6f9844c29664236662e8d5f8
I20260923 19:50:28.323566 6456 tablet_bootstrap.cc:492] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:28.334854 6456 ts_tablet_manager.cc:1403] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.305s user 0.089s sys 0.116s
I20260923 19:50:28.335511 6456 raft_consensus.cc:359] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.335668 6456 raft_consensus.cc:385] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:28.335721 6456 raft_consensus.cc:740] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:28.335914 6456 consensus_queue.cc:260] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.336483 6456 ts_tablet_manager.cc:1434] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:28.336733 6456 tablet_bootstrap.cc:492] T 7f47efa0cabd47aa8ed0deface7763ab P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:28.338179 6456 tablet_bootstrap.cc:654] T 7f47efa0cabd47aa8ed0deface7763ab P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:28.339649 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1110) took 3999 ms. Trace:
I20260923 19:50:28.339740 6459 rpcz_store.cc:276] 0923 19:50:24.340600 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:24.340648 (+ 48us) service_pool.cc:224] Handling call
0923 19:50:28.330489 (+3989841us) ts_tablet_manager.cc:1151] Deleting tablet 37de46eabdd84065975a8e5a3c3758c4
0923 19:50:28.330497 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.339629 (+ 9132us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3989666}
I20260923 19:50:28.340090 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1109) took 4000 ms. Trace:
W20260923 19:50:28.340205 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 37de46eabdd84065975a8e5a3c3758c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 37de46eabdd84065975a8e5a3c3758c4 already in progress: creating tablet
I20260923 19:50:28.340169 6459 rpcz_store.cc:276] 0923 19:50:24.339553 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:24.339619 (+ 66us) service_pool.cc:224] Handling call
0923 19:50:28.339984 (+4000365us) ts_tablet_manager.cc:1151] Deleting tablet 605093b0f8034a638b3df925ea31de34
0923 19:50:28.339995 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.340074 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3979595}
I20260923 19:50:28.340478 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1111) took 3681 ms. Trace:
I20260923 19:50:28.340550 6459 rpcz_store.cc:276] 0923 19:50:24.658693 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:24.658752 (+ 59us) service_pool.cc:224] Handling call
0923 19:50:28.340370 (+3681618us) ts_tablet_manager.cc:1151] Deleting tablet 524c11f83bc34c5fafd6c33d119ee926
0923 19:50:28.340378 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.340450 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3681430}
W20260923 19:50:28.340715 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 605093b0f8034a638b3df925ea31de34 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 605093b0f8034a638b3df925ea31de34 already in progress: creating tablet
I20260923 19:50:28.340822 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e650824e4ae474787faeb6c22a4b43f" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:28.340987 6457 tablet_bootstrap.cc:492] T 2bc47336948746d694d5a896730c501c P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:28.341662 6137 leader_election.cc:304] T 0e650824e4ae474787faeb6c22a4b43f P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:28.342499 6137 leader_election.cc:343] T c031d99a6f9844c29664236662e8d5f8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: c031d99a6f9844c29664236662e8d5f8
I20260923 19:50:28.342614 6137 leader_election.cc:304] T c031d99a6f9844c29664236662e8d5f8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:28.342720 6457 tablet_bootstrap.cc:654] T 2bc47336948746d694d5a896730c501c P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:28.343063 7980 raft_consensus.cc:2749] T 0e650824e4ae474787faeb6c22a4b43f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:28.343218 7980 raft_consensus.cc:2749] T c031d99a6f9844c29664236662e8d5f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:28.344466 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 524c11f83bc34c5fafd6c33d119ee926 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 524c11f83bc34c5fafd6c33d119ee926 already in progress: creating tablet
I20260923 19:50:28.344740 7986 raft_consensus.cc:493] T 7f47efa0cabd47aa8ed0deface7763ab P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.344902 7986 raft_consensus.cc:515] T 7f47efa0cabd47aa8ed0deface7763ab P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.346625 5803 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_2bf96f2a45e54e94b4cd9d8493636030 [id=ea52a2330cd643e486e5b348dabbd295] alter complete (version 2)
I20260923 19:50:28.347154 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f47efa0cabd47aa8ed0deface7763ab" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:28.347415 7986 leader_election.cc:290] T 7f47efa0cabd47aa8ed0deface7763ab P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:28.348125 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f47efa0cabd47aa8ed0deface7763ab" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:28.348512 5995 leader_election.cc:343] T 7f47efa0cabd47aa8ed0deface7763ab P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:28.348738 5996 leader_election.cc:343] T 7f47efa0cabd47aa8ed0deface7763ab P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:28.348829 5996 leader_election.cc:304] T 7f47efa0cabd47aa8ed0deface7763ab P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:28.349036 7986 raft_consensus.cc:2749] T 7f47efa0cabd47aa8ed0deface7763ab P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:28.349220 8055 raft_consensus.cc:493] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.349334 8055 raft_consensus.cc:515] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.349995 8055 leader_election.cc:290] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:28.351876 6461 ts_tablet_manager.cc:1929] T d5d3f96ebf1c4d05aceb06ef53737e4f P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:28.351994 6461 log.cc:1199] T d5d3f96ebf1c4d05aceb06ef53737e4f P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/d5d3f96ebf1c4d05aceb06ef53737e4f
I20260923 19:50:28.352293 6461 ts_tablet_manager.cc:1950] T d5d3f96ebf1c4d05aceb06ef53737e4f P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:28.353498 5803 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 40adb472162042e48fdbb496b342996a (table default.Table_9430735288754d599f68f15e1d52c0cf [id=8fe16214ad774a54982dbadeac1b4235]). Expected version 2 got 0
I20260923 19:50:28.353989 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet d5d3f96ebf1c4d05aceb06ef53737e4f (table default.Table_5f9a8360065c42c6b42e7ab6deb71bdf [id=1e1ce17e7c394d7cbb8a4ec6e64dee8f]) successfully deleted
W20260923 19:50:28.354519 6139 leader_election.cc:343] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: d3f7b33bbf3f453e8e841ee5d99c5b31
I20260923 19:50:28.355086 8053 raft_consensus.cc:493] T 146a402ff29a4e0b834a9f270d61e21c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.355232 6459 tablet_replica.cc:333] T c031d99a6f9844c29664236662e8d5f8 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:28.355206 8053 raft_consensus.cc:515] T 146a402ff29a4e0b834a9f270d61e21c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.355419 6459 raft_consensus.cc:2243] T c031d99a6f9844c29664236662e8d5f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:28.355571 6459 raft_consensus.cc:2272] T c031d99a6f9844c29664236662e8d5f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:28.355743 8053 leader_election.cc:290] T 146a402ff29a4e0b834a9f270d61e21c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:28.356053 6459 ts_tablet_manager.cc:1916] T c031d99a6f9844c29664236662e8d5f8 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:28.356398 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146a402ff29a4e0b834a9f270d61e21c" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:28.360595 5805 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet d35ff653bf8d41cfbcf83359402a8f6a
I20260923 19:50:28.361110 5805 catalog_manager.cc:6934] ReplaceTablet: tablet d35ff653bf8d41cfbcf83359402a8f6a deleted and replaced by tablet c41d0f0861e34a99bbb584a165a3690f
I20260923 19:50:28.357436 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146a402ff29a4e0b834a9f270d61e21c" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:28.358314 6137 leader_election.cc:343] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: d3f7b33bbf3f453e8e841ee5d99c5b31
I20260923 19:50:28.363116 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet d35ff653bf8d41cfbcf83359402a8f6a with delete_type TABLET_DATA_DELETED (replaced by tablet c41d0f0861e34a99bbb584a165a3690f) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:28.363184 6137 leader_election.cc:304] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:28.363425 8055 raft_consensus.cc:2749] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:28.364076 6178 tablet_service.cc:1558] Processing DeleteTablet for tablet d35ff653bf8d41cfbcf83359402a8f6a with delete_type TABLET_DATA_DELETED (replaced by tablet c41d0f0861e34a99bbb584a165a3690f) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:28.364600 5995 leader_election.cc:343] T 146a402ff29a4e0b834a9f270d61e21c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:28.364943 6040 tablet_service.cc:1558] Processing DeleteTablet for tablet d35ff653bf8d41cfbcf83359402a8f6a with delete_type TABLET_DATA_DELETED (replaced by tablet c41d0f0861e34a99bbb584a165a3690f) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:28.365056 6039 tablet_service.cc:1558] Processing DeleteTablet for tablet 18a31ed6bea444e7888f374927f90a60 with delete_type TABLET_DATA_DELETED (replaced by tablet ca73c91b58954537af373face5ad2f67) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:28.365320 8055 raft_consensus.cc:493] T dbe06eba8067413a903e4a07c2768484 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.365465 8055 raft_consensus.cc:515] T dbe06eba8067413a903e4a07c2768484 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.366114 8055 leader_election.cc:290] T dbe06eba8067413a903e4a07c2768484 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:28.367640 6139 leader_election.cc:343] T dbe06eba8067413a903e4a07c2768484 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: dbe06eba8067413a903e4a07c2768484
W20260923 19:50:28.367868 6137 leader_election.cc:343] T dbe06eba8067413a903e4a07c2768484 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: dbe06eba8067413a903e4a07c2768484
I20260923 19:50:28.367945 6137 leader_election.cc:304] T dbe06eba8067413a903e4a07c2768484 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:28.368135 8055 raft_consensus.cc:2749] T dbe06eba8067413a903e4a07c2768484 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:28.368989 5996 leader_election.cc:343] T 146a402ff29a4e0b834a9f270d61e21c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:28.369092 5996 leader_election.cc:304] T 146a402ff29a4e0b834a9f270d61e21c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:28.369299 7986 raft_consensus.cc:2749] T 146a402ff29a4e0b834a9f270d61e21c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:28.373167 7986 raft_consensus.cc:493] T 8b8a973b247343008a29d67dfa712a0b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.373322 7986 raft_consensus.cc:515] T 8b8a973b247343008a29d67dfa712a0b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.374526 7986 leader_election.cc:290] T 8b8a973b247343008a29d67dfa712a0b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:28.375007 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a973b247343008a29d67dfa712a0b" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:28.375483 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a973b247343008a29d67dfa712a0b" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:28.376082 5996 leader_election.cc:343] T 8b8a973b247343008a29d67dfa712a0b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:28.376451 5995 leader_election.cc:343] T 8b8a973b247343008a29d67dfa712a0b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:28.376489 6458 ts_tablet_manager.cc:1929] T 22c89609da884c47b1dbc1470b37efbe P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:28.376605 6458 log.cc:1199] T 22c89609da884c47b1dbc1470b37efbe P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/22c89609da884c47b1dbc1470b37efbe
I20260923 19:50:28.376587 5995 leader_election.cc:304] T 8b8a973b247343008a29d67dfa712a0b P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:28.376904 6458 ts_tablet_manager.cc:1950] T 22c89609da884c47b1dbc1470b37efbe P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:28.377673 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1219) took 1597 ms. Trace:
I20260923 19:50:28.377765 6458 rpcz_store.cc:276] 0923 19:50:26.780484 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:26.780545 (+ 61us) service_pool.cc:224] Handling call
0923 19:50:28.258262 (+1477717us) ts_tablet_manager.cc:1151] Deleting tablet 22c89609da884c47b1dbc1470b37efbe
0923 19:50:28.258274 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.334172 (+ 75898us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.376437 (+ 42265us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.377654 (+ 1217us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1477534}
I20260923 19:50:28.378140 6458 tablet_replica.cc:333] T cb11d6e082784ad98cfb5253dbb88707 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:28.378293 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 22c89609da884c47b1dbc1470b37efbe (table default.Table_5bf3acc342a34bba8f50e005425b4c5d [id=a34c7ad2f3004c6e908b87fb99389632]) successfully deleted
I20260923 19:50:28.378326 6458 raft_consensus.cc:2243] T cb11d6e082784ad98cfb5253dbb88707 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:28.378451 6458 raft_consensus.cc:2272] T cb11d6e082784ad98cfb5253dbb88707 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:28.378930 6458 ts_tablet_manager.cc:1916] T cb11d6e082784ad98cfb5253dbb88707 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:28.379894 7986 raft_consensus.cc:2749] T 8b8a973b247343008a29d67dfa712a0b P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:28.382699 8049 raft_consensus.cc:493] T a263c0fc71424999b76ef01de9a51eda P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.382822 8049 raft_consensus.cc:515] T a263c0fc71424999b76ef01de9a51eda P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.383338 8049 leader_election.cc:290] T a263c0fc71424999b76ef01de9a51eda P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:28.384893 6457 tablet_bootstrap.cc:492] T 2bc47336948746d694d5a896730c501c P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:28.385089 6457 ts_tablet_manager.cc:1403] T 2bc47336948746d694d5a896730c501c P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.044s user 0.003s sys 0.000s
I20260923 19:50:28.385848 6457 raft_consensus.cc:359] T 2bc47336948746d694d5a896730c501c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.386127 6457 raft_consensus.cc:385] T 2bc47336948746d694d5a896730c501c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:28.386235 6457 raft_consensus.cc:740] T 2bc47336948746d694d5a896730c501c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:28.386783 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a263c0fc71424999b76ef01de9a51eda" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:28.386905 6457 consensus_queue.cc:260] T 2bc47336948746d694d5a896730c501c P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.387583 6457 ts_tablet_manager.cc:1434] T 2bc47336948746d694d5a896730c501c P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260923 19:50:28.387691 6280 leader_election.cc:343] T a263c0fc71424999b76ef01de9a51eda P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:28.388552 6454 tablet_bootstrap.cc:492] T 2526884ab0ef404aaf93051cc842c695 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:28.388680 6454 ts_tablet_manager.cc:1403] T 2526884ab0ef404aaf93051cc842c695 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.082s user 0.002s sys 0.001s
I20260923 19:50:28.389403 6454 raft_consensus.cc:359] T 2526884ab0ef404aaf93051cc842c695 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.389554 6454 raft_consensus.cc:385] T 2526884ab0ef404aaf93051cc842c695 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:28.389611 6454 raft_consensus.cc:740] T 2526884ab0ef404aaf93051cc842c695 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:28.389845 6454 consensus_queue.cc:260] T 2526884ab0ef404aaf93051cc842c695 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.390484 6454 ts_tablet_manager.cc:1434] T 2526884ab0ef404aaf93051cc842c695 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:50:28.390731 6454 tablet_bootstrap.cc:492] T ea2ef507c6e24d369427048171dfec06 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:28.392606 6200 raft_consensus.cc:3060] T 40adb472162042e48fdbb496b342996a P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:28.395925 8055 raft_consensus.cc:493] T 2526884ab0ef404aaf93051cc842c695 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.396065 8055 raft_consensus.cc:515] T 2526884ab0ef404aaf93051cc842c695 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.396658 8055 leader_election.cc:290] T 2526884ab0ef404aaf93051cc842c695 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:28.399209 6459 ts_tablet_manager.cc:1929] T c031d99a6f9844c29664236662e8d5f8 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:28.402798 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a263c0fc71424999b76ef01de9a51eda" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:28.403020 6059 raft_consensus.cc:2468] T a263c0fc71424999b76ef01de9a51eda P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:28.403196 6459 log.cc:1199] T c031d99a6f9844c29664236662e8d5f8 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/c031d99a6f9844c29664236662e8d5f8
W20260923 19:50:28.403600 6137 leader_election.cc:343] T 2526884ab0ef404aaf93051cc842c695 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 2526884ab0ef404aaf93051cc842c695
W20260923 19:50:28.405998 6139 leader_election.cc:343] T 2526884ab0ef404aaf93051cc842c695 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 2526884ab0ef404aaf93051cc842c695
I20260923 19:50:28.406354 6139 leader_election.cc:304] T 2526884ab0ef404aaf93051cc842c695 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:28.406682 6178 tablet_service.cc:1558] Processing DeleteTablet for tablet 2526884ab0ef404aaf93051cc842c695 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:28.406804 7980 raft_consensus.cc:2749] T 2526884ab0ef404aaf93051cc842c695 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:28.407795 6459 ts_tablet_manager.cc:1950] T c031d99a6f9844c29664236662e8d5f8 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:28.408563 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1112) took 3402 ms. Trace:
I20260923 19:50:28.409595 6459 rpcz_store.cc:276] 0923 19:50:25.006236 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:25.006291 (+ 55us) service_pool.cc:224] Handling call
0923 19:50:28.340755 (+3334464us) ts_tablet_manager.cc:1151] Deleting tablet c031d99a6f9844c29664236662e8d5f8
0923 19:50:28.355192 (+ 14437us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.373483 (+ 18291us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.399156 (+ 25673us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.408550 (+ 9394us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3334227}
I20260923 19:50:28.410981 6459 tablet_replica.cc:333] T dbe06eba8067413a903e4a07c2768484 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:28.411111 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet c031d99a6f9844c29664236662e8d5f8 (table default.Table_2c882fb60c3a4a5685508054fe5fa20d [id=4f2f07c1e27c431299438af5105e9f2e]) successfully deleted
I20260923 19:50:28.411195 6459 raft_consensus.cc:2243] T dbe06eba8067413a903e4a07c2768484 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:28.411329 6459 raft_consensus.cc:2272] T dbe06eba8067413a903e4a07c2768484 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:28.414058 6459 ts_tablet_manager.cc:1916] T dbe06eba8067413a903e4a07c2768484 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:28.418165 6457 tablet_bootstrap.cc:492] T cf0caa6afcf546678c233a9333b77a2a P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:28.418329 8103 tablet.cc:1751] T 40adb472162042e48fdbb496b342996a P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:28.419872 6457 tablet_bootstrap.cc:654] T cf0caa6afcf546678c233a9333b77a2a P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:28.420895 6461 tablet_replica.cc:333] T 146a402ff29a4e0b834a9f270d61e21c P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:28.421152 6461 raft_consensus.cc:2243] T 146a402ff29a4e0b834a9f270d61e21c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:28.421355 6461 raft_consensus.cc:2272] T 146a402ff29a4e0b834a9f270d61e21c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:28.422084 6461 ts_tablet_manager.cc:1916] T 146a402ff29a4e0b834a9f270d61e21c P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:28.424129 5805 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 40adb472162042e48fdbb496b342996a (table default.Table_9430735288754d599f68f15e1d52c0cf [id=8fe16214ad774a54982dbadeac1b4235]). Expected version 2 got 0
I20260923 19:50:28.428229 6461 ts_tablet_manager.cc:1929] T 146a402ff29a4e0b834a9f270d61e21c P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:28.434510 6454 tablet_bootstrap.cc:654] T ea2ef507c6e24d369427048171dfec06 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:28.437233 7980 raft_consensus.cc:493] T 2852e91ccd0c44b3b16f8189e57575d7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.437417 7980 raft_consensus.cc:515] T 2852e91ccd0c44b3b16f8189e57575d7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.438072 7980 leader_election.cc:290] T 2852e91ccd0c44b3b16f8189e57575d7 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:28.441447 6137 leader_election.cc:343] T 2852e91ccd0c44b3b16f8189e57575d7 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 2852e91ccd0c44b3b16f8189e57575d7
W20260923 19:50:28.441890 6139 leader_election.cc:343] T 2852e91ccd0c44b3b16f8189e57575d7 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 2852e91ccd0c44b3b16f8189e57575d7
I20260923 19:50:28.442004 6139 leader_election.cc:304] T 2852e91ccd0c44b3b16f8189e57575d7 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:28.442420 7980 raft_consensus.cc:2749] T 2852e91ccd0c44b3b16f8189e57575d7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:28.445586 5803 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_9430735288754d599f68f15e1d52c0cf [id=8fe16214ad774a54982dbadeac1b4235] alter complete (version 2)
I20260923 19:50:28.450172 5805 master_service.cc:960] ReplaceTablet: received request to replace tablet 47c261638f0d48bb82c78c9a04d487b2 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:28.455217 5796 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 25117ec346224a85942d0106b4962a88
I20260923 19:50:28.455758 5796 catalog_manager.cc:6934] ReplaceTablet: tablet 25117ec346224a85942d0106b4962a88 deleted and replaced by tablet 28f0540aabaf4d1dbf4c4312e01ddcd3
I20260923 19:50:28.456744 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 25117ec346224a85942d0106b4962a88 with delete_type TABLET_DATA_DELETED (replaced by tablet 28f0540aabaf4d1dbf4c4312e01ddcd3) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:28.457095 6178 tablet_service.cc:1558] Processing DeleteTablet for tablet 25117ec346224a85942d0106b4962a88 with delete_type TABLET_DATA_DELETED (replaced by tablet 28f0540aabaf4d1dbf4c4312e01ddcd3) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:28.457214 6456 tablet_bootstrap.cc:492] T 7f47efa0cabd47aa8ed0deface7763ab P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:28.457345 6456 ts_tablet_manager.cc:1403] T 7f47efa0cabd47aa8ed0deface7763ab P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.121s user 0.004s sys 0.004s
I20260923 19:50:28.458102 6456 raft_consensus.cc:359] T 7f47efa0cabd47aa8ed0deface7763ab P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.458251 6456 raft_consensus.cc:385] T 7f47efa0cabd47aa8ed0deface7763ab P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:28.458299 6456 raft_consensus.cc:740] T 7f47efa0cabd47aa8ed0deface7763ab P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:28.459699 6456 consensus_queue.cc:260] T 7f47efa0cabd47aa8ed0deface7763ab P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.460189 6456 ts_tablet_manager.cc:1434] T 7f47efa0cabd47aa8ed0deface7763ab P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260923 19:50:28.460816 8095 tablet.cc:1751] T 35f46a1be80c4194b592c5d00fe1f342 P 2bf41435f70447f19992d368ca6b46bd: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:28.434571 6459 ts_tablet_manager.cc:1929] T dbe06eba8067413a903e4a07c2768484 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:28.465658 6459 log.cc:1199] T dbe06eba8067413a903e4a07c2768484 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/dbe06eba8067413a903e4a07c2768484
I20260923 19:50:28.466908 5802 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 2d1ed91cfd5f4d1eb1ea75fa6183141a
I20260923 19:50:28.467118 6459 ts_tablet_manager.cc:1950] T dbe06eba8067413a903e4a07c2768484 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:28.467434 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1113) took 3458 ms. Trace:
I20260923 19:50:28.467535 6459 rpcz_store.cc:276] 0923 19:50:25.008985 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:25.009038 (+ 53us) service_pool.cc:224] Handling call
0923 19:50:28.410932 (+3401894us) ts_tablet_manager.cc:1151] Deleting tablet dbe06eba8067413a903e4a07c2768484
0923 19:50:28.410942 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.421907 (+ 10965us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.434523 (+ 12616us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.467418 (+ 32895us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3401693}
I20260923 19:50:28.467947 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1114) took 3455 ms. Trace:
I20260923 19:50:28.468189 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet dbe06eba8067413a903e4a07c2768484 (table default.Table_85f67787052f46c2b29555acf4abc05c [id=98fdaeb42b5a426f8d96225de816958d]) successfully deleted
I20260923 19:50:28.468637 6458 ts_tablet_manager.cc:1929] T cb11d6e082784ad98cfb5253dbb88707 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:28.468801 6458 log.cc:1199] T cb11d6e082784ad98cfb5253dbb88707 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/cb11d6e082784ad98cfb5253dbb88707
I20260923 19:50:28.469522 6458 ts_tablet_manager.cc:1950] T cb11d6e082784ad98cfb5253dbb88707 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:28.471082 5799 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet cf64073cdde748bc8ed3ce7580a71160 (table default.Table_ec1f04b2e36247fa96e9591cb7ab7eff [id=662eb0a4f944445486929d42c5ebfd01]). Expected version 3 got 0
I20260923 19:50:28.468622 6178 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d1ed91cfd5f4d1eb1ea75fa6183141a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:28 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:28.471406 6459 rpcz_store.cc:276] 0923 19:50:25.012393 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:25.012456 (+ 63us) service_pool.cc:224] Handling call
0923 19:50:28.467828 (+3455372us) ts_tablet_manager.cc:1151] Deleting tablet 367a8b9a9b2b453e91082a8cc4f5f64c
0923 19:50:28.467840 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.467934 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3455160}
I20260923 19:50:28.471539 5799 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 7f47efa0cabd47aa8ed0deface7763ab (table default.Table_f57f8cacbedb49c6be509b51c824b960 [id=ada5cc6ef65b4859bf027fd3af9ad0f2]). Expected version 2 got 0
I20260923 19:50:28.471709 5799 catalog_manager.cc:5838] T f2799563250845b0b9d7d51b2367b16b P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } }
I20260923 19:50:28.472065 5799 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet f2799563250845b0b9d7d51b2367b16b (table default.Table_bc33f65d5674483c9854966514392420 [id=b6e6ca970bea466f80938e694f770e67]). Expected version 1 got 0
I20260923 19:50:28.472249 5799 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet a6da9b3eea4547c9bb80b08bd26c5dc2 (table default.Table_52abb1a930aa442b9fb361345d7da76f [id=8996d40848d44ed09261ee25d61bb906]). Expected version 1 got 0
I20260923 19:50:28.469540 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d1ed91cfd5f4d1eb1ea75fa6183141a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:28 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:28.472726 6459 tablet_replica.cc:333] T fc151f4d78344efeada6d6e57af6eb9f P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:28.473176 5799 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet f1c1d4f73488499a9e5add81e9d5e2d6 (table default.Table_7f7907c8e1bc4ad1ae68faf5f072b318 [id=80e3a84f7199464fa96426daeeeb84cd]). Expected version 2 got 0
I20260923 19:50:28.473273 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1220) took 1692 ms. Trace:
I20260923 19:50:28.473472 6459 raft_consensus.cc:2243] T fc151f4d78344efeada6d6e57af6eb9f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:28.473575 5799 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 0f90406b20f54787bd27255d5ae81d1c (table default.Table_8aad9ce166cb40659479e35cbcbf1d88 [id=cec162ada3144aaba98196d363cf587d]). Expected version 1 got 0
I20260923 19:50:28.473732 6459 raft_consensus.cc:2272] T fc151f4d78344efeada6d6e57af6eb9f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:28.473835 5799 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 397ec5e49673406cb26a2efab0ad8401 (table default.Table_92f3bea4e4164a738fb75f01e95cd776 [id=0b80967a8fb94518ad872fbce9bae934]). Expected version 1 got 0
W20260923 19:50:28.475229 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 367a8b9a9b2b453e91082a8cc4f5f64c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 367a8b9a9b2b453e91082a8cc4f5f64c already in progress: creating tablet
I20260923 19:50:28.476334 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 4e3cdffa2c2a4e5da4980dea84d82c4e
I20260923 19:50:28.477221 6178 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e3cdffa2c2a4e5da4980dea84d82c4e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:28 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:28.477607 6200 raft_consensus.cc:3060] T 0e650824e4ae474787faeb6c22a4b43f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:28.477931 5695 master-stress-test.cc:581] Killed test thread 16/25
I20260923 19:50:28.478046 5695 master-stress-test.cc:579] Killing test thread 17/25
I20260923 19:50:28.478116 5695 master-stress-test.cc:581] Killed test thread 17/25
I20260923 19:50:28.478178 5695 master-stress-test.cc:579] Killing test thread 18/25
I20260923 19:50:28.478236 5695 master-stress-test.cc:581] Killed test thread 18/25
I20260923 19:50:28.478293 5695 master-stress-test.cc:579] Killing test thread 19/25
I20260923 19:50:28.478354 5695 master-stress-test.cc:581] Killed test thread 19/25
I20260923 19:50:28.478413 5695 master-stress-test.cc:579] Killing test thread 20/25
I20260923 19:50:28.478472 5695 master-stress-test.cc:581] Killed test thread 20/25
I20260923 19:50:28.478533 5695 master-stress-test.cc:579] Killing test thread 21/25
I20260923 19:50:28.480345 6458 rpcz_store.cc:276] 0923 19:50:26.780638 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:26.780753 (+ 115us) service_pool.cc:224] Handling call
0923 19:50:28.378091 (+1597338us) ts_tablet_manager.cc:1151] Deleting tablet cb11d6e082784ad98cfb5253dbb88707
0923 19:50:28.378102 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.433389 (+ 55287us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.468567 (+ 35178us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.473255 (+ 4688us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1597209}
I20260923 19:50:28.474699 6456 tablet_bootstrap.cc:492] T 559f3e3016aa470f9732a727b4528586 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:28.475099 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 6b55111894bc4787be5f66f1f8d79482 (DEFAULT_TABLE table=default.Table_b2ca67b2177c4c03a924e9b0a4b46742 [id=5cbff99cb9a4477e814ac021eb9d441c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.480767 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet cb11d6e082784ad98cfb5253dbb88707 (table default.Table_d178d42e78ae42b88975c9bc050e0041 [id=e3da2a14cd094e53b0a99042f93cb576]) successfully deleted
I20260923 19:50:28.480856 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b55111894bc4787be5f66f1f8d79482. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.480903 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 6b55111894bc4787be5f66f1f8d79482 (DEFAULT_TABLE table=default.Table_b2ca67b2177c4c03a924e9b0a4b46742 [id=5cbff99cb9a4477e814ac021eb9d441c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.481320 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b55111894bc4787be5f66f1f8d79482. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.482745 6317 tablet_service.cc:1511] Processing CreateTablet for tablet cd95d7cd608243b78421107a0cd510e0 (DEFAULT_TABLE table=default.Table_6d4436d2f89b4e74b85c8b13a581843e [id=0d77d7483b6543099df13f4f14c5fd24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.483069 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd95d7cd608243b78421107a0cd510e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.479027 6309 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e3cdffa2c2a4e5da4980dea84d82c4e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:28 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:28.486017 6459 ts_tablet_manager.cc:1916] T fc151f4d78344efeada6d6e57af6eb9f P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:28.489478 6456 tablet_bootstrap.cc:654] T 559f3e3016aa470f9732a727b4528586 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:28.491024 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1222) took 1710 ms. Trace:
I20260923 19:50:28.491528 6458 rpcz_store.cc:276] 0923 19:50:26.780859 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:26.780945 (+ 86us) service_pool.cc:224] Handling call
0923 19:50:28.490882 (+1709937us) ts_tablet_manager.cc:1151] Deleting tablet 4952cee21fe9402db99783e05ffaffd5
0923 19:50:28.490891 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.490979 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1709794}
I20260923 19:50:28.496481 6317 tablet_service.cc:1558] Processing DeleteTablet for tablet 85f5ba9097674f9d889e178eaea4f0d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:28.497349 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 373d6442546d41e2b5567dfc92ae07b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:28.500308 6454 tablet_bootstrap.cc:492] T ea2ef507c6e24d369427048171dfec06 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:28.497713 6456 tablet_bootstrap.cc:492] T 559f3e3016aa470f9732a727b4528586 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:28.500437 6454 ts_tablet_manager.cc:1403] T ea2ef507c6e24d369427048171dfec06 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.110s user 0.004s sys 0.000s
I20260923 19:50:28.500479 6456 ts_tablet_manager.cc:1403] T 559f3e3016aa470f9732a727b4528586 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.003s
I20260923 19:50:28.501168 6454 raft_consensus.cc:359] T ea2ef507c6e24d369427048171dfec06 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.501336 6454 raft_consensus.cc:385] T ea2ef507c6e24d369427048171dfec06 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:28.501405 6454 raft_consensus.cc:740] T ea2ef507c6e24d369427048171dfec06 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:28.501305 6456 raft_consensus.cc:359] T 559f3e3016aa470f9732a727b4528586 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.501467 6456 raft_consensus.cc:385] T 559f3e3016aa470f9732a727b4528586 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:28.501602 6456 raft_consensus.cc:740] T 559f3e3016aa470f9732a727b4528586 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:28.501583 6454 consensus_queue.cc:260] T ea2ef507c6e24d369427048171dfec06 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.501827 6456 consensus_queue.cc:260] T 559f3e3016aa470f9732a727b4528586 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.502431 6456 ts_tablet_manager.cc:1434] T 559f3e3016aa470f9732a727b4528586 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260923 19:50:28.502765 6456 tablet_bootstrap.cc:492] T 772ece5283a949408d849f6e56f5f17b P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:28.503968 8049 raft_consensus.cc:493] T cf64073cdde748bc8ed3ce7580a71160 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.504050 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 90f519d54f5a41f98eb10259a8beb82f (DEFAULT_TABLE table=default.Table_e773814b4bc24001813b9088825f6247 [id=70a4d3875d7f41e49ff0a734e3908fc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.504081 8049 raft_consensus.cc:515] T cf64073cdde748bc8ed3ce7580a71160 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.504392 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90f519d54f5a41f98eb10259a8beb82f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.504685 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1223) took 1723 ms. Trace:
I20260923 19:50:28.504695 8049 leader_election.cc:290] T cf64073cdde748bc8ed3ce7580a71160 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:28.505381 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf64073cdde748bc8ed3ce7580a71160" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:28.505941 6280 leader_election.cc:343] T cf64073cdde748bc8ed3ce7580a71160 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:28.506844 6166 tablet_service.cc:1511] Processing CreateTablet for tablet 90f519d54f5a41f98eb10259a8beb82f (DEFAULT_TABLE table=default.Table_e773814b4bc24001813b9088825f6247 [id=70a4d3875d7f41e49ff0a734e3908fc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.507222 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90f519d54f5a41f98eb10259a8beb82f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.504776 6458 rpcz_store.cc:276] 0923 19:50:26.780981 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:26.781074 (+ 93us) service_pool.cc:224] Handling call
0923 19:50:28.504580 (+1723506us) ts_tablet_manager.cc:1151] Deleting tablet a0743d5ac2264af6b045af0474cbf58c
0923 19:50:28.504588 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.504670 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1723397}
I20260923 19:50:28.508212 6458 tablet_replica.cc:333] T d04b3a9ade7a405bb619704095fac279 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:28.508456 6458 raft_consensus.cc:2243] T d04b3a9ade7a405bb619704095fac279 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:28.509690 6458 raft_consensus.cc:2272] T d04b3a9ade7a405bb619704095fac279 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:28.510462 6458 ts_tablet_manager.cc:1916] T d04b3a9ade7a405bb619704095fac279 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:28.510771 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 4952cee21fe9402db99783e05ffaffd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4952cee21fe9402db99783e05ffaffd5 already in progress: creating tablet
W20260923 19:50:28.511015 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet a0743d5ac2264af6b045af0474cbf58c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0743d5ac2264af6b045af0474cbf58c already in progress: creating tablet
I20260923 19:50:28.511653 6317 tablet_service.cc:1511] Processing CreateTablet for tablet 02a9f02e1a964401a34c37ceaef4f1e3 (DEFAULT_TABLE table=default.Table_564b5ac3637c4a75aee56960a3e1fe03 [id=a6d4111238e74195935bd70f2adf0451]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.511986 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02a9f02e1a964401a34c37ceaef4f1e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.513461 6175 tablet_service.cc:1511] Processing CreateTablet for tablet 02a9f02e1a964401a34c37ceaef4f1e3 (DEFAULT_TABLE table=default.Table_564b5ac3637c4a75aee56960a3e1fe03 [id=a6d4111238e74195935bd70f2adf0451]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.513859 6175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02a9f02e1a964401a34c37ceaef4f1e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.514366 6454 ts_tablet_manager.cc:1434] T ea2ef507c6e24d369427048171dfec06 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260923 19:50:28.514648 6454 tablet_bootstrap.cc:492] T 02fa9052a7054659baf9b07b770bb538 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:28.516317 6454 tablet_bootstrap.cc:654] T 02fa9052a7054659baf9b07b770bb538 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:28.517040 6309 tablet_service.cc:1511] Processing CreateTablet for tablet 9dae0fccc74646869b0da7a4ad1fe98c (DEFAULT_TABLE table=default.Table_b0623fc8e1dd40bcbd5dc4850272935b [id=fbe6e46b8d50471f913c5068f29399a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.517357 6309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dae0fccc74646869b0da7a4ad1fe98c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.518481 6169 tablet_service.cc:1511] Processing CreateTablet for tablet 9dae0fccc74646869b0da7a4ad1fe98c (DEFAULT_TABLE table=default.Table_b0623fc8e1dd40bcbd5dc4850272935b [id=fbe6e46b8d50471f913c5068f29399a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.518811 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dae0fccc74646869b0da7a4ad1fe98c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.525202 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 001523cd54e842fd926f48419e46c435 (DEFAULT_TABLE table=default.Table_7a817dc7d005417a847ee0402080fe76 [id=d61abaee27364bb2bfcf45b160b9ffd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.525555 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 001523cd54e842fd926f48419e46c435. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.525995 6461 log.cc:1199] T 146a402ff29a4e0b834a9f270d61e21c P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/146a402ff29a4e0b834a9f270d61e21c
I20260923 19:50:28.526327 6461 ts_tablet_manager.cc:1950] T 146a402ff29a4e0b834a9f270d61e21c P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:28.527384 6461 tablet_replica.cc:333] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:28.527305 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 001523cd54e842fd926f48419e46c435 (DEFAULT_TABLE table=default.Table_7a817dc7d005417a847ee0402080fe76 [id=d61abaee27364bb2bfcf45b160b9ffd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.527571 6461 raft_consensus.cc:2243] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:28.527637 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 001523cd54e842fd926f48419e46c435. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.527717 6461 raft_consensus.cc:2272] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:28.528191 6461 ts_tablet_manager.cc:1916] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:28.447506 6457 tablet_bootstrap.cc:492] T cf0caa6afcf546678c233a9333b77a2a P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:28.458487 8097 tablet.cc:1751] T 35f46a1be80c4194b592c5d00fe1f342 P e546f660e7e541d1aa9ae38e5ee5b9c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:28.517961 7986 raft_consensus.cc:493] T 3acf4a03174f45d5aee9c9b1454784f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.530004 6457 ts_tablet_manager.cc:1403] T cf0caa6afcf546678c233a9333b77a2a P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.112s user 0.002s sys 0.002s
I20260923 19:50:28.530086 7986 raft_consensus.cc:515] T 3acf4a03174f45d5aee9c9b1454784f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.530687 7986 leader_election.cc:290] T 3acf4a03174f45d5aee9c9b1454784f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:28.530606 6457 raft_consensus.cc:359] T cf0caa6afcf546678c233a9333b77a2a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.530768 6457 raft_consensus.cc:385] T cf0caa6afcf546678c233a9333b77a2a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:28.530824 6457 raft_consensus.cc:740] T cf0caa6afcf546678c233a9333b77a2a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:28.530997 6457 consensus_queue.cc:260] T cf0caa6afcf546678c233a9333b77a2a P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.531455 6457 ts_tablet_manager.cc:1434] T cf0caa6afcf546678c233a9333b77a2a P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260923 19:50:28.531394 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3acf4a03174f45d5aee9c9b1454784f8" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:28.531711 6457 tablet_bootstrap.cc:492] T c013c07fd27a46f29a464d73fe752e10 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
W20260923 19:50:28.532023 5996 leader_election.cc:343] T 3acf4a03174f45d5aee9c9b1454784f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:28.533025 6457 tablet_bootstrap.cc:654] T c013c07fd27a46f29a464d73fe752e10 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:28.532955 6170 tablet_service.cc:1511] Processing CreateTablet for tablet 904f0a65ae7f41a5b690b208550533a7 (DEFAULT_TABLE table=default.Table_cb7681f47cb44025a62096e5b8e95087 [id=c7dda5ebfe6944c8a50f287500cdd013]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.533310 6170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 904f0a65ae7f41a5b690b208550533a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.540627 6459 ts_tablet_manager.cc:1929] T fc151f4d78344efeada6d6e57af6eb9f P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:28.540799 6459 log.cc:1199] T fc151f4d78344efeada6d6e57af6eb9f P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/fc151f4d78344efeada6d6e57af6eb9f
I20260923 19:50:28.541143 6459 ts_tablet_manager.cc:1950] T fc151f4d78344efeada6d6e57af6eb9f P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:28.541450 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1115) took 3448 ms. Trace:
I20260923 19:50:28.541589 6459 rpcz_store.cc:276] 0923 19:50:25.092525 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:25.092608 (+ 83us) service_pool.cc:224] Handling call
0923 19:50:28.472680 (+3380072us) ts_tablet_manager.cc:1151] Deleting tablet fc151f4d78344efeada6d6e57af6eb9f
0923 19:50:28.472691 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.496701 (+ 24010us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.540566 (+ 43865us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.541437 (+ 871us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3379566}
I20260923 19:50:28.542050 6459 tablet_replica.cc:333] T 0c537304c32c44adaa1e05de4496293f P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:28.542076 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet fc151f4d78344efeada6d6e57af6eb9f (table default.Table_412c7972d6ad4c9c9e44ad5763e7a6c7 [id=22bf03cd65ab4346af756b244875c007]) successfully deleted
I20260923 19:50:28.542356 6459 raft_consensus.cc:2243] T 0c537304c32c44adaa1e05de4496293f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:28.542498 6459 raft_consensus.cc:2272] T 0c537304c32c44adaa1e05de4496293f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:28.542836 6170 tablet_service.cc:1511] Processing CreateTablet for tablet 62f632be03354e0da46613ca5a62325f (DEFAULT_TABLE table=default.Table_e1580fe44b374656b6657f26f1927b29 [id=c73cbcb1bf1e45b8a7b84753eaae5635]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.543239 6170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62f632be03354e0da46613ca5a62325f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.503743 6178 tablet_service.cc:1511] Processing CreateTablet for tablet cd95d7cd608243b78421107a0cd510e0 (DEFAULT_TABLE table=default.Table_6d4436d2f89b4e74b85c8b13a581843e [id=0d77d7483b6543099df13f4f14c5fd24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.547252 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd95d7cd608243b78421107a0cd510e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.548189 6309 tablet_service.cc:1511] Processing CreateTablet for tablet 904f0a65ae7f41a5b690b208550533a7 (DEFAULT_TABLE table=default.Table_cb7681f47cb44025a62096e5b8e95087 [id=c7dda5ebfe6944c8a50f287500cdd013]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.548684 6309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 904f0a65ae7f41a5b690b208550533a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.552017 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 62f632be03354e0da46613ca5a62325f (DEFAULT_TABLE table=default.Table_e1580fe44b374656b6657f26f1927b29 [id=c73cbcb1bf1e45b8a7b84753eaae5635]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.552403 5799 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 7f47efa0cabd47aa8ed0deface7763ab (table default.Table_f57f8cacbedb49c6be509b51c824b960 [id=ada5cc6ef65b4859bf027fd3af9ad0f2]). Expected version 2 got 0
I20260923 19:50:28.554400 6312 tablet_service.cc:1511] Processing CreateTablet for tablet e60597e9959b4224b59655c0d8f6f7a9 (DEFAULT_TABLE table=default.Table_bd5cff276b1e441088052e4e8264430c [id=a06551208d4c4e51bf81f02ab35146e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.555668 6456 tablet_bootstrap.cc:654] T 772ece5283a949408d849f6e56f5f17b P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:28.556358 8049 raft_consensus.cc:493] T ce6b86f947ce420994eaa5ff39ad9c87 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.556479 8049 raft_consensus.cc:515] T ce6b86f947ce420994eaa5ff39ad9c87 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.557051 8049 leader_election.cc:290] T ce6b86f947ce420994eaa5ff39ad9c87 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:28.557224 8103 tablet.cc:1751] T 0e650824e4ae474787faeb6c22a4b43f P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260923 19:50:28.542960 6459 ts_tablet_manager.cc:1916] T 0c537304c32c44adaa1e05de4496293f P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:28.558552 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce6b86f947ce420994eaa5ff39ad9c87" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:28.559056 6280 leader_election.cc:343] T ce6b86f947ce420994eaa5ff39ad9c87 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:28.559260 8049 raft_consensus.cc:493] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.564075 5798 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 0e650824e4ae474787faeb6c22a4b43f (table default.Table_5572c14c35d14aa8bc14916e403dfe0f [id=bf2950f7469241d390951965f4e98f23]). Expected version 3 got 0
I20260923 19:50:28.564764 6170 tablet_service.cc:1511] Processing CreateTablet for tablet e60597e9959b4224b59655c0d8f6f7a9 (DEFAULT_TABLE table=default.Table_bd5cff276b1e441088052e4e8264430c [id=a06551208d4c4e51bf81f02ab35146e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.566361 6170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e60597e9959b4224b59655c0d8f6f7a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.559379 8049 raft_consensus.cc:515] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.573210 7980 raft_consensus.cc:493] T c5cb76fa5e084604aa58bf888cfe4852 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.573354 7980 raft_consensus.cc:515] T c5cb76fa5e084604aa58bf888cfe4852 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.573971 7980 leader_election.cc:290] T c5cb76fa5e084604aa58bf888cfe4852 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:28.575229 6137 leader_election.cc:343] T c5cb76fa5e084604aa58bf888cfe4852 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: c5cb76fa5e084604aa58bf888cfe4852
W20260923 19:50:28.576045 6139 leader_election.cc:343] T c5cb76fa5e084604aa58bf888cfe4852 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: c5cb76fa5e084604aa58bf888cfe4852
I20260923 19:50:28.576136 6139 leader_election.cc:304] T c5cb76fa5e084604aa58bf888cfe4852 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:28.576560 7980 raft_consensus.cc:2749] T c5cb76fa5e084604aa58bf888cfe4852 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:28.580513 6166 tablet_service.cc:1558] Processing DeleteTablet for tablet ea2ef507c6e24d369427048171dfec06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:28.582430 8049 leader_election.cc:290] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:28.588404 6458 ts_tablet_manager.cc:1929] T d04b3a9ade7a405bb619704095fac279 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:28.588555 6458 log.cc:1199] T d04b3a9ade7a405bb619704095fac279 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/d04b3a9ade7a405bb619704095fac279
I20260923 19:50:28.588892 6458 ts_tablet_manager.cc:1950] T d04b3a9ade7a405bb619704095fac279 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:28.589417 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e60597e9959b4224b59655c0d8f6f7a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.590091 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62f632be03354e0da46613ca5a62325f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.594579 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6da9b3eea4547c9bb80b08bd26c5dc2" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:28.595193 6280 leader_election.cc:343] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:28.595332 7986 raft_consensus.cc:493] T 2bc47336948746d694d5a896730c501c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.595469 7986 raft_consensus.cc:515] T 2bc47336948746d694d5a896730c501c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.596128 7986 leader_election.cc:290] T 2bc47336948746d694d5a896730c501c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:28.596977 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc47336948746d694d5a896730c501c" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:28.597474 5996 leader_election.cc:343] T 2bc47336948746d694d5a896730c501c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:28.598877 7980 raft_consensus.cc:493] T f8052b05169b4673b387ac8b716ffc4e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.599023 7980 raft_consensus.cc:515] T f8052b05169b4673b387ac8b716ffc4e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.599345 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1221) took 1818 ms. Trace:
I20260923 19:50:28.599434 6458 rpcz_store.cc:276] 0923 19:50:26.780728 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:26.781221 (+ 493us) service_pool.cc:224] Handling call
0923 19:50:28.508172 (+1726951us) ts_tablet_manager.cc:1151] Deleting tablet d04b3a9ade7a405bb619704095fac279
0923 19:50:28.508181 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.530024 (+ 21843us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.588352 (+ 58328us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.599327 (+ 10975us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1726813}
I20260923 19:50:28.599589 7980 leader_election.cc:290] T f8052b05169b4673b387ac8b716ffc4e P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:28.599802 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1236) took 1625 ms. Trace:
I20260923 19:50:28.599869 6458 rpcz_store.cc:276] 0923 19:50:26.974801 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:26.974865 (+ 64us) service_pool.cc:224] Handling call
0923 19:50:28.599698 (+1624833us) ts_tablet_manager.cc:1151] Deleting tablet 20d299b0112b4eb4ae1b8cb266c69a11
0923 19:50:28.599707 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.599784 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1624647}
I20260923 19:50:28.600206 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1238) took 1582 ms. Trace:
I20260923 19:50:28.600270 6458 rpcz_store.cc:276] 0923 19:50:27.017618 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:27.017660 (+ 42us) service_pool.cc:224] Handling call
0923 19:50:28.600098 (+1582438us) ts_tablet_manager.cc:1151] Deleting tablet 11e0f1c645184da19ce11927e1d562c3
0923 19:50:28.600108 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.600193 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1573574}
W20260923 19:50:28.600641 6137 leader_election.cc:343] T f8052b05169b4673b387ac8b716ffc4e P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: f8052b05169b4673b387ac8b716ffc4e
I20260923 19:50:28.601020 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet d04b3a9ade7a405bb619704095fac279 (table default.Table_b79ffd6b55d94f789da88e84cb293bb5 [id=cd3183840770461faead259af133d3d1]) successfully deleted
W20260923 19:50:28.601311 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 20d299b0112b4eb4ae1b8cb266c69a11 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20d299b0112b4eb4ae1b8cb266c69a11 already in progress: creating tablet
I20260923 19:50:28.601459 6459 ts_tablet_manager.cc:1929] T 0c537304c32c44adaa1e05de4496293f P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:28.601559 6459 log.cc:1199] T 0c537304c32c44adaa1e05de4496293f P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/0c537304c32c44adaa1e05de4496293f
W20260923 19:50:28.601805 6139 leader_election.cc:343] T f8052b05169b4673b387ac8b716ffc4e P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: f8052b05169b4673b387ac8b716ffc4e
I20260923 19:50:28.601859 6459 ts_tablet_manager.cc:1950] T 0c537304c32c44adaa1e05de4496293f P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:28.601913 6139 leader_election.cc:304] T f8052b05169b4673b387ac8b716ffc4e P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:28.602145 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1116) took 3486 ms. Trace:
I20260923 19:50:28.602208 6459 rpcz_store.cc:276] 0923 19:50:25.116026 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:25.116571 (+ 545us) service_pool.cc:224] Handling call
0923 19:50:28.542004 (+3425433us) ts_tablet_manager.cc:1151] Deleting tablet 0c537304c32c44adaa1e05de4496293f
0923 19:50:28.542014 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.578350 (+ 36336us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.601394 (+ 23044us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.602132 (+ 738us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3425110}
I20260923 19:50:28.602355 7980 raft_consensus.cc:2749] T f8052b05169b4673b387ac8b716ffc4e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:28.602524 6459 tablet_replica.cc:333] T 528fca12bfe04747830ad1d3bb323676 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:28.602700 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 0c537304c32c44adaa1e05de4496293f (table default.Table_5febe26a78884634a01aa0ec62f36604 [id=e2a29fc060074c45918b97001dd03207]) successfully deleted
I20260923 19:50:28.605255 5799 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: default.Table_3dfc627cb077492dadef1e21d7613ebc [id=d6a2d0fc236a4056b224d01249f045b0] alter complete (version 2)
I20260923 19:50:28.608155 6454 tablet_bootstrap.cc:492] T 02fa9052a7054659baf9b07b770bb538 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:28.608322 6454 ts_tablet_manager.cc:1403] T 02fa9052a7054659baf9b07b770bb538 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.094s user 0.004s sys 0.004s
I20260923 19:50:28.609053 6454 raft_consensus.cc:359] T 02fa9052a7054659baf9b07b770bb538 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.609257 6454 raft_consensus.cc:385] T 02fa9052a7054659baf9b07b770bb538 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:28.609346 6454 raft_consensus.cc:740] T 02fa9052a7054659baf9b07b770bb538 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:28.609592 6454 consensus_queue.cc:260] T 02fa9052a7054659baf9b07b770bb538 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.610502 6454 ts_tablet_manager.cc:1434] T 02fa9052a7054659baf9b07b770bb538 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:28.611744 6457 tablet_bootstrap.cc:492] T c013c07fd27a46f29a464d73fe752e10 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:28.611924 6457 ts_tablet_manager.cc:1403] T c013c07fd27a46f29a464d73fe752e10 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.080s user 0.003s sys 0.004s
W20260923 19:50:28.612540 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 11e0f1c645184da19ce11927e1d562c3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11e0f1c645184da19ce11927e1d562c3 already in progress: creating tablet
I20260923 19:50:28.612556 6457 raft_consensus.cc:359] T c013c07fd27a46f29a464d73fe752e10 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.612702 6457 raft_consensus.cc:385] T c013c07fd27a46f29a464d73fe752e10 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:28.612759 6457 raft_consensus.cc:740] T c013c07fd27a46f29a464d73fe752e10 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:28.612988 6459 raft_consensus.cc:2243] T 528fca12bfe04747830ad1d3bb323676 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:28.612937 6457 consensus_queue.cc:260] T c013c07fd27a46f29a464d73fe752e10 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.613229 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1256) took 1471 ms. Trace:
I20260923 19:50:28.613340 6458 rpcz_store.cc:276] 0923 19:50:27.141572 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:27.155657 (+ 14085us) service_pool.cc:224] Handling call
0923 19:50:28.612913 (+1457256us) ts_tablet_manager.cc:1151] Deleting tablet f5f285e125dc445197a59e02e199a606
0923 19:50:28.613115 (+ 202us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.613208 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1455544}
I20260923 19:50:28.613507 6457 ts_tablet_manager.cc:1434] T c013c07fd27a46f29a464d73fe752e10 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260923 19:50:28.613806 6457 tablet_bootstrap.cc:492] T a367cf3788ef49148a5c8d6864f71d8e P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
W20260923 19:50:28.613903 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet f5f285e125dc445197a59e02e199a606 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5f285e125dc445197a59e02e199a606 already in progress: creating tablet
W20260923 19:50:28.614126 5792 catalog_manager.cc:5136] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): alter failed for tablet 98f61ace3a984938ace1fedbaa1dafa3 (table default.Table_c624a31c5179478cb6c54a36d7a36892 [id=26caa02bc37e471abdf29bbbb3acba69]),no further retry: Not found: Tablet not found: 98f61ace3a984938ace1fedbaa1dafa3
I20260923 19:50:28.614521 6459 raft_consensus.cc:2272] T 528fca12bfe04747830ad1d3bb323676 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:28.615134 6454 tablet_bootstrap.cc:492] T 2e1c19a751904a6295897376e9c5ee56 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:28.615370 6456 tablet_bootstrap.cc:492] T 772ece5283a949408d849f6e56f5f17b P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:28.616503 6458 tablet_replica.cc:333] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:28.616770 6454 tablet_bootstrap.cc:654] T 2e1c19a751904a6295897376e9c5ee56 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:28.616775 6458 raft_consensus.cc:2243] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:28.620760 6458 raft_consensus.cc:2272] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:28.623618 6317 tablet_service.cc:1558] Processing DeleteTablet for tablet 559f3e3016aa470f9732a727b4528586 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:28.623680 6178 tablet_service.cc:1558] Processing DeleteTablet for tablet 02fa9052a7054659baf9b07b770bb538 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:28.623703 6461 ts_tablet_manager.cc:1929] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:28.623793 6461 log.cc:1199] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/b6ef90ddd7a34dfdb8309d0e1c3688e7
I20260923 19:50:28.624099 6461 ts_tablet_manager.cc:1950] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:28.624102 6459 ts_tablet_manager.cc:1916] T 528fca12bfe04747830ad1d3bb323676 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:28.625927 7986 raft_consensus.cc:493] T cf0caa6afcf546678c233a9333b77a2a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.626188 6458 ts_tablet_manager.cc:1916] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:28.626102 7986 raft_consensus.cc:515] T cf0caa6afcf546678c233a9333b77a2a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.627543 7986 leader_election.cc:290] T cf0caa6afcf546678c233a9333b77a2a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:28.628031 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf0caa6afcf546678c233a9333b77a2a" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:28.628541 5996 leader_election.cc:343] T cf0caa6afcf546678c233a9333b77a2a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:28.632947 6454 tablet_bootstrap.cc:492] T 2e1c19a751904a6295897376e9c5ee56 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:28.633229 6454 ts_tablet_manager.cc:1403] T 2e1c19a751904a6295897376e9c5ee56 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.003s
I20260923 19:50:28.633728 8049 raft_consensus.cc:493] T 7f47efa0cabd47aa8ed0deface7763ab P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.633853 8049 raft_consensus.cc:515] T 7f47efa0cabd47aa8ed0deface7763ab P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.634097 6454 raft_consensus.cc:359] T 2e1c19a751904a6295897376e9c5ee56 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.634243 6454 raft_consensus.cc:385] T 2e1c19a751904a6295897376e9c5ee56 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:28.634290 6454 raft_consensus.cc:740] T 2e1c19a751904a6295897376e9c5ee56 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:28.634516 8049 leader_election.cc:290] T 7f47efa0cabd47aa8ed0deface7763ab P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:28.634472 6454 consensus_queue.cc:260] T 2e1c19a751904a6295897376e9c5ee56 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.635303 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f47efa0cabd47aa8ed0deface7763ab" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:28.635818 6280 leader_election.cc:343] T 7f47efa0cabd47aa8ed0deface7763ab P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:28.636211 6279 leader_election.cc:304] T a263c0fc71424999b76ef01de9a51eda P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
W20260923 19:50:28.636315 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 907bfabdc1f948d4872363b44bea154a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 907bfabdc1f948d4872363b44bea154a already in progress: creating tablet
I20260923 19:50:28.636567 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 146a402ff29a4e0b834a9f270d61e21c (table default.Table_605d43f9448e4b4bb429f8bf52d6ac55 [id=834c18797d8e48a79c45628c5180b80b]) successfully deleted
I20260923 19:50:28.636665 8049 raft_consensus.cc:2804] T a263c0fc71424999b76ef01de9a51eda P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:28.636731 8049 raft_consensus.cc:493] T a263c0fc71424999b76ef01de9a51eda P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:28.636791 8049 raft_consensus.cc:3060] T a263c0fc71424999b76ef01de9a51eda P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:28.636972 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf64073cdde748bc8ed3ce7580a71160" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:28.637145 6059 raft_consensus.cc:2468] T cf64073cdde748bc8ed3ce7580a71160 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:28.637310 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc47336948746d694d5a896730c501c" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:28.637630 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3acf4a03174f45d5aee9c9b1454784f8" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:28.638504 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf0caa6afcf546678c233a9333b77a2a" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:28.640676 8049 raft_consensus.cc:515] T a263c0fc71424999b76ef01de9a51eda P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.641167 6454 ts_tablet_manager.cc:1434] T 2e1c19a751904a6295897376e9c5ee56 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260923 19:50:28.641438 6454 tablet_bootstrap.cc:492] T 3c713a0973dc45debf61c228a4bf13bf P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:28.641964 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a263c0fc71424999b76ef01de9a51eda" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
W20260923 19:50:28.642478 6280 leader_election.cc:343] T a263c0fc71424999b76ef01de9a51eda P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:28.643364 8049 leader_election.cc:290] T a263c0fc71424999b76ef01de9a51eda P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:28.643672 6178 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e1c19a751904a6295897376e9c5ee56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:28.615485 6456 ts_tablet_manager.cc:1403] T 772ece5283a949408d849f6e56f5f17b P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.113s user 0.003s sys 0.003s
I20260923 19:50:28.645790 6456 raft_consensus.cc:359] T 772ece5283a949408d849f6e56f5f17b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.645984 6456 raft_consensus.cc:385] T 772ece5283a949408d849f6e56f5f17b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:28.646049 6456 raft_consensus.cc:740] T 772ece5283a949408d849f6e56f5f17b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:28.646235 6456 consensus_queue.cc:260] T 772ece5283a949408d849f6e56f5f17b P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.646674 6456 ts_tablet_manager.cc:1434] T 772ece5283a949408d849f6e56f5f17b P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 19:50:28.651594 6456 tablet_bootstrap.cc:492] T 37769256de33432697e9d4fb235f473f P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:28.652737 6454 tablet_bootstrap.cc:654] T 3c713a0973dc45debf61c228a4bf13bf P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:28.653136 7986 consensus_queue.cc:1048] T 8d20b59aa99f49f0b2f4d7dd861470f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:28.659631 5798 master_service.cc:960] ReplaceTablet: received request to replace tablet 4e69656e9fc941e19eb7de5c87bc9050 from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:28.661597 6454 tablet_bootstrap.cc:492] T 3c713a0973dc45debf61c228a4bf13bf P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:28.661574 7980 raft_consensus.cc:493] T e6e04d16675443fc923a5f8216e292b6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.661857 6454 ts_tablet_manager.cc:1403] T 3c713a0973dc45debf61c228a4bf13bf P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.020s user 0.007s sys 0.000s
I20260923 19:50:28.661835 7980 raft_consensus.cc:515] T e6e04d16675443fc923a5f8216e292b6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.662482 7980 leader_election.cc:290] T e6e04d16675443fc923a5f8216e292b6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:28.662606 6454 raft_consensus.cc:359] T 3c713a0973dc45debf61c228a4bf13bf P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.662739 6454 raft_consensus.cc:385] T 3c713a0973dc45debf61c228a4bf13bf P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:28.662788 6454 raft_consensus.cc:740] T 3c713a0973dc45debf61c228a4bf13bf P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:28.662990 6454 consensus_queue.cc:260] T 3c713a0973dc45debf61c228a4bf13bf P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.663480 6454 ts_tablet_manager.cc:1434] T 3c713a0973dc45debf61c228a4bf13bf P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20260923 19:50:28.664143 6139 leader_election.cc:343] T e6e04d16675443fc923a5f8216e292b6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: e6e04d16675443fc923a5f8216e292b6
W20260923 19:50:28.664258 6137 leader_election.cc:343] T e6e04d16675443fc923a5f8216e292b6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: e6e04d16675443fc923a5f8216e292b6
I20260923 19:50:28.664358 6137 leader_election.cc:304] T e6e04d16675443fc923a5f8216e292b6 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:28.664642 8055 raft_consensus.cc:2749] T e6e04d16675443fc923a5f8216e292b6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:28.666009 6454 tablet_bootstrap.cc:492] T ba0453ef529344dfbab1130daa985fef P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:28.667634 6454 tablet_bootstrap.cc:654] T ba0453ef529344dfbab1130daa985fef P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:28.667644 6457 tablet_bootstrap.cc:654] T a367cf3788ef49148a5c8d6864f71d8e P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:28.668128 6456 tablet_bootstrap.cc:654] T 37769256de33432697e9d4fb235f473f P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:28.668617 6309 tablet_service.cc:1558] Processing DeleteTablet for tablet 772ece5283a949408d849f6e56f5f17b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:28.671319 6178 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c713a0973dc45debf61c228a4bf13bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:28.675323 6461 tablet_replica.cc:333] T 839bcf991b754f9e95a1dd6c4f826e71 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:28.675576 6461 raft_consensus.cc:2243] T 839bcf991b754f9e95a1dd6c4f826e71 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:28.675743 6461 raft_consensus.cc:2272] T 839bcf991b754f9e95a1dd6c4f826e71 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:28.676394 6461 ts_tablet_manager.cc:1916] T 839bcf991b754f9e95a1dd6c4f826e71 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:28.678820 6054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6da9b3eea4547c9bb80b08bd26c5dc2" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:28.679032 6054 raft_consensus.cc:2468] T a6da9b3eea4547c9bb80b08bd26c5dc2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:28.680258 6054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f47efa0cabd47aa8ed0deface7763ab" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:28.680501 6054 raft_consensus.cc:2468] T 7f47efa0cabd47aa8ed0deface7763ab P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:28.681047 6054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a263c0fc71424999b76ef01de9a51eda" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:28.681209 6054 raft_consensus.cc:3060] T a263c0fc71424999b76ef01de9a51eda P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:28.683250 6456 tablet_bootstrap.cc:492] T 37769256de33432697e9d4fb235f473f P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:28.683368 6456 ts_tablet_manager.cc:1403] T 37769256de33432697e9d4fb235f473f P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.003s
I20260923 19:50:28.683961 6054 raft_consensus.cc:2468] T a263c0fc71424999b76ef01de9a51eda P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:28.683979 6456 raft_consensus.cc:359] T 37769256de33432697e9d4fb235f473f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.684113 6456 raft_consensus.cc:385] T 37769256de33432697e9d4fb235f473f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:28.684163 6456 raft_consensus.cc:740] T 37769256de33432697e9d4fb235f473f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:28.684350 6456 consensus_queue.cc:260] T 37769256de33432697e9d4fb235f473f P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.684868 6456 ts_tablet_manager.cc:1434] T 37769256de33432697e9d4fb235f473f P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260923 19:50:28.685134 6456 tablet_bootstrap.cc:492] T 3acf4a03174f45d5aee9c9b1454784f8 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:28.685532 7980 raft_consensus.cc:493] T 02fa9052a7054659baf9b07b770bb538 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.685662 7980 raft_consensus.cc:515] T 02fa9052a7054659baf9b07b770bb538 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.686242 7980 leader_election.cc:290] T 02fa9052a7054659baf9b07b770bb538 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:28.687544 6139 leader_election.cc:343] T 02fa9052a7054659baf9b07b770bb538 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 02fa9052a7054659baf9b07b770bb538
W20260923 19:50:28.687913 6137 leader_election.cc:343] T 02fa9052a7054659baf9b07b770bb538 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 02fa9052a7054659baf9b07b770bb538
I20260923 19:50:28.687999 6137 leader_election.cc:304] T 02fa9052a7054659baf9b07b770bb538 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:28.688344 7980 raft_consensus.cc:2749] T 02fa9052a7054659baf9b07b770bb538 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:28.694062 5995 leader_election.cc:343] T 2bc47336948746d694d5a896730c501c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:28.694272 5995 leader_election.cc:304] T 2bc47336948746d694d5a896730c501c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:28.694576 7986 raft_consensus.cc:2749] T 2bc47336948746d694d5a896730c501c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:28.694900 5995 leader_election.cc:343] T 3acf4a03174f45d5aee9c9b1454784f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:28.694989 5995 leader_election.cc:304] T 3acf4a03174f45d5aee9c9b1454784f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:28.695215 7986 raft_consensus.cc:2749] T 3acf4a03174f45d5aee9c9b1454784f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:28.695535 5995 leader_election.cc:343] T cf0caa6afcf546678c233a9333b77a2a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:28.695657 5995 leader_election.cc:304] T cf0caa6afcf546678c233a9333b77a2a P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:28.695842 7986 raft_consensus.cc:2749] T cf0caa6afcf546678c233a9333b77a2a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:28.696266 6039 tablet_service.cc:1558] Processing DeleteTablet for tablet 25117ec346224a85942d0106b4962a88 with delete_type TABLET_DATA_DELETED (replaced by tablet 28f0540aabaf4d1dbf4c4312e01ddcd3) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:28.696578 6039 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d1ed91cfd5f4d1eb1ea75fa6183141a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:28 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:28.696883 6039 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e3cdffa2c2a4e5da4980dea84d82c4e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:28 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:28.697347 6039 tablet_service.cc:1511] Processing CreateTablet for tablet 6b55111894bc4787be5f66f1f8d79482 (DEFAULT_TABLE table=default.Table_b2ca67b2177c4c03a924e9b0a4b46742 [id=5cbff99cb9a4477e814ac021eb9d441c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.697769 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b55111894bc4787be5f66f1f8d79482. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.706610 6459 ts_tablet_manager.cc:1929] T 528fca12bfe04747830ad1d3bb323676 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:28.706823 6458 ts_tablet_manager.cc:1929] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260923 19:50:28.706992 6458 log.cc:1199] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/85d35ebef3c24a2e89233dd900b63513
I20260923 19:50:28.707391 6458 ts_tablet_manager.cc:1950] T 85d35ebef3c24a2e89233dd900b63513 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:28.708240 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1255) took 1566 ms. Trace:
I20260923 19:50:28.708443 6459 log.cc:1199] T 528fca12bfe04747830ad1d3bb323676 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/528fca12bfe04747830ad1d3bb323676
I20260923 19:50:28.708928 6459 ts_tablet_manager.cc:1950] T 528fca12bfe04747830ad1d3bb323676 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:28.708767 8049 raft_consensus.cc:493] T 559f3e3016aa470f9732a727b4528586 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.709438 8049 raft_consensus.cc:515] T 559f3e3016aa470f9732a727b4528586 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.710189 8049 leader_election.cc:290] T 559f3e3016aa470f9732a727b4528586 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:28.711308 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "559f3e3016aa470f9732a727b4528586" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:28.712051 6280 leader_election.cc:343] T 559f3e3016aa470f9732a727b4528586 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:28.714391 6039 tablet_service.cc:1511] Processing CreateTablet for tablet cd95d7cd608243b78421107a0cd510e0 (DEFAULT_TABLE table=default.Table_6d4436d2f89b4e74b85c8b13a581843e [id=0d77d7483b6543099df13f4f14c5fd24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.714774 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd95d7cd608243b78421107a0cd510e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.719247 5799 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 8d20b59aa99f49f0b2f4d7dd861470f8 (table default.Table_3a666373aff54c2d8256d8fc785cfcc1 [id=57da80bd083d4763a5523608ea26f2bb]). Expected version 1 got 0
I20260923 19:50:28.721168 8053 raft_consensus.cc:493] T 0f90406b20f54787bd27255d5ae81d1c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.721326 8053 raft_consensus.cc:515] T 0f90406b20f54787bd27255d5ae81d1c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.722128 8053 leader_election.cc:290] T 0f90406b20f54787bd27255d5ae81d1c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:28.724115 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f90406b20f54787bd27255d5ae81d1c" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:28.724349 6341 raft_consensus.cc:2468] T 0f90406b20f54787bd27255d5ae81d1c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 0.
I20260923 19:50:28.725171 7980 raft_consensus.cc:493] T ba639d8c68cf49a49a5ec5729143cf6b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.725293 7980 raft_consensus.cc:515] T ba639d8c68cf49a49a5ec5729143cf6b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.725829 7980 leader_election.cc:290] T ba639d8c68cf49a49a5ec5729143cf6b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:28.727768 5996 leader_election.cc:304] T 0f90406b20f54787bd27255d5ae81d1c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:28.728097 8053 raft_consensus.cc:2804] T 0f90406b20f54787bd27255d5ae81d1c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:28.728168 8053 raft_consensus.cc:493] T 0f90406b20f54787bd27255d5ae81d1c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:28.728219 8053 raft_consensus.cc:3060] T 0f90406b20f54787bd27255d5ae81d1c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
W20260923 19:50:28.728293 6137 leader_election.cc:343] T ba639d8c68cf49a49a5ec5729143cf6b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: ba639d8c68cf49a49a5ec5729143cf6b
I20260923 19:50:28.729128 6457 tablet_bootstrap.cc:492] T a367cf3788ef49148a5c8d6864f71d8e P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:28.729240 6457 ts_tablet_manager.cc:1403] T a367cf3788ef49148a5c8d6864f71d8e P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.115s user 0.000s sys 0.004s
I20260923 19:50:28.729799 6457 raft_consensus.cc:359] T a367cf3788ef49148a5c8d6864f71d8e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.729967 6457 raft_consensus.cc:385] T a367cf3788ef49148a5c8d6864f71d8e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:28.730011 6457 raft_consensus.cc:740] T a367cf3788ef49148a5c8d6864f71d8e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:28.730960 8053 raft_consensus.cc:515] T 0f90406b20f54787bd27255d5ae81d1c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.731663 8053 leader_election.cc:290] T 0f90406b20f54787bd27255d5ae81d1c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:28.732101 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f90406b20f54787bd27255d5ae81d1c" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:28.732300 6342 raft_consensus.cc:3060] T 0f90406b20f54787bd27255d5ae81d1c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:28.734269 6040 tablet_service.cc:1511] Processing CreateTablet for tablet 90f519d54f5a41f98eb10259a8beb82f (DEFAULT_TABLE table=default.Table_e773814b4bc24001813b9088825f6247 [id=70a4d3875d7f41e49ff0a734e3908fc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.734617 6040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90f519d54f5a41f98eb10259a8beb82f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.735239 6342 raft_consensus.cc:2468] T 0f90406b20f54787bd27255d5ae81d1c P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in term 1.
W20260923 19:50:28.735939 6139 leader_election.cc:343] T ba639d8c68cf49a49a5ec5729143cf6b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: ba639d8c68cf49a49a5ec5729143cf6b
I20260923 19:50:28.736079 6139 leader_election.cc:304] T ba639d8c68cf49a49a5ec5729143cf6b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:28.736569 7980 raft_consensus.cc:2749] T ba639d8c68cf49a49a5ec5729143cf6b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:28.738441 5996 leader_election.cc:304] T 0f90406b20f54787bd27255d5ae81d1c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters:
I20260923 19:50:28.738809 5799 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 8d20b59aa99f49f0b2f4d7dd861470f8 (table default.Table_3a666373aff54c2d8256d8fc785cfcc1 [id=57da80bd083d4763a5523608ea26f2bb]). Expected version 1 got 0
I20260923 19:50:28.712280 6458 rpcz_store.cc:276] 0923 19:50:27.141470 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:27.157132 (+ 15662us) service_pool.cc:224] Handling call
0923 19:50:28.614408 (+1457276us) ts_tablet_manager.cc:1151] Deleting tablet 85d35ebef3c24a2e89233dd900b63513
0923 19:50:28.616464 (+ 2056us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.680272 (+ 63808us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.683580 (+ 3308us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.708221 (+ 24641us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1455787}
I20260923 19:50:28.739639 6458 tablet_replica.cc:333] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:28.739840 6458 raft_consensus.cc:2243] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:28.739274 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 85d35ebef3c24a2e89233dd900b63513 (table default.Table_7d891deab94f4132b4358c6e4dfd54af [id=da91b06e11c64bb0aaec37a0188b5586]) successfully deleted
I20260923 19:50:28.740962 6309 tablet_service.cc:1558] Processing DeleteTablet for tablet 37769256de33432697e9d4fb235f473f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:17 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:28.741084 6458 raft_consensus.cc:2272] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:28.741595 6458 ts_tablet_manager.cc:1916] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:28.741629 8053 raft_consensus.cc:2804] T 0f90406b20f54787bd27255d5ae81d1c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:28.720948 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1117) took 3585 ms. Trace:
I20260923 19:50:28.745318 6459 rpcz_store.cc:276] 0923 19:50:25.135846 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:25.135914 (+ 68us) service_pool.cc:224] Handling call
0923 19:50:28.602480 (+3466566us) ts_tablet_manager.cc:1151] Deleting tablet 528fca12bfe04747830ad1d3bb323676
0923 19:50:28.602489 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.679711 (+ 77222us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.706550 (+ 26839us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.720918 (+ 14368us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3466395}
I20260923 19:50:28.747710 6459 tablet_replica.cc:333] T e6e04d16675443fc923a5f8216e292b6 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:28.748286 6040 tablet_service.cc:1511] Processing CreateTablet for tablet 02a9f02e1a964401a34c37ceaef4f1e3 (DEFAULT_TABLE table=default.Table_564b5ac3637c4a75aee56960a3e1fe03 [id=a6d4111238e74195935bd70f2adf0451]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.748472 6459 raft_consensus.cc:2243] T e6e04d16675443fc923a5f8216e292b6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:28.748706 6040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02a9f02e1a964401a34c37ceaef4f1e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.748765 6459 raft_consensus.cc:2272] T e6e04d16675443fc923a5f8216e292b6 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:28.749322 6459 ts_tablet_manager.cc:1916] T e6e04d16675443fc923a5f8216e292b6 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:28.754020 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 528fca12bfe04747830ad1d3bb323676 (table default.Table_141fc144025e434aa7d7a6e0ecb9c98d [id=f4622a8ebb6644cba5c5c4d18a9a22f1]) successfully deleted
I20260923 19:50:28.754252 6457 consensus_queue.cc:260] T a367cf3788ef49148a5c8d6864f71d8e P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.755271 6035 tablet_service.cc:1511] Processing CreateTablet for tablet 9dae0fccc74646869b0da7a4ad1fe98c (DEFAULT_TABLE table=default.Table_b0623fc8e1dd40bcbd5dc4850272935b [id=fbe6e46b8d50471f913c5068f29399a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.755651 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dae0fccc74646869b0da7a4ad1fe98c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.757769 6459 ts_tablet_manager.cc:1929] T e6e04d16675443fc923a5f8216e292b6 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:28.761776 8053 raft_consensus.cc:697] T 0f90406b20f54787bd27255d5ae81d1c P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 LEADER]: Becoming Leader. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Running, Role: LEADER
I20260923 19:50:28.762156 8053 consensus_queue.cc:237] T 0f90406b20f54787bd27255d5ae81d1c P e546f660e7e541d1aa9ae38e5ee5b9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.760510 6458 ts_tablet_manager.cc:1929] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260923 19:50:28.764321 6458 log.cc:1199] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/26031fe469d046518cdd0f1e955e19d1
I20260923 19:50:28.764693 6458 ts_tablet_manager.cc:1950] T 26031fe469d046518cdd0f1e955e19d1 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:28.765468 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1265) took 1390 ms. Trace:
I20260923 19:50:28.765555 6458 rpcz_store.cc:276] 0923 19:50:27.375355 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:27.376279 (+ 924us) service_pool.cc:224] Handling call
0923 19:50:28.739594 (+1363315us) ts_tablet_manager.cc:1151] Deleting tablet 26031fe469d046518cdd0f1e955e19d1
0923 19:50:28.739604 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.744617 (+ 5013us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.760461 (+ 15844us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.765448 (+ 4987us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1363122}
I20260923 19:50:28.766014 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 26031fe469d046518cdd0f1e955e19d1 (table default.Table_d6a453784ebd47b9b8c169ab766d6c23 [id=82cba3f0e2f64118a0747fe6ff9bc796]) successfully deleted
I20260923 19:50:28.767165 5799 master_service.cc:960] ReplaceTablet: received request to replace tablet fc71e2911b9e4d1eb3fcebe7d1e4d96c from {username='slave'} at 127.0.0.1:59912
I20260923 19:50:28.757863 6459 log.cc:1199] T e6e04d16675443fc923a5f8216e292b6 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/e6e04d16675443fc923a5f8216e292b6
I20260923 19:50:28.767818 6459 ts_tablet_manager.cc:1950] T e6e04d16675443fc923a5f8216e292b6 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:28.767782 6035 tablet_service.cc:1511] Processing CreateTablet for tablet 001523cd54e842fd926f48419e46c435 (DEFAULT_TABLE table=default.Table_7a817dc7d005417a847ee0402080fe76 [id=d61abaee27364bb2bfcf45b160b9ffd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.764827 6454 tablet_bootstrap.cc:492] T ba0453ef529344dfbab1130daa985fef P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:28.768244 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 001523cd54e842fd926f48419e46c435. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.768237 6454 ts_tablet_manager.cc:1403] T ba0453ef529344dfbab1130daa985fef P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.102s user 0.014s sys 0.020s
I20260923 19:50:28.768987 6454 raft_consensus.cc:359] T ba0453ef529344dfbab1130daa985fef P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.769186 6454 raft_consensus.cc:385] T ba0453ef529344dfbab1130daa985fef P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:28.769250 6454 raft_consensus.cc:740] T ba0453ef529344dfbab1130daa985fef P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:28.769457 6454 consensus_queue.cc:260] T ba0453ef529344dfbab1130daa985fef P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.769976 6454 ts_tablet_manager.cc:1434] T ba0453ef529344dfbab1130daa985fef P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:28.770210 6454 tablet_bootstrap.cc:492] T d04b3a9ade7a405bb619704095fac279 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:28.771736 6454 tablet_bootstrap.cc:654] T d04b3a9ade7a405bb619704095fac279 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:28.772315 6456 tablet_bootstrap.cc:654] T 3acf4a03174f45d5aee9c9b1454784f8 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:28.775267 6022 tablet_service.cc:1511] Processing CreateTablet for tablet 62f632be03354e0da46613ca5a62325f (DEFAULT_TABLE table=default.Table_e1580fe44b374656b6657f26f1927b29 [id=c73cbcb1bf1e45b8a7b84753eaae5635]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.775650 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62f632be03354e0da46613ca5a62325f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.782284 6178 tablet_service.cc:1558] Processing DeleteTablet for tablet ba0453ef529344dfbab1130daa985fef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:28.783780 6457 ts_tablet_manager.cc:1434] T a367cf3788ef49148a5c8d6864f71d8e P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.054s user 0.002s sys 0.000s
I20260923 19:50:28.784137 6457 tablet_bootstrap.cc:492] T ebc288d8d453481592df11cd1bfed3ac P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:28.786003 6457 tablet_bootstrap.cc:654] T ebc288d8d453481592df11cd1bfed3ac P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:28.786916 6456 tablet_bootstrap.cc:492] T 3acf4a03174f45d5aee9c9b1454784f8 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:28.787066 6456 ts_tablet_manager.cc:1403] T 3acf4a03174f45d5aee9c9b1454784f8 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.102s user 0.014s sys 0.009s
I20260923 19:50:28.787420 6279 leader_election.cc:304] T cf64073cdde748bc8ed3ce7580a71160 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:28.787564 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet b6ef90ddd7a34dfdb8309d0e1c3688e7 (table default.Table_5fddffc3232840a1897043b514d0e68b [id=3382d05ca17e45efae6c9c6f4e854edf]) successfully deleted
W20260923 19:50:28.787851 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 9968ab539c9149e98aa5326c208ce140 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9968ab539c9149e98aa5326c208ce140 already in progress: creating tablet
W20260923 19:50:28.788066 6279 leader_election.cc:343] T ce6b86f947ce420994eaa5ff39ad9c87 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: ce6b86f947ce420994eaa5ff39ad9c87
I20260923 19:50:28.788166 6279 leader_election.cc:304] T ce6b86f947ce420994eaa5ff39ad9c87 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:28.788465 8049 raft_consensus.cc:2804] T cf64073cdde748bc8ed3ce7580a71160 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:28.788537 8049 raft_consensus.cc:493] T cf64073cdde748bc8ed3ce7580a71160 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:28.788606 8049 raft_consensus.cc:3060] T cf64073cdde748bc8ed3ce7580a71160 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:28.788960 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f90406b20f54787bd27255d5ae81d1c" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:28.789310 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f90406b20f54787bd27255d5ae81d1c" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:28.789701 8103 tablet.cc:1751] T 35f46a1be80c4194b592c5d00fe1f342 P 61022dd7f2f14dc19aebe3af5f08f430: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260923 19:50:28.791282 8049 raft_consensus.cc:515] T cf64073cdde748bc8ed3ce7580a71160 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.792282 7993 raft_consensus.cc:2749] T ce6b86f947ce420994eaa5ff39ad9c87 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:28.794137 8049 leader_election.cc:290] T cf64073cdde748bc8ed3ce7580a71160 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:28.794340 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf64073cdde748bc8ed3ce7580a71160" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
W20260923 19:50:28.795090 6280 leader_election.cc:343] T cf64073cdde748bc8ed3ce7580a71160 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:28.797456 6456 raft_consensus.cc:359] T 3acf4a03174f45d5aee9c9b1454784f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.797624 6456 raft_consensus.cc:385] T 3acf4a03174f45d5aee9c9b1454784f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:28.797681 6456 raft_consensus.cc:740] T 3acf4a03174f45d5aee9c9b1454784f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:28.797866 6456 consensus_queue.cc:260] T 3acf4a03174f45d5aee9c9b1454784f8 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.804200 6456 ts_tablet_manager.cc:1434] T 3acf4a03174f45d5aee9c9b1454784f8 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260923 19:50:28.804514 6456 tablet_bootstrap.cc:492] T 30fe07956e8940fcb7ba1e2e16ced463 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:28.805867 6456 tablet_bootstrap.cc:654] T 30fe07956e8940fcb7ba1e2e16ced463 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:28.786844 6022 tablet_service.cc:1511] Processing CreateTablet for tablet e60597e9959b4224b59655c0d8f6f7a9 (DEFAULT_TABLE table=default.Table_bd5cff276b1e441088052e4e8264430c [id=a06551208d4c4e51bf81f02ab35146e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.809630 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e60597e9959b4224b59655c0d8f6f7a9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:28.789829 5995 leader_election.cc:343] T 0f90406b20f54787bd27255d5ae81d1c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:28.815547 5995 consensus_peers.cc:597] T 8d20b59aa99f49f0b2f4d7dd861470f8 P e546f660e7e541d1aa9ae38e5ee5b9c0 -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260923 19:50:28.815712 5995 leader_election.cc:343] T 0f90406b20f54787bd27255d5ae81d1c P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:28.806705 6035 tablet_service.cc:1511] Processing CreateTablet for tablet 904f0a65ae7f41a5b690b208550533a7 (DEFAULT_TABLE table=default.Table_cb7681f47cb44025a62096e5b8e95087 [id=c7dda5ebfe6944c8a50f287500cdd013]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.816552 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 904f0a65ae7f41a5b690b208550533a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.830533 6461 ts_tablet_manager.cc:1929] T 839bcf991b754f9e95a1dd6c4f826e71 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:28.830670 6461 log.cc:1199] T 839bcf991b754f9e95a1dd6c4f826e71 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/839bcf991b754f9e95a1dd6c4f826e71
I20260923 19:50:28.830950 6461 ts_tablet_manager.cc:1950] T 839bcf991b754f9e95a1dd6c4f826e71 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:28.831877 6461 tablet_replica.cc:333] T d35ff653bf8d41cfbcf83359402a8f6a P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:28.832089 6461 raft_consensus.cc:2243] T d35ff653bf8d41cfbcf83359402a8f6a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:28.832254 6461 raft_consensus.cc:2272] T d35ff653bf8d41cfbcf83359402a8f6a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:28.832818 6461 ts_tablet_manager.cc:1916] T d35ff653bf8d41cfbcf83359402a8f6a P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:28.834496 6279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.193:39887, user_credentials={real_user=slave}} blocked reactor thread for 46429us
I20260923 19:50:28.834883 6279 leader_election.cc:304] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:28.835014 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 839bcf991b754f9e95a1dd6c4f826e71 (table default.Table_c61ffa0e84514cddb714dc30da0a21f6 [id=3ee0e52e785f4cb39add98261628d513]) successfully deleted
I20260923 19:50:28.835700 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1118) took 3663 ms. Trace:
I20260923 19:50:28.835747 8049 raft_consensus.cc:2804] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:28.835824 8049 raft_consensus.cc:493] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:28.835892 8049 raft_consensus.cc:3060] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:28.834937 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1285) took 1037 ms. Trace:
I20260923 19:50:28.836088 6458 rpcz_store.cc:276] 0923 19:50:27.797295 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:27.797482 (+ 187us) service_pool.cc:224] Handling call
0923 19:50:28.834789 (+1037307us) ts_tablet_manager.cc:1151] Deleting tablet fb44c10b4f6148738306c617aac88b43
0923 19:50:28.834803 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.834916 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1037105}
I20260923 19:50:28.837564 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1287) took 1039 ms. Trace:
I20260923 19:50:28.837700 6459 rpcz_store.cc:276] 0923 19:50:25.172249 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:25.172305 (+ 56us) service_pool.cc:224] Handling call
0923 19:50:28.747650 (+3575345us) ts_tablet_manager.cc:1151] Deleting tablet e6e04d16675443fc923a5f8216e292b6
0923 19:50:28.747665 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.754815 (+ 7150us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.757722 (+ 2907us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.835670 (+ 77948us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3575065}
W20260923 19:50:28.837818 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet fb44c10b4f6148738306c617aac88b43 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb44c10b4f6148738306c617aac88b43 already in progress: creating tablet
I20260923 19:50:28.837999 6458 rpcz_store.cc:276] 0923 19:50:27.797675 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:27.797723 (+ 48us) service_pool.cc:224] Handling call
0923 19:50:28.837444 (+1039721us) ts_tablet_manager.cc:1151] Deleting tablet d525bdd4c25843c988865553bd2b3066
0923 19:50:28.837454 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.837546 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1039527}
I20260923 19:50:28.838411 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet e6e04d16675443fc923a5f8216e292b6 (table default.Table_ea8c4179d37e4165869f5bf030971467 [id=5c206f48fb1a4be587f17803f654ce5a]) successfully deleted
I20260923 19:50:28.838724 7993 raft_consensus.cc:493] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260923 19:50:28.838884 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet d525bdd4c25843c988865553bd2b3066 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d525bdd4c25843c988865553bd2b3066 already in progress: creating tablet
I20260923 19:50:28.838843 7993 raft_consensus.cc:515] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.839413 7993 leader_election.cc:290] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:28.839804 6456 tablet_bootstrap.cc:492] T 30fe07956e8940fcb7ba1e2e16ced463 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:28.839803 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bbd8fcc5ea1431ab9e4fadb7d52269e" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:28.839932 6456 ts_tablet_manager.cc:1403] T 30fe07956e8940fcb7ba1e2e16ced463 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.000s
W20260923 19:50:28.840330 6280 leader_election.cc:343] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:28.840536 6459 tablet_replica.cc:333] T 554655516bb547ad9c2aa1ee66dc8deb P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:28.840533 6456 raft_consensus.cc:359] T 30fe07956e8940fcb7ba1e2e16ced463 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.840683 6456 raft_consensus.cc:385] T 30fe07956e8940fcb7ba1e2e16ced463 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:28.840744 6456 raft_consensus.cc:740] T 30fe07956e8940fcb7ba1e2e16ced463 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:28.839253 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1286) took 1041 ms. Trace:
I20260923 19:50:28.840888 6458 rpcz_store.cc:276] 0923 19:50:27.797429 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:27.800128 (+ 2699us) service_pool.cc:224] Handling call
0923 19:50:28.839161 (+1039033us) ts_tablet_manager.cc:1151] Deleting tablet 039419cd51504cf2af724d92cbaa8858
0923 19:50:28.839170 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.839239 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1038870}
W20260923 19:50:28.841277 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 039419cd51504cf2af724d92cbaa8858 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 039419cd51504cf2af724d92cbaa8858 already in progress: creating tablet
I20260923 19:50:28.841378 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1284) took 1044 ms. Trace:
I20260923 19:50:28.841018 6459 raft_consensus.cc:2243] T 554655516bb547ad9c2aa1ee66dc8deb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:28.841450 6458 rpcz_store.cc:276] 0923 19:50:27.797153 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:27.800381 (+ 3228us) service_pool.cc:224] Handling call
0923 19:50:28.841282 (+1040901us) ts_tablet_manager.cc:1151] Deleting tablet e8b0d0a8e4e54ec195893127f7a76bed
0923 19:50:28.841291 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.841364 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1040766}
I20260923 19:50:28.841725 6459 raft_consensus.cc:2272] T 554655516bb547ad9c2aa1ee66dc8deb P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:28.841823 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet e8b0d0a8e4e54ec195893127f7a76bed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e8b0d0a8e4e54ec195893127f7a76bed already in progress: creating tablet
I20260923 19:50:28.842324 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1288) took 1041 ms. Trace:
I20260923 19:50:28.842402 6458 rpcz_store.cc:276] 0923 19:50:27.800598 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:27.801694 (+ 1096us) service_pool.cc:224] Handling call
0923 19:50:28.842229 (+1040535us) ts_tablet_manager.cc:1151] Deleting tablet db943a36b2fe4ca9813e08ddb38ce7f6
0923 19:50:28.842237 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.842308 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1040389}
I20260923 19:50:28.842485 6457 tablet_bootstrap.cc:492] T ebc288d8d453481592df11cd1bfed3ac P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:28.842614 6457 ts_tablet_manager.cc:1403] T ebc288d8d453481592df11cd1bfed3ac P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.059s user 0.001s sys 0.002s
W20260923 19:50:28.842762 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet db943a36b2fe4ca9813e08ddb38ce7f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db943a36b2fe4ca9813e08ddb38ce7f6 already in progress: creating tablet
I20260923 19:50:28.843029 6458 tablet_replica.cc:333] T ba0453ef529344dfbab1130daa985fef P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:28.843204 6458 raft_consensus.cc:2243] T ba0453ef529344dfbab1130daa985fef P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:28.843343 6458 raft_consensus.cc:2272] T ba0453ef529344dfbab1130daa985fef P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:28.843590 6459 ts_tablet_manager.cc:1916] T 554655516bb547ad9c2aa1ee66dc8deb P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:28.843773 6458 ts_tablet_manager.cc:1916] T ba0453ef529344dfbab1130daa985fef P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:28.843334 6457 raft_consensus.cc:359] T ebc288d8d453481592df11cd1bfed3ac P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.845597 6457 raft_consensus.cc:385] T ebc288d8d453481592df11cd1bfed3ac P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:28.845695 6457 raft_consensus.cc:740] T ebc288d8d453481592df11cd1bfed3ac P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:28.846012 6457 consensus_queue.cc:260] T ebc288d8d453481592df11cd1bfed3ac P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.838735 8049 raft_consensus.cc:515] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.846727 6457 ts_tablet_manager.cc:1434] T ebc288d8d453481592df11cd1bfed3ac P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260923 19:50:28.847721 8049 leader_election.cc:290] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:28.848048 6279 leader_election.cc:304] T 7f47efa0cabd47aa8ed0deface7763ab P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:28.848299 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6da9b3eea4547c9bb80b08bd26c5dc2" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
I20260923 19:50:28.849694 6454 tablet_bootstrap.cc:492] T d04b3a9ade7a405bb619704095fac279 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:28.849849 6454 ts_tablet_manager.cc:1403] T d04b3a9ade7a405bb619704095fac279 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.080s user 0.013s sys 0.034s
I20260923 19:50:28.850915 6454 raft_consensus.cc:359] T d04b3a9ade7a405bb619704095fac279 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.851202 6454 raft_consensus.cc:385] T d04b3a9ade7a405bb619704095fac279 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:28.851312 6454 raft_consensus.cc:740] T d04b3a9ade7a405bb619704095fac279 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:28.851574 6454 consensus_queue.cc:260] T d04b3a9ade7a405bb619704095fac279 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.851959 6457 tablet_bootstrap.cc:492] T 3a4b9d48f02a4372adce6d9eb80935f6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:28.852865 7980 raft_consensus.cc:493] T 3c713a0973dc45debf61c228a4bf13bf P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.852972 7980 raft_consensus.cc:515] T 3c713a0973dc45debf61c228a4bf13bf P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.853493 7980 leader_election.cc:290] T 3c713a0973dc45debf61c228a4bf13bf P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:28.856277 6454 ts_tablet_manager.cc:1434] T d04b3a9ade7a405bb619704095fac279 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260923 19:50:28.856564 6454 tablet_bootstrap.cc:492] T 688bb1055ba94c2996cdfea6dea76416 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
W20260923 19:50:28.848726 6280 leader_election.cc:343] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
W20260923 19:50:28.857370 6137 leader_election.cc:343] T 3c713a0973dc45debf61c228a4bf13bf P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 3c713a0973dc45debf61c228a4bf13bf
I20260923 19:50:28.854702 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c713a0973dc45debf61c228a4bf13bf" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:28.857697 6341 raft_consensus.cc:2468] T 3c713a0973dc45debf61c228a4bf13bf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:28.857739 7993 raft_consensus.cc:2804] T 7f47efa0cabd47aa8ed0deface7763ab P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:28.857836 7993 raft_consensus.cc:493] T 7f47efa0cabd47aa8ed0deface7763ab P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:28.857925 7993 raft_consensus.cc:3060] T 7f47efa0cabd47aa8ed0deface7763ab P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:28.858227 6454 tablet_bootstrap.cc:654] T 688bb1055ba94c2996cdfea6dea76416 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:28.858489 6139 leader_election.cc:304] T 3c713a0973dc45debf61c228a4bf13bf P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:28.858878 7980 raft_consensus.cc:2804] T 3c713a0973dc45debf61c228a4bf13bf P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:28.858942 7980 raft_consensus.cc:493] T 3c713a0973dc45debf61c228a4bf13bf P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:28.859050 7980 raft_consensus.cc:3060] T 3c713a0973dc45debf61c228a4bf13bf P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:28.860922 7993 raft_consensus.cc:515] T 7f47efa0cabd47aa8ed0deface7763ab P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.861922 7993 leader_election.cc:290] T 7f47efa0cabd47aa8ed0deface7763ab P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:28.862001 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f47efa0cabd47aa8ed0deface7763ab" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
W20260923 19:50:28.862505 6280 leader_election.cc:343] T 7f47efa0cabd47aa8ed0deface7763ab P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:28.862775 6279 leader_election.cc:304] T a263c0fc71424999b76ef01de9a51eda P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:28.863055 7993 raft_consensus.cc:2804] T a263c0fc71424999b76ef01de9a51eda P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:28.863204 7993 raft_consensus.cc:697] T a263c0fc71424999b76ef01de9a51eda P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:28.863487 6461 ts_tablet_manager.cc:1929] T d35ff653bf8d41cfbcf83359402a8f6a P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:28.863632 6461 log.cc:1199] T d35ff653bf8d41cfbcf83359402a8f6a P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/d35ff653bf8d41cfbcf83359402a8f6a
I20260923 19:50:28.863503 7993 consensus_queue.cc:237] T a263c0fc71424999b76ef01de9a51eda P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.864012 6461 ts_tablet_manager.cc:1950] T d35ff653bf8d41cfbcf83359402a8f6a P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:28.865046 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet d35ff653bf8d41cfbcf83359402a8f6a (table default.Table_f8ddcdb63fd04bd7b8f2a95e97e449bf [id=3c751273c2a044e09499b3a07044b3db]) successfully deleted
W20260923 19:50:28.865116 6279 leader_election.cc:343] T 559f3e3016aa470f9732a727b4528586 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 559f3e3016aa470f9732a727b4528586
I20260923 19:50:28.865207 6279 leader_election.cc:304] T 559f3e3016aa470f9732a727b4528586 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:28.865393 8132 raft_consensus.cc:2749] T 559f3e3016aa470f9732a727b4528586 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:28.866014 6054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf64073cdde748bc8ed3ce7580a71160" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:28.866190 6054 raft_consensus.cc:3060] T cf64073cdde748bc8ed3ce7580a71160 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:28.866287 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6da9b3eea4547c9bb80b08bd26c5dc2" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:28.866410 6060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bbd8fcc5ea1431ab9e4fadb7d52269e" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:28.866462 6059 raft_consensus.cc:3060] T a6da9b3eea4547c9bb80b08bd26c5dc2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:28.866596 6060 raft_consensus.cc:2468] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:28.866899 6056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f47efa0cabd47aa8ed0deface7763ab" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:28.867053 6056 raft_consensus.cc:3060] T 7f47efa0cabd47aa8ed0deface7763ab P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:28.869139 6054 raft_consensus.cc:2468] T cf64073cdde748bc8ed3ce7580a71160 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:28.869251 6059 raft_consensus.cc:2468] T a6da9b3eea4547c9bb80b08bd26c5dc2 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:28.869630 6056 raft_consensus.cc:2468] T 7f47efa0cabd47aa8ed0deface7763ab P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:28.870566 7980 raft_consensus.cc:515] T 3c713a0973dc45debf61c228a4bf13bf P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.871932 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c713a0973dc45debf61c228a4bf13bf" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:28.872154 6341 raft_consensus.cc:3060] T 3c713a0973dc45debf61c228a4bf13bf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:28.872532 6461 tablet_replica.cc:333] T 18a31ed6bea444e7888f374927f90a60 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:28.872792 6461 raft_consensus.cc:2243] T 18a31ed6bea444e7888f374927f90a60 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:28.872960 6461 raft_consensus.cc:2272] T 18a31ed6bea444e7888f374927f90a60 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:28.873107 8132 consensus_queue.cc:1048] T f2799563250845b0b9d7d51b2367b16b P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:28.873487 6461 ts_tablet_manager.cc:1916] T 18a31ed6bea444e7888f374927f90a60 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:28.873682 6279 leader_election.cc:304] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:28.874191 8132 raft_consensus.cc:2804] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:28.874262 8132 raft_consensus.cc:493] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:28.874325 8132 raft_consensus.cc:3060] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:28.875427 6341 raft_consensus.cc:2468] T 3c713a0973dc45debf61c228a4bf13bf P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:28.876425 6139 leader_election.cc:304] T 3c713a0973dc45debf61c228a4bf13bf P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:28.876863 8132 raft_consensus.cc:515] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.877375 8132 leader_election.cc:290] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:28.877542 8055 raft_consensus.cc:2804] T 3c713a0973dc45debf61c228a4bf13bf P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
W20260923 19:50:28.877662 6137 leader_election.cc:343] T 3c713a0973dc45debf61c228a4bf13bf P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Not found: Tablet not found: 3c713a0973dc45debf61c228a4bf13bf
I20260923 19:50:28.877815 7980 leader_election.cc:290] T 3c713a0973dc45debf61c228a4bf13bf P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:28.878261 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bbd8fcc5ea1431ab9e4fadb7d52269e" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430"
W20260923 19:50:28.878706 6280 leader_election.cc:343] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:28.883101 6175 tablet_service.cc:1558] Processing DeleteTablet for tablet d04b3a9ade7a405bb619704095fac279 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:07 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:28.883352 6457 tablet_bootstrap.cc:654] T 3a4b9d48f02a4372adce6d9eb80935f6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:28.885208 6279 leader_election.cc:304] T cf64073cdde748bc8ed3ce7580a71160 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:28.886210 8049 raft_consensus.cc:2804] T cf64073cdde748bc8ed3ce7580a71160 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:28.886991 6279 leader_election.cc:304] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:28.888211 8049 raft_consensus.cc:697] T cf64073cdde748bc8ed3ce7580a71160 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:28.840920 6456 consensus_queue.cc:260] T 30fe07956e8940fcb7ba1e2e16ced463 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.888695 8132 raft_consensus.cc:2804] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:28.888736 8049 consensus_queue.cc:237] T cf64073cdde748bc8ed3ce7580a71160 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.888897 8132 raft_consensus.cc:697] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:28.889292 8132 consensus_queue.cc:237] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.889496 6279 leader_election.cc:304] T 7f47efa0cabd47aa8ed0deface7763ab P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:28.893051 6461 ts_tablet_manager.cc:1929] T 18a31ed6bea444e7888f374927f90a60 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:28.893186 6461 log.cc:1199] T 18a31ed6bea444e7888f374927f90a60 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/18a31ed6bea444e7888f374927f90a60
I20260923 19:50:28.893815 6461 ts_tablet_manager.cc:1950] T 18a31ed6bea444e7888f374927f90a60 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:28.894845 6454 tablet_bootstrap.cc:492] T 688bb1055ba94c2996cdfea6dea76416 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:28.895002 6454 ts_tablet_manager.cc:1403] T 688bb1055ba94c2996cdfea6dea76416 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.039s user 0.010s sys 0.012s
I20260923 19:50:28.895915 6459 ts_tablet_manager.cc:1929] T 554655516bb547ad9c2aa1ee66dc8deb P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:28.896081 6459 log.cc:1199] T 554655516bb547ad9c2aa1ee66dc8deb P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/554655516bb547ad9c2aa1ee66dc8deb
I20260923 19:50:28.896224 8049 raft_consensus.cc:2804] T 7f47efa0cabd47aa8ed0deface7763ab P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:28.896400 8049 raft_consensus.cc:697] T 7f47efa0cabd47aa8ed0deface7763ab P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:28.896427 6459 ts_tablet_manager.cc:1950] T 554655516bb547ad9c2aa1ee66dc8deb P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:28.896682 8049 consensus_queue.cc:237] T 7f47efa0cabd47aa8ed0deface7763ab P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.897143 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1119) took 3628 ms. Trace:
I20260923 19:50:28.897236 6459 rpcz_store.cc:276] 0923 19:50:25.268872 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:25.268931 (+ 59us) service_pool.cc:224] Handling call
0923 19:50:28.838314 (+3569383us) ts_tablet_manager.cc:1151] Deleting tablet 554655516bb547ad9c2aa1ee66dc8deb
0923 19:50:28.838323 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.850411 (+ 12088us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.895867 (+ 45456us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.897121 (+ 1254us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3569184}
I20260923 19:50:28.897670 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 554655516bb547ad9c2aa1ee66dc8deb (table default.Table_bf20f5ba63594cce94f323629947c04c [id=648700f6ed984eb8942ecfc647e8c725]) successfully deleted
I20260923 19:50:28.895869 6454 raft_consensus.cc:359] T 688bb1055ba94c2996cdfea6dea76416 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.897912 6454 raft_consensus.cc:385] T 688bb1055ba94c2996cdfea6dea76416 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:28.897979 6454 raft_consensus.cc:740] T 688bb1055ba94c2996cdfea6dea76416 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:28.898626 6454 consensus_queue.cc:260] T 688bb1055ba94c2996cdfea6dea76416 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.899158 6454 ts_tablet_manager.cc:1434] T 688bb1055ba94c2996cdfea6dea76416 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260923 19:50:28.899426 6459 tablet_replica.cc:333] T 0a5ce253bcce410b9517449f133d39e8 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:28.899618 6459 raft_consensus.cc:2243] T 0a5ce253bcce410b9517449f133d39e8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:28.899780 6459 raft_consensus.cc:2272] T 0a5ce253bcce410b9517449f133d39e8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:28.900282 6459 ts_tablet_manager.cc:1916] T 0a5ce253bcce410b9517449f133d39e8 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:28.900702 6454 tablet_bootstrap.cc:492] T f2799563250845b0b9d7d51b2367b16b P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:28.902290 6454 tablet_bootstrap.cc:654] T f2799563250845b0b9d7d51b2367b16b P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:28.895280 6457 tablet_bootstrap.cc:492] T 3a4b9d48f02a4372adce6d9eb80935f6 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:28.905578 6457 ts_tablet_manager.cc:1403] T 3a4b9d48f02a4372adce6d9eb80935f6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.054s user 0.004s sys 0.000s
I20260923 19:50:28.906319 6457 raft_consensus.cc:359] T 3a4b9d48f02a4372adce6d9eb80935f6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.906451 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 18a31ed6bea444e7888f374927f90a60 (table default.Table_e526c19d02b9432eabd892ed7a9a291c [id=6f9ac3e4264245358d37624ba8d8fa73]) successfully deleted
I20260923 19:50:28.906527 6457 raft_consensus.cc:385] T 3a4b9d48f02a4372adce6d9eb80935f6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:28.906598 6457 raft_consensus.cc:740] T 3a4b9d48f02a4372adce6d9eb80935f6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:28.906816 6457 consensus_queue.cc:260] T 3a4b9d48f02a4372adce6d9eb80935f6 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.907315 6457 ts_tablet_manager.cc:1434] T 3a4b9d48f02a4372adce6d9eb80935f6 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:28.904301 6059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bbd8fcc5ea1431ab9e4fadb7d52269e" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0"
I20260923 19:50:28.907591 6457 tablet_bootstrap.cc:492] T 16144661b56c4f858c55e8e0d3999019 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:28.907682 6059 raft_consensus.cc:3060] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:28.909175 6457 tablet_bootstrap.cc:654] T 16144661b56c4f858c55e8e0d3999019 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:28.890415 6456 ts_tablet_manager.cc:1434] T 30fe07956e8940fcb7ba1e2e16ced463 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.050s user 0.001s sys 0.000s
W20260923 19:50:28.910079 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 25117ec346224a85942d0106b4962a88 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 25117ec346224a85942d0106b4962a88 already in progress: creating tablet
I20260923 19:50:28.910181 6456 tablet_bootstrap.cc:492] T 89b950342b66486fa6ec0cdf03ad4881 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:28.911634 6456 tablet_bootstrap.cc:654] T 89b950342b66486fa6ec0cdf03ad4881 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:28.911793 6059 raft_consensus.cc:2468] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
W20260923 19:50:28.912623 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 2d1ed91cfd5f4d1eb1ea75fa6183141a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d1ed91cfd5f4d1eb1ea75fa6183141a already in progress: creating tablet
W20260923 19:50:28.921907 6280 consensus_peers.cc:597] T f2799563250845b0b9d7d51b2367b16b P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260923 19:50:28.922117 5790 catalog_manager.cc:5043] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): delete failed for tablet 4e3cdffa2c2a4e5da4980dea84d82c4e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4e3cdffa2c2a4e5da4980dea84d82c4e already in progress: creating tablet
I20260923 19:50:28.924499 6457 tablet_bootstrap.cc:492] T 16144661b56c4f858c55e8e0d3999019 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:28.924726 6457 ts_tablet_manager.cc:1403] T 16144661b56c4f858c55e8e0d3999019 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.003s
I20260923 19:50:28.924934 5798 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 83e97b26500048d0b75350a21a8ff96b: Sending DeleteTablet for 3 replicas of tablet 4e69656e9fc941e19eb7de5c87bc9050
I20260923 19:50:28.925381 5798 catalog_manager.cc:6934] ReplaceTablet: tablet 4e69656e9fc941e19eb7de5c87bc9050 deleted and replaced by tablet 0cdf7a55499149d1af3a39408571f641
I20260923 19:50:28.925634 6457 raft_consensus.cc:359] T 16144661b56c4f858c55e8e0d3999019 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.925806 6457 raft_consensus.cc:385] T 16144661b56c4f858c55e8e0d3999019 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:28.925946 6457 raft_consensus.cc:740] T 16144661b56c4f858c55e8e0d3999019 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:28.925951 6309 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e69656e9fc941e19eb7de5c87bc9050 with delete_type TABLET_DATA_DELETED (replaced by tablet 0cdf7a55499149d1af3a39408571f641) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:28.926216 6457 consensus_queue.cc:260] T 16144661b56c4f858c55e8e0d3999019 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.926467 6175 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e69656e9fc941e19eb7de5c87bc9050 with delete_type TABLET_DATA_DELETED (replaced by tablet 0cdf7a55499149d1af3a39408571f641) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:28.926858 6457 ts_tablet_manager.cc:1434] T 16144661b56c4f858c55e8e0d3999019 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:28.927175 6457 tablet_bootstrap.cc:492] T 83fdbb8a5352447b8ad6570e44674e97 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:28.930023 6279 leader_election.cc:304] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:28.930405 8135 raft_consensus.cc:2804] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:28.930404 5796 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 2bc47336948746d694d5a896730c501c (table default.Table_4aba50515e344158b08d4c2afc6cae77 [id=ae53e002c7f0400ab80f8d83a958e1b2]). Expected version 2 got 0
I20260923 19:50:28.930514 8135 raft_consensus.cc:697] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Becoming Leader. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Running, Role: LEADER
I20260923 19:50:28.930640 5796 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet c013c07fd27a46f29a464d73fe752e10 (table default.Table_d6b7dd3e3841487bb83baf44aa4b24eb [id=57e6db69771648aa8952d2385f25ad45]). Expected version 1 got 0
I20260923 19:50:28.930735 8135 consensus_queue.cc:237] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.930841 5796 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet a367cf3788ef49148a5c8d6864f71d8e (table default.Table_da05e9879e314fd78f1b40a857a393fb [id=d3b60b7fc1d84a46aa49932d5c3363ea]). Expected version 6 got 0
I20260923 19:50:28.930984 5796 catalog_manager.cc:5838] T 0f90406b20f54787bd27255d5ae81d1c P e546f660e7e541d1aa9ae38e5ee5b9c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193). New cstate: current_term: 1 leader_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:28.931301 5796 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 0f90406b20f54787bd27255d5ae81d1c (table default.Table_8aad9ce166cb40659479e35cbcbf1d88 [id=cec162ada3144aaba98196d363cf587d]). Expected version 1 got 0
I20260923 19:50:28.932400 5695 master-stress-test.cc:581] Killed test thread 21/25
I20260923 19:50:28.932484 5695 master-stress-test.cc:579] Killing test thread 22/25
I20260923 19:50:28.932469 6035 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e69656e9fc941e19eb7de5c87bc9050 with delete_type TABLET_DATA_DELETED (replaced by tablet 0cdf7a55499149d1af3a39408571f641) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:28.932586 5695 master-stress-test.cc:581] Killed test thread 22/25
I20260923 19:50:28.932652 5695 master-stress-test.cc:579] Killing test thread 23/25
I20260923 19:50:28.932375 5802 catalog_manager.cc:5838] T a263c0fc71424999b76ef01de9a51eda P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } }
I20260923 19:50:28.932713 5695 master-stress-test.cc:581] Killed test thread 23/25
I20260923 19:50:28.932771 5695 master-stress-test.cc:579] Killing test thread 24/25
I20260923 19:50:28.932793 5802 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet a263c0fc71424999b76ef01de9a51eda (table default.Table_634d169330774b228dacd2343d35d4e9 [id=59963339362940748a99a3ff36c31bbd]). Expected version 1 got 0
I20260923 19:50:28.932833 5695 master-stress-test.cc:581] Killed test thread 24/25
I20260923 19:50:28.932897 5695 master-stress-test.cc:579] Killing test thread 25/25
I20260923 19:50:28.932958 5695 master-stress-test.cc:581] Killed test thread 25/25
I20260923 19:50:28.933127 5695 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task5JtCX2/build/asan/bin/kudu pid 5972
I20260923 19:50:28.932999 5802 catalog_manager.cc:5838] T cf64073cdde748bc8ed3ce7580a71160 P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:28.933296 5802 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet cf64073cdde748bc8ed3ce7580a71160 (table default.Table_ec1f04b2e36247fa96e9591cb7ab7eff [id=662eb0a4f944445486929d42c5ebfd01]). Expected version 3 got 0
I20260923 19:50:28.933677 6461 tablet_replica.cc:333] T 4e69656e9fc941e19eb7de5c87bc9050 P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:28.933540 5802 catalog_manager.cc:5838] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } }
I20260923 19:50:28.933907 6461 raft_consensus.cc:2243] T 4e69656e9fc941e19eb7de5c87bc9050 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:28.933909 5802 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet a6da9b3eea4547c9bb80b08bd26c5dc2 (table default.Table_52abb1a930aa442b9fb361345d7da76f [id=8996d40848d44ed09261ee25d61bb906]). Expected version 1 got 0
I20260923 19:50:28.934075 6461 raft_consensus.cc:2272] T 4e69656e9fc941e19eb7de5c87bc9050 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:28.934128 5802 catalog_manager.cc:5838] T 7f47efa0cabd47aa8ed0deface7763ab P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } }
I20260923 19:50:28.934427 5802 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 7f47efa0cabd47aa8ed0deface7763ab (table default.Table_f57f8cacbedb49c6be509b51c824b960 [id=ada5cc6ef65b4859bf027fd3af9ad0f2]). Expected version 2 got 0
I20260923 19:50:28.934588 6461 ts_tablet_manager.cc:1916] T 4e69656e9fc941e19eb7de5c87bc9050 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:28.938143 8055 raft_consensus.cc:697] T 3c713a0973dc45debf61c228a4bf13bf P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:28.938431 8055 consensus_queue.cc:237] T 3c713a0973dc45debf61c228a4bf13bf P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:28.938881 6457 tablet_bootstrap.cc:654] T 83fdbb8a5352447b8ad6570e44674e97 P e546f660e7e541d1aa9ae38e5ee5b9c0: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:28.943298 8053 raft_consensus.cc:493] T 195d4fe5f92e4e2c9330dce34c303723 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:28.943468 8053 raft_consensus.cc:515] T 195d4fe5f92e4e2c9330dce34c303723 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.944125 8053 leader_election.cc:290] T 195d4fe5f92e4e2c9330dce34c303723 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
W20260923 19:50:28.944998 5796 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet a367cf3788ef49148a5c8d6864f71d8e (table default.Table_da05e9879e314fd78f1b40a857a393fb [id=d3b60b7fc1d84a46aa49932d5c3363ea], current schema version=6): Not found: failed to reset TS proxy: No leader found: Tablet a367cf3788ef49148a5c8d6864f71d8e consensus state has no leader
I20260923 19:50:28.945828 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195d4fe5f92e4e2c9330dce34c303723" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:28.946554 5995 leader_election.cc:343] T 195d4fe5f92e4e2c9330dce34c303723 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:28.947005 6035 tablet_service.cc:1558] Processing DeleteTablet for tablet cf0caa6afcf546678c233a9333b77a2a with delete_type TABLET_DATA_DELETED (replaced by tablet e1178b26b95b41babd12b9b8b5bdbd6e) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:28.947831 6461 ts_tablet_manager.cc:1929] T 4e69656e9fc941e19eb7de5c87bc9050 P e546f660e7e541d1aa9ae38e5ee5b9c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:28.950023 6461 log.cc:1199] T 4e69656e9fc941e19eb7de5c87bc9050 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-0/wal/wals/4e69656e9fc941e19eb7de5c87bc9050
I20260923 19:50:28.950489 6461 ts_tablet_manager.cc:1950] T 4e69656e9fc941e19eb7de5c87bc9050 P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting consensus metadata
I20260923 19:50:28.950572 6456 tablet_bootstrap.cc:492] T 89b950342b66486fa6ec0cdf03ad4881 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:28.950734 6456 ts_tablet_manager.cc:1403] T 89b950342b66486fa6ec0cdf03ad4881 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.041s user 0.002s sys 0.001s
I20260923 19:50:28.952579 6456 raft_consensus.cc:359] T 89b950342b66486fa6ec0cdf03ad4881 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.952746 6456 raft_consensus.cc:385] T 89b950342b66486fa6ec0cdf03ad4881 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:28.952811 6456 raft_consensus.cc:740] T 89b950342b66486fa6ec0cdf03ad4881 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:28.953019 6456 consensus_queue.cc:260] T 89b950342b66486fa6ec0cdf03ad4881 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:28.953464 6456 ts_tablet_manager.cc:1434] T 89b950342b66486fa6ec0cdf03ad4881 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20260923 19:50:28.954326 5790 catalog_manager.cc:5063] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): tablet 4e69656e9fc941e19eb7de5c87bc9050 (table default.Table_454977731aee4768be1b7437bb41c1ba [id=1337273e913b43e797c0fb356ca5085b]) successfully deleted
I20260923 19:50:28.954607 6461 tablet_replica.cc:333] T cf0caa6afcf546678c233a9333b77a2a P e546f660e7e541d1aa9ae38e5ee5b9c0: stopping tablet replica
I20260923 19:50:28.956300 6461 raft_consensus.cc:2243] T cf0caa6afcf546678c233a9333b77a2a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:28.956532 6461 raft_consensus.cc:2272] T cf0caa6afcf546678c233a9333b77a2a P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:28.957079 6461 ts_tablet_manager.cc:1916] T cf0caa6afcf546678c233a9333b77a2a P e546f660e7e541d1aa9ae38e5ee5b9c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:28.958882 6456 tablet_bootstrap.cc:492] T 195d4fe5f92e4e2c9330dce34c303723 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:28.955089 6458 ts_tablet_manager.cc:1929] T ba0453ef529344dfbab1130daa985fef P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:28.955672 6309 tablet_service.cc:1558] Processing DeleteTablet for tablet 30fe07956e8940fcb7ba1e2e16ced463 with delete_type TABLET_DATA_DELETED (replaced by tablet 2ed8d49f1b3d4bee80b1822df2a7f495) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:28.961131 6458 log.cc:1199] T ba0453ef529344dfbab1130daa985fef P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/ba0453ef529344dfbab1130daa985fef
I20260923 19:50:28.961474 6458 ts_tablet_manager.cc:1950] T ba0453ef529344dfbab1130daa985fef P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:28.962436 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1291) took 1141 ms. Trace:
I20260923 19:50:28.964711 6458 rpcz_store.cc:276] 0923 19:50:27.821319 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:27.821498 (+ 179us) service_pool.cc:224] Handling call
0923 19:50:28.842979 (+1021481us) ts_tablet_manager.cc:1151] Deleting tablet ba0453ef529344dfbab1130daa985fef
0923 19:50:28.842988 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.935571 (+ 92583us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.955040 (+ 19469us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:28.962414 (+ 7374us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1021284}
I20260923 19:50:28.965284 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet ba0453ef529344dfbab1130daa985fef (table default.Table_a4db4b4f4a6b45eabe9a2ae50186a32c [id=3944a1ccbf364bb5a7920714dbe72c8e]) successfully deleted
I20260923 19:50:28.966394 6458 tablet_replica.cc:333] T f4313a4d8a9c411fad593b05ad655fc4 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:28.966625 6458 raft_consensus.cc:2243] T f4313a4d8a9c411fad593b05ad655fc4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:28.966790 6458 raft_consensus.cc:2272] T f4313a4d8a9c411fad593b05ad655fc4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:28.970232 6458 ts_tablet_manager.cc:1916] T f4313a4d8a9c411fad593b05ad655fc4 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:28.971608 6456 tablet_bootstrap.cc:654] T 195d4fe5f92e4e2c9330dce34c303723 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:28.975476 6309 tablet_service.cc:1511] Processing CreateTablet for tablet 8db70f86d99e4e099b5710b9a064641d (DEFAULT_TABLE table=default.Table_635e873370874d5286a4991d32624567 [id=47197aa0fe854f62a04514f707ca6a85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.975841 6309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8db70f86d99e4e099b5710b9a064641d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.975752 6035 tablet_service.cc:1511] Processing CreateTablet for tablet 8db70f86d99e4e099b5710b9a064641d (DEFAULT_TABLE table=default.Table_635e873370874d5286a4991d32624567 [id=47197aa0fe854f62a04514f707ca6a85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.976132 6035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8db70f86d99e4e099b5710b9a064641d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.978751 6317 tablet_service.cc:1511] Processing CreateTablet for tablet 7b6e1e183fab45a790414ab77cd29603 (DEFAULT_TABLE table=default.Table_2dc82647d3b74ebb9d0c0c87c981535c [id=3a3915b4ee71490db6b009082e8dab8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.978960 6311 tablet_service.cc:1511] Processing CreateTablet for tablet 21cd9a4a997246e495fb495d0e1983d7 (DEFAULT_TABLE table=default.Table_c88a994ba635433bb4174e090650a738 [id=853489af6dee4ca4a0038b2cefe4cbec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.979069 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b6e1e183fab45a790414ab77cd29603. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.979254 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21cd9a4a997246e495fb495d0e1983d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.982211 6170 tablet_service.cc:1511] Processing CreateTablet for tablet 7b6e1e183fab45a790414ab77cd29603 (DEFAULT_TABLE table=default.Table_2dc82647d3b74ebb9d0c0c87c981535c [id=3a3915b4ee71490db6b009082e8dab8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.982385 6178 tablet_service.cc:1511] Processing CreateTablet for tablet 21cd9a4a997246e495fb495d0e1983d7 (DEFAULT_TABLE table=default.Table_c88a994ba635433bb4174e090650a738 [id=853489af6dee4ca4a0038b2cefe4cbec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.982661 6170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b6e1e183fab45a790414ab77cd29603. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.982637 6175 tablet_service.cc:1511] Processing CreateTablet for tablet 8db70f86d99e4e099b5710b9a064641d (DEFAULT_TABLE table=default.Table_635e873370874d5286a4991d32624567 [id=47197aa0fe854f62a04514f707ca6a85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.982940 6175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8db70f86d99e4e099b5710b9a064641d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.983243 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21cd9a4a997246e495fb495d0e1983d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.984752 6312 tablet_service.cc:1511] Processing CreateTablet for tablet 3181c29a3d874731a368ffaea2f299c9 (DEFAULT_TABLE table=default.Table_6a0c7f6b4cd74190b8ef9422a9e568b3 [id=b1bfa1d23d444b6388c147d8654a94a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.985057 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3181c29a3d874731a368ffaea2f299c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.986500 6022 tablet_service.cc:1511] Processing CreateTablet for tablet 21cd9a4a997246e495fb495d0e1983d7 (DEFAULT_TABLE table=default.Table_c88a994ba635433bb4174e090650a738 [id=853489af6dee4ca4a0038b2cefe4cbec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.986554 6039 tablet_service.cc:1511] Processing CreateTablet for tablet 7b6e1e183fab45a790414ab77cd29603 (DEFAULT_TABLE table=default.Table_2dc82647d3b74ebb9d0c0c87c981535c [id=3a3915b4ee71490db6b009082e8dab8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.986907 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b6e1e183fab45a790414ab77cd29603. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.987087 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195d4fe5f92e4e2c9330dce34c303723" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:28.987682 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21cd9a4a997246e495fb495d0e1983d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.990124 6040 tablet_service.cc:1511] Processing CreateTablet for tablet 3181c29a3d874731a368ffaea2f299c9 (DEFAULT_TABLE table=default.Table_6a0c7f6b4cd74190b8ef9422a9e568b3 [id=b1bfa1d23d444b6388c147d8654a94a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.990473 6040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3181c29a3d874731a368ffaea2f299c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.993351 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 948fd14dfbb347169c59756fa0119eaa (DEFAULT_TABLE table=default.Table_ee26b17f99ee47f0bce353e82d693ffd [id=017f7795ca374a9690f4df2e7eae89f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.993675 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 948fd14dfbb347169c59756fa0119eaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:28.994714 6166 tablet_service.cc:1511] Processing CreateTablet for tablet 3181c29a3d874731a368ffaea2f299c9 (DEFAULT_TABLE table=default.Table_6a0c7f6b4cd74190b8ef9422a9e568b3 [id=b1bfa1d23d444b6388c147d8654a94a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.995066 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3181c29a3d874731a368ffaea2f299c9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:28.997780 5996 leader_election.cc:343] T 195d4fe5f92e4e2c9330dce34c303723 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:28.998116 5996 leader_election.cc:304] T 195d4fe5f92e4e2c9330dce34c303723 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:28.998548 8053 raft_consensus.cc:2749] T 195d4fe5f92e4e2c9330dce34c303723 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:28.998934 6022 tablet_service.cc:1511] Processing CreateTablet for tablet 948fd14dfbb347169c59756fa0119eaa (DEFAULT_TABLE table=default.Table_ee26b17f99ee47f0bce353e82d693ffd [id=017f7795ca374a9690f4df2e7eae89f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:28.999451 6022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 948fd14dfbb347169c59756fa0119eaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.002338 6456 tablet_bootstrap.cc:492] T 195d4fe5f92e4e2c9330dce34c303723 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:29.002465 6456 ts_tablet_manager.cc:1403] T 195d4fe5f92e4e2c9330dce34c303723 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.044s user 0.003s sys 0.001s
I20260923 19:50:29.003072 6456 raft_consensus.cc:359] T 195d4fe5f92e4e2c9330dce34c303723 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.003244 6456 raft_consensus.cc:385] T 195d4fe5f92e4e2c9330dce34c303723 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:29.003297 6456 raft_consensus.cc:740] T 195d4fe5f92e4e2c9330dce34c303723 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:29.004379 6459 ts_tablet_manager.cc:1929] T 0a5ce253bcce410b9517449f133d39e8 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 19:50:29.004489 6459 log.cc:1199] T 0a5ce253bcce410b9517449f133d39e8 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/0a5ce253bcce410b9517449f133d39e8
I20260923 19:50:29.004813 6459 ts_tablet_manager.cc:1950] T 0a5ce253bcce410b9517449f133d39e8 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:29.005584 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1120) took 3721 ms. Trace:
I20260923 19:50:29.007906 6458 ts_tablet_manager.cc:1929] T f4313a4d8a9c411fad593b05ad655fc4 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:29.008010 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 37d62209b4e24b19a9f6fd15924ee840 (DEFAULT_TABLE table=default.Table_fe7a9dce52984e97bc233025d7356af7 [id=18fc883cc8cf47d8b39d0084b99a526c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.008359 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37d62209b4e24b19a9f6fd15924ee840. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.010144 5802 catalog_manager.cc:5838] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 2bf41435f70447f19992d368ca6b46bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf41435f70447f19992d368ca6b46bd (127.5.143.195). New cstate: current_term: 1 leader_uuid: "2bf41435f70447f19992d368ca6b46bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } health_report { overall_health: UNKNOWN } } }
I20260923 19:50:29.010679 5802 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 397ec5e49673406cb26a2efab0ad8401 (table default.Table_92f3bea4e4164a738fb75f01e95cd776 [id=0b80967a8fb94518ad872fbce9bae934]). Expected version 1 got 0
I20260923 19:50:29.017552 8053 raft_consensus.cc:493] T 16144661b56c4f858c55e8e0d3999019 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:29.017714 8053 raft_consensus.cc:515] T 16144661b56c4f858c55e8e0d3999019 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.018371 8053 leader_election.cc:290] T 16144661b56c4f858c55e8e0d3999019 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:29.020402 6311 tablet_service.cc:1511] Processing CreateTablet for tablet e6a836aea30a4fdd83293a30e4b6c6a0 (DEFAULT_TABLE table=default.Table_3080c3aa85fa47f484f69a81a8791a7b [id=179239dc84bf4d76aa9c357955e97da9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.020898 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6a836aea30a4fdd83293a30e4b6c6a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.022159 6456 consensus_queue.cc:260] T 195d4fe5f92e4e2c9330dce34c303723 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.021816 5796 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet f2799563250845b0b9d7d51b2367b16b (table default.Table_bc33f65d5674483c9854966514392420 [id=b6e6ca970bea466f80938e694f770e67]). Expected version 1 got 0
I20260923 19:50:29.022648 6456 ts_tablet_manager.cc:1434] T 195d4fe5f92e4e2c9330dce34c303723 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.020s user 0.000s sys 0.002s
I20260923 19:50:29.022827 5796 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet 8d20b59aa99f49f0b2f4d7dd861470f8 (table default.Table_3a666373aff54c2d8256d8fc785cfcc1 [id=57da80bd083d4763a5523608ea26f2bb]). Expected version 1 got 0
I20260923 19:50:29.022900 6456 tablet_bootstrap.cc:492] T 664d849daee54b02b7b7e2bb340d92fa P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:29.023579 6039 tablet_service.cc:1511] Processing CreateTablet for tablet 37d62209b4e24b19a9f6fd15924ee840 (DEFAULT_TABLE table=default.Table_fe7a9dce52984e97bc233025d7356af7 [id=18fc883cc8cf47d8b39d0084b99a526c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.023944 6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37d62209b4e24b19a9f6fd15924ee840. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.024940 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet 16144661b56c4f858c55e8e0d3999019 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:29.025060 6456 tablet_bootstrap.cc:654] T 664d849daee54b02b7b7e2bb340d92fa P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:29.025267 6034 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a4b9d48f02a4372adce6d9eb80935f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:29.008021 6458 log.cc:1199] T f4313a4d8a9c411fad593b05ad655fc4 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/f4313a4d8a9c411fad593b05ad655fc4
I20260923 19:50:29.028651 6458 ts_tablet_manager.cc:1950] T f4313a4d8a9c411fad593b05ad655fc4 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:29.028992 6034 tablet_service.cc:1511] Processing CreateTablet for tablet e6a836aea30a4fdd83293a30e4b6c6a0 (DEFAULT_TABLE table=default.Table_3080c3aa85fa47f484f69a81a8791a7b [id=179239dc84bf4d76aa9c357955e97da9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.029364 6034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6a836aea30a4fdd83293a30e4b6c6a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.031818 5796 catalog_manager.cc:5938] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887) does not have the latest schema for tablet f2799563250845b0b9d7d51b2367b16b (table default.Table_bc33f65d5674483c9854966514392420 [id=b6e6ca970bea466f80938e694f770e67]). Expected version 1 got 0
I20260923 19:50:29.036800 5796 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 195d4fe5f92e4e2c9330dce34c303723 (table default.Table_d42d1c583ed9482caaaf742a8a82f476 [id=57f2abae03734c489c96cda418f2bf54]). Expected version 2 got 0
I20260923 19:50:29.037057 5796 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet f2799563250845b0b9d7d51b2367b16b (table default.Table_bc33f65d5674483c9854966514392420 [id=b6e6ca970bea466f80938e694f770e67]). Expected version 1 got 0
I20260923 19:50:29.037995 6040 tablet_service.cc:1558] Processing DeleteTablet for tablet ebc288d8d453481592df11cd1bfed3ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:56924
I20260923 19:50:29.040366 6312 tablet_service.cc:1511] Processing CreateTablet for tablet 0f89794260d14516abe871d136096df8 (DEFAULT_TABLE table=default.Table_ed22033b8aa14771a6556e39f1edfe4b [id=2f7d5767872146f08034a1db3807fe5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.007628 6169 tablet_service.cc:1511] Processing CreateTablet for tablet 948fd14dfbb347169c59756fa0119eaa (DEFAULT_TABLE table=default.Table_ee26b17f99ee47f0bce353e82d693ffd [id=017f7795ca374a9690f4df2e7eae89f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.019429 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 37d62209b4e24b19a9f6fd15924ee840 (DEFAULT_TABLE table=default.Table_fe7a9dce52984e97bc233025d7356af7 [id=18fc883cc8cf47d8b39d0084b99a526c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.022039 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16144661b56c4f858c55e8e0d3999019" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:29.040617 6459 rpcz_store.cc:276] 0923 19:50:25.283832 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:25.283886 (+ 54us) service_pool.cc:224] Handling call
0923 19:50:28.899378 (+3615492us) ts_tablet_manager.cc:1151] Deleting tablet 0a5ce253bcce410b9517449f133d39e8
0923 19:50:28.899387 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:28.971817 (+ 72430us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.004325 (+ 32508us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.005564 (+ 1239us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3613486}
I20260923 19:50:29.040916 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 948fd14dfbb347169c59756fa0119eaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.041123 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1121) took 3686 ms. Trace:
I20260923 19:50:29.041225 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37d62209b4e24b19a9f6fd15924ee840. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.042804 6457 tablet_bootstrap.cc:492] T 83fdbb8a5352447b8ad6570e44674e97 P e546f660e7e541d1aa9ae38e5ee5b9c0: No bootstrap required, opened a new log
I20260923 19:50:29.042966 6457 ts_tablet_manager.cc:1403] T 83fdbb8a5352447b8ad6570e44674e97 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent bootstrapping tablet: real 0.116s user 0.011s sys 0.005s
I20260923 19:50:29.045240 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 4af74fc65d244d8fb56bfa347a9a93df (DEFAULT_TABLE table=default.Table_8038669b54be49eeb28df9b063c7af2f [id=319e76f681034646af88650ddbbc4413]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.041209 6459 rpcz_store.cc:276] 0923 19:50:25.354464 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:25.354519 (+ 55us) service_pool.cc:224] Handling call
0923 19:50:29.040994 (+3686475us) ts_tablet_manager.cc:1151] Deleting tablet 00eba27e9f2948e8a298c3fbca52a282
0923 19:50:29.041005 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.041105 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3686169}
W20260923 19:50:29.046059 5995 leader_election.cc:343] T 16144661b56c4f858c55e8e0d3999019 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:29.046365 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 0a5ce253bcce410b9517449f133d39e8 (table default.Table_84d13e1ea6234e5ca45738376e83f537 [id=0d4f6a5bb30c4d2a937424cf0e651afd]) successfully deleted
W20260923 19:50:29.046659 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 00eba27e9f2948e8a298c3fbca52a282 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 00eba27e9f2948e8a298c3fbca52a282 already in progress: creating tablet
I20260923 19:50:29.046773 6182 tablet_service.cc:1511] Processing CreateTablet for tablet 0f89794260d14516abe871d136096df8 (DEFAULT_TABLE table=default.Table_ed22033b8aa14771a6556e39f1edfe4b [id=2f7d5767872146f08034a1db3807fe5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.046886 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1122) took 3620 ms. Trace:
I20260923 19:50:29.046955 6459 rpcz_store.cc:276] 0923 19:50:25.426146 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:25.426364 (+ 218us) service_pool.cc:224] Handling call
0923 19:50:29.046093 (+3619729us) ts_tablet_manager.cc:1151] Deleting tablet 401061423caf48639929bd8864c53218
0923 19:50:29.046105 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.046265 (+ 160us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3619529}
I20260923 19:50:29.047107 6182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f89794260d14516abe871d136096df8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:29.047271 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 401061423caf48639929bd8864c53218 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 401061423caf48639929bd8864c53218 already in progress: creating tablet
I20260923 19:50:29.047693 6166 tablet_service.cc:1511] Processing CreateTablet for tablet e6a836aea30a4fdd83293a30e4b6c6a0 (DEFAULT_TABLE table=default.Table_3080c3aa85fa47f484f69a81a8791a7b [id=179239dc84bf4d76aa9c357955e97da9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.048075 6035 tablet_service.cc:1511] Processing CreateTablet for tablet 0f89794260d14516abe871d136096df8 (DEFAULT_TABLE table=default.Table_ed22033b8aa14771a6556e39f1edfe4b [id=2f7d5767872146f08034a1db3807fe5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.048431 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1123) took 3622 ms. Trace:
I20260923 19:50:29.048508 6459 rpcz_store.cc:276] 0923 19:50:25.426274 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:25.426603 (+ 329us) service_pool.cc:224] Handling call
0923 19:50:29.047168 (+3620565us) ts_tablet_manager.cc:1151] Deleting tablet 8e95ec2f36be418fa2f042cd14b7a8bd
0923 19:50:29.047176 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.048415 (+ 1239us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3620437}
I20260923 19:50:29.048620 6034 tablet_service.cc:1511] Processing CreateTablet for tablet 4af74fc65d244d8fb56bfa347a9a93df (DEFAULT_TABLE table=default.Table_8038669b54be49eeb28df9b063c7af2f [id=319e76f681034646af88650ddbbc4413]), partition=RANGE (key) PARTITION UNBOUNDED
W20260923 19:50:29.048929 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 8e95ec2f36be418fa2f042cd14b7a8bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8e95ec2f36be418fa2f042cd14b7a8bd already in progress: creating tablet
I20260923 19:50:29.049316 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6a836aea30a4fdd83293a30e4b6c6a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.049369 8049 raft_consensus.cc:493] T 89b950342b66486fa6ec0cdf03ad4881 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:29.049482 8049 raft_consensus.cc:515] T 89b950342b66486fa6ec0cdf03ad4881 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.050393 8049 leader_election.cc:290] T 89b950342b66486fa6ec0cdf03ad4881 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:29.050594 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b950342b66486fa6ec0cdf03ad4881" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:29.051052 6280 leader_election.cc:343] T 89b950342b66486fa6ec0cdf03ad4881 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:29.051548 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1124) took 3608 ms. Trace:
I20260923 19:50:29.051957 6454 tablet_bootstrap.cc:492] T f2799563250845b0b9d7d51b2367b16b P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:29.052210 6454 ts_tablet_manager.cc:1403] T f2799563250845b0b9d7d51b2367b16b P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.152s user 0.013s sys 0.019s
I20260923 19:50:29.052932 6317 tablet_service.cc:1511] Processing CreateTablet for tablet 31b0005ea9e84db0b9645370deda7d9a (DEFAULT_TABLE table=default.Table_f05afdc95cc341428732a9bcb92c74a1 [id=e1926ba0d85540d88fd9e31376a3f285]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.043927 6457 raft_consensus.cc:359] T 83fdbb8a5352447b8ad6570e44674e97 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.053376 6457 raft_consensus.cc:385] T 83fdbb8a5352447b8ad6570e44674e97 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:29.053449 6169 tablet_service.cc:1511] Processing CreateTablet for tablet 4af74fc65d244d8fb56bfa347a9a93df (DEFAULT_TABLE table=default.Table_8038669b54be49eeb28df9b063c7af2f [id=319e76f681034646af88650ddbbc4413]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.053490 6457 raft_consensus.cc:740] T 83fdbb8a5352447b8ad6570e44674e97 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e546f660e7e541d1aa9ae38e5ee5b9c0, State: Initialized, Role: FOLLOWER
I20260923 19:50:29.053504 6454 raft_consensus.cc:359] T f2799563250845b0b9d7d51b2367b16b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.053653 6454 raft_consensus.cc:385] T f2799563250845b0b9d7d51b2367b16b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:29.053709 6454 raft_consensus.cc:740] T f2799563250845b0b9d7d51b2367b16b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:29.053767 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4af74fc65d244d8fb56bfa347a9a93df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.053923 6454 consensus_queue.cc:260] T f2799563250845b0b9d7d51b2367b16b P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.054527 6454 ts_tablet_manager.cc:1434] T f2799563250845b0b9d7d51b2367b16b P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:29.054778 6454 tablet_bootstrap.cc:492] T f4313a4d8a9c411fad593b05ad655fc4 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:29.054046 6457 consensus_queue.cc:260] T 83fdbb8a5352447b8ad6570e44674e97 P e546f660e7e541d1aa9ae38e5ee5b9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.055557 6183 tablet_service.cc:1511] Processing CreateTablet for tablet 31b0005ea9e84db0b9645370deda7d9a (DEFAULT_TABLE table=default.Table_f05afdc95cc341428732a9bcb92c74a1 [id=e1926ba0d85540d88fd9e31376a3f285]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.055909 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31b0005ea9e84db0b9645370deda7d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.056792 6454 tablet_bootstrap.cc:654] T f4313a4d8a9c411fad593b05ad655fc4 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:29.057303 6457 ts_tablet_manager.cc:1434] T 83fdbb8a5352447b8ad6570e44674e97 P e546f660e7e541d1aa9ae38e5ee5b9c0: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260923 19:50:29.052114 6459 rpcz_store.cc:276] 0923 19:50:25.442665 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:25.443024 (+ 359us) service_pool.cc:224] Handling call
0923 19:50:29.051435 (+3608411us) ts_tablet_manager.cc:1151] Deleting tablet 9e341a8bf3324ac4811b90e6653cfd4c
0923 19:50:29.051443 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.051532 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3605545}
I20260923 19:50:29.057427 6023 tablet_service.cc:1511] Processing CreateTablet for tablet 28f0540aabaf4d1dbf4c4312e01ddcd3 (DEFAULT_TABLE table=default.Table_387466f7eef54d308b97edbff5fb6587 [id=cd4e32eb3921431ab9b911a58f5bd216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.058174 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1125) took 3605 ms. Trace:
W20260923 19:50:29.058270 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 9e341a8bf3324ac4811b90e6653cfd4c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e341a8bf3324ac4811b90e6653cfd4c already in progress: creating tablet
I20260923 19:50:29.057765 6040 tablet_service.cc:1511] Processing CreateTablet for tablet 31b0005ea9e84db0b9645370deda7d9a (DEFAULT_TABLE table=default.Table_f05afdc95cc341428732a9bcb92c74a1 [id=e1926ba0d85540d88fd9e31376a3f285]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.058351 6459 rpcz_store.cc:276] 0923 19:50:25.452381 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:25.452435 (+ 54us) service_pool.cc:224] Handling call
0923 19:50:29.058081 (+3605646us) ts_tablet_manager.cc:1151] Deleting tablet a6f344e2095145b8a3670c99049030ef
0923 19:50:29.058089 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.058159 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3605453}
I20260923 19:50:29.058665 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1126) took 3592 ms. Trace:
W20260923 19:50:29.058715 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet a6f344e2095145b8a3670c99049030ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a6f344e2095145b8a3670c99049030ef already in progress: creating tablet
I20260923 19:50:29.059002 6056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b950342b66486fa6ec0cdf03ad4881" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" is_pre_election: true
I20260923 19:50:29.059249 6056 raft_consensus.cc:2468] T 89b950342b66486fa6ec0cdf03ad4881 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 0.
I20260923 19:50:29.059324 6459 rpcz_store.cc:276] 0923 19:50:25.466648 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:25.466718 (+ 70us) service_pool.cc:224] Handling call
0923 19:50:29.058574 (+3591856us) ts_tablet_manager.cc:1151] Deleting tablet b18ddbbf3ce84927bc330b8affc37bb8
0923 19:50:29.058582 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.058649 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3591665}
I20260923 19:50:29.059626 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1128) took 3468 ms. Trace:
I20260923 19:50:29.060271 6309 tablet_service.cc:1511] Processing CreateTablet for tablet 28f0540aabaf4d1dbf4c4312e01ddcd3 (DEFAULT_TABLE table=default.Table_387466f7eef54d308b97edbff5fb6587 [id=cd4e32eb3921431ab9b911a58f5bd216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.060477 6459 rpcz_store.cc:276] 0923 19:50:25.591627 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:25.591754 (+ 127us) service_pool.cc:224] Handling call
0923 19:50:29.059537 (+3467783us) ts_tablet_manager.cc:1151] Deleting tablet 1ea8f44ac03b4ad196725f871a615cdd
0923 19:50:29.059544 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.059612 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3467581}
I20260923 19:50:29.060994 6182 tablet_service.cc:1511] Processing CreateTablet for tablet 28f0540aabaf4d1dbf4c4312e01ddcd3 (DEFAULT_TABLE table=default.Table_387466f7eef54d308b97edbff5fb6587 [id=cd4e32eb3921431ab9b911a58f5bd216]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.061410 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f89794260d14516abe871d136096df8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.061470 6314 tablet_service.cc:1511] Processing CreateTablet for tablet 035f27bcd4fb485c829c458c08af18f0 (DEFAULT_TABLE table=default.Table_d6eda42a46db42cf8948594954f698d0 [id=9190b107c5844a59aa69f8afa9b3644e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.061616 6317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31b0005ea9e84db0b9645370deda7d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.061789 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 035f27bcd4fb485c829c458c08af18f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.065780 6309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28f0540aabaf4d1dbf4c4312e01ddcd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.066349 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4af74fc65d244d8fb56bfa347a9a93df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.068969 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16144661b56c4f858c55e8e0d3999019" candidate_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
W20260923 19:50:29.069234 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet b18ddbbf3ce84927bc330b8affc37bb8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b18ddbbf3ce84927bc330b8affc37bb8 already in progress: creating tablet
W20260923 19:50:29.069443 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 1ea8f44ac03b4ad196725f871a615cdd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ea8f44ac03b4ad196725f871a615cdd already in progress: creating tablet
W20260923 19:50:29.069715 5996 leader_election.cc:343] T 16144661b56c4f858c55e8e0d3999019 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:29.069836 6100 generic_service.cc:196] Checking for leaks (request via RPC)
I20260923 19:50:29.069865 5996 leader_election.cc:304] T 16144661b56c4f858c55e8e0d3999019 P e546f660e7e541d1aa9ae38e5ee5b9c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e546f660e7e541d1aa9ae38e5ee5b9c0; no voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430
I20260923 19:50:29.072191 6182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28f0540aabaf4d1dbf4c4312e01ddcd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.073156 8053 raft_consensus.cc:2749] T 16144661b56c4f858c55e8e0d3999019 P e546f660e7e541d1aa9ae38e5ee5b9c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:29.076826 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1127) took 3506 ms. Trace:
I20260923 19:50:29.077298 6459 rpcz_store.cc:276] 0923 19:50:25.570086 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:25.570212 (+ 126us) service_pool.cc:224] Handling call
0923 19:50:29.061031 (+3490819us) ts_tablet_manager.cc:1151] Deleting tablet bec98cea4c254d5c9186acbbc7212159
0923 19:50:29.061039 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.076805 (+ 15766us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3468960}
I20260923 19:50:29.078193 6459 tablet_replica.cc:333] T e1de117713f34b51bbda0c712f0b837c P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
W20260923 19:50:29.078266 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet bec98cea4c254d5c9186acbbc7212159 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bec98cea4c254d5c9186acbbc7212159 already in progress: creating tablet
I20260923 19:50:29.078922 6459 raft_consensus.cc:2243] T e1de117713f34b51bbda0c712f0b837c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:29.079541 6459 raft_consensus.cc:2272] T e1de117713f34b51bbda0c712f0b837c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:29.081862 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1292) took 1260 ms. Trace:
I20260923 19:50:29.081966 6458 rpcz_store.cc:276] 0923 19:50:27.821446 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:27.824295 (+ 2849us) service_pool.cc:224] Handling call
0923 19:50:28.966330 (+1142035us) ts_tablet_manager.cc:1151] Deleting tablet f4313a4d8a9c411fad593b05ad655fc4
0923 19:50:28.966343 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.005051 (+ 38708us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.007866 (+ 2815us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.081843 (+ 73977us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1141860}
I20260923 19:50:29.082291 6458 tablet_replica.cc:333] T f8007918eca14c81947e5999fe13a705 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:29.082443 6458 raft_consensus.cc:2243] T f8007918eca14c81947e5999fe13a705 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:29.082552 6458 raft_consensus.cc:2272] T f8007918eca14c81947e5999fe13a705 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:29.082986 6458 ts_tablet_manager.cc:1916] T f8007918eca14c81947e5999fe13a705 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:29.084266 6457 tablet_bootstrap.cc:492] T 8b4c2a0ae64841c6971a0840c1d5b739 P e546f660e7e541d1aa9ae38e5ee5b9c0: Bootstrap starting.
I20260923 19:50:29.085186 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet f4313a4d8a9c411fad593b05ad655fc4 (table default.Table_76b550f8599f4650b443c16ae2483ba8 [id=e4f5c7258f02460aad591023927c0dfd]) successfully deleted
I20260923 19:50:29.086024 6175 tablet_service.cc:1511] Processing CreateTablet for tablet 035f27bcd4fb485c829c458c08af18f0 (DEFAULT_TABLE table=default.Table_d6eda42a46db42cf8948594954f698d0 [id=9190b107c5844a59aa69f8afa9b3644e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.086351 6175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 035f27bcd4fb485c829c458c08af18f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.087915 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 16f281a7daf048bf84f73e71f1d5adf1 (DEFAULT_TABLE table=default.Table_4c4edf078b36450b8f188f6b0b32b99c [id=f310bae44577417283106bd7655f9525]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.088183 6170 tablet_service.cc:1511] Processing CreateTablet for tablet 16f281a7daf048bf84f73e71f1d5adf1 (DEFAULT_TABLE table=default.Table_4c4edf078b36450b8f188f6b0b32b99c [id=f310bae44577417283106bd7655f9525]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.088263 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f281a7daf048bf84f73e71f1d5adf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.088614 6170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f281a7daf048bf84f73e71f1d5adf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.090337 6178 tablet_service.cc:1511] Processing CreateTablet for tablet eda5696cef1b4934a62e41cdc47edb3e (DEFAULT_TABLE table=default.Table_649d6f0a403747c38f6b0f9b6ed91fdf [id=e4b5c3517d5f489688184ef9f66153c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.090662 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eda5696cef1b4934a62e41cdc47edb3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.092911 6172 tablet_service.cc:1511] Processing CreateTablet for tablet b547612fcad24c119b6d581a48e5c288 (DEFAULT_TABLE table=default.Table_c226d135e45747ee938348bb6951dc4b [id=a7b03185e41c4751ad89f5a41196b044]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.093214 6172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b547612fcad24c119b6d581a48e5c288. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.096236 6311 tablet_service.cc:1511] Processing CreateTablet for tablet b547612fcad24c119b6d581a48e5c288 (DEFAULT_TABLE table=default.Table_c226d135e45747ee938348bb6951dc4b [id=a7b03185e41c4751ad89f5a41196b044]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.096678 6183 tablet_service.cc:1511] Processing CreateTablet for tablet f928a23ec4e74586b50c21f7e5ee5153 (DEFAULT_TABLE table=default.Table_11dfed549adc4c229e01f95bf9ba637a [id=db03b025e39c4e75892f8afba554514a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.097010 6183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f928a23ec4e74586b50c21f7e5ee5153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.097288 6312 tablet_service.cc:1511] Processing CreateTablet for tablet f928a23ec4e74586b50c21f7e5ee5153 (DEFAULT_TABLE table=default.Table_11dfed549adc4c229e01f95bf9ba637a [id=db03b025e39c4e75892f8afba554514a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.100905 6309 tablet_service.cc:1511] Processing CreateTablet for tablet eda5696cef1b4934a62e41cdc47edb3e (DEFAULT_TABLE table=default.Table_649d6f0a403747c38f6b0f9b6ed91fdf [id=e4b5c3517d5f489688184ef9f66153c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.106257 6311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b547612fcad24c119b6d581a48e5c288. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.106320 8135 raft_consensus.cc:493] T 37769256de33432697e9d4fb235f473f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:29.106468 8135 raft_consensus.cc:515] T 37769256de33432697e9d4fb235f473f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.107086 8135 leader_election.cc:290] T 37769256de33432697e9d4fb235f473f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:29.107775 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37769256de33432697e9d4fb235f473f" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:29.107898 6309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eda5696cef1b4934a62e41cdc47edb3e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260923 19:50:29.110606 6280 leader_election.cc:343] T 37769256de33432697e9d4fb235f473f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:29.111018 6178 tablet_service.cc:1511] Processing CreateTablet for tablet c41d0f0861e34a99bbb584a165a3690f (DEFAULT_TABLE table=default.Table_f8ddcdb63fd04bd7b8f2a95e97e449bf [id=3c751273c2a044e09499b3a07044b3db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.111332 6458 ts_tablet_manager.cc:1929] T f8007918eca14c81947e5999fe13a705 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:29.111426 6458 log.cc:1199] T f8007918eca14c81947e5999fe13a705 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/f8007918eca14c81947e5999fe13a705
I20260923 19:50:29.111732 6458 ts_tablet_manager.cc:1950] T f8007918eca14c81947e5999fe13a705 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:29.114647 6178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c41d0f0861e34a99bbb584a165a3690f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.114691 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1290) took 1293 ms. Trace:
I20260923 19:50:29.114777 6458 rpcz_store.cc:276] 0923 19:50:27.821214 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:27.824563 (+ 3349us) service_pool.cc:224] Handling call
0923 19:50:29.082251 (+1257688us) ts_tablet_manager.cc:1151] Deleting tablet f8007918eca14c81947e5999fe13a705
0923 19:50:29.082260 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.087781 (+ 5521us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.111292 (+ 23511us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.114674 (+ 3382us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1257551}
I20260923 19:50:29.115087 6458 tablet_replica.cc:333] T 688bb1055ba94c2996cdfea6dea76416 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:29.115259 6456 tablet_bootstrap.cc:492] T 664d849daee54b02b7b7e2bb340d92fa P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:29.115247 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet f8007918eca14c81947e5999fe13a705 (table default.Table_105f26b7d508479ab5114c279aca4dfb [id=7eee19aa1d0348e08accd2764d2cfdce]) successfully deleted
I20260923 19:50:29.115386 6456 ts_tablet_manager.cc:1403] T 664d849daee54b02b7b7e2bb340d92fa P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.093s user 0.007s sys 0.009s
I20260923 19:50:29.115470 8055 raft_consensus.cc:493] T ea2ef507c6e24d369427048171dfec06 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:29.115604 8055 raft_consensus.cc:515] T ea2ef507c6e24d369427048171dfec06 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.115768 5796 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet f2799563250845b0b9d7d51b2367b16b (table default.Table_bc33f65d5674483c9854966514392420 [id=b6e6ca970bea466f80938e694f770e67]). Expected version 1 got 0
I20260923 19:50:29.116098 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f928a23ec4e74586b50c21f7e5ee5153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.116050 6456 raft_consensus.cc:359] T 664d849daee54b02b7b7e2bb340d92fa P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.116212 6456 raft_consensus.cc:385] T 664d849daee54b02b7b7e2bb340d92fa P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:29.116209 8055 leader_election.cc:290] T ea2ef507c6e24d369427048171dfec06 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:29.116257 6456 raft_consensus.cc:740] T 664d849daee54b02b7b7e2bb340d92fa P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:29.116443 6456 consensus_queue.cc:260] T 664d849daee54b02b7b7e2bb340d92fa P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.116933 6456 ts_tablet_manager.cc:1434] T 664d849daee54b02b7b7e2bb340d92fa P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
W20260923 19:50:29.116972 6139 leader_election.cc:343] T ea2ef507c6e24d369427048171dfec06 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: ea2ef507c6e24d369427048171dfec06
I20260923 19:50:29.117218 6456 tablet_bootstrap.cc:492] T 1ea8f44ac03b4ad196725f871a615cdd P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:29.115262 6458 raft_consensus.cc:2243] T 688bb1055ba94c2996cdfea6dea76416 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:29.118067 6458 raft_consensus.cc:2272] T 688bb1055ba94c2996cdfea6dea76416 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:29.118521 6458 ts_tablet_manager.cc:1916] T 688bb1055ba94c2996cdfea6dea76416 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:29.121397 5802 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 664d849daee54b02b7b7e2bb340d92fa (table default.Table_5462319331504a0b829c0181aa5b0cd6 [id=3a747074a6a04ddbb009b135c67c25b0]). Expected version 1 got 0
I20260923 19:50:29.122612 6170 tablet_service.cc:1558] Processing DeleteTablet for tablet 688bb1055ba94c2996cdfea6dea76416 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:29.123281 6459 ts_tablet_manager.cc:1916] T e1de117713f34b51bbda0c712f0b837c P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:29.126528 6309 tablet_service.cc:1511] Processing CreateTablet for tablet c41d0f0861e34a99bbb584a165a3690f (DEFAULT_TABLE table=default.Table_f8ddcdb63fd04bd7b8f2a95e97e449bf [id=3c751273c2a044e09499b3a07044b3db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.127068 6309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c41d0f0861e34a99bbb584a165a3690f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.132112 6314 tablet_service.cc:1511] Processing CreateTablet for tablet e090f9fc85cd4c80af3734784cbd9797 (DEFAULT_TABLE table=default.Table_cc6a33a0b6804847b00e08408245d538 [id=32f61a044b0a4d71ad8ecaaba322a6ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.132454 6314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e090f9fc85cd4c80af3734784cbd9797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.133867 6454 tablet_bootstrap.cc:492] T f4313a4d8a9c411fad593b05ad655fc4 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:29.134009 6454 ts_tablet_manager.cc:1403] T f4313a4d8a9c411fad593b05ad655fc4 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.079s user 0.004s sys 0.001s
I20260923 19:50:29.134676 6454 raft_consensus.cc:359] T f4313a4d8a9c411fad593b05ad655fc4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.134815 6454 raft_consensus.cc:385] T f4313a4d8a9c411fad593b05ad655fc4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:29.134856 6454 raft_consensus.cc:740] T f4313a4d8a9c411fad593b05ad655fc4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:29.135031 6454 consensus_queue.cc:260] T f4313a4d8a9c411fad593b05ad655fc4 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.135506 6454 ts_tablet_manager.cc:1434] T f4313a4d8a9c411fad593b05ad655fc4 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 19:50:29.143584 6175 tablet_service.cc:1558] Processing DeleteTablet for tablet f4313a4d8a9c411fad593b05ad655fc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:29.147997 6456 tablet_bootstrap.cc:654] T 1ea8f44ac03b4ad196725f871a615cdd P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:29.150583 6454 tablet_bootstrap.cc:492] T 22c89609da884c47b1dbc1470b37efbe P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:29.152096 6454 tablet_bootstrap.cc:654] T 22c89609da884c47b1dbc1470b37efbe P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:29.157544 6458 ts_tablet_manager.cc:1929] T 688bb1055ba94c2996cdfea6dea76416 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:29.157660 6458 log.cc:1199] T 688bb1055ba94c2996cdfea6dea76416 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/688bb1055ba94c2996cdfea6dea76416
I20260923 19:50:29.157963 6458 ts_tablet_manager.cc:1950] T 688bb1055ba94c2996cdfea6dea76416 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:29.158728 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1289) took 1337 ms. Trace:
I20260923 19:50:29.158816 6458 rpcz_store.cc:276] 0923 19:50:27.821079 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:27.824742 (+ 3663us) service_pool.cc:224] Handling call
0923 19:50:29.115043 (+1290301us) ts_tablet_manager.cc:1151] Deleting tablet 688bb1055ba94c2996cdfea6dea76416
0923 19:50:29.115052 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.131606 (+ 16554us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.157478 (+ 25872us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.158710 (+ 1232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3328,"tablet-delete.queue_time_us":1290186}
I20260923 19:50:29.158962 6169 tablet_service.cc:1511] Processing CreateTablet for tablet e090f9fc85cd4c80af3734784cbd9797 (DEFAULT_TABLE table=default.Table_cc6a33a0b6804847b00e08408245d538 [id=32f61a044b0a4d71ad8ecaaba322a6ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.159147 6458 tablet_replica.cc:333] T ce6b86f947ce420994eaa5ff39ad9c87 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:29.159273 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 688bb1055ba94c2996cdfea6dea76416 (table default.Table_f92387e003d44b0eb22010e7ca6598af [id=1e323f5b380a4af4acc3865649648e12]) successfully deleted
I20260923 19:50:29.161317 6459 ts_tablet_manager.cc:1929] T e1de117713f34b51bbda0c712f0b837c P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:29.161953 6459 log.cc:1199] T e1de117713f34b51bbda0c712f0b837c P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/e1de117713f34b51bbda0c712f0b837c
I20260923 19:50:29.162546 6459 ts_tablet_manager.cc:1950] T e1de117713f34b51bbda0c712f0b837c P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:29.164764 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1134) took 3517 ms. Trace:
I20260923 19:50:29.165076 6325 tablet_service.cc:1511] Processing CreateTablet for tablet 3a1b8fa3420841e0a7f1654595377aff (DEFAULT_TABLE table=default.Table_f61890549c354792ac2571c3d169f4c8 [id=fa7f4964733a49d6a7ad88dca4a84b6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.165423 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a1b8fa3420841e0a7f1654595377aff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.165835 6454 tablet_bootstrap.cc:492] T 22c89609da884c47b1dbc1470b37efbe P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:29.161334 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e090f9fc85cd4c80af3734784cbd9797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.171949 6454 ts_tablet_manager.cc:1403] T 22c89609da884c47b1dbc1470b37efbe P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.004s
I20260923 19:50:29.172982 6454 raft_consensus.cc:359] T 22c89609da884c47b1dbc1470b37efbe P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.159320 6458 raft_consensus.cc:2243] T ce6b86f947ce420994eaa5ff39ad9c87 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:29.173702 6458 raft_consensus.cc:2272] T ce6b86f947ce420994eaa5ff39ad9c87 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:29.173933 6454 raft_consensus.cc:385] T 22c89609da884c47b1dbc1470b37efbe P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:29.173990 6312 tablet_service.cc:1511] Processing CreateTablet for tablet 2584dd00ff12430d8b8ae7eff1c4178b (DEFAULT_TABLE table=default.Table_ea8e40f321be4c45a3c164ebe2ea00ee [id=164b1a4614fc4437a182241fcdc58f8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.174170 6454 raft_consensus.cc:740] T 22c89609da884c47b1dbc1470b37efbe P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:29.165917 6459 rpcz_store.cc:276] 0923 19:50:25.647267 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:25.653125 (+ 5858us) service_pool.cc:224] Handling call
0923 19:50:29.078150 (+3425025us) ts_tablet_manager.cc:1151] Deleting tablet e1de117713f34b51bbda0c712f0b837c
0923 19:50:29.078160 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.128482 (+ 50322us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.161264 (+ 32782us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.164747 (+ 3483us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3424822}
I20260923 19:50:29.174400 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2584dd00ff12430d8b8ae7eff1c4178b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.174674 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1137) took 3389 ms. Trace:
I20260923 19:50:29.174669 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet e1de117713f34b51bbda0c712f0b837c (table default.Table_9d716833c456436cbc514b6a9070c9e1 [id=e3fafc4359af49c88437fb5815526518]) successfully deleted
I20260923 19:50:29.174813 6459 rpcz_store.cc:276] 0923 19:50:25.785397 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:25.785474 (+ 77us) service_pool.cc:224] Handling call
0923 19:50:29.174558 (+3389084us) ts_tablet_manager.cc:1151] Deleting tablet 09792de9c452418781a4331ea1b0477c
0923 19:50:29.174567 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.174660 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3372283}
I20260923 19:50:29.175405 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1177) took 2845 ms. Trace:
W20260923 19:50:29.175482 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 09792de9c452418781a4331ea1b0477c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 09792de9c452418781a4331ea1b0477c already in progress: creating tablet
I20260923 19:50:29.175534 6459 rpcz_store.cc:276] 0923 19:50:26.330222 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:26.330283 (+ 61us) service_pool.cc:224] Handling call
0923 19:50:29.175313 (+2845030us) ts_tablet_manager.cc:1151] Deleting tablet 5ce73f31a1f64a24835a272fea8d65c4
0923 19:50:29.175322 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.175390 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2844797}
I20260923 19:50:29.176071 6458 ts_tablet_manager.cc:1916] T ce6b86f947ce420994eaa5ff39ad9c87 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:29.176362 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1178) took 2845 ms. Trace:
W20260923 19:50:29.176430 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 5ce73f31a1f64a24835a272fea8d65c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ce73f31a1f64a24835a272fea8d65c4 already in progress: creating tablet
I20260923 19:50:29.176856 6459 rpcz_store.cc:276] 0923 19:50:26.330653 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:26.330692 (+ 39us) service_pool.cc:224] Handling call
0923 19:50:29.176275 (+2845583us) ts_tablet_manager.cc:1151] Deleting tablet b483bc3a99864e6f96b12709e1a8681f
0923 19:50:29.176283 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.176348 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2845428}
I20260923 19:50:29.179442 6166 tablet_service.cc:1511] Processing CreateTablet for tablet 2584dd00ff12430d8b8ae7eff1c4178b (DEFAULT_TABLE table=default.Table_ea8e40f321be4c45a3c164ebe2ea00ee [id=164b1a4614fc4437a182241fcdc58f8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.182207 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2584dd00ff12430d8b8ae7eff1c4178b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.182745 6325 tablet_service.cc:1511] Processing CreateTablet for tablet cba83e93b39b4885b338db3b5c6cb1a6 (DEFAULT_TABLE table=default.Table_00a26bd9f7b342d5af560a7a0c14d3da [id=1b2be586d3ee4d47911570cc19daa28d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.183063 6325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cba83e93b39b4885b338db3b5c6cb1a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.180977 6169 tablet_service.cc:1511] Processing CreateTablet for tablet 3a1b8fa3420841e0a7f1654595377aff (DEFAULT_TABLE table=default.Table_f61890549c354792ac2571c3d169f4c8 [id=fa7f4964733a49d6a7ad88dca4a84b6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.188618 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a1b8fa3420841e0a7f1654595377aff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.188915 6166 tablet_service.cc:1511] Processing CreateTablet for tablet cba83e93b39b4885b338db3b5c6cb1a6 (DEFAULT_TABLE table=default.Table_00a26bd9f7b342d5af560a7a0c14d3da [id=1b2be586d3ee4d47911570cc19daa28d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.189209 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cba83e93b39b4885b338db3b5c6cb1a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.176687 6454 consensus_queue.cc:260] T 22c89609da884c47b1dbc1470b37efbe P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.193751 6459 tablet_replica.cc:333] T a10d35bf564d45488524d3d21721f4e5 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
W20260923 19:50:29.193923 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet b483bc3a99864e6f96b12709e1a8681f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b483bc3a99864e6f96b12709e1a8681f already in progress: creating tablet
I20260923 19:50:29.199322 6459 raft_consensus.cc:2243] T a10d35bf564d45488524d3d21721f4e5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:29.200263 6456 tablet_bootstrap.cc:492] T 1ea8f44ac03b4ad196725f871a615cdd P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:29.200799 6456 ts_tablet_manager.cc:1403] T 1ea8f44ac03b4ad196725f871a615cdd P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.084s user 0.005s sys 0.001s
I20260923 19:50:29.201735 6456 raft_consensus.cc:359] T 1ea8f44ac03b4ad196725f871a615cdd P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.201977 6456 raft_consensus.cc:385] T 1ea8f44ac03b4ad196725f871a615cdd P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:29.202965 6456 raft_consensus.cc:740] T 1ea8f44ac03b4ad196725f871a615cdd P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:29.203261 6456 consensus_queue.cc:260] T 1ea8f44ac03b4ad196725f871a615cdd P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.209590 6456 ts_tablet_manager.cc:1434] T 1ea8f44ac03b4ad196725f871a615cdd P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.009s user 0.000s sys 0.001s
I20260923 19:50:29.209590 6325 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ea8f44ac03b4ad196725f871a615cdd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:25 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:29.212301 6456 tablet_bootstrap.cc:492] T 1985088eb56b40c1aeecc1ec7409bcdf P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:29.212986 6459 raft_consensus.cc:2272] T a10d35bf564d45488524d3d21721f4e5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:29.203068 6178 tablet_service.cc:1558] Processing DeleteTablet for tablet 22c89609da884c47b1dbc1470b37efbe with delete_type TABLET_DATA_DELETED (replaced by tablet 295502f94faf4d4880e9516aa8d9cb79) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:29.195024 6454 ts_tablet_manager.cc:1434] T 22c89609da884c47b1dbc1470b37efbe P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.023s user 0.001s sys 0.001s
I20260923 19:50:29.215854 6454 tablet_bootstrap.cc:492] T a263c0fc71424999b76ef01de9a51eda P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:29.216629 6459 ts_tablet_manager.cc:1916] T a10d35bf564d45488524d3d21721f4e5 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 19:50:29.219000 5791 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet e6baf2c29bf949fcbc1a4948da3e6575 (table default.Table_f93d7474533e4043821432c7150dff6d [id=c2ca52bda1d34ddaa0fc1a3cc897e369], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet e6baf2c29bf949fcbc1a4948da3e6575 consensus state has no leader
I20260923 19:50:29.223187 6456 tablet_bootstrap.cc:654] T 1985088eb56b40c1aeecc1ec7409bcdf P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:29.230960 6454 tablet_bootstrap.cc:654] T a263c0fc71424999b76ef01de9a51eda P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:29.232390 8135 raft_consensus.cc:493] T 772ece5283a949408d849f6e56f5f17b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:29.232537 8135 raft_consensus.cc:515] T 772ece5283a949408d849f6e56f5f17b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.233166 8135 leader_election.cc:290] T 772ece5283a949408d849f6e56f5f17b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:29.233516 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772ece5283a949408d849f6e56f5f17b" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:29.234144 6280 leader_election.cc:343] T 772ece5283a949408d849f6e56f5f17b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:29.244917 6459 ts_tablet_manager.cc:1929] T a10d35bf564d45488524d3d21721f4e5 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:29.245062 6459 log.cc:1199] T a10d35bf564d45488524d3d21721f4e5 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/a10d35bf564d45488524d3d21721f4e5
I20260923 19:50:29.248948 6458 ts_tablet_manager.cc:1929] T ce6b86f947ce420994eaa5ff39ad9c87 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:29.249152 6458 log.cc:1199] T ce6b86f947ce420994eaa5ff39ad9c87 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/ce6b86f947ce420994eaa5ff39ad9c87
I20260923 19:50:29.250159 6458 ts_tablet_manager.cc:1950] T ce6b86f947ce420994eaa5ff39ad9c87 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:29.250991 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1293) took 1418 ms. Trace:
I20260923 19:50:29.251246 6458 rpcz_store.cc:276] 0923 19:50:27.832999 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:27.833055 (+ 56us) service_pool.cc:224] Handling call
0923 19:50:29.159098 (+1326043us) ts_tablet_manager.cc:1151] Deleting tablet ce6b86f947ce420994eaa5ff39ad9c87
0923 19:50:29.159110 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.179943 (+ 20833us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.248882 (+ 68939us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.250974 (+ 2092us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1325865}
I20260923 19:50:29.252270 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet ce6b86f947ce420994eaa5ff39ad9c87 (table default.Table_145e4ce20b7d428da857269e35bbee83 [id=70f85c0de552418e98578790dded6b7c]) successfully deleted
I20260923 19:50:29.252677 6458 tablet_replica.cc:333] T 3c713a0973dc45debf61c228a4bf13bf P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:29.252894 6458 raft_consensus.cc:2243] T 3c713a0973dc45debf61c228a4bf13bf P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:29.253209 6458 raft_consensus.cc:2272] T 3c713a0973dc45debf61c228a4bf13bf P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:29.254053 6458 ts_tablet_manager.cc:1916] T 3c713a0973dc45debf61c228a4bf13bf P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:29.277021 8055 raft_consensus.cc:493] T ba0453ef529344dfbab1130daa985fef P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:29.277177 8055 raft_consensus.cc:515] T ba0453ef529344dfbab1130daa985fef P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.277804 8055 leader_election.cc:290] T ba0453ef529344dfbab1130daa985fef P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:29.279740 6139 leader_election.cc:343] T ba0453ef529344dfbab1130daa985fef P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: ba0453ef529344dfbab1130daa985fef
I20260923 19:50:29.281934 6169 tablet_service.cc:1511] Processing CreateTablet for tablet 0cdf7a55499149d1af3a39408571f641 (DEFAULT_TABLE table=default.Table_454977731aee4768be1b7437bb41c1ba [id=1337273e913b43e797c0fb356ca5085b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.282328 6169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cdf7a55499149d1af3a39408571f641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.293283 6454 tablet_bootstrap.cc:492] T a263c0fc71424999b76ef01de9a51eda P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:29.293432 6454 ts_tablet_manager.cc:1403] T a263c0fc71424999b76ef01de9a51eda P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.078s user 0.003s sys 0.003s
I20260923 19:50:29.294171 6454 raft_consensus.cc:359] T a263c0fc71424999b76ef01de9a51eda P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.294528 6454 raft_consensus.cc:385] T a263c0fc71424999b76ef01de9a51eda P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:29.294590 6454 raft_consensus.cc:740] T a263c0fc71424999b76ef01de9a51eda P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:29.294849 6454 consensus_queue.cc:260] T a263c0fc71424999b76ef01de9a51eda P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.295441 6454 ts_tablet_manager.cc:1434] T a263c0fc71424999b76ef01de9a51eda P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:50:29.274183 6312 tablet_service.cc:1511] Processing CreateTablet for tablet 0cdf7a55499149d1af3a39408571f641 (DEFAULT_TABLE table=default.Table_454977731aee4768be1b7437bb41c1ba [id=1337273e913b43e797c0fb356ca5085b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 19:50:29.299839 6312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cdf7a55499149d1af3a39408571f641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 19:50:29.301048 8135 raft_consensus.cc:493] T 30fe07956e8940fcb7ba1e2e16ced463 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:29.301168 8135 raft_consensus.cc:515] T 30fe07956e8940fcb7ba1e2e16ced463 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.301766 8135 leader_election.cc:290] T 30fe07956e8940fcb7ba1e2e16ced463 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:29.302214 6459 ts_tablet_manager.cc:1950] T a10d35bf564d45488524d3d21721f4e5 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:29.302683 6454 tablet_bootstrap.cc:492] T f8007918eca14c81947e5999fe13a705 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:29.304315 6454 tablet_bootstrap.cc:654] T f8007918eca14c81947e5999fe13a705 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:29.294085 6280 consensus_peers.cc:597] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:29.305935 6456 tablet_bootstrap.cc:492] T 1985088eb56b40c1aeecc1ec7409bcdf P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:29.306057 6456 ts_tablet_manager.cc:1403] T 1985088eb56b40c1aeecc1ec7409bcdf P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.094s user 0.004s sys 0.003s
I20260923 19:50:29.306777 6456 raft_consensus.cc:359] T 1985088eb56b40c1aeecc1ec7409bcdf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.306933 6456 raft_consensus.cc:385] T 1985088eb56b40c1aeecc1ec7409bcdf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:29.306984 6456 raft_consensus.cc:740] T 1985088eb56b40c1aeecc1ec7409bcdf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:29.307132 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30fe07956e8940fcb7ba1e2e16ced463" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:29.307147 6456 consensus_queue.cc:260] T 1985088eb56b40c1aeecc1ec7409bcdf P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.307606 6456 ts_tablet_manager.cc:1434] T 1985088eb56b40c1aeecc1ec7409bcdf P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260923 19:50:29.307840 6456 tablet_bootstrap.cc:492] T 1cf016ff0bb8418d84358d17876338bf P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:29.309126 5802 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet a263c0fc71424999b76ef01de9a51eda (table default.Table_634d169330774b228dacd2343d35d4e9 [id=59963339362940748a99a3ff36c31bbd]). Expected version 1 got 0
I20260923 19:50:29.309374 6456 tablet_bootstrap.cc:654] T 1cf016ff0bb8418d84358d17876338bf P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:29.311810 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1179) took 2980 ms. Trace:
I20260923 19:50:29.311981 6459 rpcz_store.cc:276] 0923 19:50:26.330944 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:26.330979 (+ 35us) service_pool.cc:224] Handling call
0923 19:50:29.193709 (+2862730us) ts_tablet_manager.cc:1151] Deleting tablet a10d35bf564d45488524d3d21721f4e5
0923 19:50:29.193718 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.240105 (+ 46387us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.244849 (+ 4744us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.311790 (+ 66941us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2862581}
I20260923 19:50:29.312579 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet a10d35bf564d45488524d3d21721f4e5 (table default.Table_c670311ee64c4e728677dc29691ea3f9 [id=fa0ce77597ba4d37aca817429efd86b7]) successfully deleted
W20260923 19:50:29.312819 6280 leader_election.cc:343] T 30fe07956e8940fcb7ba1e2e16ced463 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:29.313099 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1180) took 2981 ms. Trace:
I20260923 19:50:29.313210 6459 rpcz_store.cc:276] 0923 19:50:26.331225 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:26.331261 (+ 36us) service_pool.cc:224] Handling call
0923 19:50:29.312893 (+2981632us) ts_tablet_manager.cc:1151] Deleting tablet 1e835fa95fa84b43be4c27b7e3e26af3
0923 19:50:29.312904 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.313083 (+ 179us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2981421}
W20260923 19:50:29.313650 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 1e835fa95fa84b43be4c27b7e3e26af3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e835fa95fa84b43be4c27b7e3e26af3 already in progress: creating tablet
I20260923 19:50:29.318275 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1181) took 2986 ms. Trace:
I20260923 19:50:29.320351 5796 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet a263c0fc71424999b76ef01de9a51eda (table default.Table_634d169330774b228dacd2343d35d4e9 [id=59963339362940748a99a3ff36c31bbd]). Expected version 1 got 0
I20260923 19:50:29.321933 6459 rpcz_store.cc:276] 0923 19:50:26.331577 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:26.331613 (+ 36us) service_pool.cc:224] Handling call
0923 19:50:29.318140 (+2986527us) ts_tablet_manager.cc:1151] Deleting tablet c9fe3ffc092a476fa0632581efc2fd6d
0923 19:50:29.318152 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.318254 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2986365}
W20260923 19:50:29.322449 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet c9fe3ffc092a476fa0632581efc2fd6d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c9fe3ffc092a476fa0632581efc2fd6d already in progress: creating tablet
I20260923 19:50:29.322602 5798 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 1985088eb56b40c1aeecc1ec7409bcdf (table default.Table_097795475d8a46e582c0d71ee25ea439 [id=e33a2afc0ace49b5926b11b2fd64c737]). Expected version 2 got 0
I20260923 19:50:29.323258 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1167) took 3048 ms. Trace:
I20260923 19:50:29.323361 6459 rpcz_store.cc:276] 0923 19:50:26.274638 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:26.336412 (+ 61774us) service_pool.cc:224] Handling call
0923 19:50:29.323128 (+2986716us) ts_tablet_manager.cc:1151] Deleting tablet f994c5da7ed6483dacb47350531c0ea0
0923 19:50:29.323140 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.323242 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2986434}
W20260923 19:50:29.323817 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet f994c5da7ed6483dacb47350531c0ea0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f994c5da7ed6483dacb47350531c0ea0 already in progress: creating tablet
I20260923 19:50:29.324150 6459 tablet_replica.cc:333] T 684eb2576b4b4730813b993e36b242df P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:29.324395 6459 raft_consensus.cc:2243] T 684eb2576b4b4730813b993e36b242df P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:29.324600 6459 raft_consensus.cc:2272] T 684eb2576b4b4730813b993e36b242df P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:29.325165 6459 ts_tablet_manager.cc:1916] T 684eb2576b4b4730813b993e36b242df P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:29.341189 6454 tablet_bootstrap.cc:492] T f8007918eca14c81947e5999fe13a705 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:29.341353 6454 ts_tablet_manager.cc:1403] T f8007918eca14c81947e5999fe13a705 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.001s
I20260923 19:50:29.342135 6454 raft_consensus.cc:359] T f8007918eca14c81947e5999fe13a705 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.343870 6454 raft_consensus.cc:385] T f8007918eca14c81947e5999fe13a705 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:29.343964 6454 raft_consensus.cc:740] T f8007918eca14c81947e5999fe13a705 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:29.344678 6458 ts_tablet_manager.cc:1929] T 3c713a0973dc45debf61c228a4bf13bf P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:29.344741 6454 consensus_queue.cc:260] T f8007918eca14c81947e5999fe13a705 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.345356 6458 log.cc:1199] T 3c713a0973dc45debf61c228a4bf13bf P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/3c713a0973dc45debf61c228a4bf13bf
I20260923 19:50:29.345723 6458 ts_tablet_manager.cc:1950] T 3c713a0973dc45debf61c228a4bf13bf P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:29.351173 8055 raft_consensus.cc:493] T f4313a4d8a9c411fad593b05ad655fc4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:29.351331 8055 raft_consensus.cc:515] T f4313a4d8a9c411fad593b05ad655fc4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.352006 8055 leader_election.cc:290] T f4313a4d8a9c411fad593b05ad655fc4 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:29.352896 6139 leader_election.cc:343] T f4313a4d8a9c411fad593b05ad655fc4 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: f4313a4d8a9c411fad593b05ad655fc4
I20260923 19:50:29.346961 6456 tablet_bootstrap.cc:492] T 1cf016ff0bb8418d84358d17876338bf P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:29.349416 7993 raft_consensus.cc:493] T 1ea8f44ac03b4ad196725f871a615cdd P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:29.353274 7993 raft_consensus.cc:515] T 1ea8f44ac03b4ad196725f871a615cdd P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.358624 7993 leader_election.cc:290] T 1ea8f44ac03b4ad196725f871a615cdd P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:29.359074 7405 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.5.143.193:44673 (request call id 148) took 1314 ms (client timeout 1000 ms). Trace:
W20260923 19:50:29.359196 7405 rpcz_store.cc:269] 0923 19:50:28.044694 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:28.044748 (+ 54us) service_pool.cc:224] Handling call
0923 19:50:29.357995 (+1313247us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x616000041854. stack: 00007fadd80b8366 00007fadd80b8120 00007fadd70c234d 00000000009a4cb4 00000000009a4c7d 00007fade763265d 00007fade7632753 00007fade41afdb1 00007fadebf9eacd 00007fadec128738 00007fade2afc1f6 00007fade2afbf25 00007faddf20263e 00007faddf20151e 00007faddf207758 00007faddf2080bf
0923 19:50:29.358983 (+ 988us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3018512640}
I20260923 19:50:29.353276 6456 ts_tablet_manager.cc:1403] T 1cf016ff0bb8418d84358d17876338bf P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.045s user 0.001s sys 0.003s
I20260923 19:50:29.359550 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ea8f44ac03b4ad196725f871a615cdd" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:29.353366 8049 raft_consensus.cc:493] T 1985088eb56b40c1aeecc1ec7409bcdf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:29.359773 8049 raft_consensus.cc:515] T 1985088eb56b40c1aeecc1ec7409bcdf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:29.360095 6280 leader_election.cc:343] T 1ea8f44ac03b4ad196725f871a615cdd P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:29.360271 8049 leader_election.cc:290] T 1985088eb56b40c1aeecc1ec7409bcdf P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:29.360595 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1985088eb56b40c1aeecc1ec7409bcdf" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:29.361085 6280 leader_election.cc:343] T 1985088eb56b40c1aeecc1ec7409bcdf P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:29.361390 6456 raft_consensus.cc:359] T 1cf016ff0bb8418d84358d17876338bf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.361547 6456 raft_consensus.cc:385] T 1cf016ff0bb8418d84358d17876338bf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:29.361604 6456 raft_consensus.cc:740] T 1cf016ff0bb8418d84358d17876338bf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:29.361852 6456 consensus_queue.cc:260] T 1cf016ff0bb8418d84358d17876338bf P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:29.363858 7410 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.5.143.194:42739 (request call id 122) took 1291 ms (client timeout 1000 ms). Trace:
I20260923 19:50:29.363971 8120 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 83e97b26500048d0b75350a21a8ff96b)
I20260923 19:50:29.364171 8120 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } }
I20260923 19:50:29.365111 8120 leader_election.cc:290] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83e97b26500048d0b75350a21a8ff96b (127.5.143.253:45285), 009ffee03a4d41db84df9f450aa84562 (127.5.143.252:45543)
W20260923 19:50:29.366469 7411 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.5.143.195:53061 (request call id 132) took 1315 ms (client timeout 1000 ms). Trace:
W20260923 19:50:29.366571 7411 rpcz_store.cc:269] 0923 19:50:28.050935 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:28.051026 (+ 91us) service_pool.cc:224] Handling call
0923 19:50:29.365390 (+1314364us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x616000041854. stack: 00007fadd80b8366 00007fadd80b8120 00007fadd70c234d 00000000009a4cb4 00000000009a4c7d 00007fade763265d 00007fade7632753 00007fade41afdb1 00007fadebf9eacd 00007fadec128738 00007fade2afc1f6 00007fade2afbf25 00007faddf20263e 00007faddf20151e 00007faddf207758 00007faddf2080bf
0923 19:50:29.366403 (+ 1013us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3020539136}
I20260923 19:50:29.367479 7429 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50930 (request call id 1) took 1377 ms. Trace:
I20260923 19:50:29.367722 5814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" candidate_term: 4 candidate_status { last_received { term: 3 index: 1568 } } ignore_live_leader: false dest_uuid: "83e97b26500048d0b75350a21a8ff96b" is_pre_election: true
I20260923 19:50:29.368243 6679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" candidate_term: 4 candidate_status { last_received { term: 3 index: 1568 } } ignore_live_leader: false dest_uuid: "009ffee03a4d41db84df9f450aa84562" is_pre_election: true
I20260923 19:50:29.369323 7356 leader_election.cc:304] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3d628214a34b4fa3ca0c1abe422bae; no voters: 009ffee03a4d41db84df9f450aa84562, 83e97b26500048d0b75350a21a8ff96b
I20260923 19:50:29.369807 8120 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260923 19:50:29.363991 7410 rpcz_store.cc:269] 0923 19:50:28.072171 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:28.072232 (+ 61us) service_pool.cc:224] Handling call
0923 19:50:29.362498 (+1290266us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x616000041854. stack: 00007fadd80b8366 00007fadd80b8120 00007fadd70c234d 00000000009a4cb4 00000000009a4c7d 00007fade763265d 00007fade7632753 00007fade41afdb1 00007fadebf9eacd 00007fadec128738 00007fade2afc1f6 00007fade2afbf25 00007faddf20263e 00007faddf20151e 00007faddf207758 00007faddf2080bf
0923 19:50:29.363789 (+ 1291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2965691136}
I20260923 19:50:29.372570 6456 ts_tablet_manager.cc:1434] T 1cf016ff0bb8418d84358d17876338bf P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:50:29.372958 6456 tablet_bootstrap.cc:492] T a83726da349c4cd1852e956c8fa2cda5 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:29.374812 6456 tablet_bootstrap.cc:654] T a83726da349c4cd1852e956c8fa2cda5 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:29.377533 5798 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 1cf016ff0bb8418d84358d17876338bf (table default.Table_527c2568db7446559d0c719602184b02 [id=9e398f48d86e4c5898cac7336d3c24bf]). Expected version 4 got 0
I20260923 19:50:29.377624 6459 ts_tablet_manager.cc:1929] T 684eb2576b4b4730813b993e36b242df P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:29.377724 6459 log.cc:1199] T 684eb2576b4b4730813b993e36b242df P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/684eb2576b4b4730813b993e36b242df
I20260923 19:50:29.378064 6459 ts_tablet_manager.cc:1950] T 684eb2576b4b4730813b993e36b242df P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:29.378865 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1182) took 2996 ms. Trace:
I20260923 19:50:29.353091 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1294) took 1501 ms. Trace:
I20260923 19:50:29.375430 7993 raft_consensus.cc:493] T 664d849daee54b02b7b7e2bb340d92fa P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:29.380029 7993 raft_consensus.cc:515] T 664d849daee54b02b7b7e2bb340d92fa P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.380673 7993 leader_election.cc:290] T 664d849daee54b02b7b7e2bb340d92fa P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:29.386159 5798 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 1cf016ff0bb8418d84358d17876338bf (table default.Table_527c2568db7446559d0c719602184b02 [id=9e398f48d86e4c5898cac7336d3c24bf]). Expected version 4 got 0
I20260923 19:50:29.387121 6458 rpcz_store.cc:276] 0923 19:50:27.852082 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:27.852172 (+ 90us) service_pool.cc:224] Handling call
0923 19:50:29.252625 (+1400453us) ts_tablet_manager.cc:1151] Deleting tablet 3c713a0973dc45debf61c228a4bf13bf
0923 19:50:29.252636 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.319565 (+ 66929us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.344618 (+ 25053us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.353069 (+ 8451us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1400281}
I20260923 19:50:29.387619 6458 tablet_replica.cc:333] T 9ee02922d2be45f5a1473a53a6f253c4 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:29.387687 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 3c713a0973dc45debf61c228a4bf13bf (table default.Table_9acef25c391f4b8c9354ebc2c0a70c81 [id=7a872158deeb4117ba99842f7878ec46]) successfully deleted
I20260923 19:50:29.387861 6458 raft_consensus.cc:2243] T 9ee02922d2be45f5a1473a53a6f253c4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:29.388113 6458 raft_consensus.cc:2272] T 9ee02922d2be45f5a1473a53a6f253c4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:29.388706 6458 ts_tablet_manager.cc:1916] T 9ee02922d2be45f5a1473a53a6f253c4 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:29.408349 8049 raft_consensus.cc:493] T 1cf016ff0bb8418d84358d17876338bf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:29.384091 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664d849daee54b02b7b7e2bb340d92fa" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:29.391789 6454 ts_tablet_manager.cc:1434] T f8007918eca14c81947e5999fe13a705 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.050s user 0.018s sys 0.001s
I20260923 19:50:29.408520 8049 raft_consensus.cc:515] T 1cf016ff0bb8418d84358d17876338bf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.408923 6454 tablet_bootstrap.cc:492] T 9ee02922d2be45f5a1473a53a6f253c4 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:29.409155 8049 leader_election.cc:290] T 1cf016ff0bb8418d84358d17876338bf P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
W20260923 19:50:29.409228 6280 leader_election.cc:343] T 664d849daee54b02b7b7e2bb340d92fa P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:29.400367 6169 tablet_service.cc:1558] Processing DeleteTablet for tablet f8007918eca14c81947e5999fe13a705 with delete_type TABLET_DATA_DELETED (replaced by tablet 75958985ee414a5a9907ec0c7dece252) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:29.409811 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cf016ff0bb8418d84358d17876338bf" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:29.410270 6280 leader_election.cc:343] T 1cf016ff0bb8418d84358d17876338bf P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:29.410419 6459 rpcz_store.cc:276] 0923 19:50:26.382318 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:26.382386 (+ 68us) service_pool.cc:224] Handling call
0923 19:50:29.324102 (+2941716us) ts_tablet_manager.cc:1151] Deleting tablet 684eb2576b4b4730813b993e36b242df
0923 19:50:29.324112 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.349678 (+ 25566us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.377561 (+ 27883us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.378845 (+ 1284us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2941432}
I20260923 19:50:29.410878 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 684eb2576b4b4730813b993e36b242df (table default.Table_af4eb1297d19460fade71cf33df073a4 [id=9673e7b97bef46628623a1926735866e]) successfully deleted
I20260923 19:50:29.413597 8055 raft_consensus.cc:493] T 2e1c19a751904a6295897376e9c5ee56 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:29.413731 8055 raft_consensus.cc:515] T 2e1c19a751904a6295897376e9c5ee56 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.414372 8055 leader_election.cc:290] T 2e1c19a751904a6295897376e9c5ee56 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:29.415058 6139 leader_election.cc:343] T 2e1c19a751904a6295897376e9c5ee56 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 2e1c19a751904a6295897376e9c5ee56
I20260923 19:50:29.421550 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1183) took 2814 ms. Trace:
I20260923 19:50:29.422510 6456 tablet_bootstrap.cc:492] T a83726da349c4cd1852e956c8fa2cda5 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:29.422711 6456 ts_tablet_manager.cc:1403] T a83726da349c4cd1852e956c8fa2cda5 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.050s user 0.001s sys 0.003s
I20260923 19:50:29.423471 6456 raft_consensus.cc:359] T a83726da349c4cd1852e956c8fa2cda5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.423691 6456 raft_consensus.cc:385] T a83726da349c4cd1852e956c8fa2cda5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:29.423774 6456 raft_consensus.cc:740] T a83726da349c4cd1852e956c8fa2cda5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:29.424011 6456 consensus_queue.cc:260] T a83726da349c4cd1852e956c8fa2cda5 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.424544 6456 ts_tablet_manager.cc:1434] T a83726da349c4cd1852e956c8fa2cda5 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:29.424674 6459 rpcz_store.cc:276] 0923 19:50:26.607422 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:26.612922 (+ 5500us) service_pool.cc:224] Handling call
0923 19:50:29.421416 (+2808494us) ts_tablet_manager.cc:1151] Deleting tablet d35d749868aa488b99374483df2c5678
0923 19:50:29.421428 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.421530 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2808218}
W20260923 19:50:29.425235 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet d35d749868aa488b99374483df2c5678 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d35d749868aa488b99374483df2c5678 already in progress: creating tablet
I20260923 19:50:29.425629 6459 tablet_replica.cc:333] T 670d9cb0e6e2414092f72ffd5e6b00ea P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:29.425932 6456 tablet_bootstrap.cc:492] T 9756a1f8e23a436bb7c19c8cba7bdc05 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:29.427660 6456 tablet_bootstrap.cc:654] T 9756a1f8e23a436bb7c19c8cba7bdc05 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:29.427922 6459 raft_consensus.cc:2243] T 670d9cb0e6e2414092f72ffd5e6b00ea P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:29.428117 6459 raft_consensus.cc:2272] T 670d9cb0e6e2414092f72ffd5e6b00ea P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:29.428691 6459 ts_tablet_manager.cc:1916] T 670d9cb0e6e2414092f72ffd5e6b00ea P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:29.434835 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet a83726da349c4cd1852e956c8fa2cda5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:23 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:29.443615 6454 tablet_bootstrap.cc:654] T 9ee02922d2be45f5a1473a53a6f253c4 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:29.457713 6458 ts_tablet_manager.cc:1929] T 9ee02922d2be45f5a1473a53a6f253c4 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:29.457979 6458 log.cc:1199] T 9ee02922d2be45f5a1473a53a6f253c4 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/9ee02922d2be45f5a1473a53a6f253c4
I20260923 19:50:29.458346 6458 ts_tablet_manager.cc:1950] T 9ee02922d2be45f5a1473a53a6f253c4 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:29.459194 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1295) took 1558 ms. Trace:
I20260923 19:50:29.459398 6458 rpcz_store.cc:276] 0923 19:50:27.900477 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:27.900604 (+ 127us) service_pool.cc:224] Handling call
0923 19:50:29.387564 (+1486960us) ts_tablet_manager.cc:1151] Deleting tablet 9ee02922d2be45f5a1473a53a6f253c4
0923 19:50:29.387575 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.403106 (+ 15531us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.457643 (+ 54537us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.459173 (+ 1530us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1486789}
I20260923 19:50:29.460135 6456 tablet_bootstrap.cc:492] T 9756a1f8e23a436bb7c19c8cba7bdc05 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:29.461625 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 9ee02922d2be45f5a1473a53a6f253c4 (table default.Table_3f7aea8c4b01456887ad705c059f1572 [id=2b72f46eeef54308965034c7d49f0947]) successfully deleted
I20260923 19:50:29.461727 6456 ts_tablet_manager.cc:1403] T 9756a1f8e23a436bb7c19c8cba7bdc05 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.036s user 0.003s sys 0.000s
I20260923 19:50:29.462260 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1296) took 1443 ms. Trace:
I20260923 19:50:29.462393 6458 rpcz_store.cc:276] 0923 19:50:28.018539 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:28.018607 (+ 68us) service_pool.cc:224] Handling call
0923 19:50:29.462131 (+1443524us) ts_tablet_manager.cc:1151] Deleting tablet f0915e6df24f42b3b8b1a558b7ebc7ff
0923 19:50:29.462142 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.462243 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1443356}
I20260923 19:50:29.462488 6456 raft_consensus.cc:359] T 9756a1f8e23a436bb7c19c8cba7bdc05 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.462728 6456 raft_consensus.cc:385] T 9756a1f8e23a436bb7c19c8cba7bdc05 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:29.462786 6456 raft_consensus.cc:740] T 9756a1f8e23a436bb7c19c8cba7bdc05 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:29.462991 6456 consensus_queue.cc:260] T 9756a1f8e23a436bb7c19c8cba7bdc05 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.463588 6456 ts_tablet_manager.cc:1434] T 9756a1f8e23a436bb7c19c8cba7bdc05 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260923 19:50:29.467231 6454 tablet_bootstrap.cc:492] T 9ee02922d2be45f5a1473a53a6f253c4 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:29.467389 6454 ts_tablet_manager.cc:1403] T 9ee02922d2be45f5a1473a53a6f253c4 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.059s user 0.002s sys 0.011s
I20260923 19:50:29.468027 6454 raft_consensus.cc:359] T 9ee02922d2be45f5a1473a53a6f253c4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.468180 6454 raft_consensus.cc:385] T 9ee02922d2be45f5a1473a53a6f253c4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:29.468247 6454 raft_consensus.cc:740] T 9ee02922d2be45f5a1473a53a6f253c4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:29.468456 6454 consensus_queue.cc:260] T 9ee02922d2be45f5a1473a53a6f253c4 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.469035 6454 ts_tablet_manager.cc:1434] T 9ee02922d2be45f5a1473a53a6f253c4 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:29.470108 6454 tablet_bootstrap.cc:492] T cf64073cdde748bc8ed3ce7580a71160 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:29.471494 6454 tablet_bootstrap.cc:654] T cf64073cdde748bc8ed3ce7580a71160 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:29.479667 6459 ts_tablet_manager.cc:1929] T 670d9cb0e6e2414092f72ffd5e6b00ea P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:29.480654 6456 tablet_bootstrap.cc:492] T 4e69656e9fc941e19eb7de5c87bc9050 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:29.482388 6456 tablet_bootstrap.cc:654] T 4e69656e9fc941e19eb7de5c87bc9050 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:29.483755 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet 9756a1f8e23a436bb7c19c8cba7bdc05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:13 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:29.479836 6169 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ee02922d2be45f5a1473a53a6f253c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:29.491869 6459 log.cc:1199] T 670d9cb0e6e2414092f72ffd5e6b00ea P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/670d9cb0e6e2414092f72ffd5e6b00ea
I20260923 19:50:29.491951 8055 raft_consensus.cc:493] T f2799563250845b0b9d7d51b2367b16b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:29.492100 8055 raft_consensus.cc:515] T f2799563250845b0b9d7d51b2367b16b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.492455 6459 ts_tablet_manager.cc:1950] T 670d9cb0e6e2414092f72ffd5e6b00ea P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:29.492769 8055 leader_election.cc:290] T f2799563250845b0b9d7d51b2367b16b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:29.493458 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2799563250845b0b9d7d51b2367b16b" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:29.496923 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1185) took 2867 ms. Trace:
I20260923 19:50:29.508049 6459 rpcz_store.cc:276] 0923 19:50:26.629734 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:26.629913 (+ 179us) service_pool.cc:224] Handling call
0923 19:50:29.425579 (+2795666us) ts_tablet_manager.cc:1151] Deleting tablet 670d9cb0e6e2414092f72ffd5e6b00ea
0923 19:50:29.425589 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.454929 (+ 29340us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.479602 (+ 24673us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.496901 (+ 17299us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2795501}
I20260923 19:50:29.508679 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 670d9cb0e6e2414092f72ffd5e6b00ea (table default.Table_40208153d40d477c8a2d41c8efc1617c [id=8065910e86444becaf5f982fbdeb2aed]) successfully deleted
I20260923 19:50:29.509151 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1184) took 2883 ms. Trace:
I20260923 19:50:29.509290 6459 rpcz_store.cc:276] 0923 19:50:26.625608 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:26.630415 (+ 4807us) service_pool.cc:224] Handling call
0923 19:50:29.509018 (+2878603us) ts_tablet_manager.cc:1151] Deleting tablet 6cf5a8a047d547b58e08e50e9066018e
0923 19:50:29.509030 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.509135 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2878448}
W20260923 19:50:29.509778 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 6cf5a8a047d547b58e08e50e9066018e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6cf5a8a047d547b58e08e50e9066018e already in progress: creating tablet
I20260923 19:50:29.510143 6459 tablet_replica.cc:333] T 92f94b93d1364bb1a2562eb577707cf1 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:29.510385 6459 raft_consensus.cc:2243] T 92f94b93d1364bb1a2562eb577707cf1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:29.510597 6459 raft_consensus.cc:2272] T 92f94b93d1364bb1a2562eb577707cf1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:29.511186 6459 ts_tablet_manager.cc:1916] T 92f94b93d1364bb1a2562eb577707cf1 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:29.513666 6456 tablet_bootstrap.cc:492] T 4e69656e9fc941e19eb7de5c87bc9050 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:29.513820 6456 ts_tablet_manager.cc:1403] T 4e69656e9fc941e19eb7de5c87bc9050 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.048s user 0.010s sys 0.003s
I20260923 19:50:29.514611 6456 raft_consensus.cc:359] T 4e69656e9fc941e19eb7de5c87bc9050 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.514789 6456 raft_consensus.cc:385] T 4e69656e9fc941e19eb7de5c87bc9050 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:29.514858 6456 raft_consensus.cc:740] T 4e69656e9fc941e19eb7de5c87bc9050 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:29.515070 6456 consensus_queue.cc:260] T 4e69656e9fc941e19eb7de5c87bc9050 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.515589 6456 ts_tablet_manager.cc:1434] T 4e69656e9fc941e19eb7de5c87bc9050 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:50:29.518046 6456 tablet_bootstrap.cc:492] T d2dd611746d741e88b6911bf5d51f3e5 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:29.519680 6456 tablet_bootstrap.cc:654] T d2dd611746d741e88b6911bf5d51f3e5 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:29.522830 8055 raft_consensus.cc:493] T a263c0fc71424999b76ef01de9a51eda P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:29.522989 8055 raft_consensus.cc:515] T a263c0fc71424999b76ef01de9a51eda P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.523605 8055 leader_election.cc:290] T a263c0fc71424999b76ef01de9a51eda P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:29.524677 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a263c0fc71424999b76ef01de9a51eda" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:29.538610 6454 tablet_bootstrap.cc:492] T cf64073cdde748bc8ed3ce7580a71160 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:29.538781 6454 ts_tablet_manager.cc:1403] T cf64073cdde748bc8ed3ce7580a71160 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.069s user 0.008s sys 0.009s
I20260923 19:50:29.539485 6454 raft_consensus.cc:359] T cf64073cdde748bc8ed3ce7580a71160 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.539662 6454 raft_consensus.cc:385] T cf64073cdde748bc8ed3ce7580a71160 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:29.539728 6454 raft_consensus.cc:740] T cf64073cdde748bc8ed3ce7580a71160 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:29.539945 6454 consensus_queue.cc:260] T cf64073cdde748bc8ed3ce7580a71160 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.540549 6454 ts_tablet_manager.cc:1434] T cf64073cdde748bc8ed3ce7580a71160 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:29.546170 6454 tablet_bootstrap.cc:492] T 85f5ba9097674f9d889e178eaea4f0d7 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:29.547827 6454 tablet_bootstrap.cc:654] T 85f5ba9097674f9d889e178eaea4f0d7 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:29.549911 6456 tablet_bootstrap.cc:492] T d2dd611746d741e88b6911bf5d51f3e5 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:29.550055 6456 ts_tablet_manager.cc:1403] T d2dd611746d741e88b6911bf5d51f3e5 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.003s
I20260923 19:50:29.550524 6459 ts_tablet_manager.cc:1929] T 92f94b93d1364bb1a2562eb577707cf1 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:29.550576 6454 tablet_bootstrap.cc:492] T 85f5ba9097674f9d889e178eaea4f0d7 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:29.550699 6459 log.cc:1199] T 92f94b93d1364bb1a2562eb577707cf1 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/92f94b93d1364bb1a2562eb577707cf1
I20260923 19:50:29.550817 6454 ts_tablet_manager.cc:1403] T 85f5ba9097674f9d889e178eaea4f0d7 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.002s
I20260923 19:50:29.551220 6459 ts_tablet_manager.cc:1950] T 92f94b93d1364bb1a2562eb577707cf1 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:29.551574 6454 raft_consensus.cc:359] T 85f5ba9097674f9d889e178eaea4f0d7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.551743 6454 raft_consensus.cc:385] T 85f5ba9097674f9d889e178eaea4f0d7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:29.551811 6454 raft_consensus.cc:740] T 85f5ba9097674f9d889e178eaea4f0d7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:29.552600 6456 raft_consensus.cc:359] T d2dd611746d741e88b6911bf5d51f3e5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.552774 6456 raft_consensus.cc:385] T d2dd611746d741e88b6911bf5d51f3e5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:29.552843 6456 raft_consensus.cc:740] T d2dd611746d741e88b6911bf5d51f3e5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:29.553089 6456 consensus_queue.cc:260] T d2dd611746d741e88b6911bf5d51f3e5 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.553205 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1186) took 2836 ms. Trace:
I20260923 19:50:29.553380 6459 rpcz_store.cc:276] 0923 19:50:26.716763 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:26.717487 (+ 724us) service_pool.cc:224] Handling call
0923 19:50:29.510093 (+2792606us) ts_tablet_manager.cc:1151] Deleting tablet 92f94b93d1364bb1a2562eb577707cf1
0923 19:50:29.510103 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.531097 (+ 20994us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.550461 (+ 19364us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.553186 (+ 2725us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2792296}
I20260923 19:50:29.553582 6456 ts_tablet_manager.cc:1434] T d2dd611746d741e88b6911bf5d51f3e5 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260923 19:50:29.555595 5796 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet cf64073cdde748bc8ed3ce7580a71160 (table default.Table_ec1f04b2e36247fa96e9591cb7ab7eff [id=662eb0a4f944445486929d42c5ebfd01]). Expected version 3 got 0
I20260923 19:50:29.556560 6456 tablet_bootstrap.cc:492] T 431ad4da27544d68aa5666293984a86a P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:29.558869 6456 tablet_bootstrap.cc:654] T 431ad4da27544d68aa5666293984a86a P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:29.566042 6454 consensus_queue.cc:260] T 85f5ba9097674f9d889e178eaea4f0d7 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.566823 6454 ts_tablet_manager.cc:1434] T 85f5ba9097674f9d889e178eaea4f0d7 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260923 19:50:29.567113 6454 tablet_bootstrap.cc:492] T cb11d6e082784ad98cfb5253dbb88707 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:29.569006 6454 tablet_bootstrap.cc:654] T cb11d6e082784ad98cfb5253dbb88707 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:29.569092 5798 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet cf64073cdde748bc8ed3ce7580a71160 (table default.Table_ec1f04b2e36247fa96e9591cb7ab7eff [id=662eb0a4f944445486929d42c5ebfd01]). Expected version 3 got 0
I20260923 19:50:29.580691 6169 tablet_service.cc:1558] Processing DeleteTablet for tablet 85f5ba9097674f9d889e178eaea4f0d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60148
W20260923 19:50:29.587455 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet f0915e6df24f42b3b8b1a558b7ebc7ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0915e6df24f42b3b8b1a558b7ebc7ff already in progress: creating tablet
I20260923 19:50:29.588739 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1297) took 1523 ms. Trace:
I20260923 19:50:29.589430 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 92f94b93d1364bb1a2562eb577707cf1 (table default.Table_da77a1d14aed4fba88200eb53fd16559 [id=54986bca912743be8c7e5bcb2627d151]) successfully deleted
I20260923 19:50:29.589469 6454 tablet_bootstrap.cc:492] T cb11d6e082784ad98cfb5253dbb88707 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:29.589054 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet d2dd611746d741e88b6911bf5d51f3e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:29.589671 6458 rpcz_store.cc:276] 0923 19:50:28.064975 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:28.065036 (+ 61us) service_pool.cc:224] Handling call
0923 19:50:29.588587 (+1523551us) ts_tablet_manager.cc:1151] Deleting tablet 907bfabdc1f948d4872363b44bea154a
0923 19:50:29.588600 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.588715 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1523373}
W20260923 19:50:29.590152 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 907bfabdc1f948d4872363b44bea154a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 907bfabdc1f948d4872363b44bea154a already in progress: creating tablet
I20260923 19:50:29.590485 6454 ts_tablet_manager.cc:1403] T cb11d6e082784ad98cfb5253dbb88707 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.004s
I20260923 19:50:29.591096 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1299) took 1495 ms. Trace:
I20260923 19:50:29.592121 6458 rpcz_store.cc:276] 0923 19:50:28.095371 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:28.095425 (+ 54us) service_pool.cc:224] Handling call
0923 19:50:29.590789 (+1495364us) ts_tablet_manager.cc:1151] Deleting tablet 9968ab539c9149e98aa5326c208ce140
0923 19:50:29.590967 (+ 178us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.591078 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1495182}
W20260923 19:50:29.592921 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 9968ab539c9149e98aa5326c208ce140 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9968ab539c9149e98aa5326c208ce140 already in progress: creating tablet
I20260923 19:50:29.593343 6458 tablet_replica.cc:333] T d35ff653bf8d41cfbcf83359402a8f6a P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:29.593755 6458 raft_consensus.cc:2243] T d35ff653bf8d41cfbcf83359402a8f6a P 2bf41435f70447f19992d368ca6b46bd [term 1 LEADER]: Raft consensus shutting down.
I20260923 19:50:29.594046 6459 tablet_replica.cc:333] T 9c4a200d16464676976694656cbe28e2 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:29.594259 6459 raft_consensus.cc:2243] T 9c4a200d16464676976694656cbe28e2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:29.594421 6459 raft_consensus.cc:2272] T 9c4a200d16464676976694656cbe28e2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:29.595016 6459 ts_tablet_manager.cc:1916] T 9c4a200d16464676976694656cbe28e2 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:29.595219 6458 raft_consensus.cc:2272] T d35ff653bf8d41cfbcf83359402a8f6a P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:29.599149 6456 tablet_bootstrap.cc:492] T 431ad4da27544d68aa5666293984a86a P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:29.599367 6456 ts_tablet_manager.cc:1403] T 431ad4da27544d68aa5666293984a86a P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.043s user 0.003s sys 0.006s
I20260923 19:50:29.600517 6456 raft_consensus.cc:359] T 431ad4da27544d68aa5666293984a86a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.600759 6456 raft_consensus.cc:385] T 431ad4da27544d68aa5666293984a86a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:29.600859 6456 raft_consensus.cc:740] T 431ad4da27544d68aa5666293984a86a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:29.601161 6456 consensus_queue.cc:260] T 431ad4da27544d68aa5666293984a86a P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.601727 6456 ts_tablet_manager.cc:1434] T 431ad4da27544d68aa5666293984a86a P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:29.604759 6456 tablet_bootstrap.cc:492] T f28da30d48454ffd9626df789a2f2063 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:29.606941 6458 ts_tablet_manager.cc:1916] T d35ff653bf8d41cfbcf83359402a8f6a P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:29.594937 6454 raft_consensus.cc:359] T cb11d6e082784ad98cfb5253dbb88707 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.608526 6454 raft_consensus.cc:385] T cb11d6e082784ad98cfb5253dbb88707 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:29.608618 6454 raft_consensus.cc:740] T cb11d6e082784ad98cfb5253dbb88707 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:29.608850 6454 consensus_queue.cc:260] T cb11d6e082784ad98cfb5253dbb88707 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.609561 6454 ts_tablet_manager.cc:1434] T cb11d6e082784ad98cfb5253dbb88707 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
I20260923 19:50:29.615283 6169 tablet_service.cc:1558] Processing DeleteTablet for tablet cb11d6e082784ad98cfb5253dbb88707 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:29.618392 6454 tablet_bootstrap.cc:492] T ce6b86f947ce420994eaa5ff39ad9c87 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:29.618667 6456 tablet_bootstrap.cc:654] T f28da30d48454ffd9626df789a2f2063 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:29.620091 6454 tablet_bootstrap.cc:654] T ce6b86f947ce420994eaa5ff39ad9c87 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:29.621384 8135 raft_consensus.cc:493] T d2dd611746d741e88b6911bf5d51f3e5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:29.621524 8135 raft_consensus.cc:515] T d2dd611746d741e88b6911bf5d51f3e5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.622215 8135 leader_election.cc:290] T d2dd611746d741e88b6911bf5d51f3e5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:29.623106 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2dd611746d741e88b6911bf5d51f3e5" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:29.623672 6280 leader_election.cc:343] T d2dd611746d741e88b6911bf5d51f3e5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:29.624877 6458 ts_tablet_manager.cc:1929] T d35ff653bf8d41cfbcf83359402a8f6a P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260923 19:50:29.624990 6458 log.cc:1199] T d35ff653bf8d41cfbcf83359402a8f6a P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/d35ff653bf8d41cfbcf83359402a8f6a
I20260923 19:50:29.625326 6458 ts_tablet_manager.cc:1950] T d35ff653bf8d41cfbcf83359402a8f6a P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:29.626109 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet 431ad4da27544d68aa5666293984a86a with delete_type TABLET_DATA_DELETED (replaced by tablet 68459111552949aab20982dd7c28f7d3) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:29.634416 6459 ts_tablet_manager.cc:1929] T 9c4a200d16464676976694656cbe28e2 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:29.634575 6459 log.cc:1199] T 9c4a200d16464676976694656cbe28e2 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/9c4a200d16464676976694656cbe28e2
I20260923 19:50:29.634886 6459 ts_tablet_manager.cc:1950] T 9c4a200d16464676976694656cbe28e2 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:29.635710 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1187) took 2908 ms. Trace:
I20260923 19:50:29.635815 6459 rpcz_store.cc:276] 0923 19:50:26.727080 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:26.728759 (+ 1679us) service_pool.cc:224] Handling call
0923 19:50:29.593991 (+2865232us) ts_tablet_manager.cc:1151] Deleting tablet 9c4a200d16464676976694656cbe28e2
0923 19:50:29.594003 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.599933 (+ 5930us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.634344 (+ 34411us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.635688 (+ 1344us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2865029}
I20260923 19:50:29.637184 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1190) took 2890 ms. Trace:
I20260923 19:50:29.637280 6459 rpcz_store.cc:276] 0923 19:50:26.746601 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:26.746648 (+ 47us) service_pool.cc:224] Handling call
0923 19:50:29.637049 (+2890401us) ts_tablet_manager.cc:1151] Deleting tablet 2f45d03e655042d18dcbded39b3a8df6
0923 19:50:29.637059 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.637167 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2806255}
W20260923 19:50:29.637773 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 2f45d03e655042d18dcbded39b3a8df6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f45d03e655042d18dcbded39b3a8df6 already in progress: creating tablet
I20260923 19:50:29.626120 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1300) took 1263 ms. Trace:
I20260923 19:50:29.637964 6458 rpcz_store.cc:276] 0923 19:50:28.362982 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:28.363050 (+ 68us) service_pool.cc:224] Handling call
0923 19:50:29.593293 (+1230243us) ts_tablet_manager.cc:1151] Deleting tablet d35ff653bf8d41cfbcf83359402a8f6a
0923 19:50:29.593304 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.618277 (+ 24973us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.624822 (+ 6545us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.626099 (+ 1277us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1229994}
I20260923 19:50:29.638216 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1197) took 2859 ms. Trace:
I20260923 19:50:29.638306 6459 rpcz_store.cc:276] 0923 19:50:26.779182 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:26.779243 (+ 61us) service_pool.cc:224] Handling call
0923 19:50:29.638098 (+2858855us) ts_tablet_manager.cc:1151] Deleting tablet a0743d5ac2264af6b045af0474cbf58c
0923 19:50:29.638110 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.638198 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2783726}
I20260923 19:50:29.638620 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet d35ff653bf8d41cfbcf83359402a8f6a (table default.Table_f8ddcdb63fd04bd7b8f2a95e97e449bf [id=3c751273c2a044e09499b3a07044b3db]) successfully deleted
W20260923 19:50:29.638743 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet a0743d5ac2264af6b045af0474cbf58c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0743d5ac2264af6b045af0474cbf58c already in progress: creating tablet
I20260923 19:50:29.639870 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1301) took 1183 ms. Trace:
I20260923 19:50:29.641907 6458 rpcz_store.cc:276] 0923 19:50:28.456632 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:28.456687 (+ 55us) service_pool.cc:224] Handling call
0923 19:50:29.639721 (+1183034us) ts_tablet_manager.cc:1151] Deleting tablet 25117ec346224a85942d0106b4962a88
0923 19:50:29.639736 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.639842 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1182820}
I20260923 19:50:29.642097 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1198) took 2862 ms. Trace:
I20260923 19:50:29.642189 6459 rpcz_store.cc:276] 0923 19:50:26.779633 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:26.779685 (+ 52us) service_pool.cc:224] Handling call
0923 19:50:29.641980 (+2862295us) ts_tablet_manager.cc:1151] Deleting tablet 4952cee21fe9402db99783e05ffaffd5
0923 19:50:29.641991 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.642079 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2787549}
W20260923 19:50:29.642609 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 4952cee21fe9402db99783e05ffaffd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4952cee21fe9402db99783e05ffaffd5 already in progress: creating tablet
W20260923 19:50:29.642889 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 25117ec346224a85942d0106b4962a88 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 25117ec346224a85942d0106b4962a88 already in progress: creating tablet
I20260923 19:50:29.642933 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1212) took 2643 ms. Trace:
I20260923 19:50:29.643000 6459 rpcz_store.cc:276] 0923 19:50:26.999783 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:27.008128 (+ 8345us) service_pool.cc:224] Handling call
0923 19:50:29.642839 (+2634711us) ts_tablet_manager.cc:1151] Deleting tablet 11e0f1c645184da19ce11927e1d562c3
0923 19:50:29.642849 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.642920 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2634495}
W20260923 19:50:29.643381 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 11e0f1c645184da19ce11927e1d562c3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11e0f1c645184da19ce11927e1d562c3 already in progress: creating tablet
I20260923 19:50:29.643422 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1302) took 1174 ms. Trace:
I20260923 19:50:29.643842 6459 tablet_replica.cc:333] T 64e8951eb899461aa9c0b36e3f7555e2 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:29.643858 6458 rpcz_store.cc:276] 0923 19:50:28.469425 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:28.469493 (+ 68us) service_pool.cc:224] Handling call
0923 19:50:29.643300 (+1173807us) ts_tablet_manager.cc:1151] Deleting tablet 2d1ed91cfd5f4d1eb1ea75fa6183141a
0923 19:50:29.643311 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.643403 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1170668}
I20260923 19:50:29.644052 6459 raft_consensus.cc:2243] T 64e8951eb899461aa9c0b36e3f7555e2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:29.644200 6459 raft_consensus.cc:2272] T 64e8951eb899461aa9c0b36e3f7555e2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:29.644556 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 2d1ed91cfd5f4d1eb1ea75fa6183141a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d1ed91cfd5f4d1eb1ea75fa6183141a already in progress: creating tablet
I20260923 19:50:29.644774 6459 ts_tablet_manager.cc:1916] T 64e8951eb899461aa9c0b36e3f7555e2 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:29.645056 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1304) took 1166 ms. Trace:
I20260923 19:50:29.645363 6458 rpcz_store.cc:276] 0923 19:50:28.478913 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:28.478984 (+ 71us) service_pool.cc:224] Handling call
0923 19:50:29.644941 (+1165957us) ts_tablet_manager.cc:1151] Deleting tablet 4e3cdffa2c2a4e5da4980dea84d82c4e
0923 19:50:29.644951 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.645039 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1159160}
W20260923 19:50:29.647677 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet 4e3cdffa2c2a4e5da4980dea84d82c4e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4e3cdffa2c2a4e5da4980dea84d82c4e already in progress: creating tablet
I20260923 19:50:29.648099 6458 tablet_replica.cc:333] T 85f5ba9097674f9d889e178eaea4f0d7 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:29.648531 6458 raft_consensus.cc:2243] T 85f5ba9097674f9d889e178eaea4f0d7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:29.650804 6458 raft_consensus.cc:2272] T 85f5ba9097674f9d889e178eaea4f0d7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:29.651602 6458 ts_tablet_manager.cc:1916] T 85f5ba9097674f9d889e178eaea4f0d7 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:29.653034 6454 tablet_bootstrap.cc:492] T ce6b86f947ce420994eaa5ff39ad9c87 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:29.653177 6454 ts_tablet_manager.cc:1403] T ce6b86f947ce420994eaa5ff39ad9c87 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.002s
I20260923 19:50:29.654017 6454 raft_consensus.cc:359] T ce6b86f947ce420994eaa5ff39ad9c87 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.654194 6454 raft_consensus.cc:385] T ce6b86f947ce420994eaa5ff39ad9c87 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:29.654251 6454 raft_consensus.cc:740] T ce6b86f947ce420994eaa5ff39ad9c87 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:29.654461 6454 consensus_queue.cc:260] T ce6b86f947ce420994eaa5ff39ad9c87 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.658483 8135 raft_consensus.cc:493] T 3acf4a03174f45d5aee9c9b1454784f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:29.658649 8135 raft_consensus.cc:515] T 3acf4a03174f45d5aee9c9b1454784f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.659307 8135 leader_election.cc:290] T 3acf4a03174f45d5aee9c9b1454784f8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:29.660028 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3acf4a03174f45d5aee9c9b1454784f8" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:29.660658 6280 leader_election.cc:343] T 3acf4a03174f45d5aee9c9b1454784f8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:29.662834 6169 tablet_service.cc:1558] Processing DeleteTablet for tablet ce6b86f947ce420994eaa5ff39ad9c87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:29.664701 6456 tablet_bootstrap.cc:492] T f28da30d48454ffd9626df789a2f2063 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:29.664850 6456 ts_tablet_manager.cc:1403] T f28da30d48454ffd9626df789a2f2063 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.060s user 0.005s sys 0.005s
I20260923 19:50:29.665555 6456 raft_consensus.cc:359] T f28da30d48454ffd9626df789a2f2063 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.665727 6456 raft_consensus.cc:385] T f28da30d48454ffd9626df789a2f2063 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:29.665791 6456 raft_consensus.cc:740] T f28da30d48454ffd9626df789a2f2063 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:29.665922 6454 ts_tablet_manager.cc:1434] T ce6b86f947ce420994eaa5ff39ad9c87 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260923 19:50:29.666075 6456 consensus_queue.cc:260] T f28da30d48454ffd9626df789a2f2063 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.666678 6454 tablet_bootstrap.cc:492] T 8d20b59aa99f49f0b2f4d7dd861470f8 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:29.668924 6454 tablet_bootstrap.cc:654] T 8d20b59aa99f49f0b2f4d7dd861470f8 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:29.671504 5796 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet f28da30d48454ffd9626df789a2f2063 (table default.Table_4c7beeb130604565858c166a2b4c4c53 [id=e319867d5e9c46c79d9f5a564faec3e9]). Expected version 1 got 0
I20260923 19:50:29.673297 6456 ts_tablet_manager.cc:1434] T f28da30d48454ffd9626df789a2f2063 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260923 19:50:29.673686 6456 tablet_bootstrap.cc:492] T cf0caa6afcf546678c233a9333b77a2a P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:29.675268 6456 tablet_bootstrap.cc:654] T cf0caa6afcf546678c233a9333b77a2a P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:29.682505 6459 ts_tablet_manager.cc:1929] T 64e8951eb899461aa9c0b36e3f7555e2 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:29.682648 6459 log.cc:1199] T 64e8951eb899461aa9c0b36e3f7555e2 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/64e8951eb899461aa9c0b36e3f7555e2
I20260923 19:50:29.682942 6459 ts_tablet_manager.cc:1950] T 64e8951eb899461aa9c0b36e3f7555e2 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:29.683667 5796 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet f28da30d48454ffd9626df789a2f2063 (table default.Table_4c7beeb130604565858c166a2b4c4c53 [id=e319867d5e9c46c79d9f5a564faec3e9]). Expected version 1 got 0
I20260923 19:50:29.687601 6458 ts_tablet_manager.cc:1929] T 85f5ba9097674f9d889e178eaea4f0d7 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:29.687920 6458 log.cc:1199] T 85f5ba9097674f9d889e178eaea4f0d7 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/85f5ba9097674f9d889e178eaea4f0d7
I20260923 19:50:29.688454 6458 ts_tablet_manager.cc:1950] T 85f5ba9097674f9d889e178eaea4f0d7 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:29.689725 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1306) took 1193 ms. Trace:
I20260923 19:50:29.690986 6458 rpcz_store.cc:276] 0923 19:50:28.496372 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:28.496422 (+ 50us) service_pool.cc:224] Handling call
0923 19:50:29.648046 (+1151624us) ts_tablet_manager.cc:1151] Deleting tablet 85f5ba9097674f9d889e178eaea4f0d7
0923 19:50:29.648056 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.676196 (+ 28140us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.679375 (+ 3179us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.689704 (+ 10329us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1147717}
I20260923 19:50:29.693297 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 85f5ba9097674f9d889e178eaea4f0d7 (table default.Table_0b7f0cec058c44798de4db8eeaf31ef4 [id=ae0f416afa6d49d4a3ab11ed40f0df48]) successfully deleted
I20260923 19:50:29.692910 6456 tablet_bootstrap.cc:492] T cf0caa6afcf546678c233a9333b77a2a P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:29.693799 6456 ts_tablet_manager.cc:1403] T cf0caa6afcf546678c233a9333b77a2a P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.000s
I20260923 19:50:29.694638 6456 raft_consensus.cc:359] T cf0caa6afcf546678c233a9333b77a2a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.694866 6456 raft_consensus.cc:385] T cf0caa6afcf546678c233a9333b77a2a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:29.694969 6456 raft_consensus.cc:740] T cf0caa6afcf546678c233a9333b77a2a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:29.695283 6456 consensus_queue.cc:260] T cf0caa6afcf546678c233a9333b77a2a P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.698150 6198 raft_consensus.cc:3060] T f2799563250845b0b9d7d51b2367b16b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:29.704607 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet cf0caa6afcf546678c233a9333b77a2a with delete_type TABLET_DATA_DELETED (replaced by tablet e1178b26b95b41babd12b9b8b5bdbd6e) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:29.706209 6456 ts_tablet_manager.cc:1434] T cf0caa6afcf546678c233a9333b77a2a P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260923 19:50:29.706562 6456 tablet_bootstrap.cc:492] T 146a402ff29a4e0b834a9f270d61e21c P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:29.708312 6456 tablet_bootstrap.cc:654] T 146a402ff29a4e0b834a9f270d61e21c P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:29.718140 6458 tablet_replica.cc:333] T 373d6442546d41e2b5567dfc92ae07b1 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:29.718374 6458 raft_consensus.cc:2243] T 373d6442546d41e2b5567dfc92ae07b1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:29.718537 6458 raft_consensus.cc:2272] T 373d6442546d41e2b5567dfc92ae07b1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:29.719111 6458 ts_tablet_manager.cc:1916] T 373d6442546d41e2b5567dfc92ae07b1 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:29.720633 6454 tablet_bootstrap.cc:492] T 8d20b59aa99f49f0b2f4d7dd861470f8 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:29.720789 6454 ts_tablet_manager.cc:1403] T 8d20b59aa99f49f0b2f4d7dd861470f8 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.055s user 0.006s sys 0.001s
I20260923 19:50:29.721542 6454 raft_consensus.cc:359] T 8d20b59aa99f49f0b2f4d7dd861470f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.721716 6454 raft_consensus.cc:385] T 8d20b59aa99f49f0b2f4d7dd861470f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:29.721768 6454 raft_consensus.cc:740] T 8d20b59aa99f49f0b2f4d7dd861470f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:29.725309 6458 ts_tablet_manager.cc:1929] T 373d6442546d41e2b5567dfc92ae07b1 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:29.725421 6458 log.cc:1199] T 373d6442546d41e2b5567dfc92ae07b1 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/373d6442546d41e2b5567dfc92ae07b1
I20260923 19:50:29.725674 6458 ts_tablet_manager.cc:1950] T 373d6442546d41e2b5567dfc92ae07b1 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:29.730093 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1307) took 1232 ms. Trace:
I20260923 19:50:29.730206 6458 rpcz_store.cc:276] 0923 19:50:28.497265 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:28.497311 (+ 46us) service_pool.cc:224] Handling call
0923 19:50:29.718079 (+1220768us) ts_tablet_manager.cc:1151] Deleting tablet 373d6442546d41e2b5567dfc92ae07b1
0923 19:50:29.718091 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.722362 (+ 4271us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.725255 (+ 2893us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.730068 (+ 4813us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50,"tablet-delete.queue_time_us":1217745}
I20260923 19:50:29.730655 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 373d6442546d41e2b5567dfc92ae07b1 (table default.Table_1916c5305d984163ac72fcf98ce30e62 [id=666f42c33b8943a6a0362c47d38aa2b3]) successfully deleted
I20260923 19:50:29.731961 6458 tablet_replica.cc:333] T 559f3e3016aa470f9732a727b4528586 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:29.732146 6458 raft_consensus.cc:2243] T 559f3e3016aa470f9732a727b4528586 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:29.732280 6458 raft_consensus.cc:2272] T 559f3e3016aa470f9732a727b4528586 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:29.732463 5796 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet f2799563250845b0b9d7d51b2367b16b (table default.Table_bc33f65d5674483c9854966514392420 [id=b6e6ca970bea466f80938e694f770e67]). Expected version 1 got 0
I20260923 19:50:29.732793 6458 ts_tablet_manager.cc:1916] T 559f3e3016aa470f9732a727b4528586 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:29.738883 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1213) took 2722 ms. Trace:
I20260923 19:50:29.739005 6459 rpcz_store.cc:276] 0923 19:50:27.016395 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:27.016452 (+ 57us) service_pool.cc:224] Handling call
0923 19:50:29.643798 (+2627346us) ts_tablet_manager.cc:1151] Deleting tablet 64e8951eb899461aa9c0b36e3f7555e2
0923 19:50:29.643807 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.648382 (+ 4575us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.682441 (+ 34059us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.738288 (+ 55847us) spinlock_profiling.cc:243] Waited 54.9 ms on lock 0x61800000d518. stack: 00007fc70c102366 00007fc70c102120 00007fc70b10c34d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007fc70c0f7dfd 00007fc70c0f8e6e 00007fc720083ecd 00007fc720004213 00007fc71c14cd23 00007fc71c17fa64 00007fc71c1603a0 00007fc71c16012d 0000000000aaef9c 00007fc70c14888f
0923 19:50:29.738859 (+ 571us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126290176,"tablet-delete.queue_time_us":2627070}
I20260923 19:50:29.739255 8135 raft_consensus.cc:493] T 431ad4da27544d68aa5666293984a86a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:29.739418 8135 raft_consensus.cc:515] T 431ad4da27544d68aa5666293984a86a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.739466 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 64e8951eb899461aa9c0b36e3f7555e2 (table default.Table_562543b3ee364c59a1a2a7fd61331c74 [id=d1195b250ce24d589296d3a776339d7b]) successfully deleted
I20260923 19:50:29.739880 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1211) took 2762 ms. Trace:
I20260923 19:50:29.739972 6459 rpcz_store.cc:276] 0923 19:50:26.977205 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:27.020748 (+ 43543us) service_pool.cc:224] Handling call
0923 19:50:29.739761 (+2719013us) ts_tablet_manager.cc:1151] Deleting tablet 20d299b0112b4eb4ae1b8cb266c69a11
0923 19:50:29.739772 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.739864 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2718808}
I20260923 19:50:29.740094 8135 leader_election.cc:290] T 431ad4da27544d68aa5666293984a86a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:29.740363 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 20d299b0112b4eb4ae1b8cb266c69a11 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20d299b0112b4eb4ae1b8cb266c69a11 already in progress: creating tablet
I20260923 19:50:29.740651 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "431ad4da27544d68aa5666293984a86a" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:29.741048 6454 consensus_queue.cc:260] T 8d20b59aa99f49f0b2f4d7dd861470f8 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
W20260923 19:50:29.741204 6280 leader_election.cc:343] T 431ad4da27544d68aa5666293984a86a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:29.741920 6454 ts_tablet_manager.cc:1434] T 8d20b59aa99f49f0b2f4d7dd861470f8 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.021s user 0.002s sys 0.000s
I20260923 19:50:29.741446 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1231) took 2536 ms. Trace:
I20260923 19:50:29.742090 6459 rpcz_store.cc:276] 0923 19:50:27.205439 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:27.208063 (+ 2624us) service_pool.cc:224] Handling call
0923 19:50:29.741350 (+2533287us) ts_tablet_manager.cc:1151] Deleting tablet f5f285e125dc445197a59e02e199a606
0923 19:50:29.741360 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.741432 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2533092}
W20260923 19:50:29.742530 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet f5f285e125dc445197a59e02e199a606 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5f285e125dc445197a59e02e199a606 already in progress: creating tablet
I20260923 19:50:29.742738 5796 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet f2799563250845b0b9d7d51b2367b16b (table default.Table_bc33f65d5674483c9854966514392420 [id=b6e6ca970bea466f80938e694f770e67]). Expected version 1 got 0
I20260923 19:50:29.743064 6454 tablet_bootstrap.cc:492] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:29.744920 6456 tablet_bootstrap.cc:492] T 146a402ff29a4e0b834a9f270d61e21c P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:29.745077 6456 ts_tablet_manager.cc:1403] T 146a402ff29a4e0b834a9f270d61e21c P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.039s user 0.000s sys 0.008s
I20260923 19:50:29.745798 8055 raft_consensus.cc:493] T 22c89609da884c47b1dbc1470b37efbe P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:29.745957 8055 raft_consensus.cc:515] T 22c89609da884c47b1dbc1470b37efbe P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.746043 6456 raft_consensus.cc:359] T 146a402ff29a4e0b834a9f270d61e21c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.746201 6456 raft_consensus.cc:385] T 146a402ff29a4e0b834a9f270d61e21c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:29.746254 6456 raft_consensus.cc:740] T 146a402ff29a4e0b834a9f270d61e21c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:29.746500 8055 leader_election.cc:290] T 22c89609da884c47b1dbc1470b37efbe P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:29.747259 6139 leader_election.cc:343] T 22c89609da884c47b1dbc1470b37efbe P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 22c89609da884c47b1dbc1470b37efbe
I20260923 19:50:29.747506 6456 consensus_queue.cc:260] T 146a402ff29a4e0b834a9f270d61e21c P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.748258 6459 tablet_replica.cc:333] T 85d35ebef3c24a2e89233dd900b63513 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:29.749220 6459 raft_consensus.cc:2243] T 85d35ebef3c24a2e89233dd900b63513 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:29.758630 5798 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 8d20b59aa99f49f0b2f4d7dd861470f8 (table default.Table_3a666373aff54c2d8256d8fc785cfcc1 [id=57da80bd083d4763a5523608ea26f2bb]). Expected version 1 got 0
I20260923 19:50:29.765682 6456 ts_tablet_manager.cc:1434] T 146a402ff29a4e0b834a9f270d61e21c P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.021s user 0.003s sys 0.000s
I20260923 19:50:29.767105 6198 raft_consensus.cc:3060] T cf64073cdde748bc8ed3ce7580a71160 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:29.771806 6456 tablet_bootstrap.cc:492] T 8b8a973b247343008a29d67dfa712a0b P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:29.773499 6456 tablet_bootstrap.cc:654] T 8b8a973b247343008a29d67dfa712a0b P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:29.775738 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet 146a402ff29a4e0b834a9f270d61e21c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:29.780469 8135 consensus_queue.cc:1048] T cf64073cdde748bc8ed3ce7580a71160 P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:29.780819 6459 raft_consensus.cc:2272] T 85d35ebef3c24a2e89233dd900b63513 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:29.782881 6459 ts_tablet_manager.cc:1916] T 85d35ebef3c24a2e89233dd900b63513 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:29.788434 6458 ts_tablet_manager.cc:1929] T 559f3e3016aa470f9732a727b4528586 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:29.789505 6454 tablet_bootstrap.cc:654] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:29.789758 6458 log.cc:1199] T 559f3e3016aa470f9732a727b4528586 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/559f3e3016aa470f9732a727b4528586
I20260923 19:50:29.790258 6458 ts_tablet_manager.cc:1950] T 559f3e3016aa470f9732a727b4528586 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:29.791419 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1316) took 1167 ms. Trace:
I20260923 19:50:29.792577 6458 rpcz_store.cc:276] 0923 19:50:28.623509 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:28.623563 (+ 54us) service_pool.cc:224] Handling call
0923 19:50:29.731900 (+1108337us) ts_tablet_manager.cc:1151] Deleting tablet 559f3e3016aa470f9732a727b4528586
0923 19:50:29.731911 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.784362 (+ 52451us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.788370 (+ 4008us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.791396 (+ 3026us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1108149}
I20260923 19:50:29.793671 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 559f3e3016aa470f9732a727b4528586 (table default.Table_d7d1452530dc40018f8d5568a97f273b [id=7ceb51c74b464ca4a1c59cdac4d65f2a]) successfully deleted
I20260923 19:50:29.794217 6458 tablet_replica.cc:333] T 772ece5283a949408d849f6e56f5f17b P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:29.794636 6458 raft_consensus.cc:2243] T 772ece5283a949408d849f6e56f5f17b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:29.795141 6458 raft_consensus.cc:2272] T 772ece5283a949408d849f6e56f5f17b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:29.795908 6458 ts_tablet_manager.cc:1916] T 772ece5283a949408d849f6e56f5f17b P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:29.797734 8055 raft_consensus.cc:493] T d04b3a9ade7a405bb619704095fac279 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:29.797997 8055 raft_consensus.cc:515] T d04b3a9ade7a405bb619704095fac279 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.798851 8055 leader_election.cc:290] T d04b3a9ade7a405bb619704095fac279 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:29.799674 6139 leader_election.cc:343] T d04b3a9ade7a405bb619704095fac279 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: d04b3a9ade7a405bb619704095fac279
I20260923 19:50:29.801808 8181 raft_consensus.cc:493] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 83e97b26500048d0b75350a21a8ff96b)
I20260923 19:50:29.367566 7429 rpcz_store.cc:276] 0923 19:50:27.989574 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:27.989623 (+ 49us) service_pool.cc:224] Handling call
0923 19:50:28.020340 (+ 30717us) raft_consensus.cc:1471] Updating replica for 624 ops
0923 19:50:28.126877 (+106537us) raft_consensus.cc:1534] Early marking committed up to index 0
0923 19:50:28.126883 (+ 6us) raft_consensus.cc:1539] Triggering prepare for 624 ops
0923 19:50:28.127009 (+ 126us) write_op.cc:270] Start()
0923 19:50:28.127038 (+ 29us) write_op.cc:276] Timestamp: P: 1790193015864598 usec, L: 0
0923 19:50:28.127198 (+ 160us) write_op.cc:270] Start()
0923 19:50:28.127217 (+ 19us) write_op.cc:276] Timestamp: P: 1790193015866963 usec, L: 0
0923 19:50:28.127361 (+ 144us) write_op.cc:270] Start()
0923 19:50:28.127379 (+ 18us) write_op.cc:276] Timestamp: P: 1790193015890301 usec, L: 0
0923 19:50:28.127520 (+ 141us) write_op.cc:270] Start()
0923 19:50:28.127538 (+ 18us) write_op.cc:276] Timestamp: P: 1790193015890949 usec, L: 0
0923 19:50:28.127680 (+ 142us) write_op.cc:270] Start()
0923 19:50:28.127698 (+ 18us) write_op.cc:276] Timestamp: P: 1790193015891584 usec, L: 0
0923 19:50:28.127821 (+ 123us) write_op.cc:270] Start()
0923 19:50:28.127840 (+ 19us) write_op.cc:276] Timestamp: P: 1790193015900518 usec, L: 0
0923 19:50:28.127960 (+ 120us) write_op.cc:270] Start()
0923 19:50:28.127997 (+ 37us) write_op.cc:276] Timestamp: P: 1790193015901064 usec, L: 0
0923 19:50:28.128301 (+ 304us) write_op.cc:270] Start()
0923 19:50:28.128329 (+ 28us) write_op.cc:276] Timestamp: P: 1790193015901576 usec, L: 0
0923 19:50:28.128484 (+ 155us) write_op.cc:270] Start()
0923 19:50:28.128504 (+ 20us) write_op.cc:276] Timestamp: P: 1790193015902215 usec, L: 0
0923 19:50:28.128620 (+ 116us) write_op.cc:270] Start()
0923 19:50:28.128649 (+ 29us) write_op.cc:276] Timestamp: P: 1790193015902836 usec, L: 0
0923 19:50:28.128769 (+ 120us) write_op.cc:270] Start()
0923 19:50:28.128787 (+ 18us) write_op.cc:276] Timestamp: P: 1790193015903501 usec, L: 0
0923 19:50:28.128911 (+ 124us) write_op.cc:270] Start()
0923 19:50:28.128928 (+ 17us) write_op.cc:276] Timestamp: P: 1790193015904125 usec, L: 0
0923 19:50:28.129069 (+ 141us) write_op.cc:270] Start()
0923 19:50:28.129087 (+ 18us) write_op.cc:276] Timestamp: P: 1790193015928222 usec, L: 0
0923 19:50:28.129198 (+ 111us) write_op.cc:270] Start()
0923 19:50:28.129216 (+ 18us) write_op.cc:276] Timestamp: P: 1790193015928774 usec, L: 0
0923 19:50:28.129330 (+ 114us) write_op.cc:270] Start()
0923 19:50:28.129347 (+ 17us) write_op.cc:276] Timestamp: P: 1790193015929239 usec, L: 0
0923 19:50:28.158832 (+ 29485us) write_op.cc:270] Start()
0923 19:50:28.158867 (+ 35us) write_op.cc:276] Timestamp: P: 1790193016008340 usec, L: 0
0923 19:50:28.160020 (+ 1153us) write_op.cc:270] Start()
0923 19:50:28.160067 (+ 47us) write_op.cc:276] Timestamp: P: 1790193016154755 usec, L: 0
0923 19:50:28.160248 (+ 181us) write_op.cc:270] Start()
0923 19:50:28.160269 (+ 21us) write_op.cc:276] Timestamp: P: 1790193016345507 usec, L: 0
0923 19:50:28.160397 (+ 128us) write_op.cc:270] Start()
0923 19:50:28.160417 (+ 20us) write_op.cc:276] Timestamp: P: 1790193016346880 usec, L: 0
0923 19:50:28.160555 (+ 138us) write_op.cc:270] Start()
0923 19:50:28.160577 (+ 22us) write_op.cc:276] Timestamp: P: 1790193016347522 usec, L: 0
0923 19:50:28.160698 (+ 121us) write_op.cc:270] Start()
0923 19:50:28.160716 (+ 18us) write_op.cc:276] Timestamp: P: 1790193016348018 usec, L: 0
0923 19:50:28.160856 (+ 140us) write_op.cc:270] Start()
0923 19:50:28.160893 (+ 37us) write_op.cc:276] Timestamp: P: 1790193016348546 usec, L: 0
0923 19:50:28.161013 (+ 120us) write_op.cc:270] Start()
0923 19:50:28.161031 (+ 18us) write_op.cc:276] Timestamp: P: 1790193016353771 usec, L: 0
0923 19:50:28.161201 (+ 170us) write_op.cc:270] Start()
0923 19:50:28.161224 (+ 23us) write_op.cc:276] Timestamp: P: 1790193016354427 usec, L: 0
0923 19:50:28.161387 (+ 163us) write_op.cc:270] Start()
0923 19:50:28.161406 (+ 19us) write_op.cc:276] Timestamp: P: 1790193016355069 usec, L: 0
0923 19:50:28.161530 (+ 124us) write_op.cc:270] Start()
0923 19:50:28.161548 (+ 18us) write_op.cc:276] Timestamp: P: 1790193016383943 usec, L: 0
0923 19:50:28.161668 (+ 120us) write_op.cc:270] Start()
0923 19:50:28.161686 (+ 18us) write_op.cc:276] Timestamp: P: 1790193016385290 usec, L: 0
0923 19:50:28.161829 (+ 143us) write_op.cc:270] Start()
0923 19:50:28.161847 (+ 18us) write_op.cc:276] Timestamp: P: 1790193016483811 usec, L: 0
0923 19:50:28.175744 (+ 13897us) write_op.cc:270] Start()
0923 19:50:28.175779 (+ 35us) write_op.cc:276] Timestamp: P: 1790193016526375 usec, L: 0
0923 19:50:28.175979 (+ 200us) write_op.cc:270] Start()
0923 19:50:28.176006 (+ 27us) write_op.cc:276] Timestamp: P: 1790193016528930 usec, L: 0
0923 19:50:28.176183 (+ 177us) write_op.cc:270] Start()
0923 19:50:28.176209 (+ 26us) write_op.cc:276] Timestamp: P: 1790193016529500 usec, L: 0
0923 19:50:28.176381 (+ 172us) write_op.cc:270] Start()
0923 19:50:28.176407 (+ 26us) write_op.cc:276] Timestamp: P: 1790193016530051 usec, L: 0
0923 19:50:28.176590 (+ 183us) write_op.cc:270] Start()
0923 19:50:28.176612 (+ 22us) write_op.cc:276] Timestamp: P: 1790193016542632 usec, L: 0
0923 19:50:28.176756 (+ 144us) write_op.cc:270] Start()
0923 19:50:28.176774 (+ 18us) write_op.cc:276] Timestamp: P: 1790193016618240 usec, L: 0
0923 19:50:28.176891 (+ 117us) write_op.cc:270] Start()
0923 19:50:28.176909 (+ 18us) write_op.cc:276] Timestamp: P: 1790193016712168 usec, L: 0
0923 19:50:28.177028 (+ 119us) write_op.cc:270] Start()
0923 19:50:28.177046 (+ 18us) write_op.cc:276] Timestamp: P: 1790193016712815 usec, L: 0
0923 19:50:28.177171 (+ 125us) write_op.cc:270] Start()
0923 19:50:28.177189 (+ 18us) write_op.cc:276] Timestamp: P: 1790193016713360 usec, L: 0
0923 19:50:28.177310 (+ 121us) write_op.cc:270] Start()
0923 19:50:28.177327 (+ 17us) write_op.cc:276] Timestamp: P: 1790193016714594 usec, L: 0
0923 19:50:28.177437 (+ 110us) write_op.cc:270] Start()
0923 19:50:28.177455 (+ 18us) write_op.cc:276] Timestamp: P: 1790193016775782 usec, L: 0
0923 19:50:28.177614 (+ 159us) write_op.cc:270] Start()
0923 19:50:28.177666 (+ 52us) write_op.cc:276] Timestamp: P: 1790193016864835 usec, L: 0
0923 19:50:28.177799 (+ 133us) write_op.cc:270] Start()
0923 19:50:28.177816 (+ 17us) write_op.cc:276] Timestamp: P: 1790193016935903 usec, L: 0
0923 19:50:28.190230 (+ 12414us) write_op.cc:270] Start()
0923 19:50:28.190264 (+ 34us) write_op.cc:276] Timestamp: P: 1790193016959642 usec, L: 0
0923 19:50:28.190455 (+ 191us) write_op.cc:270] Start()
0923 19:50:28.190479 (+ 24us) write_op.cc:276] Timestamp: P: 1790193016961133 usec, L: 0
0923 19:50:28.190635 (+ 156us) write_op.cc:270] Start()
0923 19:50:28.190658 (+ 23us) write_op.cc:276] Timestamp: P: 1790193016962316 usec, L: 0
0923 19:50:28.190830 (+ 172us) write_op.cc:270] Start()
0923 19:50:28.190858 (+ 28us) write_op.cc:276] Timestamp: P: 1790193016963101 usec, L: 0
0923 19:50:28.191016 (+ 158us) write_op.cc:270] Start()
0923 19:50:28.191042 (+ 26us) write_op.cc:276] Timestamp: P: 1790193016963851 usec, L: 0
0923 19:50:28.191217 (+ 175us) write_op.cc:270] Start()
0923 19:50:28.191240 (+ 23us) write_op.cc:276] Timestamp: P: 1790193016964541 usec, L: 0
0923 19:50:28.191404 (+ 164us) write_op.cc:270] Start()
0923 19:50:28.191428 (+ 24us) write_op.cc:276] Timestamp: P: 1790193016965255 usec, L: 0
0923 19:50:28.191611 (+ 183us) write_op.cc:270] Start()
0923 19:50:28.191637 (+ 26us) write_op.cc:276] Timestamp: P: 1790193017071309 usec, L: 0
0923 19:50:28.191793 (+ 156us) write_op.cc:270] Start()
0923 19:50:28.191815 (+ 22us) write_op.cc:276] Timestamp: P: 1790193017166587 usec, L: 0
0923 19:50:28.191949 (+ 134us) write_op.cc:270] Start()
0923 19:50:28.191969 (+ 20us) write_op.cc:276] Timestamp: P: 1790193017167851 usec, L: 0
0923 19:50:28.192125 (+ 156us) write_op.cc:270] Start()
0923 19:50:28.192146 (+ 21us) write_op.cc:276] Timestamp: P: 1790193017168919 usec, L: 0
0923 19:50:28.192268 (+ 122us) write_op.cc:270] Start()
0923 19:50:28.192286 (+ 18us) write_op.cc:276] Timestamp: P: 1790193017169728 usec, L: 0
0923 19:50:28.192444 (+ 158us) write_op.cc:270] Start()
0923 19:50:28.192462 (+ 18us) write_op.cc:276] Timestamp: P: 1790193017206029 usec, L: 0
0923 19:50:28.192576 (+ 114us) write_op.cc:270] Start()
0923 19:50:28.192592 (+ 16us) write_op.cc:276] Timestamp: P: 1790193017207420 usec, L: 0
0923 19:50:28.192706 (+ 114us) write_op.cc:270] Start()
0923 19:50:28.192721 (+ 15us) write_op.cc:276] Timestamp: P: 1790193017213453 usec, L: 0
0923 19:50:28.192824 (+ 103us) write_op.cc:270] Start()
0923 19:50:28.192842 (+ 18us) write_op.cc:276] Timestamp: P: 1790193017217924 usec, L: 0
0923 19:50:28.192954 (+ 112us) write_op.cc:270] Start()
0923 19:50:28.192970 (+ 16us) write_op.cc:276] Timestamp: P: 1790193017463696 usec, L: 0
0923 19:50:28.193131 (+ 161us) write_op.cc:270] Start()
0923 19:50:28.193149 (+ 18us) write_op.cc:276] Timestamp: P: 1790193017464390 usec, L: 0
0923 19:50:28.193277 (+ 128us) write_op.cc:270] Start()
0923 19:50:28.193329 (+ 52us) write_op.cc:276] Timestamp: P: 1790193017464914 usec, L: 0
0923 19:50:28.238254 (+ 44925us) write_op.cc:270] Start()
0923 19:50:28.238284 (+ 30us) write_op.cc:276] Timestamp: P: 1790193017465510 usec, L: 0
0923 19:50:28.238449 (+ 165us) write_op.cc:270] Start()
0923 19:50:28.238474 (+ 25us) write_op.cc:276] Timestamp: P: 1790193017490504 usec, L: 0
0923 19:50:28.238658 (+ 184us) write_op.cc:270] Start()
0923 19:50:28.238684 (+ 26us) write_op.cc:276] Timestamp: P: 1790193017491186 usec, L: 0
0923 19:50:28.238846 (+ 162us) write_op.cc:270] Start()
0923 19:50:28.238870 (+ 24us) write_op.cc:276] Timestamp: P: 1790193017491797 usec, L: 0
0923 19:50:28.239044 (+ 174us) write_op.cc:270] Start()
0923 19:50:28.239081 (+ 37us) write_op.cc:276] Timestamp: P: 1790193017524163 usec, L: 0
0923 19:50:28.239229 (+ 148us) write_op.cc:270] Start()
0923 19:50:28.239252 (+ 23us) write_op.cc:276] Timestamp: P: 1790193017525955 usec, L: 0
0923 19:50:28.239411 (+ 159us) write_op.cc:270] Start()
0923 19:50:28.239434 (+ 23us) write_op.cc:276] Timestamp: P: 1790193017535553 usec, L: 0
0923 19:50:28.239639 (+ 205us) write_op.cc:270] Start()
0923 19:50:28.239664 (+ 25us) write_op.cc:276] Timestamp: P: 1790193017572437 usec, L: 0
0923 19:50:28.239818 (+ 154us) write_op.cc:270] Start()
0923 19:50:28.239841 (+ 23us) write_op.cc:276] Timestamp: P: 1790193017573131 usec, L: 0
0923 19:50:28.239989 (+ 148us) write_op.cc:270] Start()
0923 19:50:28.240012 (+ 23us) write_op.cc:276] Timestamp: P: 1790193017573775 usec, L: 0
0923 19:50:28.240172 (+ 160us) write_op.cc:270] Start()
0923 19:50:28.240196 (+ 24us) write_op.cc:276] Timestamp: P: 1790193017575691 usec, L: 0
0923 19:50:28.240352 (+ 156us) write_op.cc:270] Start()
0923 19:50:28.240374 (+ 22us) write_op.cc:276] Timestamp: P: 1790193017582079 usec, L: 0
0923 19:50:28.240521 (+ 147us) write_op.cc:270] Start()
0923 19:50:28.240545 (+ 24us) write_op.cc:276] Timestamp: P: 1790193017588173 usec, L: 0
0923 19:50:28.240689 (+ 144us) write_op.cc:270] Start()
0923 19:50:28.240712 (+ 23us) write_op.cc:276] Timestamp: P: 1790193017671045 usec, L: 0
0923 19:50:28.240911 (+ 199us) write_op.cc:270] Start()
0923 19:50:28.240934 (+ 23us) write_op.cc:276] Timestamp: P: 1790193017671730 usec, L: 0
0923 19:50:28.241080 (+ 146us) write_op.cc:270] Start()
0923 19:50:28.241101 (+ 21us) write_op.cc:276] Timestamp: P: 1790193017672293 usec, L: 0
0923 19:50:28.241286 (+ 185us) write_op.cc:270] Start()
0923 19:50:28.241312 (+ 26us) write_op.cc:276] Timestamp: P: 1790193017682585 usec, L: 0
0923 19:50:28.241468 (+ 156us) write_op.cc:270] Start()
0923 19:50:28.241492 (+ 24us) write_op.cc:276] Timestamp: P: 1790193017683209 usec, L: 0
0923 19:50:28.241630 (+ 138us) write_op.cc:270] Start()
0923 19:50:28.241653 (+ 23us) write_op.cc:276] Timestamp: P: 1790193017683818 usec, L: 0
0923 19:50:28.241827 (+ 174us) write_op.cc:270] Start()
0923 19:50:28.241850 (+ 23us) write_op.cc:276] Timestamp: P: 1790193017733865 usec, L: 0
0923 19:50:28.265727 (+ 23877us) write_op.cc:270] Start()
0923 19:50:28.265760 (+ 33us) write_op.cc:276] Timestamp: P: 1790193017735330 usec, L: 0
0923 19:50:28.265952 (+ 192us) write_op.cc:270] Start()
0923 19:50:28.265982 (+ 30us) write_op.cc:276] Timestamp: P: 1790193017736187 usec, L: 0
0923 19:50:28.266151 (+ 169us) write_op.cc:270] Start()
0923 19:50:28.266173 (+ 22us) write_op.cc:276] Timestamp: P: 1790193017736916 usec, L: 0
0923 19:50:28.266329 (+ 156us) write_op.cc:270] Start()
0923 19:50:28.266349 (+ 20us) write_op.cc:276] Timestamp: P: 1790193017737720 usec, L: 0
0923 19:50:28.268924 (+ 2575us) write_op.cc:270] Start()
0923 19:50:28.268955 (+ 31us) write_op.cc:276] Timestamp: P: 1790193017814902 usec, L: 0
0923 19:50:28.269181 (+ 226us) write_op.cc:270] Start()
0923 19:50:28.269205 (+ 24us) write_op.cc:276] Timestamp: P: 1790193017821164 usec, L: 0
0923 19:50:28.272187 (+ 2982us) write_op.cc:270] Start()
0923 19:50:28.272209 (+ 22us) write_op.cc:276] Timestamp: P: 1790193017824401 usec, L: 0
0923 19:50:28.272362 (+ 153us) write_op.cc:270] Start()
0923 19:50:28.272380 (+ 18us) write_op.cc:276] Timestamp: P: 1790193017944463 usec, L: 0
0923 19:50:28.272495 (+ 115us) write_op.cc:270] Start()
0923 19:50:28.272517 (+ 22us) write_op.cc:276] Timestamp: P: 1790193017968324 usec, L: 0
0923 19:50:28.272662 (+ 145us) write_op.cc:270] Start()
0923 19:50:28.272679 (+ 17us) write_op.cc:276] Timestamp: P: 1790193017971466 usec, L: 0
0923 19:50:28.272786 (+ 107us) write_op.cc:270] Start()
0923 19:50:28.272802 (+ 16us) write_op.cc:276] Timestamp: P: 1790193017987303 usec, L: 0
0923 19:50:28.272938 (+ 136us) write_op.cc:270] Start()
0923 19:50:28.272955 (+ 17us) write_op.cc:276] Timestamp: P: 1790193018015983 usec, L: 0
0923 19:50:28.273101 (+ 146us) write_op.cc:270] Start()
0923 19:50:28.273119 (+ 18us) write_op.cc:276] Timestamp: P: 1790193018017337 usec, L: 0
0923 19:50:28.273237 (+ 118us) write_op.cc:270] Start()
0923 19:50:28.273253 (+ 16us) write_op.cc:276] Timestamp: P: 1790193018067370 usec, L: 0
0923 19:50:28.273346 (+ 93us) write_op.cc:270] Start()
0923 19:50:28.273371 (+ 25us) write_op.cc:276] Timestamp: P: 1790193018068998 usec, L: 0
0923 19:50:28.273496 (+ 125us) write_op.cc:270] Start()
0923 19:50:28.273512 (+ 16us) write_op.cc:276] Timestamp: P: 1790193018098883 usec, L: 0
0923 19:50:28.273612 (+ 100us) write_op.cc:270] Start()
0923 19:50:28.273627 (+ 15us) write_op.cc:276] Timestamp: P: 1790193018107693 usec, L: 0
0923 19:50:28.273725 (+ 98us) write_op.cc:270] Start()
0923 19:50:28.273740 (+ 15us) write_op.cc:276] Timestamp: P: 1790193018110176 usec, L: 0
0923 19:50:28.273849 (+ 109us) write_op.cc:270] Start()
0923 19:50:28.273864 (+ 15us) write_op.cc:276] Timestamp: P: 1790193018118594 usec, L: 0
0923 19:50:28.274034 (+ 170us) write_op.cc:270] Start()
0923 19:50:28.274062 (+ 28us) write_op.cc:276] Timestamp: P: 1790193018121747 usec, L: 0
0923 19:50:28.274171 (+ 109us) write_op.cc:270] Start()
0923 19:50:28.274192 (+ 21us) write_op.cc:276] Timestamp: P: 1790193018122698 usec, L: 0
0923 19:50:28.274295 (+ 103us) write_op.cc:270] Start()
0923 19:50:28.274311 (+ 16us) write_op.cc:276] Timestamp: P: 1790193018123756 usec, L: 0
0923 19:50:28.274426 (+ 115us) write_op.cc:270] Start()
0923 19:50:28.274442 (+ 16us) write_op.cc:276] Timestamp: P: 1790193018127816 usec, L: 0
0923 19:50:28.274549 (+ 107us) write_op.cc:270] Start()
0923 19:50:28.274565 (+ 16us) write_op.cc:276] Timestamp: P: 1790193018162379 usec, L: 0
0923 19:50:28.274672 (+ 107us) write_op.cc:270] Start()
0923 19:50:28.274687 (+ 15us) write_op.cc:276] Timestamp: P: 1790193018164146 usec, L: 0
0923 19:50:28.274797 (+ 110us) write_op.cc:270] Start()
0923 19:50:28.274812 (+ 15us) write_op.cc:276] Timestamp: P: 1790193018177982 usec, L: 0
0923 19:50:28.274946 (+ 134us) write_op.cc:270] Start()
0923 19:50:28.274961 (+ 15us) write_op.cc:276] Timestamp: P: 1790193018186209 usec, L: 0
0923 19:50:28.275085 (+ 124us) write_op.cc:270] Start()
0923 19:50:28.275102 (+ 17us) write_op.cc:276] Timestamp: P: 1790193018192176 usec, L: 0
0923 19:50:28.275206 (+ 104us) write_op.cc:270] Start()
0923 19:50:28.275222 (+ 16us) write_op.cc:276] Timestamp: P: 1790193018209808 usec, L: 0
0923 19:50:28.275333 (+ 111us) write_op.cc:270] Start()
0923 19:50:28.275349 (+ 16us) write_op.cc:276] Timestamp: P: 1790193018215923 usec, L: 0
0923 19:50:28.275443 (+ 94us) write_op.cc:270] Start()
0923 19:50:28.275457 (+ 14us) write_op.cc:276] Timestamp: P: 1790193018216833 usec, L: 0
0923 19:50:28.275565 (+ 108us) write_op.cc:270] Start()
0923 19:50:28.275581 (+ 16us) write_op.cc:276] Timestamp: P: 1790193018231280 usec, L: 0
0923 19:50:28.275712 (+ 131us) write_op.cc:270] Start()
0923 19:50:28.275736 (+ 24us) write_op.cc:276] Timestamp: P: 1790193018243263 usec, L: 0
0923 19:50:28.276294 (+ 558us) write_op.cc:270] Start()
0923 19:50:28.276314 (+ 20us) write_op.cc:276] Timestamp: P: 1790193018256802 usec, L: 0
0923 19:50:28.276432 (+ 118us) write_op.cc:270] Start()
0923 19:50:28.276448 (+ 16us) write_op.cc:276] Timestamp: P: 1790193018257566 usec, L: 0
0923 19:50:28.276548 (+ 100us) write_op.cc:270] Start()
0923 19:50:28.276563 (+ 15us) write_op.cc:276] Timestamp: P: 1790193018261780 usec, L: 0
0923 19:50:28.292878 (+ 16315us) write_op.cc:270] Start()
0923 19:50:28.293007 (+ 129us) write_op.cc:276] Timestamp: P: 1790193018276073 usec, L: 0
0923 19:50:28.300946 (+ 7939us) write_op.cc:270] Start()
0923 19:50:28.301130 (+ 184us) write_op.cc:276] Timestamp: P: 1790193018277320 usec, L: 0
0923 19:50:28.301794 (+ 664us) write_op.cc:270] Start()
0923 19:50:28.301922 (+ 128us) write_op.cc:276] Timestamp: P: 1790193018330891 usec, L: 0
0923 19:50:28.303140 (+ 1218us) write_op.cc:270] Start()
0923 19:50:28.303165 (+ 25us) write_op.cc:276] Timestamp: P: 1790193018331547 usec, L: 0
0923 19:50:28.303786 (+ 621us) write_op.cc:270] Start()
0923 19:50:28.303809 (+ 23us) write_op.cc:276] Timestamp: P: 1790193018332085 usec, L: 0
0923 19:50:28.304365 (+ 556us) write_op.cc:270] Start()
0923 19:50:28.311143 (+ 6778us) spinlock_profiling.cc:243] Waited 874 us on lock 0x6190000dfe58. stack: 00007fadd80b8366 00007fadd80b8120 00007fadd70c234d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007fade56db70a 00007fade56e27ef 00007fade54568dc 00007fade540e34a 00007fade55cc6ee 00007fade559a3c7 00007fade554639f 00007fade554545e 00007fade4170f11 00007fade4190667
0923 19:50:28.311257 (+ 114us) write_op.cc:276] Timestamp: P: 1790193018332712 usec, L: 0
0923 19:50:28.311927 (+ 670us) write_op.cc:270] Start()
0923 19:50:28.312387 (+ 460us) write_op.cc:276] Timestamp: P: 1790193018370677 usec, L: 0
0923 19:50:28.313641 (+ 1254us) write_op.cc:270] Start()
0923 19:50:28.313755 (+ 114us) write_op.cc:276] Timestamp: P: 1790193018371353 usec, L: 0
0923 19:50:28.314380 (+ 625us) write_op.cc:270] Start()
0923 19:50:28.314494 (+ 114us) write_op.cc:276] Timestamp: P: 1790193018371861 usec, L: 0
0923 19:50:28.315588 (+ 1094us) write_op.cc:270] Start()
0923 19:50:28.315739 (+ 151us) write_op.cc:276] Timestamp: P: 1790193018372498 usec, L: 0
0923 19:50:28.323156 (+ 7417us) write_op.cc:270] Start()
0923 19:50:28.323188 (+ 32us) write_op.cc:276] Timestamp: P: 1790193018372985 usec, L: 0
0923 19:50:28.323359 (+ 171us) write_op.cc:270] Start()
0923 19:50:28.323409 (+ 50us) write_op.cc:276] Timestamp: P: 1790193018373862 usec, L: 0
0923 19:50:28.323569 (+ 160us) write_op.cc:270] Start()
0923 19:50:28.323587 (+ 18us) write_op.cc:276] Timestamp: P: 1790193018398442 usec, L: 0
0923 19:50:28.325323 (+ 1736us) write_op.cc:270] Start()
0923 19:50:28.325346 (+ 23us) write_op.cc:276] Timestamp: P: 1790193018437259 usec, L: 0
0923 19:50:28.325519 (+ 173us) write_op.cc:270] Start()
0923 19:50:28.325571 (+ 52us) write_op.cc:276] Timestamp: P: 1790193018456456 usec, L: 0
0923 19:50:28.325731 (+ 160us) write_op.cc:270] Start()
0923 19:50:28.325753 (+ 22us) write_op.cc:276] Timestamp: P: 1790193018466762 usec, L: 0
0923 19:50:28.325870 (+ 117us) write_op.cc:270] Start()
0923 19:50:28.325914 (+ 44us) write_op.cc:276] Timestamp: P: 1790193018468287 usec, L: 0
0923 19:50:28.326035 (+ 121us) write_op.cc:270] Start()
0923 19:50:28.326052 (+ 17us) write_op.cc:276] Timestamp: P: 1790193018482697 usec, L: 0
0923 19:50:28.326150 (+ 98us) write_op.cc:270] Start()
0923 19:50:28.326164 (+ 14us) write_op.cc:276] Timestamp: P: 1790193018492525 usec, L: 0
0923 19:50:28.326311 (+ 147us) write_op.cc:270] Start()
0923 19:50:28.326329 (+ 18us) write_op.cc:276] Timestamp: P: 1790193018508223 usec, L: 0
0923 19:50:28.333277 (+ 6948us) write_op.cc:270] Start()
0923 19:50:28.333301 (+ 24us) write_op.cc:276] Timestamp: P: 1790193018510634 usec, L: 0
0923 19:50:28.333448 (+ 147us) write_op.cc:270] Start()
0923 19:50:28.333480 (+ 32us) write_op.cc:276] Timestamp: P: 1790193018516879 usec, L: 0
0923 19:50:28.333629 (+ 149us) write_op.cc:270] Start()
0923 19:50:28.333648 (+ 19us) write_op.cc:276] Timestamp: P: 1790193018536239 usec, L: 0
0923 19:50:28.333782 (+ 134us) write_op.cc:270] Start()
0923 19:50:28.333801 (+ 19us) write_op.cc:276] Timestamp: P: 1790193018548778 usec, L: 0
0923 19:50:28.333936 (+ 135us) write_op.cc:270] Start()
0923 19:50:28.333953 (+ 17us) write_op.cc:276] Timestamp: P: 1790193018559406 usec, L: 0
0923 19:50:28.334077 (+ 124us) write_op.cc:270] Start()
0923 19:50:28.334093 (+ 16us) write_op.cc:276] Timestamp: P: 1790193018569646 usec, L: 0
0923 19:50:28.334202 (+ 109us) write_op.cc:270] Start()
0923 19:50:28.334219 (+ 17us) write_op.cc:276] Timestamp: P: 1790193018579086 usec, L: 0
0923 19:50:28.334375 (+ 156us) write_op.cc:270] Start()
0923 19:50:28.334397 (+ 22us) write_op.cc:276] Timestamp: P: 1790193018614314 usec, L: 0
0923 19:50:28.334555 (+ 158us) write_op.cc:270] Start()
0923 19:50:28.334575 (+ 20us) write_op.cc:276] Timestamp: P: 1790193018616599 usec, L: 0
0923 19:50:28.334695 (+ 120us) write_op.cc:270] Start()
0923 19:50:28.334730 (+ 35us) write_op.cc:276] Timestamp: P: 1790193018617130 usec, L: 0
0923 19:50:28.334859 (+ 129us) write_op.cc:270] Start()
0923 19:50:28.334878 (+ 19us) write_op.cc:276] Timestamp: P: 1790193018617691 usec, L: 0
0923 19:50:28.334998 (+ 120us) write_op.cc:270] Start()
0923 19:50:28.335016 (+ 18us) write_op.cc:276] Timestamp: P: 1790193018672679 usec, L: 0
0923 19:50:28.335131 (+ 115us) write_op.cc:270] Start()
0923 19:50:28.335149 (+ 18us) write_op.cc:276] Timestamp: P: 1790193018687108 usec, L: 0
0923 19:50:28.335310 (+ 161us) write_op.cc:270] Start()
0923 19:50:28.335330 (+ 20us) write_op.cc:276] Timestamp: P: 1790193018687654 usec, L: 0
0923 19:50:28.335495 (+ 165us) write_op.cc:270] Start()
0923 19:50:28.335515 (+ 20us) write_op.cc:276] Timestamp: P: 1790193018688128 usec, L: 0
0923 19:50:28.335640 (+ 125us) write_op.cc:270] Start()
0923 19:50:28.335658 (+ 18us) write_op.cc:276] Timestamp: P: 1790193018688592 usec, L: 0
0923 19:50:28.335781 (+ 123us) write_op.cc:270] Start()
0923 19:50:28.335800 (+ 19us) write_op.cc:276] Timestamp: P: 1790193018689068 usec, L: 0
0923 19:50:28.335927 (+ 127us) write_op.cc:270] Start()
0923 19:50:28.335947 (+ 20us) write_op.cc:276] Timestamp: P: 1790193018743417 usec, L: 0
0923 19:50:28.336078 (+ 131us) write_op.cc:270] Start()
0923 19:50:28.336096 (+ 18us) write_op.cc:276] Timestamp: P: 1790193018773345 usec, L: 0
0923 19:50:28.336231 (+ 135us) write_op.cc:270] Start()
0923 19:50:28.336250 (+ 19us) write_op.cc:276] Timestamp: P: 1790193018773954 usec, L: 0
0923 19:50:28.360061 (+ 23811us) write_op.cc:270] Start()
0923 19:50:28.360096 (+ 35us) write_op.cc:276] Timestamp: P: 1790193018805320 usec, L: 0
0923 19:50:28.360306 (+ 210us) write_op.cc:270] Start()
0923 19:50:28.360333 (+ 27us) write_op.cc:276] Timestamp: P: 1790193018806278 usec, L: 0
0923 19:50:28.360518 (+ 185us) write_op.cc:270] Start()
0923 19:50:28.360543 (+ 25us) write_op.cc:276] Timestamp: P: 1790193018806813 usec, L: 0
0923 19:50:28.360702 (+ 159us) write_op.cc:270] Start()
0923 19:50:28.360724 (+ 22us) write_op.cc:276] Timestamp: P: 1790193018862320 usec, L: 0
0923 19:50:28.360858 (+ 134us) write_op.cc:270] Start()
0923 19:50:28.360882 (+ 24us) write_op.cc:276] Timestamp: P: 1790193018880503 usec, L: 0
0923 19:50:28.367234 (+ 6352us) write_op.cc:270] Start()
0923 19:50:28.367263 (+ 29us) write_op.cc:276] Timestamp: P: 1790193018889535 usec, L: 0
0923 19:50:28.367443 (+ 180us) write_op.cc:270] Start()
0923 19:50:28.367477 (+ 34us) write_op.cc:276] Timestamp: P: 1790193018891321 usec, L: 0
0923 19:50:28.367624 (+ 147us) write_op.cc:270] Start()
0923 19:50:28.367643 (+ 19us) write_op.cc:276] Timestamp: P: 1790193018893686 usec, L: 0
0923 19:50:28.367749 (+ 106us) write_op.cc:270] Start()
0923 19:50:28.367765 (+ 16us) write_op.cc:276] Timestamp: P: 1790193018920512 usec, L: 0
0923 19:50:28.367859 (+ 94us) write_op.cc:270] Start()
0923 19:50:28.367874 (+ 15us) write_op.cc:276] Timestamp: P: 1790193018922044 usec, L: 0
0923 19:50:28.367975 (+ 101us) write_op.cc:270] Start()
0923 19:50:28.367991 (+ 16us) write_op.cc:276] Timestamp: P: 1790193018944436 usec, L: 0
0923 19:50:28.368105 (+ 114us) write_op.cc:270] Start()
0923 19:50:28.368121 (+ 16us) write_op.cc:276] Timestamp: P: 1790193018961896 usec, L: 0
0923 19:50:28.368259 (+ 138us) write_op.cc:270] Start()
0923 19:50:28.368280 (+ 21us) write_op.cc:276] Timestamp: P: 1790193018988265 usec, L: 0
0923 19:50:28.368425 (+ 145us) write_op.cc:270] Start()
0923 19:50:28.368442 (+ 17us) write_op.cc:276] Timestamp: P: 1790193018998703 usec, L: 0
0923 19:50:28.368568 (+ 126us) write_op.cc:270] Start()
0923 19:50:28.368584 (+ 16us) write_op.cc:276] Timestamp: P: 1790193019001751 usec, L: 0
0923 19:50:28.368695 (+ 111us) write_op.cc:270] Start()
0923 19:50:28.368711 (+ 16us) write_op.cc:276] Timestamp: P: 1790193019012100 usec, L: 0
0923 19:50:28.368820 (+ 109us) write_op.cc:270] Start()
0923 19:50:28.368834 (+ 14us) write_op.cc:276] Timestamp: P: 1790193019013459 usec, L: 0
0923 19:50:28.368945 (+ 111us) write_op.cc:270] Start()
0923 19:50:28.368961 (+ 16us) write_op.cc:276] Timestamp: P: 1790193019014402 usec, L: 0
0923 19:50:28.369068 (+ 107us) write_op.cc:270] Start()
0923 19:50:28.369082 (+ 14us) write_op.cc:276] Timestamp: P: 1790193019015128 usec, L: 0
0923 19:50:28.369172 (+ 90us) write_op.cc:270] Start()
0923 19:50:28.369187 (+ 15us) write_op.cc:276] Timestamp: P: 1790193019059212 usec, L: 0
0923 19:50:28.369319 (+ 132us) write_op.cc:270] Start()
0923 19:50:28.369340 (+ 21us) write_op.cc:276] Timestamp: P: 1790193019072448 usec, L: 0
0923 19:50:28.369485 (+ 145us) write_op.cc:270] Start()
0923 19:50:28.369516 (+ 31us) write_op.cc:276] Timestamp: P: 1790193019080586 usec, L: 0
0923 19:50:28.369678 (+ 162us) write_op.cc:270] Start()
0923 19:50:28.369700 (+ 22us) write_op.cc:276] Timestamp: P: 1790193019094593 usec, L: 0
0923 19:50:28.369825 (+ 125us) write_op.cc:270] Start()
0923 19:50:28.369844 (+ 19us) write_op.cc:276] Timestamp: P: 1790193019102333 usec, L: 0
0923 19:50:28.383035 (+ 13191us) write_op.cc:270] Start()
0923 19:50:28.383063 (+ 28us) write_op.cc:276] Timestamp: P: 1790193019121071 usec, L: 0
0923 19:50:28.383224 (+ 161us) write_op.cc:270] Start()
0923 19:50:28.383244 (+ 20us) write_op.cc:276] Timestamp: P: 1790193019134357 usec, L: 0
0923 19:50:28.383392 (+ 148us) write_op.cc:270] Start()
0923 19:50:28.383412 (+ 20us) write_op.cc:276] Timestamp: P: 1790193019136422 usec, L: 0
0923 19:50:28.383559 (+ 147us) write_op.cc:270] Start()
0923 19:50:28.383579 (+ 20us) write_op.cc:276] Timestamp: P: 1790193019142875 usec, L: 0
0923 19:50:28.383700 (+ 121us) write_op.cc:270] Start()
0923 19:50:28.383719 (+ 19us) write_op.cc:276] Timestamp: P: 1790193019150673 usec, L: 0
0923 19:50:28.383851 (+ 132us) write_op.cc:270] Start()
0923 19:50:28.383880 (+ 29us) write_op.cc:276] Timestamp: P: 1790193019171709 usec, L: 0
0923 19:50:28.384034 (+ 154us) write_op.cc:270] Start()
0923 19:50:28.384057 (+ 23us) write_op.cc:276] Timestamp: P: 1790193019192647 usec, L: 0
0923 19:50:28.384205 (+ 148us) write_op.cc:270] Start()
0923 19:50:28.384224 (+ 19us) write_op.cc:276] Timestamp: P: 1790193019205595 usec, L: 0
0923 19:50:28.384378 (+ 154us) write_op.cc:270] Start()
0923 19:50:28.384399 (+ 21us) write_op.cc:276] Timestamp: P: 1790193019224997 usec, L: 0
0923 19:50:28.384544 (+ 145us) write_op.cc:270] Start()
0923 19:50:28.384568 (+ 24us) write_op.cc:276] Timestamp: P: 1790193019234903 usec, L: 0
0923 19:50:28.384719 (+ 151us) write_op.cc:270] Start()
0923 19:50:28.384740 (+ 21us) write_op.cc:276] Timestamp: P: 1790193019254272 usec, L: 0
0923 19:50:28.384884 (+ 144us) write_op.cc:270] Start()
0923 19:50:28.384903 (+ 19us) write_op.cc:276] Timestamp: P: 1790193019264264 usec, L: 0
0923 19:50:28.385046 (+ 143us) write_op.cc:270] Start()
0923 19:50:28.385065 (+ 19us) write_op.cc:276] Timestamp: P: 1790193019293350 usec, L: 0
0923 19:50:28.385205 (+ 140us) write_op.cc:270] Start()
0923 19:50:28.385225 (+ 20us) write_op.cc:276] Timestamp: P: 1790193019305972 usec, L: 0
0923 19:50:28.385373 (+ 148us) write_op.cc:270] Sta
I20260923 19:50:29.812680 5796 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet cf64073cdde748bc8ed3ce7580a71160 (table default.Table_ec1f04b2e36247fa96e9591cb7ab7eff [id=662eb0a4f944445486929d42c5ebfd01]). Expected version 3 got 0
I20260923 19:50:29.814518 6454 tablet_bootstrap.cc:492] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:29.814673 6454 ts_tablet_manager.cc:1403] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.072s user 0.003s sys 0.000s
I20260923 19:50:29.815553 6454 raft_consensus.cc:359] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.815735 6454 raft_consensus.cc:385] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:29.815804 6454 raft_consensus.cc:740] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:29.816092 8181 raft_consensus.cc:515] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } }
I20260923 19:50:29.821182 5796 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet cf64073cdde748bc8ed3ce7580a71160 (table default.Table_ec1f04b2e36247fa96e9591cb7ab7eff [id=662eb0a4f944445486929d42c5ebfd01]). Expected version 3 got 0
I20260923 19:50:29.830406 5796 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet cf64073cdde748bc8ed3ce7580a71160 (table default.Table_ec1f04b2e36247fa96e9591cb7ab7eff [id=662eb0a4f944445486929d42c5ebfd01]). Expected version 3 got 0
I20260923 19:50:29.836925 6458 ts_tablet_manager.cc:1929] T 772ece5283a949408d849f6e56f5f17b P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:29.837247 6459 ts_tablet_manager.cc:1929] T 85d35ebef3c24a2e89233dd900b63513 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260923 19:50:29.837425 6459 log.cc:1199] T 85d35ebef3c24a2e89233dd900b63513 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/85d35ebef3c24a2e89233dd900b63513
I20260923 19:50:29.839365 6458 log.cc:1199] T 772ece5283a949408d849f6e56f5f17b P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/772ece5283a949408d849f6e56f5f17b
I20260923 19:50:29.839898 6458 ts_tablet_manager.cc:1950] T 772ece5283a949408d849f6e56f5f17b P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:29.841133 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1317) took 1172 ms. Trace:
I20260923 19:50:29.841104 5814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "009ffee03a4d41db84df9f450aa84562" candidate_term: 4 candidate_status { last_received { term: 3 index: 1599 } } ignore_live_leader: false dest_uuid: "83e97b26500048d0b75350a21a8ff96b" is_pre_election: true
I20260923 19:50:29.841732 6458 rpcz_store.cc:276] 0923 19:50:28.668519 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:28.668569 (+ 50us) service_pool.cc:224] Handling call
0923 19:50:29.794163 (+1125594us) ts_tablet_manager.cc:1151] Deleting tablet 772ece5283a949408d849f6e56f5f17b
0923 19:50:29.794174 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.802433 (+ 8259us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.836857 (+ 34424us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.841113 (+ 4256us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1124793}
I20260923 19:50:29.842653 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 772ece5283a949408d849f6e56f5f17b (table default.Table_f163b8d593ca45ecb37b794671a4bf8b [id=909921effa834834ae8eed17dfd21976]) successfully deleted
I20260923 19:50:29.843035 6458 tablet_replica.cc:333] T 37769256de33432697e9d4fb235f473f P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:29.843437 6458 raft_consensus.cc:2243] T 37769256de33432697e9d4fb235f473f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:29.843883 6458 raft_consensus.cc:2272] T 37769256de33432697e9d4fb235f473f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:29.844571 6458 ts_tablet_manager.cc:1916] T 37769256de33432697e9d4fb235f473f P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:29.846038 8181 leader_election.cc:290] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b3d628214a34b4fa3ca0c1abe422bae (127.5.143.254:37151), 83e97b26500048d0b75350a21a8ff96b (127.5.143.253:45285)
I20260923 19:50:29.851521 6456 tablet_bootstrap.cc:492] T 8b8a973b247343008a29d67dfa712a0b P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:29.851714 6456 ts_tablet_manager.cc:1403] T 8b8a973b247343008a29d67dfa712a0b P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.080s user 0.007s sys 0.010s
I20260923 19:50:29.852449 6456 raft_consensus.cc:359] T 8b8a973b247343008a29d67dfa712a0b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.852629 6456 raft_consensus.cc:385] T 8b8a973b247343008a29d67dfa712a0b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:29.852699 6456 raft_consensus.cc:740] T 8b8a973b247343008a29d67dfa712a0b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:29.853029 6456 consensus_queue.cc:260] T 8b8a973b247343008a29d67dfa712a0b P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.858784 8049 raft_consensus.cc:493] T 9756a1f8e23a436bb7c19c8cba7bdc05 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:29.858933 8049 raft_consensus.cc:515] T 9756a1f8e23a436bb7c19c8cba7bdc05 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.859546 8049 leader_election.cc:290] T 9756a1f8e23a436bb7c19c8cba7bdc05 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:29.865864 6456 ts_tablet_manager.cc:1434] T 8b8a973b247343008a29d67dfa712a0b P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260923 19:50:29.877499 6456 tablet_bootstrap.cc:492] T 4c6f9953649a43aa9a0edd78b7bd47a4 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:29.880214 6458 ts_tablet_manager.cc:1929] T 37769256de33432697e9d4fb235f473f P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:29.880782 6458 log.cc:1199] T 37769256de33432697e9d4fb235f473f P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/37769256de33432697e9d4fb235f473f
I20260923 19:50:29.881176 6458 ts_tablet_manager.cc:1950] T 37769256de33432697e9d4fb235f473f P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:29.839016 8055 raft_consensus.cc:493] T f8007918eca14c81947e5999fe13a705 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:29.881721 6458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60210 (request call id 1318) took 1140 ms. Trace:
I20260923 19:50:29.881699 8055 raft_consensus.cc:515] T f8007918eca14c81947e5999fe13a705 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.881855 6458 rpcz_store.cc:276] 0923 19:50:28.740856 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:28.740913 (+ 57us) service_pool.cc:224] Handling call
0923 19:50:29.842984 (+1102071us) ts_tablet_manager.cc:1151] Deleting tablet 37769256de33432697e9d4fb235f473f
0923 19:50:29.842994 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.849421 (+ 6427us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.880150 (+ 30729us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.881702 (+ 1552us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1101886}
I20260923 19:50:29.882504 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 37769256de33432697e9d4fb235f473f (table default.Table_59a69335b281437498cea78a9cb3fadb [id=ac71e26491774bcd93d004a319b086c8]) successfully deleted
I20260923 19:50:29.882553 8055 leader_election.cc:290] T f8007918eca14c81947e5999fe13a705 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:29.882674 8055 raft_consensus.cc:493] T 688bb1055ba94c2996cdfea6dea76416 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:29.882772 8055 raft_consensus.cc:515] T 688bb1055ba94c2996cdfea6dea76416 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.883273 8055 leader_election.cc:290] T 688bb1055ba94c2996cdfea6dea76416 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:29.850061 6454 consensus_queue.cc:260] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.884032 6454 ts_tablet_manager.cc:1434] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.069s user 0.002s sys 0.000s
W20260923 19:50:29.884138 6139 leader_election.cc:343] T f8007918eca14c81947e5999fe13a705 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: f8007918eca14c81947e5999fe13a705
W20260923 19:50:29.884519 6139 leader_election.cc:343] T 688bb1055ba94c2996cdfea6dea76416 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 688bb1055ba94c2996cdfea6dea76416
I20260923 19:50:29.884809 6458 tablet_replica.cc:333] T 4e69656e9fc941e19eb7de5c87bc9050 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:29.885035 6458 raft_consensus.cc:2243] T 4e69656e9fc941e19eb7de5c87bc9050 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:29.885214 6458 raft_consensus.cc:2272] T 4e69656e9fc941e19eb7de5c87bc9050 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:29.885854 6458 ts_tablet_manager.cc:1916] T 4e69656e9fc941e19eb7de5c87bc9050 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:29.886176 6454 tablet_bootstrap.cc:492] T 373d6442546d41e2b5567dfc92ae07b1 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:29.887748 6454 tablet_bootstrap.cc:654] T 373d6442546d41e2b5567dfc92ae07b1 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:29.889405 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9756a1f8e23a436bb7c19c8cba7bdc05" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:29.892657 6458 ts_tablet_manager.cc:1929] T 4e69656e9fc941e19eb7de5c87bc9050 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:29.893080 6458 log.cc:1199] T 4e69656e9fc941e19eb7de5c87bc9050 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/4e69656e9fc941e19eb7de5c87bc9050
I20260923 19:50:29.893358 6458 ts_tablet_manager.cc:1950] T 4e69656e9fc941e19eb7de5c87bc9050 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:29.837867 6459 ts_tablet_manager.cc:1950] T 85d35ebef3c24a2e89233dd900b63513 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:29.894340 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 4e69656e9fc941e19eb7de5c87bc9050 (table default.Table_454977731aee4768be1b7437bb41c1ba [id=1337273e913b43e797c0fb356ca5085b]) successfully deleted
I20260923 19:50:29.894677 6458 tablet_replica.cc:333] T 30fe07956e8940fcb7ba1e2e16ced463 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:29.894881 6458 raft_consensus.cc:2243] T 30fe07956e8940fcb7ba1e2e16ced463 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:29.895076 6458 raft_consensus.cc:2272] T 30fe07956e8940fcb7ba1e2e16ced463 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:29.895568 6458 ts_tablet_manager.cc:1916] T 30fe07956e8940fcb7ba1e2e16ced463 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:29.899180 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1230) took 2693 ms. Trace:
I20260923 19:50:29.899296 6459 rpcz_store.cc:276] 0923 19:50:27.205359 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:27.222519 (+ 17160us) service_pool.cc:224] Handling call
0923 19:50:29.742800 (+2520281us) ts_tablet_manager.cc:1151] Deleting tablet 85d35ebef3c24a2e89233dd900b63513
0923 19:50:29.748205 (+ 5405us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.833248 (+ 85043us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.837173 (+ 3925us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.899157 (+ 61984us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1280,"tablet-delete.queue_time_us":2519918}
I20260923 19:50:29.899861 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 85d35ebef3c24a2e89233dd900b63513 (table default.Table_7d891deab94f4132b4358c6e4dfd54af [id=da91b06e11c64bb0aaec37a0188b5586]) successfully deleted
W20260923 19:50:29.895848 6280 leader_election.cc:343] T 9756a1f8e23a436bb7c19c8cba7bdc05 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:29.900524 7429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "009ffee03a4d41db84df9f450aa84562" candidate_term: 4 candidate_status { last_received { term: 3 index: 1599 } } ignore_live_leader: false dest_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" is_pre_election: true
I20260923 19:50:29.898485 6456 tablet_bootstrap.cc:654] T 4c6f9953649a43aa9a0edd78b7bd47a4 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:29.901427 6621 leader_election.cc:304] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 009ffee03a4d41db84df9f450aa84562; no voters: 6b3d628214a34b4fa3ca0c1abe422bae, 83e97b26500048d0b75350a21a8ff96b
I20260923 19:50:29.901732 8181 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 009ffee03a4d41db84df9f450aa84562 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260923 19:50:29.910076 6459 tablet_replica.cc:333] T 26031fe469d046518cdd0f1e955e19d1 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:29.910399 6459 raft_consensus.cc:2243] T 26031fe469d046518cdd0f1e955e19d1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:29.911051 6459 raft_consensus.cc:2272] T 26031fe469d046518cdd0f1e955e19d1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:29.911633 6459 ts_tablet_manager.cc:1916] T 26031fe469d046518cdd0f1e955e19d1 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:29.914661 6454 tablet_bootstrap.cc:492] T 373d6442546d41e2b5567dfc92ae07b1 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:29.914799 6454 ts_tablet_manager.cc:1403] T 373d6442546d41e2b5567dfc92ae07b1 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.000s
I20260923 19:50:29.915526 6454 raft_consensus.cc:359] T 373d6442546d41e2b5567dfc92ae07b1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.915709 6454 raft_consensus.cc:385] T 373d6442546d41e2b5567dfc92ae07b1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:29.915762 6454 raft_consensus.cc:740] T 373d6442546d41e2b5567dfc92ae07b1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:29.915969 6454 consensus_queue.cc:260] T 373d6442546d41e2b5567dfc92ae07b1 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.918674 6458 ts_tablet_manager.cc:1929] T 30fe07956e8940fcb7ba1e2e16ced463 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:29.921063 6458 log.cc:1199] T 30fe07956e8940fcb7ba1e2e16ced463 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/30fe07956e8940fcb7ba1e2e16ced463
I20260923 19:50:29.921469 6458 ts_tablet_manager.cc:1950] T 30fe07956e8940fcb7ba1e2e16ced463 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:29.922354 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 30fe07956e8940fcb7ba1e2e16ced463 (table default.Table_b0aaf57c3ec9414f89529017165bc65b [id=84b65375453448aebd9bce135f58bd90]) successfully deleted
I20260923 19:50:29.922760 6458 tablet_replica.cc:333] T 1ea8f44ac03b4ad196725f871a615cdd P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:29.922981 6458 raft_consensus.cc:2243] T 1ea8f44ac03b4ad196725f871a615cdd P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:29.923192 6458 raft_consensus.cc:2272] T 1ea8f44ac03b4ad196725f871a615cdd P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:29.923786 6458 ts_tablet_manager.cc:1916] T 1ea8f44ac03b4ad196725f871a615cdd P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:29.923815 6454 ts_tablet_manager.cc:1434] T 373d6442546d41e2b5567dfc92ae07b1 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260923 19:50:29.926367 6454 tablet_bootstrap.cc:492] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:29.927117 6456 tablet_bootstrap.cc:492] T 4c6f9953649a43aa9a0edd78b7bd47a4 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:29.927253 6456 ts_tablet_manager.cc:1403] T 4c6f9953649a43aa9a0edd78b7bd47a4 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.050s user 0.007s sys 0.004s
I20260923 19:50:29.928050 6456 raft_consensus.cc:359] T 4c6f9953649a43aa9a0edd78b7bd47a4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.928390 6456 raft_consensus.cc:385] T 4c6f9953649a43aa9a0edd78b7bd47a4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:29.928455 6456 raft_consensus.cc:740] T 4c6f9953649a43aa9a0edd78b7bd47a4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:29.928702 6456 consensus_queue.cc:260] T 4c6f9953649a43aa9a0edd78b7bd47a4 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.934158 6454 tablet_bootstrap.cc:654] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:29.935132 5695 external_mini_cluster.cc:1721] Unable to check leaks on /tmp/dist-test-task5JtCX2/build/asan/bin/kudu pid 5972: Timed out: CheckLeaks RPC to 127.5.143.193:39887 timed out after 1.000s (SENT)
I20260923 19:50:29.935371 5695 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task5JtCX2/build/asan/bin/kudu with pid 5972
I20260923 19:50:29.935514 8191 raft_consensus.cc:493] T 373d6442546d41e2b5567dfc92ae07b1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:29.935648 8191 raft_consensus.cc:515] T 373d6442546d41e2b5567dfc92ae07b1 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.936295 8191 leader_election.cc:290] T 373d6442546d41e2b5567dfc92ae07b1 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:29.937269 8135 raft_consensus.cc:493] T 146a402ff29a4e0b834a9f270d61e21c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:29.937413 8135 raft_consensus.cc:515] T 146a402ff29a4e0b834a9f270d61e21c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:29.938330 6139 leader_election.cc:343] T 373d6442546d41e2b5567dfc92ae07b1 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 373d6442546d41e2b5567dfc92ae07b1
I20260923 19:50:29.940984 8135 leader_election.cc:290] T 146a402ff29a4e0b834a9f270d61e21c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:29.943019 6459 ts_tablet_manager.cc:1929] T 26031fe469d046518cdd0f1e955e19d1 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260923 19:50:29.943151 6459 log.cc:1199] T 26031fe469d046518cdd0f1e955e19d1 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/26031fe469d046518cdd0f1e955e19d1
I20260923 19:50:29.943554 6459 ts_tablet_manager.cc:1950] T 26031fe469d046518cdd0f1e955e19d1 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:29.943522 6458 ts_tablet_manager.cc:1929] T 1ea8f44ac03b4ad196725f871a615cdd P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:29.944363 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146a402ff29a4e0b834a9f270d61e21c" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:29.944555 6458 log.cc:1199] T 1ea8f44ac03b4ad196725f871a615cdd P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/1ea8f44ac03b4ad196725f871a615cdd
I20260923 19:50:29.944857 6458 ts_tablet_manager.cc:1950] T 1ea8f44ac03b4ad196725f871a615cdd P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:29.945562 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 1ea8f44ac03b4ad196725f871a615cdd (table default.Table_1fc9244b78694fdc9006399969d4f536 [id=56a9dcfc6ce14302ad8b4418f0bbddee]) successfully deleted
W20260923 19:50:29.946154 6280 leader_election.cc:343] T 146a402ff29a4e0b834a9f270d61e21c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:29.947310 6169 tablet_service.cc:1558] Processing DeleteTablet for tablet 373d6442546d41e2b5567dfc92ae07b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:19 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:29.947875 6458 tablet_replica.cc:333] T a83726da349c4cd1852e956c8fa2cda5 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:29.948063 6458 raft_consensus.cc:2243] T a83726da349c4cd1852e956c8fa2cda5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:29.948217 6458 raft_consensus.cc:2272] T a83726da349c4cd1852e956c8fa2cda5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:29.948824 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c6f9953649a43aa9a0edd78b7bd47a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:29.950151 6456 ts_tablet_manager.cc:1434] T 4c6f9953649a43aa9a0edd78b7bd47a4 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.023s user 0.001s sys 0.001s
I20260923 19:50:29.950944 6458 ts_tablet_manager.cc:1916] T a83726da349c4cd1852e956c8fa2cda5 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:29.959329 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1237) took 2584 ms. Trace:
I20260923 19:50:29.959549 6459 rpcz_store.cc:276] 0923 19:50:27.374635 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:27.375002 (+ 367us) service_pool.cc:224] Handling call
0923 19:50:29.910010 (+2535008us) ts_tablet_manager.cc:1151] Deleting tablet 26031fe469d046518cdd0f1e955e19d1
0923 19:50:29.910023 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.934534 (+ 24511us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.942948 (+ 8414us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.959302 (+ 16354us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2412036}
I20260923 19:50:29.960111 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1257) took 2150 ms. Trace:
I20260923 19:50:29.960183 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 26031fe469d046518cdd0f1e955e19d1 (table default.Table_d6a453784ebd47b9b8c169ab766d6c23 [id=82cba3f0e2f64118a0747fe6ff9bc796]) successfully deleted
I20260923 19:50:29.960268 6459 rpcz_store.cc:276] 0923 19:50:27.810038 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:27.810113 (+ 75us) service_pool.cc:224] Handling call
0923 19:50:29.959972 (+2149859us) ts_tablet_manager.cc:1151] Deleting tablet e8b0d0a8e4e54ec195893127f7a76bed
0923 19:50:29.959985 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.960093 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2149682}
I20260923 19:50:29.960655 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1258) took 2150 ms. Trace:
W20260923 19:50:29.960759 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet e8b0d0a8e4e54ec195893127f7a76bed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e8b0d0a8e4e54ec195893127f7a76bed already in progress: creating tablet
I20260923 19:50:29.960731 6459 rpcz_store.cc:276] 0923 19:50:27.810564 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:27.810658 (+ 94us) service_pool.cc:224] Handling call
0923 19:50:29.960550 (+2149892us) ts_tablet_manager.cc:1151] Deleting tablet fb44c10b4f6148738306c617aac88b43
0923 19:50:29.960561 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.960640 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2149759}
I20260923 19:50:29.960819 6458 ts_tablet_manager.cc:1929] T a83726da349c4cd1852e956c8fa2cda5 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:29.960928 6458 log.cc:1199] T a83726da349c4cd1852e956c8fa2cda5 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/a83726da349c4cd1852e956c8fa2cda5
I20260923 19:50:29.961069 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1259) took 2150 ms. Trace:
I20260923 19:50:29.961139 6459 rpcz_store.cc:276] 0923 19:50:27.811064 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:27.811147 (+ 83us) service_pool.cc:224] Handling call
0923 19:50:29.960975 (+2149828us) ts_tablet_manager.cc:1151] Deleting tablet 039419cd51504cf2af724d92cbaa8858
0923 19:50:29.960985 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.961055 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2149685}
I20260923 19:50:29.961231 6458 ts_tablet_manager.cc:1950] T a83726da349c4cd1852e956c8fa2cda5 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:29.961464 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1260) took 2149 ms. Trace:
I20260923 19:50:29.961556 6459 rpcz_store.cc:276] 0923 19:50:27.811632 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:27.811720 (+ 88us) service_pool.cc:224] Handling call
0923 19:50:29.961362 (+2149642us) ts_tablet_manager.cc:1151] Deleting tablet d525bdd4c25843c988865553bd2b3066
0923 19:50:29.961372 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.961449 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2149499}
I20260923 19:50:29.961913 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1261) took 2149 ms. Trace:
W20260923 19:50:29.962008 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet fb44c10b4f6148738306c617aac88b43 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb44c10b4f6148738306c617aac88b43 already in progress: creating tablet
I20260923 19:50:29.961987 6459 rpcz_store.cc:276] 0923 19:50:27.812481 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:27.812607 (+ 126us) service_pool.cc:224] Handling call
0923 19:50:29.961774 (+2149167us) ts_tablet_manager.cc:1151] Deleting tablet db943a36b2fe4ca9813e08ddb38ce7f6
0923 19:50:29.961783 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.961862 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2149017}
W20260923 19:50:29.962206 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 039419cd51504cf2af724d92cbaa8858 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 039419cd51504cf2af724d92cbaa8858 already in progress: creating tablet
I20260923 19:50:29.962260 6459 tablet_replica.cc:333] T f8052b05169b4673b387ac8b716ffc4e P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:29.962380 6456 tablet_bootstrap.cc:492] T ebc288d8d453481592df11cd1bfed3ac P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
W20260923 19:50:29.962401 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet d525bdd4c25843c988865553bd2b3066 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d525bdd4c25843c988865553bd2b3066 already in progress: creating tablet
I20260923 19:50:29.962459 6459 raft_consensus.cc:2243] T f8052b05169b4673b387ac8b716ffc4e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:29.962644 6459 raft_consensus.cc:2272] T f8052b05169b4673b387ac8b716ffc4e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:29.962970 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet db943a36b2fe4ca9813e08ddb38ce7f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db943a36b2fe4ca9813e08ddb38ce7f6 already in progress: creating tablet
I20260923 19:50:29.963218 6459 ts_tablet_manager.cc:1916] T f8052b05169b4673b387ac8b716ffc4e P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:29.966967 6456 tablet_bootstrap.cc:654] T ebc288d8d453481592df11cd1bfed3ac P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:29.975808 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet a83726da349c4cd1852e956c8fa2cda5 (table default.Table_ab816e7937ae4627a7a13c8e091caf19 [id=114c61097627471983e4bec86709dc5e]) successfully deleted
I20260923 19:50:29.978101 6458 tablet_replica.cc:333] T 9756a1f8e23a436bb7c19c8cba7bdc05 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:29.978406 6458 raft_consensus.cc:2243] T 9756a1f8e23a436bb7c19c8cba7bdc05 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:29.978611 6454 tablet_bootstrap.cc:492] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:29.978611 6458 raft_consensus.cc:2272] T 9756a1f8e23a436bb7c19c8cba7bdc05 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:29.978744 6454 ts_tablet_manager.cc:1403] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.052s user 0.008s sys 0.002s
I20260923 19:50:29.979135 6458 ts_tablet_manager.cc:1916] T 9756a1f8e23a436bb7c19c8cba7bdc05 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:29.979473 6454 raft_consensus.cc:359] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.979646 6454 raft_consensus.cc:385] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:29.979692 6454 raft_consensus.cc:740] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:29.979897 6454 consensus_queue.cc:260] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.980360 6454 ts_tablet_manager.cc:1434] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:29.980669 6454 tablet_bootstrap.cc:492] T 30fe07956e8940fcb7ba1e2e16ced463 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:29.988344 6456 tablet_bootstrap.cc:492] T ebc288d8d453481592df11cd1bfed3ac P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:29.988543 6456 ts_tablet_manager.cc:1403] T ebc288d8d453481592df11cd1bfed3ac P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.004s
I20260923 19:50:29.989295 6456 raft_consensus.cc:359] T ebc288d8d453481592df11cd1bfed3ac P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.989477 6456 raft_consensus.cc:385] T ebc288d8d453481592df11cd1bfed3ac P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:29.989544 6456 raft_consensus.cc:740] T ebc288d8d453481592df11cd1bfed3ac P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:29.989766 6456 consensus_queue.cc:260] T ebc288d8d453481592df11cd1bfed3ac P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.990268 6456 ts_tablet_manager.cc:1434] T ebc288d8d453481592df11cd1bfed3ac P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:50:29.990974 6454 tablet_bootstrap.cc:654] T 30fe07956e8940fcb7ba1e2e16ced463 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:29.991736 8191 raft_consensus.cc:493] T cb11d6e082784ad98cfb5253dbb88707 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:29.992304 8191 raft_consensus.cc:515] T cb11d6e082784ad98cfb5253dbb88707 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
W20260923 19:50:29.992811 6280 consensus_peers.cc:597] T 7f47efa0cabd47aa8ed0deface7763ab P 2bf41435f70447f19992d368ca6b46bd -> Peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Couldn't send request to peer 61022dd7f2f14dc19aebe3af5f08f430. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:29.993005 8191 leader_election.cc:290] T cb11d6e082784ad98cfb5253dbb88707 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:29.995010 5796 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet a6da9b3eea4547c9bb80b08bd26c5dc2 (table default.Table_52abb1a930aa442b9fb361345d7da76f [id=8996d40848d44ed09261ee25d61bb906]). Expected version 1 got 0
I20260923 19:50:29.995157 8135 raft_consensus.cc:493] T 195d4fe5f92e4e2c9330dce34c303723 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:29.995280 8135 raft_consensus.cc:515] T 195d4fe5f92e4e2c9330dce34c303723 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:29.995800 8135 leader_election.cc:290] T 195d4fe5f92e4e2c9330dce34c303723 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:29.996166 8191 raft_consensus.cc:493] T 9ee02922d2be45f5a1473a53a6f253c4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:29.996280 8191 raft_consensus.cc:515] T 9ee02922d2be45f5a1473a53a6f253c4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:29.996683 6459 ts_tablet_manager.cc:1929] T f8052b05169b4673b387ac8b716ffc4e P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:29.996778 6459 log.cc:1199] T f8052b05169b4673b387ac8b716ffc4e P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/f8052b05169b4673b387ac8b716ffc4e
I20260923 19:50:29.996876 8191 leader_election.cc:290] T 9ee02922d2be45f5a1473a53a6f253c4 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:29.997117 6459 ts_tablet_manager.cc:1950] T f8052b05169b4673b387ac8b716ffc4e P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:29.998170 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1262) took 2153 ms. Trace:
I20260923 19:50:29.998253 6459 rpcz_store.cc:276] 0923 19:50:27.844222 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:27.884266 (+ 40044us) service_pool.cc:224] Handling call
0923 19:50:29.962209 (+2077943us) ts_tablet_manager.cc:1151] Deleting tablet f8052b05169b4673b387ac8b716ffc4e
0923 19:50:29.962221 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.977972 (+ 15751us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.996629 (+ 18657us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:29.998151 (+ 1522us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2077757}
I20260923 19:50:29.998706 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1264) took 1971 ms. Trace:
I20260923 19:50:29.998816 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet f8052b05169b4673b387ac8b716ffc4e (table default.Table_a9e7f8c6300f47c7ba79e2dbe36d7849 [id=8bac5d4f5c9c41f7b121d81382633a49]) successfully deleted
I20260923 19:50:29.998796 6459 rpcz_store.cc:276] 0923 19:50:28.027682 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:28.027733 (+ 51us) service_pool.cc:224] Handling call
0923 19:50:29.998539 (+1970806us) ts_tablet_manager.cc:1151] Deleting tablet f0915e6df24f42b3b8b1a558b7ebc7ff
0923 19:50:29.998550 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:29.998688 (+ 138us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1970589}
I20260923 19:50:29.999094 6459 tablet_replica.cc:333] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
W20260923 19:50:29.999258 6139 leader_election.cc:343] T cb11d6e082784ad98cfb5253dbb88707 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: cb11d6e082784ad98cfb5253dbb88707
I20260923 19:50:29.999269 6459 raft_consensus.cc:2243] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:29.999816 6459 raft_consensus.cc:2272] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:29.999819 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet f0915e6df24f42b3b8b1a558b7ebc7ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0915e6df24f42b3b8b1a558b7ebc7ff already in progress: creating tablet
W20260923 19:50:30.000069 6139 leader_election.cc:343] T 9ee02922d2be45f5a1473a53a6f253c4 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 9ee02922d2be45f5a1473a53a6f253c4
I20260923 19:50:30.000370 6459 ts_tablet_manager.cc:1916] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:30.000881 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195d4fe5f92e4e2c9330dce34c303723" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:30.001396 6280 leader_election.cc:343] T 195d4fe5f92e4e2c9330dce34c303723 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:30.003743 6458 ts_tablet_manager.cc:1929] T 9756a1f8e23a436bb7c19c8cba7bdc05 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:30.003834 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet ebc288d8d453481592df11cd1bfed3ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:30.003844 6458 log.cc:1199] T 9756a1f8e23a436bb7c19c8cba7bdc05 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/9756a1f8e23a436bb7c19c8cba7bdc05
I20260923 19:50:30.010927 6458 ts_tablet_manager.cc:1950] T 9756a1f8e23a436bb7c19c8cba7bdc05 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:30.011665 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 9756a1f8e23a436bb7c19c8cba7bdc05 (table default.Table_5d0c2a71e15a41e9a3200d2f16a36e16 [id=b76b9d93e83c4d80aba61d3aebcca78d]) successfully deleted
I20260923 19:50:30.013832 6458 tablet_replica.cc:333] T d2dd611746d741e88b6911bf5d51f3e5 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:30.014532 6458 raft_consensus.cc:2243] T d2dd611746d741e88b6911bf5d51f3e5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:30.014709 6458 raft_consensus.cc:2272] T d2dd611746d741e88b6911bf5d51f3e5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:30.015484 6456 tablet_bootstrap.cc:492] T 14c917ac93fd436aa13fb0839fae883f P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:30.017704 6200 raft_consensus.cc:3060] T a263c0fc71424999b76ef01de9a51eda P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:30.018770 6456 tablet_bootstrap.cc:654] T 14c917ac93fd436aa13fb0839fae883f P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:30.018745 6458 ts_tablet_manager.cc:1916] T d2dd611746d741e88b6911bf5d51f3e5 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:30.021270 8135 consensus_queue.cc:1048] T a263c0fc71424999b76ef01de9a51eda P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:30.023766 6454 tablet_bootstrap.cc:492] T 30fe07956e8940fcb7ba1e2e16ced463 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:30.023934 6454 ts_tablet_manager.cc:1403] T 30fe07956e8940fcb7ba1e2e16ced463 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.043s user 0.006s sys 0.002s
I20260923 19:50:30.024988 6454 raft_consensus.cc:359] T 30fe07956e8940fcb7ba1e2e16ced463 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:30.025230 6454 raft_consensus.cc:385] T 30fe07956e8940fcb7ba1e2e16ced463 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:30.025285 6454 raft_consensus.cc:740] T 30fe07956e8940fcb7ba1e2e16ced463 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:30.025641 6454 consensus_queue.cc:260] T 30fe07956e8940fcb7ba1e2e16ced463 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:30.026360 6459 ts_tablet_manager.cc:1929] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:30.026827 6459 log.cc:1199] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/d3f7b33bbf3f453e8e841ee5d99c5b31
I20260923 19:50:30.027330 6459 ts_tablet_manager.cc:1950] T d3f7b33bbf3f453e8e841ee5d99c5b31 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:30.028223 6458 ts_tablet_manager.cc:1929] T d2dd611746d741e88b6911bf5d51f3e5 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:30.028337 6458 log.cc:1199] T d2dd611746d741e88b6911bf5d51f3e5 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/d2dd611746d741e88b6911bf5d51f3e5
I20260923 19:50:30.026414 6454 ts_tablet_manager.cc:1434] T 30fe07956e8940fcb7ba1e2e16ced463 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260923 19:50:30.028604 6458 ts_tablet_manager.cc:1950] T d2dd611746d741e88b6911bf5d51f3e5 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:30.028759 6454 tablet_bootstrap.cc:492] T 772ece5283a949408d849f6e56f5f17b P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:30.030484 6454 tablet_bootstrap.cc:654] T 772ece5283a949408d849f6e56f5f17b P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:30.032939 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1263) took 2005 ms. Trace:
I20260923 19:50:30.033262 6459 rpcz_store.cc:276] 0923 19:50:28.027541 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:28.027739 (+ 198us) service_pool.cc:224] Handling call
0923 19:50:29.999046 (+1971307us) ts_tablet_manager.cc:1151] Deleting tablet d3f7b33bbf3f453e8e841ee5d99c5b31
0923 19:50:29.999059 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:30.015048 (+ 15989us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:30.026304 (+ 11256us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:30.032912 (+ 6608us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1970747}
I20260923 19:50:30.033823 6454 tablet_bootstrap.cc:492] T 772ece5283a949408d849f6e56f5f17b P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:30.033980 6454 ts_tablet_manager.cc:1403] T 772ece5283a949408d849f6e56f5f17b P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260923 19:50:30.034003 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet d3f7b33bbf3f453e8e841ee5d99c5b31 (table default.Table_8e3f5612c14448349fdc0fddeaead3d0 [id=57c63647576148739ad66655548492ce]) successfully deleted
I20260923 19:50:30.034359 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1265) took 1969 ms. Trace:
I20260923 19:50:30.034698 6459 rpcz_store.cc:276] 0923 19:50:28.065371 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:28.066740 (+ 1369us) service_pool.cc:224] Handling call
0923 19:50:30.034228 (+1967488us) ts_tablet_manager.cc:1151] Deleting tablet 907bfabdc1f948d4872363b44bea154a
0923 19:50:30.034241 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:30.034343 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1967154}
I20260923 19:50:30.035009 6454 raft_consensus.cc:359] T 772ece5283a949408d849f6e56f5f17b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
W20260923 19:50:30.035318 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 907bfabdc1f948d4872363b44bea154a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 907bfabdc1f948d4872363b44bea154a already in progress: creating tablet
I20260923 19:50:30.035490 6454 raft_consensus.cc:385] T 772ece5283a949408d849f6e56f5f17b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:30.035583 6454 raft_consensus.cc:740] T 772ece5283a949408d849f6e56f5f17b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:30.035701 6459 tablet_replica.cc:333] T c5cb76fa5e084604aa58bf888cfe4852 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:30.035810 6454 consensus_queue.cc:260] T 772ece5283a949408d849f6e56f5f17b P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:30.036166 6459 raft_consensus.cc:2243] T c5cb76fa5e084604aa58bf888cfe4852 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:30.036636 6459 raft_consensus.cc:2272] T c5cb76fa5e084604aa58bf888cfe4852 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:30.037312 6459 ts_tablet_manager.cc:1916] T c5cb76fa5e084604aa58bf888cfe4852 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:30.038777 6456 tablet_bootstrap.cc:492] T 14c917ac93fd436aa13fb0839fae883f P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:30.038992 6456 ts_tablet_manager.cc:1403] T 14c917ac93fd436aa13fb0839fae883f P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.003s
I20260923 19:50:30.040220 6456 raft_consensus.cc:359] T 14c917ac93fd436aa13fb0839fae883f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.040421 6456 raft_consensus.cc:385] T 14c917ac93fd436aa13fb0839fae883f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:30.040491 6456 raft_consensus.cc:740] T 14c917ac93fd436aa13fb0839fae883f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:30.040956 6456 consensus_queue.cc:260] T 14c917ac93fd436aa13fb0839fae883f P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.041464 6456 ts_tablet_manager.cc:1434] T 14c917ac93fd436aa13fb0839fae883f P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:30.041834 6454 ts_tablet_manager.cc:1434] T 772ece5283a949408d849f6e56f5f17b P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260923 19:50:30.041918 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet d2dd611746d741e88b6911bf5d51f3e5 (table default.Table_462ef67f5c8445bb919cdd9a35d15cff [id=bb4d2afeaf104e949d52cced351b3bea]) successfully deleted
I20260923 19:50:30.047842 6454 tablet_bootstrap.cc:492] T 3acf4a03174f45d5aee9c9b1454784f8 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:30.050482 6454 tablet_bootstrap.cc:654] T 3acf4a03174f45d5aee9c9b1454784f8 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:30.050504 5796 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet a263c0fc71424999b76ef01de9a51eda (table default.Table_634d169330774b228dacd2343d35d4e9 [id=59963339362940748a99a3ff36c31bbd]). Expected version 1 got 0
I20260923 19:50:30.051391 6458 tablet_replica.cc:333] T 431ad4da27544d68aa5666293984a86a P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:30.051607 6458 raft_consensus.cc:2243] T 431ad4da27544d68aa5666293984a86a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:30.051759 6458 raft_consensus.cc:2272] T 431ad4da27544d68aa5666293984a86a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:30.052548 6458 ts_tablet_manager.cc:1916] T 431ad4da27544d68aa5666293984a86a P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:30.058995 6456 tablet_bootstrap.cc:492] T 2bc47336948746d694d5a896730c501c P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:30.059631 6458 ts_tablet_manager.cc:1929] T 431ad4da27544d68aa5666293984a86a P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:30.059755 6458 log.cc:1199] T 431ad4da27544d68aa5666293984a86a P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/431ad4da27544d68aa5666293984a86a
I20260923 19:50:30.060087 6458 ts_tablet_manager.cc:1950] T 431ad4da27544d68aa5666293984a86a P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:30.060791 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 431ad4da27544d68aa5666293984a86a (table default.Table_e980698a75d14d24afdd616fa2118c72 [id=0fc34fcbffe446c693df52715ddbe9e8]) successfully deleted
I20260923 19:50:30.066606 6456 tablet_bootstrap.cc:654] T 2bc47336948746d694d5a896730c501c P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:30.070724 6169 tablet_service.cc:1558] Processing DeleteTablet for tablet 772ece5283a949408d849f6e56f5f17b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:30.071110 6169 tablet_service.cc:1558] Processing DeleteTablet for tablet 30fe07956e8940fcb7ba1e2e16ced463 with delete_type TABLET_DATA_DELETED (replaced by tablet 2ed8d49f1b3d4bee80b1822df2a7f495) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:30.075683 8135 raft_consensus.cc:493] T 8b8a973b247343008a29d67dfa712a0b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:30.075838 8135 raft_consensus.cc:515] T 8b8a973b247343008a29d67dfa712a0b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.076382 8135 leader_election.cc:290] T 8b8a973b247343008a29d67dfa712a0b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:30.077224 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8a973b247343008a29d67dfa712a0b" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:30.080542 6280 leader_election.cc:343] T 8b8a973b247343008a29d67dfa712a0b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:30.080963 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet 14c917ac93fd436aa13fb0839fae883f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:08 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:30.081452 6456 tablet_bootstrap.cc:492] T 2bc47336948746d694d5a896730c501c P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:30.081593 6456 ts_tablet_manager.cc:1403] T 2bc47336948746d694d5a896730c501c P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.023s user 0.006s sys 0.000s
I20260923 19:50:30.082348 6456 raft_consensus.cc:359] T 2bc47336948746d694d5a896730c501c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.082556 6456 raft_consensus.cc:385] T 2bc47336948746d694d5a896730c501c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:30.082621 6456 raft_consensus.cc:740] T 2bc47336948746d694d5a896730c501c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:30.082809 6456 consensus_queue.cc:260] T 2bc47336948746d694d5a896730c501c P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.083259 6456 ts_tablet_manager.cc:1434] T 2bc47336948746d694d5a896730c501c P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:50:30.087651 8049 raft_consensus.cc:493] T 14c917ac93fd436aa13fb0839fae883f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:30.087805 8049 raft_consensus.cc:515] T 14c917ac93fd436aa13fb0839fae883f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.088390 8049 leader_election.cc:290] T 14c917ac93fd436aa13fb0839fae883f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:30.090407 6199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c917ac93fd436aa13fb0839fae883f" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:30.092832 6456 tablet_bootstrap.cc:492] T 12bda2ae961446bea2f34e792f4f1706 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
W20260923 19:50:30.094697 6280 leader_election.cc:343] T 14c917ac93fd436aa13fb0839fae883f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:30.095170 6456 tablet_bootstrap.cc:654] T 12bda2ae961446bea2f34e792f4f1706 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:30.099641 6458 tablet_replica.cc:333] T cf0caa6afcf546678c233a9333b77a2a P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:30.099951 6458 raft_consensus.cc:2243] T cf0caa6afcf546678c233a9333b77a2a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:30.100170 6458 raft_consensus.cc:2272] T cf0caa6afcf546678c233a9333b77a2a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:30.101063 6458 ts_tablet_manager.cc:1916] T cf0caa6afcf546678c233a9333b77a2a P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:30.101788 8191 raft_consensus.cc:493] T 772ece5283a949408d849f6e56f5f17b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:30.101989 8191 raft_consensus.cc:515] T 772ece5283a949408d849f6e56f5f17b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:30.102689 8191 leader_election.cc:290] T 772ece5283a949408d849f6e56f5f17b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:30.103719 6139 leader_election.cc:343] T 772ece5283a949408d849f6e56f5f17b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 772ece5283a949408d849f6e56f5f17b
I20260923 19:50:30.108191 6456 tablet_bootstrap.cc:492] T 12bda2ae961446bea2f34e792f4f1706 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:30.108357 6456 ts_tablet_manager.cc:1403] T 12bda2ae961446bea2f34e792f4f1706 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.000s
I20260923 19:50:30.108426 5798 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 2bc47336948746d694d5a896730c501c (table default.Table_4aba50515e344158b08d4c2afc6cae77 [id=ae53e002c7f0400ab80f8d83a958e1b2]). Expected version 2 got 0
I20260923 19:50:30.109210 6456 raft_consensus.cc:359] T 12bda2ae961446bea2f34e792f4f1706 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.109385 6456 raft_consensus.cc:385] T 12bda2ae961446bea2f34e792f4f1706 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:30.109447 6456 raft_consensus.cc:740] T 12bda2ae961446bea2f34e792f4f1706 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:30.109663 6456 consensus_queue.cc:260] T 12bda2ae961446bea2f34e792f4f1706 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.110180 6456 ts_tablet_manager.cc:1434] T 12bda2ae961446bea2f34e792f4f1706 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:50:30.110496 6456 tablet_bootstrap.cc:492] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:30.117749 6456 tablet_bootstrap.cc:654] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:30.123807 6458 ts_tablet_manager.cc:1929] T cf0caa6afcf546678c233a9333b77a2a P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:30.124467 6454 tablet_bootstrap.cc:492] T 3acf4a03174f45d5aee9c9b1454784f8 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:30.124620 6454 ts_tablet_manager.cc:1403] T 3acf4a03174f45d5aee9c9b1454784f8 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.077s user 0.013s sys 0.012s
I20260923 19:50:30.125309 6454 raft_consensus.cc:359] T 3acf4a03174f45d5aee9c9b1454784f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:30.125470 6454 raft_consensus.cc:385] T 3acf4a03174f45d5aee9c9b1454784f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:30.125530 6454 raft_consensus.cc:740] T 3acf4a03174f45d5aee9c9b1454784f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:30.125751 6454 consensus_queue.cc:260] T 3acf4a03174f45d5aee9c9b1454784f8 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:30.126312 6454 ts_tablet_manager.cc:1434] T 3acf4a03174f45d5aee9c9b1454784f8 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260923 19:50:30.126643 6458 log.cc:1199] T cf0caa6afcf546678c233a9333b77a2a P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/cf0caa6afcf546678c233a9333b77a2a
I20260923 19:50:30.127039 6458 ts_tablet_manager.cc:1950] T cf0caa6afcf546678c233a9333b77a2a P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:30.127149 6454 tablet_bootstrap.cc:492] T 37769256de33432697e9d4fb235f473f P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:30.127946 6458 tablet_replica.cc:333] T 146a402ff29a4e0b834a9f270d61e21c P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:30.128168 6458 raft_consensus.cc:2243] T 146a402ff29a4e0b834a9f270d61e21c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:30.128309 6458 raft_consensus.cc:2272] T 146a402ff29a4e0b834a9f270d61e21c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:30.129036 6458 ts_tablet_manager.cc:1916] T 146a402ff29a4e0b834a9f270d61e21c P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:30.129243 6454 tablet_bootstrap.cc:654] T 37769256de33432697e9d4fb235f473f P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:30.141019 8055 raft_consensus.cc:493] T 85f5ba9097674f9d889e178eaea4f0d7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:30.141188 8055 raft_consensus.cc:515] T 85f5ba9097674f9d889e178eaea4f0d7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:30.141839 8055 leader_election.cc:290] T 85f5ba9097674f9d889e178eaea4f0d7 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:30.143390 6139 leader_election.cc:343] T 85f5ba9097674f9d889e178eaea4f0d7 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 85f5ba9097674f9d889e178eaea4f0d7
W20260923 19:50:30.143841 6139 consensus_peers.cc:597] T 3c713a0973dc45debf61c228a4bf13bf P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Couldn't send request to peer 2bf41435f70447f19992d368ca6b46bd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3c713a0973dc45debf61c228a4bf13bf. This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:30.147691 6200 raft_consensus.cc:3060] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:30.130134 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet cf0caa6afcf546678c233a9333b77a2a (table default.Table_232922d4519b432994b66a52cd54123c [id=f465f2caf6544a0ab7eda8fe4a377572]) successfully deleted
W20260923 19:50:30.156373 6279 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260923 19:50:30.159368 5796 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 12bda2ae961446bea2f34e792f4f1706 (table default.Table_89c60db74742422086b6dcf76932a865 [id=2d69a962a7234afeb8366c66555b91e1]). Expected version 3 got 0
I20260923 19:50:30.164328 5798 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet a263c0fc71424999b76ef01de9a51eda (table default.Table_634d169330774b228dacd2343d35d4e9 [id=59963339362940748a99a3ff36c31bbd]). Expected version 1 got 0
I20260923 19:50:30.166039 8135 consensus_queue.cc:1048] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 2bf41435f70447f19992d368ca6b46bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 19:50:30.190168 6458 ts_tablet_manager.cc:1929] T 146a402ff29a4e0b834a9f270d61e21c P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:30.190321 6458 log.cc:1199] T 146a402ff29a4e0b834a9f270d61e21c P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/146a402ff29a4e0b834a9f270d61e21c
I20260923 19:50:30.190711 6458 ts_tablet_manager.cc:1950] T 146a402ff29a4e0b834a9f270d61e21c P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:30.191672 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 146a402ff29a4e0b834a9f270d61e21c (table default.Table_605d43f9448e4b4bb429f8bf52d6ac55 [id=834c18797d8e48a79c45628c5180b80b]) successfully deleted
I20260923 19:50:30.197373 8135 raft_consensus.cc:493] T f28da30d48454ffd9626df789a2f2063 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:30.197556 8135 raft_consensus.cc:515] T f28da30d48454ffd9626df789a2f2063 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.198314 8135 leader_election.cc:290] T f28da30d48454ffd9626df789a2f2063 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:30.200718 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f28da30d48454ffd9626df789a2f2063" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:30.201332 6280 leader_election.cc:343] T f28da30d48454ffd9626df789a2f2063 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:30.204677 6459 ts_tablet_manager.cc:1929] T c5cb76fa5e084604aa58bf888cfe4852 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:30.218495 6459 log.cc:1199] T c5cb76fa5e084604aa58bf888cfe4852 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/c5cb76fa5e084604aa58bf888cfe4852
I20260923 19:50:30.219002 6459 ts_tablet_manager.cc:1950] T c5cb76fa5e084604aa58bf888cfe4852 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:30.224386 6458 tablet_replica.cc:333] T 4c6f9953649a43aa9a0edd78b7bd47a4 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:30.224622 6458 raft_consensus.cc:2243] T 4c6f9953649a43aa9a0edd78b7bd47a4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:30.224783 6458 raft_consensus.cc:2272] T 4c6f9953649a43aa9a0edd78b7bd47a4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:30.228310 5796 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet a263c0fc71424999b76ef01de9a51eda (table default.Table_634d169330774b228dacd2343d35d4e9 [id=59963339362940748a99a3ff36c31bbd]). Expected version 1 got 0
W20260923 19:50:30.229485 5789 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 5ccef781d8a84ff298051f5da709fe85 (table default.Table_25e9e9791fc94c6d84574e2c38243187 [id=9010037126534b3e8c350cfaae97b9e7], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 5ccef781d8a84ff298051f5da709fe85 consensus state has no leader
I20260923 19:50:30.230441 6456 tablet_bootstrap.cc:492] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:30.230572 6456 ts_tablet_manager.cc:1403] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.120s user 0.024s sys 0.017s
I20260923 19:50:30.231266 6456 raft_consensus.cc:359] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.231438 6456 raft_consensus.cc:385] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:30.231487 6456 raft_consensus.cc:740] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:30.231678 6456 consensus_queue.cc:260] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.232131 6456 ts_tablet_manager.cc:1434] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260923 19:50:30.232432 6456 tablet_bootstrap.cc:492] T 839bcf991b754f9e95a1dd6c4f826e71 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:30.236038 6456 tablet_bootstrap.cc:654] T 839bcf991b754f9e95a1dd6c4f826e71 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:30.243280 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet b6ef90ddd7a34dfdb8309d0e1c3688e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:30.243878 6458 ts_tablet_manager.cc:1916] T 4c6f9953649a43aa9a0edd78b7bd47a4 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:30.245239 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1266) took 2170 ms. Trace:
I20260923 19:50:30.245345 6459 rpcz_store.cc:276] 0923 19:50:28.075255 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:28.076112 (+ 857us) service_pool.cc:224] Handling call
0923 19:50:30.035528 (+1959416us) ts_tablet_manager.cc:1151] Deleting tablet c5cb76fa5e084604aa58bf888cfe4852
0923 19:50:30.035538 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:30.116366 (+ 80828us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:30.204615 (+ 88249us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:30.245220 (+ 40605us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1959064}
I20260923 19:50:30.245733 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet c5cb76fa5e084604aa58bf888cfe4852 (table default.Table_1a74b652ec7a4165b28643c452000d6d [id=74399f12686743ebbd14943c316be210]) successfully deleted
I20260923 19:50:30.251965 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1267) took 2156 ms. Trace:
I20260923 19:50:30.252138 6459 rpcz_store.cc:276] 0923 19:50:28.095279 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:28.095357 (+ 78us) service_pool.cc:224] Handling call
0923 19:50:30.245610 (+2150253us) ts_tablet_manager.cc:1151] Deleting tablet 9968ab539c9149e98aa5326c208ce140
0923 19:50:30.251822 (+ 6212us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:30.251942 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2149856}
I20260923 19:50:30.252534 6459 tablet_replica.cc:333] T 2852e91ccd0c44b3b16f8189e57575d7 P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
W20260923 19:50:30.252702 5791 catalog_manager.cc:5043] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): delete failed for tablet 9968ab539c9149e98aa5326c208ce140 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9968ab539c9149e98aa5326c208ce140 already in progress: creating tablet
I20260923 19:50:30.252761 6459 raft_consensus.cc:2243] T 2852e91ccd0c44b3b16f8189e57575d7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:30.252925 6459 raft_consensus.cc:2272] T 2852e91ccd0c44b3b16f8189e57575d7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:30.253491 6459 ts_tablet_manager.cc:1916] T 2852e91ccd0c44b3b16f8189e57575d7 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:30.255775 6456 tablet_bootstrap.cc:492] T 839bcf991b754f9e95a1dd6c4f826e71 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:30.255929 6456 ts_tablet_manager.cc:1403] T 839bcf991b754f9e95a1dd6c4f826e71 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.024s user 0.006s sys 0.000s
I20260923 19:50:30.256662 6456 raft_consensus.cc:359] T 839bcf991b754f9e95a1dd6c4f826e71 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.256830 6456 raft_consensus.cc:385] T 839bcf991b754f9e95a1dd6c4f826e71 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:30.256971 6456 raft_consensus.cc:740] T 839bcf991b754f9e95a1dd6c4f826e71 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:30.257187 6456 consensus_queue.cc:260] T 839bcf991b754f9e95a1dd6c4f826e71 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.257654 6456 ts_tablet_manager.cc:1434] T 839bcf991b754f9e95a1dd6c4f826e71 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:50:30.262530 6456 tablet_bootstrap.cc:492] T d5d3f96ebf1c4d05aceb06ef53737e4f P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:30.268203 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet 839bcf991b754f9e95a1dd6c4f826e71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:10 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:30.278935 6456 tablet_bootstrap.cc:654] T d5d3f96ebf1c4d05aceb06ef53737e4f P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:30.284823 6459 ts_tablet_manager.cc:1929] T 2852e91ccd0c44b3b16f8189e57575d7 P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:30.284994 6459 log.cc:1199] T 2852e91ccd0c44b3b16f8189e57575d7 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/2852e91ccd0c44b3b16f8189e57575d7
I20260923 19:50:30.294610 6454 tablet_bootstrap.cc:492] T 37769256de33432697e9d4fb235f473f P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:30.294782 6454 ts_tablet_manager.cc:1403] T 37769256de33432697e9d4fb235f473f P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.168s user 0.028s sys 0.067s
I20260923 19:50:30.295548 6454 raft_consensus.cc:359] T 37769256de33432697e9d4fb235f473f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.295892 6454 raft_consensus.cc:385] T 37769256de33432697e9d4fb235f473f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:30.295969 6454 raft_consensus.cc:740] T 37769256de33432697e9d4fb235f473f P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:30.296190 6454 consensus_queue.cc:260] T 37769256de33432697e9d4fb235f473f P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.296845 6454 ts_tablet_manager.cc:1434] T 37769256de33432697e9d4fb235f473f P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:30.297555 6454 tablet_bootstrap.cc:492] T 0f90406b20f54787bd27255d5ae81d1c P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:30.299659 6454 tablet_bootstrap.cc:654] T 0f90406b20f54787bd27255d5ae81d1c P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:30.300271 6456 tablet_bootstrap.cc:492] T d5d3f96ebf1c4d05aceb06ef53737e4f P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:30.300472 6456 ts_tablet_manager.cc:1403] T d5d3f96ebf1c4d05aceb06ef53737e4f P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.038s user 0.001s sys 0.004s
I20260923 19:50:30.301239 6456 raft_consensus.cc:359] T d5d3f96ebf1c4d05aceb06ef53737e4f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.301460 6456 raft_consensus.cc:385] T d5d3f96ebf1c4d05aceb06ef53737e4f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:30.307468 6169 tablet_service.cc:1558] Processing DeleteTablet for tablet 37769256de33432697e9d4fb235f473f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:17 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:30.307876 6454 tablet_bootstrap.cc:492] T 0f90406b20f54787bd27255d5ae81d1c P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:30.308040 6454 ts_tablet_manager.cc:1403] T 0f90406b20f54787bd27255d5ae81d1c P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.002s
I20260923 19:50:30.309132 6454 raft_consensus.cc:359] T 0f90406b20f54787bd27255d5ae81d1c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:30.309288 6454 raft_consensus.cc:385] T 0f90406b20f54787bd27255d5ae81d1c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:30.309329 6454 raft_consensus.cc:740] T 0f90406b20f54787bd27255d5ae81d1c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:30.309525 6454 consensus_queue.cc:260] T 0f90406b20f54787bd27255d5ae81d1c P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:30.310104 6454 ts_tablet_manager.cc:1434] T 0f90406b20f54787bd27255d5ae81d1c P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:30.310493 6454 tablet_bootstrap.cc:492] T 7f47efa0cabd47aa8ed0deface7763ab P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:30.312196 6454 tablet_bootstrap.cc:654] T 7f47efa0cabd47aa8ed0deface7763ab P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:30.306708 6456 raft_consensus.cc:740] T d5d3f96ebf1c4d05aceb06ef53737e4f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:30.312708 6456 consensus_queue.cc:260] T d5d3f96ebf1c4d05aceb06ef53737e4f P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.313316 6456 ts_tablet_manager.cc:1434] T d5d3f96ebf1c4d05aceb06ef53737e4f P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260923 19:50:30.316766 6456 tablet_bootstrap.cc:492] T c013c07fd27a46f29a464d73fe752e10 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:30.318578 6456 tablet_bootstrap.cc:654] T c013c07fd27a46f29a464d73fe752e10 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:30.322619 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet d5d3f96ebf1c4d05aceb06ef53737e4f with delete_type TABLET_DATA_DELETED (replaced by tablet 7595c09be8784a948027dd923c4b023e) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:30.326140 5798 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 0f90406b20f54787bd27255d5ae81d1c (table default.Table_8aad9ce166cb40659479e35cbcbf1d88 [id=cec162ada3144aaba98196d363cf587d]). Expected version 1 got 0
I20260923 19:50:30.335541 6454 tablet_bootstrap.cc:492] T 7f47efa0cabd47aa8ed0deface7763ab P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:30.335707 6454 ts_tablet_manager.cc:1403] T 7f47efa0cabd47aa8ed0deface7763ab P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.007s
I20260923 19:50:30.336470 6456 tablet_bootstrap.cc:492] T c013c07fd27a46f29a464d73fe752e10 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:30.336505 6454 raft_consensus.cc:359] T 7f47efa0cabd47aa8ed0deface7763ab P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.336673 6454 raft_consensus.cc:385] T 7f47efa0cabd47aa8ed0deface7763ab P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:30.336733 6454 raft_consensus.cc:740] T 7f47efa0cabd47aa8ed0deface7763ab P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:30.336872 6456 ts_tablet_manager.cc:1403] T c013c07fd27a46f29a464d73fe752e10 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.001s
I20260923 19:50:30.336941 6454 consensus_queue.cc:260] T 7f47efa0cabd47aa8ed0deface7763ab P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.337608 6454 ts_tablet_manager.cc:1434] T 7f47efa0cabd47aa8ed0deface7763ab P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:30.338418 6456 raft_consensus.cc:359] T c013c07fd27a46f29a464d73fe752e10 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.338652 6456 raft_consensus.cc:385] T c013c07fd27a46f29a464d73fe752e10 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:30.338969 6454 tablet_bootstrap.cc:492] T 559f3e3016aa470f9732a727b4528586 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:30.338742 6456 raft_consensus.cc:740] T c013c07fd27a46f29a464d73fe752e10 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:30.341523 6456 consensus_queue.cc:260] T c013c07fd27a46f29a464d73fe752e10 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.342062 6456 ts_tablet_manager.cc:1434] T c013c07fd27a46f29a464d73fe752e10 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260923 19:50:30.344219 6458 ts_tablet_manager.cc:1929] T 4c6f9953649a43aa9a0edd78b7bd47a4 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:30.344380 6458 log.cc:1199] T 4c6f9953649a43aa9a0edd78b7bd47a4 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/4c6f9953649a43aa9a0edd78b7bd47a4
I20260923 19:50:30.344784 6458 ts_tablet_manager.cc:1950] T 4c6f9953649a43aa9a0edd78b7bd47a4 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:30.346796 6456 tablet_bootstrap.cc:492] T 3a4b9d48f02a4372adce6d9eb80935f6 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:30.348682 5802 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet c013c07fd27a46f29a464d73fe752e10 (table default.Table_d6b7dd3e3841487bb83baf44aa4b24eb [id=57e6db69771648aa8952d2385f25ad45]). Expected version 1 got 0
I20260923 19:50:30.349072 6456 tablet_bootstrap.cc:654] T 3a4b9d48f02a4372adce6d9eb80935f6 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:30.351173 6454 tablet_bootstrap.cc:654] T 559f3e3016aa470f9732a727b4528586 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:30.357864 5798 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 7f47efa0cabd47aa8ed0deface7763ab (table default.Table_f57f8cacbedb49c6be509b51c824b960 [id=ada5cc6ef65b4859bf027fd3af9ad0f2]). Expected version 2 got 0
I20260923 19:50:30.361109 6458 tablet_replica.cc:333] T ebc288d8d453481592df11cd1bfed3ac P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:30.361475 6458 raft_consensus.cc:2243] T ebc288d8d453481592df11cd1bfed3ac P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:30.363247 6458 raft_consensus.cc:2272] T ebc288d8d453481592df11cd1bfed3ac P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:30.365564 6458 ts_tablet_manager.cc:1916] T ebc288d8d453481592df11cd1bfed3ac P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:30.358938 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 4c6f9953649a43aa9a0edd78b7bd47a4 (table default.Table_dc4eebd8c2d34e1b988008ab9b783cff [id=dda3ef495bce4b87bf1429ed45b3e194]) successfully deleted
I20260923 19:50:30.371270 8049 raft_consensus.cc:493] T c013c07fd27a46f29a464d73fe752e10 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:30.371582 8049 raft_consensus.cc:515] T c013c07fd27a46f29a464d73fe752e10 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.372579 8049 leader_election.cc:290] T c013c07fd27a46f29a464d73fe752e10 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:30.373863 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c013c07fd27a46f29a464d73fe752e10" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:30.374723 6280 leader_election.cc:343] T c013c07fd27a46f29a464d73fe752e10 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:30.380715 6456 tablet_bootstrap.cc:492] T 3a4b9d48f02a4372adce6d9eb80935f6 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:30.380868 6456 ts_tablet_manager.cc:1403] T 3a4b9d48f02a4372adce6d9eb80935f6 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.034s user 0.016s sys 0.000s
I20260923 19:50:30.381614 6456 raft_consensus.cc:359] T 3a4b9d48f02a4372adce6d9eb80935f6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.381780 6456 raft_consensus.cc:385] T 3a4b9d48f02a4372adce6d9eb80935f6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:30.381831 6456 raft_consensus.cc:740] T 3a4b9d48f02a4372adce6d9eb80935f6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:30.382050 6456 consensus_queue.cc:260] T 3a4b9d48f02a4372adce6d9eb80935f6 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.383967 5796 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 7f47efa0cabd47aa8ed0deface7763ab (table default.Table_f57f8cacbedb49c6be509b51c824b960 [id=ada5cc6ef65b4859bf027fd3af9ad0f2]). Expected version 2 got 0
I20260923 19:50:30.392179 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a4b9d48f02a4372adce6d9eb80935f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:16 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:30.393288 6456 ts_tablet_manager.cc:1434] T 3a4b9d48f02a4372adce6d9eb80935f6 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260923 19:50:30.400662 6456 tablet_bootstrap.cc:492] T a367cf3788ef49148a5c8d6864f71d8e P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:30.403046 6456 tablet_bootstrap.cc:654] T a367cf3788ef49148a5c8d6864f71d8e P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:30.404857 6454 tablet_bootstrap.cc:492] T 559f3e3016aa470f9732a727b4528586 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:30.405092 6454 ts_tablet_manager.cc:1403] T 559f3e3016aa470f9732a727b4528586 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.066s user 0.015s sys 0.019s
I20260923 19:50:30.405804 6454 raft_consensus.cc:359] T 559f3e3016aa470f9732a727b4528586 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:30.406082 6454 raft_consensus.cc:385] T 559f3e3016aa470f9732a727b4528586 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:30.406180 6454 raft_consensus.cc:740] T 559f3e3016aa470f9732a727b4528586 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:30.406548 6454 consensus_queue.cc:260] T 559f3e3016aa470f9732a727b4528586 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:30.407239 6454 ts_tablet_manager.cc:1434] T 559f3e3016aa470f9732a727b4528586 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:30.408345 6454 tablet_bootstrap.cc:492] T 664d849daee54b02b7b7e2bb340d92fa P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:30.415211 6169 tablet_service.cc:1558] Processing DeleteTablet for tablet 559f3e3016aa470f9732a727b4528586 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:60148
I20260923 19:50:30.416643 6454 tablet_bootstrap.cc:654] T 664d849daee54b02b7b7e2bb340d92fa P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:30.419512 6456 tablet_bootstrap.cc:492] T a367cf3788ef49148a5c8d6864f71d8e P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:30.419664 6456 ts_tablet_manager.cc:1403] T a367cf3788ef49148a5c8d6864f71d8e P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.001s
I20260923 19:50:30.420399 6456 raft_consensus.cc:359] T a367cf3788ef49148a5c8d6864f71d8e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.420548 6456 raft_consensus.cc:385] T a367cf3788ef49148a5c8d6864f71d8e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:30.420598 6456 raft_consensus.cc:740] T a367cf3788ef49148a5c8d6864f71d8e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:30.420859 6456 consensus_queue.cc:260] T a367cf3788ef49148a5c8d6864f71d8e P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.424940 6456 ts_tablet_manager.cc:1434] T a367cf3788ef49148a5c8d6864f71d8e P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260923 19:50:30.425228 6456 tablet_bootstrap.cc:492] T 18a31ed6bea444e7888f374927f90a60 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:30.426793 6456 tablet_bootstrap.cc:654] T 18a31ed6bea444e7888f374927f90a60 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:30.428545 5796 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet a367cf3788ef49148a5c8d6864f71d8e (table default.Table_da05e9879e314fd78f1b40a857a393fb [id=d3b60b7fc1d84a46aa49932d5c3363ea]). Expected version 6 got 0
I20260923 19:50:30.434649 5796 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet a367cf3788ef49148a5c8d6864f71d8e (table default.Table_da05e9879e314fd78f1b40a857a393fb [id=d3b60b7fc1d84a46aa49932d5c3363ea]). Expected version 6 got 0
I20260923 19:50:30.438251 6454 tablet_bootstrap.cc:492] T 664d849daee54b02b7b7e2bb340d92fa P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:30.438449 6454 ts_tablet_manager.cc:1403] T 664d849daee54b02b7b7e2bb340d92fa P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.030s user 0.005s sys 0.003s
I20260923 19:50:30.439122 6454 raft_consensus.cc:359] T 664d849daee54b02b7b7e2bb340d92fa P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.439352 6454 raft_consensus.cc:385] T 664d849daee54b02b7b7e2bb340d92fa P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:30.439440 6454 raft_consensus.cc:740] T 664d849daee54b02b7b7e2bb340d92fa P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:30.439714 6454 consensus_queue.cc:260] T 664d849daee54b02b7b7e2bb340d92fa P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.444548 6458 ts_tablet_manager.cc:1929] T ebc288d8d453481592df11cd1bfed3ac P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:30.444741 6458 log.cc:1199] T ebc288d8d453481592df11cd1bfed3ac P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/ebc288d8d453481592df11cd1bfed3ac
I20260923 19:50:30.445103 6458 ts_tablet_manager.cc:1950] T ebc288d8d453481592df11cd1bfed3ac P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:30.446225 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet ebc288d8d453481592df11cd1bfed3ac (table default.Table_a0bee41bcb2d439fb8619a6c19152813 [id=8a710c10b5ca42548116d743cb0812c3]) successfully deleted
I20260923 19:50:30.446635 6458 tablet_replica.cc:333] T 14c917ac93fd436aa13fb0839fae883f P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:30.447065 6458 raft_consensus.cc:2243] T 14c917ac93fd436aa13fb0839fae883f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:30.447288 6458 raft_consensus.cc:2272] T 14c917ac93fd436aa13fb0839fae883f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:30.447814 5796 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 664d849daee54b02b7b7e2bb340d92fa (table default.Table_5462319331504a0b829c0181aa5b0cd6 [id=3a747074a6a04ddbb009b135c67c25b0]). Expected version 1 got 0
I20260923 19:50:30.448272 6458 ts_tablet_manager.cc:1916] T 14c917ac93fd436aa13fb0839fae883f P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:30.450533 6454 ts_tablet_manager.cc:1434] T 664d849daee54b02b7b7e2bb340d92fa P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260923 19:50:30.450943 6456 tablet_bootstrap.cc:492] T 18a31ed6bea444e7888f374927f90a60 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:30.451197 6456 ts_tablet_manager.cc:1403] T 18a31ed6bea444e7888f374927f90a60 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.026s user 0.000s sys 0.008s
I20260923 19:50:30.451910 6456 raft_consensus.cc:359] T 18a31ed6bea444e7888f374927f90a60 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.452059 6456 raft_consensus.cc:385] T 18a31ed6bea444e7888f374927f90a60 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:30.452100 6456 raft_consensus.cc:740] T 18a31ed6bea444e7888f374927f90a60 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:30.456463 6459 ts_tablet_manager.cc:1950] T 2852e91ccd0c44b3b16f8189e57575d7 P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:30.459555 6456 consensus_queue.cc:260] T 18a31ed6bea444e7888f374927f90a60 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.463052 6456 ts_tablet_manager.cc:1434] T 18a31ed6bea444e7888f374927f90a60 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260923 19:50:30.466770 5796 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 664d849daee54b02b7b7e2bb340d92fa (table default.Table_5462319331504a0b829c0181aa5b0cd6 [id=3a747074a6a04ddbb009b135c67c25b0]). Expected version 1 got 0
I20260923 19:50:30.468166 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet 18a31ed6bea444e7888f374927f90a60 with delete_type TABLET_DATA_DELETED (replaced by tablet ca73c91b58954537af373face5ad2f67) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:30.469615 8191 raft_consensus.cc:493] T 0f90406b20f54787bd27255d5ae81d1c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:30.468732 6454 tablet_bootstrap.cc:492] T 195d4fe5f92e4e2c9330dce34c303723 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:30.469745 8191 raft_consensus.cc:515] T 0f90406b20f54787bd27255d5ae81d1c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:30.470566 8191 leader_election.cc:290] T 0f90406b20f54787bd27255d5ae81d1c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:30.471215 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f90406b20f54787bd27255d5ae81d1c" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:30.471397 6454 tablet_bootstrap.cc:654] T 195d4fe5f92e4e2c9330dce34c303723 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:30.471505 6341 raft_consensus.cc:2393] T 0f90406b20f54787bd27255d5ae81d1c P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61022dd7f2f14dc19aebe3af5f08f430 in current term 1: Already voted for candidate e546f660e7e541d1aa9ae38e5ee5b9c0 in this term.
I20260923 19:50:30.472469 6456 tablet_bootstrap.cc:492] T 8b4c2a0ae64841c6971a0840c1d5b739 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:30.472784 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1268) took 2244 ms. Trace:
I20260923 19:50:30.472862 6459 rpcz_store.cc:276] 0923 19:50:28.227973 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:28.228172 (+ 199us) service_pool.cc:224] Handling call
0923 19:50:30.252492 (+2024320us) ts_tablet_manager.cc:1151] Deleting tablet 2852e91ccd0c44b3b16f8189e57575d7
0923 19:50:30.252502 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:30.280678 (+ 28176us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:30.284745 (+ 4067us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:30.472765 (+188020us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2024101}
I20260923 19:50:30.473196 6459 tablet_replica.cc:333] T ba639d8c68cf49a49a5ec5729143cf6b P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:30.473384 6459 raft_consensus.cc:2243] T ba639d8c68cf49a49a5ec5729143cf6b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:30.473517 6459 raft_consensus.cc:2272] T ba639d8c68cf49a49a5ec5729143cf6b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:30.473923 6456 tablet_bootstrap.cc:654] T 8b4c2a0ae64841c6971a0840c1d5b739 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:30.474030 6459 ts_tablet_manager.cc:1916] T ba639d8c68cf49a49a5ec5729143cf6b P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:30.474805 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet 2852e91ccd0c44b3b16f8189e57575d7 (table default.Table_63a3afc2f4ac454cb8bb6551ba17376c [id=5a6519f52d71406bac54e12459ef85a3]) successfully deleted
W20260923 19:50:30.489547 7345 connection.cc:573] server connection from 127.5.143.193:44673 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260923 19:50:30.490056 6137 connection.cc:573] client connection to 127.5.143.193:39887 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260923 19:50:30.490213 6137 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 19:50:30.490603 6456 tablet_bootstrap.cc:492] T 8b4c2a0ae64841c6971a0840c1d5b739 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:30.490792 6456 ts_tablet_manager.cc:1403] T 8b4c2a0ae64841c6971a0840c1d5b739 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.001s
I20260923 19:50:30.491696 6456 raft_consensus.cc:359] T 8b4c2a0ae64841c6971a0840c1d5b739 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.491922 6456 raft_consensus.cc:385] T 8b4c2a0ae64841c6971a0840c1d5b739 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:30.492036 6456 raft_consensus.cc:740] T 8b4c2a0ae64841c6971a0840c1d5b739 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:30.492337 6456 consensus_queue.cc:260] T 8b4c2a0ae64841c6971a0840c1d5b739 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.492960 6456 ts_tablet_manager.cc:1434] T 8b4c2a0ae64841c6971a0840c1d5b739 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:50:30.493316 6456 tablet_bootstrap.cc:492] T 17a105f389d041dbb0bf8b828f990d27 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:30.495260 6456 tablet_bootstrap.cc:654] T 17a105f389d041dbb0bf8b828f990d27 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:30.499037 6458 ts_tablet_manager.cc:1929] T 14c917ac93fd436aa13fb0839fae883f P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:30.499142 6458 log.cc:1199] T 14c917ac93fd436aa13fb0839fae883f P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/14c917ac93fd436aa13fb0839fae883f
I20260923 19:50:30.500243 6454 tablet_bootstrap.cc:492] T 195d4fe5f92e4e2c9330dce34c303723 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:30.500265 6458 ts_tablet_manager.cc:1950] T 14c917ac93fd436aa13fb0839fae883f P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:30.500360 6454 ts_tablet_manager.cc:1403] T 195d4fe5f92e4e2c9330dce34c303723 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.032s user 0.001s sys 0.003s
I20260923 19:50:30.501031 6454 raft_consensus.cc:359] T 195d4fe5f92e4e2c9330dce34c303723 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.501210 6454 raft_consensus.cc:385] T 195d4fe5f92e4e2c9330dce34c303723 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:30.501260 6454 raft_consensus.cc:740] T 195d4fe5f92e4e2c9330dce34c303723 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
W20260923 19:50:30.502746 6279 connection.cc:573] client connection to 127.5.143.193:39887 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260923 19:50:30.502928 6279 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 19:50:30.503783 5796 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet f2799563250845b0b9d7d51b2367b16b (table default.Table_bc33f65d5674483c9854966514392420 [id=b6e6ca970bea466f80938e694f770e67]). Expected version 1 got 0
I20260923 19:50:30.505311 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b4c2a0ae64841c6971a0840c1d5b739 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:30.505355 5790 connection.cc:573] client connection to 127.5.143.193:39887 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260923 19:50:30.505467 5790 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 5 similar messages]
I20260923 19:50:30.514611 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 14c917ac93fd436aa13fb0839fae883f (table default.Table_72a581bef73d4b24868e54dc6e544838 [id=f74ac9337bca41168a71a13e62116a09]) successfully deleted
I20260923 19:50:30.514984 6458 tablet_replica.cc:333] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:30.515215 6458 raft_consensus.cc:2243] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:30.515380 6458 raft_consensus.cc:2272] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:30.516191 6458 ts_tablet_manager.cc:1916] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:30.522672 6458 ts_tablet_manager.cc:1929] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:30.522801 6458 log.cc:1199] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/b6ef90ddd7a34dfdb8309d0e1c3688e7
I20260923 19:50:30.523120 6458 ts_tablet_manager.cc:1950] T b6ef90ddd7a34dfdb8309d0e1c3688e7 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:30.524236 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet b6ef90ddd7a34dfdb8309d0e1c3688e7 (table default.Table_5fddffc3232840a1897043b514d0e68b [id=3382d05ca17e45efae6c9c6f4e854edf]) successfully deleted
I20260923 19:50:30.526208 6456 tablet_bootstrap.cc:492] T 17a105f389d041dbb0bf8b828f990d27 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:30.526503 6456 ts_tablet_manager.cc:1403] T 17a105f389d041dbb0bf8b828f990d27 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.033s user 0.005s sys 0.004s
I20260923 19:50:30.527601 6456 raft_consensus.cc:359] T 17a105f389d041dbb0bf8b828f990d27 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.527773 6456 raft_consensus.cc:385] T 17a105f389d041dbb0bf8b828f990d27 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:30.527825 6456 raft_consensus.cc:740] T 17a105f389d041dbb0bf8b828f990d27 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:30.528074 6456 consensus_queue.cc:260] T 17a105f389d041dbb0bf8b828f990d27 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.529167 6456 ts_tablet_manager.cc:1434] T 17a105f389d041dbb0bf8b828f990d27 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:30.532511 8191 raft_consensus.cc:493] T 30fe07956e8940fcb7ba1e2e16ced463 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:30.532676 8191 raft_consensus.cc:515] T 30fe07956e8940fcb7ba1e2e16ced463 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:30.533336 8191 leader_election.cc:290] T 30fe07956e8940fcb7ba1e2e16ced463 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:30.534503 6139 leader_election.cc:343] T 30fe07956e8940fcb7ba1e2e16ced463 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): Not found: Tablet not found: 30fe07956e8940fcb7ba1e2e16ced463
I20260923 19:50:30.536514 6456 tablet_bootstrap.cc:492] T e9a5f103a5bf406e97f1384b9968da96 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
W20260923 19:50:30.537683 8226 negotiation.cc:336] Failed RPC negotiation. Trace:
0923 19:50:30.525644 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.5.143.193:39887 (local address 127.5.143.194:49783)
0923 19:50:30.530045 (+ 4401us) negotiation.cc:107] Waiting for socket to connect
0923 19:50:30.530066 (+ 21us) client_negotiation.cc:175] Beginning negotiation
0923 19:50:30.530204 (+ 138us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0923 19:50:30.537403 (+ 7199us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":4272,"thread_start_us":4643,"threads_started":1}
I20260923 19:50:30.538048 6456 tablet_bootstrap.cc:654] T e9a5f103a5bf406e97f1384b9968da96 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:30.538767 8225 negotiation.cc:336] Failed RPC negotiation. Trace:
0923 19:50:30.509059 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.5.143.193:39887 (local address 127.5.143.195:54329)
0923 19:50:30.517705 (+ 8646us) negotiation.cc:107] Waiting for socket to connect
0923 19:50:30.517728 (+ 23us) client_negotiation.cc:175] Beginning negotiation
0923 19:50:30.517894 (+ 166us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0923 19:50:30.538569 (+ 20675us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":8528,"thread_start_us":8965,"threads_started":1}
W20260923 19:50:30.540258 6137 leader_election.cc:336] T 772ece5283a949408d849f6e56f5f17b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260923 19:50:30.540797 8227 negotiation.cc:336] Failed RPC negotiation. Trace:
0923 19:50:30.531737 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.5.143.193:39887 (local address 127.0.0.1:41770)
0923 19:50:30.532159 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0923 19:50:30.532178 (+ 19us) client_negotiation.cc:175] Beginning negotiation
0923 19:50:30.532306 (+ 128us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0923 19:50:30.540615 (+ 8309us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":309,"threads_started":1}
I20260923 19:50:30.539819 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet 17a105f389d041dbb0bf8b828f990d27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:30.541947 6279 consensus_peers.cc:597] T f2799563250845b0b9d7d51b2367b16b P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Status: Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260923 19:50:30.542150 6279 leader_election.cc:336] T 195d4fe5f92e4e2c9330dce34c303723 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 19:50:30.542315 6279 leader_election.cc:304] T 195d4fe5f92e4e2c9330dce34c303723 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:30.542621 8208 raft_consensus.cc:2749] T 195d4fe5f92e4e2c9330dce34c303723 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:30.542835 6137 leader_election.cc:304] T 772ece5283a949408d849f6e56f5f17b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:30.543031 6279 leader_election.cc:336] T 146a402ff29a4e0b834a9f270d61e21c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 19:50:30.543164 8191 raft_consensus.cc:2749] T 772ece5283a949408d849f6e56f5f17b P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:30.543179 6279 leader_election.cc:304] T 146a402ff29a4e0b834a9f270d61e21c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:30.543416 6279 raft_consensus.cc:2686] T 146a402ff29a4e0b834a9f270d61e21c P 2bf41435f70447f19992d368ca6b46bd: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260923 19:50:30.543529 6137 consensus_peers.cc:597] T 3c713a0973dc45debf61c228a4bf13bf P 61022dd7f2f14dc19aebe3af5f08f430 -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Status: Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260923 19:50:30.543699 6137 leader_election.cc:336] T 2e1c19a751904a6295897376e9c5ee56 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 19:50:30.543839 6137 leader_election.cc:304] T 2e1c19a751904a6295897376e9c5ee56 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:30.544030 6279 leader_election.cc:336] T 9756a1f8e23a436bb7c19c8cba7bdc05 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 19:50:30.544083 8191 raft_consensus.cc:2749] T 2e1c19a751904a6295897376e9c5ee56 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:30.544126 6279 leader_election.cc:304] T 9756a1f8e23a436bb7c19c8cba7bdc05 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:30.544261 6279 raft_consensus.cc:2686] T 9756a1f8e23a436bb7c19c8cba7bdc05 P 2bf41435f70447f19992d368ca6b46bd: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260923 19:50:30.544464 6137 leader_election.cc:336] T f4313a4d8a9c411fad593b05ad655fc4 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 19:50:30.544611 6137 leader_election.cc:304] T f4313a4d8a9c411fad593b05ad655fc4 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:30.544737 6279 consensus_peers.cc:597] T 115048f771764e41a3816e17a6c6cf94 P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Status: Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260923 19:50:30.544853 6279 consensus_peers.cc:597] T ed9fb0cab0bd43b7a05d7376125b187e P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Status: Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:30.544874 8191 raft_consensus.cc:2749] T f4313a4d8a9c411fad593b05ad655fc4 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:30.545212 6137 leader_election.cc:336] T ba0453ef529344dfbab1130daa985fef P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260923 19:50:30.544932 6279 consensus_peers.cc:597] T d39a64531dd24eb4aa1f7e0c418b985b P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Status: Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260923 19:50:30.545388 6279 consensus_peers.cc:597] T cf64073cdde748bc8ed3ce7580a71160 P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Status: Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260923 19:50:30.545483 6279 consensus_peers.cc:597] T 2398c59871d241f985bca1761e722180 P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Status: Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:30.545406 6137 leader_election.cc:304] T ba0453ef529344dfbab1130daa985fef P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:30.545559 6279 consensus_peers.cc:597] T 40adb472162042e48fdbb496b342996a P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Status: Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260923 19:50:30.545631 6279 consensus_peers.cc:597] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Status: Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260923 19:50:30.545709 6279 leader_election.cc:336] T 30fe07956e8940fcb7ba1e2e16ced463 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 19:50:30.545789 6279 leader_election.cc:304] T 30fe07956e8940fcb7ba1e2e16ced463 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:30.545861 8191 raft_consensus.cc:2749] T ba0453ef529344dfbab1130daa985fef P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:30.545950 6279 raft_consensus.cc:2686] T 30fe07956e8940fcb7ba1e2e16ced463 P 2bf41435f70447f19992d368ca6b46bd: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260923 19:50:30.546211 6137 leader_election.cc:336] T ea2ef507c6e24d369427048171dfec06 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260923 19:50:30.546383 6279 consensus_peers.cc:597] T 8d87f05f29bd476386ff6516676ce31a P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Status: Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260923 19:50:30.546509 6279 consensus_peers.cc:597] T 6a34e178007b4e8ebed429cedf44e82a P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Status: Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:30.546428 6137 leader_election.cc:304] T ea2ef507c6e24d369427048171dfec06 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:30.546586 6279 leader_election.cc:336] T 1ea8f44ac03b4ad196725f871a615cdd P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 19:50:30.546667 6279 leader_election.cc:304] T 1ea8f44ac03b4ad196725f871a615cdd P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:30.546775 8191 raft_consensus.cc:2749] T ea2ef507c6e24d369427048171dfec06 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:30.546808 6279 raft_consensus.cc:2686] T 1ea8f44ac03b4ad196725f871a615cdd P 2bf41435f70447f19992d368ca6b46bd: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260923 19:50:30.547107 6137 leader_election.cc:336] T 0f90406b20f54787bd27255d5ae81d1c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260923 19:50:30.547215 6279 leader_election.cc:336] T 1985088eb56b40c1aeecc1ec7409bcdf P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 19:50:30.547252 6137 leader_election.cc:304] T 0f90406b20f54787bd27255d5ae81d1c P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:30.547327 6279 leader_election.cc:304] T 1985088eb56b40c1aeecc1ec7409bcdf P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:30.547539 8191 raft_consensus.cc:3060] T 0f90406b20f54787bd27255d5ae81d1c P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:30.548060 6458 tablet_replica.cc:333] T 839bcf991b754f9e95a1dd6c4f826e71 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:30.548239 6458 raft_consensus.cc:2243] T 839bcf991b754f9e95a1dd6c4f826e71 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:30.550547 8191 raft_consensus.cc:2749] T 0f90406b20f54787bd27255d5ae81d1c P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:30.542045 6454 consensus_queue.cc:260] T 195d4fe5f92e4e2c9330dce34c303723 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.551330 6454 ts_tablet_manager.cc:1434] T 195d4fe5f92e4e2c9330dce34c303723 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.051s user 0.001s sys 0.001s
I20260923 19:50:30.552301 5695 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-task5JtCX2/build/asan/bin/kudu pid 6115
I20260923 19:50:30.553383 6243 generic_service.cc:196] Checking for leaks (request via RPC)
W20260923 19:50:30.553508 5790 catalog_manager.cc:4790] TS e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): CreateTablet RPC failed for tablet 0f89794260d14516abe871d136096df8: Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 19:50:30.557401 8191 raft_consensus.cc:493] T 664d849daee54b02b7b7e2bb340d92fa P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:30.559741 8208 raft_consensus.cc:2749] T 1985088eb56b40c1aeecc1ec7409bcdf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:30.559819 6458 raft_consensus.cc:2272] T 839bcf991b754f9e95a1dd6c4f826e71 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:30.560113 6279 consensus_peers.cc:597] T 4bbd8fcc5ea1431ab9e4fadb7d52269e P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Status: Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260923 19:50:30.560235 6279 consensus_peers.cc:597] T 2db82e6f314f412385b41720c7efdef5 P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Status: Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:30.560304 8208 raft_consensus.cc:493] T a367cf3788ef49148a5c8d6864f71d8e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:30.560449 8208 raft_consensus.cc:515] T a367cf3788ef49148a5c8d6864f71d8e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.561211 8208 leader_election.cc:290] T a367cf3788ef49148a5c8d6864f71d8e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
I20260923 19:50:30.562085 6458 ts_tablet_manager.cc:1916] T 839bcf991b754f9e95a1dd6c4f826e71 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:30.568250 6456 tablet_bootstrap.cc:492] T e9a5f103a5bf406e97f1384b9968da96 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:30.568395 6456 ts_tablet_manager.cc:1403] T e9a5f103a5bf406e97f1384b9968da96 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.032s user 0.000s sys 0.006s
I20260923 19:50:30.569212 6458 ts_tablet_manager.cc:1929] T 839bcf991b754f9e95a1dd6c4f826e71 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:30.569324 6458 log.cc:1199] T 839bcf991b754f9e95a1dd6c4f826e71 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/839bcf991b754f9e95a1dd6c4f826e71
I20260923 19:50:30.569244 6456 raft_consensus.cc:359] T e9a5f103a5bf406e97f1384b9968da96 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.569401 6456 raft_consensus.cc:385] T e9a5f103a5bf406e97f1384b9968da96 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:30.569466 6456 raft_consensus.cc:740] T e9a5f103a5bf406e97f1384b9968da96 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:30.569610 6458 ts_tablet_manager.cc:1950] T 839bcf991b754f9e95a1dd6c4f826e71 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:30.569684 6456 consensus_queue.cc:260] T e9a5f103a5bf406e97f1384b9968da96 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.572645 6456 ts_tablet_manager.cc:1434] T e9a5f103a5bf406e97f1384b9968da96 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260923 19:50:30.572996 6456 tablet_bootstrap.cc:492] T 2d6762b369d3496083947a4a47a51868 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:30.574589 5796 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet e9a5f103a5bf406e97f1384b9968da96 (table default.Table_eca08dbb70af4e91a7e58a26ee330b14 [id=cdafc559e97b45e4bdffb04ea94e5fab]). Expected version 1 got 0
I20260923 19:50:30.575702 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 839bcf991b754f9e95a1dd6c4f826e71 (table default.Table_c61ffa0e84514cddb714dc30da0a21f6 [id=3ee0e52e785f4cb39add98261628d513]) successfully deleted
I20260923 19:50:30.575980 6458 tablet_replica.cc:333] T d5d3f96ebf1c4d05aceb06ef53737e4f P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:30.576174 6458 raft_consensus.cc:2243] T d5d3f96ebf1c4d05aceb06ef53737e4f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:30.576304 6458 raft_consensus.cc:2272] T d5d3f96ebf1c4d05aceb06ef53737e4f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:30.560317 6279 leader_election.cc:336] T f28da30d48454ffd9626df789a2f2063 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 19:50:30.578509 6279 leader_election.cc:304] T f28da30d48454ffd9626df789a2f2063 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:30.578816 8208 raft_consensus.cc:2749] T f28da30d48454ffd9626df789a2f2063 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:30.579161 6456 tablet_bootstrap.cc:654] T 2d6762b369d3496083947a4a47a51868 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
W20260923 19:50:30.579195 6279 leader_election.cc:336] T c013c07fd27a46f29a464d73fe752e10 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 19:50:30.579401 6279 leader_election.cc:304] T c013c07fd27a46f29a464d73fe752e10 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:30.579646 8208 raft_consensus.cc:2749] T c013c07fd27a46f29a464d73fe752e10 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:30.579952 6279 consensus_peers.cc:597] T 7f47efa0cabd47aa8ed0deface7763ab P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Status: Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260923 19:50:30.580124 6279 consensus_peers.cc:597] T 0e650824e4ae474787faeb6c22a4b43f P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Status: Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260923 19:50:30.580257 6279 leader_election.cc:336] T 14c917ac93fd436aa13fb0839fae883f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 19:50:30.580340 5796 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet e9a5f103a5bf406e97f1384b9968da96 (table default.Table_eca08dbb70af4e91a7e58a26ee330b14 [id=cdafc559e97b45e4bdffb04ea94e5fab]). Expected version 1 got 0
I20260923 19:50:30.580392 6279 leader_election.cc:304] T 14c917ac93fd436aa13fb0839fae883f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:30.580678 6279 raft_consensus.cc:2686] T 14c917ac93fd436aa13fb0839fae883f P 2bf41435f70447f19992d368ca6b46bd: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260923 19:50:30.581221 6279 leader_election.cc:336] T 8b8a973b247343008a29d67dfa712a0b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 19:50:30.581296 8208 raft_consensus.cc:493] T 3a4b9d48f02a4372adce6d9eb80935f6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:30.585294 8208 raft_consensus.cc:515] T 3a4b9d48f02a4372adce6d9eb80935f6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.585979 8208 leader_election.cc:290] T 3a4b9d48f02a4372adce6d9eb80935f6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:30.582125 6458 ts_tablet_manager.cc:1916] T d5d3f96ebf1c4d05aceb06ef53737e4f P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:30.588716 6279 leader_election.cc:304] T 8b8a973b247343008a29d67dfa712a0b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:30.589062 8208 raft_consensus.cc:2749] T 8b8a973b247343008a29d67dfa712a0b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:30.589425 6279 leader_election.cc:336] T 772ece5283a949408d849f6e56f5f17b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 19:50:30.594256 6279 leader_election.cc:304] T 772ece5283a949408d849f6e56f5f17b P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:30.594628 6279 raft_consensus.cc:2686] T 772ece5283a949408d849f6e56f5f17b P 2bf41435f70447f19992d368ca6b46bd: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260923 19:50:30.595260 6279 consensus_peers.cc:597] T ec4284d6a0fa416ca95b4d675c8e3912 P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Status: Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260923 19:50:30.599282 6279 consensus_peers.cc:597] T 2ce6378a6bd844a485aebb96081307e3 P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Status: Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260923 19:50:30.599673 6279 consensus_peers.cc:597] T 1c43641327d14a888a2815e49a2762c8 P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Status: Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260923 19:50:30.599833 6279 leader_election.cc:336] T 37769256de33432697e9d4fb235f473f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 19:50:30.600008 6279 leader_election.cc:304] T 37769256de33432697e9d4fb235f473f P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:30.600230 6279 raft_consensus.cc:2686] T 37769256de33432697e9d4fb235f473f P 2bf41435f70447f19992d368ca6b46bd: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260923 19:50:30.600893 6279 consensus_peers.cc:597] T f1f1df47dc32413d9cc9456f4198dca5 P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Status: Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260923 19:50:30.601078 6279 leader_election.cc:336] T 89b950342b66486fa6ec0cdf03ad4881 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 19:50:30.601403 6279 leader_election.cc:304] T 89b950342b66486fa6ec0cdf03ad4881 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:30.601719 8208 raft_consensus.cc:2749] T 89b950342b66486fa6ec0cdf03ad4881 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:30.602120 6279 leader_election.cc:336] T 664d849daee54b02b7b7e2bb340d92fa P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 19:50:30.602274 6279 leader_election.cc:304] T 664d849daee54b02b7b7e2bb340d92fa P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:30.602519 8208 raft_consensus.cc:2749] T 664d849daee54b02b7b7e2bb340d92fa P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:30.602833 6279 leader_election.cc:336] T 1cf016ff0bb8418d84358d17876338bf P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 19:50:30.603005 6279 leader_election.cc:304] T 1cf016ff0bb8418d84358d17876338bf P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:30.603322 8208 raft_consensus.cc:2749] T 1cf016ff0bb8418d84358d17876338bf P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:30.603621 6279 consensus_peers.cc:597] T f1c1d4f73488499a9e5add81e9d5e2d6 P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Status: Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260923 19:50:30.603785 6279 consensus_peers.cc:597] T 1fcd1c1bfd2c437a955c34569605a6d4 P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Status: Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260923 19:50:30.603924 6279 leader_election.cc:336] T d2dd611746d741e88b6911bf5d51f3e5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 19:50:30.609023 6279 leader_election.cc:304] T d2dd611746d741e88b6911bf5d51f3e5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:30.609419 6279 raft_consensus.cc:2686] T d2dd611746d741e88b6911bf5d51f3e5 P 2bf41435f70447f19992d368ca6b46bd: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260923 19:50:30.609254 6458 ts_tablet_manager.cc:1929] T d5d3f96ebf1c4d05aceb06ef53737e4f P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:30.610040 6458 log.cc:1199] T d5d3f96ebf1c4d05aceb06ef53737e4f P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/d5d3f96ebf1c4d05aceb06ef53737e4f
I20260923 19:50:30.610508 6458 ts_tablet_manager.cc:1950] T d5d3f96ebf1c4d05aceb06ef53737e4f P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:30.611963 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet d5d3f96ebf1c4d05aceb06ef53737e4f (table default.Table_5f9a8360065c42c6b42e7ab6deb71bdf [id=1e1ce17e7c394d7cbb8a4ec6e64dee8f]) successfully deleted
W20260923 19:50:30.610800 6279 consensus_peers.cc:597] T a263c0fc71424999b76ef01de9a51eda P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Status: Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260923 19:50:30.612371 6279 leader_election.cc:336] T 3acf4a03174f45d5aee9c9b1454784f8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 19:50:30.612847 6279 leader_election.cc:304] T 3acf4a03174f45d5aee9c9b1454784f8 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:30.613152 8208 raft_consensus.cc:2749] T 3acf4a03174f45d5aee9c9b1454784f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:30.613715 6279 consensus_peers.cc:597] T 7b455812687f42848df5290d0cdbc312 P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Status: Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260923 19:50:30.614109 6279 consensus_peers.cc:597] T 34d62ab3d4aa457f8fea283cd9248a41 P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Status: Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260923 19:50:30.614450 6279 consensus_peers.cc:597] T f302f91c8ef44237b1c9909d88dacbff P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Status: Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260923 19:50:30.614591 6279 leader_election.cc:336] T 431ad4da27544d68aa5666293984a86a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 19:50:30.614727 6279 leader_election.cc:304] T 431ad4da27544d68aa5666293984a86a P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:30.614916 6279 raft_consensus.cc:2686] T 431ad4da27544d68aa5666293984a86a P 2bf41435f70447f19992d368ca6b46bd: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260923 19:50:30.615461 6279 consensus_peers.cc:597] T 397ec5e49673406cb26a2efab0ad8401 P 2bf41435f70447f19992d368ca6b46bd -> Peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Couldn't send request to peer e546f660e7e541d1aa9ae38e5ee5b9c0. Status: Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
I20260923 19:50:30.615868 6456 tablet_bootstrap.cc:492] T 2d6762b369d3496083947a4a47a51868 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:30.614020 6458 tablet_replica.cc:333] T 3a4b9d48f02a4372adce6d9eb80935f6 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:30.616003 6456 ts_tablet_manager.cc:1403] T 2d6762b369d3496083947a4a47a51868 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.043s user 0.007s sys 0.001s
I20260923 19:50:30.616211 6458 raft_consensus.cc:2243] T 3a4b9d48f02a4372adce6d9eb80935f6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:30.616384 6458 raft_consensus.cc:2272] T 3a4b9d48f02a4372adce6d9eb80935f6 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:30.616784 6456 raft_consensus.cc:359] T 2d6762b369d3496083947a4a47a51868 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.616964 6456 raft_consensus.cc:385] T 2d6762b369d3496083947a4a47a51868 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:30.617022 6456 raft_consensus.cc:740] T 2d6762b369d3496083947a4a47a51868 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:30.617187 6458 ts_tablet_manager.cc:1916] T 3a4b9d48f02a4372adce6d9eb80935f6 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:30.617259 6456 consensus_queue.cc:260] T 2d6762b369d3496083947a4a47a51868 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.617710 6456 ts_tablet_manager.cc:1434] T 2d6762b369d3496083947a4a47a51868 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:30.620445 6456 tablet_bootstrap.cc:492] T 83fdbb8a5352447b8ad6570e44674e97 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:30.622038 6456 tablet_bootstrap.cc:654] T 83fdbb8a5352447b8ad6570e44674e97 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:30.628224 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d6762b369d3496083947a4a47a51868 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:30.633525 6458 ts_tablet_manager.cc:1929] T 3a4b9d48f02a4372adce6d9eb80935f6 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:30.633648 6458 log.cc:1199] T 3a4b9d48f02a4372adce6d9eb80935f6 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/3a4b9d48f02a4372adce6d9eb80935f6
I20260923 19:50:30.633950 6458 ts_tablet_manager.cc:1950] T 3a4b9d48f02a4372adce6d9eb80935f6 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:30.639199 6458 tablet_replica.cc:333] T 18a31ed6bea444e7888f374927f90a60 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:30.639396 6458 raft_consensus.cc:2243] T 18a31ed6bea444e7888f374927f90a60 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:30.639535 6458 raft_consensus.cc:2272] T 18a31ed6bea444e7888f374927f90a60 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:30.641852 6458 ts_tablet_manager.cc:1916] T 18a31ed6bea444e7888f374927f90a60 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:30.642930 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 3a4b9d48f02a4372adce6d9eb80935f6 (table default.Table_c6300cbac0064c74bbc5bd955433f5d5 [id=9ef3551908034b10b7747e6e03256af1]) successfully deleted
I20260923 19:50:30.645808 6456 tablet_bootstrap.cc:492] T 83fdbb8a5352447b8ad6570e44674e97 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:30.645977 6456 ts_tablet_manager.cc:1403] T 83fdbb8a5352447b8ad6570e44674e97 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.005s
I20260923 19:50:30.646725 6456 raft_consensus.cc:359] T 83fdbb8a5352447b8ad6570e44674e97 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.646900 6456 raft_consensus.cc:385] T 83fdbb8a5352447b8ad6570e44674e97 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:30.646966 6456 raft_consensus.cc:740] T 83fdbb8a5352447b8ad6570e44674e97 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:30.647217 6456 consensus_queue.cc:260] T 83fdbb8a5352447b8ad6570e44674e97 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.647684 6456 ts_tablet_manager.cc:1434] T 83fdbb8a5352447b8ad6570e44674e97 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260923 19:50:30.648208 6279 leader_election.cc:336] T 3a4b9d48f02a4372adce6d9eb80935f6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: connect: Connection refused (error 111)
W20260923 19:50:30.648348 6279 leader_election.cc:336] T a367cf3788ef49148a5c8d6864f71d8e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: connect: Connection refused (error 111)
I20260923 19:50:30.650594 6456 tablet_bootstrap.cc:492] T c82bb40047b342d5b9468ecc374ef829 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:30.652194 6456 tablet_bootstrap.cc:654] T c82bb40047b342d5b9468ecc374ef829 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:30.653481 6458 ts_tablet_manager.cc:1929] T 18a31ed6bea444e7888f374927f90a60 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:30.653575 6458 log.cc:1199] T 18a31ed6bea444e7888f374927f90a60 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/18a31ed6bea444e7888f374927f90a60
I20260923 19:50:30.653831 6458 ts_tablet_manager.cc:1950] T 18a31ed6bea444e7888f374927f90a60 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:30.658003 6456 tablet_bootstrap.cc:492] T c82bb40047b342d5b9468ecc374ef829 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:30.658141 6456 ts_tablet_manager.cc:1403] T c82bb40047b342d5b9468ecc374ef829 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.001s
I20260923 19:50:30.658841 6456 raft_consensus.cc:359] T c82bb40047b342d5b9468ecc374ef829 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.659009 6456 raft_consensus.cc:385] T c82bb40047b342d5b9468ecc374ef829 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:30.659056 6456 raft_consensus.cc:740] T c82bb40047b342d5b9468ecc374ef829 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:30.659268 6456 consensus_queue.cc:260] T c82bb40047b342d5b9468ecc374ef829 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.659418 6458 tablet_replica.cc:333] T 8b4c2a0ae64841c6971a0840c1d5b739 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:30.659739 6456 ts_tablet_manager.cc:1434] T c82bb40047b342d5b9468ecc374ef829 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:50:30.659979 6456 tablet_bootstrap.cc:492] T e996910398694686bd68ef31239ed15f P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:30.661506 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet 83fdbb8a5352447b8ad6570e44674e97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:20 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:30.661618 6456 tablet_bootstrap.cc:654] T e996910398694686bd68ef31239ed15f P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:30.661981 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 18a31ed6bea444e7888f374927f90a60 (table default.Table_e526c19d02b9432eabd892ed7a9a291c [id=6f9ac3e4264245358d37624ba8d8fa73]) successfully deleted
I20260923 19:50:30.662407 6458 raft_consensus.cc:2243] T 8b4c2a0ae64841c6971a0840c1d5b739 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:30.662576 6458 raft_consensus.cc:2272] T 8b4c2a0ae64841c6971a0840c1d5b739 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:30.673652 6458 ts_tablet_manager.cc:1916] T 8b4c2a0ae64841c6971a0840c1d5b739 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:30.678889 6456 tablet_bootstrap.cc:492] T e996910398694686bd68ef31239ed15f P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:30.679049 6456 ts_tablet_manager.cc:1403] T e996910398694686bd68ef31239ed15f P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.014s
I20260923 19:50:30.679903 6456 raft_consensus.cc:359] T e996910398694686bd68ef31239ed15f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.680073 6456 raft_consensus.cc:385] T e996910398694686bd68ef31239ed15f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:30.680136 6456 raft_consensus.cc:740] T e996910398694686bd68ef31239ed15f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:30.680320 6456 consensus_queue.cc:260] T e996910398694686bd68ef31239ed15f P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.680794 6456 ts_tablet_manager.cc:1434] T e996910398694686bd68ef31239ed15f P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:30.685103 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet c82bb40047b342d5b9468ecc374ef829 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:20 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:30.687816 6456 tablet_bootstrap.cc:492] T 16144661b56c4f858c55e8e0d3999019 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:30.689627 6456 tablet_bootstrap.cc:654] T 16144661b56c4f858c55e8e0d3999019 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:30.699839 5796 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet f1c1d4f73488499a9e5add81e9d5e2d6 (table default.Table_7f7907c8e1bc4ad1ae68faf5f072b318 [id=80e3a84f7199464fa96426daeeeb84cd]). Expected version 2 got 0
I20260923 19:50:30.700232 6456 tablet_bootstrap.cc:492] T 16144661b56c4f858c55e8e0d3999019 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:30.700380 6456 ts_tablet_manager.cc:1403] T 16144661b56c4f858c55e8e0d3999019 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.007s
I20260923 19:50:30.701056 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet e996910398694686bd68ef31239ed15f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:12 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:30.701205 6456 raft_consensus.cc:359] T 16144661b56c4f858c55e8e0d3999019 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.701380 6456 raft_consensus.cc:385] T 16144661b56c4f858c55e8e0d3999019 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:30.701452 6456 raft_consensus.cc:740] T 16144661b56c4f858c55e8e0d3999019 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:30.701655 6456 consensus_queue.cc:260] T 16144661b56c4f858c55e8e0d3999019 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.702188 6456 ts_tablet_manager.cc:1434] T 16144661b56c4f858c55e8e0d3999019 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:50:30.704408 6456 tablet_bootstrap.cc:492] T cf538da9dc8c47a8a391efe4e17bb3a5 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:30.706163 6456 tablet_bootstrap.cc:654] T cf538da9dc8c47a8a391efe4e17bb3a5 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:30.709501 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet 16144661b56c4f858c55e8e0d3999019 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:09 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:30.748279 6458 ts_tablet_manager.cc:1929] T 8b4c2a0ae64841c6971a0840c1d5b739 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:30.748667 6458 log.cc:1199] T 8b4c2a0ae64841c6971a0840c1d5b739 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/8b4c2a0ae64841c6971a0840c1d5b739
I20260923 19:50:30.752298 5796 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 397ec5e49673406cb26a2efab0ad8401 (table default.Table_92f3bea4e4164a738fb75f01e95cd776 [id=0b80967a8fb94518ad872fbce9bae934]). Expected version 1 got 0
I20260923 19:50:30.752928 6458 ts_tablet_manager.cc:1950] T 8b4c2a0ae64841c6971a0840c1d5b739 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:30.753970 6458 tablet_replica.cc:333] T 17a105f389d041dbb0bf8b828f990d27 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:30.754267 6458 raft_consensus.cc:2243] T 17a105f389d041dbb0bf8b828f990d27 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:30.754479 6458 raft_consensus.cc:2272] T 17a105f389d041dbb0bf8b828f990d27 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:30.754549 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 8b4c2a0ae64841c6971a0840c1d5b739 (table default.Table_85afd8d42b6445daa79f5fe22456ba77 [id=97afe6551b744d45a660bd41c28b87e9]) successfully deleted
I20260923 19:50:30.755307 6458 ts_tablet_manager.cc:1916] T 17a105f389d041dbb0bf8b828f990d27 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:30.760393 8208 raft_consensus.cc:493] T 2bc47336948746d694d5a896730c501c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:30.760564 8208 raft_consensus.cc:515] T 2bc47336948746d694d5a896730c501c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.761237 8208 leader_election.cc:290] T 2bc47336948746d694d5a896730c501c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:30.762706 6456 tablet_bootstrap.cc:492] T cf538da9dc8c47a8a391efe4e17bb3a5 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:30.762835 6456 ts_tablet_manager.cc:1403] T cf538da9dc8c47a8a391efe4e17bb3a5 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.058s user 0.022s sys 0.018s
W20260923 19:50:30.763602 6279 leader_election.cc:336] T 2bc47336948746d694d5a896730c501c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: connect: Connection refused (error 111)
I20260923 19:50:30.764326 6458 ts_tablet_manager.cc:1929] T 17a105f389d041dbb0bf8b828f990d27 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:30.764446 6458 log.cc:1199] T 17a105f389d041dbb0bf8b828f990d27 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/17a105f389d041dbb0bf8b828f990d27
I20260923 19:50:30.764716 6458 ts_tablet_manager.cc:1950] T 17a105f389d041dbb0bf8b828f990d27 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:30.765555 6458 tablet_replica.cc:333] T 2d6762b369d3496083947a4a47a51868 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:30.765733 6458 raft_consensus.cc:2243] T 2d6762b369d3496083947a4a47a51868 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:30.765717 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 17a105f389d041dbb0bf8b828f990d27 (table default.Table_3a2441d714924cc1ae24db6dd739f56e [id=553d29d5d07840c9a05771679cb2fbe5]) successfully deleted
I20260923 19:50:30.765894 6458 raft_consensus.cc:2272] T 2d6762b369d3496083947a4a47a51868 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:30.763622 6456 raft_consensus.cc:359] T cf538da9dc8c47a8a391efe4e17bb3a5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.766214 6456 raft_consensus.cc:385] T cf538da9dc8c47a8a391efe4e17bb3a5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:30.766271 6456 raft_consensus.cc:740] T cf538da9dc8c47a8a391efe4e17bb3a5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:30.766507 6456 consensus_queue.cc:260] T cf538da9dc8c47a8a391efe4e17bb3a5 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.766957 6456 ts_tablet_manager.cc:1434] T cf538da9dc8c47a8a391efe4e17bb3a5 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260923 19:50:30.767887 6456 tablet_bootstrap.cc:492] T 7a6fca6d55b5493a9fb7f2e1cbf1ea29 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:30.769526 6456 tablet_bootstrap.cc:654] T 7a6fca6d55b5493a9fb7f2e1cbf1ea29 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:30.770619 6458 ts_tablet_manager.cc:1916] T 2d6762b369d3496083947a4a47a51868 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:30.786473 5796 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet cf538da9dc8c47a8a391efe4e17bb3a5 (table default.Table_1e1088639b6249c494e14d33b9f20f60 [id=e84f4a4fcfe441659dfa2f0e2c4cad3e]). Expected version 2 got 0
I20260923 19:50:30.789283 6458 ts_tablet_manager.cc:1929] T 2d6762b369d3496083947a4a47a51868 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:30.789418 6458 log.cc:1199] T 2d6762b369d3496083947a4a47a51868 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/2d6762b369d3496083947a4a47a51868
I20260923 19:50:30.789741 6458 ts_tablet_manager.cc:1950] T 2d6762b369d3496083947a4a47a51868 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:30.793044 6456 tablet_bootstrap.cc:492] T 7a6fca6d55b5493a9fb7f2e1cbf1ea29 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:30.793183 6456 ts_tablet_manager.cc:1403] T 7a6fca6d55b5493a9fb7f2e1cbf1ea29 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.003s
I20260923 19:50:30.793920 6456 raft_consensus.cc:359] T 7a6fca6d55b5493a9fb7f2e1cbf1ea29 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.794093 6456 raft_consensus.cc:385] T 7a6fca6d55b5493a9fb7f2e1cbf1ea29 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:30.794139 6456 raft_consensus.cc:740] T 7a6fca6d55b5493a9fb7f2e1cbf1ea29 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:30.794374 6456 consensus_queue.cc:260] T 7a6fca6d55b5493a9fb7f2e1cbf1ea29 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.794857 6456 ts_tablet_manager.cc:1434] T 7a6fca6d55b5493a9fb7f2e1cbf1ea29 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:50:30.796257 6456 tablet_bootstrap.cc:492] T 2ed8d49f1b3d4bee80b1822df2a7f495 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:30.797484 7993 raft_consensus.cc:493] T 16144661b56c4f858c55e8e0d3999019 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:30.797642 7993 raft_consensus.cc:515] T 16144661b56c4f858c55e8e0d3999019 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.798096 6456 tablet_bootstrap.cc:654] T 2ed8d49f1b3d4bee80b1822df2a7f495 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:30.798434 7993 leader_election.cc:290] T 16144661b56c4f858c55e8e0d3999019 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:30.802997 6279 leader_election.cc:336] T 16144661b56c4f858c55e8e0d3999019 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: connect: Connection refused (error 111)
I20260923 19:50:30.809296 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 2d6762b369d3496083947a4a47a51868 (table default.Table_f2eaab6869a44801898602e856f9ef0d [id=2cc4daef0a5a430691e945cdff900016]) successfully deleted
I20260923 19:50:30.810226 6458 tablet_replica.cc:333] T 83fdbb8a5352447b8ad6570e44674e97 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:30.810570 6458 raft_consensus.cc:2243] T 83fdbb8a5352447b8ad6570e44674e97 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:30.810839 6458 raft_consensus.cc:2272] T 83fdbb8a5352447b8ad6570e44674e97 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:30.811968 6458 ts_tablet_manager.cc:1916] T 83fdbb8a5352447b8ad6570e44674e97 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:30.821569 6456 tablet_bootstrap.cc:492] T 2ed8d49f1b3d4bee80b1822df2a7f495 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:30.821733 6456 ts_tablet_manager.cc:1403] T 2ed8d49f1b3d4bee80b1822df2a7f495 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.002s
I20260923 19:50:30.822495 6456 raft_consensus.cc:359] T 2ed8d49f1b3d4bee80b1822df2a7f495 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.822656 6456 raft_consensus.cc:385] T 2ed8d49f1b3d4bee80b1822df2a7f495 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:30.822706 6456 raft_consensus.cc:740] T 2ed8d49f1b3d4bee80b1822df2a7f495 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:30.822890 6456 consensus_queue.cc:260] T 2ed8d49f1b3d4bee80b1822df2a7f495 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.832453 6456 ts_tablet_manager.cc:1434] T 2ed8d49f1b3d4bee80b1822df2a7f495 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260923 19:50:30.836585 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ed8d49f1b3d4bee80b1822df2a7f495 with delete_type TABLET_DATA_DELETED (replaced by tablet ebc9dca1c228493a9dbaca4dd777d983) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:30.839974 6456 tablet_bootstrap.cc:492] T ecd91bf5bd9447c0bb20ba43573ff08d P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:30.841660 6456 tablet_bootstrap.cc:654] T ecd91bf5bd9447c0bb20ba43573ff08d P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:30.849834 6456 tablet_bootstrap.cc:492] T ecd91bf5bd9447c0bb20ba43573ff08d P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:30.850000 6456 ts_tablet_manager.cc:1403] T ecd91bf5bd9447c0bb20ba43573ff08d P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.008s
I20260923 19:50:30.850917 6456 raft_consensus.cc:359] T ecd91bf5bd9447c0bb20ba43573ff08d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.851083 6456 raft_consensus.cc:385] T ecd91bf5bd9447c0bb20ba43573ff08d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:30.851132 6456 raft_consensus.cc:740] T ecd91bf5bd9447c0bb20ba43573ff08d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:30.851363 6456 consensus_queue.cc:260] T ecd91bf5bd9447c0bb20ba43573ff08d P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.853235 6458 ts_tablet_manager.cc:1929] T 83fdbb8a5352447b8ad6570e44674e97 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:30.853374 6458 log.cc:1199] T 83fdbb8a5352447b8ad6570e44674e97 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/83fdbb8a5352447b8ad6570e44674e97
I20260923 19:50:30.853740 6458 ts_tablet_manager.cc:1950] T 83fdbb8a5352447b8ad6570e44674e97 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:30.855100 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 83fdbb8a5352447b8ad6570e44674e97 (table default.Table_d3fd774b813349ad97efc22b5a85001d [id=d1e7a2e7077c4a528ace41121d86e28b]) successfully deleted
I20260923 19:50:30.857903 6456 ts_tablet_manager.cc:1434] T ecd91bf5bd9447c0bb20ba43573ff08d P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260923 19:50:30.861094 6458 tablet_replica.cc:333] T c82bb40047b342d5b9468ecc374ef829 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:30.861285 6458 raft_consensus.cc:2243] T c82bb40047b342d5b9468ecc374ef829 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:30.861416 6458 raft_consensus.cc:2272] T c82bb40047b342d5b9468ecc374ef829 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:30.863891 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet ecd91bf5bd9447c0bb20ba43573ff08d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:30.865784 6456 tablet_bootstrap.cc:492] T e55ab069a0fa48398b39bbb9e7c65cd1 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:30.871618 6456 tablet_bootstrap.cc:654] T e55ab069a0fa48398b39bbb9e7c65cd1 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:30.884847 6458 ts_tablet_manager.cc:1916] T c82bb40047b342d5b9468ecc374ef829 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:30.895227 6458 ts_tablet_manager.cc:1929] T c82bb40047b342d5b9468ecc374ef829 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:30.895358 6458 log.cc:1199] T c82bb40047b342d5b9468ecc374ef829 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/c82bb40047b342d5b9468ecc374ef829
I20260923 19:50:30.897349 6458 ts_tablet_manager.cc:1950] T c82bb40047b342d5b9468ecc374ef829 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:30.898573 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet c82bb40047b342d5b9468ecc374ef829 (table default.Table_1eb5249515fc4eab900531c4d0e96923 [id=0528ddbde624485da735361c8554a744]) successfully deleted
I20260923 19:50:30.898870 6458 tablet_replica.cc:333] T e996910398694686bd68ef31239ed15f P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:30.899164 6458 raft_consensus.cc:2243] T e996910398694686bd68ef31239ed15f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:30.899314 6458 raft_consensus.cc:2272] T e996910398694686bd68ef31239ed15f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:30.899899 6458 ts_tablet_manager.cc:1916] T e996910398694686bd68ef31239ed15f P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:30.913273 7993 raft_consensus.cc:493] T 12bda2ae961446bea2f34e792f4f1706 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:30.913439 7993 raft_consensus.cc:515] T 12bda2ae961446bea2f34e792f4f1706 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.914040 7993 leader_election.cc:290] T 12bda2ae961446bea2f34e792f4f1706 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295)
W20260923 19:50:30.918792 6279 leader_election.cc:336] T 12bda2ae961446bea2f34e792f4f1706 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: connect: Connection refused (error 111)
I20260923 19:50:30.934710 6456 tablet_bootstrap.cc:492] T e55ab069a0fa48398b39bbb9e7c65cd1 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:30.934931 6456 ts_tablet_manager.cc:1403] T e55ab069a0fa48398b39bbb9e7c65cd1 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.069s user 0.015s sys 0.018s
I20260923 19:50:30.936251 6456 raft_consensus.cc:359] T e55ab069a0fa48398b39bbb9e7c65cd1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.936581 6456 raft_consensus.cc:385] T e55ab069a0fa48398b39bbb9e7c65cd1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:30.936669 6456 raft_consensus.cc:740] T e55ab069a0fa48398b39bbb9e7c65cd1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:30.936894 6458 ts_tablet_manager.cc:1929] T e996910398694686bd68ef31239ed15f P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:30.937045 6458 log.cc:1199] T e996910398694686bd68ef31239ed15f P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/e996910398694686bd68ef31239ed15f
I20260923 19:50:30.936908 6456 consensus_queue.cc:260] T e55ab069a0fa48398b39bbb9e7c65cd1 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.937408 6458 ts_tablet_manager.cc:1950] T e996910398694686bd68ef31239ed15f P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:30.937433 6456 ts_tablet_manager.cc:1434] T e55ab069a0fa48398b39bbb9e7c65cd1 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:30.937666 6456 tablet_bootstrap.cc:492] T bfe87e992ca04ea293e354da508e4c67 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:30.942582 6458 tablet_replica.cc:333] T 16144661b56c4f858c55e8e0d3999019 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:30.942811 6458 raft_consensus.cc:2243] T 16144661b56c4f858c55e8e0d3999019 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:30.942955 6458 raft_consensus.cc:2272] T 16144661b56c4f858c55e8e0d3999019 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:30.943487 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet e996910398694686bd68ef31239ed15f (table default.Table_18c12428fbbe40a394cbf271fbcd69f0 [id=9be19d72231e46eab436b439a57abba3]) successfully deleted
I20260923 19:50:30.944031 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet e55ab069a0fa48398b39bbb9e7c65cd1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:17 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:30.947523 6456 tablet_bootstrap.cc:654] T bfe87e992ca04ea293e354da508e4c67 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:30.955426 6456 tablet_bootstrap.cc:492] T bfe87e992ca04ea293e354da508e4c67 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:30.955477 6458 ts_tablet_manager.cc:1916] T 16144661b56c4f858c55e8e0d3999019 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:30.955580 6456 ts_tablet_manager.cc:1403] T bfe87e992ca04ea293e354da508e4c67 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.006s
I20260923 19:50:30.956314 6456 raft_consensus.cc:359] T bfe87e992ca04ea293e354da508e4c67 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.956506 6456 raft_consensus.cc:385] T bfe87e992ca04ea293e354da508e4c67 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:30.956560 6456 raft_consensus.cc:740] T bfe87e992ca04ea293e354da508e4c67 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:30.956790 6456 consensus_queue.cc:260] T bfe87e992ca04ea293e354da508e4c67 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.957353 6456 ts_tablet_manager.cc:1434] T bfe87e992ca04ea293e354da508e4c67 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:30.961908 6458 ts_tablet_manager.cc:1929] T 16144661b56c4f858c55e8e0d3999019 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:30.962038 6458 log.cc:1199] T 16144661b56c4f858c55e8e0d3999019 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/16144661b56c4f858c55e8e0d3999019
I20260923 19:50:30.962379 6458 ts_tablet_manager.cc:1950] T 16144661b56c4f858c55e8e0d3999019 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:30.963032 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet bfe87e992ca04ea293e354da508e4c67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:11 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:30.965350 6458 tablet_replica.cc:333] T 2ed8d49f1b3d4bee80b1822df2a7f495 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:30.965291 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 16144661b56c4f858c55e8e0d3999019 (table default.Table_eb0e9a67b9274e2ea8978f82929b81a8 [id=bd93870aaa4b43b98dbef08030d8fb0f]) successfully deleted
I20260923 19:50:30.965830 6458 raft_consensus.cc:2243] T 2ed8d49f1b3d4bee80b1822df2a7f495 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:30.966063 6458 raft_consensus.cc:2272] T 2ed8d49f1b3d4bee80b1822df2a7f495 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:30.965653 6456 tablet_bootstrap.cc:492] T 7d654b14cafa453185179fe57a25e2d9 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:30.967810 6458 ts_tablet_manager.cc:1916] T 2ed8d49f1b3d4bee80b1822df2a7f495 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:30.969466 6456 tablet_bootstrap.cc:654] T 7d654b14cafa453185179fe57a25e2d9 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:30.975592 6458 ts_tablet_manager.cc:1929] T 2ed8d49f1b3d4bee80b1822df2a7f495 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:30.975818 6458 log.cc:1199] T 2ed8d49f1b3d4bee80b1822df2a7f495 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/2ed8d49f1b3d4bee80b1822df2a7f495
I20260923 19:50:30.976217 6458 ts_tablet_manager.cc:1950] T 2ed8d49f1b3d4bee80b1822df2a7f495 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:30.977135 6458 tablet_replica.cc:333] T ecd91bf5bd9447c0bb20ba43573ff08d P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:30.977319 6458 raft_consensus.cc:2243] T ecd91bf5bd9447c0bb20ba43573ff08d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:30.977298 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 2ed8d49f1b3d4bee80b1822df2a7f495 (table default.Table_b0aaf57c3ec9414f89529017165bc65b [id=84b65375453448aebd9bce135f58bd90]) successfully deleted
I20260923 19:50:30.977443 6458 raft_consensus.cc:2272] T ecd91bf5bd9447c0bb20ba43573ff08d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:30.978052 6458 ts_tablet_manager.cc:1916] T ecd91bf5bd9447c0bb20ba43573ff08d P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:30.982117 6456 tablet_bootstrap.cc:492] T 7d654b14cafa453185179fe57a25e2d9 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:30.982287 6456 ts_tablet_manager.cc:1403] T 7d654b14cafa453185179fe57a25e2d9 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.005s
I20260923 19:50:30.982930 6456 raft_consensus.cc:359] T 7d654b14cafa453185179fe57a25e2d9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:30.983096 6456 raft_consensus.cc:385] T 7d654b14cafa453185179fe57a25e2d9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:30.983151 6456 raft_consensus.cc:740] T 7d654b14cafa453185179fe57a25e2d9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:30.983345 7993 raft_consensus.cc:493] T 7a6fca6d55b5493a9fb7f2e1cbf1ea29 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:30.983440 7993 raft_consensus.cc:515] T 7a6fca6d55b5493a9fb7f2e1cbf1ea29 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.984002 7993 leader_election.cc:290] T 7a6fca6d55b5493a9fb7f2e1cbf1ea29 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:30.984308 7993 raft_consensus.cc:493] T cf538da9dc8c47a8a391efe4e17bb3a5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:30.984413 7993 raft_consensus.cc:515] T cf538da9dc8c47a8a391efe4e17bb3a5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:30.984862 7993 leader_election.cc:290] T cf538da9dc8c47a8a391efe4e17bb3a5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:30.985117 6458 ts_tablet_manager.cc:1929] T ecd91bf5bd9447c0bb20ba43573ff08d P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:30.985237 6458 log.cc:1199] T ecd91bf5bd9447c0bb20ba43573ff08d P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/ecd91bf5bd9447c0bb20ba43573ff08d
I20260923 19:50:30.985777 6456 consensus_queue.cc:260] T 7d654b14cafa453185179fe57a25e2d9 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:30.989595 6458 ts_tablet_manager.cc:1950] T ecd91bf5bd9447c0bb20ba43573ff08d P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
W20260923 19:50:30.990190 6279 leader_election.cc:336] T 7a6fca6d55b5493a9fb7f2e1cbf1ea29 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: connect: Connection refused (error 111)
W20260923 19:50:30.990339 6279 leader_election.cc:336] T cf538da9dc8c47a8a391efe4e17bb3a5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: connect: Connection refused (error 111)
I20260923 19:50:30.992252 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet ecd91bf5bd9447c0bb20ba43573ff08d (table default.Table_0f2148660919423195f95a973fb63500 [id=429f7e5fed0e4821b00a8799176b5dbe]) successfully deleted
I20260923 19:50:30.993983 6458 tablet_replica.cc:333] T e55ab069a0fa48398b39bbb9e7c65cd1 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:30.994225 6458 raft_consensus.cc:2243] T e55ab069a0fa48398b39bbb9e7c65cd1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:30.994395 6458 raft_consensus.cc:2272] T e55ab069a0fa48398b39bbb9e7c65cd1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:30.995042 6458 ts_tablet_manager.cc:1916] T e55ab069a0fa48398b39bbb9e7c65cd1 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:30.999707 6458 ts_tablet_manager.cc:1929] T e55ab069a0fa48398b39bbb9e7c65cd1 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:30.999899 6458 log.cc:1199] T e55ab069a0fa48398b39bbb9e7c65cd1 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/e55ab069a0fa48398b39bbb9e7c65cd1
I20260923 19:50:31.000159 6458 ts_tablet_manager.cc:1950] T e55ab069a0fa48398b39bbb9e7c65cd1 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:31.001161 6458 tablet_replica.cc:333] T bfe87e992ca04ea293e354da508e4c67 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:31.001374 6458 raft_consensus.cc:2243] T bfe87e992ca04ea293e354da508e4c67 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:31.001359 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet e55ab069a0fa48398b39bbb9e7c65cd1 (table default.Table_3f0fe2b329f64cdf9617315270900e4f [id=a6dbcc9c44fb400b926e21aa6d683186]) successfully deleted
I20260923 19:50:31.001513 6458 raft_consensus.cc:2272] T bfe87e992ca04ea293e354da508e4c67 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:31.002192 6458 ts_tablet_manager.cc:1916] T bfe87e992ca04ea293e354da508e4c67 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:31.003218 6456 ts_tablet_manager.cc:1434] T 7d654b14cafa453185179fe57a25e2d9 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.021s user 0.013s sys 0.002s
I20260923 19:50:31.003507 6456 tablet_bootstrap.cc:492] T a0743d5ac2264af6b045af0474cbf58c P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:31.004873 6456 tablet_bootstrap.cc:654] T a0743d5ac2264af6b045af0474cbf58c P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:31.011010 5796 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 7d654b14cafa453185179fe57a25e2d9 (table default.Table_160de6bdea3143189e7fecd95d9e3287 [id=f509f74bbf6b4b6381509c265432cbd7]). Expected version 3 got 0
I20260923 19:50:31.013942 6456 tablet_bootstrap.cc:492] T a0743d5ac2264af6b045af0474cbf58c P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:31.014081 6456 ts_tablet_manager.cc:1403] T a0743d5ac2264af6b045af0474cbf58c P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260923 19:50:31.014658 6456 raft_consensus.cc:359] T a0743d5ac2264af6b045af0474cbf58c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.014809 6456 raft_consensus.cc:385] T a0743d5ac2264af6b045af0474cbf58c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:31.014856 6456 raft_consensus.cc:740] T a0743d5ac2264af6b045af0474cbf58c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:31.015066 6456 consensus_queue.cc:260] T a0743d5ac2264af6b045af0474cbf58c P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.015475 6456 ts_tablet_manager.cc:1434] T a0743d5ac2264af6b045af0474cbf58c P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 19:50:31.020535 6456 tablet_bootstrap.cc:492] T c462a9a5bde64e8094d7a2ca09740fc9 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:31.020136 5796 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet f2799563250845b0b9d7d51b2367b16b (table default.Table_bc33f65d5674483c9854966514392420 [id=b6e6ca970bea466f80938e694f770e67]). Expected version 1 got 0
I20260923 19:50:31.022004 6456 tablet_bootstrap.cc:654] T c462a9a5bde64e8094d7a2ca09740fc9 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:31.029362 6458 ts_tablet_manager.cc:1929] T bfe87e992ca04ea293e354da508e4c67 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:31.031490 6458 log.cc:1199] T bfe87e992ca04ea293e354da508e4c67 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/bfe87e992ca04ea293e354da508e4c67
I20260923 19:50:31.031960 6458 ts_tablet_manager.cc:1950] T bfe87e992ca04ea293e354da508e4c67 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:31.033376 6456 tablet_bootstrap.cc:492] T c462a9a5bde64e8094d7a2ca09740fc9 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:31.033577 6456 ts_tablet_manager.cc:1403] T c462a9a5bde64e8094d7a2ca09740fc9 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.011s
I20260923 19:50:31.034372 6456 raft_consensus.cc:359] T c462a9a5bde64e8094d7a2ca09740fc9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.034616 6456 raft_consensus.cc:385] T c462a9a5bde64e8094d7a2ca09740fc9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:31.034718 6456 raft_consensus.cc:740] T c462a9a5bde64e8094d7a2ca09740fc9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:31.034962 6456 consensus_queue.cc:260] T c462a9a5bde64e8094d7a2ca09740fc9 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.035606 6456 ts_tablet_manager.cc:1434] T c462a9a5bde64e8094d7a2ca09740fc9 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:31.035646 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet bfe87e992ca04ea293e354da508e4c67 (table default.Table_4d127601ed3742d99d70e54ea6381603 [id=d300c678613c463398eb51a1fd4121f1]) successfully deleted
I20260923 19:50:31.035938 6456 tablet_bootstrap.cc:492] T 950428e098994f2a9b5b17eeb36915cd P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:31.037382 6456 tablet_bootstrap.cc:654] T 950428e098994f2a9b5b17eeb36915cd P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:31.038586 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet a0743d5ac2264af6b045af0474cbf58c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:26 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:31.038987 6458 tablet_replica.cc:333] T a0743d5ac2264af6b045af0474cbf58c P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:31.039290 6458 raft_consensus.cc:2243] T a0743d5ac2264af6b045af0474cbf58c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:31.039520 6458 raft_consensus.cc:2272] T a0743d5ac2264af6b045af0474cbf58c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:31.041369 6458 ts_tablet_manager.cc:1916] T a0743d5ac2264af6b045af0474cbf58c P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:31.050779 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet c462a9a5bde64e8094d7a2ca09740fc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:31.052714 6456 tablet_bootstrap.cc:492] T 950428e098994f2a9b5b17eeb36915cd P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:31.052871 6456 ts_tablet_manager.cc:1403] T 950428e098994f2a9b5b17eeb36915cd P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.017s user 0.009s sys 0.007s
I20260923 19:50:31.053517 6456 raft_consensus.cc:359] T 950428e098994f2a9b5b17eeb36915cd P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.053694 6456 raft_consensus.cc:385] T 950428e098994f2a9b5b17eeb36915cd P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:31.053747 6456 raft_consensus.cc:740] T 950428e098994f2a9b5b17eeb36915cd P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:31.053766 6458 ts_tablet_manager.cc:1929] T a0743d5ac2264af6b045af0474cbf58c P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:31.053992 6458 log.cc:1199] T a0743d5ac2264af6b045af0474cbf58c P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/a0743d5ac2264af6b045af0474cbf58c
I20260923 19:50:31.054059 6456 consensus_queue.cc:260] T 950428e098994f2a9b5b17eeb36915cd P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.054345 6458 ts_tablet_manager.cc:1950] T a0743d5ac2264af6b045af0474cbf58c P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:31.055959 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet a0743d5ac2264af6b045af0474cbf58c (table default.Table_b7de91eb86a441d0b48afb32ddbe99ca [id=1ea285626b994f8a83c5d1860f0c05eb]) successfully deleted
I20260923 19:50:31.056316 6458 tablet_replica.cc:333] T c462a9a5bde64e8094d7a2ca09740fc9 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:31.056622 6458 raft_consensus.cc:2243] T c462a9a5bde64e8094d7a2ca09740fc9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:31.056751 6458 raft_consensus.cc:2272] T c462a9a5bde64e8094d7a2ca09740fc9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:31.057152 6456 ts_tablet_manager.cc:1434] T 950428e098994f2a9b5b17eeb36915cd P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260923 19:50:31.057441 6456 tablet_bootstrap.cc:492] T 2ca0280d7f6d486eaded141d233e5060 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:31.058856 6456 tablet_bootstrap.cc:654] T 2ca0280d7f6d486eaded141d233e5060 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:31.059998 6458 ts_tablet_manager.cc:1916] T c462a9a5bde64e8094d7a2ca09740fc9 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:31.060319 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet 950428e098994f2a9b5b17eeb36915cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:31.071544 6458 ts_tablet_manager.cc:1929] T c462a9a5bde64e8094d7a2ca09740fc9 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:31.071743 6458 log.cc:1199] T c462a9a5bde64e8094d7a2ca09740fc9 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/c462a9a5bde64e8094d7a2ca09740fc9
I20260923 19:50:31.072077 6458 ts_tablet_manager.cc:1950] T c462a9a5bde64e8094d7a2ca09740fc9 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:31.073158 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet c462a9a5bde64e8094d7a2ca09740fc9 (table default.Table_b72aa27a80014ace84053df8c32cf34f [id=87cfaf39afaf4ad08c28a17b601de141]) successfully deleted
I20260923 19:50:31.073777 6456 tablet_bootstrap.cc:492] T 2ca0280d7f6d486eaded141d233e5060 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:31.073961 6456 ts_tablet_manager.cc:1403] T 2ca0280d7f6d486eaded141d233e5060 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.017s user 0.008s sys 0.004s
I20260923 19:50:31.074507 6456 raft_consensus.cc:359] T 2ca0280d7f6d486eaded141d233e5060 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.074667 6456 raft_consensus.cc:385] T 2ca0280d7f6d486eaded141d233e5060 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:31.074728 6456 raft_consensus.cc:740] T 2ca0280d7f6d486eaded141d233e5060 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:31.074927 6456 consensus_queue.cc:260] T 2ca0280d7f6d486eaded141d233e5060 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.075433 6456 ts_tablet_manager.cc:1434] T 2ca0280d7f6d486eaded141d233e5060 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260923 19:50:31.075986 6456 tablet_bootstrap.cc:492] T a0d817069e664199bff0d7591548e2d7 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:31.077453 6456 tablet_bootstrap.cc:654] T a0d817069e664199bff0d7591548e2d7 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:31.082592 6458 tablet_replica.cc:333] T 950428e098994f2a9b5b17eeb36915cd P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:31.082960 6458 raft_consensus.cc:2243] T 950428e098994f2a9b5b17eeb36915cd P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:31.083166 6458 raft_consensus.cc:2272] T 950428e098994f2a9b5b17eeb36915cd P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:31.083989 6458 ts_tablet_manager.cc:1916] T 950428e098994f2a9b5b17eeb36915cd P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:31.100626 6456 tablet_bootstrap.cc:492] T a0d817069e664199bff0d7591548e2d7 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:31.100844 6456 ts_tablet_manager.cc:1403] T a0d817069e664199bff0d7591548e2d7 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.025s user 0.008s sys 0.014s
I20260923 19:50:31.101645 6456 raft_consensus.cc:359] T a0d817069e664199bff0d7591548e2d7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.102078 6456 raft_consensus.cc:385] T a0d817069e664199bff0d7591548e2d7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:31.102303 6456 raft_consensus.cc:740] T a0d817069e664199bff0d7591548e2d7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:31.102377 6458 ts_tablet_manager.cc:1929] T 950428e098994f2a9b5b17eeb36915cd P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:31.102478 6458 log.cc:1199] T 950428e098994f2a9b5b17eeb36915cd P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/950428e098994f2a9b5b17eeb36915cd
I20260923 19:50:31.102646 6456 consensus_queue.cc:260] T a0d817069e664199bff0d7591548e2d7 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.102837 6458 ts_tablet_manager.cc:1950] T 950428e098994f2a9b5b17eeb36915cd P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:31.107988 6456 ts_tablet_manager.cc:1434] T a0d817069e664199bff0d7591548e2d7 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260923 19:50:31.108331 6456 tablet_bootstrap.cc:492] T 13b21aadd7464b1aa2afe7a1ebc9e77f P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:31.109652 6456 tablet_bootstrap.cc:654] T 13b21aadd7464b1aa2afe7a1ebc9e77f P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:31.112362 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 950428e098994f2a9b5b17eeb36915cd (table default.Table_1704ffca6cc6482f88bac19f06b8052c [id=3f1aee81c53343468cca15adc570c588]) successfully deleted
I20260923 19:50:31.112813 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet a0d817069e664199bff0d7591548e2d7 with delete_type TABLET_DATA_DELETED (replaced by tablet d1258abcb244430ca8456ad146aa0e67) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:31.117983 6456 tablet_bootstrap.cc:492] T 13b21aadd7464b1aa2afe7a1ebc9e77f P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:31.118145 6456 ts_tablet_manager.cc:1403] T 13b21aadd7464b1aa2afe7a1ebc9e77f P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.003s
I20260923 19:50:31.120491 6456 raft_consensus.cc:359] T 13b21aadd7464b1aa2afe7a1ebc9e77f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.120671 6456 raft_consensus.cc:385] T 13b21aadd7464b1aa2afe7a1ebc9e77f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:31.120714 6456 raft_consensus.cc:740] T 13b21aadd7464b1aa2afe7a1ebc9e77f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:31.120895 6456 consensus_queue.cc:260] T 13b21aadd7464b1aa2afe7a1ebc9e77f P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.121454 6456 ts_tablet_manager.cc:1434] T 13b21aadd7464b1aa2afe7a1ebc9e77f P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 19:50:31.121992 6456 tablet_bootstrap.cc:492] T 0697b038e1a040ec8dd525c6b43cbfb8 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:31.122164 6458 tablet_replica.cc:333] T a0d817069e664199bff0d7591548e2d7 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:31.122321 6458 raft_consensus.cc:2243] T a0d817069e664199bff0d7591548e2d7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:31.122464 6458 raft_consensus.cc:2272] T a0d817069e664199bff0d7591548e2d7 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:31.123651 6456 tablet_bootstrap.cc:654] T 0697b038e1a040ec8dd525c6b43cbfb8 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:31.129976 6458 ts_tablet_manager.cc:1916] T a0d817069e664199bff0d7591548e2d7 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:31.135540 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet 13b21aadd7464b1aa2afe7a1ebc9e77f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:20 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:31.139284 6458 ts_tablet_manager.cc:1929] T a0d817069e664199bff0d7591548e2d7 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:31.139452 6458 log.cc:1199] T a0d817069e664199bff0d7591548e2d7 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/a0d817069e664199bff0d7591548e2d7
I20260923 19:50:31.139815 6458 ts_tablet_manager.cc:1950] T a0d817069e664199bff0d7591548e2d7 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:31.141148 6458 tablet_replica.cc:333] T 13b21aadd7464b1aa2afe7a1ebc9e77f P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:31.141323 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet a0d817069e664199bff0d7591548e2d7 (table default.Table_572d17eb83634c98b68bbcfedc88603e [id=7e1215217a574debb42c752695194f6b]) successfully deleted
I20260923 19:50:31.141429 6458 raft_consensus.cc:2243] T 13b21aadd7464b1aa2afe7a1ebc9e77f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:31.141593 6458 raft_consensus.cc:2272] T 13b21aadd7464b1aa2afe7a1ebc9e77f P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:31.142613 6458 ts_tablet_manager.cc:1916] T 13b21aadd7464b1aa2afe7a1ebc9e77f P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:31.147363 6456 tablet_bootstrap.cc:492] T 0697b038e1a040ec8dd525c6b43cbfb8 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:31.147586 6456 ts_tablet_manager.cc:1403] T 0697b038e1a040ec8dd525c6b43cbfb8 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.026s user 0.014s sys 0.009s
I20260923 19:50:31.148593 6456 raft_consensus.cc:359] T 0697b038e1a040ec8dd525c6b43cbfb8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.148795 6456 raft_consensus.cc:385] T 0697b038e1a040ec8dd525c6b43cbfb8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:31.148855 6456 raft_consensus.cc:740] T 0697b038e1a040ec8dd525c6b43cbfb8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:31.149077 6456 consensus_queue.cc:260] T 0697b038e1a040ec8dd525c6b43cbfb8 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.151194 6458 ts_tablet_manager.cc:1929] T 13b21aadd7464b1aa2afe7a1ebc9e77f P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:31.151425 6458 log.cc:1199] T 13b21aadd7464b1aa2afe7a1ebc9e77f P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/13b21aadd7464b1aa2afe7a1ebc9e77f
I20260923 19:50:31.151870 6458 ts_tablet_manager.cc:1950] T 13b21aadd7464b1aa2afe7a1ebc9e77f P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:31.152619 6456 ts_tablet_manager.cc:1434] T 0697b038e1a040ec8dd525c6b43cbfb8 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
I20260923 19:50:31.156055 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 13b21aadd7464b1aa2afe7a1ebc9e77f (table default.Table_9facb802b3094c0b9bf0aeb831c771f6 [id=cb6795bdff32412fbde77d27ba38390f]) successfully deleted
I20260923 19:50:31.156153 6456 tablet_bootstrap.cc:492] T 0bf1a426b7dc489ea4d73b117a87e49b P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:31.158031 6456 tablet_bootstrap.cc:654] T 0bf1a426b7dc489ea4d73b117a87e49b P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:31.165210 6456 tablet_bootstrap.cc:492] T 0bf1a426b7dc489ea4d73b117a87e49b P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:31.165364 6456 ts_tablet_manager.cc:1403] T 0bf1a426b7dc489ea4d73b117a87e49b P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.005s
I20260923 19:50:31.166062 6456 raft_consensus.cc:359] T 0bf1a426b7dc489ea4d73b117a87e49b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.166249 6456 raft_consensus.cc:385] T 0bf1a426b7dc489ea4d73b117a87e49b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:31.166303 6456 raft_consensus.cc:740] T 0bf1a426b7dc489ea4d73b117a87e49b P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:31.166523 6456 consensus_queue.cc:260] T 0bf1a426b7dc489ea4d73b117a87e49b P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.167148 6456 ts_tablet_manager.cc:1434] T 0bf1a426b7dc489ea4d73b117a87e49b P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:31.169505 6456 tablet_bootstrap.cc:492] T 7dac9efee371479ab3547e06f0e580ad P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:31.172170 6456 tablet_bootstrap.cc:654] T 7dac9efee371479ab3547e06f0e580ad P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:31.175918 5798 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 0bf1a426b7dc489ea4d73b117a87e49b (table default.Table_1f1e14e95be64e1cbd372b6b4a741546 [id=46bda7fbcac44d6d9188884e8dfb8a3e]). Expected version 1 got 0
I20260923 19:50:31.176573 6456 tablet_bootstrap.cc:492] T 7dac9efee371479ab3547e06f0e580ad P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:31.177075 6456 ts_tablet_manager.cc:1403] T 7dac9efee371479ab3547e06f0e580ad P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260923 19:50:31.177731 6456 raft_consensus.cc:359] T 7dac9efee371479ab3547e06f0e580ad P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.177917 6456 raft_consensus.cc:385] T 7dac9efee371479ab3547e06f0e580ad P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:31.177968 6456 raft_consensus.cc:740] T 7dac9efee371479ab3547e06f0e580ad P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:31.178176 6456 consensus_queue.cc:260] T 7dac9efee371479ab3547e06f0e580ad P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.178725 6456 ts_tablet_manager.cc:1434] T 7dac9efee371479ab3547e06f0e580ad P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:31.178969 6456 tablet_bootstrap.cc:492] T b898322439694b808c9bc71817a71752 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:31.180704 6456 tablet_bootstrap.cc:654] T b898322439694b808c9bc71817a71752 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:31.183365 5798 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 0bf1a426b7dc489ea4d73b117a87e49b (table default.Table_1f1e14e95be64e1cbd372b6b4a741546 [id=46bda7fbcac44d6d9188884e8dfb8a3e]). Expected version 1 got 0
I20260923 19:50:31.190212 8253 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 83e97b26500048d0b75350a21a8ff96b)
I20260923 19:50:31.190488 8253 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" member_type: VOTER last_known_addr { host: "127.5.143.254" port: 37151 } } peers { permanent_uuid: "83e97b26500048d0b75350a21a8ff96b" member_type: VOTER last_known_addr { host: "127.5.143.253" port: 45285 } } peers { permanent_uuid: "009ffee03a4d41db84df9f450aa84562" member_type: VOTER last_known_addr { host: "127.5.143.252" port: 45543 } }
I20260923 19:50:31.191851 5814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" candidate_term: 4 candidate_status { last_received { term: 3 index: 1599 } } ignore_live_leader: false dest_uuid: "83e97b26500048d0b75350a21a8ff96b" is_pre_election: true
I20260923 19:50:31.191960 8253 leader_election.cc:290] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 83e97b26500048d0b75350a21a8ff96b (127.5.143.253:45285), 009ffee03a4d41db84df9f450aa84562 (127.5.143.252:45543)
I20260923 19:50:31.192359 6679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6b3d628214a34b4fa3ca0c1abe422bae" candidate_term: 4 candidate_status { last_received { term: 3 index: 1599 } } ignore_live_leader: false dest_uuid: "009ffee03a4d41db84df9f450aa84562" is_pre_election: true
I20260923 19:50:31.193080 7356 leader_election.cc:304] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b3d628214a34b4fa3ca0c1abe422bae; no voters: 009ffee03a4d41db84df9f450aa84562, 83e97b26500048d0b75350a21a8ff96b
I20260923 19:50:31.193467 8253 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6b3d628214a34b4fa3ca0c1abe422bae [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260923 19:50:31.195416 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet 7dac9efee371479ab3547e06f0e580ad with delete_type TABLET_DATA_DELETED (replaced by tablet bc64c9a47934420b9be3a6c8fe3ed91f) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:31.195701 6458 tablet_replica.cc:333] T 7dac9efee371479ab3547e06f0e580ad P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:31.195979 6458 raft_consensus.cc:2243] T 7dac9efee371479ab3547e06f0e580ad P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:31.196179 6458 raft_consensus.cc:2272] T 7dac9efee371479ab3547e06f0e580ad P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:31.197201 6458 ts_tablet_manager.cc:1916] T 7dac9efee371479ab3547e06f0e580ad P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:31.198549 6456 tablet_bootstrap.cc:492] T b898322439694b808c9bc71817a71752 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:31.198669 6456 ts_tablet_manager.cc:1403] T b898322439694b808c9bc71817a71752 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.020s user 0.010s sys 0.006s
I20260923 19:50:31.199339 6456 raft_consensus.cc:359] T b898322439694b808c9bc71817a71752 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.199524 6456 raft_consensus.cc:385] T b898322439694b808c9bc71817a71752 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:31.199591 6456 raft_consensus.cc:740] T b898322439694b808c9bc71817a71752 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:31.199783 6456 consensus_queue.cc:260] T b898322439694b808c9bc71817a71752 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.204489 6456 ts_tablet_manager.cc:1434] T b898322439694b808c9bc71817a71752 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260923 19:50:31.204766 6456 tablet_bootstrap.cc:492] T c1347ea7774c40548975d10f6b3cba2a P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:31.206450 6456 tablet_bootstrap.cc:654] T c1347ea7774c40548975d10f6b3cba2a P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:31.230401 6458 ts_tablet_manager.cc:1929] T 7dac9efee371479ab3547e06f0e580ad P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:31.230638 6458 log.cc:1199] T 7dac9efee371479ab3547e06f0e580ad P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/7dac9efee371479ab3547e06f0e580ad
I20260923 19:50:31.231055 6458 ts_tablet_manager.cc:1950] T 7dac9efee371479ab3547e06f0e580ad P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:31.232908 6456 tablet_bootstrap.cc:492] T c1347ea7774c40548975d10f6b3cba2a P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:31.233103 6456 ts_tablet_manager.cc:1403] T c1347ea7774c40548975d10f6b3cba2a P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.028s user 0.007s sys 0.011s
I20260923 19:50:31.233162 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 7dac9efee371479ab3547e06f0e580ad (table default.Table_333fad3a38bb4b2781e372f8991a0f34 [id=a27e465b43fb4b4f9164761377d239c7]) successfully deleted
I20260923 19:50:31.234005 6456 raft_consensus.cc:359] T c1347ea7774c40548975d10f6b3cba2a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.234251 6456 raft_consensus.cc:385] T c1347ea7774c40548975d10f6b3cba2a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:31.234335 6456 raft_consensus.cc:740] T c1347ea7774c40548975d10f6b3cba2a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:31.234578 6456 consensus_queue.cc:260] T c1347ea7774c40548975d10f6b3cba2a P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.244911 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet c1347ea7774c40548975d10f6b3cba2a with delete_type TABLET_DATA_DELETED (replaced by tablet cabd3b2034664a5893bd6b084ee064e9) from {username='slave'} at 127.0.0.1:60210
W20260923 19:50:31.249185 5792 catalog_manager.cc:5043] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): delete failed for tablet c1347ea7774c40548975d10f6b3cba2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c1347ea7774c40548975d10f6b3cba2a already in progress: creating tablet
I20260923 19:50:31.256400 6456 ts_tablet_manager.cc:1434] T c1347ea7774c40548975d10f6b3cba2a P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.023s user 0.001s sys 0.000s
I20260923 19:50:31.256495 8208 raft_consensus.cc:493] T ad29d22a82434023991ffcacf7f9bee5 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e546f660e7e541d1aa9ae38e5ee5b9c0)
I20260923 19:50:31.256620 8208 raft_consensus.cc:515] T ad29d22a82434023991ffcacf7f9bee5 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.256752 6456 tablet_bootstrap.cc:492] T 4a034eb9b02d4532b4b68e74c8e5b3fa P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:31.257153 8208 leader_election.cc:290] T ad29d22a82434023991ffcacf7f9bee5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:31.259337 6279 leader_election.cc:336] T ad29d22a82434023991ffcacf7f9bee5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: connect: Connection refused (error 111)
I20260923 19:50:31.260075 6456 tablet_bootstrap.cc:654] T 4a034eb9b02d4532b4b68e74c8e5b3fa P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:31.271602 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet c1347ea7774c40548975d10f6b3cba2a with delete_type TABLET_DATA_DELETED (replaced by tablet cabd3b2034664a5893bd6b084ee064e9) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:31.272470 6458 tablet_replica.cc:333] T c1347ea7774c40548975d10f6b3cba2a P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:31.272728 6458 raft_consensus.cc:2243] T c1347ea7774c40548975d10f6b3cba2a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:31.272948 6458 raft_consensus.cc:2272] T c1347ea7774c40548975d10f6b3cba2a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:31.273772 6458 ts_tablet_manager.cc:1916] T c1347ea7774c40548975d10f6b3cba2a P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:31.283037 6456 tablet_bootstrap.cc:492] T 4a034eb9b02d4532b4b68e74c8e5b3fa P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:31.283187 6456 ts_tablet_manager.cc:1403] T 4a034eb9b02d4532b4b68e74c8e5b3fa P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.000s
I20260923 19:50:31.283905 6456 raft_consensus.cc:359] T 4a034eb9b02d4532b4b68e74c8e5b3fa P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.284093 6456 raft_consensus.cc:385] T 4a034eb9b02d4532b4b68e74c8e5b3fa P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:31.284148 6456 raft_consensus.cc:740] T 4a034eb9b02d4532b4b68e74c8e5b3fa P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:31.284346 6456 consensus_queue.cc:260] T 4a034eb9b02d4532b4b68e74c8e5b3fa P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.284829 6456 ts_tablet_manager.cc:1434] T 4a034eb9b02d4532b4b68e74c8e5b3fa P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260923 19:50:31.285384 6456 tablet_bootstrap.cc:492] T 6761b0568fbe4bb48eec6f800f6aaf74 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:31.287099 6456 tablet_bootstrap.cc:654] T 6761b0568fbe4bb48eec6f800f6aaf74 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:31.288188 6458 ts_tablet_manager.cc:1929] T c1347ea7774c40548975d10f6b3cba2a P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:31.288347 6458 log.cc:1199] T c1347ea7774c40548975d10f6b3cba2a P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/c1347ea7774c40548975d10f6b3cba2a
I20260923 19:50:31.291885 6458 ts_tablet_manager.cc:1950] T c1347ea7774c40548975d10f6b3cba2a P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:31.298358 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet c1347ea7774c40548975d10f6b3cba2a (table default.Table_96ab135786f74ab697bb37601c264ece [id=dc6240941b87434aa6037a3f08689920]) successfully deleted
I20260923 19:50:31.301718 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet 4a034eb9b02d4532b4b68e74c8e5b3fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:17 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:31.302809 7993 raft_consensus.cc:493] T b898322439694b808c9bc71817a71752 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:31.302951 7993 raft_consensus.cc:515] T b898322439694b808c9bc71817a71752 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.303508 7993 leader_election.cc:290] T b898322439694b808c9bc71817a71752 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:31.305312 6279 leader_election.cc:336] T b898322439694b808c9bc71817a71752 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: connect: Connection refused (error 111)
I20260923 19:50:31.305970 6458 tablet_replica.cc:333] T 4a034eb9b02d4532b4b68e74c8e5b3fa P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:31.306201 6458 raft_consensus.cc:2243] T 4a034eb9b02d4532b4b68e74c8e5b3fa P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:31.306373 6458 raft_consensus.cc:2272] T 4a034eb9b02d4532b4b68e74c8e5b3fa P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:31.307467 6458 ts_tablet_manager.cc:1916] T 4a034eb9b02d4532b4b68e74c8e5b3fa P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:31.310829 6456 tablet_bootstrap.cc:492] T 6761b0568fbe4bb48eec6f800f6aaf74 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:31.311003 6456 ts_tablet_manager.cc:1403] T 6761b0568fbe4bb48eec6f800f6aaf74 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.026s user 0.011s sys 0.007s
I20260923 19:50:31.311751 6456 raft_consensus.cc:359] T 6761b0568fbe4bb48eec6f800f6aaf74 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.311992 6456 raft_consensus.cc:385] T 6761b0568fbe4bb48eec6f800f6aaf74 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:31.312088 6456 raft_consensus.cc:740] T 6761b0568fbe4bb48eec6f800f6aaf74 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:31.312400 6456 consensus_queue.cc:260] T 6761b0568fbe4bb48eec6f800f6aaf74 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.314158 6458 ts_tablet_manager.cc:1929] T 4a034eb9b02d4532b4b68e74c8e5b3fa P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:31.314255 6458 log.cc:1199] T 4a034eb9b02d4532b4b68e74c8e5b3fa P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/4a034eb9b02d4532b4b68e74c8e5b3fa
I20260923 19:50:31.314566 6458 ts_tablet_manager.cc:1950] T 4a034eb9b02d4532b4b68e74c8e5b3fa P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:31.315534 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 4a034eb9b02d4532b4b68e74c8e5b3fa (table default.Table_63a6947f3c8f4223b9f33e260bc77331 [id=89d7bede656f47bb86e54e502ffd1c33]) successfully deleted
I20260923 19:50:31.316278 6456 ts_tablet_manager.cc:1434] T 6761b0568fbe4bb48eec6f800f6aaf74 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
W20260923 19:50:31.316460 5789 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet e076b89526a24344bea591eccfdde1e9 (table default.Table_efcf236fb23d420db96e34f519589c4b [id=9a8d3decee6c4df49f5cf778e0a66777], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet e076b89526a24344bea591eccfdde1e9 consensus state has no leader
I20260923 19:50:31.320720 6456 tablet_bootstrap.cc:492] T 349c0447464d4c5380cf15cb4aeb54a4 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:31.332228 6456 tablet_bootstrap.cc:654] T 349c0447464d4c5380cf15cb4aeb54a4 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:31.332360 6200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a367cf3788ef49148a5c8d6864f71d8e" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
W20260923 19:50:31.332727 6137 leader_election.cc:336] T 85f5ba9097674f9d889e178eaea4f0d7 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 19:50:31.332859 6137 leader_election.cc:304] T 85f5ba9097674f9d889e178eaea4f0d7 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:31.333155 6199 raft_consensus.cc:3060] T a6da9b3eea4547c9bb80b08bd26c5dc2 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:31.333613 8055 raft_consensus.cc:493] T 8d20b59aa99f49f0b2f4d7dd861470f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:31.333595 6198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a4b9d48f02a4372adce6d9eb80935f6" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:31.333777 8055 raft_consensus.cc:515] T 8d20b59aa99f49f0b2f4d7dd861470f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:31.334429 8055 leader_election.cc:290] T 8d20b59aa99f49f0b2f4d7dd861470f8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:31.333628 8191 raft_consensus.cc:515] T 664d849daee54b02b7b7e2bb340d92fa P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.335157 8191 leader_election.cc:290] T 664d849daee54b02b7b7e2bb340d92fa P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:31.335279 8191 raft_consensus.cc:2749] T 85f5ba9097674f9d889e178eaea4f0d7 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:31.335564 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d20b59aa99f49f0b2f4d7dd861470f8" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:31.335950 6454 tablet_bootstrap.cc:492] T 89b950342b66486fa6ec0cdf03ad4881 P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:31.336480 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664d849daee54b02b7b7e2bb340d92fa" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:31.336642 6341 raft_consensus.cc:2468] T 664d849daee54b02b7b7e2bb340d92fa P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:31.338188 6139 leader_election.cc:304] T 664d849daee54b02b7b7e2bb340d92fa P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:31.341351 6202 raft_consensus.cc:3060] T 7f47efa0cabd47aa8ed0deface7763ab P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:31.341686 6195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12bda2ae961446bea2f34e792f4f1706" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:31.342000 6193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a6fca6d55b5493a9fb7f2e1cbf1ea29" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:31.342237 6201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16144661b56c4f858c55e8e0d3999019" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:31.343477 6185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad29d22a82434023991ffcacf7f9bee5" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:31.343637 6185 raft_consensus.cc:2468] T ad29d22a82434023991ffcacf7f9bee5 P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf41435f70447f19992d368ca6b46bd in term 1.
I20260923 19:50:31.343837 6187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b898322439694b808c9bc71817a71752" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:31.344507 6197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc47336948746d694d5a896730c501c" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:31.346042 6192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf538da9dc8c47a8a391efe4e17bb3a5" candidate_uuid: "2bf41435f70447f19992d368ca6b46bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61022dd7f2f14dc19aebe3af5f08f430" is_pre_election: true
I20260923 19:50:31.346606 8191 raft_consensus.cc:2804] T 664d849daee54b02b7b7e2bb340d92fa P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:31.346690 8191 raft_consensus.cc:493] T 664d849daee54b02b7b7e2bb340d92fa P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260923 19:50:31.347790 6280 leader_election.cc:343] T a367cf3788ef49148a5c8d6864f71d8e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:31.347955 6280 leader_election.cc:304] T a367cf3788ef49148a5c8d6864f71d8e P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:31.348410 6280 leader_election.cc:343] T 3a4b9d48f02a4372adce6d9eb80935f6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:31.348518 6280 leader_election.cc:304] T 3a4b9d48f02a4372adce6d9eb80935f6 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:31.348711 6280 raft_consensus.cc:2686] T 3a4b9d48f02a4372adce6d9eb80935f6 P 2bf41435f70447f19992d368ca6b46bd: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260923 19:50:31.349540 6280 leader_election.cc:343] T 7a6fca6d55b5493a9fb7f2e1cbf1ea29 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:31.349655 6280 leader_election.cc:304] T 7a6fca6d55b5493a9fb7f2e1cbf1ea29 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:31.350522 8208 raft_consensus.cc:2749] T a367cf3788ef49148a5c8d6864f71d8e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:31.350701 8208 raft_consensus.cc:2749] T 7a6fca6d55b5493a9fb7f2e1cbf1ea29 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:31.351740 6280 leader_election.cc:343] T 16144661b56c4f858c55e8e0d3999019 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:31.351833 6280 leader_election.cc:304] T 16144661b56c4f858c55e8e0d3999019 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
W20260923 19:50:31.351970 6280 raft_consensus.cc:2686] T 16144661b56c4f858c55e8e0d3999019 P 2bf41435f70447f19992d368ca6b46bd: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260923 19:50:31.352620 6456 tablet_bootstrap.cc:492] T 349c0447464d4c5380cf15cb4aeb54a4 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:31.352735 6456 ts_tablet_manager.cc:1403] T 349c0447464d4c5380cf15cb4aeb54a4 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.032s user 0.015s sys 0.006s
I20260923 19:50:31.353474 6456 raft_consensus.cc:359] T 349c0447464d4c5380cf15cb4aeb54a4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.353619 6456 raft_consensus.cc:385] T 349c0447464d4c5380cf15cb4aeb54a4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:31.353662 6456 raft_consensus.cc:740] T 349c0447464d4c5380cf15cb4aeb54a4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:31.353852 6456 consensus_queue.cc:260] T 349c0447464d4c5380cf15cb4aeb54a4 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.354295 6456 ts_tablet_manager.cc:1434] T 349c0447464d4c5380cf15cb4aeb54a4 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260923 19:50:31.354928 6456 tablet_bootstrap.cc:492] T 1aed1eee3d914dcab3b837bf9e7a831d P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:31.357044 6456 tablet_bootstrap.cc:654] T 1aed1eee3d914dcab3b837bf9e7a831d P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:31.346745 8191 raft_consensus.cc:3060] T 664d849daee54b02b7b7e2bb340d92fa P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:31.364850 8191 raft_consensus.cc:515] T 664d849daee54b02b7b7e2bb340d92fa P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.365746 8191 leader_election.cc:290] T 664d849daee54b02b7b7e2bb340d92fa P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Requested vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:31.346764 8055 raft_consensus.cc:493] T 195d4fe5f92e4e2c9330dce34c303723 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:31.366099 8055 raft_consensus.cc:515] T 195d4fe5f92e4e2c9330dce34c303723 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.366963 8055 leader_election.cc:290] T 195d4fe5f92e4e2c9330dce34c303723 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887), 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855)
I20260923 19:50:31.353143 6454 tablet_bootstrap.cc:654] T 89b950342b66486fa6ec0cdf03ad4881 P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:31.367916 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195d4fe5f92e4e2c9330dce34c303723" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:31.368103 6342 raft_consensus.cc:2468] T 195d4fe5f92e4e2c9330dce34c303723 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
I20260923 19:50:31.368359 6341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664d849daee54b02b7b7e2bb340d92fa" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd"
I20260923 19:50:31.368501 6341 raft_consensus.cc:3060] T 664d849daee54b02b7b7e2bb340d92fa P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:31.369015 6139 leader_election.cc:304] T 195d4fe5f92e4e2c9330dce34c303723 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:31.371827 6341 raft_consensus.cc:2468] T 664d849daee54b02b7b7e2bb340d92fa P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 1.
I20260923 19:50:31.355274 6459 ts_tablet_manager.cc:1929] T ba639d8c68cf49a49a5ec5729143cf6b P 61022dd7f2f14dc19aebe3af5f08f430: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260923 19:50:31.356770 6243 rpcz_store.cc:267] Call kudu.server.GenericService.CheckLeaks from 127.0.0.1:60136 (request call id 184) took 803 ms (client timeout 1000 ms). Trace:
I20260923 19:50:31.372216 6459 log.cc:1199] T ba639d8c68cf49a49a5ec5729143cf6b P 61022dd7f2f14dc19aebe3af5f08f430: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-1/wal/wals/ba639d8c68cf49a49a5ec5729143cf6b
W20260923 19:50:31.372243 6243 rpcz_store.cc:269] 0923 19:50:30.553131 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:30.553190 (+ 59us) service_pool.cc:224] Handling call
0923 19:50:31.356746 (+803556us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260923 19:50:31.372596 6139 leader_election.cc:304] T 664d849daee54b02b7b7e2bb340d92fa P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters:
I20260923 19:50:31.372677 6459 ts_tablet_manager.cc:1950] T ba639d8c68cf49a49a5ec5729143cf6b P 61022dd7f2f14dc19aebe3af5f08f430: Deleting consensus metadata
I20260923 19:50:31.373778 6459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60148 (request call id 1269) took 3145 ms. Trace:
I20260923 19:50:31.373921 6459 rpcz_store.cc:276] 0923 19:50:28.228108 (+ 0us) service_pool.cc:167] Inserting onto call queue
0923 19:50:28.228420 (+ 312us) service_pool.cc:224] Handling call
0923 19:50:30.473131 (+2244711us) ts_tablet_manager.cc:1151] Deleting tablet ba639d8c68cf49a49a5ec5729143cf6b
0923 19:50:30.473143 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0923 19:50:30.477180 (+ 4037us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:31.355205 (+878025us) tablet_metadata.cc:665] Metadata flushed
0923 19:50:31.373758 (+ 18553us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2244583}
I20260923 19:50:31.374185 8258 raft_consensus.cc:2804] T 195d4fe5f92e4e2c9330dce34c303723 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 19:50:31.374277 8258 raft_consensus.cc:493] T 195d4fe5f92e4e2c9330dce34c303723 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 19:50:31.374292 6459 tablet_replica.cc:333] T d35ff653bf8d41cfbcf83359402a8f6a P 61022dd7f2f14dc19aebe3af5f08f430: stopping tablet replica
I20260923 19:50:31.374351 8258 raft_consensus.cc:3060] T 195d4fe5f92e4e2c9330dce34c303723 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Advancing to term 1
I20260923 19:50:31.374470 6459 raft_consensus.cc:2243] T d35ff653bf8d41cfbcf83359402a8f6a P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:31.374612 6459 raft_consensus.cc:2272] T d35ff653bf8d41cfbcf83359402a8f6a P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:31.375139 6459 ts_tablet_manager.cc:1916] T d35ff653bf8d41cfbcf83359402a8f6a P 61022dd7f2f14dc19aebe3af5f08f430: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:31.376263 8055 raft_consensus.cc:2804] T 664d849daee54b02b7b7e2bb340d92fa P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 19:50:31.376360 8055 raft_consensus.cc:697] T 664d849daee54b02b7b7e2bb340d92fa P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 LEADER]: Becoming Leader. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Running, Role: LEADER
I20260923 19:50:31.376580 8055 consensus_queue.cc:237] T 664d849daee54b02b7b7e2bb340d92fa P 61022dd7f2f14dc19aebe3af5f08f430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:31.378244 6137 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.5.143.193:39887, user_credentials={real_user=slave}} blocked reactor thread for 812138us
W20260923 19:50:31.378408 6137 leader_election.cc:336] T f2799563250845b0b9d7d51b2367b16b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 19:50:31.378506 6137 leader_election.cc:304] T f2799563250845b0b9d7d51b2367b16b P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61022dd7f2f14dc19aebe3af5f08f430; no voters: 2bf41435f70447f19992d368ca6b46bd, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:31.377784 6280 leader_election.cc:304] T ad29d22a82434023991ffcacf7f9bee5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd, 61022dd7f2f14dc19aebe3af5f08f430; no voters: e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:31.379179 8208 raft_consensus.cc:2804] T ad29d22a82434023991ffcacf7f9bee5 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260923 19:50:31.379254 8208 raft_consensus.cc:493] T ad29d22a82434023991ffcacf7f9bee5 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting leader election (detected failure of leader e546f660e7e541d1aa9ae38e5ee5b9c0)
I20260923 19:50:31.379319 8208 raft_consensus.cc:3060] T ad29d22a82434023991ffcacf7f9bee5 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Advancing to term 2
I20260923 19:50:31.379648 6454 tablet_bootstrap.cc:492] T 89b950342b66486fa6ec0cdf03ad4881 P 61022dd7f2f14dc19aebe3af5f08f430: No bootstrap required, opened a new log
I20260923 19:50:31.379758 6454 ts_tablet_manager.cc:1403] T 89b950342b66486fa6ec0cdf03ad4881 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent bootstrapping tablet: real 0.822s user 0.003s sys 0.000s
I20260923 19:50:31.380395 6454 raft_consensus.cc:359] T 89b950342b66486fa6ec0cdf03ad4881 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.380553 6454 raft_consensus.cc:385] T 89b950342b66486fa6ec0cdf03ad4881 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:31.380594 6454 raft_consensus.cc:740] T 89b950342b66486fa6ec0cdf03ad4881 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61022dd7f2f14dc19aebe3af5f08f430, State: Initialized, Role: FOLLOWER
I20260923 19:50:31.380767 6454 consensus_queue.cc:260] T 89b950342b66486fa6ec0cdf03ad4881 P 61022dd7f2f14dc19aebe3af5f08f430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
W20260923 19:50:31.382493 6280 leader_election.cc:343] T b898322439694b808c9bc71817a71752 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:31.384042 5798 catalog_manager.cc:5938] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295) does not have the latest schema for tablet 195d4fe5f92e4e2c9330dce34c303723 (table default.Table_d42d1c583ed9482caaaf742a8a82f476 [id=57f2abae03734c489c96cda418f2bf54]). Expected version 2 got 0
I20260923 19:50:31.385259 8191 raft_consensus.cc:2749] T f2799563250845b0b9d7d51b2367b16b P 61022dd7f2f14dc19aebe3af5f08f430 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:31.386813 6280 leader_election.cc:304] T b898322439694b808c9bc71817a71752 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:31.390616 6454 ts_tablet_manager.cc:1434] T 89b950342b66486fa6ec0cdf03ad4881 P 61022dd7f2f14dc19aebe3af5f08f430: Time spent starting tablet: real 0.011s user 0.001s sys 0.005s
I20260923 19:50:31.390944 6454 tablet_bootstrap.cc:492] T 1ea8f44ac03b4ad196725f871a615cdd P 61022dd7f2f14dc19aebe3af5f08f430: Bootstrap starting.
I20260923 19:50:31.392763 6454 tablet_bootstrap.cc:654] T 1ea8f44ac03b4ad196725f871a615cdd P 61022dd7f2f14dc19aebe3af5f08f430: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:31.383589 8208 raft_consensus.cc:515] T ad29d22a82434023991ffcacf7f9bee5 P 2bf41435f70447f19992d368ca6b46bd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.394212 8208 leader_election.cc:290] T ad29d22a82434023991ffcacf7f9bee5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 2 election: Requested vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:31.395215 8191 raft_consensus.cc:493] T 3acf4a03174f45d5aee9c9b1454784f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:31.395517 8191 raft_consensus.cc:515] T 3acf4a03174f45d5aee9c9b1454784f8 P 61022dd7f2f14dc19aebe3af5f08f430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:31.396260 8191 leader_election.cc:290] T 3acf4a03174f45d5aee9c9b1454784f8 P 61022dd7f2f14dc19aebe3af5f08f430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:31.397269 5791 catalog_manager.cc:5063] TS 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): tablet ba639d8c68cf49a49a5ec5729143cf6b (table default.Table_53cf6ab2721c4d7baa36065c8d48ffc1 [id=d4cdad465f1a405e8723d0dcb01e0508]) successfully deleted
I20260923 19:50:31.397339 5695 external_mini_cluster.cc:1664] Killing /tmp/dist-test-task5JtCX2/build/asan/bin/kudu with pid 6115
I20260923 19:50:31.396783 6342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3acf4a03174f45d5aee9c9b1454784f8" candidate_uuid: "61022dd7f2f14dc19aebe3af5f08f430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf41435f70447f19992d368ca6b46bd" is_pre_election: true
I20260923 19:50:31.398586 6342 raft_consensus.cc:2468] T 3acf4a03174f45d5aee9c9b1454784f8 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61022dd7f2f14dc19aebe3af5f08f430 in term 0.
W20260923 19:50:31.396932 6279 leader_election.cc:336] T ad29d22a82434023991ffcacf7f9bee5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: connect: Connection refused (error 111)
I20260923 19:50:31.397292 7993 raft_consensus.cc:2749] T b898322439694b808c9bc71817a71752 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:31.400158 6280 leader_election.cc:343] T 12bda2ae961446bea2f34e792f4f1706 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:31.400333 6280 leader_election.cc:304] T 12bda2ae961446bea2f34e792f4f1706 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:31.400848 7993 raft_consensus.cc:2749] T 12bda2ae961446bea2f34e792f4f1706 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:31.400869 6280 leader_election.cc:343] T 2bc47336948746d694d5a896730c501c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:31.400976 6280 leader_election.cc:304] T 2bc47336948746d694d5a896730c501c P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:31.401157 7993 raft_consensus.cc:2749] T 2bc47336948746d694d5a896730c501c P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 19:50:31.401527 6280 leader_election.cc:343] T cf538da9dc8c47a8a391efe4e17bb3a5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295): Illegal state: must be running to vote when last-logged opid is not known
I20260923 19:50:31.401615 6280 leader_election.cc:304] T cf538da9dc8c47a8a391efe4e17bb3a5 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf41435f70447f19992d368ca6b46bd; no voters: 61022dd7f2f14dc19aebe3af5f08f430, e546f660e7e541d1aa9ae38e5ee5b9c0
I20260923 19:50:31.401808 8243 raft_consensus.cc:2749] T cf538da9dc8c47a8a391efe4e17bb3a5 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 19:50:31.411099 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet 349c0447464d4c5380cf15cb4aeb54a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:14 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:31.411377 6458 tablet_replica.cc:333] T 349c0447464d4c5380cf15cb4aeb54a4 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:31.411598 6458 raft_consensus.cc:2243] T 349c0447464d4c5380cf15cb4aeb54a4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:31.411756 6458 raft_consensus.cc:2272] T 349c0447464d4c5380cf15cb4aeb54a4 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:31.412626 6458 ts_tablet_manager.cc:1916] T 349c0447464d4c5380cf15cb4aeb54a4 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:31.412753 6456 tablet_bootstrap.cc:492] T 1aed1eee3d914dcab3b837bf9e7a831d P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:31.412885 6456 ts_tablet_manager.cc:1403] T 1aed1eee3d914dcab3b837bf9e7a831d P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.058s user 0.000s sys 0.012s
I20260923 19:50:31.413621 6456 raft_consensus.cc:359] T 1aed1eee3d914dcab3b837bf9e7a831d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.413784 6456 raft_consensus.cc:385] T 1aed1eee3d914dcab3b837bf9e7a831d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:31.413838 6456 raft_consensus.cc:740] T 1aed1eee3d914dcab3b837bf9e7a831d P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:31.414062 6456 consensus_queue.cc:260] T 1aed1eee3d914dcab3b837bf9e7a831d P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.414568 6456 ts_tablet_manager.cc:1434] T 1aed1eee3d914dcab3b837bf9e7a831d P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:31.419842 6458 ts_tablet_manager.cc:1929] T 349c0447464d4c5380cf15cb4aeb54a4 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:31.419888 5798 catalog_manager.cc:5938] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855) does not have the latest schema for tablet 1aed1eee3d914dcab3b837bf9e7a831d (table default.Table_3091843faf2b445294c246ab74246b26 [id=a9d80c0da2e241b392d5306228ecc7f8]). Expected version 1 got 0
I20260923 19:50:31.419968 6458 log.cc:1199] T 349c0447464d4c5380cf15cb4aeb54a4 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/349c0447464d4c5380cf15cb4aeb54a4
I20260923 19:50:31.420331 6458 ts_tablet_manager.cc:1950] T 349c0447464d4c5380cf15cb4aeb54a4 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:31.420698 6456 tablet_bootstrap.cc:492] T 6c33a99f88a9401fa296c4fefb8bcfc1 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:31.426525 6456 tablet_bootstrap.cc:654] T 6c33a99f88a9401fa296c4fefb8bcfc1 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:31.432621 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 349c0447464d4c5380cf15cb4aeb54a4 (table default.Table_ab5bcf93ffdc4e0f99d62c9d56cb1447 [id=af68de300f184a85bc90e1bcd3b5e69a]) successfully deleted
I20260923 19:50:31.433008 6456 tablet_bootstrap.cc:492] T 6c33a99f88a9401fa296c4fefb8bcfc1 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:31.433130 6456 ts_tablet_manager.cc:1403] T 6c33a99f88a9401fa296c4fefb8bcfc1 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.003s
I20260923 19:50:31.433893 6456 raft_consensus.cc:359] T 6c33a99f88a9401fa296c4fefb8bcfc1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.434051 6456 raft_consensus.cc:385] T 6c33a99f88a9401fa296c4fefb8bcfc1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:31.434094 6456 raft_consensus.cc:740] T 6c33a99f88a9401fa296c4fefb8bcfc1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:31.434271 6456 consensus_queue.cc:260] T 6c33a99f88a9401fa296c4fefb8bcfc1 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.434798 6456 ts_tablet_manager.cc:1434] T 6c33a99f88a9401fa296c4fefb8bcfc1 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260923 19:50:31.435461 6456 tablet_bootstrap.cc:492] T 900726a4f2f84dde90e8bb3ab26b71c9 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:31.437276 6456 tablet_bootstrap.cc:654] T 900726a4f2f84dde90e8bb3ab26b71c9 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:31.442965 8208 raft_consensus.cc:493] T a10110f4a2b34b61a4cc586d65981606 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e546f660e7e541d1aa9ae38e5ee5b9c0)
I20260923 19:50:31.443116 8208 raft_consensus.cc:515] T a10110f4a2b34b61a4cc586d65981606 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.443706 8208 leader_election.cc:290] T a10110f4a2b34b61a4cc586d65981606 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:31.445561 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c33a99f88a9401fa296c4fefb8bcfc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:31.445768 6458 tablet_replica.cc:333] T 6c33a99f88a9401fa296c4fefb8bcfc1 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:31.445990 6458 raft_consensus.cc:2243] T 6c33a99f88a9401fa296c4fefb8bcfc1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:31.446143 6458 raft_consensus.cc:2272] T 6c33a99f88a9401fa296c4fefb8bcfc1 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
W20260923 19:50:31.446130 6279 leader_election.cc:336] T a10110f4a2b34b61a4cc586d65981606 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: connect: Connection refused (error 111)
I20260923 19:50:31.446916 6458 ts_tablet_manager.cc:1916] T 6c33a99f88a9401fa296c4fefb8bcfc1 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:31.452548 8208 raft_consensus.cc:493] T 2ca0280d7f6d486eaded141d233e5060 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:31.452688 8208 raft_consensus.cc:515] T 2ca0280d7f6d486eaded141d233e5060 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.453271 8208 leader_election.cc:290] T 2ca0280d7f6d486eaded141d233e5060 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:31.453418 6458 ts_tablet_manager.cc:1929] T 6c33a99f88a9401fa296c4fefb8bcfc1 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:31.453510 6458 log.cc:1199] T 6c33a99f88a9401fa296c4fefb8bcfc1 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/6c33a99f88a9401fa296c4fefb8bcfc1
W20260923 19:50:31.455463 6279 leader_election.cc:336] T 2ca0280d7f6d486eaded141d233e5060 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: connect: Connection refused (error 111)
I20260923 19:50:31.453841 6458 ts_tablet_manager.cc:1950] T 6c33a99f88a9401fa296c4fefb8bcfc1 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:31.458431 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 6c33a99f88a9401fa296c4fefb8bcfc1 (table default.Table_0e8b64b05f104a458762900a86b66629 [id=d739d5b9249a4d9c91b883f4a81da8af]) successfully deleted
I20260923 19:50:31.459584 6456 tablet_bootstrap.cc:492] T 900726a4f2f84dde90e8bb3ab26b71c9 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:31.459769 6456 ts_tablet_manager.cc:1403] T 900726a4f2f84dde90e8bb3ab26b71c9 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.006s
I20260923 19:50:31.461063 6456 raft_consensus.cc:359] T 900726a4f2f84dde90e8bb3ab26b71c9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.461313 6456 raft_consensus.cc:385] T 900726a4f2f84dde90e8bb3ab26b71c9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:31.461410 6456 raft_consensus.cc:740] T 900726a4f2f84dde90e8bb3ab26b71c9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:31.461637 8208 raft_consensus.cc:493] T 35f46a1be80c4194b592c5d00fe1f342 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e546f660e7e541d1aa9ae38e5ee5b9c0)
I20260923 19:50:31.461737 8208 raft_consensus.cc:515] T 35f46a1be80c4194b592c5d00fe1f342 P 2bf41435f70447f19992d368ca6b46bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.461954 6456 consensus_queue.cc:260] T 900726a4f2f84dde90e8bb3ab26b71c9 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.462368 8208 leader_election.cc:290] T 35f46a1be80c4194b592c5d00fe1f342 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
I20260923 19:50:31.462553 6456 ts_tablet_manager.cc:1434] T 900726a4f2f84dde90e8bb3ab26b71c9 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260923 19:50:31.462936 6456 tablet_bootstrap.cc:492] T ec5793bdec5244aa8cf13b7fb3b84b8a P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
W20260923 19:50:31.466460 6279 leader_election.cc:336] T 35f46a1be80c4194b592c5d00fe1f342 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: connect: Connection refused (error 111)
I20260923 19:50:31.473927 8208 raft_consensus.cc:493] T 900726a4f2f84dde90e8bb3ab26b71c9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:31.474092 8208 raft_consensus.cc:515] T 900726a4f2f84dde90e8bb3ab26b71c9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.474684 8208 leader_election.cc:290] T 900726a4f2f84dde90e8bb3ab26b71c9 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:31.476361 6279 leader_election.cc:336] T 900726a4f2f84dde90e8bb3ab26b71c9 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: connect: Connection refused (error 111)
I20260923 19:50:31.477918 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet 900726a4f2f84dde90e8bb3ab26b71c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:15 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:31.479688 6458 tablet_replica.cc:333] T 900726a4f2f84dde90e8bb3ab26b71c9 P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:31.479907 6458 raft_consensus.cc:2243] T 900726a4f2f84dde90e8bb3ab26b71c9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:31.480058 6458 raft_consensus.cc:2272] T 900726a4f2f84dde90e8bb3ab26b71c9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:31.480831 6458 ts_tablet_manager.cc:1916] T 900726a4f2f84dde90e8bb3ab26b71c9 P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:31.482542 6456 tablet_bootstrap.cc:654] T ec5793bdec5244aa8cf13b7fb3b84b8a P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:31.489486 6456 tablet_bootstrap.cc:492] T ec5793bdec5244aa8cf13b7fb3b84b8a P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:31.489660 6456 ts_tablet_manager.cc:1403] T ec5793bdec5244aa8cf13b7fb3b84b8a P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.006s
I20260923 19:50:31.490343 6456 raft_consensus.cc:359] T ec5793bdec5244aa8cf13b7fb3b84b8a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.490509 6456 raft_consensus.cc:385] T ec5793bdec5244aa8cf13b7fb3b84b8a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:31.490566 6456 raft_consensus.cc:740] T ec5793bdec5244aa8cf13b7fb3b84b8a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:31.490772 6456 consensus_queue.cc:260] T ec5793bdec5244aa8cf13b7fb3b84b8a P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.491285 6458 ts_tablet_manager.cc:1929] T 900726a4f2f84dde90e8bb3ab26b71c9 P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:31.491415 6458 log.cc:1199] T 900726a4f2f84dde90e8bb3ab26b71c9 P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/900726a4f2f84dde90e8bb3ab26b71c9
I20260923 19:50:31.491729 6458 ts_tablet_manager.cc:1950] T 900726a4f2f84dde90e8bb3ab26b71c9 P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:31.491300 6456 ts_tablet_manager.cc:1434] T ec5793bdec5244aa8cf13b7fb3b84b8a P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 19:50:31.494405 5792 catalog_manager.cc:5063] TS 2bf41435f70447f19992d368ca6b46bd (127.5.143.195:32855): tablet 900726a4f2f84dde90e8bb3ab26b71c9 (table default.Table_2117af45b89a4af2a58df762cb072590 [id=6ecf0fc802d2487bbfc8876815b3bf2b]) successfully deleted
I20260923 19:50:31.494958 6456 tablet_bootstrap.cc:492] T 4935c06f29cf4c729946f35829dfdf92 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:31.496901 6456 tablet_bootstrap.cc:654] T 4935c06f29cf4c729946f35829dfdf92 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:31.498456 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet ec5793bdec5244aa8cf13b7fb3b84b8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:17 UTC) from {username='slave'} at 127.0.0.1:60210
I20260923 19:50:31.501144 6458 tablet_replica.cc:333] T ec5793bdec5244aa8cf13b7fb3b84b8a P 2bf41435f70447f19992d368ca6b46bd: stopping tablet replica
I20260923 19:50:31.501358 6458 raft_consensus.cc:2243] T ec5793bdec5244aa8cf13b7fb3b84b8a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus shutting down.
I20260923 19:50:31.501518 6458 raft_consensus.cc:2272] T ec5793bdec5244aa8cf13b7fb3b84b8a P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Raft consensus is shut down!
I20260923 19:50:31.502292 6458 ts_tablet_manager.cc:1916] T ec5793bdec5244aa8cf13b7fb3b84b8a P 2bf41435f70447f19992d368ca6b46bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 19:50:31.507022 6456 tablet_bootstrap.cc:492] T 4935c06f29cf4c729946f35829dfdf92 P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:31.507157 6456 ts_tablet_manager.cc:1403] T 4935c06f29cf4c729946f35829dfdf92 P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.001s
I20260923 19:50:31.507982 6456 raft_consensus.cc:359] T 4935c06f29cf4c729946f35829dfdf92 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.508148 6456 raft_consensus.cc:385] T 4935c06f29cf4c729946f35829dfdf92 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:31.508200 6456 raft_consensus.cc:740] T 4935c06f29cf4c729946f35829dfdf92 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:31.508430 6456 consensus_queue.cc:260] T 4935c06f29cf4c729946f35829dfdf92 P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.508924 6456 ts_tablet_manager.cc:1434] T 4935c06f29cf4c729946f35829dfdf92 P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260923 19:50:31.509240 6456 tablet_bootstrap.cc:492] T 39261cedbdb54d1f8ae0e07ae1cfeb3e P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:31.511262 6456 tablet_bootstrap.cc:654] T 39261cedbdb54d1f8ae0e07ae1cfeb3e P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:31.523013 6456 tablet_bootstrap.cc:492] T 39261cedbdb54d1f8ae0e07ae1cfeb3e P 2bf41435f70447f19992d368ca6b46bd: No bootstrap required, opened a new log
I20260923 19:50:31.523171 6456 ts_tablet_manager.cc:1403] T 39261cedbdb54d1f8ae0e07ae1cfeb3e P 2bf41435f70447f19992d368ca6b46bd: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.006s
I20260923 19:50:31.524071 8208 raft_consensus.cc:493] T 7d654b14cafa453185179fe57a25e2d9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 19:50:31.524012 6456 raft_consensus.cc:359] T 39261cedbdb54d1f8ae0e07ae1cfeb3e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.524194 6456 raft_consensus.cc:385] T 39261cedbdb54d1f8ae0e07ae1cfeb3e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 19:50:31.524252 6456 raft_consensus.cc:740] T 39261cedbdb54d1f8ae0e07ae1cfeb3e P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf41435f70447f19992d368ca6b46bd, State: Initialized, Role: FOLLOWER
I20260923 19:50:31.524221 8208 raft_consensus.cc:515] T 7d654b14cafa453185179fe57a25e2d9 P 2bf41435f70447f19992d368ca6b46bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } }
I20260923 19:50:31.524734 8208 leader_election.cc:290] T 7d654b14cafa453185179fe57a25e2d9 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61022dd7f2f14dc19aebe3af5f08f430 (127.5.143.194:35295), e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887)
W20260923 19:50:31.527323 6279 leader_election.cc:336] T 7d654b14cafa453185179fe57a25e2d9 P 2bf41435f70447f19992d368ca6b46bd [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer e546f660e7e541d1aa9ae38e5ee5b9c0 (127.5.143.193:39887): Network error: Client connection negotiation failed: client connection to 127.5.143.193:39887: connect: Connection refused (error 111)
I20260923 19:50:31.527562 6456 consensus_queue.cc:260] T 39261cedbdb54d1f8ae0e07ae1cfeb3e P 2bf41435f70447f19992d368ca6b46bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61022dd7f2f14dc19aebe3af5f08f430" member_type: VOTER last_known_addr { host: "127.5.143.194" port: 35295 } } peers { permanent_uuid: "e546f660e7e541d1aa9ae38e5ee5b9c0" member_type: VOTER last_known_addr { host: "127.5.143.193" port: 39887 } } peers { permanent_uuid: "2bf41435f70447f19992d368ca6b46bd" member_type: VOTER last_known_addr { host: "127.5.143.195" port: 32855 } }
I20260923 19:50:31.528229 6456 ts_tablet_manager.cc:1434] T 39261cedbdb54d1f8ae0e07ae1cfeb3e P 2bf41435f70447f19992d368ca6b46bd: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260923 19:50:31.528503 6456 tablet_bootstrap.cc:492] T b0534795317747b28bef09df8a1c7244 P 2bf41435f70447f19992d368ca6b46bd: Bootstrap starting.
I20260923 19:50:31.529398 6458 ts_tablet_manager.cc:1929] T ec5793bdec5244aa8cf13b7fb3b84b8a P 2bf41435f70447f19992d368ca6b46bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260923 19:50:31.529488 6458 log.cc:1199] T ec5793bdec5244aa8cf13b7fb3b84b8a P 2bf41435f70447f19992d368ca6b46bd: Deleting WAL directory at /tmp/dist-test-task5JtCX2/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790192993707481-5695-0/minicluster-data/ts-2/wal/wals/ec5793bdec5244aa8cf13b7fb3b84b8a
I20260923 19:50:31.529748 6458 ts_tablet_manager.cc:1950] T ec5793bdec5244aa8cf13b7fb3b84b8a P 2bf41435f70447f19992d368ca6b46bd: Deleting consensus metadata
I20260923 19:50:31.530392 6456 tablet_bootstrap.cc:654] T b0534795317747b28bef09df8a1c7244 P 2bf41435f70447f19992d368ca6b46bd: Neither blocks nor log segments found. Creating new log.
I20260923 19:50:31.530529 6312 tablet_service.cc:1558] Processing DeleteTablet for tablet 4935c06f29cf4c729946f35829dfdf92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 19:50:18 UTC) from {username='slave'